Twitter developer announces advanced people search upgrades ahead of SXSW2010

Announcement via Twitter

Alex Payne, a developer @Twitter announced today via tweet that work has been completed on a project to enhance the scalability, resiliency and quality of people search results at Twitter. While the engineer tried to downplay the announcement, the impact could be huge for how people find each other on Twitter. I’m going on a hunch, but I am betting that Twitter made the changes in advance of a looming swarm or location-crazed socialites that will be descnding upon Austin TX in just a few days.

SXSW is coming up. Twitter counting on not going down

Sidestepping all the hype surrounding the upcoming festival, most, if not all the attendees are avid Twitter users following hundreds and thousands of other users. What do twitter users do when they drink? Well, besides have sex? They tweet. And tweet. And look up followers. And tweet. The tweeting alone has been known to bring the service down before (hello @FailWhale!) but what about people search? I asked the developers and engineers and have not had a comment back yet, but I would wager again that if it is a priority at Twitter, it has to do with reliability and uptime. These guys are serious about it now.

Web app scalability experts

If you don’t run in global web domination circles, you’re unaware thatAlex Payne (who also caught some heat for a cryptic tweet that could mean HUGE things for the Twitter.com web interface) is also the author of Programming Scala (O’Reilly):

With this book, you’ll discover why Scala is ideal for highly scalable, component-based applications that support concurrency and distribution.

Six months in the making, the upgrades are all behind the scenes according to Evan Weaver, infrastructure team manager for Twitter:

@joelgibby The changes are all behind the scenes. It’s been like a six-month project, I think. We are very proud.

Alex shared that he had been working with Steve Jenson on the project for some time and that the:

Thing I’ve been working on with @stevej for a while is now out to 100% of users: highly scalable, slightly better quality people search!

He also shared:

Lots of room for improvement in people search quality, but our main goal of making it hella shared/replicated was accomplished with GUSTO.

Indeed.

Social information sharing – better than a press release?

Twitter has been vibing quite hard on it’s own sidechannels with no doubt triple-vetted tweets from developers hinting at upcoming features along with announcements of enhancements to twitter profiles and some new partnerships. This post was different though, because he announced that it is fully rolled out now. Before making his announcement, he retweeted @evan (Evan Weaver, infrastructure team manager @Twitter), who said “scalable people search is scalable.” We sure hope so.

Scaling to keep pace with realtime

Building scalable infrastructure is key in Twitter keeping the talking stick  in the realtime web conversation.  As social sites like Twitter grow by the thousands and millions of users uptime becomes increasingly critical as those users begin to rely on the service for everyday convenience connections like meeting friends for drinks or getting advice on local food carts, or for gathering life-saving information (via Mashable) on friends or family who may be in harm’s way. Remember the June 2009 Iranian Election? The US State Department suggested that Twitter perform routine maintenance such that Twitter would only briefly be down during the middle of the night, Iranian time. This is not just some web2.0 toy or for teens any longer. It’s a core web service, like Google Search, Reddit or Digg. Sidenote: Reddit and Digg have been tremendous community forces of good in their own right, with Reddit and Digg users together raising over $185,000 in 12 hours for Haiti relief efforts.

Dynamic development team

After this post was published, @stevej informs me that only the three mentioned in the post were responsible for the site changes, though “frontend-type folks are ofter working on that page, though.” Thanks, Steve!
I was not able to find out if the only developers responsible were just the three mentioning it on Twitter, but whether 3 or 300, Twitter really has some talented people working for them. Just check out their blogs for evidence. These are some of the brightest folks the web has to offer. As Twitter continues to open up to the web at large with announcements going out via Twitter employees rather than traditional press releases, expect to see excitement about new features and realtime developments in the unfolding Twitter story and its players.