Twitter Fail Whale may be taking a vacation. Twitter with it’s new Java Server called Blender will make searches three times faster. Spikes in traffic such as when the Japan earthquake happened will be fewer. That will be a sign of relief for millions of Tweeples which serve more than 1 billion queries per day.
The change has reduced search latencies by approximately three times (from 800ms to 250ms), Twitter claims, and CPU load on Twitter’s front-end servers was cut in half.
Twitter illustrates the advantages of the new search architecture with the recent spike in search queries after the Tōhoku earthquake and tsunami hit Japan on March 11, which significantly increased search latencies. After the deployment of Blender, average search latency dropped to slightly more than 225ms and remained stable ever since.