Tumblr: Hashing Your Way to Handling 23,000 Blog Requests per Second - High Scalability -
This is a guest post by Michael Schenck, SRE Staff Engineer at Tumblr. At Tumblr, blogs (or Tumblelog) are one of our most highly trafficked faces on the internet. One of the most convenient aspects of tumblelogs is their highly cacheable nature, which is fantastic because of the high views/post ratio the Tumblr network offers our users. That said, it's not entirely trivial to scale out the peri
How WhatsApp Grew to Nearly 500 Million Users, 11,000 cores, and 70 Million Messages a Second - High Scalability -
When we last visited WhatsApp they’d just been acquired by Facebook for $19 billion. We learned about their early architecture, which centered around a maniacal focus on optimizing Erlang into handling 2 million connections a server, working on All The Phones, and making users happy through simplicity. Two years later traffic has grown 10x. How did WhatsApp make that jump to the next level of scal
New Relic Architecture - Collecting 20+ Billion Metrics a Day - High Scalability -
This is a guest post by Brian Doll, Application Performance Engineer at New Relic. New Relic’s multitenant, SaaS web application monitoring service collects and persists over 100,000 metrics every second on a sustained basis, while still delivering an average page load time of 1.5 seconds. We believe that good architecture and good tools can help you handle an extremely large amount of data while
Here's a 1300 Year Old Solution to Resilience - Rebuild, Rebuild, Rebuild - High Scalability -
How is it possible that a wooden Shinto shrine built in the 7th century is still standing? The answer depends on how you answer this philosophical head scratcher: With nearly every cell in your body continually being replaced, are you still the same person? The Ise Grand Shrine has been in continuous existence for over 1300 years because every twenty years an exact replica has been rebuilt on an a
How Disqus Went Realtime with 165K Messages Per Second and Less than .2 Seconds Latency - High Scalability -
Here's an Update On Disqus: It's Still About Realtime, But Go Demolishes Python. How do you add realtime functionality to a web scale application? That's what Adam Hitchcock, a Software Engineer at Disqus talks about in an excellent talk: Making DISQUS Realtime (slides). Disqus had to take their commenting system and add realtime capabilities to it. Not something that's easy to do when at the time
How HipChat Stores and Indexes Billions of Messages Using ElasticSearch and Redis - High Scalability -
« Sponsored Post: Netflix, Logentries, Host Color, Booking, Apple, ScaleOut, MongoDB, BlueStripe, AiScaler, Aerospike, LogicMonitor, AppDynamics, ManageEngine, Site24x7 | Main | Stuff The Internet Says On Scalability For January 3rd, 2014 » This article is from an interview with Zuhaib Siddique, a production engineer at HipChat, makers of group chat and IM for teams. HipChat started in an unusual
How Twitter Improved JVM Performance by Reducing GC and Faster Memory Allocation - High Scalability -
Netty is a high-performance NIO (New IO) client server framework for Java that Twitter uses internally as a protocol agonostic RPC system. Twitter found some problems with Netty 3's memory management for buffer allocations beacause it generated a lot of garbage during operation. When you send as many messages as Twitter it creates a lot of GC pressure and the simple act of zero filling newly alloc
The Architecture Twitter Uses to Deal with 150M Active Users, 300K QPS, a 22 MB/S Firehose, and Send Tweets in Under 5 Seconds - High Scalability -
Toy solutions solving Twitter’s “problems” are a favorite scalability trope. Everybody has this idea that Twitter is easy. With a little architectural hand waving we have a scalable Twitter, just that simple. Well, it’s not that simple as Raffi Krikorian, VP of Engineering at Twitter, describes in his superb and very detailed presentation on Timelines at Scale. If you want to know how Twitter work
NoSQL Style - A Gangnam Style Parody - High Scalability -
Listen up all you IT people...NoSQL, it's the rage now, so turn the page now and boost your stack...Hey, mighty people...Go, go, go, hey, hey, hey, hey, hey, hey...Go NoSQL style... I for one feel both edified and entertained...can't wait for the Harlem Shake version. Kafka 101 This is a guest article by Stanislav Kozlovski, an Apache Kafka Committer. If you would like to connect with Stanislav, y
DuckDuckGo Architecture - 1 Million Deep Searches a Day and Growing - High Scalability -
« Better Browser Caching is More Important than No Javascript or Fast Networks for HTTP Performance | Main | Stuff The Internet Says On Scalability For January 25, 2013 » This is an interview with Gabriel Weinberg, founder of Duck Duck Go and general all around startup guru, on what DDG’s architecture looks like in 2012. Innovative search engine upstart DuckDuckGo had 30 million searches in Februa
WordPress.com Serves 70,000 req/sec and over 15 Gbit/sec of Traffic using NGINX - High Scalability -
This is a guest post by Barry Abrahamson, Chief Systems Wrangler at Automattic, and Nginx's Coufounder Andrew Alexeev. WordPress.com serves more than 33 million sites attracting over 339 million people and 3.4 billion pages each month. Since April 2008, WordPress.com has experienced about 4.4 times growth in page views. WordPress.com VIP hosts many popular sites including CNN’s Political Ticker, N
Google Spanner's Most Surprising Revelation: NoSQL is Out and NewSQL is In - High Scalability -
Google recently released a paper on Spanner, their planet enveloping tool for organizing the world’s monetizable information. Reading the Spanner paper I felt it had that chiseled in stone feel that all of Google’s best papers have. An instant classic. Jeff Dean foreshadowed Spanner’s humungousness as early as 2009. Now Spanner seems fully online, just waiting to handle “millions of machines acro
Pinterest Architecture Update - 18 Million Visitors, 10x Growth,12 Employees, 410 TB of Data - High Scalability -
« Sponsored Post: Torbit, Infragistics, Velocity, Reality Check Network, Gigaspaces, AiCache, Logic Monitor, Attribution Modeling, New Relic, AppDynamics, CloudSigma, ManageEnine, Site24x7 | Main | Stuff The Internet Says On Scalability For May 18, 2012 » There has been an update on Pinterest: Pinterest growth driven by Amazon cloud scalability since our last post: A Short on the Pinterest Stack f
7 Years of YouTube Scalability Lessons in 30 Minutes
« Sponsored Post: Gigaspaces, Nokia, Oracle, Percona Live, AiCache, ElasticHosts, Logic Monitor, Attribution Modeling, New Relic, AppDynamics, CloudSigma, ManageEngine, Site24x | Main | Stuff The Internet Says On Scalability For March 23, 2012 » If you started out building a dating site and instead ended up building a video sharing site (YouTube) that handles 4 billion views a day, then it’s just
Tumblr Architecture - 15 Billion Page Views a Month and Harder to Scale than Twitter - High Scalability -
With over 15 billion page views a month Tumblr has become an insanely popular blogging platform. Users may like Tumblr for its simplicity, its beauty, its strong focus on user experience, or its friendly and engaged community, but like it they do. Growing at over 30% a month has not been without challenges. Some reliability problems among them. It helps to realize that Tumblr operates at surprisin
11 Common Web Use Cases Solved in Redis - High Scalability -
« Myth: Google Uses Server Farms So You Should Too - Resurrection of the Big-Ass Machines | Main | Sponsored Post: TripAdvisor, eHarmony, NoSQL Now!, Surge, BioWare, Tungsten, deviantART, Aconex, Hadapt, Mathworks, AppDynamics, ScaleOut, Membase, CloudSigma, ManageEngine, Site24x7 » In How to take advantage of Redis just adding it to your stack Salvatore 'antirez' Sanfilippo shows how to solve som
Stack Overflow Makes Slow Pages 100x Faster by Simple SQL Tuning - High Scalability -
The most common complaint against NoSQL is that if you know how to write good SQL queries then SQL works fine. If SQL is slow you can always tune it and make it faster. A great example of this incremental improvement process was written up by StackExchange's Sam Saffron, in A day in the life of a slow page at Stack Overflow, where he shows through profiling and SQL tuning it was possible to reduce
Numbers Everyone Should Know - High Scalability -
Google AppEngine Numbers This group of numbers is from Brett Slatkin in Building Scalable Web Apps with Google App Engine. Writes are expensive! Datastore is transactional: writes require disk access Disk access means disk seeks Rule of thumb: 10ms for a disk seek Simple math: 1s / 10ms = 100 seeks/sec maximum Depends on: * The size and shape of your data * Doing work in batches (batch puts and ge
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Google Finds: Centralized Control, Distributed Data Architectures Work Better than Fully Decentralized Architectures - High Scalability -
Iron.io Moved From Ruby to Go: 28 Servers Cut and Colossal Clusterf**ks Prevented - High Scalability -