The Four Innovation Phases of Netflix’s Trillions Scale Real-time Data Infrastructure
My name is Zhenzhong Xu. I joined Netflix in 2015 as a founding engineer on the Real-time Data Infrastructure team and later led the Stream Processing Engines team. I developed an interest in real-time data in the early 2010s, and ever since believe there is much value yet to be uncovered. Netflix was a fantastic place to be surrounded by many amazing colleagues. I can’t be more proud of everyone
EngineeringUpgrading GitHub.com to MySQL 8.0GitHub uses MySQL to store vast amounts of relational data. This is the story of how we seamlessly upgraded our production fleet to MySQL 8.0. Over 15 years ago, GitHub started as a Ruby on Rails application with a single MySQL database. Since then, GitHub has evolved its MySQL architecture to meet the scaling and resiliency needs of the platform—includi
How Netflix Scales its API with GraphQL Federation (Part 2)
In our previous post and QConPlus talk, we discussed GraphQL Federation as a solution for distributing our GraphQL schema and implementation. In this post, we shift our attention to what is needed to run a federated GraphQL platform successfully — from our journey implementing it to lessons learned. Our Journey so FarOver the past year, we’ve implemented the core infrastructure pieces necessary fo
Debugging Incidents in Google’s Distributed Systems - ACM Queue
June 6, 2020 Volume 18, issue 2 PDF Debugging Incidents in Google's Distributed Systems How experts debug production issues in complex distributed systems Charisma Chan and Beth Cooper Google has published two books about SRE (Site Reliability Engineering) principles, best practices, and practical applications.1,2 In the heat of the moment when handling a production incident, however, a team's act
And open a browser at localhost:3000. Features# Our demo version has a few neat features! Postgres 14.5, psql, pg_dump, etc. Save & restore state to/from a file. Save & restore Postgres state to/from the browser storage (IndexedDB). Quick start from a state file or fully reboot the emulator. Memory configuration options from 128MB to 1024MB. Adjust the font size for the terminal. Upload files to t
Introducing Terramate — An Orchestrator and Code Generator for Terraform
Today, after months of hard work, we’re proud, ecstatic, and numerous other adjectives, to introduce a new tool Terramate to the open-source and Terraform community. In this blog post, we will explain what Terramate is and why we decided to build it and why our clients love it. If instead, you’d like to see some comprehensive examples that explain how to use Terramate in detail, please take a look
Historical expertise provided by Jerry Beck, Amelia Cook, Jason DeMarco, Maureen Furniss, Monique Henry-Hudson, Willow Catelyn Maclay, Linda Simensky, Koji Yamamura Entries by Rebecca Alter, Elly Belle, Kambole Campbell, Jen Chaney, Amelia Cook, Alex Costello, Marley Crusch, Toussaint Egan, Christopher L. Inoa, Genevieve Koski, Willow Catelyn Maclay, Rafael Motamayor, Sammy Nickalls, Joshua Rivera
There will be cases like the serverless compute engine ECS Fargate, Google Cloud Run, etc., where some of these pieces are out of our control, so we work on a shared responsibility model. The provider is responsible for keeping the base pieces working and secured And you can focus on the upper layers. Prevention: 8 steps for shift left security Before your application inside a container is execute
Goodbye to the C++ Implementation of Zig ⚡ Zig Programming Language
Goodbye to the C++ Implementation of ZigHow we used WebAssembly to annihilate 80,000 lines of legacy codeAuthor: Andrew Kelley It’s funny - I have shared this story a handful of times with friends of mine who are qualified, competent software engineers, and each time the response was confusion about why any of this would be necessary or even remotely helpful. WebAssembly?! After ten minutes of puz
My Restaurant Was My Life for 20 Years. Does the World Need It Anymore? (Published 2020)
transcript Listen to This Article.Produced by Kelly Prime; edited by Mike Benoist; written by Gabrielle Hamilton; and narrated by January LaVoyAfter being forced to shutter the restaurant that was her life’s work, Gabrielle Hamilton asks: Will there be a place for it in the New York of the future? Recorded by Audm. gabrielle hamiltonI’m Gabrielle Hamilton, and I’m the chef and owner of Prune Resta
カオスエンジニアリングの過去と今(前編)
カオスエンジニアリングが変わりつつある？ きっかけはMSのクラウドソリューションアーキテクトの真壁さんの発言と記事。 本番環境で試験することを前提に進められてきたカオスエンジニアリングは、クラウドネイティブ前提の環境とKubernetesの躍進によって、本番環境に出す前に試験するように姿が変わってきている。もしくは見直されようとしているのではないか？ そういう趣旨だ。 この変化がなぜ今起きようとしているのだろうか。 その理由を2015年に成立したカオスエンジニアリングの原則 、さらにその昔の提案元であるNetflixの技術背景を見ながら考察したい。 そもそもカオスエンジニアリングってなんだ？ カオスエンジニアリングとはなんだろうか？ まずは、カオスエンジニアリングの規範である、カオスエンジニアリングの原則 を参照したい。 カオスエンジニアリングは、分散システムにおいてシステムが不安定な状態
The Top 100 Video Games of All TimeOur first refresh since 2019 features some big changes. IGN’s Top 100 games list encompasses the best of the best throughout history, spanning generations of consoles, PCs, handhelds, and more. Our list last saw a major update back in 2019, and since then, there have been several games released that deserved to be added. Just as importantly, we looked at the tota
How a simple Linux kernel memory corruption bug can lead to complete system compromise
In this case, reallocating the object as one of those three types didn't seem to me like a nice way forward (although it should be possible to exploit this somehow with some effort, e.g. by using count.counter to corrupt the buf field of seq_file). Also, some systems might be using the slab_nomerge kernel command line flag, which disables this merging behavior. Another approach that I didn't look
A Second Conversation with Werner Vogels – Communications of the ACM
CACM Web Account Membership in ACM includes a subscription to Communications of the ACM (CACM), the computing industry's most trusted source for staying connected to the world of advanced computing. Sign In Sign Up When I joined Amazon in 1998, the company had a single U.S.-based website selling only books and running a monolithic C application on five servers, a handful of Berkeley DBs for key/va
Whitepaper Title
Security Overview of AWS Fargate First published April, 2022 Notices Customers are responsible for making their own independent assessment of the information in this document. This document: (a) is for informational purposes only, (b) represents current AWS product offerings and practices, which are subject to change without notice, and (c) does not create any commitments or assurances from AWS an
What is asynchronous communication? Plus, how to implement it
What the heck is asynchronous communication anyway? And what you can do to start implementing it, whether you're an individual contributor or a team leader. Illustration by Yin WeihungStudy after study after study into remote work has clarified that remote workers are more productive than their office-bound counterparts. What’s not entirely clear is why. Yes, people gain back time (and sanity) by
Do Not Use '>' in Your Command Prompt (and How to Stay Safe in Shell) - Tanel Poder Consulting
Do Not Use '>' in Your Command Prompt (and How to Stay Safe in Shell) Over the years of troubleshooting performance problems in the Unix/Linux world, I have seen multiple cases where a regularly used command line tool in a customer server just stops working for some reason. The tool just returns immediately, doing absolutely nothing. No output printed, no coredumps and the exit code is zero (succe
In preparation for our upcoming release of Wasmtime 1.0 on September 20, we have prepared two blog posts describing the work we have put into the compiler and runtime recently. This first post will describe performance-related projects: making the compiler generate faster code, making the compiler itself run faster, making Wasmtime instantiate a compiled module faster, and making Wasmtime’s runtim
Debugging Incidents in Google’s Distributed Systems – Communications of the ACM
CACM Web Account Membership in ACM includes a subscription to Communications of the ACM (CACM), the computing industry's most trusted source for staying connected to the world of advanced computing. Sign In Sign Up Google has published two books about Site Reliability Engineering (SRE) principles, best practices, and practical applications.1,2 In the heat of the moment when handling a production i
I have read from Unity Blog long time ago that talks about project stripping, explaining reproduce steps, making it easier for the QA team to make it... It's scary. If you are Unity devs, you know the feeling of checking Unity Hub every morning for update, and hope that it will randomly fix your years old bug, while introducing the less amount of new bugs as possible. It really make you sweats ner
Beat Maker Software Free Download Full Version For Mac
Visiteurs depuis le 26/01/2019 : 5076 Connectés : 1 Record de connectés : 12 More on Rap Beat Maker Free Full Version Data Added 1: August 08, 2014 The ultimate Contract making App available for mobile devices worldwide for FREE! CMPRO-LITE will allow you to create 10 custom contracts FREE. Beat Maker Software Free Download Full Version For Mac FreeFull version will allow you to create unlimited t
Modern Web Development on the JAMstack: Modern Techniques for Ultra Fast Sites and Web Applications
Really pause and think about how much time and effort web teams around the world have spent building and managing infrastructure. For many years, launching a site or web application has been as much about deploying complex server environments as it’s been about building actual application code. The cloud made provision- ing all these resources faster but no less complicated. The JAMstack was born
On February 23, 2020, Ahmaud Arbery, a 25-year-old black man, was murdered during a racially motivated hate crime[b] while jogging in Satilla Shores, a neighborhood near Brunswick in Glynn County, Georgia.[1][2][3][4][5][9] Three white men, who later claimed to police that they assumed he was a burglar,[10][2][1][11] pursued Arbery in their trucks for several minutes, using the vehicles to block h
古川耕 ラジオ放送作家の仕事を語る
古川耕さんがblock.fm『INSIDE OUT』に出演。渡辺志保さん、DJ YANATAKEさんと『ウィークエンド・シャッフル』や『アフター6ジャンクション』、『生活は踊る』などでのラジオ放送作家の仕事について話していました。 【この後すぐ！！22時からは #INSIDE_OUT by @yanatake ,@shiho_wk 】 ゲストに放送作家・ライターの古川耕さんをお迎えしてヒップホップを黎明期から支えメジャー局へ早くから日本語ラップを送り込んだ、その挑戦と裏側をインタビュー!⁰ #ラジオ革命 #blockfm #MassiveWeekhttps://t.co/PdoSwcDQQ5 pic.twitter.com/af8Y94JU6p — block.fm (@blockfmjp) December 9, 2019 （DJ YANATAKE）ちょっとね、ライターとしてはお話も聞き
Back in October at HashiConf 2023, we announced Terraform stacks, a new feature to simplify infrastructure provisioning and management at scale. This announcement has us and the broader Terraform community excited about one of the biggest changes to hit HashiCorp Terraform in recent years. While stacks are still under development, we wanted to share a few more details and answer some questions. Wh
Everything about history and evolution of videogames! Site Search (use this search bar to find exact word on these pages) (you may need to refresh page to search) This is website about history of video games and video games "Firsts". What was first color game? First racing game? First banned game? First 3D Game? You will find all these game here! Plus -Retro reviews and photos from old magazines!.
古川耕 FRONT・blastライター時代を語る
古川耕さんがblock.fm『INSIDE OUT』に出演。渡辺志保さん、DJ YANATAKEさんとヒップホップ専門誌FRONT・blast編集部に入り、編集者からライターになった話などをしていました。 （渡辺志保）というわけで今日のゲストをここでお迎えしたいと思います。今日のゲストは古川耕さん、お招きしております！ （古川耕）はい、どうも、こんばんは！ （DJ YANATAKE）よいしょー！ いらっしゃーい！（拍手）。 （古川耕）ああ、こんな感じなんですね（笑）。どうも、放送作家の古川です。 （渡辺志保）みなさんね、「あれ？ いまからアトロクが始まるのかな？」みたいな感じでね。「何しに来たんですか？」みたいなね（笑）。 （古川耕）お招きいただいてありがとうございます。 （渡辺志保）とんでもないです。 （古川耕）めっちゃ緊張するわー。 （DJ YANATAKE）まさか来ていただけるとは。
Terraform best practices for reliability at any scale
State file proliferation for fun and profitWhen first adopting Terraform there’s a natural attraction to having a single state file that covers your entire infrastructure. It’s simple. It’s expressive. It’s fast—at first. And it’s a terrible idea. At scale, many Terraform state files are better than one. But how do you draw the boundaries and decide which resources belong in which state files? Wha
Making new games for retro consoles is something that amateur developers can do quite easily thanks to today's technology. Last year, I released a new game for my favorite console: the Super Nintendo (SNES). The project went as far as an actual physical release, with a cartridge and a cardboard box like the 90's. In this article, I'll present you the numerous steps of this incredible journey: desi
20,000 Startup Ideas
20,000 Startup Ideas (This data comes from the O*NET web site.) This gives a kind of map of the territory of current economically important human activities. Therefore it represents a good source of startup ideas. It maybe is even the listing of approximately all startup ideas. Visit individuals in homes or attend group meetings to provide information on agency services, requirements, or procedure
Visiteurs depuis le 26/01/2019 : 4585 Connectés : 1 Record de connectés : 19 Equilab Poker For Mac MacWithin the world of modern computer operating systems, the age-old dilemma pits PC users and their Windows platform against Mac users who prefer Apple's MacOS. This debate won't be settled anytime soon, what with diehard PC and Mac loyalists living and dying with every system update sent their way
Untitled/unsorted collection of math notes Dennis Yurichev Untitled/unsorted collection of math notes Dennis Yurichev May 18, 2023 Contents 1 Unsorted parts 1 1.1 Fencepost error / off-by-one error . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 GCD and LCM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 1.2.1
Archived Reliability Pillar AWS Well-Architected Framework This paper has been archived. The latest version is now available at: https://docs.aws.amazon.com/wellarchitected/latest/reliability-pillar/welcome.html Archived Reliability Pillar AWS Well-Architected Framework Reliability Pillar: AWS Well-Architected Framework Copyright © 2020 Amazon Web Services, Inc. and/or its affiliates. All rights res
"},"dump":{"kind":"string","value":"CC-MAIN-2013-20"},"url":{"kind":"string","value":"http://%20jwashington@ap.org/Content/Press-Release/2012/How-AP-reported-in-all-formats-from-tornado-stricken-regions"},"date":{"kind":"string","value":"2013-05-18T05:48:54Z"},"file_path":{"kind":"string","value":"s3://commoncrawl/crawl-data/CC-MAIN-2013-20/segments/1368696381249/warc/CC-MAIN-20130516092621-00000-
How bad are search results? Let's compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
Marginalia does relatively well by sometimes providing decent but not great answers and then providing no answers or very obviously irrelevant answers to the questions it can't answer, with a relatively low rate of scams, lower than any other search engine (although, for these queries, ChatGPT returns zero scams and Marginalia returns some). Interestingly, Mwmbl lets users directly edit search res
Publications AK Press Autonomedia The Blast Catholic Worker Cronaca Sovversiva Fifth Estate Free Society Freiheit Golos Truda Liberty Loompanics Mother Earth PM Press Regeneración Vanguard The Word Works Resistance to Civil Government (1849) To the Workingmen of America (1883) Anarchism and Other Essays (1910) Now and After (1929) In Defense of Anarchism (1970) Post-Scarcity Anarchism (1971) The A
The Go Blog Secure Randomness in Go 1.22 Russ Cox and Filippo Valsorda 2 May 2024 Computers aren’t random. On the contrary, hardware designers work very hard to make sure computers run every program the same way every time. So when a program does need random numbers, that requires extra effort. Traditionally, computer scientists and programming languages have distinguished between two different ki
Horizontally scaling the Rails backend of Shop app with Vitess
Opens in a new windowOpens an external siteOpens an external site in a new window Good problems We experienced hockey stick growth after we launched the Shop app. We were glued to our dashboards and saw millions of users onboard onto the app. This was gratifying, but we were becoming more nervous as our backend was pushed closer to its limit. We wrote the backend in Ruby on Rails, and used a MySQL
Cryptography engineers have been tearing their hair out over PGP’s deficiencies for (literally) decades. When other kinds of engineers get wind of this, they’re shocked. PGP is bad? Why do people keep telling me to use PGP? The answer is that they shouldn’t be telling you that, because PGP is bad and needs to go away. There are, as you’re about to see, lots of problems with PGP. Fortunately, if yo
Cloudflare's Handling of an RCE Vulnerability in cdnjs
Cloudflare's Handling of an RCE Vulnerability in cdnjs07/24/2021 cdnjs provides JavaScript, CSS, images, and fonts assets for websites to reference with more than 4,000 libraries available. By utilizing cdnjs, websites can load faster with less strain on one’s own origin server as files are served directly from Cloudflare’s edge. Recently, a blog post detailed a vulnerability in the way cdnjs’ bac
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Upgrading GitHub.com to MySQL 8.0
Postgres WASM by Snaplet and Supabase
The 100 Most Influential Sequences in Animation History
Container security best practices: Comprehensive guide
The Top 100 Video Games of All Time - IGN
Wasmtime 1.0: A Look at Performance
Objectively comparing Unity and Unreal Engine
Murder of Ahmaud Arbery - Wikipedia
Terraform stacks, explained
History of Video Games
Making a SNES game in 2020 - Yo-Yo Shuriken by Dr. Ludos
Equilab Poker For Mac
Untitled/unsorted collection of math notes
Reliability Pillar AWS Well-Architected Framework
HuggingFaceFW/fineweb · Datasets at Hugging Face
Capitol Hill Occupied Protest - Wikipedia
Secure Randomness in Go 1.22 - The Go Programming Language
Latacora - The PGP Problem