How Uber Engineering Evaluated JSON Encoding and Compression Algorithms to Put the Squeeze on Trip Data
For compression, we put three lossless and widely accepted libraries to the test: Snappy zlib Bzip2 (BZ2) Snappy aims to provide high speeds and reasonable compression. BZ2 trades speed for better compression, and zlib falls somewhere between them. Testing Our goal was to find the combination of encoding protocol and compression algorithm with the most compact result at the highest speed. We teste
Scrooge — Scrooge 24.2.0 documentation
Scrooge¶ Scrooge is a thrift code generator written in Scala, which currently generates code for Scala, Java, Cocoa, Android and Lua. It’s meant to be a replacement for the apache thrift code generator, and generates conforming, binary-compatible codecs by building on top of libthrift. Since Scala is API-compatible with Java, you can use the apache thrift code generator to generate Java files and
Schema evolution in Avro, Protocol Buffers and Thrift — Martin Kleppmann’s blog
Schema evolution in Avro, Protocol Buffers and Thrift Published by Martin Kleppmann on 05 Dec 2012. So you have some data that you want to store in a file or send over the network. You may find yourself going through several phases of evolution: Using your programming language’s built-in serialization, such as Java serialization, Ruby’s marshal, or Python’s pickle. Or maybe you even invent your ow
Thrift: The Missing Guide
Thrift is a software framework for scalable cross-language services development. It combines a software stack with a code generation engine to build services that work efficiently and seamlessly between C++, Java, Python, PHP, Ruby, Erlang, Perl, Haskell, C#, Cocoa, JavaScript, Node.js, Smalltalk, and OCaml. Thrift is clearly abundant in features. What is sorely lacking though is good documentatio
Under the Hood: Building and open-sourcing fbthrift
Thrift v. 1 At Facebook, we place a lot of emphasis on choosing the best tools and implementations for our backend services, regardless of programming language. We use various programming languages on a case-by-case basis to optimize for the right combination of performance, ease and speed of development, availability of existing libraries, and so on. To support this practice, in 2006 we created T
Engineering Blogs - Ooyala Community
Written by Anupama Shetty 4/13/17 Code coverage as defined by Wikipedia refers to a measure used to describe the degree to which the source code of a program is executed when a particular test suite runs. Thus, serving as a metric to track the percentage of code lines having a corresponding test to validate its functionality. While code coverage itself is not a self sufficient metric and may not a
Programmer’s Guide to Apache Thrift
Learn AI-Assisted Python Programming, Second Edition—Save 45% TODAY ONLY! Learn AI-Assisted Python Programming, Second Edition—Save 45% TODAY ONLY!
NimbusSanL-Regu
The Unified Logging Infrastructure for Data Analytics at Twitter George Lee, Jimmy Lin, Chuang Liu, Andrew Lorek, and Dmitriy Ryaboy Twitter, Inc. @GeorgeJLee @lintool @chuangl4 @mrtall @squarecog ABSTRACT In recent years, there has been a substantial amount of work on large-scale data analytics using Hadoop-based platforms running on large clusters of commodity machines. A less- explored topic is
max.lueb.be » Installing Apache Thrift on Mac OS X 10.5 Leopard
Thrift is a efficient framework for cross-language serialization and RPC that recently became an Apache Incubator project. It’s definately a cool project to check out if you are building a high traffic web application or are writing distributed computing code. Installing the framework on OS X isn’t currently totally straightforward, provided below is a guide to get Thrift built on OS X Leopard. Fi
Apache Thrift を MacOS X 上で試す « ロジカルにアナログで。
「あの超大規模サイトであるFacebookがAPI公開の為に作った」というキャッチーなフレーズにひっかかって、Apache Thriftというものを試してみました。EvernoteのAPIもThriftらしいです。 いったいどんな事ができる技術なんでしょうね？ 「習うより慣れろ」 ということで、とにかく動かして雰囲気を見てみましょう。 僕もちょっと触ってみただけですが、情報が分散していてわかりにくかったので、自身のメモを兼ねて、動かすまでの手順を書いてみたいと思います。 Apache Thriftってなに？ Thrift自体はいろいろな方がその特長を書かれているのでこちらをどうぞ。 Wikipedia「Thrift (プロトコル)」 Thriftが便利すぎる @IT 「巨大SNSを支える多言語混在RPC開発フレームワーク“Thrift” 」 簡単に言えば、 「Java, C++, Pyth
Secrets of BackType's Data Engineers
When you buy through affiliate links in our content, we may earn a commission at no extra cost to you. Learn how our funding model works. By using this website you agree to our terms and conditions and privacy policy. We uphold a strict editorial policy that focuses on factual accuracy, relevance, and impartiality. Our content, created by leading industry experts, is meticulously reviewed by a tea
BLOG::broomie.net: Thriftが便利すぎる
ちょっと前に「thriftって便利らしいよー」って話を聞いていたのだけれども、なかなか手をつけられずにいたらはてなブックーマークで使われているらしいという噂を聞いたり、Thriftを使って俺俺Key-Value Storeを作ったのように、TXを使ったThriftの紹介などが出てきたりしたのでそろそろ自分でも試したいなあと思い、試しました。で、先に結論を言っておくとThrift、とても気に入りました。とても簡単に処理用の専用サーバをたてることができて、かつ簡単にクライアントから処理要求が送れます。ボクは今まではRESTFulな感じでhttpでこのタスクをやっていたのですが、RESTFulな専用サーバをたてるのは結構開発コストがかかるんですよね。その点で、Thriftは開発コストはとても落ちると思うのでとても気に入っています。なんといって言語バインディングを自動で生成してくれるのは本当に開発
Cybozu Developer Network: Facebookで開発されたオープンソースのRPCフレームワーク「Thrift」調査報告
サイボウズはクラウドベースのグループウェアや業務改善サービスを軸に、社会のチームワーク向上を支援しています。
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
https://thrift.apache.org/static/files/thrift-20070401.pdf
Reliable and Scalable Data Ingestion at Airbnb
Apache Avro in LivePerson [Hebrew]
GitHub - CommBank/humbug: Humbug is a very simple scrooge replacement for Thrift structs with more than 254 fields
Introducing self-describing Thrift
tachiba.jp