Basic Setup for Cloudera Hadoop Distribution
This is the third time I’ve turned a vanilla mac into a ninja coding machine, and following my design principle of “first time = coincidence, second time = annoying, third time = pattern”, I’ve decided to write down the details for the next time. Getting Cloudera’s Hadoop distribution up an running sounds pretty easy. Original title and link: Basic Setup for Cloudera Hadoop Distribution (NoSQL dat
Amazon SimpleDB, MongoDB, CouchDB, and RavenDB Compared
I wanted to share this before the weekend is over: Jesse Wolgamott’s video: “Battle of NoSQL starts: Amazon’s SDB vs MongoDB vs CouchDB vs RavenDB” from September’s Lone Star Ruby Conference. You can download the video from the Confreaks site for watching offline. Original title and link: Amazon SimpleDB, MongoDB, CouchDB, and RavenDB Compared (NoSQL databases © myNoSQL)
Goodbye Google App Engine (GAE)
[…] developing on GAE introduced such a design complexity that working around it pushes us 5 months behind schedule. Now that we had developed tools and workarounds for all the problems we found in GAE, we were starting being fast with the development of features eventually, and at that point we found the cloud was totally unstable, doggy. Carlos Ble’s post lists 13 issues they’ve had with Google
NoSQL Databases - The Trend for Databases in the Cloud?
From a sys-con article[1]: Will there be some sort of “war” between NoSQL and SQL supporters like the one of REST versus SOAP? The answer is maybe. Who will win this case? As with SOAP versus REST, there won’t be a winner or a loser. Bad parallel, but it begs a comment: I hope (some) NoSQL databases will be more like REST, as I wouldn’t call SOAP a success.
How does HBase write performance differ from write performance in Cassandra
Copyright © 2009-2015. All rights reserved. This blog is called myNoSQL and it is written by me, Alex Popescu, a software architect with a passion for open source and communities. It records my readings, learnings, and opinions on NoSQL databases, polyglot persistence, and distributed systems -- subjects that I'm passionate about. The opinions expressed here are my own, and no other party necessar
ZooKeeper Promoted to Apache Top Level Project
ZooKeeper, the centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services, that started under Hadoop umbrella has been promoted to an Apache Top Level Project, according to the ☞ report sent out by Doug Cutting. In case you are wondering what it means, simply put it’s a proof of the project maturity and its community t
Why We Love HBase: An Interview with Ryan Rawson
A must read interview with Ryan Rawson[1] about HBase: It’s cost-effective, fast at data retrieval, and dependable. Instead of buying one or two very large computers, HBase runs on a network of smaller and cheaper machines. By storing data across these multiple smaller machines, we get better performance since we can always add more machines to improve data storage and retrieval as StumbleUpon’s d
Welcome to HBase!
When you need a really really big database, forget MySQL, Oracle, Access, HBase is your free tool I initially read it differently: when you need a really really big Oracle, IBM, MS SQLServer database, HBase is your friend. Original title and link: Welcome to HBase! (NoSQL databases © myNoSQL) via: http://sitivi.blogspot.com/2010/11/welcome-to-hbase.html
HBase at Facebook and Why Not MySQL or Cassandra
Jeremiah Peschka on: What makes this decision interesting is not just the reasons that Apache HBase was chosen, but also the reasons that MySQL and Cassandra were not chosen. Briefly: not MySQL: because sharding can be very difficult at the scale of Facebook messages systemnot Cassandra: because of replication behavior Update: There were a few pointing out that the original article is inaccurate.
A Study of Hadoop Developers from Karmasphere
Karmasphere, a a Big Data Intelligence (BDI) software company bringing Apache Hadoop power to developers and analysts, has published the results of a survey among Hadoop users. The report can be downloaded from ☞ here (PDF). Interesting notes: Within a year, 86% of projects have moved to either active development or productionIn 68% of the cases, the first use of Hadoop was not mandated by s
Facebook: The Underlying Technology of Messages Using HBase
Cassandra, MySQL, and HBase were evaluated for the Facebook new messaging system. HBase was finally picked and is now behind the new product announced today: HBase comes with very good scalability and performance for this workload and a simpler consistency model than Cassandra. While we’ve done a lot of work on HBase itself over the past year, when we started we also found it to be the most featur
eBay, Hadoop, HBase
From ☞ DBMS2: eBay sees Hadoop as an interesting tool for certain special purposes: eBay likes Hadoop for certain tasks such as image analysis.eBay doesn’t like Hadoop for anything that requires data movement, such as a join.Similarly, eBay doesn’t like HBase.But based on reports from Hadoop World it looks like eBay usage of Hadoop is quite wide: eBay had a 4 node cluster in 2007, a 28 and a 10 no
Hadoop Best Practices and Anti-Patterns
An extensive post about Hadoop best practices and anti-patterns from Yahoo!: This blog post represents compendium of best practices for applications running on Apache Hadoop. In fact, we introduce the notion of aGrid Pattern which, similar to a Design Pattern, represents a general reusable solution for applications running on the Grid. This blog post enumerates characteristics of well behaved appl
Hadoop at Twitter: An Interview with Kevin Weil, Twitter Analytics Lead
Kevin Weil[1] in an interview about Twitter’s usage of Hadoop: Hadoop is our data warehouse; every piece of data we store is archived in HDFS. We use HBase for data that sees updates frequently, or data we occasionally need low-latency access to. Every node in our cluster runs HBase. We use Java MapReduce for simple jobs, or jobs which have tight performance requirements. We use Pig for most of ou
Neo4j for Ruby
Copyright © 2009-2015. All rights reserved. This blog is called myNoSQL and it is written by me, Alex Popescu, a software architect with a passion for open source and communities. It records my readings, learnings, and opinions on NoSQL databases, polyglot persistence, and distributed systems -- subjects that I'm passionate about. The opinions expressed here are my own, and no other party necessar
MapReduce and Hadoop Future
In the light of ☞ Google Caffeine announcement — a summary of a summary would be that Google replaced MapReduce-based index updates with a new engine that would provide more timely updates — ☞ Tony Bain is wondering if Michael Stonebraker and DeWitt’ paper ☞ MapReduce: a major step backwards hasn’t thus been proved to be correct: Firstly, was Stonebraker and Dewitt right? It is red faced time for
Why Enterprises Are Uninterested in NoSQL
Michael Stonebraker in an article around this survey on NoSQL knowledge in the enterprise world To get more color on the situation, I contacted a very senior technical guru at a large enterprise who is responsible for looking at new database management system (DBMS) technology for his company. I asked him how interested he was in NoSQL and, in effect, how interested his company was. He reported “n
Django Getting NoSQL Support in Trunk?
We’ve covered Django and NoSQL extensively over here and now the news it that “official” NoSQL support might get into Django trunk: Waldemar Kornewald: in my last discussion on django-users Russell told me that he’d like to see four proof-of-concept (or better) backends before considering NoSQL for inclusion in trunk. The primary point was that enough eyeballs have looked at the API, first. Now we
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
HBase: Importing Large Data
NoSQL and Django Panel Video