はてなブックマーク

Copyright © 2009-2015. All rights reserved. This blog is called myNoSQL and it is written by me, Alex Popescu, a software architect with a passion for open source and communities. It records my readings, learnings, and opinions on NoSQL databases, polyglot persistence, and distributed systems -- subjects that I'm passionate about. The opinions expressed here are my own, and no other party necessar

Copyright © 2009-2015. All rights reserved. This blog is called myNoSQL and it is written by me, Alex Popescu, a software architect with a passion for open source and communities. It records my readings, learnings, and opinions on NoSQL databases, polyglot persistence, and distributed systems -- subjects that I'm passionate about. The opinions expressed here are my own, and no other party necessar

It’s unfortunate that the post focuses mostly on the usage of Spring and RabitMQ and the slidedeck doesn’t dive deeper into the architecture, data flows, and data stores, but the diagrams below should give you an idea of this truly polyglot persistentency architecture: The slide deck presenting architecture principles and numbers about the platform after the break.

A couple of most notable NoSQL databases targeting large scalable systems are written in Java: Cassandra, HBase, BigCouch. Then there’s also Hadoop. Plus a series of caching and data grid solutions like Terracotta, Gigaspaces. They are all facing the same challenge: tuning the JVM garbage collector for predictable latency and throughput. Jonathan Ellis’s slides presented at Fosdem 2012 are coverin

It’s been only a couple of hours since the news about Amazon DynamoDB got out. Here are my notes gathered from the Amazon DynamoDB documentation. If you found interesting bits please leave a comment and I’ll add them to the list (with attribution): it is not the first managed/hosted NoSQLit is the first managed NoSQL databases that auto-shards Update: As pointed out in the comments, Microsoft Azur

Mark Callaghan: MongoDB doesn’t need multi-statement transactions. Both are limited by 1-writer or N-reader concurrency, but writes to database files are much faster with LevelDB because it doesn’t do update in place. So LevelDB doesn’t lose as much performance for IO-bound workloads by doing 1-writer or N-readers and my guess is that this could make MongoDB much better at supporting IO-bound work

Jeff Darcy has written a while back about the (lack of) security in NoSQL database. Unfortunately things haven’t changed much and if you check the NoSQL + Node.js applications I’ve posted lately you’ll notice that some of them are completely ignoring security. And there are some people realizing the risks and starting to express their concerns: Playing with MongoDB lately, I’m getting scared. Beca

Robert Atkinson: Electric power utilities can use data analytics and smart meters to better manage resources and avoid blackouts, Food inspectors can use data to better track meat and produce safety from farm to fork , Public health officials can use health data to detect infectious disease outbreaks, Regulators can track pharmaceutical and medical device safety and effectiveness through better da

Even if the Yfrog presentation on their usage of HBase has only 9 slides, you’ll find some very interesting notes in there. Here’s a couple that caught my eyes: 10k concurrent requests/second4 HBase clusters ranging from 50TB to 1PBHaving more smaller nodes is better than having less faster bigger nodesWe use sub $1k desktop grade servers, they work great![1]Inexpensive 2TB Hitachi disks (~$100) w

Links to the most publicized paper of a Hadoop use case, Facebook has presented at SIGMOD 2011: paper and presentation slides: Facebook recently deployed Facebook Messages, its first ever user-facing application built on the Apache Hadoop platform. Apache HBase is a database-like layer built on Hadoop designed to support billions of messages per day. This paper describes the reasons why Facebook c

The picture should speak for Digg’s polyglot persistency approach: But here is also a description of the data stores in use: Digg stores data in multiple types system depending on the type of data and the access patterns, and also for historical reasons in some cases :) Cassandra: The primary store for “Object-like” access patterns for such things as Items (stories), Users, Diggs and the indexes t

Copyright © 2009-2015. All rights reserved. This blog is called myNoSQL and it is written by me, Alex Popescu, a software architect with a passion for open source and communities. It records my readings, learnings, and opinions on NoSQL databases, polyglot persistence, and distributed systems -- subjects that I'm passionate about. The opinions expressed here are my own, and no other party necessar

Just in case you needed yet another example of building analytics systems on top of MongoDB: Patrick Stokes’[1] presentation about how Buddy Media is implementing their entire platform analytics engine on MongoDB:

A long series of articles by Todd Anderson on building a DHTML application for mobiles using jQuery Mobile and CouchDB: Getting started: installationDocument view: displaying the first pageTemplates and Mustache.js: using mustache.js for the templatesEditing documents: the first input pageAdding documents: write operationsDeleting documentsAuthorization and validation part 1 and part 2.Planning to

This is a guest post by Greg Luck, Founder and CTO, Ehcache . Is Ehcache a NoSQL store? No, I would not characterise it as that, but I have seen it used for some NoSQL use cases. In these situations it compared very well — with higher performance and more flexible consistency than the well-known NoSQL stores. Let me explain. Ehcache is the de facto open source cache for Java. It is used to boost p

Pere Urbón-Bayes must check slides deck on graph databases and their applicability. I like this graph database products slide most: Neo4j: open source database NoSQL graphDex: the high performance graph databaseHyperGraphDB: an IA and semantic web graph databaseInfogrid: the Internet graph databaseSones: SaaS dot Net graph databaseVertexDB: high performance database server

There was one NoSQL conference that I’ve missed and I was really pissed off: Hadoop World. Even if I’ve followed and curated the Twitter feed, resulting in Hadoop World in tweets, the feeling of not being there made me really sad. But now, thanks to Cloudera I’ll be able to watch most of the presentations. Many of them have already been published and the complete list can be found ☞ here. Based on

Just a quick reference of the continuously growing Hadoop tools ecosystem. HadoopThe Apache Hadoop project develops open-source software for reliable, scalable, distributed computing. hadoop.apache.org HDFSA distributed file system that provides high throughput access to application data. hadoop.apache.org/hdfs/ MapReduceA software framework for distributed processing of large data sets on compute