Balancing Workload Across Nodes with Akka 2
About Us News, articles, code snippets and more by the hakkers in the Akka community. Links: Akka Home Akka Docs In Akka 2, there is a nifty little thing called the BalancingDispatcher, which will magically distribute work to a collection of Actors in the most efficient way possible (i.e. it’s a work stealing dispatcher). The SmallestMailboxRouter has this kind of feel as well. However, the Balanc
The Log: What every software engineer should know about real-time data's unifying abstraction | LinkedIn Engineering
The Log: What every software engineer should know about real-time data's unifying abstraction I joined LinkedIn about six years ago at a particularly interesting time. We were just beginning to run up against the limits of our monolithic, centralized database and needed to start the transition to a portfolio of specialized distributed systems. This has been an interesting experience: we built, dep
Big Data
Big Data teaches you to build big data systems using an architecture that takes advantage of clustered hardware along with new tools designed specifically to capture and analyze web-scale data. It describes a scalable, easy-to-understand approach to big data systems that can be built and run by a small team. Following a realistic example, this book guides readers through the theory of big data sys
Springframework.org
Spring Data’s mission is to provide a familiar and consistent, Spring-based programming model for data access while still retaining the special traits of the underlying data store. It makes it easy to use data access technologies, relational and non-relational databases, map-reduce frameworks, and cloud-based data services. This is an umbrella project which contains many subprojects that are speci
Etsy Engineering | Batch Processing Millions and Millions of Images
I joined Etsy back in February and knew immediately that there would be no shortage of technical challenges. Many of our job postings for Engineering positions describe the company as a place "where the word 'millions' is used frequently and in many contexts". I got a taste of that within my first weeks on the job. We are in the process of redesigning a few of the major sections around etsy.com.
Announcing Hank: A Fast, Open-Source, Batch-Updatable, Distributed Key-Value Store
We’re really excited to announce the open-source debut of a cool piece of Rapleaf’s internal infrastructure, a distributed database project we call Hank. Our use case is very particular: we have tons of data that needs to get processed, producing a lot of data points for individual people, which then need to be made randomly accessible so they can be served through our API. You can think of it as
Quartz Enterprise Job Scheduler
What is the Quartz Job Scheduling Library? Quartz is a richly featured, open source job scheduling library that can be integrated within virtually any Java application - from the smallest stand-alone application to the largest e-commerce system. Quartz can be used to create simple or complex schedules for executing tens, hundreds, or even tens-of-thousands of jobs; jobs whose tasks are defined as
s2chronos
S2Chronosは2013/5月末をもって開発とMLでのサポートを終了しました。 ようこそ S2Chronosプロジェクトへ S2Chronosは，Seasar2に対応したJavaオブジェクトスケジューリングフレームワークです． ユーザイベントではなく，時間によってビジネスロジックを実行させる要求は常にあります．課金や解約に関連する月次処理などです． このような日時に関連するビジネスロジックを，S2上でタスククラスとして登録し，スケジューリングすることが可能になるのがS2Chronosです． バッチプログラムを別プログラムに切り出すと，ウェブアプリ内にあるDao, Logic, Serviceとの連携に手間がかかります． どうせなら，ウェブアプリの中にS2Chronosとタスククラスを内包してしまえば，後は必要なコンポーネントをタスクにDIするだけで簡単にバッチ処理が実装できます．
Spring Batch - soracane
具体的にどのようなことができるかを箇条書きした方が、イメージをしやすいと思いますので以下に列挙してみます。
バッチ処理はJavaでバッチリ？その現状とこれから
「Java News.jp（Javaに関する最新ニュース）」の安藤幸央氏が、CoolなプログラミングのためのノウハウやTIPS、筆者の経験などを「Rundown」（駆け足の要点説明）でお届けします。（編集部） バッチ処理の変遷 Javaの登場以来、ホストコンピュータ、専用サーバなどで動いていた数多くのレガシー（既存資産）システムが、Java環境へ移行してきました。Web上のオンラインアプリケーションにおいては、特にJavaの活躍の場が増えたといってもよいでしょう。 その中でも移行が遅れており、旧来のマシン環境、旧来の言語での利用が続いてきたものに「バッチ処理」が挙げられます。 ■そもそも「バッチ処理」とは何か？ ここでいうバッチ処理はWindowsのバッチファイル（.bat）を示すのではありません。大量のトランザクションデータを扱い、大量のデータを順次処理することを示します。 また、バッチ
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Kubernetes Meets High-Performance Computing
http://www.vldb.org/pvldb/vol7/p1441-boykin.pdf
The three eras of business data processing
How companies are using Spark - O'Reilly Media
Preview the new Google Groups - Google Groups
Spring | Home
https://www.exforsys.com/forum/75170-batch-processing-design-pattern.html
J2EE Batch Processing
Hadoop向け基幹バッチ分散処理ソフト「Asakusa」の全貌