分散システムについて語らせてくれNTT Tech Conference #2 にて話した資料 時間が足りなかったので全部は話せなかった。
OpenZipkin · A distributed tracing system
Zipkin Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be sum
分散学習用TensorFlowコードの書き方 - めもめも
何の話かというと Google Cloud MLを利用して、TensorFlowの分散学習を行う方法です。取り急ぎ、自分用のメモとして公開しておきます。 分散学習にはいくつかのパターンがありますが、最もシンプルな「データ分散」の場合を説明します。各ノードは同じモデルに対して、個別に学習データを適用して、Variableを修正する勾配ベクトルを計算します。それぞれで計算した勾配ベクトルを用いて、共通のVariableを修正していきます。 前提知識 TensorFlowの分散学習処理を行う際は、3種類のノードを使用します。 ・Parameter Server：Workerが計算した勾配ベクトルを用いて、Variableのアップデートを行います。 ・Worker：教師データから勾配ベクトルを計算します。 ・Master：Workerと同様の処理に加えて、学習済みモデルの保存やテストセットに対する
Google's Dremel Makes Big Data Look Small
In recent years, Google has published three particularly interesting papers on the infrastructure that underpins its massive web operation -- and the Google infrastructure is often a bellwether for the future of web software. The most intriguing paper is the one that describes a tool called Dremel. Mike Olson is one of the main brains behind the Hadoop movement. But even he looks toward the new br
Leslie Barry Lamport - A.M. Turing Award Laureate
BIRTH: 7 February 1941 in New York, New York EDUCATION: Bronx High School of Science (1957); B.S. (Massachusetts Institute of Technology, Mathematics, 1960); M.S (Brandeis University, Mathematics, 1963); PhD (Brandeis University, Mathematics, 1972). EXPERIENCE: Massachusetts Computer Associates, 1970-1977; SRI International, 1977-1985; Digital Equipment Corporation and Compaq, 1985-2001; Micros
Books on Pattern-Oriented Software Architecture
This page describes the five books on Pattern-Oriented Software Architecture (POSA). All of these books are published by Wiley. View this page in Romanian courtesy of azoft. Pattern-Oriented Software Architecture: A System of Patterns, Volume 1 POSA1 is the first volume in the POSA series and was published in 1996. This book represents the progression and evolution of the pattern approach into a s
CRAN Task View: High-Performance and Parallel Computing with R
Dirk Eddelbuettel (2025). CRAN Task View: High-Performance and Parallel Computing with R. Version 2025-10-21. URL https://CRAN.R-project.org/view=HighPerformanceComputing. The packages from this task view can be installed automatically using the ctv package. For example, ctv::install.views("HighPerformanceComputing", coreOnly = TRUE) installs all the core packages or ctv::update.views("HighPerform
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
john wilkes
Andy Konwinski
Philosophy — SCOOP 0.7.2 dev documentation
Philosophy — SCOOP 0.7 2.0 documentation
'Nobel Prize in Computing' goes to distributed computing wrangler Leslie Lamport - Network World
CS 848: Data Infrastructure: Schedule