Meson: Workflow Orchestration for Netflix Recommendations
At Netflix, our goal is to predict what you want to watch before you watch it. To do this, we run a large number of machine learning (ML) workflows every day. In order to support the creation of these workflows and make efficient use of resources, we created Meson. Meson is a general purpose workflow orchestration and scheduling framework that we built to manage ML pipelines that execute workloads
Streaming SQL with Apache Calcite
With the rise of the Internet of Things (IoT) and low-latency analytics, streaming data becomes ever more important. Surprisingly, one of the most promising approaches for processing streaming data is SQL. In this presentation, Julian Hyde shows how to build streaming SQL analytics that deliver results with low latency, adapt to network changes, and play nicely with BI tools and stored data. He al
Cloud Foundry BOSH
About Installation Guides Reference Stemcells Releases Welcome to¶ BOSH is a project that unifies release engineering, deployment, and lifecycle management of small and large-scale cloud software. BOSH can provision and deploy software over hundreds of VMs. It also performs monitoring, failure recovery, and software updates with zero-to-minimal downtime. While BOSH was developed to deploy Cloud
Applying the Kappa architecture in the telco industry
Kappa architecture and Bayesian models yield quick, accurate analytics in cloud monitoring systems. Ever-growing volumes of data, shorter time constraints, and an increasing need for accuracy are defining the new analytics environment. In the telecom industry, traditional user and network data coexists with machine-to-machine (M2M) traffic, media data, social activities, and so on. In terms of
bliki: Immutable Server
Automated configuration tools (such as CFEngine, Puppet, or Chef) allow you to specify how servers should be configured, and bring new and existing machines into compliance. This helps to avoid the problem of fragile SnowflakeServers. Such tools can create PhoenixServers that can be torn down and rebuilt at will. An Immutable Server is the logical conclusion of this approach, a server that once de
20 amusing Linux commands to have fun with the terminal – BinaryTides
For a linux user, the terminal or command line is a powerful and important tool for work. A lot of things on linux are done inside the terminal. When working on a linux server, the command line shell is the only interface to work with, most of the time. But the terminal is also very textish and a bit non-interesting at time. The linux terminal is not always dull and boring. There are commands to m
Spark by holman
▁▂▃▅▂▇ in your shell. View the Project on GitHub holman/spark Download ZIP File Download TAR Ball View On GitHub spark sparklines for your shell See? Here's a graph of your productivity gains after using spark: ▁▂▃▅▇ install spark is a shell script, so drop it somewhere and make sure it's added to your $PATH. It's helpful if you have a super-neat collection of dotfiles, like mine. If you're on OS
A Word is Worth a Thousand Vectors - Stitch Fix Technology
Standard natural language processing (NLP) is a messy and difficult affair. It requires teaching a computer about English-specific word ambiguities as well as the hierarchical, sparse nature of words in sentences. At Stitch Fix, word vectors help computers learn from the raw text in customer notes. Our systems, composed of machines and human experts, need to recommend the maternity line when she s
Linuxbrew のススメ - Qiita
2019/02/04 追記 本家 Homebrew 2.0.0 にて Linuxbrew を merge して正式にサポートすることになりました。やったね。 追記終了。 What's Linuxbrew "Linuxbrew is a fork of Homebrew, the Mac OS package manager, for Linux." by Linuxbrew というわけで OS X の Homebrew を Linux 環境でも使えるようにしたものです。 Why Linuxbrew Debian や RHEL系(CentOS など) は安定性を重視していることにより公式の package が古くてアワワってなりませんか？ その度に公式の開発版を持ってきたり、公式ではないリポジトリ追加したり、非公式 package を探したりして、そして package の依存関係がゴチャっ
Amazon Redshiftで使えるPostgreSQL管理ツールを幾つか試してみた | DevelopersIO
新年あけましておめでとうございます！しんやです。今年もよろしくお願いしますと言う事で2014年1発目のエントリです。 本日1/6は仕事始め。社内での全体朝礼の後、社員皆で秋葉原の弊社から10分程歩き、神田明神へ参拝に行ってきました。 神田明神 - Wikipedia 神田明神｜東京都千代田区外神田2-16-2 当初、10分程ちょちょい〜と歩いて、15分程軽くお参りしてそのまま帰ってくるのかな〜、という位のノリだったのですが、付近まで来てみると...予想以上の、想像以上の人の列!! 列の最後尾は緩やかな坂の下まで続いておりました。そして鳥居の辺りからは一面びっしり人の波。 参拝後は逆サイドから回って鳥居入り口まで戻り、来た道を帰って行ったのですが、正直ここまでの混雑、正直神田明神を甘く見てました...神田明神パネぇ!! さて、ここから本題。Amazon Redshiftにアクセス出来る専用ツ
Causal Inference: What If (the book)
Jamie Robins and I have written a book that provides a cohesive presentation of concepts of, and methods for, causal inference. Much of this material is currently scattered across journals in several disciplines or confined to technical articles. We expect that the book will be of interest to anyone interested in causal inference, e.g., epidemiologists, statisticians, psychologists, economists, so
(BDT303) Running Spark and Presto on the Netflix Big Data Platform
(BDT303) Running Spark and Presto on the Netflix Big Data Platform In this session, we discuss how Spark and Presto complement the Netflix big data platform stack that started with Hadoop, and the use cases that Spark and Presto address. Also, we discuss how we run Spark and Presto on top of the Amazon EMR infrastructure; specifically, how we use Amazon S3 as our data warehouse and how we leverage
Analytics.js 2.0 Source- Segment Documentation
Analytics.js 2.0, the latest version of Segment’s JavaScript source, enables you to send your data to any tool without having to learn, test, or use a new API every time. Analytics.js 2.0 is available as an open-source project. All sources created on April 5, 2022 and after, default to use Analytics.js 2.0. Benefits of Analytics.js 2.0 Analytics.js 2.0 provides two key benefits over the previous v
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Stitch Fix ❤ UNIX | Stitch Fix Technology – Multithreaded
Loading...
GitHub - stitchfix/splits: A Python library for dealing with splittable files
GitHub - NataliaDiaz/Ontologies: A set of created ontologies for human activity modelling and lifestyle profiling
https://events.static.linuxfound.org/sites/events/files/slides/Netflix%20Integrating%20Spark%20at%20Petabyte%20Scale.pdf