nerves.build
Photography Phoenix GenStage & Flow GeoCoding Personal Cloud When I first heard about GenStage and Flow my thought was to use it in a photo processing project that I had on the backburner. With so many photos to manage, and not just digital pictures, but scans, original art as well as older digital photos with sketchy data attached. I’ve never been happy with the organizing tools available in the
初心者のElixir |> Flow,GenStage |> Concurrent MapReduce - Qiita
When 2017/04/01 At Elixir Conf Japan 2017 LT Self Introduction ちきさん (Tomohiro Noguchi) Twitter/GitHub/Qiita: @ovrmrw I've started to learn Elixir 1 month ago. What I talk about Reading a JSON file and doing MapReduce. (JSONファイルを読み込んでMapReduceしたい。) Differences between Eager, Lazy and Flow(Concurrent). (Eager, Lazy, Flow(Concurrent)の違いについて。) Flow & GenStage is extremely fast. (Flowめちゃくちゃ速い。) === Git
Designing a P2P Lending platform with Elixir in mind
With this post, I want to share with you the design process on one of our latest projects — a P2P marketplace that was intended to be used by one of largest online lenders and all kinds of investors for securitization of their portfolios. And almost insane stack change that turned out to be a great idea. Why? To attract new engineers and backers to Elixir community. I do not consider myself an ent
How to use Elixir’s GenStage.Flow for image resizing
Image resizing is often a pretty important (but not often thought about) feature for many websites. We all want to make pages load fast and look good, and that means sending images at the size they’re going to be displayed, and hopefully optimised to minimise file size. At carwow, one of the big sources of images is stock photos of cars, which look something like this: We receive batches of these
GenStage and Flow - José Valim (Lambda Days 2017)
http://www.lambdadays.org/lambdadays2017/jose-valim José will explore the rationale and design decisions behind GenStage and Flow, two abstractions that have been researched and now implemented in the Elixir programming with a focus on back-pressure, concurrency and data processing.
Using Elixir's GenStage and Flow to build product recommendations - Binary Consulting
Background Flow allows developers to express computations on collections, similar to the Enum and Stream modules, although computations will be executed in parallel using multiple GenStages. The canonical example of Flow, taken from the GitHub repository, demonstrates how to count words in a document in parallel: File.stream!("path/to/some/file") |> Flow.from_enumerable() |> Flow.flat_map(&String.
Tuning Elixir GenStage/Flow pipeline processing
There are many use cases for GenStage/Flow. One of such cases that I recently faced was to get some records from PostgreSQL database, download files associated with these records from Amazon S3, extract text from these files and index this text into ElasticSearch. This task can be represented as a pipeline with four steps: SELECT record from database DOWNLOAD pdf file EXTRACT text from that file I
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
send/receive messages in Elixir and rate control
Using Elixir's GenStage and Flow to build product recommendations
