はてなブックマーク

There are many use cases for GenStage/Flow. One of such cases that I recently faced was to get some records from PostgreSQL database, download files associated with these records from Amazon S3, extract text from these files and index this text into ElasticSearch. This task can be represented as a pipeline with four steps: SELECT record from database DOWNLOAD pdf file EXTRACT text from that file I