Leveraging AWS to Build a Scalable Data Pipeline - High Scalability -

While at Netflix and LinkedIn Siddharth "Sid" Anand wrote some great articles for HS. Sid is back, this time as a Data Architect at Agari. Original article is here. Data-rich companies (e.g. LinkedIn, Facebook, Google, and Twitter) have historically built custom data pipelines over bare metal in custom-designed data centers. In order to meet strict requirements on data security, fault-tolerance, c

[yoshidashingo]

Leveraging AWS to Build a Scalable Data Pipeline