System Design: Data Ingestion & Processing Pipeline

• 

  The design

• I was interviewing for a data infra role at Zoox, and wanted to study the domain in detail!
• Data infra @ Zoox is a very interesting problem. Each car by itself produces 1TB of data / day. The question becomes, how do you ingest that much data for 100k cars for example? How do you store it? how do you process it? How do you make all that data accessible to the downstream teams?
• This is my answer to all those!

Built With

• design