Senior Software Engineer, Streaming Infrastructure

Job description preview

From Airbnb’s original posting

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. Airbnb's Data Infrastructure organization builds the systems that store, move, and transform data across the company. Our Data Movement & Transformation (DMT) group is building a single, unified platform for moving data between Airbnb's storage systems, replacing dozens of one-off tools with one reliable, well-supported way to get data where it needs to go. This platform is the foundation for Data as a Service, a top-level infrastructure initiative at Airbnb. The Community You Will Join: The Ingestion team is the front door to DMT. We build and operate two managed, multi-tenant platforms that move data out of Airbnb's online databases for offline processing: • SpinalTap: near real-time change data capture (CDC) streaming to Kafka for every Aurora and UDS table at Airbnb. • DBExports: periodic full-table snapshots and…