Data Platform Engineer

Job description preview

From ClickHouse’s original posting

ABOUT THE ROLE At ClickHouse, we believe in making product decisions grounded in data, not gut feelings. To support that, we've built a comprehensive internal data warehouse — read more about it on our blog https://clickhouse.com/blog/building-a-data-warehouse-with-clickhouse. It powers analytics, forecasting, and decision-making across every team in the company. Our stack centers on ClickHouse as the core storage and processing engine, complemented by dbt, Airflow, S3, AWS, Superset, and GitHub Actions. We ingest data from 30+ distinct external sources, process over 2.5 PB of data, and deliver most data marts to business consumers with a 1-hour end-to-end latency - a standard that demands highly optimized, rock-solid transformation pipelines. We're looking for a Senior Data Engineer to help evolve the DWH platform, push its technical boundaries, and deliver reliable, high-performance data models to business users across the organization. KEY RESPONSIBILITIES 1. DWH Platform Development - Design and develop reusable Airflow components - operators, connectors, and hooks - along with custom integrations tailored to our data architecture. - Build reusable dbt macros and abstractions:…