Senior Software Engineer, Streaming Platform

Job description preview

From Grab’s original posting

Job Description: Get to Know the Team The Stream Processing Platform team strives to enable seamless and secure real-time access to the events or "streams", serving as Grab's unified, common access pattern for real-time data. The functional areas this team covers are streaming (Kafka), stream processing (Flink, Flink SQL, Kafka Connect), Change Data Capture, near real-time lake ingestion, stream exploration (Zeppelin, Flink SQL Gateway), and an in-house control plane for tenancy and resource management. Some examples of the team's work are shared publicly on the Grab Engineering blog: • Make Flink deployments safer through platform guardrails and production deployment patterns (Safer deployment of streaming applications). • Improve Flink release confidence with shadow testing (Enhancing Flink deployment with shadow testing). • Strengthen real-time Kafka data quality with syntactic and semantic stream contracts (Real-time data quality monitoring). • Use machine learning to make Flink autoscaling more predictable and reliable (Machine-learning predictive autoscaling for Flink).These are examples of the platform thinking this role will contribute to: turning complex real-time…