Location: Hybrid - Cape Town / Johannesburg

Employment Type: Full-Time

Department: Data Engineering

We aim to build one of the strongest Engineering capabilities within Africa. Our Data Engineers are key to help us achieve this.

We’re expanding our Data Engineering team and are looking for a Streaming-focused Data Engineer who can design, build, and manage real-time data pipelines at scale, using technologies like Apache Kafka, Apache Flink, and modern cloud-native services (Azure, AWS, Databricks, etc.).

You will play a key role in designing and implementing real-time data streaming pipelines that power analytics, AI, and operational insights. Working closely with architects, data engineers, and cloud engineers, you’ll build resilient streaming frameworks that enable near real-time decisioning and event-driven architectures across multiple domains.

Key Responsibilities

• Design, build, and optimise real-time data ingestion and streaming pipelines using Apache Kafka and Apache Flink (or similar frameworks like Spark Structured Streaming).
• Implement exactly-once processing, stateful stream processing, and windowing concepts for low-latency data flows.
• Develop schema management and data contracts using Schema Registry / Confluent Schema.
• Integrate with data lakes, warehouses, and APIs for downstream analytics and reporting (e.g., AWS, Databricks, Azure, Snowflake, etc.).
• Implement monitoring, alerting, and observability for streaming pipelines using tools like Prometheus, Grafana, or OpenTelemetry.
• Collaborate with platform engineers to design scalable Kafka clusters and Flink runtimes (on Kubernetes, Databricks, or native cloud services).