Real-Time Data Engineer: Kafka, Temporal & Pipelines

Infinitive; McLean (VA); Hybrid; USD 90,000 - 154,000; Full time

Job summary

Infinitive is seeking an experienced Data Engineer to design, build, and scale our event-driven data platforms. You will bridge high-throughput streaming with durable workflow orchestration and strict data governance.

You will work with Apache Kafka, Temporal, and modern cloud data warehouses to design robust schemas, automate validation, and implement end-to-end ETL/ELT pipelines using Python, Spark and SQL.

Qualifications

• 4+ years of professional data engineering or backend distributed systems experience.
• Hands-on with Temporal (or Cadence) for durable workflows.
• Deep Kafka expertise including partitioning, consumer groups and topic design.
• Strong data schema design & validation with Avro/Protobuf/JSON Schema.
• Experience with schema evolution and registry services (Confluent, AWS Glue).

Responsibilities

• Architect and maintain high-volume data streams using Apache Kafka.
• Establish and enforce robust data schema design and validation.
• Design durable workflows with Temporal for cross-system ETL tasks.
• Build end-to-end batch and streaming pipelines with Python, SQL and Spark.
• Model analytical data in cloud warehouses/lakehouses and ensure data quality.

Skills

Kafka

Python

SQL

Spark

schema design

data quality

Temporal

ETL/ELT

CI/CD

Tools

Kafka Connect

Schema Registry

dbt

Job description

Infinitive is seeking an experienced Data Engineer to design, build, and scale our event-driven data platforms. You will bridge high-throughput streaming with durable workflow orchestration and strict data governance.

You will work with Apache Kafka, Temporal, and modern cloud data warehouses to design robust schemas, automate validation, and implement end-to-end ETL/ELT pipelines using Python, Spark and SQL.