Onsite Data Engineer: Streaming Pipelines & Orchestration

Infinitive Inc; McLean (VA); On-site; USD 90,000 - 154,000; Full time

Job summary

Infinitive Inc is hiring a Data Engineer to design, build, and scale next-generation, event-driven data platforms in McLean, VA onsite. You will work on high-volume streaming systems with Apache Kafka, Temporal, and schema contracts across microservices and lakehouse storage.

You will develop end-to-end batch and near-real-time pipelines using Python, SQL, and Spark, and model data in Snowflake, BigQuery, Databricks, and Redshift.

Qualifications

• 4+ years of data engineering or backend distributed systems experience.
• Experience with Temporal or Cadence and durable workflows.
• Deep expertise in Apache Kafka and related tooling.
• Schema definition frameworks like Avro, Protobuf, or JSON Schema.
• Experience with schema evolution and registries (Confluent, AWS Glue).
• Ability to perform data validation and quality checks with GE, Pandera, Pydantic, or dbt tests.
• Strong Python and Spark (PySpark) skills are required.

Responsibilities

• Architect, deploy, and maintain high-volume data streams with Kafka and Connect.
• Define schema standards, versioning, and automated validation across services.
• Build durable Temporal workflows coordinating long-running pipelines.
• Create end-to-end batch and near-real-time pipelines with Python, SQL, Spark.
• Model analytics in Snowflake, BigQuery, Databricks, and Redshift.
• Implement testing, data drift detection, and observability for pipelines.
• Collaborate with engineers and analysts on data contracts and CI/CD release patterns.

Skills

Python

SQL

Distributed systems

Go

Java

Tools

Temporal

Cadence

Apache Kafka

Kafka Connect

Schema Registry

Avro

Protobuf

JSON Schema

Confluent Schema Registry

AWS Glue Schema Registry

Great Expectations

Pandera

Pydantic

dbt

Spark

PySpark

Spark SQL

Snowflake

BigQuery

Databricks

Redshift

Python

SQL

gRPC

Job description

Infinitive Inc is hiring a Data Engineer to design, build, and scale next-generation, event-driven data platforms in McLean, VA onsite. You will work on high-volume streaming systems with Apache Kafka, Temporal, and schema contracts across microservices and lakehouse storage.

You will develop end-to-end batch and near-real-time pipelines using Python, SQL, and Spark, and model data in Snowflake, BigQuery, Databricks, and Redshift.