Hybrid Data Engineer - Streaming Pipelines, Kafka & Cloud

JetHead Development Inc.; Carlsbad (CA); Hybrid; USD 90,000 - 190,000; Full time

Benefits offered by this job

401k matching

Health insurance

Dental insurance

Vision insurance

Life insurance

Paid time off

Job summary

JetHead Development Inc. is seeking a Data Engineer to design and run data pipelines, streaming systems, and a hybrid cloud infrastructure in support of analytics and operational decisions.

You will build streaming and batch pipelines with Python, Flink, and Kafka, connect data sources via Kafka Connect and MSK, and enable SQL access through Athena. The role requires working hybrid in Carlsbad, CA, with on-site presence as needed.

Qualifications

• Practical Python skills and experience with structured data.
• Experience building data pipelines ingesting, transforming, and storing data.
• Familiarity with containerization and CI/CD practices.
• Understanding of Kafka or equivalent event-streaming concepts.
• Knowledge of SQL and Git with collaborative development.

Responsibilities

• Build and maintain streaming and batch data pipelines using Python, Flink, and Kafka.
• Connect data sources with Kafka Connect and AWS MSK.
• Create datasets with Iceberg and enable SQL access via Athena.
• Implement data validation, schema evolution, and error handling.
• Package, deploy, and operate apps with Docker, Kubernetes, and AWS EKS.
• Enable repeatable releases using Helm, Terraform, and GitHub Actions.
• Monitor pipeline health with Prometheus and Grafana.
• Collaborate with analysts and customers to clarify requirements.

Skills

Python

SQL

Data pipelines

Event streaming

CI/CD

Tools

Apache Flink

Kafka

Kafka Connect

Iceberg

Athena

Docker

Kubernetes

AWS EKS

Helm

Terraform

GitHub Actions

Prometheus

Grafana

Git

Job description

JetHead Development Inc. is seeking a Data Engineer to design and run data pipelines, streaming systems, and a hybrid cloud infrastructure in support of analytics and operational decisions.

You will build streaming and batch pipelines with Python, Flink, and Kafka, connect data sources via Kafka Connect and MSK, and enable SQL access through Athena. The role requires working hybrid in Carlsbad, CA, with on-site presence as needed.