Data Engineer (On-Premise and Hybrid)

JetHead Development Inc.; Carlsbad (CA); Hybrid; USD 90,000 - 190,000; Full time

Benefits offered by this job

401k matching

Health insurance

Dental insurance

Vision insurance

Life insurance

Paid time off

Job summary

JetHead Development Inc. is seeking a Data Engineer to design and run data pipelines, streaming systems, and a hybrid cloud infrastructure in support of analytics and operational decisions.

You will build streaming and batch pipelines with Python, Flink, and Kafka, connect data sources via Kafka Connect and MSK, and enable SQL access through Athena. The role requires working hybrid in Carlsbad, CA, with on-site presence as needed.

Qualifications

• Practical Python skills and experience with structured data.
• Experience building data pipelines ingesting, transforming, and storing data.
• Familiarity with containerization and CI/CD practices.
• Understanding of Kafka or equivalent event-streaming concepts.
• Knowledge of SQL and Git with collaborative development.

Responsibilities

• Build and maintain streaming and batch data pipelines using Python, Flink, and Kafka.
• Connect data sources with Kafka Connect and AWS MSK.
• Create datasets with Iceberg and enable SQL access via Athena.
• Implement data validation, schema evolution, and error handling.
• Package, deploy, and operate apps with Docker, Kubernetes, and AWS EKS.
• Enable repeatable releases using Helm, Terraform, and GitHub Actions.
• Monitor pipeline health with Prometheus and Grafana.
• Collaborate with analysts and customers to clarify requirements.

Skills

Python

SQL

Data pipelines

Event streaming

CI/CD

Tools

Apache Flink

Kafka

Kafka Connect

Iceberg

Athena

Docker

Kubernetes

AWS EKS

Helm

Terraform

GitHub Actions

Prometheus

Grafana

Git

Job description

JetHead Development Inc. is hiring a Data Engineer to design and run data pipelines, streaming systems, and hybrid cloud infrastructure in support of analytics and operational decisions.

Responsibilities

• Build and maintain streaming and batch data pipelines using Python, Apache Flink, and Kafka
• Connect data sources using Kafka Connect and AWS Managed Streaming for Apache Kafka (Amazon MSK)
• Create and maintain datasets with Apache Iceberg and enable SQL access through Amazon Athena
• Implement data validation, schema evolution, and error handling to keep pipelines dependable as upstream data changes
• Package, deploy, and operate applications with Docker, Kubernetes, and AWS EKS
• Enable repeatable releases using Helm, Terraform, and GitHub Actions
• Track pipeline health, performance, and failures with Prometheus and Grafana
• Partner with analysts and customers to clarify requirements, troubleshoot issues, and document solutions

Requirements

• Practical Python skills and experience working with structured data
• Experience building data pipelines or applications that ingest, transform, and store data
• Familiarity with containerization and CI/CD practices
• Understanding of Kafka or equivalent event-streaming concepts
• Familiarity with data schemas, data quality checks, and managing data format changes
• Foundational knowledge of cloud infrastructure including compute, storage, networking, and access controls
• Working knowledge of SQL and Git with collaborative development practices
• Strong problem-solving, documentation, and interpersonal skills
• Ability to work a hybrid schedule with on-site time in Carlsbad, CA
• Authorization to work in the United States without employer sponsorship

Technologies

• Python
• Apache Flink
• Kafka
• Kafka Connect
• AWS Managed Streaming for Apache Kafka (Amazon MSK)
• Apache Iceberg
• Amazon Athena
• Docker
• Kubernetes
• AWS EKS
• Helm
• Terraform
• GitHub Actions
• Prometheus
• Grafana
• SQL
• Git

Preferred Qualifications

• Hands-on experience with Apache Flink, Kafka Connect, Apache Iceberg, Athena, or AWS Batch
• Experience with Kubernetes, Helm, Terraform, and GitHub Actions
• Familiarity with Prometheus and Grafana
• Experience with specification-driven development, including tools such as OpenSpec
• Familiarity with Model Context Protocol (MCP) and preparing documented, governed datasets for access through MCP tools
• Knowledge of network or satellite systems

Benefits

• 401(k) retirement plan with employer matching
• Medical, dental, and vision coverage
• Health savings account
• Life insurance
• Paid time off
• 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Vision insurance

Job Details

• Job type: Full-time
• Compensation: $90,000.00 - $190,000.00 per year
• Work location: Hybrid remote in Carlsbad, CA 92008
• Commute: Carlsbad, CA 92008 (Required)
• Relocation: Carlsbad, CA 92008 (Relocate before starting work, Required)