Java Developer, Data Ingestion Pipelines (Kubernetes, Kafka, Snowflake)

Programmers.io; Bellevue (WA); In loco; USD 120.000 - 160.000; Tempo pieno

Descrizione del lavoro

Programmers in Bellevue, WA is seeking a Java developer to build and maintain data ingestion pipelines that move data from source systems into Kafka and then into Snowflake. Pipelines run on Kubernetes, and you will own them from development through production support.

You will work with data engineers and downstream teams, write tests, set up CI/CD, and maintain documentation while ensuring reliability and low latency across the data flow.

Competenze

• 5+ years of Java development experience.
• Hands-on with Kubernetes and Docker.
• Strong Apache Kafka experience (producers/consumers/Kafka Connect).
• Snowflake data loading knowledge.

Mansioni

• Build and maintain Java services to ingest data and publish to Kafka.
• Move data from Kafka to Snowflake using Connect or custom consumers.
• Deploy and run on Kubernetes with Docker and Helm.
• Handle retries, duplicates, and failed messages.
• Monitor pipelines and fix production issues.
• Write tests, CI/CD, and maintain docs.
• Onboard new sources with data engineers.

Conoscenze

Java

Kubernetes

Docker

Apache Kafka

Snowflake

Strumenti

Kafka Connect

Descrizione del lavoro

Location: Bellevue, WA

Type: Full-Time

About the Role

We need a Java developer to build and maintain data ingestion pipelines that move data from source systems into Kafka and then into Snowflake. Pipelines run on Kubernetes, and you will own them from development through production support.

Responsibilities

• Build and maintain Java services that ingest data from source systems and publish to Kafka.
• Deliver data from Kafka to Snowflake using Kafka Connect, Snowpipe, or custom consumers.
• Deploy and run applications on Kubernetes using Docker and Helm.
• Handle schema changes, retries, duplicates, and failed messages.
• Monitor pipelines (throughput, lag, errors) and fix production issues.
• Write tests, set up CI/CD, and maintain documentation.
• Work with data engineers and downstream teams to onboard new sources.

Required Skills

• 5+ years of Java development (Spring Boot or similar).
• Hands-on experience with Kubernetes and Docker.
• Strong experience with Apache Kafka (producers, consumers, Kafka Connect).
• Working knowledge of Snowflake data loading.