Sr. Confluent Kafka Developer

BCforward; Minneapolis (MN); On-site; USD 90,000 - 103,000; Full time

Job summary

BCforward seeks a Sr. Confluent Kafka Developer to join our team in Minneapolis, MN. You will design, build, and operate scalable streaming pipelines using Confluent Kafka and Apache Flink for high-performance applications.

The role requires 3+ years in distributed systems, 2+ years in Python for Kafka apps, and hands-on experience with Schema Registry, Terraform, and AWS services. You will collaborate with data engineering to ensure data quality and reliability.

Qualifications

• 3 years in software development focused on Apache Kafka and distributed systems.
• 2 years of Python experience for Kafka applications.
• Hands-on Confluent Kafka with Schema Registry.
• Infrastructure as Code with Terraform.
• Experience with AWS services such as EC2, S3, IAM, and Lambda.
• Knowledge of data integration, ETL, and pipeline orchestration.
• Operational monitoring and performance tuning of streaming pipelines.
• Strong troubleshooting skills across Kafka and its ecosystem.
• Analytical problem-solving, attention to detail, and clear communication.
• Proven collaboration in cross-functional team environments.

Responsibilities

• Develop, implement, and manage streaming data pipelines using Confluent Kafka and Apache Flink.
• Integrate streaming solutions with AWS and Snowflake platforms in collaboration with data engineering teams.
• Design, build, and maintain real-time pipelines with a focus on data quality, integrity, and reliability.
• Use Terraform to manage and automate infrastructure deployments on AWS or other clouds.
• Develop and maintain CI/CD pipelines for Kafka clusters and related services.
• Collaborate with development, DevOps, and data science teams to deliver optimal data solutions.
• Provide support and guidance on Kafka issues, patterns, and best practices.
• Evaluate new Kafka and streaming technologies and recommend improvements.

Skills

Apache Kafka

Python

Schema Registry

Data integration

ETL

Pipeline orchestration

Monitoring

Troubleshooting

Cross-functional collaboration

Communication

Tools

Terraform

AWS

Docker

Kubernetes

Kafka Connect

ksqlDB

Snowflake

Job description

Job Title: Sr. Confluent Kafka Developer

Location: Minneapolis, MN

Duration: Temp – 10 months

Pay Range: $65/hr $75/hr (W2)

Job ID: 409880

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking a Confluent Cloud Kafka Developer to join our dynamic team. The ideal candidate will have strong experience in Apache Kafka, Confluent Cloud, distributed streaming, and real-time data integrations and a proven ability to design, build, and operate scalable streaming pipelines for high-performance applications.

Responsibilities:

• Develop, implement, and manage streaming data pipelines using Confluent Kafka and Apache Flink.
• Integrate streaming solutions with AWS and Snowflake platforms in collaboration with data engineering teams.
• Design, build, and maintain real-time pipelines with a focus on data quality, integrity, and reliability.
• Use Terraform to manage and automate infrastructure deployments on AWS or other clouds.
• Develop and maintain CI/CD pipelines for Kafka clusters and related services.
• Collaborate with development, DevOps, and data science teams to deliver optimal data solutions.
• Provide support and guidance on Kafka issues, patterns, and best practices.
• Evaluate new Kafka and streaming technologies and recommend improvements.

Required Skills & Qualifications:

• 3 years in software development focused on Apache Kafka and distributed systems.
• 2 years of Python experience for Kafka applications.
• Hands-on Confluent Kafka with Schema Registry.
• Infrastructure as Code with Terraform.
• Experience with AWS services such as EC2, S3, IAM, and Lambda.
• Knowledge of data integration, ETL, and pipeline orchestration.
• Operational monitoring and performance tuning of streaming pipelines.
• Strong troubleshooting skills across Kafka and its ecosystem.
• Analytical problem-solving, attention to detail, and clear communication.
• Proven collaboration in cross-functional team environments.

Preferred Skills:

• 2 years with Confluent Cloud delivering Kafka-based solutions.
• Proficiency with Apache Flink, ksqlDB, and Kafka Connect.
• Working knowledge of Snowflake for cloud analytics.
• Strong Java skills for scalable event-driven applications.
• Experience with additional streaming tools or platforms.
• Familiarity with CI/CD, Docker, and Kubernetes for cloud-native delivery.
• Certifications in AWS, Apache Kafka, or related technologies.

Why BCforward?

At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:

• Competitive compensation and benefits
• Opportunities for growth with global clients
• A supportive, inclusive culture that values innovation and people
• Exposure to cutting-edge technologies and projects

About Our Commitment

BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.