AWS/Kafka Data Engineer - Senior Software Engineer

Capgemini; Atlanta (GA); Hybrid; USD 89,000 - 166,000; Full time

Benefits offered by this job

Paid time off 12-25 days

Medical, dental, and vision coverage

401(k) retirement plan

Life and disability insurance

Employee assistance programs

Job summary

Capgemini is seeking a Senior AWS and Kafka Data Engineer to design, build, and deploy real-time and batch data pipelines in a hybrid role across multiple U.S. locations, including Atlanta, GA.

You will leverage AWS, Kafka, Java, and Spring Boot to integrate ERP sources with data lakes and platforms. The role requires 10+ years of experience, strong hands-on with AWS Managed Kafka and PostgreSQL/MySQL/SQL Server/Oracle, and proficiency in containerization (Docker, Kubernetes) and IaC

Qualifications

• 10+ years of software and/or data engineering experience.
• Strong proficiency in AWS, Kafka, Java, Spring Boot, and Python.
• Experience with AWS Managed Kafka and multi-database systems (PostgreSQL, MySQL, SQL Server, Oracle).

Responsibilities

• Design, build, and deploy real-time and batch data pipelines across ERP sources with downstream data lakes.
• Use Apache Kafka, Kafka Connect, Kafka Streams or Apache Flink to process CDC and transactional data.
• Build microservices and integration layers using Java and Spring Boot.
• Containerize with Docker and deploy with Kubernetes.
• Optimize multi-database environments (PostgreSQL, MySQL, SQL Server, Oracle).
• Manage IaC with Terraform or AWS CloudFormation and implement CI/CD with GitHub Actions.
• Implement monitoring with DataDog, New Relic, or Splunk.

Skills

AWS

Kafka

Java

Spring Boot

Python

Tools

Docker

Kubernetes

Terraform

AWS CloudFormation

GitHub Actions

Job description

Capgemini is hiring a Senior AWS and Kafka Data Engineer to design, build, and deploy real-time and batch data pipelines. This hybrid position supports delivery across multiple U.S. locations, including Atlanta, and involves using AWS and Apache Kafka to integrate enterprise data sources with downstream data lakes and platforms.

Role Responsibilities

• Design, build, and deploy robust real-time and batch data pipelines that integrate disparate ERP sources with downstream data lakes and platforms.
• Use Apache Kafka, Kafka Connect, and stream processing engines such as Kafka Streams or Apache Flink to process and transform high-volume change data capture (CDC) and transactional data.
• Build resilient microservices and integration layers using Java and Spring Boot to coordinate complex data flows and enterprise APIs.
• Package applications into Docker containers and support scalable deployments using Kubernetes, including service discovery and container orchestration.
• Optimize multi-database environments across PostgreSQL, MySQL, SQL Server, and Oracle.
• Manage Infrastructure as Code with Terraform or AWS CloudFormation and implement automated CI/CD deployment pipelines using GitHub Actions.
• Implement end-to-end monitoring, APM, log management, and alerting using tools such as DataDog, New Relic, or Splunk to support pipeline health and transactional accuracy.

Required Qualifications

• 10+ years of software and/or data engineering experience.
• Strong proficiency in AWS, Kafka, Java, Spring Boot, and Python.
• Expertise in AWS Managed Kafka (data and integration), including experience designing and configuring AWS Managed Kafka.
• Experience working with PostgreSQL, MySQL, SQL Server, and Oracle.

Technologies

AWS, Apache Kafka, Kafka Connect, Kafka Streams, Apache Flink, Java, Spring Boot, Docker, Kubernetes, PostgreSQL, MySQL, SQL Server, Oracle, Terraform, AWS CloudFormation, GitHub Actions, DataDog, New Relic, Splunk, AWS Managed Kafka.

Compensation

The base compensation range for this role in the posted location is USD 89,400 - 166,398 per year.

In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws.

Benefits

• Paid time off based on employee grade (A-F): vacation 12-25 days depending on grade, plus company paid holidays, personal days, and sick leave.
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada).
• Retirement savings plans (for example, 401(k) in the U.S., RRSP in Canada).
• Life and disability insurance.
• Employee assistance programs.

Location

This is a hybrid role based across locations, including Atlanta, Dallas, Chicago, Nashville, and New Jersey. The posted location is Atlanta, GA 30305.