Hybrid Real-Time Data Engineer: AWS + Kafka

Capgemini; Atlanta (GA); Hybrid; USD 89.000 - 166.000; Vollzeit

Benefits dieser Stelle

Paid time off

Medical and dental coverage

401(k) retirement plans

Life and disability insurance

Zusammenfassung

Capgemini in the United States is seeking an experienced data/software engineer to design, build, and deploy real-time and batch data pipelines. You will integrate ERP data with data lakes and platforms, using Kafka, Kafka Connect, and stream processing engines to handle CDC and transactional data.

You will develop resilient microservices in Java and Spring Boot, containerize with Docker, and orchestrate deployments with Kubernetes, while configuring IaC with Terraform or CloudFormation and

Qualifikationen

• 10+ years of software/data engineering experience.
• Strong proficiency in AWS, Kafka, Java, Spring Boot, Python.
• Expertise in AWS Managed Kafka.
• Experience with PostgreSQL, MySQL, SQL Server, and Oracle.

Aufgaben

• Design, build, and deploy real-time and batch data pipelines integrating ERP with data lakes and platforms.
• Leverage Kafka, Kafka Connect, and stream processing engines to process CDC and transactional data.
• Build resilient microservices and integration layers using Java and Spring Boot to orchestrate data flows and APIs.
• Package applications into Docker containers and deploy with Kubernetes, including service discovery.
• Manage multi-database environments across PostgreSQL, MySQL, SQL Server, and Oracle.
• Configure IaC with Terraform or AWS CloudFormation and build CI/CD with GitHub Actions.
• Set up end-to-end monitoring and alerting with DataDog, New Relic, or Splunk.

Kenntnisse

Data engineering

AWS

Kafka

Java

Spring Boot

Python

PostgreSQL

MySQL

SQL Server

Oracle

Kubernetes

Terraform

Tools

Docker

Kubernetes

GitHub Actions

Terraform

AWS CloudFormation

DataDog

New Relic

Splunk

Jobbeschreibung

Capgemini in the United States is seeking an experienced data/software engineer to design, build, and deploy real-time and batch data pipelines. You will integrate ERP data with data lakes and platforms, using Kafka, Kafka Connect, and stream processing engines to handle CDC and transactional data.

You will develop resilient microservices in Java and Spring Boot, containerize with Docker, and orchestrate deployments with Kubernetes, while configuring IaC with Terraform or CloudFormation and