Data Engineering Lead: Real-Time Cloud Pipelines

Capgemini; Irving (TX); On-site; USD 72,000 - 112,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Retirement benefits

Job summary

Capgemini in Irving, TX seeks a senior Data Engineer to define architectures for scalable data pipelines and microservices. You will own Python-based implementations, cloud-native ingestion, and real-time as well as batch processing across enterprise platforms.

The role requires strong AWS experience, SQL data quality practices, and leadership of data-focused engineering teams. Expect collaboration with business, product, and engineering stakeholders in a demanding environment.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or related field.
• 8+ years of experience in data engineering or related disciplines with increasing responsibility.
• Strong experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge).
• Strong foundation developing and deploying Python solutions to a production environment.
• Experience leading teams to build high-throughput, scalable data pipelines.
• Experience with CI/CD tools such as Azure DevOps, Jira, Jenkins.
• Experience developing data integration frameworks and source data pipelines.
• Strong SQL including data quality and validation practices.

Responsibilities

• Actively collaborate with Principal Software Engineers and Data Architects to define solution architecture.
• Lead the solution design and optimization of scalable data pipelines and microservices in Python.
• Drive cloud-native data ingestion and streaming solutions on AWS such as Kinesis and S3.
• Own data integration frameworks and source data pipelines for CI Autonomy initiatives.
• Partner with stakeholders to translate requirements into scalable architectures and designs.
• Establish automated testing, data quality controls, and validation frameworks.
• Lead monitoring, performance tuning, and root-cause analysis with CloudWatch.

Skills

Python

AWS data services

Data pipelines

Microservices

SQL

CI/CD

Leadership

Observability

Education

Bachelor's degree in Computer Science or Computer Engineering

Tools

Kinesis

S3

DynamoDB

EventBridge

Azure DevOps

Jira

Jenkins

Job description

Capgemini in Irving, TX seeks a senior Data Engineer to define architectures for scalable data pipelines and microservices. You will own Python-based implementations, cloud-native ingestion, and real-time as well as batch processing across enterprise platforms.

The role requires strong AWS experience, SQL data quality practices, and leadership of data-focused engineering teams. Expect collaboration with business, product, and engineering stakeholders in a demanding environment.