Senior Data Engineer — Physical AI Platform & Cloud Pipelines

Caterpillar Inc.; Chicago (IL); On-site; USD 113,000 - 183,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plan

Tuition Reimbursement

Relocation assistance

Job summary

Caterpillar Inc. is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data platforms that deliver reliable, high-quality data for business and engineering teams.

Working in an agile environment, you will help develop data architecture, performance, reliability, and continuous improvement across modern data solutions. In this role, you will collaborate with engineers, data architects, and stakeholders to translate complex requirements into

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or related field.
• 5+ years of experience in data engineering or related disciplines with increasing responsibility.
• Experience with modern Caterpillar data platforms such as Helios Data Platform.
• Strong Python solutions deployed to production environments.
• Experience leading teams to build high-throughput, scalable data pipelines.
• Experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.).
• Strong SQL skills with data quality and validation practices.
• Experience with CI/CD tools (Azure DevOps, Jira, Jenkins).
• Experience developing microservices for real-time data ingestion.
• Ability to ensure data integrity across distributed systems.

Responsibilities

• Actively collaborate with Lead Software Engineers and Data Architects to define and implement solution architecture.
• Implement scalable data pipelines and microservices in Python for real-time and batch processing across enterprise platforms.
• Lead cloud-native data ingestion and streaming solutions using AWS services such as Kinesis, S3, DynamoDB, EventBridge.
• Design and operate data integration frameworks and source data pipelines supporting autonomy initiatives.
• Translate complex requirements into scalable data architectures, workflows, mappings and designs.
• Establish automated testing, data quality controls, and validation frameworks for data integrity.

Skills

Solution architecture

Collaborative teamwork

Data-driven decision making

Communication

Problem solving

Agile methodologies

Mentoring

Education

Bachelor’s degree in Computer Science or related field

Tools

Python

Java

AWS

SQL

CI/CD tools (Azure DevOps, Jira, Jenkins)

Job description

Caterpillar Inc. is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data platforms that deliver reliable, high-quality data for business and engineering teams.

Working in an agile environment, you will help develop data architecture, performance, reliability, and continuous improvement across modern data solutions. In this role, you will collaborate with engineers, data architects, and stakeholders to translate complex requirements into