Senior Data Engineer - Autonomous Construction AI Platform

Caterpillar; Chicago (IL); On-site; USD 120,000 - 180,000; Full time

Job summary

Caterpillar is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data platforms in an agile environment. You will work across teams to ensure data reliability and availability for business and engineering needs.

In this role you’ll implement real-time and batch processing using AWS services and help shape data architectures that support autonomous construction technologies and scalable analytics across global operations.

Qualifications

• Experience designing scalable data architectures.
• Strong collaboration across engineering and product teams.
• Proficiency in Python/Java and backend data systems.
• Experience with Agile development lifecycle.
• Ability to translate complex requirements into data workflows.

Responsibilities

• Collaborate with Lead Software Engineers to define solution architecture.
• Implement scalable data pipelines and microservices in Python.
• Develop cloud-native data ingestion and streaming solutions using AWS services.
• Lead data integration frameworks and source data pipelines for autonomy initiatives.
• Partner with stakeholders to translate requirements into scalable designs.
• Establish automated testing, data quality controls, and validation frameworks.
• Implement monitoring and performance tuning of production data platforms.

Skills

Python

Java

Data pipelines

Cloud-native

Real-time processing

Distributed systems

Agile

Communication skills

Tools

AWS

Kinesis

S3

DynamoDB

EventBridge

CloudWatch

Job description

Caterpillar is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data platforms in an agile environment. You will work across teams to ensure data reliability and availability for business and engineering needs.

In this role you’ll implement real-time and batch processing using AWS services and help shape data architectures that support autonomous construction technologies and scalable analytics across global operations.