Lead Data Engineer – Physical AI Platform (Edge & Cloud)

Caterpillar Brazil; Chicago, Northern (IL, KY); Hybrid; USD 128,000 - 209,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plans

Paid time off

Job summary

Caterpillar Inc. is seeking a Lead Data Engineer for the Physical AI Platform in Chicago. You will design, build, and scale data pipelines and cloud-based data platforms, enabling real-time and batch processing for enterprise systems.

You will lead architecture, collaborate with software engineers, and ensure data quality, reliability, and observability across distributed environments.

Qualifications

• Bachelor's degree required in a technical field.
• 8+ years in data engineering with increasing responsibility.
• Experience with large scale Caterpillar data platforms is a plus.

Responsibilities

• Design, build, and maintain scalable data pipelines and microservices.
• Lead cloud-native data ingestion and streaming solutions.
• Drive data architecture and continuous improvement across platforms.
• Collaborate with engineers and stakeholders to translate requirements into scalable data designs.
• Establish automated testing and data quality controls.

Skills

Python

AWS

SQL

Data Pipelines

Java

Education

Bachelor's degree in CS/CE or related field

Tools

Kinesis

S3

DynamoDB

EventBridge

CI/CD (Azure DevOps/Jira/Jenkins)

Job description

Caterpillar Inc. is seeking a Lead Data Engineer for the Physical AI Platform in Chicago. You will design, build, and scale data pipelines and cloud-based data platforms, enabling real-time and batch processing for enterprise systems.

You will lead architecture, collaborate with software engineers, and ensure data quality, reliability, and observability across distributed environments.