Senior Lead Data Engineer — Python Pipelines & GenAI

Caterpillar Brazil; Chicago, Northern (IL, KY); Hybrid; USD 128,000 - 209,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

Paid time off

401(k) savings plans

Health Savings Account (HSA)

Job summary

Caterpillar Inc. is seeking a Senior Lead Data Engineer to develop Python data pipelines that support digital and data capabilities for Caterpillar’s global operations. The role focuses on building scalable data flows, CI/CD automation, and leveraging AWS services and GenAI tooling within a Chicago-based team.

You will work closely with Cat Digital to deliver data-driven solutions across applications, analytics, and AI initiatives, contributing to a sustainable, connected product ecosystem.

Qualifications

• Experience designing and developing software applications in Python.
• Hands-on experience with CI/CD tooling and pipelines.

Responsibilities

• Develop Python data pipelines to build business data objects.
• Build and deploy CI/CD pipelines for data engineering workloads.
• Collaborate with Cat Dealers and partners on digital portfolio initiatives.
• Ensure software quality through unit and integration testing.

Skills

Python development

Git version control

CI/CD pipelines

AWS components

Snowflake

GenAI tooling

Tools

AWS Lambda

Kinesis

CloudWatch

SageMaker

GitHub Copilot

Claude Code

Job description

Caterpillar Inc. is seeking a Senior Lead Data Engineer to develop Python data pipelines that support digital and data capabilities for Caterpillar’s global operations. The role focuses on building scalable data flows, CI/CD automation, and leveraging AWS services and GenAI tooling within a Chicago-based team.

You will work closely with Cat Digital to deliver data-driven solutions across applications, analytics, and AI initiatives, contributing to a sustainable, connected product ecosystem.