Senior Lead Data Engineer - Scalable Python Pipelines & AI

Caterpillar Inc.; Chicago (IL); On-site; USD 128,000 - 209,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Paid time off

401(k)

HSA

FSAs

Career development

Incentive bonus

Disability benefits

Life Insurance

Parental leave

Tuition Reimbursement

Job summary

Caterpillar Inc. in Chicago, IL seeks a Senior Lead Data Engineer to advance Cat Digital’s data platforms, analytics, and AI initiatives. You will build Python data pipelines and collaborate with partners to enable applications that drive customer value.

Responsibilities include building and deploying CI/CD pipelines, implementing source-to-target mappings, and ensuring test quality, while mentoring teammates in a fast‑paced, global team.

Qualifications

• Proficient in Python for data engineering and analytics.
• Experience building scalable data pipelines and data models.
• Strong understanding of CI/CD and software testing.
• Familiarity with cloud platforms and data warehouse technologies.

Responsibilities

• Develop Python data pipelines and data objects to support applications.
• Build and deploy CI/CD pipelines and automate workflows.
• Implement source-to-target mappings within pipelines.
• Perform unit and integration testing and ensure code quality.
• Mentor team members and promote engineering best practices.

Skills

Python

Data pipelines

Git

CI/CD

AWS

Snowflake

GenAI

Cloud services

Tools

Jenkins

Github Actions

Azure DevOps

Terraform

GitHub Copilot

Claude Code

Job description

Caterpillar Inc. in Chicago, IL seeks a Senior Lead Data Engineer to advance Cat Digital’s data platforms, analytics, and AI initiatives. You will build Python data pipelines and collaborate with partners to enable applications that drive customer value.

Responsibilities include building and deploying CI/CD pipelines, implementing source-to-target mappings, and ensuring test quality, while mentoring teammates in a fast‑paced, global team.