Senior Data Engineer – AI-Driven Data Pipelines

Caterpillar Inc.; Chicago (IL); On-site; USD 113,000 - 183,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plans

Health Savings Account (HSA)

Flexible Spending Accounts (FSAs)

Career Development

Incentive bonus

Parental leave

Tuition Reimbursement

Job summary

Caterpillar Inc. is seeking a Senior Data Engineer to develop Python data pipelines and support a broad digital and data portfolio. You will work with global teams to deliver data-driven solutions powering applications across marketing, analytics, and operations.

The role emphasizes building scalable data pipelines, deploying CI/CD, and collaborating with teams across the enterprise. Onsite work is required in Chicago, IL, Peoria, IL, or Dallas, TX with competitive compensation and benefits.

Qualifications

• Experience designing data pipelines in Python.
• Experience with Git in medium to large teams.
• Proficient with CI/CD tooling and pipelines.
• Experience with AWS components (Lambda, Kinesis, etc.).
• Experience with Snowflake data warehouses.

Responsibilities

• Develop Python data pipelines to build business data objects used by applications.
• Collaborate across teams on new program development and complex problems.
• Build and deploy CI/CD pipelines to production.
• Implement source-to-target mapping as pipeline code.
• Conduct unit and integration testing to ensure quality.
• Maintain high standards of software quality with best practices.
• Mentor team members and identify areas for growth.

Skills

Python

Git

CI/CD

AWS

Snowflake

GenAI

AI tools

Tools

Jenkins

GitHub Actions

Azure DevOps

CloudFormation

SageMaker

Job description

Caterpillar Inc. is seeking a Senior Data Engineer to develop Python data pipelines and support a broad digital and data portfolio. You will work with global teams to deliver data-driven solutions powering applications across marketing, analytics, and operations.

The role emphasizes building scalable data pipelines, deploying CI/CD, and collaborating with teams across the enterprise. Onsite work is required in Chicago, IL, Peoria, IL, or Dallas, TX with competitive compensation and benefits.