Senior Lead Data Engineer — Python Pipelines & GenAI

Caterpillar Inc; Chicago (IL); On-site; USD 128,000 - 209,000; Full time

Benefits offered by this job

Medical benefits

PTO

401(k)

Health Savings Account

Training & development

Incentive bonus

Job summary

Caterpillar Inc. in Chicago, IL is seeking a Senior Lead Data Engineer to architect and deliver Python data pipelines that power enterprise applications and analytics.

You will join Cat Digital's Data Engineering team and collaborate with yellow-iron partners and dealers to enable scalable data platforms. Ideal candidates bring strong Python development, experience building end-to-end data pipelines, and a track record with CI/CD, AWS, and Snowflake.

Qualifications

• Proven Python development experience.
• Git version control on medium to large teams.
• CI/CD tools experience (Jenkins, Github Actions, Azure DevOps).
• Experience with AWS services (Lambda, Kinesis, EventBridge, CloudWatch, CloudFormation, DynamoDB, S3, SageMaker, IAM, RDS).
• Experience with Snowflake.
• Hands-on with GenAI developer tools and AI coding assistants.

Responsibilities

• Develop Python data pipelines to build business data objects.
• Build and deploy CI/CD pipelines.
• Interpret design requirements for engineering implementation.
• Perform unit and integration testing.
• Maintain high software quality with best practices.
• Identify growth areas and contribute to team improvements.

Skills

Python development

Git version control

CI/CD

AWS

Snowflake

GenAI tools

AI coding assistants

Tools

Jenkins

Github Actions

Azure DevOps

SageMaker

Job description

Caterpillar Inc. in Chicago, IL is seeking a Senior Lead Data Engineer to architect and deliver Python data pipelines that power enterprise applications and analytics.

You will join Cat Digital's Data Engineering team and collaborate with yellow-iron partners and dealers to enable scalable data platforms. Ideal candidates bring strong Python development, experience building end-to-end data pipelines, and a track record with CI/CD, AWS, and Snowflake.