Senior Lead Data Engineer — Python Data Pipelines

Caterpillar Financial Services Corporation; Chicago (IL); On-site; USD 128,000 - 209,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plans

Health Savings Account (HSA)

Flexible Spending Accounts (FSAs)

Career Development

Incentive bonus

Parental leave

Tuition Reimbursement

Disability benefits

Life Insurance

Adoption benefits

Job summary

Caterpillar Inc. is seeking a Senior Lead Data Engineer to join the Data Engineering team in Chicago.

You will develop Python data pipelines to support applications and leverage modern data platforms and automation features. You will build, test, and deploy CI/CD pipelines, interpret design requirements, and resolve complex technical problems across teams while ensuring high software quality and scalable data solutions.

Qualifications

• Software development experience and solid knowledge of OOP principles.
• Experience in designing and developing software applications in Python.
• Experience working with Git version control on medium to large teams.
• Deploying software using CI/CD tools such as Jenkins, Github Actions, Azure DevOps etc.
• Experience with AWS components such as Lambda, Kinesis, Event Bridge, CloudWatch, CloudFormation, Dynamo, Fargate, S3, Sage Maker, IAM and RDS
• Experience working with Snowflake
• Hands-on experience with GenAI developer tools
• Experience with tools such as GitHub Copilot or Claude Code, or similar AI coding assistants to improve developer productivity, code quality, and delivery speed

Responsibilities

• Responsibilities across functional lines with new program development.
• Perform complex programming, project management, and development tasks with minimal supervision.
• Work directly on complex application/technical problems and resolution.
• Interpret design requirements for engineering implementation.
• Build and deploy CI/CD pipelines.
• Implement source-to-target mapping as pipeline code.
• Responsible for unit and integration testing.
• Maintain high standards of software quality and best practices.
• Identify and encourage areas for growth and improvement within the team.
• Perform other duties as assigned by Caterpillar management.

Skills

Software Development

Software Development Life Cycle

Software Product Design/Architecture

Software Product Technical Knowledge

Software Product Testing

Tools

Git

Jenkins

GitHub Actions

Azure DevOps

AWS

Snowflake

GenAI tools

GitHub Copilot

Claude Code

Job description

Caterpillar Inc. is seeking a Senior Lead Data Engineer to join the Data Engineering team in Chicago.

You will develop Python data pipelines to support applications and leverage modern data platforms and automation features. You will build, test, and deploy CI/CD pipelines, interpret design requirements, and resolve complex technical problems across teams while ensuring high software quality and scalable data solutions.