Senior Data Engineer - Python Pipelines & AWS Cloud

Cat (CaterpillarCareers); Chicago (IL); On-site; USD 113,000 - 183,000; Full time

Benefits offered by this job

Medical, dental, vision benefits

401(k) with company match

Paid time off

Onsite work environment

Job summary

Caterpillar Digital is hiring a Senior Data Engineer to develop Python data pipelines enabling business data objects for Caterpillar applications. You’ll build, test, and deploy scalable data solutions, collaborating across teams to deliver AI-ready analytics and digital capabilities.

You will use AWS services, Snowflake, and modern CI/CD tooling to ensure high-quality software and reliable data pipelines in a fast-paced environment.

Qualifications

• Experience designing and developing software applications in Python
• Experience with Git version control on medium to large teams
• Deploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops
• Experience with AWS components such as Lambda, Kinesis, EventBridge, CloudWatch, CloudFormation, Dynamo, Fargate, S3, SageMaker, IAM and RDS
• Experience working with Snowflake
• Hands-on experience with GenAI developer tools
• Experience with AI coding assistants like GitHub Copilot or Claude Code to improve productivity

Responsibilities

• Develop Python data pipelines that build data objects for applications
• Work across functional lines on new program development
• Create and manage CI/CD pipelines
• Interpret design requirements for engineering implementation
• Perform unit and integration testing
• Maintain high software quality through best practices and code reviews
• Identify growth opportunities within the team

Skills

Python

Git

CI/CD

AWS

Snowflake

GenAI tools

AI coding assistants

Tools

Jenkins

Github Actions

Azure DevOps

AWS Lambda

CloudFormation

DynamoDB

S3

SageMaker

IAM

RDS

Job description

Caterpillar Digital is hiring a Senior Data Engineer to develop Python data pipelines enabling business data objects for Caterpillar applications. You’ll build, test, and deploy scalable data solutions, collaborating across teams to deliver AI-ready analytics and digital capabilities.

You will use AWS services, Snowflake, and modern CI/CD tooling to ensure high-quality software and reliable data pipelines in a fast-paced environment.