Senior Lead Data Engineer

Caterpillar Brazil; Chicago, Northern (IL, KY); Hybrid; USD 128,000 - 209,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

Paid time off

401(k) savings plans

Health Savings Account (HSA)

Job summary

Caterpillar Inc. is seeking a Senior Lead Data Engineer to develop Python data pipelines that support digital and data capabilities for Caterpillar’s global operations. The role focuses on building scalable data flows, CI/CD automation, and leveraging AWS services and GenAI tooling within a Chicago-based team.

You will work closely with Cat Digital to deliver data-driven solutions across applications, analytics, and AI initiatives, contributing to a sustainable, connected product ecosystem.

Qualifications

• Experience designing and developing software applications in Python.
• Hands-on experience with CI/CD tooling and pipelines.

Responsibilities

• Develop Python data pipelines to build business data objects.
• Build and deploy CI/CD pipelines for data engineering workloads.
• Collaborate with Cat Dealers and partners on digital portfolio initiatives.
• Ensure software quality through unit and integration testing.

Skills

Python development

Git version control

CI/CD pipelines

AWS components

Snowflake

GenAI tooling

Tools

AWS Lambda

Kinesis

CloudWatch

SageMaker

GitHub Copilot

Claude Code

Job description

Career Area: Technology, Digital and Data Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it. Cat Digital is the digital and technology arm of Caterpillar Inc., leveraging the latest technologies to build industry leading digital solutions for our customers and dealers. With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics, and AI capabilities to help our customers build a better, more sustainable world.

Job Summary:

Our global team is responsible for bringing digital capabilities to Caterpillar’s world-famous yellow iron. Working with your yellow partners and Cat Dealers, we execute key components of digital and marketing portfolios, including global marketing & brand, enterprise data, analytics and AI, equipment management, eCommerce, digital marketing, rental & used digital solutions, and aftermarket leads & insights. As a Senior Lead Data Engineer on the Data Engineering team, you will be responsible for developing Python data pipelines that build business data objects used to support applications

What You Will Do:

Responsibilities of the incumbents are across functional lines with individuals assigned in new program development. Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.

Works directly on complex application/technical problem identification and resolution.

Interpreting design requirements for engineering implementation Building and deploying CICD pipelines Implementing source to target mapping as pipeline code Responsibility for Unit and Integration testing Maintains high standards of software quality within the team by establishing good practices and habits Identifies and encourage areas for growth and improvement within the team Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.

What You Will Have:

Software Development Strong expertise in software development tools and activities; ability to produce software products or systems in line with product requirements.

Software Development Life Cycle: Strong expertise in software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace.

Software Product Design/Architecture: Strong expertise in software product design; ability to convert market requirements into the software product design.

Software Product Technical Knowledge: Strong expertise in technical aspects of a software products; ability to design, configure and integrate technical aspects of software products.

Software Product Testing: Strong expertise in software product testing; ability to design, plan, and execute testing strategies and tactics to ensure software product quality and adherence to stated requirements.

Considerations For Top Candidates:

Software development experience and solid knowledge of OOP principles Experience in designing and developing software applications in Python Experience working with Git version control on medium to large teams Deploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops etc. Experience with AWS components such as Lambda, Kinesis, Event Bridge, CloudWatch, CloudFormation, Dynamo, Fargate, S3, Sage Maker, IAM and RDS Experience working with Snowflake Hands‑on experience with GenAI developer tools Experience with tools such as GitHub Copilot or Claude Code, or similar AI coding assistants to improve developer productivity, code quality, and delivery speed

Additional Details:

This position requires the candidate to be in Chicago, IL Domestic relocation assistance is NOT available for this position Visa sponsorship is available with this position

Pay Range:

Summary Pay Range: $128,470.00 - $208,770.00 Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.

Benefits:

• Medical, dental, and vision benefits*
• Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
• 401(k) savings plans*
• Health Savings Account (HSA)*