Senior Lead Data Engineer

Caterpillar Inc

Chicago (IL)

On-site

USD 128,000 - 209,000

Full time

5 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical benefits
PTO
401(k)
Health Savings Account
Training & development
Incentive bonus

Job summary

Caterpillar Inc. in Chicago, IL is seeking a Senior Lead Data Engineer to architect and deliver Python data pipelines that power enterprise applications and analytics.

You will join Cat Digital's Data Engineering team and collaborate with yellow-iron partners and dealers to enable scalable data platforms. Ideal candidates bring strong Python development, experience building end-to-end data pipelines, and a track record with CI/CD, AWS, and Snowflake.

Qualifications

  • Proven Python development experience.
  • Git version control on medium to large teams.
  • CI/CD tools experience (Jenkins, Github Actions, Azure DevOps).
  • Experience with AWS services (Lambda, Kinesis, EventBridge, CloudWatch, CloudFormation, DynamoDB, S3, SageMaker, IAM, RDS).
  • Experience with Snowflake.
  • Hands-on with GenAI developer tools and AI coding assistants.

Responsibilities

  • Develop Python data pipelines to build business data objects.
  • Build and deploy CI/CD pipelines.
  • Interpret design requirements for engineering implementation.
  • Perform unit and integration testing.
  • Maintain high software quality with best practices.
  • Identify growth areas and contribute to team improvements.

Skills

Python development
Git version control
CI/CD
AWS
Snowflake
GenAI tools
AI coding assistants

Tools

Jenkins
Github Actions
Azure DevOps
SageMaker

Job description

Career Area:

Technology, Digital and Data

Job Description:
Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Cat Digital is the digital and technology arm of Caterpillar Inc., leveraging the latest technologies to build industry leading digital solutions for our customers and dealers. With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics, and AI capabilities to help our customers build a better, more sustainable world.

Job Summary:

Our global team is responsible for bringing digital capabilities to Caterpillar's world-famous yellow iron. Working with your yellow partners and Cat Dealers, we execute key components of digital and marketing portfolios, including global marketing & brand, enterprise data, analytics and AI, equipment management, eCommerce, digital marketing, rental & used digital solutions, and aftermarket leads & insights.

As a Senior Lead Data Engineer on the Data Engineering team, you will be responsible for developing Python data pipelines that build business data objects used to support applications

What You Will Do:
  • Responsibilities of the incumbents are across functional lines with individuals assigned in new program development.
  • Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
  • Works directly on complex application/technical problem identification and resolution.
  • Interpreting design requirements for engineering implementation
  • Building and deploying CICD pipelines
  • Implementing source to target mapping as pipeline code
  • Responsibility for Unit and Integration testing
  • Maintains high standards of software quality within the team by establishing good practices and habits
  • Identifies and encourage areas for growth and improvement within the team
  • Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.
What You Will Have:
  • Software Development Strong expertise in software development tools and activities; ability to produce software products or systems in line with product requirements.
  • Software Development Life Cycle: Strong expertise in software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace.
  • Software Product Design/Architecture: Strong expertise in software product design; ability to convert market requirements into the software product design.
  • Software Product Technical Knowledge: Strong expertise in technical aspects of a software products; ability to design, configure and integrate technical aspects of software products.
  • Software Product Testing: Strong expertise in software product testing; ability to design, plan, and execute testing strategies and tactics to ensure software product quality and adherence to stated requirements.
Considerations For Top Candidates:
  • Software development experience and solid knowledge of OOP principles
  • Experience in designing and developing software applications in Python
  • Experience working with Git version control on medium to large teams
  • Deploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops etc.
  • Experience with AWS components such as Lambda, Kinesis, Event Bridge, CloudWatch, CloudFormation, Dynamo, Fargate, S3, Sage Maker, IAM and RDS
  • Experience working with Snowflake
  • Hands-on experience with GenAI developer tools
  • Experience with tools such as GitHub Copilot or Claude Code, or similar AI coding assistants to improve developer productivity, code quality, and delivery speed
Additional Details:
  • This position requires the candidate to be in Chicago, IL
  • Domestic relocation assistance is NOT available for this position
  • Visa sponsorship is available with this position
Summary Pay Range:

$128,470.00 - $208,770.00

Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.

Benefits:

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.

  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

* These benefits also apply to part-time employees

Visa sponsorship is available for eligible applicants.

Posting Dates:

Any offer of employment is conditioned upon the successful completion of a drug screen.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Lead Data Engineer
Senior Lead Data Engineer

Caterpillar Financial Services Corporation • Chicago (IL)

On-site
USD 128,000 - 209,000
Medical, dental, and vision benefits
401(k) savings plans
Health Savings Account (HSA)
+8
Senior Lead Data Engineer
Senior Lead Data Engineer

Caterpillar Inc. • Chicago (IL)

On-site
USD 128,000 - 209,000
Medical benefits
Dental benefits
Vision benefits
+10
Senior Software Engineer
Senior Software Engineer

Caterpillar Inc. • Peoria (IL)

On-site
USD 113,000 - 183,000
Medical benefits
Paid time off
401(k) plan
+7
Senior Lead Data Engineer
Senior Lead Data Engineer

Caterpillar Brazil • Chicago (IL), Northern (KY)

Hybrid
USD 128,000 - 209,000
Medical, dental, and vision benefits
Paid time off
401(k) savings plans
+1
Senior Software Engineer
Senior Software Engineer

Caterpillar Brazil • Chicago (IL), Northern (KY)

Hybrid
USD 113,000 - 183,000
Medical, dental, and vision benefits
Paid time off plan
401(k) plans
+4
Lead Data Engineer – Physical AI Platform, Data Engineering
Lead Data Engineer – Physical AI Platform, Data Engineering

Caterpillar Inc. • Irving (TX)

On-site
USD 128,000 - 209,000
Medical, dental, and vision benefits
Paid time off
401(k) matching
+2
Senior Data Engineer – Physical AI Platform, Data Engineering
Senior Data Engineer – Physical AI Platform, Data Engineering

Caterpillar Inc. • Chicago (IL)

On-site
USD 113,000 - 183,000
Medical, dental, and vision benefits
401(k) savings plan
Tuition Reimbursement
+1
Data Engineer
Data Engineer

Caterpillar Financial Services Corporation • Chicago (IL)

On-site
USD 89,000 - 145,000
Medical benefits
Dental benefits
Vision benefits
+11
Senior Data Engineer
Senior Data Engineer

Caterpillar Inc. • Peoria (IL)

On-site
USD 112,000 - 184,000
Medical, dental, and vision benefits
Paid time off
401(k) savings plans
+8
Senior Software Engineer
Senior Software Engineer

Caterpillar Brazil • Peoria (IL)

On-site
USD 113,000 - 183,000
Medical benefits
401(k) savings plans
Health Savings Account
+2