Data Engineer - Python Pipelines & AWS

Caterpillar Financial Services Corporation; Peoria (IL); On-site; USD 98,000 - 158,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k) plans

HSA

FSAs

Career development

Incentive bonus

Job summary

Caterpillar Inc. is seeking a Data Engineer to join its Platform Data Engineering team in Chicago, IL or Peoria, IL. The role focuses on developing Python data pipelines that power business data objects for applications and requires strong OO design and modern software practices.

You will build and deploy CI/CD pipelines, implement mapping logic, and ensure robust unit and integration tests while collaborating with cross-functional teams to deliver scalable data solutions.

Qualifications

• Proficiency in Python and OO design.
• Experience designing and building data pipelines.
• Familiarity with Git version control and CI/CD tools.
• Experience with AWS services (Lambda, S3, DynamoDB, RDS).
• Knowledge of relational or NoSQL databases.

Responsibilities

• Develop Python data pipelines to build business data objects for apps.
• Build and deploy CI/CD pipelines.
• Implement source-to-target mapping in pipeline code.
• Perform unit and integration testing and ensure code quality.
• Collaborate with cross-functional teams to deliver solutions.

Skills

OOP principles

Python

Git

CI/CD

AWS

SQL/NoSQL

Communication

Tools

Jenkins

Github Actions

Azure DevOps

Job description

Caterpillar Inc. is seeking a Data Engineer to join its Platform Data Engineering team in Chicago, IL or Peoria, IL. The role focuses on developing Python data pipelines that power business data objects for applications and requires strong OO design and modern software practices.

You will build and deploy CI/CD pipelines, implement mapping logic, and ensure robust unit and integration tests while collaborating with cross-functional teams to deliver scalable data solutions.