Data Engineer — Python Pipelines (On-site Chicago)

Caterpillar Inc.; Peoria (IL); On-site; USD 89,000 - 145,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plans

Health Savings Account

Job summary

Caterpillar Inc. is hiring a Data Engineer on the Platform Data Engineering team to develop Python data pipelines supporting applications.

You will work across functional lines, building and deploying CI/CD pipelines, and implementing data pipelines from source to target with strong emphasis on quality, testing, and performance. You will be part of a global team in Chicago or Peoria, contributing to scalable data solutions.

Qualifications

• Proficient in Python development and OO programming.
• Experience designing and developing Python data pipelines.
• Strong knowledge of software development lifecycle and best practices.

Responsibilities

• Develop Python data pipelines to build business data objects.
• Build and deploy CI/CD pipelines.
• Implement source to target mapping as pipeline code.
• Perform unit and integration testing.
• Maintain high software quality standards within the team.

Skills

Python

Git

CI/CD

AWS

Databases

OOP

Lambda

DynamoDB

PostgreSQL

MongoDB

Tools

Jenkins

GitHub Actions

Azure DevOps

AWS S3

AWS Lambda

DynamoDB

Job description

Caterpillar Inc. is hiring a Data Engineer on the Platform Data Engineering team to develop Python data pipelines supporting applications.

You will work across functional lines, building and deploying CI/CD pipelines, and implementing data pipelines from source to target with strong emphasis on quality, testing, and performance. You will be part of a global team in Chicago or Peoria, contributing to scalable data solutions.