Platform Data Engineer: Python Pipelines & CI/CD

Caterpillar; Centralia (IL); On-site; USD 89,000 - 145,000; Full time

Benefits offered by this job

Medical and Dental benefits

Paid time off

401(k) retirement plan

Health Savings Account

Flexible Spending Accounts

Career development

Bonus incentive

Job summary

Caterpillar is seeking a Data Engineer for the Platform Data Engineering team in Chicago/Peoria, IL to build Python data pipelines powering business applications.

You will design, deploy, and maintain CI/CD pipelines, work with AWS services and databases, and collaborate across functions to deliver reliable data solutions. Onsite work is required five days a week, relocation or visa sponsorship are not offered.

Qualifications

• Proven experience developing Python-based data pipelines.
• Strong knowledge of Python and OO design.
• Experience with Git version control and CI/CD.

Responsibilities

• Develop Python data pipelines to build business data objects.
• Build and deploy CI/CD pipelines.
• Translate design requirements into pipeline code.
• Perform unit and integration testing.
• Maintain high software quality standards.
• Collaborate with cross-functional teams.
• Identify areas for growth and improvement within the team.
• Handle complex application/technical problem identification.

Skills

Python development

Object-oriented programming

Git version control

CI/CD pipelines

AWS services

Tools

Jenkins

Github Actions

Azure DevOps

AWS Lambda

DynamoDB

S3

Job description

Caterpillar is seeking a Data Engineer for the Platform Data Engineering team in Chicago/Peoria, IL to build Python data pipelines powering business applications.

You will design, deploy, and maintain CI/CD pipelines, work with AWS services and databases, and collaborate across functions to deliver reliable data solutions. Onsite work is required five days a week, relocation or visa sponsorship are not offered.