Senior Data Engineer - Python Pipelines & Cloud (CI/CD)

Caterpillar Brazil; Chicago (IL); On-site; USD 112,710 - 183,140; Full time

Benefits offered by this job

Medical benefits

Dental & Vision benefits

401(k) plan

Health Savings Account (HSA)

Flexible Spending Accounts (FSAs)

Career development

Job summary

Caterpillar Inc. is seeking a Senior Data Engineer for the Helios Data Engineering team in Chicago. You will develop Python data pipelines that build business data objects to support applications.

Responsibilities include implementing complex pipeline solutions, building CI/CD workflows, and ensuring high-quality software through tests and best practices. This role requires onsite presence in Chicago, IL, with relocation not offered.

Qualifications

• Strong data engineering background with Python.
• Experience in SDLC and building scalable data pipelines.
• Ability to design and implement reliable software architectures.

Responsibilities

• Perform programming, project management, and development tasks with minimal supervision.
• Interpret requirements and translate into engineering solutions.
• Build and deploy CI/CD pipelines for data applications.
• Implement source-to-target mapping for pipeline code.
• Conduct unit and integration tests.
• Maintain high software quality standards within the team.
• Identify growth opportunities within the team.

Skills

Decision Making

Effective Communications

Software Development

Software Development Life Cycle

Software Product Design

Software Product Knowledge

Software Product Testing

OOP

Data Chunking

Python

Git

CI/CD

AWS

Database Knowledge

Tools

Jenkins

GitHub Actions

Azure DevOps

SageMaker

PostgreSQL

DynamoDB

MongoDB

Oracle

Job description

Caterpillar Inc. is seeking a Senior Data Engineer for the Helios Data Engineering team in Chicago. You will develop Python data pipelines that build business data objects to support applications.

Responsibilities include implementing complex pipeline solutions, building CI/CD workflows, and ensuring high-quality software through tests and best practices. This role requires onsite presence in Chicago, IL, with relocation not offered.