Data Engineer: Python Pipelines & CI/CD (Onsite)

Caterpillar; Chicago (IL); On-site; USD 89,000 - 145,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Paid time off

401(k) savings plans

Health Savings Account

Flexible Spending Accounts

Career Development

Incentive bonus

Disability benefits

Life Insurance

Parental leave

Tuition Reimbursement

Employee Discounts

Job summary

Caterpillar Inc. is seeking a Data Engineer for the Platform Data Engineering team to develop Python data pipelines that support business data objects used by Caterpillar applications. The role emphasizes building and deploying CI/CD pipelines and working with AWS services.

The incumbent will apply OO design, collaborate across functions, and ensure software quality through testing, while maintaining strong communication with the team.

Qualifications

• Software development experience and solid working knowledge of OOP principles.
• Experience designing and developing software applications in Python.
• Experience working with Git version control.
• Deploying software using CI/CD tools such as Jenkins, Github Actions, Azure DevOps etc.
• Experience with AWS components such as Lambda, Dynamo, Fargate, S3, Sagemaker, IAM and RDS.
• Experience with relational and/or NoSQL databases such as PostgreSQL, DynamoDB, MongoDB, Oracle, etc.
• Demonstrated ability to learn quickly and stay current with technologies.
• Exceptional communication skills with cross-functional teams.

Responsibilities

• Develop Python data pipelines that build business data objects for applications.
• Perform complex programming and development tasks with minimal supervision.
• Build and deploy CI/CD pipelines and implement source-to-target mapping in pipelines.
• Conduct unit and integration testing; maintain high software quality.

Skills

Python

Git

CI/CD

AWS

Relational databases

NoSQL databases

OOP

Data pipelines

Jenkins

Github Actions

Tools

Azure DevOps

Job description

Caterpillar Inc. is seeking a Data Engineer for the Platform Data Engineering team to develop Python data pipelines that support business data objects used by Caterpillar applications. The role emphasizes building and deploying CI/CD pipelines and working with AWS services.

The incumbent will apply OO design, collaborate across functions, and ensure software quality through testing, while maintaining strong communication with the team.