Senior Data Engineer — Python Pipelines & AWS

Caterpillar Brazil; Peoria (IL); On-site; USD 113,000 - 183,000; Full time

Benefits offered by this job

Medical benefits

401(k) savings plans

Health Savings Account

Paid time off

Career development

Job summary

Caterpillar Inc. is seeking a Senior Software Engineer for the Data Engineering team to develop Python data pipelines that power critical applications.

You will design, build, test, and deploy data solutions, collaborating with Cat Dealers and internal partners to advance analytics and AI capabilities. Responsibilities include implementing complex pipelines, ensuring code quality, and contributing to CI/CD initiatives while leveraging AWS services and Snowflake.

Qualifications

• Strong OO programming and software development experience.
• Proficient in Python for data pipelines and apps.
• Solid Git version control and collaboration in medium/large teams.
• Experience deploying with CI/CD tools (Jenkins, GitHub Actions, Azure DevOps).
• Experience with AWS services (Lambda, Kinesis, EventBridge, CloudWatch, SageMaker, IAM, RDS).
• Familiarity with Snowflake data platform.
• Hands-on with GenAI developer tools and AI coding assistants.
• Ability translate requirements into robust software designs.

Responsibilities

• Develop Python data pipelines to build business data objects.
• Contribute to complex application/technical problem resolution.
• Build and deploy CI/CD pipelines and automate tests.
• Implement source-to-target mappings in pipelines.
• Ensure unit and integration testing with quality standards.
• Collaborate with cross-functional teams and drive improvements.

Skills

Python

Git

CI/CD

AWS

Snowflake

GenAI tools

AI coding assistants

Code quality

Tools

Jenkins

Github Actions

Azure DevOps

SageMaker

Job description

Caterpillar Inc. is seeking a Senior Software Engineer for the Data Engineering team to develop Python data pipelines that power critical applications.

You will design, build, test, and deploy data solutions, collaborating with Cat Dealers and internal partners to advance analytics and AI capabilities. Responsibilities include implementing complex pipelines, ensuring code quality, and contributing to CI/CD initiatives while leveraging AWS services and Snowflake.