Senior Data Engineer

Caterpillar Financial Services Corporation; Peoria, Chicago (IL, IL); On-site; USD 112,710 - 183,140; Full time

Benefits offered by this job

Medical benefits

Dental & Vision benefits

401(k) plan

Health Savings Account (HSA)

Flexible Spending Accounts (FSAs)

Career development

Job summary

Caterpillar Inc. is seeking a Senior Data Engineer for the Helios Data Engineering team in Chicago. You will develop Python data pipelines that build business data objects to support applications.

Responsibilities include implementing complex pipeline solutions, building CI/CD workflows, and ensuring high-quality software through tests and best practices. This role requires onsite presence in Chicago, IL, with relocation not offered.

Qualifications

• Strong data engineering background with Python.
• Experience in SDLC and building scalable data pipelines.
• Ability to design and implement reliable software architectures.

Responsibilities

• Perform programming, project management, and development tasks with minimal supervision.
• Interpret requirements and translate into engineering solutions.
• Build and deploy CI/CD pipelines for data applications.
• Implement source-to-target mapping for pipeline code.
• Conduct unit and integration tests.
• Maintain high software quality standards within the team.
• Identify growth opportunities within the team.

Skills

Decision Making

Effective Communications

Software Development

Software Development Life Cycle

Software Product Design

Software Product Knowledge

Software Product Testing

OOP

Data Chunking

Python

Git

CI/CD

AWS

Database Knowledge

Tools

Jenkins

GitHub Actions

Azure DevOps

SageMaker

PostgreSQL

DynamoDB

MongoDB

Oracle

Job description

Senior Data Engineer – Helios Data Engineering team at Caterpillar Inc. You will develop Python data pipelines that build business data objects to support applications.

Responsibilities

• Perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
• Work directly on complex application/technical problem identification and resolution.
• Interpret design requirements for engineering implementation.
• Build and deploy CI/CD pipelines.
• Implement source to target mapping as pipeline code.
• Perform unit and integration testing.
• Maintain high standards of software quality within the team by establishing good practices and habits.
• Identify and encourage areas for growth and improvement within the team.
• Perform other job duties as assigned by Caterpillar management from time to time.

Qualifications & Desired Skills

• Decision Making and Critical Thinking – knowledge of decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment.
• Effective Communications – ability to effectively transmit, receive, and accurately interpret ideas, information, and needs through appropriate communication behaviors.
• Software Development – extensive knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements.
• Software Development Life Cycle – knowledge of SDLC; ability to use a structured methodology for delivering and managing new or enhanced software products.
• Software Product Design/Architecture – knowledge of software product design; ability to convert market requirements into software product design.
• Software Product Technical Knowledge – knowledge of technical aspects of a software product; ability to design, configure and integrate technical aspects.
• Software Product Testing – extensive knowledge of software product testing; ability to design, plan, and execute testing strategies and tactics to ensure quality.
• Extensive software development experience and solid working knowledge of OOP principles.
• Knowledge and experience with embedding models and concepts for effectively chunking data.
• Extensive experience designing and developing software applications in Python.
• Extensive experience working with Git version control.
• Extensive experience deploying software using CI/CD tools such as Jenkins, GitHub Actions, Azure DevOps, etc.
• Experience with AWS components such as Bedrock, Lambda, Dynamo, Fargate, S3, SageMaker, IAM, and RDS.
• Experience with relational and/or NoSQL databases such as PostgreSQL, DynamoDB, MongoDB, Oracle, etc.
• Demonstrated strong learning ability and proactive approach to staying current with the latest technologies and industry trends.

Compensation

Pay Range: $112,710.00 – $183,140.00. Compensation and benefits offered may vary depending on multiple individualized factors, including job level, market location, job‑related knowledge, skills, performance, and experience.

Benefits

• Medical, dental, and vision benefits*
• Paid time off (Vacation, Holidays, Volunteer, etc.)*
• 401(k) savings plans*
• Health Savings Account (HSA)*
• Flexible Spending Accounts (FSAs)*
• Health Lifestyle Programs*
• Employee Assistance Program*
• Voluntary Benefits and Employee Discounts*
• Career Development*
• Incentive bonus*
• Disability benefits*
• Life Insurance*
• Parental leave*
• Adoption benefits*
• Tuition Reimbursement*
• These benefits also apply to part‑time employees.

All benefits are subject to plan eligibility, terms, and guidelines. This position requires working onsite five days a week. Relocation assistance is NOT available for this position. Visa sponsorship is NOT available for this position. This position requires the candidate to be in Chicago, IL or Peoria, IL.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.