Senior Data Engineer

Caterpillar Brazil; Peoria (IL); On-site; USD 112,710 - 183,140; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plans

Health Savings Account (HSA)

Job summary

Caterpillar Inc. is seeking a Senior Data Engineer to join the Helios Data Engineering team in Peoria, IL or Chicago, IL. You will develop Python data pipelines and data objects used by business applications, while building robust CI/CD pipelines and ensuring high-quality software delivery.

The role requires extensive Python and OOP experience, embedding models, and strong knowledge of Git and CI/CD tools. Candidates should be comfortable working with AWS components and multiple databases to

Qualifications

• Extensive software development experience with Python and OOP principles.
• Experience embedding models and chunking data for scalable pipelines.
• Strong knowledge of Git version control and CI/CD practices.
• Familiarity with AWS services (Bedrock, Lambda, S3, Sagemaker).
• Experience with relational and NoSQL databases (PostgreSQL, DynamoDB, MongoDB or Oracle).

Responsibilities

• Develop Python data pipelines and build data objects to support applications.
• Build and deploy CI/CD pipelines and automate deployment processes.
• Translate design requirements into robust engineering implementations.
• Perform unit and integration testing to ensure software quality.
• Collaborate with cross-functional teams to improve data engineering components.

Skills

Embedding models

OOP

Python

Git

CI/CD tooling

Tools

Jenkins

GitHub Actions

Azure DevOps

AWS Bedrock

AWS Lambda

AWS S3

AWS Sagemaker

AWS IAM

AWS RDS

PostgreSQL

DynamoDB

MongoDB

Oracle

Job description

## Senior Data EngineerApplylocations: Peoria, Illinois: Chicago, Illinoistime type: Full timeposted on: Posted Todayjob requisition id: R0000382322**Career Area:**Technology, Digital and Data**Job Description:****Your Work Shapes the World at Caterpillar Inc.**When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.As a Senior Data Engineer on the Helios Data Engineering team, you will be responsible for developing Python data pipelines that build business data objects used to support applications. **What You Will Do:*** Responsibilities of the incumbents are across functional lines with individuals assigned in new program development.* Performs all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.* Works directly on complex application/technical problem identification and resolution.* Interpreting design requirements for engineering implementation* Building and deploying CICD pipelines* Implementing source to target mapping as pipeline code* Performs Unit and Integration testing* Maintains high standards of software quality within the team by establishing good practices and habits* Identifies and encourage areas for growth and improvement within the team* Performs other job duties as assigned by Caterpillar management from time to time.**What You Will Have:*** **Decision Making and Critical Thinking:** Knowledge of the decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment.* **Effective Communications:** Understanding of effective communication concepts, tools and techniques; ability to effectively transmit, receive, and accurately interpret ideas, information, and needs through the application of appropriate communication behaviors.* **Software Development:** Extensive knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements.* **Software Development Life Cycle:** Knowledge of software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace.* **Software Product Design/Architecture:** Knowledge of software product design; ability to convert market requirements into the software product design.* **Software Product Technical Knowledge:** Knowledge of technical aspects of a software products; ability to design, configure and integrate technical aspects of software products.* **Software Product Testing:** Extensive knowledge of software product testing; ability to design, plan, and execute testing strategies and tactics to ensure software product quality and adherence to stated requirements.**Considerations for Top Candidates:*** Extensive software development experience and solid working knowledge of OOP principles.* Knowledge and experience with Embedding Models and Concepts for effectively chunking data* Extensive experience in designing and developing software applications in Python.* Extensive experience working with Git version control* Extensive experience deploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops etc.* Experience with AWS components such as Bedrock, Lambda, Dynamo, Fargate, S3, Sagemaker, IAM and RDS* Experience with relational and/or noSQL databases such as PostgreSQL, DynamoDB, MongoDB, Oracle, etc.* Demonstrated strong learning ability and a proactive approach to staying current with the latest technologies and industry trends.**Additional Details:*** This position requires the candidate to be in Chicago, IL or Peoria, IL* Relocation assistance is NOT available for this position* Visa sponsorship is NOT available with this position### ### **Summary Pay Range:**$112,710.00 - $183,140.00Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.**Benefits:**Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.* Medical, dental, and vision benefits\** Paid time off plan (Vacation, Holidays, Volunteer, etc.)\** 401(k) savings plans\** Health Savings Account (HSA)\** Flexible Spending Accounts (FSAs)\** Health Lifestyle Programs\** Employee Assistance Program\** Voluntary Benefits and Employee Discounts\** Career Development\** Incentive bonus\** Disability benefits* Life Insurance* Parental leave* Adoption benefits* Tuition Reimbursement \* These benefits also apply to part-time employees### ### This position requires working onsite five days a week.### Visa Sponsorship is not available for this position.**Posting Dates:**Any offer of employment is conditioned upon the successful completion of a drug screen.Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.