Data Engineer, AI-Driven Physical Platform

Caterpillar Inc; Chicago (IL); Sur place; USD 98 000 - 158 000; Plein temps

Avantages offerts par ce poste

Medical, dental, and vision benefits

401(k) savings plans

Health Savings Account (HSA)

Résumé du poste

Caterpillar Inc. is seeking a Data Engineer to design, build, and maintain scalable data pipelines and microservices in a cloud environment. The role focuses on performance, reliability, and data quality within an agile development context.

You will work with Python and Java, leverage AWS data services, and contribute to autonomous construction site initiatives. The position is onsite in Chicago, IL, with full-time employment and relocation/visa support as applicable.

],

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or related field.
• 2+ years development experience on modern, large scale data platforms.
• 3+ years developing and deploying Java or Python solutions to production.
• Experience building high-throughput, scalable data pipelines.
• Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge).
• Proficiency in SQL and data quality practices.
• Experience deploying software using CI/CD tools.

Responsabilités

• Design, build, and optimize data pipelines and microservices using Python for real-time and batch processing.
• Develop cloud-based data ingestion solutions using AWS services (Kinesis, S3, DynamoDB, EventBridge).
• Build and maintain data integration workflows for source data pipelines aligned to CI Autonomy.
• Translate business requirements into reliable data workflows, mappings, and system designs.
• Implement automated testing and validation to ensure data integrity across distributed systems.
• Monitor and troubleshoot pipelines using CloudWatch to maintain reliability.

Connaissances

Python

Java

AWS

CI/CD

Data pipelines

Microservices

SQL

Distributed systems

Formation

Bachelor's degree in Computer Science/Engineering or related field

Outils

Azure DevOps

Jira

Jenkins

Description du poste

Caterpillar Inc. is seeking a Data Engineer to design, build, and maintain scalable data pipelines and microservices in a cloud environment. The role focuses on performance, reliability, and data quality within an agile development context.

You will work with Python and Java, leverage AWS data services, and contribute to autonomous construction site initiatives. The position is onsite in Chicago, IL, with full-time employment and relocation/visa support as applicable.

],