Data Engineer, Physical AI Platform (Chicago)

Caterpillar Brazil; Chicago (IL); On-site; USD 98,000 - 158,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plans

Health Savings Account (HSA)

Flexible Spending Accounts (FSAs)

Relocation assistance

Visa sponsorship

Job summary

Caterpillar Inc. in Chicago, IL is seeking a Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data systems. You will work on real-time and batch data processing, integrating diverse data sources, and ensuring data quality in an agile setting.

This role emphasizes distributed systems, microservices, and AWS tools. Domestic relocation and visa sponsorship are available for this position, with a strong focus on reliability and performance.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or related field.
• 2+ years development experience on modern, large scale, complex data platforms.
• 3+ years developing and deploying Java or Python solutions to a production environment.
• Experience building high-throughput, scalable data pipelines.
• Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.)
• Proficiency in SQL, including data quality and validation practices
• Proficiency in deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc.
• Experience developing microservices that support real-time data ingestion
• Experience developing software applications using relational and noSQL databases
• Ability to ensure data integrity across distributed and streaming systems
• Experience with API development and secure integrations (OAuth 2.0)
• Proven experience with monitoring, testing, and automation in large-scale data environments

Responsibilities

• Design, build, and optimize data pipelines and microservices using Python for real-time and batch processing
• Develop cloud-based data ingestion solutions using AWS services (Kinesis, S3, DynamoDB, EventBridge, etc.)
• Build and maintain data integration workflows for source data pipelines aligned to CI Autonomy
• Translate business requirements into reliable data workflows, mappings, and system designs
• Implement automated testing and validation to ensure data integrity across distributed systems
• Monitor and troubleshoot pipelines using tools like CloudWatch to maintain reliability

Skills

Python

Java

SQL

NoSQL

Distributed systems

Data pipelines

Communication

Education

Bachelor’s degree in Computer Science/Computer Engineering

Tools

AWS Kinesis

AWS S3

DynamoDB

EventBridge

CloudWatch

CI/CD

Azure DevOps

Jira

Jenkins

Job description

Caterpillar Inc. in Chicago, IL is seeking a Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data systems. You will work on real-time and batch data processing, integrating diverse data sources, and ensuring data quality in an agile setting.

This role emphasizes distributed systems, microservices, and AWS tools. Domestic relocation and visa sponsorship are available for this position, with a strong focus on reliability and performance.