Data Engineer: Physical AI Platform & Real-Time Pipelines

Caterpillar Financial Services Corporation; Chicago (IL); On-site; USD 98,000 - 158,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) savings plans

Health Savings Account (HSA)

Flexible Spending Accounts (FSAs)

Career Development

Incentive bonus

Tuition Reimbursement

Job summary

Caterpillar Inc. in Chicago, IL, is seeking a Data Engineer to design, build, and maintain scalable data pipelines, microservices, and cloud-based data systems in an agile environment. Focus on performance, reliability, and data quality.

You will work with Python and AWS to ingest, process, and orchestrate data across real-time and batch workflows, ensuring robust data architectures for enterprise-scale use cases.

Qualifications

• Design, build and optimize data pipelines and microservices.
• Experience with real-time and batch processing architectures.
• Strong knowledge of AWS data services and cloud-based data systems.

Responsibilities

• Design, build, and optimize data pipelines and microservices using Python for real-time and batch processing
• Develop cloud-based data ingestion solutions using AWS services (Kinesis, S3, DynamoDB, EventBridge, etc.)
• Build and maintain data integration workflows for source data pipelines aligned to CI Autonomy
• Translate business requirements into reliable data workflows, mappings, and system designs
• Implement automated testing and validation to ensure data integrity across distributed systems
• Monitor and troubleshoot pipelines using CloudWatch to maintain reliability

Skills

Python

Java

AWS

SQL

Data pipelines

Data quality

Education

Bachelor’s degree in Computer Science, Computer Engineering, or related field

Tools

AWS services

Job description

Caterpillar Inc. in Chicago, IL, is seeking a Data Engineer to design, build, and maintain scalable data pipelines, microservices, and cloud-based data systems in an agile environment. Focus on performance, reliability, and data quality.

You will work with Python and AWS to ingest, process, and orchestrate data across real-time and batch workflows, ensuring robust data architectures for enterprise-scale use cases.