Data Engineer: Physical AI & Real-Time Pipelines

Caterpillar Financial Services Corporation; Irving (TX); On-site; USD 98,000 - 158,000; Full time

Benefits offered by this job

Medical benefits

Paid time off

401(k) savings

HSA

Flexible Spending Accounts

Career development

Incentive bonus

Parental leave

Tuition reimbursement

Job summary

Caterpillar Financial Services Corporation in Irving, TX is seeking a Data Engineer to design, build, and maintain scalable data pipelines, microservices, and cloud-based data systems in an agile environment, with emphasis on performance, reliability, and data quality.

You will work with Python, AWS Kinesis, S3, DynamoDB, and CI/CD tools to translate business requirements into robust data workflows while ensuring data integrity across distributed systems and real-time ingestion.

Qualifications

• Must have 2+ years development on modern, large scale data platforms.
• 3+ years deploying Java or Python solutions to production.
• Experience building high-throughput, scalable data pipelines.
• Strong hands-on AWS data services experience.
• Proficiency in SQL and data quality practices.

Responsibilities

• Design, build, and optimize data pipelines and microservices for real-time and batch processing.
• Develop cloud-based ingestion solutions using AWS services such as Kinesis and S3.
• Build and maintain data integration workflows aligned to CI Autonomy.
• Translate business requirements into reliable data workflows and system designs.
• Implement automated testing to ensure data integrity across distributed systems.
• Monitor pipelines using CloudWatch and troubleshoot to maintain reliability.

Skills

Python

Java

AWS

SQL

CI/CD

Microservices

Data pipelines

NoSQL

API development

Real-time data

Education

Bachelor’s degree in Computer Science, Computer Engineering, or related field

Tools

AWS Kinesis

AWS S3

DynamoDB

EventBridge

Azure DevOps

Jira

Jenkins

Job description

Caterpillar Financial Services Corporation in Irving, TX is seeking a Data Engineer to design, build, and maintain scalable data pipelines, microservices, and cloud-based data systems in an agile environment, with emphasis on performance, reliability, and data quality.

You will work with Python, AWS Kinesis, S3, DynamoDB, and CI/CD tools to translate business requirements into robust data workflows while ensuring data integrity across distributed systems and real-time ingestion.