Senior Data Engineer — Physical AI & Edge Platform

Caterpillar Inc.; Irving (TX); On-site; USD 113,000 - 183,000; Full time

Benefits offered by this job

Medical, dental, vision benefits

Relocation assistance

Vacation, PTO and holidays

Job summary

Caterpillar Inc. is seeking a Senior Data Engineer in Irving, TX to design, build, and maintain scalable data pipelines and cloud-based data platforms. You will collaborate with software engineers and data architects to deliver reliable data solutions in an agile environment.

You will work with Python and AWS services to enable real-time and batch processing, streaming, and data quality across enterprise systems, helping optimize performance and reliability at scale.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or related field.
• 5+ years of experience in data engineering or related disciplines with increasing responsibility.
• Strong experience with modern Caterpillar data platforms such as Helios Data Platform.
• Proficient in Python and production-grade data pipelines.
• Experience leading teams to build high-throughput, scalable data pipelines.
• Strong hands-on experience with AWS data services at scale (Kinesis, S3, DynamoDB, EventBridge).
• Experience deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins.
• Ability to design and integrate APIs, data pipelines, streaming platforms, and databases.

Responsibilities

• Actively collaborate with Lead Software Engineers and Data Architects to define and implement solution architecture
• Implement scalable data pipelines and microservices in Python for real-time and batch processing
• Drive cloud-native data ingestion and streaming solutions using AWS services
• Lead design, implementation, and operational excellence of data integration frameworks
• Translate complex requirements into scalable data architectures and workflows
• Establish automated testing, data quality controls, and validation frameworks
• Implement monitoring, performance tuning, and root-cause analysis for data platforms

Skills

Python

Java

SQL

AWS

CI/CD

Data modeling

Leadership

Education

Bachelor’s degree in Computer Science or related field

Tools

Kinesis

S3

DynamoDB

EventBridge

CloudWatch

Azure DevOps

Jira

Job description

Caterpillar Inc. is seeking a Senior Data Engineer in Irving, TX to design, build, and maintain scalable data pipelines and cloud-based data platforms. You will collaborate with software engineers and data architects to deliver reliable data solutions in an agile environment.

You will work with Python and AWS services to enable real-time and batch processing, streaming, and data quality across enterprise systems, helping optimize performance and reliability at scale.