Lead Data Engineer, Physical AI Platform — Onsite

Caterpillar Brazil; Irving (TX); On-site; USD 128,470 - 208,770; Full time

Benefits offered by this job

Relocation assistance

Visa sponsorship available

Job summary

Caterpillar Inc. is seeking a Lead Data Engineer for the Physical AI Platform to design and maintain scalable data pipelines and cloud data platforms. You will work with principal engineers to define architectures, implement real-time and batch processing, and own data integration across enterprise systems.

You will lead with strong Python/Java development, AWS tooling, and CI/CD practices, ensuring high data quality and reliability in a demanding, onsite environment at Irving, TX.

Qualifications

• 8+ years of data engineering experience with increasing responsibility.
• Experience with Helios Data Platform or large-scale Caterpillar data platforms is a plus.
• Strong background in AWS data services (Kinesis, S3, DynamoDB, EventBridge) at scale.
• Proven track record of building high-throughput data pipelines and real-time data ingestion.
• Experience leading teams and delivering scalable, reliable data solutions.
• Strong SQL skills with data quality and validation practices.
• Familiarity with CI/CD tooling and automated testing for data pipelines.

Responsibilities

• Design, build, and maintain scalable data pipelines, microservices, and cloud data platforms.
• Lead solution design and optimize data pipelines for real-time and batch processing.
• Develop cloud-native data ingestion and streaming using AWS services.
• Define data integration frameworks and streams to support autonomy initiatives.
• Collaborate with business and engineering stakeholders to translate requirements into architectures.
• Implement automated data quality controls and validation across distributed data ecosystems.
• Monitor, tune, and troubleshoot production data platforms with observability tools.

Skills

Python

Java

AWS

SQL

CI/CD

Data pipelines

Microservices

Data quality

Observability

Big data

Education

Bachelor’s degree in Computer Science, Computer Engineering, or related field

Tools

Azure DevOps

Jira

Jenkins

Job description

Caterpillar Inc. is seeking a Lead Data Engineer for the Physical AI Platform to design and maintain scalable data pipelines and cloud data platforms. You will work with principal engineers to define architectures, implement real-time and batch processing, and own data integration across enterprise systems.

You will lead with strong Python/Java development, AWS tooling, and CI/CD practices, ensuring high data quality and reliability in a demanding, onsite environment at Irving, TX.