Senior Data Engineer - AI-Driven Construction Platform

Caterpillar; Irving (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Caterpillar is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines, microservices, and cloud-based data platforms. You will work in an agile environment to improve data architecture, performance, reliability, and data quality across enterprise systems.

Responsibilities include implementing scalable data pipelines in Python/Java, enabling real-time and batch processing, and driving cloud-native ingestion with AWS services.

Qualifications

• Experience designing scalable data architectures and data platforms.
• Strong programming expertise in Python and Java for backend data systems.
• Hands-on with cloud-native data pipelines and services (AWS).
• Familiarity with agile development processes and CI/CD.

Responsibilities

• Actively collaborate with Lead Software Engineers and Data Architects to define and implement solution architecture
• Implement the solution design and optimize scalable data pipelines and microservices in Python, enabling real-time and batch data processing across enterprise platforms
• Drive the development of cloud-native data ingestion and streaming solutions leveraging AWS services including Kinesis, S3, DynamoDB, EventBridge, and related technologies
• Lead the design, implementation, and operational excellence of data integration frameworks and source data pipelines supporting CI Autonomy initiatives
• Partner with business, product, and engineering stakeholders to translate complex requirements into scalable data architectures, workflows, mappings, and system designs
• Establish and enforce automated testing, data quality controls, and validation frameworks to ensure integrity, reliability, and compliance across distributed data ecosystems
• Implement operational monitoring, performance tuning, and root-cause analysis of production data platforms using observability tools such as CloudWatch to maintain high availability and service reliability

Skills

Python

Java

Data pipelines

Cloud platforms

Agile

Tools

AWS

Kinesis

S3

DynamoDB

EventBridge

Job description

Caterpillar is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines, microservices, and cloud-based data platforms. You will work in an agile environment to improve data architecture, performance, reliability, and data quality across enterprise systems.

Responsibilities include implementing scalable data pipelines in Python/Java, enabling real-time and batch processing, and driving cloud-native ingestion with AWS services.