Data Engineer: Cloud Pipelines & Real-Time Data AWS

Caterpillar; Irving (TX); On-site; USD 98,000 - 158,000; Full time

Job summary

Caterpillar is seeking a data engineering professional to design and maintain scalable data pipelines and cloud-based data systems. The role involves building both real-time and batch processing solutions using Python, Java, and AWS services to ensure reliable data flows.

You will translate business requirements into robust system designs, implement testing and validation, and monitor pipelines for performance and data quality. This is an on-site position based in Texas.

Qualifications

• Designs and builds scalable data pipelines.
• Develops real-time and batch processing solutions using Python, Java and AWS services.
• Translates requirements into robust data system designs.
• Implements testing, validation, and monitoring for reliability and data quality.

Responsibilities

• Designs, builds, and maintains scalable data pipelines, microservices, and cloud-based data systems.
• Develops real-time and batch processing solutions.
• Creates data integrations and workflows.
• Translates requirements into system designs and validates implementations.

Skills

Python

Java

AWS

Tools

AWS

Job description

Caterpillar is seeking a data engineering professional to design and maintain scalable data pipelines and cloud-based data systems. The role involves building both real-time and batch processing solutions using Python, Java, and AWS services to ensure reliable data flows.

You will translate business requirements into robust system designs, implement testing and validation, and monitor pipelines for performance and data quality. This is an on-site position based in Texas.