Lead Data Engineer — Scalable Pipelines & AI (Irving)

Caterpillar Brazil

Irving (TX)

On-site

USD 128,000 - 209,000

Full time

3 days ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision benefits

401(k) savings plans

Health Savings Account

Job summary

Caterpillar Inc. is seeking a Lead Data Engineer for the Irving, TX office. You will design and maintain scalable data pipelines, microservices, and cloud-based data platforms that deliver reliable data to business and engineering teams.

You will lead data architecture, performance improvements, and ensure data quality across distributed systems, working in an agile environment with cross-functional teams.

Qualifications

Bachelor’s degree in Computer Science, Computer Engineering, or related field.
8+ years of data engineering experience with increasing responsibility.
Strong experience with AWS data services at scale (Kinesis, S3, DynamoDB, EventBridge).
Experience leading teams to build high-throughput, scalable data pipelines.
Experience deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins.

Responsibilities

Design, build, and maintain scalable data pipelines and microservices.
Architect cloud-based data platforms delivering high-quality data for multiple teams.
Develop real-time and batch data processing solutions across enterprise platforms.
Implement automated testing, data quality controls, and validation frameworks.

Skills

Python

Java

AWS

Data pipelines

CI/CD

Microservices

Education

Bachelor's degree in Computer Science/Engineering or related field

Tools

Kinesis

DynamoDB

EventBridge

Job description

You will lead data architecture, performance improvements, and ensure data quality across distributed systems, working in an agile environment with cross-functional teams.

Get your free, confidential resume review.

or drag and drop your file here.