Data Engineering Lead

Robotics Technologies; Irving (TX); On-site; USD 84,000 - 120,000; Full time

Job summary

Robotics Technologies LLC in Irving, TX is seeking an experienced Senior Data Engineer to architect and build scalable data pipelines and microservices in Python. You will partner with principal engineers and data architects to define solution architecture and deliver real-time and batch processing across enterprise platforms.

You will lead cloud-native data ingestion leveraging AWS Kinesis, S3, DynamoDB, EventBridge, and related services, ensuring data quality, observability, and CI/CD

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or related field.
• 8+ years of experience in data engineering or related disciplines.
• Experience with large-scale Caterpillar data platforms such as Helios Data Platform.
• Strong Python production experience and data pipeline development.
• Expertise with AWS data services (Kinesis, S3, DynamoDB, EventBridge) at scale.
• Proven ability to lead teams building high-throughput, scalable data pipelines.
• Experience deploying software using CI/CD tools (Azure DevOps, Jira, Jenkins).
• Strong SQL skills with data quality and validation practices.
• Experience with distributed and streaming systems data integrity.
• Familiarity with observability and monitoring (e.g., CloudWatch).

Responsibilities

• Collaborate with principal engineers and data architects to define solution architecture.
• Lead design and optimization of scalable data pipelines and microservices in Python.
• Develop cloud-native data ingestion and streaming solutions using AWS services.
• Own data integration frameworks and source data pipelines for CI Autonomy initiatives.
• Translate complex requirements into scalable data architectures and workflows.
• Institute automated testing, data quality controls, and validation frameworks.
• Lead production monitoring, performance tuning, and root-cause analysis using observability tools.

Skills

Python

Data pipelines

Data engineering

SQL

AWS

Microservices

Cloud architecture

Team leadership

Education

Bachelor's degree in Computer Science/Engineering

Tools

AWS Kinesis

Amazon S3

DynamoDB

EventBridge

CloudWatch

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Duration: 8 Months + Extension

Bill Rate: $74/hour (C2C)

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description

• Actively collaborate with Principal Software Engineers and Data Architects to define solution architecture
• Lead the solution design and optimization of scalable data pipelines and microservices in Python, enabling both real-time and batch data processing across enterprise platforms
• Drive the development of cloud-native data ingestion and streaming solutions leveraging AWS services including Kinesis, S3, DynamoDB, EventBridge, and related technologies
• Own the design, implementation, and operational excellence of data integration frameworks and source data pipelines supporting CI Autonomy initiatives
• Partner with business, product, and engineering stakeholders to translate complex requirements into scalable data architectures, workflows, mappings, and system designs
• Establish and enforce automated testing, data quality controls, and validation frameworks to ensure integrity, reliability, and compliance across distributed data ecosystems
• Lead operational monitoring, performance tuning, and root-cause analysis of production data platforms using observability tools such as CloudWatch to maintain high availability and service reliability
• Bachelor's degree in Computer Science, Computer Engineering, or related field
• 8+ years of experience in data engineering or related disciplines with increasing responsibility
• Extensive experience on modern, large scale, complex Caterpillar data platforms such as Helios Data Platform
• Strong foundation developing and deploying Python solutions to a production environment
• Experience leading teams to build high-throughput, scalable data pipelines
• Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.) at scale
• Strong in SQL, including data quality and validation practices
• Experience in deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc.
• Experience developing microservices that support real-time data ingestion
• Experience developing software applications using relational and noSQL databases
• Ability to ensure data integrity across distributed and streaming systems
• Experience with monitoring, testing, and automation in large-scale data environments

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.