Senior ML Data Services Engineer: Scalable Data Pipelines

Energy Jobline ZR; Pittsburgh (Allegheny County); On-site; USD 149,000 - 199,000; Full time

Job summary

Motional is seeking a Senior Engineer to join the ML Data Services team to build data infrastructure for Autonomy ML teams. You will design RESTful APIs, deploy scalable pipelines, and own high-availability backend services that process terabytes of data for ML training and evaluation.

You will collaborate with leadership to set objectives and timelines, develop monitoring for data pipelines, and mentor junior engineers, shaping SDLC practices and code quality across the team.

Qualifications

• 5+ years of software development experience with Python; relevant experience with Java or Go.
• 5+ years of web backend development experience with REST APIs and microservices.
• 3+ years of AWS cloud experience (e.g., DynamoDB, API Gateway, EKS, Lambda, OpenSearch, Redshift, S3).
• 3+ years of data engineering experience with AWS Step Functions, Airflow or Prefect.
• Strong written and oral communication skills.
• Experience working in cross-functional development teams, including quarterly road map design.
• Hands-on experience using modern AI coding tools to accelerate development, refactoring, and code review.
• Ability to mentor junior engineers.

Responsibilities

• Design and implement Restful APIs and microservices for data labeling and annotations.
• Architect, build and maintain scalable data processing pipelines with cloud ETL technology.
• Take ownership of highly-available, critical backend services and APIs that store and expose terabytes of data.
• Work closely with leadership and stakeholders to define objectives, align timelines, and build the execution plan.
• Design and develop monitoring and observability services for the MLOps data service pipelines.
• Mentor and teach junior engineers in the team to develop good SDLC skills and better quality code with pairing sessions.

Skills

Python

Java or Go

REST APIs

AWS

Data engineering

Communication

Mentoring

Education

BS or MS in Computer Science or related field

Tools

Docker

Kubernetes

Airflow

Job description

Motional is seeking a Senior Engineer to join the ML Data Services team to build data infrastructure for Autonomy ML teams. You will design RESTful APIs, deploy scalable pipelines, and own high-availability backend services that process terabytes of data for ML training and evaluation.

You will collaborate with leadership to set objectives and timelines, develop monitoring for data pipelines, and mentor junior engineers, shaping SDLC practices and code quality across the team.