Data Engineer — Cloud, MLOps & AI Pipelines

Jobtailor; Dearborn (MO); On-site; USD 120,000 - 180,000; Full time

Job summary

Jobtailor is seeking a Senior Data Engineer to collaborate across teams and design a scalable data architecture for Connected Vehicle Software. You will source data, ensure effective transformation practices, and build data pipelines in cloud environments.

You will implement MLOps pipelines in GCP and AWS, integrate Vertex AI, monitor data quality, mentor junior engineers, and translate analytical challenges into AI/ML solutions for product development.

Qualifications

• Master’s degree or foreign equivalent in Computer Science, Software Engineering, Information Systems, Data Engineering, or a related field, and 4 years of experience; or equivalent education and experience, including 6+ years with a bachelor’s degree
• 4 years of professional experience in data engineering, data product development, and software product launches
• Proficiency in at least three of Java, Python, Spark, Scala, and SQL
• 3 years of cloud data/software engineering experience building scalable, reliable, cost-effective batch and streaming production pipelines
• Experience with data warehouses such as Amazon Redshift, Microsoft Azure Synapse Analytics, and Google BigQuery
• Experience with workflow orchestration tools such as Airflow and Cloud Run
• Experience with relational databases including MySQL, PostgreSQL, and SQL Server
• Experience with real-time streaming platforms including Apache Kafka and GCP Pub/Sub
• Experience with microservices architecture for large-scale real-time data processing
• Experience with REST APIs for compute, storage, operations, and security
• Experience with DevOps tools including Tekton, GitHub Actions, Git, GitHub, Terraform, and Docker
• Experience with Atlassian JIRA
• Comfort working in ambiguous environments requiring innovative problem-solving
• Candidates must be legally authorized to work in the United States
• Visa sponsorship is not available

Responsibilities

• Collaborate across teams and internal organizations to develop a wider data architecture plan for Connected Vehicle Software
• Work with data stewards and data owners to source and understand data and ensure effective data transformation practices
• Streamline data acquisition, processing, and presentation with data analytics stakeholders
• Analyze connected vehicle data to support new product development and production vehicle improvements
• Design and build a Semantic Data layer to serve AI agents
• Design and implement scalable data science and MLOps pipelines in GCP and AWS
• Integrate cloud technologies and AI tools such as Vertex AI into workflows
• Translate vehicle engineering problems into mathematical representations and AI/ML solutions
• Develop and maintain data quality systems across the development lifecycle
• Build pipelines monitoring data quality and analytical model and agentic solution performance
• Translate technical work for diverse stakeholders and mentor junior data engineering team members

Skills

Java

Python

Spark

Scala

SQL

Data Warehousing

Microservices Architecture

REST APIs

Real-Time Streaming

Data Product Development

Cloud Data Engineering

Education

Master’s degree in Computer Science/Software Engineering/Information Systems/Data Engineering

Tools

GCP

AWS

Vertex AI

Airflow

Cloud Run

MySQL

PostgreSQL

SQL Server

Apache Kafka

GCP Pub/Sub

Job description

Jobtailor is seeking a Senior Data Engineer to collaborate across teams and design a scalable data architecture for Connected Vehicle Software. You will source data, ensure effective transformation practices, and build data pipelines in cloud environments.

You will implement MLOps pipelines in GCP and AWS, integrate Vertex AI, monitor data quality, mentor junior engineers, and translate analytical challenges into AI/ML solutions for product development.