Senior AI Data Engineer - GPSC Insights Engineering

General Motors Company; Austin (TX); Hybrid; USD 140,000 - 190,000; Full time

Job summary

General Motors Company in Austin, TX is seeking a Senior AI Data Engineer to design, build, and optimize industrialized data assets and AI data products. You will own solutions from discovery through production, ensuring data for training and inference is trusted, scalable, and observable.

You will lead complex initiatives across teams, applying deep data engineering and software engineering expertise to shape architecture and drive delivery with significant impact across GPSC Insights

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, or equivalent.
• 6+ years of experience delivering scalable data solutions in production.
• Strong Python and SQL; Scala a plus.
• Hands-on experience with data pipelines for ML/AI workloads.
• Experience with Spark and Kubernetes in production pipelines.
• Proficiency with streaming tech like Kafka.
• Cloud experience (Azure preferred; AWS/GCP also considered).
• Understanding of CI/CD, observability, and data governance.
• Experience with AI workflows and data platforms for ML/LLM use cases.

Responsibilities

• Own data and AI engineering solutions across batch, streaming, and near real-time workloads.
• Design, build, and operate data pipelines and AI data products with strong contracts and observability.
• Collaborate with data scientists, product owners, and platform teams to translate needs into technical plans.
• Mentor junior engineers and raise engineering standards through design reviews and documentation.
• Ensure data quality, security, and governance in production environments.

Skills

Python

SQL

Apache Spark

Kubernetes

Kafka

LangChain

Vertex AI

RAG / vector search

Education

Bachelor's degree in Computer Science / Software Engineering / Data Engineering

Tools

Azure

AWS

GCP

Job description

Job Description

This role is categorized as hybrid. This means the successful candidate is expected to report to Austin, TX three times per week, at minimum [or other frequency dictated by the business if more than 3 days]. The Role Join our GPSC Insights Engineering team, responsible for ideating, incubating, and delivering new data solutions for global purchasing supply chain (GPSC) and our partners. As a Senior AI Data Engineer, you will design, build, and optimize industrialized data assets, AI data products, and data platforms that support Business Intelligence, Advanced Analytics, machine learning, and generative AI use cases. You will own solutions from discovery through production, ensuring that data used for training, evaluation, retrieval, inference, and decisioning is trusted, scalable, secure, observable, and fit for purpose. In this role within the GPSC Insights Engineering organization under the Data organization, you will independently lead complex initiatives with multiple moving parts and drive delivery across teams. You will apply deep data engineering and software engineering expertise to solve novel problems, shape architecture and technology strategy, influence partners through data and clear recommendations, and deliver solutions with significant impact across the function.

What You’ll Do

• Own the architecture, design, development, and production delivery of scalable data and AI engineering solutions across batch, streaming, and near-real-time workloads.
• Assemble, curate, and transform large structured, semi-structured, and unstructured datasets for model training, validation, evaluation, feature generation, embedding generation, retrieval, and inference.
• Design and implement robust source-system integrations from files, database extracts, APIs, event streams, external suppliers, and supply-chain systems.
• Build high-quality data pipelines and reusable data products with strong data contracts, schema management, lineage, metadata, quality checks, and observability.
• Develop and operationalize feature, embedding, and vector-retrieval pipelines where appropriate for machine learning and generative AI applications.
• Build AI-enabled data and application workflows using appropriate AI development frameworks and services, applying retrieval, evaluation, and workflow orchestration patterns where appropriate.
• Establish repeatable MLOps/LLMOps engineering patterns, including data and model versioning, experiment and evaluation workflows, CI/CD, deployment automation, monitoring, drift detection, and retraining triggers.
• Design for functional and non-functional requirements, including performance, scalability, reliability, resiliency, security, privacy, cost, and SLA/SLO attainment.
• Lead architecture discussions and technology evaluations; identify tradeoffs, propose alternative approaches, and drive decisions for complex problems with limited precedent.
• Identify and implement process improvements, automation, infrastructure redesign, and developer tooling that increase delivery speed and reduce operational risk.
• Partner with data scientists, ML engineers, product owners, business stakeholders, platform teams, cybersecurity, and governance partners to translate customer needs into actionable technical plans.
• Work with operations teams to resolve production issues, lead root-cause analysis, and implement preventative improvements across data and AI platforms.
• Communicate recommendations, risks, progress, and results to technical and non-technical audiences, using data to demonstrate value and address concerns.
• Mentor peers and junior engineers, provide guidance on difficult technical issues, and raise engineering standards through design reviews, documentation, and knowledge sharing.
• Model GM behaviors by speaking candidly about risks, protecting sensitive information, experimenting responsibly, moving with urgency, collaborating inclusively, and owning outcomes.

Your Skills & Abilities (Required Qualifications)

• Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, or a related field, or equivalent experience.
• 6+ years of experience in data engineering, software engineering, platform engineering, or a related discipline, including production delivery of scalable data solutions.
• Strong proficiency in Python and SQL; experience with Scala or another production programming language is a plus.
• Hands‑on experience engineering data pipelines or platforms that support machine learning, advanced analytics, or generative AI workloads, including data preparation, feature or embedding generation, evaluation, or inference data delivery.
• Experience with distributed data processing such as Apache Spark and container orchestration such as Kubernetes.
• Proficiency with streaming and event-driven data solutions using Kafka or comparable technologies, including operation in Kubernetes-based environments.
• Experience with cloud platforms; Azure preferred, with AWS or GCP also considered.
• Solid understanding of CI/CD, infrastructure automation, testing, observability, incident response, and production support practices.
• Experience with data architecture, modeling, schema design, data contracts, relational and non-relational data stores, object storage, and APIs.
• Strong understanding of performance optimization techniques such as partitioning, clustering, caching, indexing, and workload tuning.
• Working knowledge of data quality, governance, metadata, lineage, privacy, access controls, and responsible use of sensitive data in AI systems.
• Experience with AI application development frameworks and services such as LangChain, CrewAI, Vertex AI, or comparable technologies.
• Working knowledge of RAG/vector search, FastAPI/React application patterns, LLM evaluation, and agent orchestration.
• Strong collaboration, communication, and influencing skills, with the ability to work across multiple teams and disciplines and drive outcomes without direct authority.

What Can Give You a Competitive