AI Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Atlanta (GA); Presencial; USD 120 000 - 180 000; Tempo integral

Resumo da oferta

MACHINE LEARNING TECHNOLOGIES LLC in Atlanta is hiring an AI Data Engineer to design and maintain scalable data pipelines for AI/ML initiatives. The role focuses on SQL and Python/Scala, cloud data platforms, and RAG architectures, embeddings, and unstructured data processing.

Key responsibilities include building vector pipelines, feature stores for model training and inference, and ensuring data quality and governance across pipelines.

Qualificações

• Strong SQL and Python/Scala skills.
• Experience with cloud data platforms.
• Hands-on experience with Apache Airflow, dbt, or similar orchestration tools.
• Understanding of embedding models, vector search, and RAG architectures.
• Experience processing structured and unstructured data.
• Knowledge of ML lifecycle concepts and data engineering best practices.

Responsabilidades

• Design and develop data pipelines to ingest, clean, and transform structured and unstructured data.
• Build and maintain vector embedding pipelines and integrate vector databases.
• Develop data pipelines and feature stores for ML model training and inference.
• Implement RAG pipelines, including document chunking, embedding refresh, and metadata tagging.
• Collaborate with ML Engineers and Data Scientists to support model training and evaluation.
• Ensure data quality, lineage, governance, and security across AI data pipelines.
• Optimize data pipelines for performance, scalability, and cost efficiency.
• Support MLOps/LLMOps workflows, including dataset versioning and reproducibility.
• Implement data access controls and entitlement logic to ensure secure AI data usage.

Conhecimentos

SQL

Python/Scala

Cloud platforms

Vector embeddings

RAG architectures

Data pipelines

Ferramentas

Apache Airflow

dbt

Vector databases

Descrição da oferta de emprego

Job Description

Job Overview

• Job ID: J53715


• Job Title: AI Data Engineer


• Location: Atlanta, GA


• Duration: 12 Months + Extension


• Domain Exposure: Manufacturing


• Work Authorization: US Citizen,Green Card,OPT-EAD,CPT,H-1B,H4-EAD,L2-EAD,GC-EAD


• Client: To Be Discussed Later


• Employment Type: W-2, 1099, C2C

Job Summary

We are seeking an experienced AI Data Engineer to design, develop, and maintain scalable data pipelines and infrastructure supporting AI/ML initiatives. The ideal candidate will have strong SQL and Python/Scala skills, cloud data platform experience, and knowledge of RAG architectures, vector databases, embeddings, and unstructured data processing.

Key Responsibilities

• Design and develop data pipelines to ingest, clean, and transform structured and unstructured data.


• Build and maintain vector embedding pipelines and integrate vector databases.


• Develop data pipelines and feature stores for ML model training and inference.


• Implement RAG pipelines, including document chunking, embedding refresh, and metadata tagging.


• Collaborate with ML Engineers and Data Scientists to support model training and evaluation.


• Ensure data quality, lineage, governance, and security across AI data pipelines.


• Optimize data pipelines for performance, scalability, and cost efficiency.


• Support MLOps/LLMOps workflows, including dataset versioning and reproducibility.


• Implement data access controls and entitlement logic to ensure secure AI data usage.

Required Skills

• Strong SQL and proficiency in Python or Scala.


• Experience with cloud data platforms.


• Hands-on experience with Apache Airflow, dbt, or similar orchestration tools.


• Understanding of embedding models, vector search, and RAG architectures.


• Experience processing structured and unstructured data.


• Knowledge of ML lifecycle concepts and data engineering best practices.

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.