Remote Data Engineer for AI/ML Pipelines

Equiliem; United States; Remote; USD 171,924,000 - 186,252,000; Full time

Benefits offered by this job

Medical Insurance

Vision & Dental Insurance

Life Insurance

Matching 401(k)

Commuter Benefits

Employee Discounts & Rewards

Payroll Payment Options

Job summary

Equiliem is seeking a Data Engineer - AI/ML to design, build, and maintain data infrastructure for AI initiatives, including model training, RAG, vector search, and production ML systems. You will create reliable pipelines for structured and unstructured data, enabling governance and MLOps workflows.

The role requires strong data engineering skills, familiarity with embedding models, and collaboration with ML teams to support data requirements for training and deployment.

Qualifications

• The candidate has strong SQL and either Python or Scala.
• Experience building data pipelines on cloud platforms.
• Familiarity with Airflow or dbt for orchestration/transformation.

Responsibilities

• Design and build pipelines to ingest, clean, transform, and prepare data for AI/ML use cases.
• Process unstructured data sources like PDFs, transcripts, logs.
• Build vector embedding pipelines and integrate vector databases.
• Develop feature pipelines and data infra for model training and inference.
• Support RAG architectures with chunking, embeddings, and tagging.
• Collaborate with ML engineers to meet data needs for training and evaluation.
• Implement data quality, lineage, governance, and monitoring across pipelines.
• Optimize pipelines for cost, scalability, reliability, and performance.
• Support streaming ingestion and modern data platform capabilities.
• Assist MLOps/LLMOps workflows including dataset versioning.
• Enforce data entitlement and access controls for AI systems.

Skills

SQL

Python

Scala

Cloud data platform

Airflow

dbt

Vector search

RAG architectures

ML data lifecycles

Data governance

Education

Bachelor's degree in CS/Data Engineering/CE or related field

Tools

Airflow

dbt

Job description

Equiliem is seeking a Data Engineer - AI/ML to design, build, and maintain data infrastructure for AI initiatives, including model training, RAG, vector search, and production ML systems. You will create reliable pipelines for structured and unstructured data, enabling governance and MLOps workflows.

The role requires strong data engineering skills, familiarity with embedding models, and collaboration with ML teams to support data requirements for training and deployment.