Data Engineer - AI/ML

Equiliem; United States; Remote; USD 171,924,000 - 186,252,000; Full time

Benefits offered by this job

Medical Insurance

Vision & Dental Insurance

Life Insurance

Matching 401(k)

Commuter Benefits

Employee Discounts & Rewards

Payroll Payment Options

Job summary

Equiliem is seeking a Data Engineer - AI/ML to design, build, and maintain data infrastructure for AI initiatives, including model training, RAG, vector search, and production ML systems. You will create reliable pipelines for structured and unstructured data, enabling governance and MLOps workflows.

The role requires strong data engineering skills, familiarity with embedding models, and collaboration with ML teams to support data requirements for training and deployment.

Qualifications

• The candidate has strong SQL and either Python or Scala.
• Experience building data pipelines on cloud platforms.
• Familiarity with Airflow or dbt for orchestration/transformation.

Responsibilities

• Design and build pipelines to ingest, clean, transform, and prepare data for AI/ML use cases.
• Process unstructured data sources like PDFs, transcripts, logs.
• Build vector embedding pipelines and integrate vector databases.
• Develop feature pipelines and data infra for model training and inference.
• Support RAG architectures with chunking, embeddings, and tagging.
• Collaborate with ML engineers to meet data needs for training and evaluation.
• Implement data quality, lineage, governance, and monitoring across pipelines.
• Optimize pipelines for cost, scalability, reliability, and performance.
• Support streaming ingestion and modern data platform capabilities.
• Assist MLOps/LLMOps workflows including dataset versioning.
• Enforce data entitlement and access controls for AI systems.

Skills

SQL

Python

Scala

Cloud data platform

Airflow

dbt

Vector search

RAG architectures

ML data lifecycles

Data governance

Education

Bachelor's degree in CS/Data Engineering/CE or related field

Tools

Airflow

dbt

Job description

Data Engineer - AI/ML

Location: Remote

Pay: $60.00 - $65.00 per hour (26-10598)

Job Summary

The AI/ML Data Engineer will design, build, and maintain data infrastructure supporting artificial intelligence and machine learning initiatives, including model training, retrieval-augmented generation (RAG), and production ML systems. This role will develop reliable pipelines for structured and unstructured data while supporting vector search, feature engineering, data governance, and MLOps workflows. The ideal candidate combines strong data engineering skills with practical knowledge of AI/ML data architectures and emerging AI technologies.

Job Responsibilities

• Design and build pipelines to ingest, clean, transform, and prepare structured and unstructured data for AI/ML use cases.
• Process documents, PDFs, transcripts, logs, and other unstructured data sources.
• Build and maintain vector embedding pipelines and support vector database integrations.
• Develop feature pipelines and data infrastructure supporting ML model training and inference.
• Implement data pipelines supporting RAG architectures, including chunking strategies, embedding refresh cycles, and metadata tagging.
• Partner with ML engineers and data scientists to understand data requirements for model training, evaluation, and deployment.
• Implement and maintain data quality, lineage, governance, and monitoring across pipelines supporting AI systems.
• Optimize data pipelines for cost, scalability, reliability, and performance.
• Support streaming ingestion and modern data platform capabilities, including dynamic or incremental data processing.
• Support MLOps and LLMOps workflows, including dataset versioning and tracking data used for model training and evaluation.
• Implement data entitlement and access control logic to ensure AI systems only access authorized data.
• Contribute to reproducible and compliant AI/ML data workflows.

Job Requirements

• Strong SQL skills and proficiency in Python or Scala for data pipeline development.
• Experience developing and maintaining data pipelines in a cloud-based data platform.
• Experience with data orchestration and transformation tools such as Airflow or dbt.
• Understanding of embedding models, vector search, and retrieval-augmented generation (RAG) architectures.
• Experience processing and transforming unstructured data.
• Familiarity with machine learning lifecycle concepts, including training, evaluation, deployment, and data management.
• Strong understanding of data quality, lineage, governance, and access controls.
• Ability to collaborate effectively with data scientists, ML engineers, and other technical stakeholders.

Education

• Bachelor's degree in Computer Science, Data Engineering, Computer Engineering, or a related technical field preferred.

About Equiliem

Equiliem believes in empowering success. It's our job to cultivate relationships that connect people and employers in a way that is inclusive, intelligent, and allows both to thrive.

Across the U.S., leading companies in healthcare, government, engineering, manufacturing, professional services, and energy rely on us for their workforce solutions. Our recruiting and HR services include contract and direct hire staffing, Payrolling/EOR, Independent Contractor Compliance, and Managed Services.

For almost 30 years, we've helped shape our industry. Today, we continue to research, ask questions, and continuously enhance the candidate journey and client experience.

Benefits

We offer a comprehensive benefits package to our employees, which includes:

• Medical Insurance
• Vision & Dental Insurance
• Life Insurance
• Matching 401(k)
• Commuter Benefits
• Employee Discounts & Rewards
• Payroll Payment Options

Future Communication Consent

By applying, you are providing consent for Equiliem to engage with you via phone calls, AI-generated calls, AI-generated text messages, standard text messages, and/or emails to share job opportunities. Consistent with our Privacy Policy, information obtained will not be shared with third parties for marketing or promotional purposes. Message frequency may vary for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You may reply STOP to cancel or HELP for assistance.

EEO Employer

Equiliem is an equal opportunity employer. We do not discriminate or allow discrimination based on race, color, religion, creed, sex, age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Equiliem will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [emailprotected] or [phone].