Senior Data Engineer — Remote AI/ML Pipelines & RAG

Hidden Jobs; United States; Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Fully remote work

USD-denominated gross compensation

Hardware provisioning

Referral program

Training and English classes

Job summary

Hidden Jobs is seeking a senior Data/ML Engineer to own end-to-end data architecture feeding our warehouse, LLM-enabled apps, and AI-backed analytics. The role blends traditional data engineering with ML/LLM ops for ingestion, transformation, semantic search, and conversational interfaces.

Remote, LATAM-focused with in-person verification. You will design pipelines, build retrieval workflows, and enable analytics and AI-generated insights while collaborating with stakeholders to operationalize

Qualifications

• 8+ years hands-on experience as a Data Engineer.
• Strong Python for transformation, manipulation, and large-scale processing.
• Production experience with big data tooling such as Apache Spark, Hadoop, and Kafka for distributed and real-time workloads.
• Demonstrated ability to design pipelines that ingest from RDBMS, JSON, API, and flat-file sources.
• Advanced SQL and PL/SQL skills, deep BI and data-warehouse knowledge, plus cloud warehouse experience (Snowflake or Redshift).
• Solid grasp of software engineering principles, comfort on Unix/Linux/Windows, Agile workflows, and version control in distributed environments.

Responsibilities

• Design, build, and maintain scalable pipelines that move data from diverse sources into central feature stores, training workflows, and real-time inference services.
• Engineer retrieval workflows over unstructured data, including embeddings, indexing, and semantic search patterns that support RAG-style applications.
• Develop lightweight analytics and dashboarding experiences that surface natural-language query capabilities and AI-generated insights.
• Define processes for prompt engineering, agent orchestration, and model fine-tuning routines that power conversational interfaces.
• Manage vector data stores and the indexing strategies that keep retrieval-augmented workflows fast and reliable.
• Partner with data and business stakeholders to translate language-model use cases into scalable, production-ready solutions, and document all pipelines and model deployment routines.

Skills

Python

SQL/PLSQL

Spark

Hadoop

Kafka

Data pipelines

Unix/Linux

Agile

Version control

Tools

Snowflake

Redshift

DataStax AstraDB

LangChain

Job description

Hidden Jobs is seeking a senior Data/ML Engineer to own end-to-end data architecture feeding our warehouse, LLM-enabled apps, and AI-backed analytics. The role blends traditional data engineering with ML/LLM ops for ingestion, transformation, semantic search, and conversational interfaces.

Remote, LATAM-focused with in-person verification. You will design pipelines, build retrieval workflows, and enable analytics and AI-generated insights while collaborating with stakeholders to operationalize