Remote AI Data Engineer — Production Pipelines & LLM Ops

Aptlogica Technologies; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Aptlogica Technologies is seeking a hands-on AI Data Engineer to build, operate, and optimize production‑grade data pipelines for conversational AI and RAG applications. You will translate architecture designs into reliable data systems and ensure observability and governance.

The role requires 5–8+ years of experience, strong Python/SQL, PySpark, Snowflake, and cloud experience (AWS/Azure). You will work on ML/LLMOps foundations, vector stores, and agentic infrastructure to enable scalable AI

Qualifications

• Proven experience building scalable production batch and streaming data pipelines.
• Strong expertise in Python, SQL, PySpark, Snowflake, Delta Lake, Kafka, and Spark Structured Streaming.
• Experience with AWS/Azure and production RAG infrastructure, including vector stores, embeddings, and retrieval pipelines.
• Working knowledge of MLOps, MLflow, AI CI/CD, automated evaluation, and production monitoring.

Responsibilities

• Build, test, and maintain batch and real‑time pipelines using Snowflake, PySpark, Delta Lake, and Kafka.
• Migrate legacy ETL/data warehouses to AWS/Azure cloud‑native architectures, optimizing latency and cost.
• Maintain CI/CD pipelines for automated testing, deployment, rollback, and IaC using Terraform and GitHub Actions.
• Build document ingestion, embedding pipelines, vector store management, and hybrid retrieval using Pinecone, FAISS, ChromaDB, and OpenSearch.
• Automate evaluation for factual accuracy, hallucination detection, and regression; monitor pipeline health and model metrics.
• Build data APIs, tool schemas, memory/state stores, text-to‑SQL layers, semantic query interfaces, and context APIs for autonomous agents and conversational AI.
• Implement agent observability by capturing inputs, retrieved context, tool calls, reasoning traces, and outputs.

Skills

Python

SQL

PySpark

Kafka

Delta Lake

Snowflake

Docker

Kubernetes

GitHub Actions

MLflow

Education

B.Tech/M.Tech/MS in CS or related field

Tools

Snowflake

Delta Lake

Kafka

PySpark

AWS

Azure

Docker

Kubernetes

GitHub Actions

MLflow

OpenAI

Claude

Hugging Face

Pinecone

FAISS

ChromaDB

OpenSearch

Neo4j

FastAPI

Job description

Aptlogica Technologies is seeking a hands-on AI Data Engineer to build, operate, and optimize production‑grade data pipelines for conversational AI and RAG applications. You will translate architecture designs into reliable data systems and ensure observability and governance.

The role requires 5–8+ years of experience, strong Python/SQL, PySpark, Snowflake, and cloud experience (AWS/Azure). You will work on ML/LLMOps foundations, vector stores, and agentic infrastructure to enable scalable AI