Senior Data Engineer - AI Platform (Remote)

NextPath Workforce Solutions; New York (NY); Remote; USD 160,000 - 200,000; Full time

Job summary

NextPath Workforce Solutions is seeking a Senior Data Engineer – AI Platform to join our client’s team in a fully remote direct‑hire role. You will design, build, and scale an enterprise Data & AI platform supporting analytics and AI initiatives.

You will develop scalable data pipelines across batch, streaming, structured, and unstructured workloads; build AI‑ready data products and retrieval capabilities for AI applications; implement vector search and RAG capabilities; mentor engineers and

Qualifications

• 8+ years building and operating enterprise data platforms, incl. hands-on AI/data work.
• Advanced SQL and Python with production-grade software engineering practices.
• Hands-on Databricks experience and modern data modeling.
• Experience building and operating Retrieval-Augmented Generation (RAG) pipelines.
• Experience with vector databases and AI search (embeddings, indexing/search).

Responsibilities

• Design, build, and scale an enterprise Data & AI platform supporting analytics and AI initiatives.
• Develop and optimize scalable data pipelines across batch, streaming, structured, and unstructured workloads.
• Build AI-ready data products and retrieval capabilities for AI-powered applications.
• Implement and improve vector search, hybrid search, and RAG capabilities.
• Develop event-driven/streaming solutions for near real-time insights.
• Establish engineering best practices for data modeling, testing, observability, governance, security, and reliability.
• Create self-service and automation to improve developer productivity and time-to-insight.
• Partner with cross-functional teams to deliver trusted data solutions for critical initiatives.
• Mentor engineers and contribute to architecture decisions and platform direction.

Skills

SQL

Python

Databricks

RAG pipelines

Vector databases

AI search

Data modeling

Job description

NextPath Workforce Solutions is seeking a Senior Data Engineer – AI Platform to join our client’s team in a fully remote direct‑hire role. You will design, build, and scale an enterprise Data & AI platform supporting analytics and AI initiatives.

You will develop scalable data pipelines across batch, streaming, structured, and unstructured workloads; build AI‑ready data products and retrieval capabilities for AI applications; implement vector search and RAG capabilities; mentor engineers and