Remote Senior Data Engineer - AI Platform

NextPath Workforce Solutions; New York (NY); Remote; USD 160,000 - 200,000; Full time

Job summary

NextPath Workforce Solutions is seeking a Senior Data Engineer - AI Platform for a fully remote direct-hire role. The position targets a leader who will design and scale an enterprise Data & AI platform to support analytics and AI initiatives.

The ideal candidate has 8+ years of experience building data platforms, strong SQL/Python, Databricks, and hands-on experience with RAG pipelines and vector search, enabling AI-powered applications across diverse data workloads.

Qualifications

• 8+ years building and operating enterprise data platforms with hands-on AI/data work.
• Advanced SQL and Python with production-grade software practices.
• Hands-on Databricks experience and modern data modeling.
• Experience building Retrieval-Augmented Generation (RAG) pipelines.
• Experience with vector databases and AI search (embeddings, indexing).

Responsibilities

• Design, build, and scale an enterprise Data & AI platform.
• Develop scalable data pipelines across batch, streaming, structured, and unstructured data.
• Build AI-ready data products and retrieval capabilities for AI-powered apps.
• Improve vector search, hybrid search, and RAG capabilities.
• Develop event-driven/streaming solutions for near real-time insights.
• Establish engineering best practices for data modeling, testing, observability, governance, security and reliability.
• Create self-service and automation to improve developer productivity.
• Partner with cross-functional teams to deliver trusted data solutions for critical initiatives.
• Mentor engineers and contribute to architecture decisions and platform direction.

Skills

SQL

Python

RAG pipelines

Tools

Databricks

Vector databases

AI search

Job description

NextPath Workforce Solutions is seeking a Senior Data Engineer - AI Platform for a fully remote direct-hire role. The position targets a leader who will design and scale an enterprise Data & AI platform to support analytics and AI initiatives.

The ideal candidate has 8+ years of experience building data platforms, strong SQL/Python, Databricks, and hands-on experience with RAG pipelines and vector search, enabling AI-powered applications across diverse data workloads.