Senior AI Data Engineer - Data Lakes, RAG & LLM

Hallmark Global Solutions Ltd; New Jersey; Hybrid; USD 180,000 - 240,000; Full time

Job summary

Hallmark Global Solutions Ltd. seeks a Senior AI Data Engineer with 10+ years of data engineering experience and hands-on AI/ML data pipelines.

You will design scalable data platforms and data lakes to support Generative AI, RAG, LLM, and MCP-based solutions. You will build high-volume pipelines with Python, Spark and SQL, transform data for AI apps, and collaborate with data scientists to integrate platforms with AI tools.

Qualifications

• 10+ years of experience in Data Engineering.
• Strong hands-on experience with Python.
• Strong experience with Apache Spark / PySpark.
• Advanced SQL skills.
• Experience designing and working with Data Lakes and modern data platforms.
• Strong understanding of AI/ML data pipelines and architectures.
• Hands-on experience with RAG and LLM-based applications.
• Understanding of MCP (Model Context Protocol) and its application in AI systems.
• Experience working with structured and unstructured data.
• Strong understanding of data modeling, ETL/ELT, data processing, and distributed computing.
• Excellent problem-solving and communication skills.

Responsibilities

• Design, develop, and maintain scalable data engineering and data lake solutions.
• Build and optimize high-volume data pipelines using Python, Spark, and SQL.
• Prepare and transform structured and unstructured data for AI/ML and Generative AI applications.
• Develop data pipelines and architectures supporting RAG and LLM applications.
• Work with AI/ML teams to integrate data platforms with modern AI solutions.
• Develop and maintain data ingestion, transformation, processing, and orchestration workflows.
• Design data models and data architectures optimized for analytics and AI use cases.
• Implement solutions for data quality, governance, security, scalability, and performance.
• Work with LLMs, embeddings, vector-based retrieval, and RAG architectures.
• Contribute to MCP-based AI integrations and applications.
• Troubleshoot and optimize data pipelines and distributed processing environments.
• Collaborate with data scientists, AI/ML engineers, architects, and business stakeholders.

Skills

10+ years exp

Python

Spark / PySpark

SQL

Data Lakes

AI/ML pipelines

RAG / LLM

MCP protocol

Structured & unstructured

ETL/ELT

Tools

Vector databases

Embedding pipelines

Cloud data platforms

Job description

Hallmark Global Solutions Ltd. seeks a Senior AI Data Engineer with 10+ years of data engineering experience and hands-on AI/ML data pipelines.

You will design scalable data platforms and data lakes to support Generative AI, RAG, LLM, and MCP-based solutions. You will build high-volume pipelines with Python, Spark and SQL, transform data for AI apps, and collaborate with data scientists to integrate platforms with AI tools.