VP GenAI Platform Engineer

JCW Group; Charlotte (NC); Hybrid; USD 140,000 - 190,000; Full time

Job summary

JCW Group partners with a global financial institution to design and build an enterprise GenAI platform. The AI Solutions Engineer will architect a secure, scalable system on Databricks and Azure, delivering production-grade services and RAG pipelines for downstream applications.

You will work with architecture, technology, data, and business stakeholders, writing code and ensuring production readiness in a regulated environment.

Qualifications

• Experience deploying GenAI models to production environments.
• Strong Python development skills and GenAI tooling proficiency.
• Familiar with MLOps practices and CI/CD pipelines.

Responsibilities

• Design scalable, secure AI platform on Databricks and Azure.
• Build REST/WebSocket services for downstream apps.
• Develop RAG pipelines and orchestration layers.
• Create data pipelines to support AI/ML needs.
• Apply MLOps patterns for model lifecycle and observability.
• Mentor engineers on GenAI techniques and platform usage.

Skills

Python

GenAI frameworks

RESTful services

CI/CD

MLOps

Communication

Education

Bachelor's degree in Computer Science / Data Science

Tools

Databricks

Azure

LangGraph

Haystack

LlamaIndex

MLflow

Job description

Candidates must be authorized to work in the US without current or future sponsorship (including H-1B transfer or OPT/STEM OPT). Work authorization will be verified as part of the hiring process.

About the Role

JCW is partnering with a global financial institution to hire an AI Solutions Engineer to help design and build its enterprise GenAI platform. This is a high-impact role at the center of the bank’s AI strategy. You will architect a secure, scalable platform on Databricks and Azure, and build the services, RAG pipelines and agentic workflows that the rest of the business will rely on. You will work closely with Architecture, Technology, Data and business stakeholders, and partner with Azure, Databricks and other infrastructure providers. This is a hands‑on engineering seat. It is not a research role and not a pure architecture role. We want someone who can design the platform, write the code, and get it into production in a regulated environment.

What You’ll Do

• Design and architect a scalable, secure and compliant AI platform using Databricks and Azure Cloud Services as the foundation
• Build REST and WebSocket‑based AI/LLM platform services for consumption by downstream applications across the bank
• Develop and maintain production‑grade RAG (Retrieval‑Augmented Generation) pipelines and agentic orchestration layers using LangGraph and similar tools
• Build efficient, scalable data pipelines to support AI and ML data requirements
• Apply standardized architecture patterns and MLOps/LLMOps practices for model lifecycle management, observability and security
• Evaluate emerging GenAI technologies and integrate those that deliver clear business value
• Mentor and educate wider engineering teams on GenAI techniques and platform capabilities

What We’re Looking For

• Bachelor’s degree in Computer Science, Machine Learning, Data Science or a related field
• 3+ years of hands‑on experience developing, deploying and maintaining GenAI or advanced ML models in production
• 3+ years of Python and GenAI frameworks/tools such as Databricks Vector Search, Azure AI Search, Azure AI Document Intelligence, LangGraph, Haystack or LlamaIndex
• Advanced knowledge of prompt engineering, fine‑tuning, embedding models and RAG implementation, including vector databases, chunking strategies and GraphRAG
• Strong familiarity with MLOps/LLMOps tools (e.g., MLflow), Databricks and cloud platforms
• Proven experience building and deploying RESTful services, containerization and automated CI/CD
• Working knowledge of ML libraries such as PyTorch, TensorFlow and Hugging Face Transformers
• Excellent communication skills, with the ability to influence and partner with technical and non‑technical stakeholders

The Details

This role is based in Charlotte, NC, with 2 days per week on site. Candidates looking to relocate to Charlotte are welcome to apply, though relocation assistance is not provided. Applicants must be US Citizens or Green Card holders; visa sponsorship is not available.

JCW is proud to be an equal opportunity recruiter. We are committed to fostering an inclusive recruitment process and ensuring equal consideration for all applicants regardless of gender, age, disability, religion, sexual orientation, marital status, or race.