AI Platform Engineer

Accord Technologies Inc; Dallas (TX); Hybrid; USD 130,000 - 180,000; Full time

Job summary

A technology firm is seeking a skilled Platform AI Engineer to develop an advanced Model-as-a-Service platform for AI projects. This senior role demands expertise in Python and data engineering, with a focus on creating user-friendly tools for complex AI deployments. The candidate will manage a substantial on-premises GPU farm and integrate deployment pipelines using CI/CD tools. Strong problem-solving abilities and a track record in producing scalable platform services are essential.

Qualifications

• 10-15+ years of experience building production-grade platforms.
• Expert hands-on knowledge of Python and extensive data engineering experience.
• Proven record in developing tools/platforms for other developers or business units.

Responsibilities

• Design and develop a Model-as-a-Service platform for AI solutions.
• Optimize end-to-end Retrieval-Augmented Generation pipelines.
• Manage and optimize on-premises GPU farms in the U.S. banking sector.

Skills

Expert Python

Data Engineering

RAG Expertise

Platform Engineering

Infrastructure Knowledge

DevOps

Job description

Location: Dallas, TX, Charlotte, NC

Position type: W2 contract.

Visa: Any visa independent.

Platform AI Engineer

Our goal is to build an internal, on-premises AI ecosystem that mimics the capabilities of AWS or Azure. You will be responsible for creating a horizontal platform used by various lines of business to deploy AI projects simultaneously.

Key Responsibilities

• Design and develop a Model-as-a-Service platform that allows non-experts to use drag-and-drop components to build AI solutions.
• Build and optimize end-to-end Retrieval-Augmented Generation pipelines with sophisticated chunking strategies and vector database management.
• Develop and maintain MCP libraries, clients, and servers to connect various data sources to the AI engine.
• Help manage and optimize one of the largest on-premises GPU farms in the U.S. banking sector (500+ Nvidia nodes).
• Build a repository for Agentic AI where users can select existing agents or build custom ones for specialized tasks.
• Integrate AI deployment pipelines with enterprise-level CI/CD tools such as Jenkins and Ansible.
• Implement corporate-level guardrails and work within Model Risk Management frameworks to ensure all AI deployments are secure and compliant.

Required Technical Skills

• Expert Python: Deep, hands‑on knowledge is mandatory.
• Data Engineering: Extensive experience in massive data ingestion and processing.
• RAG Expertise: Deep understanding of vector databases, inferencing, and advanced chunking strategies.
• Platform Engineering: Proven experience building tools/platforms that other developers or business units use.
• Infrastructure Knowledge: Experience mimicking cloud capabilities (AWS/Azure) within a strictly on‑premise environment.
• DevOps: Familiarity with Jenkins, Ansible, and automated deployment pipelines.

Experience & Qualifications

• Seniority: This is a senior-level role; we are looking for someone with a proven track record of building production‑grade platforms (10‑15+ years).
• Industry Knowledge: Stay current with the latest AI advancements such as rag-less inferencing and agentic frameworks.
• Problem Solver: Ability to translate a business unit use case into a scalable platform service.
• Experience with Scale: Experience working with large‑scale GPU farms and high‑volume data environments is highly preferred.