Senior Data & AI Platform Engineer

Soni; New York (NY); On-site; USD 175,000 - 215,000; Full time

Job summary

Soni is seeking a Senior Data & AI Platform Engineer to design, build, and support secure, scalable cloud infrastructure for enterprise AI. The role emphasizes Azure AI Foundry, data pipelines, and DevSecOps across Python apps and LLM integrations.

The ideal candidate has 8+ years in cloud infra, platform engineering, and data systems, with strong Python, Terraform, and Kubernetes experience. Expect collaboration across security, architecture, and business teams.

Qualifications

• Bachelor's degree in CS/CE/IS or related field.
• 8+ years in cloud infrastructure, platform engineering, DevOps, or data engineering.
• Experience building enterprise platforms or shared developer services.
• Strong Python development skills, REST APIs (FastAPI/Flask) & automation scripting.
• Experience with Terraform and/or Bicep, Docker, Kubernetes, CI/CD pipelines.
• Experience integrating enterprise LLM services like Azure OpenAI and Anthropic Claude APIs.
• Knowledge of RAG, vector search, and AI frameworks like LangChain or Semantic Kernel.
• Solid cloud security, identity management, DevSecOps, and governance.

Responsibilities

• Design, build, and support enterprise AI platforms for Python-based AI apps.
• Configure and manage Azure AI Foundry, hubs, workspaces, models, access controls.
• Integrate Azure OpenAI and LLM APIs with secure auth, monitoring, and cost controls.
• Develop reusable developer tools, templates, and automation for AI delivery.
• Build data pipelines with Azure Data Factory and Databricks.
• Implement vector search and document retrieval for RAG apps.
• Maintain Azure Data Lake, Azure SQL, Cosmos DB, and related platforms.
• Provision Azure infra with Terraform/Bicep; exposure to AWS.
• Create CI/CD pipelines with Azure DevOps or GitHub Actions; manage Docker/Kubernetes (AKS).
• Apply DevSecOps practices: secrets, scans, policy enforcement.

Education

Bachelor's degree in Computer Science, Computer Engineering, Information Systems, or related field

Tools

Azure DevOps

GitHub Actions

Terraform

Bicep

AKS

Azure Data Factory

Azure Databricks

Cosmos DB

Azure Data Lake

SQL

Job description

Our client is seeking a Senior Data & AI Platform Engineer to design, build, and support secure, scalable cloud infrastructure that enables enterprise AI initiatives. This platform engineering role focuses on building the infrastructure, developer tooling, and data platforms that allow engineering teams to rapidly develop and deploy AI-powered Python applications. The ideal candidate has strong experience with Azure cloud technologies, data engineering, infrastructure automation, DevOps, and AI platform services.

Responsibilities

• Design, build, and support enterprise AI platforms for Python-based AI applications.
• Configure and manage Azure AI Foundry, including AI hubs, project workspaces, model deployments, and access controls.
• Integrate Azure OpenAI and third-party LLM APIs using secure authentication, API management, monitoring, and cost controls.
• Develop reusable developer tools, templates, and automation to accelerate AI application delivery.
• Build and maintain data pipelines using Azure Data Factory and Azure Databricks.
• Implement vector search and document retrieval infrastructure to support RAG applications.
• Manage Azure Data Lake, Azure SQL, Cosmos DB, and other enterprise data platforms.
• Provision and maintain Azure infrastructure using Terraform and/or Bicep, with exposure to AWS environments.
• Build CI/CD pipelines using Azure DevOps and/or GitHub Actions and manage containerized workloads with Docker and Kubernetes (AKS).
• Implement DevSecOps best practices, including secrets management, security scanning, and policy enforcement.
• Partner with engineering, architecture, security, and business teams to deliver secure, scalable AI solutions.
• Create technical documentation, architecture diagrams, and operational runbooks.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, Information Systems, or a related field.
• 8+ years of experience in cloud infrastructure, platform engineering, DevOps, or data engineering.
• Experience building enterprise platforms or shared developer services.
• Strong Python development skills, including REST APIs (FastAPI or Flask) and automation scripting.
• Experience with Terraform and/or Bicep, Docker, Kubernetes, and CI/CD pipelines.
• Experience integrating enterprise LLM services such as Azure OpenAI and Anthropic Claude APIs.
• Knowledge of RAG architectures, vector search, and AI frameworks such as LangChain or Semantic Kernel.
• Strong understanding of cloud security, identity management, DevSecOps, and enterprise governance.
• Preferred: Experience with AWS, Microsoft Fabric, Azure Synapse, Databricks Unity Catalog, Azure certifications (AI-102, DP-203, AZ-305), or experience supporting highly regulated enterprise environments.

Compensation

$175,000 to $215,000 annually

Compensation is based on a range of factors that include relevant experience, knowledge, skills, other job-related qualifications