Senior AI Data Engineer — Generative AI Platforms

Medidata Solutions, Inc.; New York (NY); Hybrid; USD 115,000 - 153,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Life insurance

Disability insurance

401(k) matching

Family leave

Flexible PTO

10 paid holidays

Job summary

Medidata Solutions, Inc. is seeking a Senior AI & Data Engineer on the Study Experience team to design, build, and operate production-grade AI and data solutions enabling intelligent applications, automation, analytics, and workflows.

This hands-on role focuses on Generative AI and agentic workflows, partnering with AWS, Snowflake, Python, and Java to deliver scalable data pipelines and LLM-powered services. Collaboration across engineering, product, QA, and platform teams is essential.

Qualifications

• 5+ years of professional experience in software engineering, AI engineering, data engineering, or a related technical discipline.
• Strong hands-on experience developing production applications and services using Python.
• Practical experience building or integrating Generative AI applications, LLM workflows, agentic systems, or AI-enabled services.
• Good understanding of RAG, embeddings, vector search, retrieval, grounding, and LLM orchestration concepts.
• Experience with at least one AI orchestration framework or emerging protocol such as LangGraph, LangChain, MCP, or equivalent technologies.
• Strong SQL and data engineering fundamentals, including experience building production data pipelines and integrations.
• Experience working with AWS and modern data platforms such as Snowflake.
• Experience developing or integrating REST APIs and backend services.
• Strong understanding of modern software engineering practices including automated testing, CI/CD, version control, observability, and production support.
• Ability to independently troubleshoot complex issues across AI services, APIs, data pipelines, and cloud environments.
• Strong communication and collaboration skills and the ability to contribute effectively to technical design discussions.

Responsibilities

• Design and build production Generative AI applications, AI agents, and LLM-powered workflows for enterprise use cases.
• Develop AI services and backend capabilities using Python, APIs, and cloud-native engineering patterns.
• Build RAG and retrieval workflows that securely connect enterprise data and applications to AI solutions.
• Implement agentic workflows involving tool calling, structured outputs, retrieval, workflow execution, and external system integrations.
• Work with AI orchestration frameworks and emerging standards such as LangGraph, LangChain, MCP, or similar technologies.
• Implement testing, evaluation, guardrails, monitoring, and observability to improve the quality and reliability of production AI solutions.
• Design and maintain scalable data pipelines and ETL/ELT workflows that support AI, analytics, and operational applications.
• Build data solutions using AWS, Snowflake, Python, SQL, and modern data engineering technologies.
• Develop and integrate APIs and backend services, including Java-based applications where needed.
• Apply strong software engineering practices including automated testing, CI/CD, Git, security, documentation, and production support.
• Use AI-assisted development tools and coding agents as part of day-to-day design, coding, testing, debugging, and code review.
• Collaborate with engineers, architects, product teams, and business stakeholders on technical designs and production solutions.
• Mentor engineers through technical guidance, code reviews, and knowledge sharing.

Skills

Python

Generative AI

LLM workflows

AI orchestration

Data pipelines

AWS

Snowflake

REST APIs

CI/CD

Debugging

Tools

LangGraph

LangChain

MCP

OpenAI APIs

AWS Bedrock

Kubernetes

Docker

Airflow

dbt

Job description

Medidata Solutions, Inc. is seeking a Senior AI & Data Engineer on the Study Experience team to design, build, and operate production-grade AI and data solutions enabling intelligent applications, automation, analytics, and workflows.

This hands-on role focuses on Generative AI and agentic workflows, partnering with AWS, Snowflake, Python, and Java to deliver scalable data pipelines and LLM-powered services. Collaboration across engineering, product, QA, and platform teams is essential.