Senior Data Engineer, AI & Analytics Infrastructure

IBM; New York (NY); On-site; USD 120,000 - 170,000; Full time

Job summary

IBM Consulting seeks an experienced Data Engineer to design and scale data pipelines and infrastructure for a high-priority Agentic AI engagement. You’ll work with AI architects to ensure data reaches the right systems in the right form, applying modern data platforms and governance practices.

You will build scalable architectures using Microsoft Fabric, Databricks, and Azure Synapse, while enabling tool calling, contextual retrieval, and multi-agent coordination for enterprise AI delivery.

Qualifications

• 7+ years designing, developing, and deploying scalable AI apps.
• Experience with agentic AI workflows and RAG architectures.
• Hands-on data pipelines and data governance experience.
• Experience with CI/CD, LLMOps, and cloud-native deployment.

Responsibilities

• Design, build, and maintain robust data pipelines ingesting and delivering data.
• Architect data lakehouse patterns and scalable data infra for AI use cases.
• Implement data quality checks, governance, lineage, and access controls.
• Collaborate with AI engineers to ensure data readiness for models and dashboards.

Skills

AI pipelines

LangChain

LangGraph

MLOps

Data governance

Data infrastructure

Azure/Microsoft Fabric

Databricks

Azure Synapse

API and data platforms

Education

Master's Degree

Tools

LangChain

LangGraph

Microsoft Fabric

Databricks

Azure Synapse Analytics

Pinecone

Weaviate

Job description

IBM Consulting seeks an experienced Data Engineer to design and scale data pipelines and infrastructure for a high-priority Agentic AI engagement. You’ll work with AI architects to ensure data reaches the right systems in the right form, applying modern data platforms and governance practices.

You will build scalable architectures using Microsoft Fabric, Databricks, and Azure Synapse, while enabling tool calling, contextual retrieval, and multi-agent coordination for enterprise AI delivery.