Senior AI Data Engineer - Databricks & Agentic AI

JPMorgan Chase & Co.; Wilmington (NC); On-site; USD 61,000 - 101,000; Full time

Job summary

JPMorgan Chase & Co. in the United States seeks a senior, hands-on Lead Software Engineer to build and optimize data pipelines for agentic AI systems. You will design data retrieval layers, APIs, and scalable data services powering enterprise AI workloads.

The role requires expert Python/PySpark knowledge, Databricks/AWS experience, and leadership to mentor engineers while delivering reliable AI-enabled data products on a fast-paced agile team.

Qualifications

• Formal training or certification in software engineering
• At least 5 years of applied software engineering experience
• Expert Python and PySpark programming skills with a production portfolio
• Hands-on Databricks and AWS (Glue, S3, SQS/SNS, Lambda) experience
• Deep Spark and SQL expertise, data warehousing experience
• Experience with CI/CD and automated testing frameworks
• Understanding of agile, DevOps, security, and data governance
• Exposure to agentic AI concepts and API/data service development

Responsibilities

• Build and optimize data pipelines for agentic AI systems
• Develop data retrieval and indexing layers across sources
• Maintain APIs and data services for enterprise systems
• Uphold data quality, security, and governance
• Write secure production code following AWS best practices
• Implement multi-step agent workflows with memory and persistence
• Conduct code reviews and raise technical standards
• Mentor engineers and collaborate with product and data science teams
• Evaluate emerging agentic AI frameworks and data engineering practices

Skills

Python proficiency

PySpark experience

Agile mindset

Mentoring

Team leadership

DevOps practices

Education

Software engineering certification

Tools

Databricks

AWS

Snowflake

Terraform

LangGraph / OpenAI API

Pinecone / FAISS / Chroma

Job description

JPMorgan Chase & Co. in the United States seeks a senior, hands-on Lead Software Engineer to build and optimize data pipelines for agentic AI systems. You will design data retrieval layers, APIs, and scalable data services powering enterprise AI workloads.

The role requires expert Python/PySpark knowledge, Databricks/AWS experience, and leadership to mentor engineers while delivering reliable AI-enabled data products on a fast-paced agile team.