Lead Databricks/PySpark Engineer for Agentic AI

JPMorgan Chase & Co.; Wilmington (NC); Sur place; USD 140 000 - 190 000; Plein temps

Résumé du poste

JPMorganChase is seeking a Lead Software Engineer to advance data engineering for agentic AI systems. You will work in the Corporate Sector-Global Finance team, delivering production-grade PySpark/Databricks dataproducts and mentoring engineers in a fast-paced agile setting.

You will champion secure, scalable data solutions, collaborate with data scientists and product owners, and drive best practices across the SDLC with a focus on reliability and performance.

Qualifications

• Formal training or certification on software engineering concepts and 5+ years applied experience.
• Experience leading AI-assisted software development tools and setting team expectations for AI output correctness, performance, and security.
• Strong understanding of responsible AI use in engineering workflows, data sensitivity, secure handling, resiliency and security.
• Expert-level programming skills in Python/PySpark with production-grade code.
• Extensive hands-on experience with Databricks and AWS, including Glue, S3, Lambda, Spark and SQL.
• Knowledge of Lakehouse/Delta Lake architectures, data observability, and cost optimization.
• In-depth knowledge of enterprise-scale data warehousing and CI/CD processes.
• Agile methodologies, DevOps practices, and security considerations.
• Understanding of agentic AI concepts and data infrastructure to support autonomous agents.
• Experience building APIs and data services for AI agents.

Responsabilités

• Build and optimize data pipelines and workflows for agentic AI systems with real-time access to high-quality data.
• Drive team adoption of AI-assisted engineering practices to improve code quality, delivery speed, and operations, including automated testing and secure coding standards.
• Apply SDLC toolchain knowledge to improve automation and delivery value.
• Develop data retrieval and indexing layers enabling AI agents to search and synthesize information across data sources.
• Build and maintain APIs, data services, and endpoints for AI agents to interact with enterprise systems.
• Enforce data governance, quality, security, and compliance for data consumed and generated by autonomous AI agents.
• Hands-on production code development following AWS best practices and CI/CD pipelines; build orchestration and state management for multi-step workflows.
• Mentor junior engineers through pairing, reviews, and coaching; maintain engineering excellence.
• Collaborate with product owners, data scientists, and stakeholders to translate requirements into production-ready AI solutions; evaluate new AI frameworks and data engineering practices.

Connaissances

Python/PySpark

Databricks

AWS cloud

CI/CD

Big data

Agile/DevOps

Mentoring

Formation

Bachelor's degree in CS or related field

Outils

Terraform

Snowflake

S3

Lambda

Description du poste

JPMorganChase is seeking a Lead Software Engineer to advance data engineering for agentic AI systems. You will work in the Corporate Sector-Global Finance team, delivering production-grade PySpark/Databricks dataproducts and mentoring engineers in a fast-paced agile setting.

You will champion secure, scalable data solutions, collaborate with data scientists and product owners, and drive best practices across the SDLC with a focus on reliability and performance.