Principal Software Engineer

Testing Site - JPMC; New York (NY); On-site; USD 180,000 - 280,000; Full time

Job summary

Testing Site - JPMC in New York seeks a senior AI/ML engineer to design, implement, and scale AI/ML infrastructure on AWS to support model serving and fine-tuning.

Collaborate with data scientists, engineers, and product teams to deploy AI/ML solutions, mentor juniors, monitor model performance, and drive Gen AI productionization and LLM Ops. Stay ahead of AI trends and build robust, scalable workflows that align with regulatory and security requirements.

Qualifications

• Bachelor's or Master's degree in CS, Engineering or related field.
• 8+ years of AI/ML engineering experience focusing on AWS, Databricks and Gen AI.
• Strong understanding of AI/ML algorithms, model serving and fine-tuning.
• Proven production experience with Gen AI use cases and LLM Ops.

Responsibilities

• Design, implement, and scale AI/ML infra on AWS for model serving.
• Collaborate with cross-functional teams for deployment of AI/ML solutions.
• Develop and optimize ML models to meet business objectives.
• Stay updated on Gen AI tech and integrate into strategy.
• Lead Gen AI productionization and LLM Ops.
• Mentor juniors and foster a culture of innovation.
• Monitor model performance and scalability; identify improvements.
• Implement optimization techniques to enhance accuracy and efficiency.

Skills

AI/ML engineering

LLM Ops

Model serving

Leadership

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related field

Tools

AWS

Databricks

Gen AI tools

Job description

Key Responsibilities:

• Design, implement, and scale AI/ML infrastructure and platforms on AWS to support serving and fine-tuning of models.
• Collaborate with cross-functional teams to ensure seamless integration and deployment of AI/ML solutions.
• Develop and optimize machine learning models and algorithms to meet business objectives.
• Stay updated with the latest advancements in AI/ML and Gen AI technologies and incorporate them into the organization's strategy.
• Leverage Databricks for data processing, model training, and deployment.
• Utilize Gen AI tools and frameworks to enhance model performance and capabilities.
• Implement best practices for LLM Ops to ensure efficient model lifecycle management.
• Lead the productionalization of Gen AI use cases, ensuring robust and scalable solutions.
• Work closely with data scientists, engineers, and product teams to deliver AI-driven solutions.
• Mentor and guide junior team members, fostering a culture of innovation and excellence.
• Monitor the performance of AI/ML models and platforms, identifying areas for improvement.
• Implement optimization techniques to enhance model accuracy, efficiency, and scalability.

Required qualifications, capabilities and skills:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Minimum 8+ years of experience experience in AI/ML engineering, with a focus on AWS, Databricks, and Gen AI.
• Strong understanding of AI/ML algorithms, model serving, and fine-tuning techniques.
• Proven experience in LLM Ops and the productionalization of Gen AI use cases.
• Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
• Strong communication and leadership skills, with the ability to influence and drive change.

Preferred qualifications, capabilities and skills:

• Experience with other cloud platforms and AI/ML tools.
• Familiarity with data engineering and data science workflows.
• Knowledge of regulatory and compliance requirements related to AI/ML solutions