Senior AI/ML Engineer

Cooley AI; New York (NY); On-site; USD 145,000 - 210,000; Full time

Benefits offered by this job

Medical

HSAs

Dental

Vision

Commuter benefits

Life insurance

AD&D

LTD

PTO 21 days

Paid holidays 10

Parental leave

Fertility benefits

Job summary

Cooley seeks a Senior AI/ML Engineer to join the Practice Engineering team. The role focuses on building, deploying, and operating enterprise-scale AI/ML solutions across Azure, AWS and hybrid platforms.

It is highly hands-on with emphasis on secure, scalable software engineering practices. Responsibilities include designing production AI pipelines, collaborating with cross-functional teams, and staying current with AI and cloud technologies to deliver practical, high-performance solutions for

Qualifications

• Minimum 5+ years building and deploying AI/ML solutions.
• Hands-on experience with AI/ML on Azure and/or AWS.
• Strong Python for building LLM-powered applications.
• Experience integrating LLM apps with enterprise data sources, APIs, and retrieval systems (RAG).
• Experience building agentic and LLM-powered apps using LangChain, LangSmith, Pydantic AI or similar tooling.
• Knowledge of cloud security, governance, and data privacy.

Responsibilities

• Design, build, and maintain production-grade AI/ML solutions across Azure, AWS, and other cloud platforms.
• Implement end-to-end AI application pipelines including data ingestion, prompt engineering, evaluation, deployment, and monitoring.
• Collaborate with engineering, data, and business teams to translate requirements into practical AI/ML implementations.
• Write high quality, scalable, and maintainable code for AI/ML workloads.
• Optimize performance, reliability, and cost efficiency of cloud-based AI/ML services.
• Integrate AI/ML solutions with enterprise data platforms (data lakes/warehouses/APIs) and streaming systems.
• Support AI solution lifecycle management including versioning, prompt iteration, evaluation, and production support.
• Apply security, compliance, and data privacy best practices in all AI/ML implementations.
• Contribute to technical design discussions and provide guidance on AI/ML patterns.
• Stay current with AI, ML, and cloud technologies and apply pragmatically.

Skills

AI/ML experience

Python

Azure

AWS

LangChain

LangSmith

Pydantic AI

APIs

RAG

cloud security

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems or related discipline

Tools

LangChain

LangSmith

Pydantic AI

Job description

Cooley is seeking a Senior AI/ML Engineer to join the Practice Engineering team.

Position summary:

As a leading technology law firm, Cooley is determined to become a leader in the digital practice of law. Cooley Innovation embraces a culture of customer service excellence, and all members of the department are expected to advance this mission. To that end, the Artificial Intelligence/ Machine Learning Engineer will play a key role in building, deploying, and operating enterprise scale Artificial Intelligence (AI) and Machine Learning (ML) solutions across Azure, AWS, and other cloud and hybrid platforms. This role is highly hands on and execution focused, combining strong software engineering practices with applied AI and ML expertise to deliver secure, scalable, and high performing solutions that support the firm’s business and technology objectives. Specific duties and responsibilities include, but are not limited to, the following:

Position Responsibilities

• Design, build, and maintain production grade AI and ML solutions across Azure, AWS, and other cloud platforms
• Implement end to end AI application pipelines including data ingestion, prompt engineering, evaluation, deployment, and monitoring
• Collaborate closely with engineering, data, and business teams to translate requirements into practical AI and ML implementations
• Write high quality, scalable, and maintainable code for AI and ML workloads
• Optimize performance, reliability, and cost efficiency of cloud based AI and ML services
• Integrate AI and ML solutions with enterprise data platforms such as data lakes, data warehouses, APIs, and streaming systems
• Support AI solution lifecycle management including versioning, prompt iteration, evaluation, and production support
• Apply security, compliance, and data privacy best practices in all AI and ML implementations
• Contribute to technical design discussions and provide guidance on AI and ML implementation patterns
• Stay current with advancements in AI, ML, and cloud technologies and apply them pragmatically
• All other duties as assigned or required

Required

Skills and experience:

• After orientation at Cooley LLP, exhibit proficiency in the Microsoft Office suite, iManage and other firm applications
• Ability to work extended and/or weekend hours, as required
• Ability to travel, as required
• 5+ years directly applicable experience (e.g., building and deploying AI and ML solutions)
• Hands on experience developing AI and ML solutions on Azure and or AWS
• Strong proficiency in Python for building and operating LLM-powered applications and agentic workflows
• Experience integrating LLM applications with enterprise data sources, APIs, and retrieval systems (RAG)
• Hands on experience building agentic and LLM-powered applications using frameworks such as LangChain, LangSmith, Pydantic AI, or similar orchestration and observability tooling
• Knowledge of cloud security, governance, and data privacy principles as they relate to AI and ML systems

Preferred

• Bachelor’s degree in Computer Science, Engineering, Information Systems or related discipline

Competencies

• Excellent oral and written communications skills, including technical and user documentation writing
• Strong analytical, problem solving, critical thinking and implementation skills
• Professional demeanor
• Excellent attention to detail, follow-up, organizational and communications skills
• Ability to work independently and under pressure
• Ability to solve problems independently and simultaneously
• Entrepreneurial by nature
• Ability to organize, prioritize and coordinate multiple activities often under tight timelines
• Ability to drive projects to completion and achieve goals
• Strong judgment
• Team-player with collaborative spirit
• Unwavering ability to handle and maintain confidentiality regarding firm information, projects,
• client data
• High level of professionalism at all times
• Effective presentation skills

Cooley offers a competitive compensation and excellent benefits package and is committed to fair and equitable employment practices.

EOE.

The expected annual pay range for this position with a full-time schedule is $145,000 - $210,000. Please note that final offer amount will be dependent on geographic location, applicable experience and skillset of the candidate.

We offer a full range of elective benefits including medical, health savings account (with applicable medical plan), dental, vision, health and/or dependent care flexible spending accounts, pre-tax commuter benefits, life insurance, AD&D, long-term care coverage, backup care for children and/or adults and other parental support benefits. In addition to elective benefit options, benefited employees receive firm-paid life insurance, AD&D, LTD, short term medical benefits as well as 21 days of Paid Time Off ("PTO") and 10 paid holidays each year. We provide generous parental leave and fertility benefits. New employees will attend a detailed benefit orientation to learn more about our many benefits and resources.