Senior AI/ML Engineer

Cooley AI; New York (NY); On-site; USD 200,000 - 300,000; Full time

Benefits offered by this job

Medical plan

Dental plan

Vision plan

HSA

Job summary

Cooley AI seeks a Senior AI/ML Engineer to design, deploy, and operate enterprise-grade AI/ML solutions across Azure, AWS, and hybrid platforms. The role emphasizes hands-on development, scalable pipelines, and secure, cost-efficient cloud services.

You will collaborate with engineering, data, and business teams to translate requirements into practical AI implementations, writing high-quality code and ensuring data privacy and governance across deployments.

Qualifications

• 5+ years directly applicable experience (e.g., building and deploying AI and ML solutions).
• Hands-on experience developing AI/ML solutions on Azure and/or AWS.
• Strong proficiency in Python for building and operating LLM-powered applications and agentic workflows.
• Experience integrating LLM applications with enterprise data sources, APIs, and retrieval systems (RAG).
• Knowledge of cloud security, governance, and data privacy principles as they relate to AI and ML systems.

Responsibilities

• Design, build, and maintain production-grade AI/ML solutions across cloud platforms.
• Implement end-to-end AI application pipelines including data ingestion, prompt engineering, evaluation, deployment, and monitoring.
• Collaborate with engineering, data, and business teams to translate requirements into practical AI implementations.
• Write high-quality, scalable code for AI workloads and integrate with enterprise data platforms.

Skills

Python

LLM workflows

Data ingestion

Cloud integration

Security & privacy

Education

Bachelor’s degree in CS/Engineering

Tools

Azure

AWS

LangChain

LangSmith

Pydantic AI

Job description

Cooley AI is seeking a Senior AI/ML Engineer to join the Practice Engineering team.

About Cooley AI

Cooley AI is the wholly-owned subsidiary of Cooley LLP. The frontier development arm of the leading technology law firm in the world. Our mission is to bring the best-in-class practices from the technology field into the legal domain to help lead our firm and the legal industry into the AI era. All employees of Cooley AI are employees of Cooley and are seconded to Cooley AI.

Position summary

As a leading technology law firm, Cooley is determined to become a leader in the digital practice of law. Cooley Innovation embraces a culture of customer service excellence, and all members of the department are expected to advance this mission. To that end, the Artificial Intelligence/ Machine Learning Engineer will play a key role in building, deploying, and operating enterprise scale Artificial Intelligence (AI) and Machine Learning (ML) solutions across Azure, AWS, and other cloud and hybrid platforms. This role is highly hands on and execution focused, combining strong software engineering practices with applied AI and ML expertise to deliver secure, scalable, and high performing solutions that support the firm’s business and technology objectives. Specific duties and responsibilities include, but are not limited to, the following:

Position Responsibilities

• Design, build, and maintain production grade AI and ML solutions across Azure, AWS, and other cloud platforms
• Implement end to end AI application pipelines including data ingestion, prompt engineering, evaluation, deployment, and monitoring
• Collaborate closely with engineering, data, and business teams to translate requirements into practical AI and ML implementations
• Write high quality, scalable, and maintainable code for AI and ML workloads
• Optimize performance, reliability, and cost efficiency of cloud based AI and ML services
• Integrate AI and ML solutions with enterprise data platforms such as data lakes, data warehouses, APIs, and streaming systems
• Support AI solution lifecycle management including versioning, prompt iteration, evaluation, and production support
• Apply security, compliance, and data privacy best practices in all AI and ML implementations
• Contribute to technical design discussions and provide guidance on AI and ML implementation patterns
• Stay current with advancements in AI, ML, and cloud technologies and apply them pragmatically
• All other duties as assigned or required

Required

• After orientation at Cooley LLP, exhibit proficiency in the Microsoft Office suite, iManage and other firm applications
• Ability to work extended and/or weekend hours, as required
• Ability to travel, as required
• 5+ years directly applicable experience (e.g., building and deploying AI and ML solutions)
• Hands on experience developing AI and ML solutions on Azure and or AWS
• Strong proficiency in Python for building and operating LLM-powered applications and agentic workflows
• Experience integrating LLM applications with enterprise data sources, APIs, and retrieval systems (RAG)
• Hands on experience building agentic and LLM-powered applications using frameworks such as LangChain, LangSmith, Pydantic AI, or similar orchestration and observability tooling
• Knowledge of cloud security, governance, and data privacy principles as they relate to AI and ML systems

Preferred

• Bachelor’s degree in Computer Science, Engineering, Information Systems or related discipline

Competencies

• Excellent oral and written communications skills, including technical and user documentation writing
• Strong analytical, problem solving, critical thinking and implementation skills
• Professional demeanor
• Excellent attention to detail, follow-up, organizational and communications skills
• Ability to work independently and under pressure
• Ability to solve problems independently and simultaneously
• Entrepreneurial by nature
• Ability to organize, prioritize and coordinate multiple activities often under tight timelines
• Ability to drive projects to completion and achieve goals
• Strong judgment
• Team-player with collaborative spirit
• Unwavering ability to handle and maintain confidentiality regarding firm information, projects,
• client data
• High level of professionalism at all times
• Effective presentation skills

Cooley offers a competitive compensation and excellent benefits package and is committed to fair and equitable employment practices.

EOE.

The expected annual pay range for this position with a full-time schedule is $200,000 - $300,000. Please note that final offer amount will be dependent on geographic location, applicable experience and skillset of the candidate.

We offer a full range of elective benefits including medical, health savings account (with applicable medical plan), dental, vision, health and/or dependent care flexible spending accounts, pre-tax commuter benefits, life insurance, AD&D, long-term care coverage, backup care for children and/or adults and other parental support benefits. In addition to elective benefit options, benefited employees receive firm-paid life insurance, AD&D, LTD, short term medical benefits as well as 21 days of Paid Time Off (“PTO”) and 10 paid holidays each year. We provide generous parental leave and fertility benefits. New employees will attend a detailed benefit orientation to learn more about our many benefits and resources.