Associate AI Engineer

Columbia University Irving Medical Center

New York (NY)

On-site

USD 127,000 - 143,100

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Columbia University Irving Medical Center is seeking an Associate Applied AI Engineer to support the development and maintenance of AI applications. This role involves designing and implementing solutions for administrative, research, clinical, and educational operations. Candidates should have a Bachelor's degree in a related field and significant experience in AI, programming, and software development. Responsibilities include troubleshooting, developing AI tools, and ensuring compliance with data governance standards.

Qualifications

  • Bachelor's degree or equivalent in education and experience, plus four years of experience.
  • Minimum 4 years of professional experience in software engineering or AI.
  • Experience with at least one programming language commonly used for AI development.

Responsibilities

  • Design, develop, and maintain AI-enabled applications utilizing RAG techniques.
  • Troubleshoot AI applications and assist with technical issues.
  • Partner with teams to design and implement AI-enabled solutions.

Skills

Software engineering
Artificial intelligence
Machine learning
Data engineering
Problem-solving
Python
JavaScript
TypeScript
Java
C#

Education

Bachelor’s degree in Computer Science, Engineering, AI, or related field

Tools

LangChain
LlamaIndex
AWS
Google Cloud Platform
Microsoft Azure

Job description

Grade 105

  • Job Type: Officer of Administration
  • Bargaining Unit:
  • Regular/Temporary: Regular
  • End Date if Temporary:
  • Hours Per Week: 35
  • Standard Work Schedule:
  • Building:
  • Salary Range: $127,000 - $143,100

The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to departmental budgets, qualifications, experience, education, licenses, specialty, and training. The above hiring range represents the University's good faith and reasonable estimate of the range of possible compensation at the time of posting.

Position Summary

The Associate Applied AI Engineer supports the development, deployment, and maintenance of artificial intelligence applications for the Columbia University Irving Medical Center (CUIMC). This role contributes to the design and implementation of AI-enabled solutions that support administrative, research, clinical, and educational operations across the institution.

Working closely with senior engineers and cross-functional teams, the Junior Engineer assists in building applications that leverage large language models (LLMs), retrieval-augmented generation (RAG), automation frameworks, and machine learning techniques. This role focuses on implementing AI solutions, supporting application deployment, and ensuring systems operate securely, efficiently, and in alignment with institutional policies and governance standards.

Responsibility Highlights
AI Development and Implementation
  • Design, develop, and maintain AI-enabled applications utilizing retrieval-augmented generation (RAG) techniques to enhance knowledge discovery, automate workflows, and support decision-making across CUIMC operations.
  • Build scalable AI tools and services that integrate with CUIMC administrative, clinical, research, and educational systems.
  • Develop rapid proof-of-concept prototypes to evaluate new technologies and demonstrate solution feasibility to stakeholders.
  • Assist with optimization of prompts, pipelines, and model workflows to improve application performance and reliability.
Technical Support and Documentation
  • Troubleshoot AI applications and assist with diagnosing and resolving technical or performance issues in development or production environments.
  • Maintain clear technical documentation, including architecture diagrams, workflows, and implementation notes to support system sustainability and team knowledge sharing.
Operations & Continuous Improvement
  • Monitor emerging developments in artificial intelligence, machine learning frameworks, and generative AI technologies relevant to healthcare and higher education.
  • Prototype solutions using open-source tools and AI platforms present demonstrations or findings to internal stakeholders.
  • Participate in exploratory initiatives assessing new AI capabilities and their potential institutional impact.
Responsible AI and Compliance
  • Support the design and deployment of AI solutions that prioritize privacy, transparency, security, and ethical use of data.
  • Adhere to CUIMC policies related to data governance, compliance, and institutional review requirements.
  • Contribute to the development of internal best practices and governance frameworks for the safe and responsible use of generative and predictive AI technologies.
People Engagement
  • Partner with engineers, analysts, data scientists, and institutional stakeholders to design and implement AI-enabled solutions.
  • Participate in stakeholder discussions to assess needs and recommend AI tools aligned with institutional priorities.
Other Duties
  • Perform other related duties and responsibilities as assigned/requested.
Minimum Qualifications
  • Bachelor's degree or equivalent in education and experience, plus four years of experience.
Preferred Qualifications
  • Bachelor’s degree in Computer Science, Engineering, Artificial Intelligence, Statistics, or equivalent combination of education and experience.
  • Minimum 4 years of professional experience in software engineering, artificial intelligence, machine learning, data engineering, or a related technical field.
  • Experience with at least one programming language commonly used for AI or application development (e.g., Python, JavaScript, TypeScript, Java, or C#).
  • Experience developing, testing, and maintaining software applications, data pipelines, or AI-enabled solutions.
  • Strong analytical and problem-solving skills with the ability to translate technical concepts into practical solutions.
  • Master’s degree in Computer Science, Artificial Intelligence, Data Science, Engineering, Statistics, or a related discipline.
  • Experience developing applications that leverage large language models (LLMs), generative AI tools, or retrieval-augmented generation (RAG).
  • Familiarity with AI development frameworks or orchestration tools such as LangChain, LlamaIndex, or similar technologies.
  • Experience deploying applications or machine learning workflows in cloud environments such as AWS, Google Cloud Platform, or Microsoft Azure.
  • Exposure to AI platforms such as Amazon Bedrock, Google Vertex AI, or Azure AI Studio.
  • Experience working with natural language processing (NLP), data extraction, or analytics involving structured and unstructured data.
  • Familiarity with Agile development practices, Git-based version control, and collaborative software development workflows.

Equal Opportunity Employer / Disability / Veteran

Columbia University is committed to the hiring of qualified local residents.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Principal AI Engineer
Principal AI Engineer

Columbia University • New York (NY), Northern (KY)

Hybrid
USD 150,000 - 220,000
AI Developer/Engineer
AI Developer/Engineer

Connect for Health Co • Denver (CO)

Remote
USD 111,000 - 146,000
Robust benefits package
403(b) plan
Paid time off
+2
AI Engineer
AI Engineer

NYU Langone Health • New York (NY)

On-site
USD 98,000 - 140,000
AI Engineer (AI Accelerator Program)
AI Engineer (AI Accelerator Program)

UCSF Health • San Francisco (CA)

Hybrid
USD 140,000 - 210,000
AI Solutions Architect - Computing Services
AI Solutions Architect - Computing Services

Carnegie Mellon University • Pittsburgh

On-site
USD 90,000 - 120,000
Medical and dental insurance
Generous retirement savings program
Tuition benefits
+2
AI Engineer New York, NY
AI Engineer New York, NY

NYU Langone • New York (NY), Northern (KY)

Hybrid
USD 70,000 - 91,000
Machine Learning Engineer
Machine Learning Engineer

NYU Langone Hospitals • New York (NY)

On-site
USD 84,000 - 126,000
Comprehensive benefits package
Generous time-off program
Holistic wellness program
AI/ML Engineer - Engineering Excellence (Full Stack Developer)
AI/ML Engineer - Engineering Excellence (Full Stack Developer)

Citi • Jacksonville (TX)

On-site
USD 107,000 - 161,000
AI Developer/Analyst - Information Technology Services
AI Developer/Analyst - Information Technology Services

The University at Albany, State University of New York • City of Albany (NY)

Hybrid
USD 80,000 - 100,000
Digital Software Engineer Lead Analyst - VP
Digital Software Engineer Lead Analyst - VP

Citi • Jacksonville (TX)

On-site
USD 126,000 - 188,000
Medical, dental & vision coverage
401(k)
Life, accident, and disability保险
+2