Senior AI Engineer — NYC In-Office AI Platform

Kharon; New York (NY); On-site; USD 160,000 - 200,000; Full time

Benefits offered by this job

Fully sponsored medical, dental, and視

FSA program for medical and dependent"

Long term disability

401k + Roth with matching and vesting

Flexible paid time off + 11 paid

Job summary

Kharon in New York City is seeking a Senior AI Engineer for its AI Platform to design and ship production AI components. In-office attendance at least 3 days per week is required.

You will collaborate with product managers, designers, engineers, and data scientists to translate complex business problems into scalable AI systems, build data pipelines, and ensure monitoring and ethical alignment. This role offers a competitive base salary and comprehensive benefits as Kharon expands its risk

Qualifications

• Bachelor's or Master’s degree in Computer Science, Artificial Intelligence, Engineering, or a related field preferred.
• Strong software development skills in Python and experience with libraries like Langchain/Langgraph, Agent SDKs, Pydantic, SQLAlchemy/Alembic, PySpark/Polars/Pandas.
• Experience with tracing systems (MLFlow, Sentry), RAG Systems, Memory Systems, MCP Servers, Agent Skills, and knowledge of different models and tradeoffs.
• Strong understanding of how to make use of AI tools for rapid development (Cursor, Claude Code, etc)
• Familiarity with containerization (Docker), cloud deployment (AWS preferred, Github Actions)
• Demonstrated ability to ship high-quality, production-ready ML/AI systems under tight iteration cycles.
• Passion for solving complex problems with real-world impact, especially in high-stakes or regulated domains.
• Excellent communication skills and the ability to thrive in cross-functional, mission-driven environments.

Responsibilities

• Design, develop, and ship proof-of-concept AI applications within days or weeks.
• Build and integrate advanced AI components, including Model Context Protocol clients and servers, foundation model fine-tuning, and multi-agent orchestration frameworks (eg. Claude Agent SDK, LangChain, AutoGPTI).
• Take features from idea to production, including architecting data flows, writing high-quality code, containerizing services, and deploying them in secure cloud environments (e.g., AWS).
• Partner closely with product managers, designers, engineers, and data scientists to translate abstract business problems into concrete, scalable AI systems.
• Develop production-grade data pipelines integrating data to/from AI systems.
• Develop and maintain internal tools to speed up development cycles, CI/CD scripts, evaluation harnesses, dashboards, and secure sandbox environments.
• Ensure AI systems are monitored, explainable, and aligned with ethical, regulatory, and performance standards.
• Stay at the forefront of AI/ML advancements, evaluate open-source frameworks, and share best practices across the team.

Skills

Python

Langchain/Langgraph

Agent SDKs

Pydantic

SQLAlchemy/Alembic

PySpark/Polars/Pandas

MLFlow/Sentry tracing

RAG Systems

Memory Systems

Cloud deployment (AWS)

Education

Bachelor’s or Master’s in CS/AI/Engineering

Tools

Docker

AWS

GitHub Actions

Claude Agent SDK

Job description

Kharon in New York City is seeking a Senior AI Engineer for its AI Platform to design and ship production AI components. In-office attendance at least 3 days per week is required.

You will collaborate with product managers, designers, engineers, and data scientists to translate complex business problems into scalable AI systems, build data pipelines, and ensure monitoring and ethical alignment. This role offers a competitive base salary and comprehensive benefits as Kharon expands its risk