Senior ML Platform Engineer — AI Agents (Remote)

Ellkay, Llc; United States; Hybrid; USD 180,000 - 250,000; Full time

Benefits offered by this job

Medical, Dental, and Vision benefits

Remote work options

401k with matching

Gym membership / Exercise stipends

Generous PTO

Employee discounts

On-site HQ lunches

Job summary

ELLKAY is seeking an engineering leader to design and deliver shared AI/ML services across migration, archive, connector, and interoperability products. This hands-on role combines model development, LLM applications, and governance, while mentoring the ML team and partnering with data, product, clinical, and security leaders to scale pilots into production.

You will define architecture, enforce quality and cost targets, and drive adoption of common services across workflows, with a focus on

Qualifications

• 8+ years of relevant software/ML engineering experience with ownership of production ML systems.
• Strong Python and SQL, solid software design, automated testing, API development.
• Hands-on model training, feature engineering, model selection, evaluation, and leakage prevention.
• Production experience with LLMs, retrieval-augmented generation, embeddings, tool calling, and routing.
• Ability to design distributed services, cloud serving, access controls, and lifecycle management.
• Mentoring engineers and translating product needs into designs; degree or equivalent experience accepted.

Responsibilities

• Lead design and delivery of shared AI/ML services for migration, archive, connector, and interoperability products.
• Define architecture, model-routing, retrieval interfaces, tool contracts, and release criteria; mentor team.
• Design governed agent experiences for guidance, migration recommendations, and operational explanations.
• Integrate with shared agent gateway and platform APIs; enforce checks, approvals, and auditable actions.
• Choose among rules, classical ML, retrieval, and LLMs based on quality, latency, and cost; oversee production pilots.

Skills

Leadership

Mentoring engineers

Cross-functional collaboration

Strong communication

Education

Bachelor’s or Master’s in CS/Engineering or equivalent

Tools

Python

SQL

PyTorch

scikit-learn

Job description

ELLKAY is seeking an engineering leader to design and deliver shared AI/ML services across migration, archive, connector, and interoperability products. This hands-on role combines model development, LLM applications, and governance, while mentoring the ML team and partnering with data, product, clinical, and security leaders to scale pilots into production.

You will define architecture, enforce quality and cost targets, and drive adoption of common services across workflows, with a focus on