Generative AI Solutions Developer

Kx Systems, Inc.; New York (NY); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Individually tailored training and skills development

Private healthcare package

Enhanced maternity and paternity package

Wellness Days and Volunteer Days

Job summary

A data-driven technology firm is seeking a skilled professional who will lead the technical design for large-language-model solutions across various cloud platforms. The candidate will shape multi-cloud architectures, define MLOps patterns, and establish security and compliance controls. A strong background in Python and over 10 years of experience building ML platforms is essential. This role offers a hybrid working model and emphasizes continuous learning and ownership of tasks.

Qualifications

• 10-15 years building cloud-native data or ML platforms on AWS, Azure, and/or GCP.
• Hands-on with embedding models, tokenizer optimisation, prompt orchestration, and OpenAI/Anthropic APIs.

Responsibilities

• Own the end-to-end technical design for LLM and generative-AI solutions.
• Shape multi-cloud architectures for training, fine-tuning and serving LLMs.
• Define MLOps/GitOps patterns for model lifecycle and cost-optimize GPU clusters.

Skills

Python

Probability & statistics

Data cleaning & preprocessing

Go

Java

C++

Job description

KX software powers the time-aware data-driven decisions that enable fast-moving companies to outpace competitors, realizing the full potential of their AI investments. The KX platform delivers transformational value by addressing data challenges related to completeness, timeliness and efficiency, ensuring companies understand change over time and can achieve faster, more accurate insights at any scale, cost-effectively.

KX is essential to the operations of the world's top investment banks, aerospace and defence, high-tech manufacturing, healthcare and life sciences, automotive and fleet telematics organizations. The company has established offices and a robust customer base across North America, Europe, and Asia Pacific.

Overview Of The Role

Own the end-to-end technical design for large-language-model (LLM) and generative-AI solutions across NVIDIA, AWS, Azure and GCP stacks. You will translate business use-cases into secure, scalable architectures, lead reference implementations, and mentor delivery teams for enterprise deployments—especially in financial-services environments.

Key Responsibilities

• Shape multi-cloud architectures for training, fine-tuning and serving LLMs (e.g., NeMo, Bedrock, Azure OpenAI, Vertex AI).
• Define MLOps/GitOps patterns for model lifecycle, vector–DB indexing, retrieval-augmented generation (RAG) and guard-railing. Benchmark and cost-optimize GPU, Grace Hopper and CPU clusters (TCO & carbon impact).Build production pipelines in Python (FastAPI, LangChain, Ray, Triton, Airflow).
• Establish security and compliance controls (encryption, IAM, SOC 2, FINRA,GDPR).
• Support pre-sales and proofs-of-concept with capital-markets clients.

Skills

Programming

• Python (must-have)
• li>

Math & ML Basics

• Probability & statistics
• ML concepts: overfitting, loss functions, training vs inference

Data Skills

• Data cleaning & preprocessing
• 10-15 yrs building cloud-native data or ML platforms on AWS, Azure and/or GCP. Deep expertise in Python plus one of Go, Java
• or C++.Hands-on with embedding models, tokenizer optimisation, prompt orchestration and OpenAI/Anthropic APIs. Prior delivery of enterprise Gen-AI systems (risk analytics, chatbots, document generation etc.).Solid grounding in distributed systems (K8s, service mesh, Kafka, Redis, GPU scheduling).

Preferred Qualifications

• Experience with kdb+/q, ClickHouse or similar time-series stores. Contributions to open-source AI frameworks or NVIDIA NGC containers. Working knowledge of SRE/FinOps best practice.

Location & Workplace Type

This position takes on a Hybrid working model based in Ontario, Canada.

Why Choose KX

Data Driven: We lead with instinct and follow fact.

Naturally Curious: We lean in, listen and learn fast.

All In: We take ownership, take on challenges and give it our all.

• Individually tailored training and skills development
• Private healthcare package and Employee Assistance Programme
• Enhanced maternity and paternity package
• Wellness Days and Volunteer Days

Job Info

• Job Identification 11353
• Job Category KX
• Posting Date 02/03/2026, 09:25 AM