Senior Machine Learning Engineer - AWS, Real-Time Inference, Pipelines

TWG AI; New York (NY); On-site; USD 190,000 - 290,000; Full time

Benefits offered by this job

Bonus

Medical benefits

Job summary

TWG AI is seeking a Senior ML Engineer for AWS and Real-Time Inference to own the fast path: ingesting live trading data and scoring it in near real time. It's a systems-heavy role focused on streaming, low-latency inference, and the retraining cadence that keeps models current and most directly determines whether the systems keep up with live markets.

You will build streaming pipelines, low-latency inference services, and manage model retraining cadence, collaborating with data science and

Qualifications

• Experience with streaming systems (Kafka/Kinesis/MSK) and modern data storage formats.
• Proficiency in low-latency, high-throughput inference services.
• Go and Python programming; production AWS experience.
• Familiarity with financial market data a plus.
• Familiarity with chain-data infrastructure a plus.

Responsibilities

• Streaming and storage pipelines that feed both model training and low-latency inference.
• The online inference path and its latency; connect real-time detector to runtime model while keeping latency under live load.
• The model retraining cadence as data and labels accumulate, including drift-triggered retraining.
• Productionizing new features and detectors on the fast path, in partnership with data science.

Skills

Streaming systems

Low-latency inference

Go

Python

AWS

Financial data

Chain-data infra

Tools

Kafka

Kinesis

MSK

Job description

The Organization

At TWG AI, we drive innovation and business transformation across a range of industries—including financial services, insurance, technology, media, and sports—by leveraging data and AI as core assets. Our AI-first, cloud-native approach delivers real-time intelligence and interactive business applications, empowering informed decision-making for both customers and employees.

The Organization

At TWG AI, we drive innovation and business transformation across a range of industries—including financial services, insurance, technology, media, and sports—by leveraging data and AI as core assets. Our AI-first, cloud-native approach delivers real-time intelligence and interactive business applications, empowering informed decision-making for both customers and employees.

We prioritize responsible data and AI practices, ensuring ethical standards and regulatory compliance.

Our decentralized structure enables each business unit to operate autonomously, supported by a central AI Solutions Group, while strategic partnerships with leading data and AI vendors fuel game-changing efforts in marketing, operations, and product development.

You will collaborate with management to advance our data and analytics transformation, enhance productivity, and enable agile, data-driven decisions. By leveraging relationships with top tech startups and universities, you will help create competitive advantages and drive enterprise innovation.

At TWG, your contributions will support our goal of sustained growth and superior returns, as we deliver rare value and impact across our businesses.

The Role

As a Senior ML Engineer for AWS and Real-Time Inference, you'll own the fast path: ingesting live trading data and scoring it in near real time. It's a systems-heavy role focused on streaming, low-latency inference, and the retraining cadence that keeps models current and most directly determines whether the systems keep up with live markets.

Key Responsibilities

• Streaming and storage pipelines that feed both model training and low-latency inference
• The online inference path and its latency. A real-time detector microservice is built and unit-tested but not yet deployed — it needs to be connected to a run-time model and hold latency under live load. One known, non-trivial problem lives here: batch scoring ranks across a whole population, but single-account (or single-wallet) real-time scoring has no population to rank against, so it must threshold on calibrated raw scores.
• The model retraining cadence as data and labels accumulate, including drift-triggered retraining
• Productionizing new features and detectors on the fast path, in partnership with data science

Requirements

Qualifications

• Strong data / ML engineering experience with streaming systems (e.g., Kafka / Kinesis / MSK) and modern data storage formats
• Experience building low-latency, high-throughput inference services
• Proficiency in a systems language (e.g., Go) alongside Python
• Production AWS experience
• Familiarity with financial market data or trading protocols a plus — the US feed is a FIX 5.0 SP2 drop-copy session with real-world quirks (nanosecond timestamps, repeating groups, dedup semantics)
• Familiarity with chain-data infrastructure (node providers, subgraphs, event indexing) is a plus

Benefits

Position Location

This is an onsite position based out of our Santa Monica, CA or New York, NY offices.

Compensation

The base pay for this position is $190,000-290,000. A bonus will be provided as part of the compensation package, in addition to a full range of medical, financial, and/or other benefits.

TWG is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.