Forward Deployed Engineer (OpenAI Platform)

Carbon60; Toronto; Hybrid; CAD 180,000 - 200,000; Full time

Benefits offered by this job

RRSP retirement matching

Health & dental premiums

Health Care Spending Account

Remote first

Flexible work hours

Parental leave options

Job summary

OpsGuru, a Carbon60 Company, is seeking a Forward Deployed Engineer to embed within customer environments, delivering OpenAI-powered data platforms and agentic workflows. You will drive end-to-end delivery from data discovery to API integration, with a focus on building modern lakehouses and enterprise AI architectures.

The role emphasizes direct client engagement, Spec-Driven Development, and robust governance, security, and MLOps practices.

Qualifications

• 10+ years of senior hands-on experience in data, ML/AI architectures and enterprise data platforms.
• Strong expertise with OpenAI ecosystem components and Azure OpenAI Service.
• Proven ability to interact with C-suite and client engineering teams.
• Experience with Spec-Driven Development (SDD) and AI-assisted tooling.

Responsibilities

• Embed within customer environments to audit data pipelines and deliver OpenAI API integration end-to-end.
• Refactor legacy data estates into modern lakehouses optimized for OpenAI embeddings.
• Architect production-grade pipelines using OpenAI APIs, embeddings, and multi-agent orchestration.
• Establish LLM cost controls, evaluation frameworks, and token-budget strategies.
• Train customer teams on best practices, security standards, and maintainable MLOps patterns.

Skills

Data engineering

ML/AI architecture

Customer-facing

SDD experience

OpenAI platform

Tools

OpenAI Platform APIs

Azure OpenAI Service

Fine-Tuning

Structured Outputs

Function Calling

OpenAI Vector Stores

Job description

Forward Deployed Engineer (OpenAI Platform)

Location: Remote Time zone: NA/Eastern Type: Full-time Experience: 10+ Years

Role Overview

This position requires a Forward Deployed Engineer (FDE) specializing in Data, Machine Learning, and OpenAI technologies to embed directly within customer environments. You will serve as the primary technical authority transforming legacy data estates and operational bottlenecks into production-grade data pipelines, OpenAI-powered agentic workflows, and enterprise AI solutions.

The role is heavily customer-facing: you will work alongside client business units and engineering teams to rapidly build modern data platforms and deploy custom OpenAI architectures (leveraging o-series reasoning models, Assistants API, and Azure OpenAI Service). This is a high-ownership, hands-on role where you will leverage Spec-Driven Development (SDD) and AI-assisted workflows to drive immediate enterprise value directly where the customer operates.

Key Responsibilities

• Customer Embedding & OpenAI Delivery: Deploy directly into customer environments to audit domain logic and data pipelines. Own end-to-end delivery—from data discovery to OpenAI API integration and model fine-tuning—building trust as the customer's lead technical partner.
• Data Platform Modernization: Partner with client leadership to refactor legacy SQL databases, monolithic ETL jobs, or unmaintained data warehouses into modern lakehouses optimized for low-latency retrieval and OpenAI embeddings.
• Spec-Driven Development (SDD): Apply a "spec-first" engineering workflow using OpenAI-powered tools (Cursor, Copilot). Write structured specifications (schemas, function definitions, transformations) to auto-generate production PySpark jobs, data models, and API wrappers.
• OpenAI & Agentic AI Implementation: Architect production-grade solution pipelines utilizing OpenAI Assistants API, Structured Outputs, Function Calling/Tool Use, and multi-agent orchestration SDKs. Build advanced RAG architectures using OpenAI Embeddings and specialized vector engines.
• LLMOps, Evals & Cost Optimization: Establish robust evaluation frameworks (OpenAI Evals) to measure accuracy, latency, and hallucination control. Implement aggressive token budget management, prompt caching, batch processing via OpenAI Batch API, and circuit breakers.
• Client Enablement & Enterprise Governance: Train customer engineering teams on OpenAI best practices, Azure OpenAI security standards (VNet, RBAC, Data Privacy), SDD methodologies, and maintainable MLOps patterns.
  

Requirements

• 10+ Years of Experience: Proven track record as a Principal Data Engineer, Lead ML/AI Architect, or Enterprise Solutions Architect scaling distributed data systems.
• OpenAI Ecosystem Depth: Mastery of OpenAI Platform APIs, Azure OpenAI Service, Fine-Tuning, Structured Outputs, Function Calling, Realtime API, and OpenAI Vector Stores/Embeddings.
• Customer-Facing Aptitude: Strong executive presence to interface directly with client C-suite stakeholders and technical engineering leads.
• Generative AI & SDD Experience: Demonstrated proficiency using structured natural language specs to guide AI tools in auto-generating ETL jobs, test suites, and schema contracts.
• Willingness to Travel: Comfort with occasional travel (once/quarter to customer sites.
  

Preferred Qualifications

• Prior experience in a Software/Data Engineer or technical consulting role within enterprise AI.
• Direct experience migrating on-premises legacy data systems to Azure OpenAI cloud architectures.
• Deep understanding of AI governance, content safety filtering, and private endpoint deployments for OpenAI workloads.

Compensation & Perks

• Competitive compensation package (180K - 200K CAD / year)
• Retirement Savings Matching Program (RRSP)
• Access to the latest tech
• Partnership with Perkopolis Discounts

Flexibility & Time Off

• Remote first work environment
• Flexible work hours & location
• Paid parental leave options

Health & Wellness

• Employer paid health & dental premiums
• GreenShield+ Counselling Mental Health
• $500 in Health Care Spending Account annually

Growth & Development

• Peer recognition rewards

As an employer, OpsGuru, a Carbon60 Company, recognizes the importance of balancing our careers with other aspects of our lives, and our culture reflects this ethos - from flexible work hours to health and wellness incentives and having fun along the way. We look for people who thrive in an environment of accountability and at times ambiguity as we adapt and grow our business.

OpsGuru is an equal-opportunity employer. We welcome and encourage applications from people with all levels of ability. Accommodations are available on request for candidates taking part in all aspects of the selection process. We thank all applicants for their interest in this exciting opportunity.

Only candidates that meet the qualifications will be contacted for an interview.