Principal Backend Engineer (Forward Deployed)

FDE Times; San Francisco (CA); Hybrid; USD 250,000 - 300,000; Full time

Benefits offered by this job

Bonuses and equity included in offers

Job summary

Invisible Technologies in the United States is seeking a Principal Forward Deployed Engineer to lead AI-powered solutions, shaping architecture and strategy for clients' most critical workflows. You’ll work hands-on on models and deployments while driving end-to-end strategy and client success.

This hybrid role blends AI engineering with technical consulting, focusing on production-grade LLM and agentic systems, with opportunities to mentor engineers and influence team culture.

Qualifications

• 10+ years of software engineering experience in data, ML, or backend systems.
• Deep proficiency in Python with hands-on ML/LLM toolchains (Hugging Face, LangChain, OpenAI, Pinecone).
• Experience with Docker, FastAPI, Kubernetes and cloud environments (GCP/AWS/Azure).
• Strong in ML Ops, model versioning, monitoring, and lifecycle management.
• Excellent communication and client-facing skills; able to lead conversations with diverse stakeholders.

Responsibilities

• Partner with delivery and exec stakeholders to scope and lead AI-driven solutions, including LLM and agentic systems.
• Identify opportunities in messy workflows and convert them into repeatable systems.
• Lead architecture design and trade-offs for performance, scalability, cost, and reliability.
• Own projects from discovery through deployment, including client delivery and post-launch iteration.
• Build reusable infrastructure and playbooks; advance MLOps practices for model versioning and monitoring.
• Coach mid-level engineers and shape the forward-deployed AI engineering culture.

Skills

Python

ML/LLM Frameworks

Deployment & Infrastructure

Platform Orchestration

Data Management

MLOps

System Design

Communication & Client-facing

Education

Bachelor's degree in Data Science or Computer Science or equivalent

Tools

Hugging Face

LangChain

OpenAI

Pinecone

Docker

FastAPI

Kubernetes

Cloud Platforms (GCP/AWS/Azure)

Kafka

Job description

Job Description

About Invisible

Invisible Technologies makes AI work. Our end-to-end AI platform structures messy data, automates digital workflows, deploys agentic solutions, measures outcomes, and integrates human expertise where it matters most.

Our platform cleans, labels, and structures company data so it is ready for AI. It adapts models to each business and adds human expertise when needed, the same approach we have used to improve models for more than 80% of the world’s top AI companies, including Microsoft, AWS, and Cohere.

Our successes span industries, from supply chain automation for Swiss Gear to AI-enabled naval simulations with SAIC, and validating NBA draft picks for the Charlotte Hornets.

Profitable for more than half a decade, Invisible reached $134M in revenue and ranked as the number two fastest growing AI company on the 2024 Inc. 5000. In September 2025, we raised $100M in growth capital to accelerate our mission of making AI actually work in the enterprise and to advance our platform technology.

About The Role

As a Principal Forward Deployed Engineer (FDE) at Invisible, you'll lead high-impact, AI-powered solutions that reshape how our clients operate their most critical workflows. You won't just build and deploy — you'll drive the strategy, architecture, and execution of end-to-end systems, working directly with clients.

This is a hybrid role: equal parts AI engineer, software builder, and technical consultant. It's perfect for someone who wants to be hands-on with models and close to the impact they generate. The team is increasingly focused on applied AI work — building and deploying LLM-powered and agentic systems in production — so strong ML engineering instincts can be a valuable addition alongside your architecture and leadership experience.

What You’ll Do

• Partner with delivery and executive stakeholders to scope, design, and lead implementation of AI-driven solutions, including LLM and agentic systems
• Identify transformational opportunities in messy, ambiguous workflows and turn them into repeatable systems
• Lead architecture design and trade-off discussions across performance, scalability, cost, and reliability — including for ML/AI-specific systems like RAG pipelines and production-grade AI applications
• Own projects from first discovery call through full deployment — including client-facing delivery, internal coordination, and post-launch iteration
• Build shared infrastructure, reusable components, and internal playbooks to level-up the team, including MLOps practices for model versioning, monitoring, and lifecycle management
• Coach and mentor mid-level engineers and help shape the culture of forward-deployed AI engineering at Invisible

What We Need

• 10+ years of software engineering experience, including significant time spent building data, ML, or backend systems
• Python & ML/LLM Frameworks: Deep proficiency in Python with hands-on experience using Hugging Face, LangChain, OpenAI, Pinecone, and related ecosystems, including LLMs and AI Agents
• Deployment & Infrastructure: Skilled in full-stack and API-based deployment patterns, including Docker, FastAPI, Kubernetes, and cloud environments (GCP, AWS, Azure)
• Platform Orchestration: Experienced with workflow orchestration libraries, pub/sub systems (Kafka), and schema governance
• Data Management: Expertise in data governance and operations, including Unity Catalog and policy management, cluster/job orchestration, data contracts and quality enforcement, Delta/ETL pipelines, and replay processes
• ML Operations (for teams with an applied AI/ML focus): Experience with MLOps frameworks and best practices — model versioning, monitoring, and lifecycle management — and designing scalable ML systems such as RAG pipelines
• Strong product and system design instincts — you understand business needs and how to translate them into technical architecture
• Experience building usable systems from messy data and ambiguous requirements
• Excellent communication and client-facing skills; you've led conversations with technical and non-technical stakeholders alike
• Proven experience owning projects from scoping through deployment in ambiguous, high-stakes environments
• Strong engineering background demonstrated by a Bachelor's degree in Data Science, Computer Science and related fields OR equivalent professional experience
• Be willing to be on-call for our customers when situations arise
• Travel: Willingness to travel for on-site client engagements as needed
• Onsite: Available to work from the office a few days per week, depending on team needs — some NYC-based teams require 3 days per week onsite; your specific requirement will depend on the team you're placed with

What’s In It For You

Invisible is committed to fair and competitive pay, ensuring that compensation reflects both market conditions and the value each team member brings. Our salary structure accounts for regional differences in cost of living while maintaining internal equity.

The annual salary range for this position, depending on level, is: $250,000 - $300,000 USD

You can find more information about our geographic pay tiers here. During the interview process, your Invisible Talent Acquisition Partner will confirm which tier applies to your location. For candidates outside the U.S., compensation is adjusted to reflect local market conditions and cost of living.

• Bonuses and equity are included in all full-time offers. Final compensation is determined by a combination of factors, including location, job-related experience, skills, knowledge, internal pay equity, and overall market conditions. Because of this, every offer is unique. Additional details on total compensation and benefits will be discussed during the hiring process.

What It's Like to Work at Invisible

At Invisible, we’re not just redefining work—we’re reinventing it. We operate at the intersection of advanced AI and human ingenuity, pushing the boundaries of what’s possible to unlock productivity and scale. Ownership is at the core of everything we do. Here, you won’t just execute tasks—you’ll build, innovate, and shape the future alongside world-class clients pushing the boundaries of AI.

We expect bold ideas, relentless drive, and the ability to turn ambiguity into opportunity. The pace is fast, the challenges are big, and the growth is unmatched. We’re not for everyone, and we’re okay with that. If you’re looking for predictable routines, this isn’t the place for you. But if you’re driven to create, thrive in dynamic environments, and want a front-row seat to the AI revolution, you’ll fit right in.

Country Hiring Guidelines

Invisible is a hybrid organization with offices and team members located around the world. While some roles may offer remote flexibility, most positions involve in-office collaboration and are tied to specific locations. Any location-based requirements or hybrid expectations will be communicated by our Talent Acquisition team during the recruiting process.

AI Interviewing Guidelines

Our hiring team thoughtfully uses AI to support an efficient, engaging, and inclusive interview process. Since AI can also be a helpful tool for candidates, we've outlined expectations for using it ethically throughout your interview journey. Click here to learn more about how we use AI and our guidelines for candidates.

Accessibility Statement

We are committed to providing reasonable accommodations for individuals with disabilities. If you require an accommodation to participate in the application or interview process, please submit your request using our accommodation request form. Here is the link the google form: https://docs.google.com/forms/d/e/1FAIpQLScqsu0PCQ0m0lwt-VFeXovNbZxWk0jogv8QI_ciGqZsIbSBjQ/viewform?usp=sharing&ouid=102356854798492362557

Equal Opportunity Statement

We’re an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, or veteran status, or any other basis protected by law.

Due to a high volume of candidates, Invisible may use automated decision-maker technologies to filter candidates based on response to our application questions and other provided information. Our use of automated decision-making enables us to be efficient by providing a manageable list of possible candidates that meet our mandatory hiring criteria. If you object to our use of automated decision-making please contact us.