Senior Software Engineer

Cityblock; United States; Remote; USD 110,000 - 145,000; Full time

Benefits offered by this job

Health insurance

Life insurance

Retirement benefits

Equity program

Paid time off

Job summary

Cityblock Health is seeking a full‑stack product engineer to ship AI‑driven features in a regulated healthcare context. You will take an AI-native idea from prototype to production, partnering with product, design, and clinical operations to ensure safety, compliance, and measurable value for members and care teams.

You'll own end‑to‑end features, integrate LLM APIs and SDKs, build evals and observability, design for trust with a human‑in‑the‑loop, and help mature the prototyping loop so product

Qualifications

• 4+ years of engineering experience.
• Strong full-stack product engineering skills and shipping mentality.
• Experience integrating LLM APIs or SDKs into shipped products or related production experience.
• Strong product sense: prioritize measurable value and user adoption.
• Comfort handling ambiguity with scoped, high-value ideas and growing independence.
• Experience building evals or quality measurement for AI features.
• Fluent in daily use of AI assistants for engineering with discernment on trust.

Responsibilities

• Implement full-stack features that integrate LLM APIs/SDKs into member- and care-team-facing surfaces.
• Own features end to end: system design, model/SDK integration, evals, and UX.
• Build observability and evals to measure quality and drive improvement.
• Contribute to prototyping loop, eval discipline, and quality bar by shipping features.
• Deploy prototypes to real users early and iterate toward production-ready solutions.
• Communicate feasibility and tradeoffs back to product/design for roadmap planning.
• Collaborate with product, design, and clinical ops to identify high-value AI opportunities.
• Partner with data org to access grounded, trustworthy context for features.

Skills

Full-stack development

LLM/SDK integration

Product sense

Observability & evals

Regulated healthcare familiarity

Education

CS degree or equivalent

Tools

LangSmith

Braintrust

Job description

Job Description: Cityblock is putting AI directly into the hands of the care teams and members we serve. You are a full-stack product engineer who takes an AI-native idea from a rough prototype to a feature running in production, in front of real clinical users, and you contribute to the prototyping loop that lets product and design move at that speed. Most of the value of AI in our product is still undiscovered. Your job is to shorten the distance between an idea and something people can actually use, and then to productionize effective use of AI into features that hold up in a regulated healthcare product. Reporting into the Product Engineering org, this role covers system design, including the LLM/SDK integration underneath, the evals and golden datasets that tell you whether it's working, and the UX. You embed with product, design, and work with clinical operations. Because these features run in a regulated healthcare product in front of real members and care teams, you help decide where AI acts on its own, where it stays advisory with a human in the loop, and how we prove a feature is safe to trust, designing for compliance from the start.

Responsibilities

• Implement full-stack feature work that integrates LLM APIs and SDKs into member- and care-team-facing product surfaces.
• Own features end to end: system design, model/SDK integration, evals, and the UX that determines whether the feature is actually trusted and used.
• Build observability and evals alongside the feature, so quality can be measured and then improved.
• Apply and help improve the team's prototyping loop, eval discipline, and quality bar through the work you ship.
• Put prototypes in front of real users early, learn from what breaks, and harden the ones worth keeping into production.
• Bring an honest read of what's feasible back to product and design, so the roadmap reflects reality.
• Work with product management, design, and clinical operations to find and understand the high-value AI opportunities behind the features you build.
• Partner with the data organization for the grounded, trustworthy context your features depend on.

Requirements for the Role

• 4+ years of experience as an engineer
• You are a strong full-stack product engineer who ships.
• You solve problems by building working software.
• Experience integrating LLM APIs or SDKs into a shipped product, or closely related production experience you can build on.
• Strong product sense: you care about whether people use your products and whether they provide measurable value.
• Comfort owning ambiguity by taking a well-scoped, high-value idea and turning it into something real, with decreasing guidance over time.
• Experience building evals or quality measurement for AI features, or the clear instinct that you need to.
• Fluent daily use of AI assistants for engineering, with a clear sense of when to trust them and when not to.
• Drawn to mission-oriented work, and comfortable partnering with clinical and design experts whose expertise differs from yours.

Nice to Have

• A CS degree or equivalent.
• Prior work in a regulated or compliance-heavy environment (HIPAA, SOC 2, or similar).
• Experience building AI-native product features from scratch, including the evals around them.
• Design sensibility strong enough to prototype UX yourself.
• Exposure to clinical operations or working alongside clinical staff as end users.
• Hands‑on with retrieval‑augmented generation (RAG): embeddings, vector search, and grounding LLM output in trusted context.
• Familiarity with agentic patterns including tool/function calling, structured outputs, and multi‑step orchestration.
• Experience with LLM eval and observability tooling (e.g., Braintrust, LangSmith) and LLM-as-judge techniques.
• Comfort in a modern TypeScript/Node/React stack, including streaming and latency‑sensitive LLM UX.

We take into account an individual’s qualifications, skillset, and experience in determining final salary. This role is eligible for health insurance, life insurance, retirement benefits, participation in the company’s equity program, paid time off, including vacation and sick leave. The actual offer will be at the company’s sole discretion and determined by relevant business considerations, including the final candidate’s qualifications, years of experience, skillset, and geographic location. The expected salary range for this position is: $110,000.00 - $145,000.00 Annual

Cityblock values diversity as a core tenet of the work we do and the populations we serve. We are an equal opportunity employer, indiscriminate of race, religion, ethnicity, national origin, citizenship, gender, gender identity, sexual orientation, age, veteran status, disability, genetic information, or any other protected characteristic. We do not accept unsolicited resumes from outside recruiters/placement agencies. Cityblock will not pay fees associated with resumes presented through unsolicited means.

Cityblock Health is the first tech‑driven provider for communities with complex needs—bringing better care to where it’s needed most, block by block. Founded in 2017 on the premise that "health is local" and based in Brooklyn, we are backed by Alphabet’s Sidewalk Labs along with some of the top healthcare investors in the country. Our mission is to improve the health of underserved communities. Importantly, our solutions are designed specifically for Medicaid and lower‑income Medicare beneficiaries, and we meet our members where they are, bringing care into the home and neighborhoods through our community‑based care teams and Virtual Care offerings. In close collaboration with community‑based organizations, local providers, and leading health plans, we are reorganizing the health system to focus on what matters to our members. Equipped with world‑class, custom care delivery technology, we deliver personalized primary care, behavioral health, and social services to deliver a radically better experience of care for every member and community we serve. Over the next year, we’ll grow quickly to bring better care to many more members and their communities. To do this, we need people who, like us, believe that everyone should have good care for what matters to them, in their community. Our work is grounded in a belief in the power of a diverse community. To close gaps in care and advance equity in the communities we serve, we have to start with making our own team diverse and inclusive. Our ways of working are characterized by creativity, collaboration, and mutual learning that comes from bringing together a community from diverse backgrounds and perspectives. We strive to ensure that every person on the Cityblock team, and every Cityblock member, feels supported and included as a part of our community.

Our Values:

• Aim for Understanding
• Be All In
• Bring Your Whole Self
• Lean Into Discomfort
• Put Members First

About our Team:

We employ a field‑based, home‑based care model and are committed to meeting members where they are--in their homes, in their community, and in our Hubs. We will go above and beyond to connect with Cityblock members in a non‑judgmental, respectful and empathic manner, to meet their needs, and to provide feedback to the system as a whole as we strive to do better every day.