Staff Software Engineer - LLM Prompt Quality

Sully.ai Inc.; United States; Remote; USD 90,000 - 150,000; Full time

Job summary

Join a forward-thinking company as a Senior Full Stack Engineer, where you will redefine healthcare delivery through innovative AI solutions. This role involves hands-on development, collaborating with co-founders to build essential product features, and leveraging your expertise in prompt engineering to optimize model performance. You'll work in a flexible, remote-first culture, tackling scalability challenges while making a significant impact on healthcare. If you're passionate about technology and eager to contribute to a mission-driven team, this opportunity is perfect for you.

Benefits

Competitive Salary

Equity Options

Flexible Remote Work

Early-Stage Impact Opportunities

Qualifications

• Expertise in prompt engineering and improving LLM output quality.
• Experience in fast-paced startup environments and collaboration.

Responsibilities

• Build core components and enhance product capabilities.
• Evaluate and improve LLMs' output quality and accuracy.

Skills

Prompt Engineering

Software Development

Collaboration

Customer Interaction

Evaluating LLM Output

Tools

ReactJS

Node.js

Express.js

NoSQL

SQL

CI/CD Pipelines

GCP

Azure

AWS

Job description

About Us

At Sully.ai, we're not just building AI – we're redefining the future of how healthcare is delivered. Our end to end solutions empower healthcare providers by automating doctors’ administrative tasks, reducing misdiagnosis, and enhancing efficiency.

What You'll Do

1. We are seeking an exceptional Senior Full Stack Engineer to join our team and play a pivotal hands-on role in shaping the current and future capabilities of our product.

2. Work closely with the co-founders and be responsible for building core components and elevating our product to the next level.

3. Be an expert prompt engineer who deeply studies the latest strategies for prompting new models and getting the best performance out of them.

4. Use your innovative thinking and application of new ideas for prompt iteration and optimization for supporting new models, iterating on user feedback, etc.

5. Full-stack engineering, touching all parts of the stack and building end-to-end features.

What You'll Bring

1. Expertise in evaluating and improving output quality, accuracy and consistency of LLMs, both off-the-shelf and fine-tuned.

2. Experience building and/or using prompting frameworks for prompt hosting, versioning and application.

3. Proven track record in fast-paced, startup environments and collaborating with global teams.

4. Advanced skills in software development methodologies, programming languages, and system architecture.

5. Experience in customer-facing roles for requirements gathering and updates.

6. Knowledge of GenAI, LLMs.

Tech Stack

Frontend: ReactJS, Bootstrap, Tailwind CSS, or similar frameworks.
Backend: Node.js, Express.js.
Databases: NoSQL and SQL.
DevOps: CI/CD pipelines, cloud services (GCP, Azure, AWS).
Bonus: Experience with Applied GenAI, LLMOps, and LLM evaluations.

Why Join Sully.ai?
Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.