Staff Software Engineer - Generative AI / LLMs

Skyrocket Ventures, Inc.; Palo Alto, New York (CA, NY); Hybrid; USD 200,000 - 250,000; Full time

Job summary

Skyrocket Ventures is seeking a Staff Software Engineer specializing in Generative AI and LLMs to join their team. In this role, you will work remotely or in-person, leveraging your expertise in Python and AWS to enhance AI-driven backend services. This is a unique opportunity to help shape the future of AI technology within a rapidly growing company funded by industry veterans.

Qualifications

• Minimum 5 years of backend software development experience.
• Strong expertise in building and operating low-latency, high-scale services.
• Experience deploying AI/ML models in production.

Responsibilities

• Design and implement scalable backend services using Python and LLMs.
• Collaborate with cross-functional teams to integrate AI models.
• Optimize AI models for performance and scalability.

Skills

Python

AWS

AI model optimization

Problem-solving

Distributed systems

Education

Bachelor’s or master’s degree in computer science

Tools

Docker

Kubernetes

Job description

Staff Software Engineer - Generative AI / LLMs

Staff Software Engineer - Generative AI / LLMs

4 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Skyrocket Ventures

Recruiting Director at Skyrocket Ventures

Staff Software Engineer - Generative AI / LLMs

Location: you could either work remotely or in the company's offices in Palo Alto and New York. Some team members come 1x/week, but most people in the company work 100% remotely.

The company has raised $50 million in series B funding and is founded by industry veterans with a track record of tremendous success. The CEO/Cofounder previously cofounded a company that is publicly traded and has reached an over $20 billion market cap. The CTO/Cofounder previously was a long time engineering leader at Facebook.

The company's product involves risk assessment, fraud detection/prevention, and AI. It is already being used by many customers. Revenues are increasing rapidly.

The company has about 80 employees and 40 engineers and is growing rapidly.

The company will pay a salary up to $250k, plus equity which could be very lucrative.

I'm guessing you may not be actively seeking a new job right now, but whatever the case may be, please let me know if you or anyone you know may be open to hearing more and exploring this opportunity.

Job Responsibilities:

- Working with Python and LLMs to design and implement scalable backend services to solve business problems.

- Collaborating with cross-functional teams such as product, front end, and QA to define technical requirements and ensure the seamless integration of AI models with other platform components.

- Optimizing AI models and backend services for maximum performance, scalability, and maintainability in a distributed environment.

- Identifying and resolve bottlenecks related to AI processing and system performance, ensuring efficient resource utilization and system stability.

- Implementing best practices for deploying, monitoring, and maintaining AI models in production, including CI/CD pipelines and model versioning.

- Proactively monitoring the health and performance of AI-driven backend services, applying strategies to mitigate potential issues and ensure high availability.

Qualifications:

- A Bachelor’s or master’s degree in computer science or equivalent experience.

- At least 5 years of backend software development experience.

- Strong expertise in Python and AWS technologies.

- Expertise in building and operating low-latency, high-scale services in distributed environments.

- Experience deploying and optimizing AI/ML models in production environments using containerization (Docker, Kubernetes) and cloud platforms (AWS, GCP).

- Familiarity with microservices architecture, RESTful APIs, and security best practices in AI services.

- Experience with distributed data systems such as Kafka, ClickHouse, or similar technologies to manage large-scale AI workloads.

- Strong understanding of CI/CD tools (such as Jenkins, Git, Maven, Gradle) and agile development methodologies, with a focus on automating model deployment.

- Excellent problem-solving abilities, with a focus on AI model performance optimization, scalability, and system architecture.

About Skyrocket Ventures

Skyrocket Ventures is a recruiting firm for hundreds of high growth technology companies that range from industry leaders to top-tier startups. This opportunity is with one of our client companies for a full-time permanent hire. Please only apply if you are authorized to work in the U.S.

Please note that even if this job is not a perfect match, we encourage you to apply as long as it is in the ballpark. Companies are often flexible in hiring candidates who do not perfectly fit their written job description, as long as the most important qualifications are there and the candidate is good in general.

Most of the jobs we are recruiting for are not posted online, so if you would like to know of all the opportunities we have that match your interests and qualifications, then please get in touch with us.

After you apply to this job posting, we’ll consider you for this job as well as any other potential matches with our client companies. If we have any potential matches, we’ll share your resume with those companies and contact you about any interview opportunities we can get you.

Thank you, and we wish you a great job search!

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Industries

  Software Development, Technology, Information and Media, and Financial Services

Referrals increase your chances of interviewing at Skyrocket Ventures by 2x

Get notified about new Software Engineer jobs in United States.

Software Engineer - Fullstack, Multiple Locations

United States $81,900.00-$174,600.00 1 week ago

Software Engineer, Early Career - Messaging API

Software Engineer (L5) - Open Connect Platform

United States $100,000.00-$720,000.00 1 week ago

Full-Stack Software Engineer (New graduates: United States)

United States $70,000.00-$100,000.00 2 weeks ago

New York, NY $140,000.00-$185,000.00 1 week ago

Software Engineer (L5) - Ads Identity & Privacy

United States $100,000.00-$720,000.00 2 weeks ago

Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

United States $100,000.00-$720,000.00 2 weeks ago

New York, United States $142,600.00-$196,200.00 1 week ago

United States $140,000.00-$170,000.00 1 month ago

Software Engineer Intern/Co-op (Fall 2025)

New York, NY $145,000.00-$260,000.00 7 months ago

United States $100,000.00-$720,000.00 2 weeks ago

Costa Mesa, CA $125,000.00-$155,000.00 1 day ago

Software Engineer - AI/ML, Multiple Locations

United States $81,900.00-$174,600.00 1 week ago

United States $90,000.00-$170,000.00 9 months ago

Software Engineer - AI/ML, Multiple Locations

Redmond, WA $81,900.00-$174,600.00 2 weeks ago

United States $110,000.00-$140,000.00 1 day ago

Software Engineer L4/L5, Training Platform, Machine Learning Platform

United States $100,000.00-$720,000.00 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.