Staff Software Engineer (Data Platform)

Scale AI; New York (NY); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Health & wellbeing

Career growth stipend

Community events

Parental leave

Job summary

Scale AI in New York is seeking a Platform Engineer to lead the design and development of core data storage, streaming, caching, and indexing platforms and underlying systems. You’ll drive architecture, design, implementation, and reliability of foundational data platforms, working closely with stakeholders to understand and refine requirements.

You’ll collaborate with cross-functional teams to deliver new features, mentor junior engineers, and uplift engineering standards while engaging with

Qualifications

• 8+ years of full-time engineering experience across backend and data systems.
• Extensive experience with data storage, streaming, and warehousing technologies.
• Proven ability to architect scalable platforms and lead engineering teams.

Responsibilities

• Lead design and development of core data storage, streaming, caching, and indexing platforms.
• Drive architecture and reliability of foundational data platforms across projects.
• Collaborate with cross-functional teams and stakeholders to refine requirements.
• Mentor juniors and uplift engineering standards across the organization.

Skills

Distributed systems

Cloud platforms

Backend systems

CI/CD tooling

Data storage

Data streaming

Team leadership

Cross-functional collaboration

Tools

Kubernetes

CircleCI

ElasticSearch

Redis

Kinesis

Snowflake

Job description

• As the world adjusts to this new reality, leading platform companies are scrambling to build LLMs at billion scale, while large enterprises figure out how to add it to their products
• To make them safe, aligned and actually useful, these models need human evaluation and reinforcement learning through human feedback (RLHF) during pre‑training, fine‑tuning, and production evaluations
• At Scale, our products include the Generative AI Data Engine, SGP, Donovan, and others that power the most advanced LLMs and generative models in the world through world‑class RLHF, human data generation, model evaluation, safety, and alignment
• The data we are producing is some of the most important work for how humanity will interact with AI
• At the foundation of these products is the Platform Engineering team
• In this role, you will lead the design and development of core data storage, streaming, caching, and indexing platforms and underlying systems
• You’ll also get widespread exposure to the forefront of the AI race as Scale sees it in enterprises, startups, governments, and large tech companies
• You’ll drive the architecture, design, implementation, and reliability of our foundational data platforms and systems, working closely with stakeholders and internal customers to understand and refine requirements
• Collaborate with cross‑functional teams to define, design, and deliver new features
• Proactively identify opportunities for, and driving improvements to, current programming practices, including process enhancements and tool upgrades
• Present technical information to teams and stakeholders, providing guidance and insight on development processes and technologies
• Provide technical leadership, including: upholding and upleveling engineering standards across the organization, mentoring junior engineers

Benefits

• Health & Wellbeing: Our holistic approach to supporting Scaliens includes comprehensive health coverage, dental and vision insurance, mental healthcare services, and more. PTO policies and accommodating schedules ensure you’ll get time off when you need it to relax and recharge. Note that our offerings may vary by region as we strive to respond to the unique needs of Scaliens around the globe.
• Personal & Career Growth: Continuously learn and grow through annual learning & development stipend, attending leadership breakfasts, manager training, speaker series, and joining an ERG.
• Building Scale Community: We welcome guests to our offices, and you can expect to see Scalien families and friends around. Join local happy hours, and accept invites to game nights, book clubs, and many other employee‑led community events.
• Parental Support: Balancing work and family is essential, and Scale understands the importance of having adequate leave policies in place to promote a healthy home and work life.

Extensive experience in various database technologies (MongoDB, Postgres), streaming/processing solutions (Kinesis, Flink, Spark), indexing/caching (ElasticSearch, Redis), and various data query engines (Trino, Presto, Snowflake, etc.)Experience working fluently with standard containerization & deployment technologies like Kubernetes and various public cloud offeringsShow a track record of mentoring and leading teams in successful projectsExperience driving cross functional collaboration and communication at an organizational or broader levelExtensive experience in software development and a deep understanding of distributed systems, cloud platforms and data systems8+ years of full‑time engineering experience, post‑graduation with specialties in back‑end systems, specifically related to building large‑scale data storage, streaming, and warehousing systemsPossess excellent communication and collaboration skills, and the ability to translate complex technical concepts to non‑technical stakeholdersStrong knowledge of software engineering best practices and CI/CD tooling (CircleCI)Experience with performance tuning and cost optimizations of cloud based data platformsExperience defining a data lifecycle strategy and designing/implementing tooling for data privacy (i.e. GDPR) needsExperience scaling products at hyper‑growth startupsExcitement to work with AI technologies