Software Engineer – Data Platform Team

Eightfold AI; Santa Clara (CA); Hybrid; USD 131,000 - 181,000; Full time

Benefits offered by this job

Hybrid work model

Equity awards

Discretionary bonuses

Job summary

Eightfold AI is hiring for a Senior Data Platform Engineer to design, develop, and maintain large-scale data platforms used by millions of users. You will lead architecture decisions for distributed, resilient systems and drive performance improvements across high-volume data pipelines.

You will collaborate with cross-functional teams and work across AWS and Azure, delivering end-to-end product capabilities with ownership and quality code.

Qualifications

• 2-6 years of professional experience in building core features of highly scalable data platform.
• Proven experience in building highly available distributed systems.
• Working experience in high-volume data pipelines, data ingestion and data integration.

Responsibilities

• Lead the design and evolution of the core data platform architecture with auto-scaling and fault tolerance.
• Drive scaling, optimization, and innovation of the Data Platform.
• Extend platform capabilities with new data processing techniques and collaborate with stakeholders.
• Diagnose and resolve complex problems in distributed systems and support deployment across environments.
• Partner with Engineering, Operations, Analytics, Marketing, and Business teams for end-to-end delivery.
• Work across AWS and Azure cloud platforms.

Skills

Distributed systems

Python

Flask

Performance optimization

Cloud platforms

Education

Bachelor's degree in Computer Science or related field

Tools

Flask Framework

AWS

Azure

GCP

Job description

About The Role/Team Join Eightfolds core Data Platform team to design, develop, and maintain the large-scale software platforms that serve millions of users globally. In this critical role, you will leverage cutting-edge technologies to work on complex, high-performance distributed systems, ensuring our platform is resilient, scalable, and the foundational power for our entire product suite.

What You will Own and Deliver

• Platform Architecture & Design: Lead the design and evolution of our core data platform architecture, focusing on building distributed and resilient systems with built-in features for auto-scaling, fault tolerance, horizontal scalability, and load balancing.
• Performance Engineering: Drive the scaling, optimization, and innovation of the Data Platform. This includes analyzing data processing workflows, implementing caching mechanisms, fine-tuning database queries, and proactively addressing performance bottlenecks for maximum efficiency and responsiveness.
• Feature Expansion & Innovation: Continuously extend the platform’s capabilities by staying current with industry trends and emerging technologies. Conduct research and development for new data processing techniques and collaborate closely with stakeholders to implement features that meet evolving business and user needs.
• System Operations: Diagnose and resolve complex problems within our distributed systems environment and support the seamless deployment and operation of our products across various environments.
• Cross-Functional Collaboration: Partner with Engineering, Operations, Analytics, Marketing, and Business teams to ensure successful, end-to-end product development and delivery.
• Cloud Stack Management: Work across major cloud platforms, specifically AWS and Azure.

What You Bring

Experience

• 2-6 years of professional experience in building core features of highly scalable data platform.
• Proven experience in building highly available distributed systems.
• Working experience in high-volume data pipelines, data ingestion and data integration.

Technical Expertise

• Expertise in building and optimizing high-performance, high-throughput systems.
• Proficiency with core backend technologies including AWS, Python, and the Flask Framework.
• Strong foundational understanding of distributed system design principles.
• Proven experience with cloud platforms (AWS, Azure, GCP).

Mindset & Skills

• Excellent analytical and complex problem-solving skills, particularly with data analysis.
• A proactive attitude with a strong sense of ownership to rigorously chase down complex problems to the root and deliver permanent fixes.
• Ability to thrive in a fast-paced environment, handling context-switching effectively, and a genuine desire to solve real Customer problems.
• Commitment to high-quality code and a drive to ship features quickly and reliably.

Pay Transparency. Please note this role is categorized as hybrid in Santa Clara, CA The base salary ranges below are provided for pay transparency. Base pay is only one piece of our total compensation package as this role is eligible for bonus and equity awards. Compensation varies depending on a number of factors including qualifications, skills, competencies, experience and zones determined by location. SF Bay Area, CA is in Zone A.

Base annual salary range in Zone A: $130,750 to $181,000 USD + discretionary bonus up to 10% + preIPO equity (stock options).

Hybrid Work. At Eightfold, we believe our best work happens when we collaborate closely, learn from one another, and build together. We follow a hybrid work model that combines flexibility with a strong emphasis on in-person collaboration to foster innovation, culture, and rapid execution.

Employees based near our Santa Clara office are expected to work from the office 3 days per week, as we believe regular in-person engagement is essential to how we build high-impact products and strong teams.

Eightfold.ai provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, veteran or disability status.

Experience our comprehensive benefits with family medical, vision and dental coverage, a competitive base salary, and eligibility for equity awards and discretionary bonuses or commissions.