Senior Data Platform Engineer – Insights & Pipelines

Remote; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Backstory.ai is hiring a Senior Software Engineer for the Data Modeling team in San Francisco. You will build and maintain backend services, REST APIs, databases, and big data jobs that power unified insights across our platform.

You will work with engineering and product to enable Account 360, Opportunity 360, and AI-powered features, while optimizing for data freshness, reliability, and cost. Join a highly autonomous team pushing frontier analytics.

Qualifications

• 5+ years of professional backend experience in an enterprise environment.
• 2+ years of experience programming in Python or Scala.
• Experience with distributed systems and SOA.
• Experience with large-scale data processing frameworks (Spark, Hive, Hadoop, MapReduce, or similar).
• Experience with stream processing technologies such as Kafka, Apache Samza, or Apache Storm.
• Elasticsearch experience is a plus.
• LLMs or NLP familiarity is a plus.
• Familiarity with analytical databases and ETL pipeline design.
• Strong analytical and problem-solving skills with a track record of delivering elegant, practical solutions.
• Ability to take ownership in an unfamiliar or legacy codebase and incrementally improve it.
• Strong inclination toward automation and reducing manual operational toil.

Responsibilities

• Design, build, and maintain backend services, REST APIs, databases, and big data pipelines that power customer-facing insights and analytics.
• Implement and maintain near-real-time stream-based data processing pipelines in collaboration with batch-oriented data refresh workflows.
• Develop and evolve a query engine capable of answering complex, cross-deal/account questions and delivering actionable insights for sales managers and executives.
• Scale data processing and insights generation pipelines to handle growing volumes of activity data while managing infrastructure costs.
• Collaborate with Engineering and Product teams to translate business and customer needs into robust, well-documented technical solutions.
• Follow and promote software development best practices, delivering clean, maintainable, and well-monitored code.
• Build internal tooling to enable customer support teams to investigate and resolve support requests in a self-service manner.
• Ensure high-quality alerting, dashboards, tracing, and runbooks are in place for all production services.

Skills

Backend engineering

Python/Scala

Distributed systems

Big data

Kafka/Samza/Storm

Elasticsearch

LLMs/NLP

ETL pipelines

Automation

Ownership

Job description

Backstory.ai is hiring a Senior Software Engineer for the Data Modeling team in San Francisco. You will build and maintain backend services, REST APIs, databases, and big data jobs that power unified insights across our platform.

You will work with engineering and product to enable Account 360, Opportunity 360, and AI-powered features, while optimizing for data freshness, reliability, and cost. Join a highly autonomous team pushing frontier analytics.