Senior Data Engineer: GenAI & Data Platform Innovator

Logoslabs; San Francisco (CA); À distance; USD 140 000 - 190 000; Plein temps

Avantages offerts par ce poste

PTO program

Health benefits

Remote work

Résumé du poste

Firstup is hiring a Senior Data Platform Engineer to design and maintain scalable data pipelines and analytics, leveraging GenAI techniques to make data accessible across the business. You will work with multi-tenant SaaS environments, implement SQL standards, and collaborate with teams to ensure robust data solutions.

The role requires 8+ years in distributed systems, experience with AWS/GCP, and proficiency in Python, Kafka, and Spark.

Qualifications

• Bachelor's degree in Computer Science or related field, or equivalent professional experience.
• 8+ years building reliable, high-performance, large-scale distributed systems, with an emphasis on streaming and data pipelines.
• Experience working with and maintaining multi-tenant SaaS experiences.
• Experience building natural language interfaces over data warehouses, including applying GenAI/LLM techniques to data and analytics.
• Enterprise-level experience with at least one large-scale analytical data warehouse or query engine: StarRocks, Amazon Redshift, Snowflake, Databricks, or Trino.
• Expertise writing, optimizing, and analyzing SQL.
• Hands-on experience building and operating distributed data platforms on AWS or GCP.
• Hands-on experience with streaming platforms such as Kafka and Spark.
• Experience scaling data modeling and warehousing.
• Proficiency in python.

Responsabilités

• Design, build, and maintain scalable data pipelines, warehouse models, and analytics solutions, balancing data quality, business value, and speed.
• Build and maintain natural language interfaces to data and analytics, applying GenAI/LLM techniques to make data more accessible across the business.
• Use GenAI coding tools and practices in daily development to improve code quality, testing, and delivery speed.
• Continuously evaluate new technologies that could improve and scale the team's data platform and technology stack.
• Establish and follow standards for SQL development, data modeling, testing, documentation, code reviews, and production support.
• Support production data pipelines through on-call rotation and incident response, partnering with engineering, analytics, and business teams.
• Document and maintain expertise in the technology stack and product domain, translating business needs into technical solutions with product management.

Formation

Bachelor's degree in Computer Science or related field, or equivalent professional experience

8+ years building distributed systems with streaming/data pipelines

GenAI/LLM techniques for data analytics

Python

Outils

StarRocks

Amazon Redshift

Snowflake

Databricks

Trino

AWS

GCP

Kafka

Spark

SQL

Airflow

Metabase

Description du poste

Firstup is hiring a Senior Data Platform Engineer to design and maintain scalable data pipelines and analytics, leveraging GenAI techniques to make data accessible across the business. You will work with multi-tenant SaaS environments, implement SQL standards, and collaborate with teams to ensure robust data solutions.

The role requires 8+ years in distributed systems, experience with AWS/GCP, and proficiency in Python, Kafka, and Spark.