Senior Data Engineer - Real-Time Data Platform & AI

youcom; San Francisco (CA); Hybrid; USD 180,000 - 220,000; Full time

Benefits offered by this job

In-person gatherings in SF & NYC

Job summary

You.com is seeking a hands-on Data Engineer to build and scale a modern data platform in San Francisco. You’ll partner with Finance, Engineering, Product, and Analytics to create reliable, high-performance pipelines from ingestion to insights.

Work with Databricks, AWS, Kafka, and DBT to design ETL/ELT workflows, implement data quality checks, and enable data activation across enterprise tools like Salesforce and BI dashboards.

Qualifications

• 6+ years of experience in data engineering or a related field.
• Proficiency with Databricks, AWS services and Kafka.
• Proficiency in Python (PySpark) and SQL for large-scale data processing.
• Experience building ETL/ELT pipelines (DBT/Airflow or similar).
• Experience with data ingestion tools such as Fivetran.

Responsibilities

• Build and maintain scalable data pipelines (batch and streaming) using Databricks, Spark, Kafka, and AWS services.
• Build and maintain pipelines from source systems (Salesforce, billing, product events, API logs) into analytics layers.
• Design, develop, and optimize ETL/ELT workflows using DBT, PySpark, SQL.
• Monitor pipeline performance and ensure data quality and reliability.

Skills

Python (PySpark)

SQL

Data modeling

Big data processing

Problem solving

Tools

Databricks

AWS

Kafka

DBT

Fivetran

Job description

You.com is seeking a hands-on Data Engineer to build and scale a modern data platform in San Francisco. You’ll partner with Finance, Engineering, Product, and Analytics to create reliable, high-performance pipelines from ingestion to insights.

Work with Databricks, AWS, Kafka, and DBT to design ETL/ELT workflows, implement data quality checks, and enable data activation across enterprise tools like Salesforce and BI dashboards.