Senior Data Engineer

Two Dots; San Francisco (CA); On-site; USD 150,000 - 225,000; Full time

Job summary

Join an innovative company that is revolutionizing the data integration landscape. As a Senior Data Engineer, you'll play a pivotal role in enhancing our data infrastructure, transitioning from ad-hoc solutions to robust, scalable pipelines. You'll collaborate closely with a talented engineering team, driving product improvements and enabling machine learning applications. This is an exciting opportunity to make a tangible impact in a dynamic environment that values trust, ownership, and growth. If you're passionate about data and eager to shape the future of our technology, we want to hear from you!

Benefits

Medical insurance

Vision insurance

Paid maternity leave

Paid paternity leave

Equity package

Flexible work culture

Qualifications

• 5+ years of experience in data engineering with strong SQL skills.
• Experience with Google Cloud Platform and serverless DAG runners.

Responsibilities

• Build durable data pipelines and standardize analytics processes.
• Maintain golden datasets for model development and evaluation.

Skills

SQL

Data Engineering

Machine Learning

Google Cloud Platform

Apache Airflow

Apache Beam

Education

Bachelor's degree in STEM

Master's degree in STEM

Tools

BigQuery

Apache Airflow

Apache Beam

Job description

1 week ago Be among the first 25 applicants

This range is provided by Two Dots. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$150,000.00/yr - $225,000.00/yr

Direct message the job poster from Two Dots

Fractional Head of Technical Recruitment | Podcast Host | YouTuber @yournexttechstartup

Two Dots is helping to unlock unstructured information and connect it with software. The computer revolution helped us organize the world’s business data, but data entry and integrations have continued to be huge bottlenecks for most businesses. We’re using AI to solve a boring problem - extracting information from PDFs and integrating it into financial workflows that deliver huge value for our customers. We’re retrofitting the computer revolution onto every document trapped in a bank filing cabinet today.

Role Overview:

We’re looking for our first Senior Data Engineer. You’ll report directly to the CTO and work closely with our ML engineers to level up our data infrastructure. Today, we have the basics: solid logging, a functional data warehouse, and some key dashboards. Your job will be to take us from “it works” to “it accelerates”—building durable pipelines, standardizing analytics, and making it dramatically easier for engineers and founders to drive product improvements, revenue growth, and machine learning applications. You'll be joining a Series A, five person engineering team, where you’ll have real ownership, work across disciplines, and set the foundation for a data platform that can scale with us.

Key Responsibilities:

• Transition from ad-hoc SQL notebooks to source controlled durable pipelines for key performance indicators, in-depth product analytics, experiment analysis, and machine learning training and evaluation
• Enable rigorous evaluation of product proposals for their forecasted impact on KPIs
• Standardize experiment analysis, making it easy to see standard metrics and breakdowns in clear diffs to ensure we’re always stepping in the right direction
• Maintain golden datasets and evaluation pipelines for vision and text model development.
• Very strong understanding of analytics-oriented SQL (such as BigQuery), including advanced aggregation (such as cubes), efficient metric smoothing, arbitrary iteration, performance considerations, and function libraries. Understanding of when to materialize, use views, and factoring into UDFs and TVFs.
• 5+ years of professional experience after earning a Bachelor’s or Master’s degree in a STEM field.
• Experience with serverless DAG runners such as Apache Airflow or equivalent, with mixtures of SQL and C-like stages
• Familiarity with distributed pipeline tools like Apache Beam
• Converting online serving functionality to offline long-running jobs with backpressure sensitivity (for backtesting or simulation)
• Strong understanding of Google Cloud Platform is critical

What you get in return:

• An opportunity to revolutionize the real estate leasing industry and own projects that make a tangible impact
• An environment with a work culture that is based on trust, ownership, flexibility and a growth mindset
• A competitive salary, comprehensive equity package, and substantial benefits

Closing:

Two Dots is an equal opportunity employer. We aim to build a workforce of individuals from different backgrounds, with different abilities, identities, and mindsets. Even if you do not meet all of the qualifications listed above, we encourage you to apply!

Compensation is variable and is subject to a candidate’s personal qualifications and expectations. For this role, we offer the following base salary range, in addition to an equity package and full benefits: $150k - $225k per year.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Software Development

Referrals increase your chances of interviewing at Two Dots by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

Paid maternity leave

Paid paternity leave

Get notified about new Data Engineer jobs in San Francisco, CA.

San Francisco, CA $114,000.00-$171,000.00 1 day ago

San Francisco, CA $170,000.00-$250,000.00 2 weeks ago

Data Engineer, Analytics (Technical Leadership)

San Francisco, CA $206,000.00-$281,000.00 1 day ago

United States $173,000.00-$242,000.00 1 day ago

San Francisco, CA $145,000.00-$204,000.00 1 day ago

San Francisco, CA $173,000.00-$242,000.00 1 day ago

San Francisco, CA $130,000.00-$238,000.00 4 days ago

San Francisco, CA $150,000.00-$200,000.00 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.