Senior Data Engineer — Build Trustworthy AI Pipelines

Foresight Works; San Francisco (CA); In loco; USD 180.000 - 240.000; Tempo pieno

Vantaggi offerti da questo lavoro

Health

Dental

Vision

401(k)

PTO

Descrizione del lavoro

Foresight is seeking a Senior Data Engineer to build the data foundation behind our platform. You will construct pipelines from customer data sources to clean, trusted, modeled data powering predictions, analytics, and reporting.

This hands-on role treats data engineering as product engineering, ensuring every customer-facing number is accurate, explainable, and available when it matters. You will own core data flows and contribute to data standards.

Competenze

• 5+ years of experience building and running production data pipelines from source to consumer.
• Strong in Python and advanced SQL, including writing and tuning complex queries.
• Deep data modeling experience in Postgres or a similar relational database: schema design, indexing, partitioning and migrations.
• Experience parsing and normalizing messy real-world data: large files, inconsistent formats, missing or contradictory values.
• Hands-on with workflow orchestration for multi-step pipelines with dependencies, retries and backfills.
• Experience with AWS data services such as S3, managed databases, streaming and serverless compute.
• Testing mindset for data: validation, quality checks, and reproducible, idempotent pipelines.
• Clear in communication and comfortable making pragmatic trade-offs on a small team.

Mansioni

• Own pipelines from design through production: define data contracts, set freshness and quality targets, and keep them met.
• Partner with ML engineers on the features and datasets their models need, and with full stack engineers on the data behind each product feature.
• Design for failure: pipelines that retry safely, can be re-run without duplicating data, and recover cleanly from bad inputs.
• Make data observable, so problems are caught by monitors before a customer notices them.
• Keep cost in check as data volumes grow, choosing the simplest tool that does the job well.
• Help set the team's data standards and shape the platform as one of its first data engineers.

Conoscenze

Python

Advanced SQL

Data modeling

Data pipelines

Communication

Strumenti

PostgreSQL

AWS

S3

ETL

Descrizione del lavoro

Foresight is seeking a Senior Data Engineer to build the data foundation behind our platform. You will construct pipelines from customer data sources to clean, trusted, modeled data powering predictions, analytics, and reporting.

This hands-on role treats data engineering as product engineering, ensuring every customer-facing number is accurate, explainable, and available when it matters. You will own core data flows and contribute to data standards.