Senior Data Engineer - Remote, Unlimited PTO

People Data Labs

United States

Remote

USD 200,000 - 220,000

Full time

3 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Stock

Unlimited PTO

Medical insurance

Dental insurance

Vision insurance

Wellness stipend

Remote-friendly

Job summary

People Data Labs is seeking a senior Data Engineer to build scalable data pipelines and an entity resolution framework. You will work with Spark, SQL, AWS and Databricks, contributing to data quality and scalable ingestion at scale.

You will tackle undefined data problems, push data quality, and collaborate with a high-autonomy team in a remote-friendly environment. A quantitative degree is preferred and strong Python/SQL skills are required.

Qualifications

5-7+ years of industry experience with strategic technical problem solving.
Strong software development fundamentals.
Experience with Python.
Expertise with Apache Spark (Java/Scala/Python).
Experience with SQL.
Experience building scalable data processing systems.
Experience using Airflow, dbt, or Dagster.
Knowledge of modern data design, storage patterns and partitioning.
Experience with Databricks and cloud services (AWS preferred).
Experience with data warehousing and data lakehouse patterns.

Responsibilities

Build infrastructure for ingestion, transformation, and loading large data volumes using Spark, SQL, AWS, and Databricks.
Develop an organic entity resolution framework merging billions of entities into clean datasets.
Develop CI/CD pipelines and anomaly detection to improve data quality in production.
Tackle largely undefined data engineering and data science problems.