Senior Data Engineer

Spokeo Inc.; Pasadena (CA); Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Bonus program

Equity plans

401(k)

100% medical/dental/vision coverage

Unlimited PTO

Job summary

Spokeo Inc. is seeking a Senior Data Engineer to build and optimize our data systems, including ETL pipelines, storage, and entity resolution. You’ll work with AWS infrastructure (Airflow, PySpark, EMR, S3, DynamoDB) to develop data products and automation features.

You will collaborate with data science teams, implement scalable data solutions, and ensure governance and quality across ETL processes. The role supports a remote-first team and includes competitive compensation and benefits.

Qualifications

• 7+ years of development experience in data engineering in a production environment.
• 5+ years with large datasets (100M+ records or multiple TB).
• 5+ years of distributed systems design on AWS with EMR.
• 5+ years of Python programming.
• 5+ years in big data ecosystems; Spark is required; PySpark preferred.
• 5+ years of SQL, schema design, and dimensional data modeling.
• 5+ years using dataflow orchestration tools like Airflow.
• 2+ years with non-relational databases (DynamoDB, Elasticsearch).
• Bachelor’s degree in CS/IS/Math or related field is required.

Responsibilities

• Build infrastructure and data automation pipelines to ingest, process, and load data from various sources.
• Collaborate with stakeholders and data science teams to develop data products, including entity resolution.
• Create unit and stress-test components to monitor performance and resolve issues.
• Develop data analysis tools to provide data insights and capture key metrics.
• Research solutions and maintain technical documentation.
• Follow best practices for data governance, quality, cleansing, and ETL activities.

Skills

Python

PySpark

Spark

SQL

Airflow

AWS

EMR

DynamoDB

Elasticsearch

Data engineering

Education

Bachelor's degree in CS/IS/Math

Job description

About Spokeo

Join our mission to make the world more transparent with data.

Spokeo is a people intelligence platform that helps over 18 million monthly visitors reconnect with friends, reunite with families, and build trust in new relationships. Thousands of companies also trust Spokeo’s 60 billion public records to improve customer research, help verify information, and prevent fraud.

Founded in 2006, Spokeo has built a dedicated, remote-first team with an average tenure of 6.9 years. It has earned recognition from Comparably as a Best Company for Compensation, Employee Happiness, Perks and Benefits, Support for Women, Work-Life Balance, and CEO Leadership.

About This Opportunity

As a Senior Data Engineer at Spokeo, you will develop, optimize, and improve our data systems, including ETL pipelines, storage, and entity resolution. This involves working with infrastructure built in AWS, including Airflow, PySpark, EMR, S3, DynamoDB, and more. This role will help build and improve data products, automation platform features, analytical software packages, and data pipeline orchestration tools.

What You’ll Do

• Build infrastructure and data automation pipelines to ingest, process, and load data from various sources. Automate and integrate new components into the data pipeline.
• Collaborate with stakeholders and data science teams to develop data products, including entity resolution and best selection, to efficiently execute product vision and strategy in alignment with organizational goals and priorities.
• Create unit and stress-test components to monitor technical performance and ensure that identified issues are resolved.
• Develop data analysis tools to provide data insights and capture key metrics.
• Research solutions and maintain technical documentation.
• Follow best practices for data governance, quality, cleansing, and other ETL-related activities.

Who You Are

• Required: 7+ years of development experience in data engineering within a production environment (internships and academic settings excluded).
• Proven experience working with large datasets exceeding 100M+ records or multiple terabytes.
• Required: 5+ years of development experience in highly scalable, distributed systems and cluster architectures using AWS and utilizing EMR.
• Required: 5+ years of hands‑on programming experience with Python.
• Required: 5+ years of professional experience working in big data ecosystems; Spark is required; PySpark is preferable.
• Required: 5+ years of experience with SQL, schema design, and dimensional data modeling.
• Required: 5+ years of professional experience working with dataflow orchestration tools, such as Airflow.
• Required: 2+ years of experience with non‑relational databases (e.g., DynamoDB, Elasticsearch, etc.).
• Required: A bachelor’s degree in Computer Science, Information Systems, Mathematics, or a related field is required.

Working at Spokeo

• Spokeo offers a bonus program, equity plans, and a 401 (k).
• Once a year, we do a discretionary, merit‑based salary increase.
• Additional benefits include 100% medical/dental/vision coverage and unlimited employee PTO.

Hiring at Spokeo

We extend written offers to candidates who successfully complete their selection process. Offers will depend on several factors, including, but not limited to, marketplace competition, job leveling, experience, and skills.

Privacy Notice for Candidates: https://www.spokeo.com/recruiting-policy

Spokeo is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Spokeo fosters a business culture where ideas and decisions from all people help us grow, innovate, create the best products, and be relevant in a rapidly changing world.