Senior Data Engineer — Remote, Spark & Pipelines

Spokeo Inc.; Pasadena (TX); Remote; USD 130,000 - 190,000; Full time

Benefits offered by this job

Bonus program

Equity plans

401(k)

100% medical/dental/vision coverage

Unlimited PTO

Job summary

Spokeo Inc. is seeking a Senior Data Engineer to design, optimize, and expand our data systems including ETL pipelines and storage solutions. You will work with AWS-based infrastructure (Airflow, PySpark, EMR, S3, DynamoDB and more) to build data products and orchestration tools that scale with the business.

You will collaborate with data science and stakeholder teams to deliver data-driven features, ensure data quality, and maintain comprehensive documentation for governance and compliance.

Qualifications

• 7+ years of development experience in data engineering within a production environment.
• Experience with datasets exceeding 100M records or multiple terabytes.
• 5+ years of development in highly scalable, distributed systems using AWS and EMR.
• 5+ years of Python programming.
• 5+ years of experience with Spark / PySpark in big data ecosystems.
• 5+ years of SQL, schema design, and dimensional data modeling.
• 5+ years of dataflow orchestration tools such as Airflow.
• 2+ years of experience with non-relational databases (DynamoDB, Elasticsearch, etc.).
• Bachelor's degree in Computer Science, Information Systems, Mathematics, or a related field

Responsibilities

• Build data infrastructure and automation pipelines to ingest, process, and load data from diverse sources.
• Collaborate with stakeholders and data science teams to develop data products.
• Create unit and stress tests to monitor performance and fix issues.
• Develop data analysis tools to provide insights and metrics.
• Research solutions and maintain technical documentation.
• Follow best practices for data governance, quality, and ETL activities.

Skills

Python

SQL

Spark

Distributed systems

Data engineering

Big data

Pipelines

Education

Bachelor's degree in Computer Science / Information Systems / Mathematics

Tools

Airflow

PySpark

Spark

EMR

DynamoDB

Elasticsearch

S3

Job description

Spokeo Inc. is seeking a Senior Data Engineer to design, optimize, and expand our data systems including ETL pipelines and storage solutions. You will work with AWS-based infrastructure (Airflow, PySpark, EMR, S3, DynamoDB and more) to build data products and orchestration tools that scale with the business.

You will collaborate with data science and stakeholder teams to deliver data-driven features, ensure data quality, and maintain comprehensive documentation for governance and compliance.