Lead Data Engineer - Scalable Pipelines (Remote-friendly)

Emploive; Northern (KY); Hybrid; USD 100,000 - 130,000; Full time

Benefits offered by this job

Remote-first environment

New York office access

WeWork spaces access

Stock options

401(k) retirement plan

Performance-based quarterly bonus

Job summary

Adelaide is seeking a hands-on Lead Data Engineer to lead our data engineering team and own the pipelines powering Adelaide's AU metric. Based in New York, NY with flexible work options, you will supervise one Data Engineer and collaborate with data scientists to structure data from internal and external sources into our SaaS analytics dashboard.

This role requires strong Python, SQL, Spark, and AWS skills, plus a track record of building reliable, scalable data pipelines.

Qualifications

• Bachelor's degree in Computer Science required.
• Proficient in Python, SQL, and big data frameworks (Spark/Scala) and Airflow.
• Experience with Pandas and Docker.
• Familiar with AWS services (ECS, S3, Kinesis, Redshift, EMR).
• Strong data structures/algorithms; experience with ML.

Responsibilities

• Structure a sophisticated network and pipeline of data across internal and external sources.
• Maintain high uptime for SaaS analytics dashboard and connected platforms.
• Design, build, deploy, and maintain reliable data pipelines with teammates.
• Maintain and optimize existing data pipelines and integrations.
• Optimize data stores for fast querying to support technology and reporting needs.
• Ensure data infrastructure is reliable and secure.

Skills

Python

SQL

Spark

Scala

Airflow

Redshift

Postgres

Pandas

Docker

AWS

Data structures & algorithms

Machine learning

Education

Bachelor's degree in Computer Science

Tools

Docker

AWS

Job description

Adelaide is seeking a hands-on Lead Data Engineer to lead our data engineering team and own the pipelines powering Adelaide's AU metric. Based in New York, NY with flexible work options, you will supervise one Data Engineer and collaborate with data scientists to structure data from internal and external sources into our SaaS analytics dashboard.

This role requires strong Python, SQL, Spark, and AWS skills, plus a track record of building reliable, scalable data pipelines.