Lead Data Engineer: Real-Time Data Pipelines (Remote-friendly)

Adelaide Metrics Inc.; New York, Northern (NY, KY); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Health insurance

Paid time off

Parental leave

Wellness stipend

Stock options

New York office access

WeWork spaces access

Holiday break

Volunteer time off

Performance bonus

Job summary

Adelaide Metrics Inc. is looking for a hands-on Lead Data Engineer to lead our data engineering team and own the pipelines powering Adelaide’s AU metric. The role is based in New York, NY, with flexible work options as part of a remote-friendly setup.

You will supervise oneData Engineer and collaborate with data scientists to structure data flows from internal and external sources into our SaaS analytics dashboard and connected platforms. Strong Python/SQL/Spark skills are essential.

Qualifications

• Bachelor's degree in Computer Science.
• Proficiency in Python, SQL, Spark, Scala and Airflow.
• Experience with Pandas, Docker, and AWS technologies.

Responsibilities

• Structure a sophisticated network and pipeline of data across internal and external sources.
• Maintain a high degree of uptime for the SaaS analytics dashboard and connected platforms.
• Design, build, deploy, and maintain reliable data pipelines with the team.
• Maintain and optimize existing data pipelines and integrations.
• Optimize data stores for fast, efficient querying to support tech and reporting needs.
• Ensure the quality, reliability, and security of the data infrastructure.

Skills

Python

SQL

Spark

Scala

Airflow

Pandas

Machine Learning

Algorithms

Education

Bachelor's degree in Computer Science

Tools

Docker

AWS

Job description

Adelaide Metrics Inc. is looking for a hands-on Lead Data Engineer to lead our data engineering team and own the pipelines powering Adelaide’s AU metric. The role is based in New York, NY, with flexible work options as part of a remote-friendly setup.

You will supervise oneData Engineer and collaborate with data scientists to structure data flows from internal and external sources into our SaaS analytics dashboard and connected platforms. Strong Python/SQL/Spark skills are essential.