Lead Data Lake Engineer – ETL, API Imports, Azure

Apollov2; City of White Plains (NY); On-site; USD 80,000 - 90,000; Full time

Job summary

ApolloV2 in White Plains, NY is seeking a Data Engineer to lead the data lake build-out, shaping how data flows and is structured. You will own ETL pipelines and oversee external data imports as we onboard new clients.

This leadership role combines strategic direction with hands-on work, including Python-based ETL development, complex SQL queries, and ensuring data moves efficiently into the lake rather than the transactional DB. On-site, full-time.

Qualifications

• Experience with data lake architectures and medallion design.
• Strong SQL and Python for ETL and data processing.
• Leadership experience in data engineering projects.

Responsibilities

• Lead data lake build-out and expansion for onboarding clients.
• Own external data imports as part of client onboarding.
• Lead API-based data imports directly into the data lake.
• Design, build, and maintain ETL pipelines using Python.
• Write and optimize SQL queries on large datasets.
• Develop web scraping tools when needed.
• Set technical direction and best practices for data engineering.

Skills

Azure Synapse

Azure Data Lake Studio

SQL

Python

ETL pipelines

Git/GitHub

Docker

Deployment

Communication

Independent work

Tools

PySpark

Kafka

Flink

Microsoft 365

Job description

ApolloV2 in White Plains, NY is seeking a Data Engineer to lead the data lake build-out, shaping how data flows and is structured. You will own ETL pipelines and oversee external data imports as we onboard new clients.

This leadership role combines strategic direction with hands-on work, including Python-based ETL development, complex SQL queries, and ensuring data moves efficiently into the lake rather than the transactional DB. On-site, full-time.