Lead Data Engineer: Scalable Pipelines & Platform

Pankalytics; Rockville, Northern (MD, KY); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Pankalytics in Rockville, MD is seeking a senior data engineer to lead the design, development, and scalability of foundational data infrastructure and processing pipelines. You will mentor staff and align technical architecture with business goals.

You will architect scalable batch and real-time data pipelines, define data engineering standards, optimize data lake/warehouse performance, and collaborate on data governance and security with cross-functional teams.

Qualifications

• 8+ years in data engineering
• Proficiency in Python, Scala, or Java
• Advanced SQL
• Deep expertise with Spark and Kafka
• Experience with cloud data platforms and orchestration

Responsibilities

• Architect scalable, fault-tolerant batch and real-time data pipelines
• Define data engineering standards, code quality benchmarks, and testing strategies
• Optimize data lake and data warehouse performance for cross-functional analytics and ML workloads
• Collaborate with Data Architects and Security teams for data governance and compliance

Skills

Python

Scala

Java

SQL

Spark

Kafka

Cloud orchestration

Tools

Spark

Kafka

Cloud platforms

Job description

Pankalytics in Rockville, MD is seeking a senior data engineer to lead the design, development, and scalability of foundational data infrastructure and processing pipelines. You will mentor staff and align technical architecture with business goals.

You will architect scalable batch and real-time data pipelines, define data engineering standards, optimize data lake/warehouse performance, and collaborate on data governance and security with cross-functional teams.