Staff Data Engineer

Pankalytics; Rockville, Northern (MD, KY); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Pankalytics in Rockville, MD is seeking a senior data engineer to lead the design, development, and scalability of foundational data infrastructure and processing pipelines. You will mentor staff and align technical architecture with business goals.

You will architect scalable batch and real-time data pipelines, define data engineering standards, optimize data lake/warehouse performance, and collaborate on data governance and security with cross-functional teams.

Qualifications

• 8+ years in data engineering
• Proficiency in Python, Scala, or Java
• Advanced SQL
• Deep expertise with Spark and Kafka
• Experience with cloud data platforms and orchestration

Responsibilities

• Architect scalable, fault-tolerant batch and real-time data pipelines
• Define data engineering standards, code quality benchmarks, and testing strategies
• Optimize data lake and data warehouse performance for cross-functional analytics and ML workloads
• Collaborate with Data Architects and Security teams for data governance and compliance

Skills

Python

Scala

Java

SQL

Spark

Kafka

Cloud orchestration

Tools

Spark

Kafka

Cloud platforms

Job description

Role Overview:

Lead the design, development, and scalability of foundational data infrastructure and processing pipelines. Drive data engineering best practices, mentor engineering staff, and align technical architecture with business goals.

Key Responsibilities:

• Architect scalable, fault-tolerant batch and real-time data pipelines using distributed computing frameworks.
• Define data engineering standards, code quality benchmarks, and automated testing strategies.
• Optimize data lake and data warehouse performance for cross-functional analytics and machine learning workloads.
• Collaborate with Data Architects and Security teams to ensure strict data governance and compliance.

Qualifications:

• 8+ years in data engineering; expert proficiency in Python, Scala, or Java; advanced SQL; deep expertise with Spark, Kafka, and cloud data platform orchestration.