Senior Data Engineer

PRI Technology; New York (NY); On-site; USD 130,000 - 190,000; Full time

Job summary

PRI Technology seeks a Senior Data Engineer to own the design and delivery of complex data platforms powering analytics, AI, and reporting. You will mentor engineers, set standards, and guide cloud-native migrations across an enterprise data fabric.

Your deep SQL and Python expertise will drive ELT/ETL architectures using Azure Data Factory, Databricks, and Synapse. You will champion data quality, governance, and scalable models for enterprise decisions.

Qualifications

• 6+ years of progressive data engineering experience in production environments.
• Expert-level SQL (tuning, indexing) and Python (PySpark) skills.
• Experience designing dimensional models and data lake architectures at scale.
• Experience building data pipelines that support ML feature engineering and model serving.
• Background in data quality engineering, validation, SLA enforcement, and lineage tracking.
• Experience migrating legacy data solutions to cloud-native platforms.

Responsibilities

• Architect, build, and own complex data pipelines for high-volume, critical enterprise workstreams.
• Lead ELT/ETL framework design using SQL, Python, Azure Data Factory, Databricks, and Azure Synapse Analytics.
• Establish pipeline reliability: monitoring, alerting, error handling, recovery protocols.
• Design scalable data models for dimensional warehousing and data lake architectures on Azure.
• Drive data governance including metadata, lineage, data cataloging (Purview), and access control.
• Mentor Data Engineers with code reviews, architectural feedback, and best practices.

Skills

SQL

Python

PySpark

Databricks

Azure Data Factory

Azure Synapse Analytics

Data Modeling

Data Quality

Data Governance

ML Pipelines

Education

Bachelor's degree in CS/Data Science/IT

Tools

Databricks

Azure Data Factory

Azure Synapse

SQL Server

Oracle

Microsoft Purview

Job description

As a Senior Data Engineer you will own the design and delivery of complex data engineering solutions that power enterprise analytics, AI, and reporting capabilities. Reporting to the Lead Data Engineer, you will drive technical decisions, set engineering standards, and ensure the reliability and scalability of data platform across 49+ integrated enterprise source systems.

This role demands deep technical mastery in SQL, Python, and Azure cloud data engineering, combined with a product orientation—understanding how the data assets you build translate into decisions, reports, and AI outputs for the business. You will mentor Data Engineers, contribute to architectural direction, and serve as a technical anchor for delivery across the Tetris team's sprint cycles.

Advanced Pipeline Development & Ownership

• Architect, build, and own complex data pipelines for high-volume, high criticality workstreams across enterprise data platform.
• Lead the design and implementation of ELT/ETL frameworks using SQL, Python, Azure Data Factory, Databricks, and Azure Synapse Analytics.
• Establish pipeline reliability standards—monitoring, alerting, error handling, and recovery protocols—and ensure adherence across the team.
• Drive the design of scalable data models supporting dimensional warehousing, data lake architectures on Azure.
• Contribute to architectural decisions on data storage, partitioning, compute optimization, and consumption layer design.
• Lead migrations from legacy data solutions to modern cloud-native platforms, managing risk and business continuity throughout.

AI & Analytics Enablement

• Design and deliver feature pipelines and data preparation frameworks that support machine learning model development and deployment.
• Partner with Data Scientists to translate model requirements into production-grade data assets and feature stores.
• Collaborate with Analytics Engineers to ensure data models are optimized for analytical consumption and reporting performance.

Data Quality & Governance Leadership

• Define and implement data quality frameworks—validation rules, SLAs, anomaly detection, and automated testing for pipeline outputs.
• Lead data governance initiatives including metadata management, lineage tracking, data cataloging (Microsoft Purview), and access control.
• Ensure platform compliance with HIPAA, data policies, and applicable regulatory requirements.

Mentorship & Technical Leadership

• Mentor Data Engineers—providing code reviews, technical guidance, and architectural feedback that elevates team capability.
• Contribute to engineering standards, reusable frameworks, and technical documentation.
• Participate in Agile ceremonies and model strong engineering discipline—clear DevOps hygiene, sprint commitment, and delivery accountability.

Education:

• Bachelor’s degree in computer science, Data Science, Information Technology, or a related quantitative field.

Experience:

• 6+ years of progressive experience in data engineering with demonstrated ownership of complex, production-grade data platforms.
• Expert-level SQL (query optimization, indexing strategy, execution plans) and Python (PySpark, pipeline frameworks, testing).
• Proven experience designing dimensional data models and data lake architecture at enterprise scale.
• Experience building data pipelines that directly support machine learning feature engineering and model serving.
• Strong background in data quality engineering—automated validation, SLA enforcement, and lineage tracking.
• Experience with relational databases (SQL Server, Oracle) and migration from legacy to cloud-native platforms.