Senior Data Engineer - Cloud Data Pipelines & AI

PRI Technology; New York (NY); On-site; USD 130,000 - 190,000; Full time

Job summary

PRI Technology seeks a Senior Data Engineer to own the design and delivery of complex data platforms powering analytics, AI, and reporting. You will mentor engineers, set standards, and guide cloud-native migrations across an enterprise data fabric.

Your deep SQL and Python expertise will drive ELT/ETL architectures using Azure Data Factory, Databricks, and Synapse. You will champion data quality, governance, and scalable models for enterprise decisions.

Qualifications

• 6+ years of progressive data engineering experience in production environments.
• Expert-level SQL (tuning, indexing) and Python (PySpark) skills.
• Experience designing dimensional models and data lake architectures at scale.
• Experience building data pipelines that support ML feature engineering and model serving.
• Background in data quality engineering, validation, SLA enforcement, and lineage tracking.
• Experience migrating legacy data solutions to cloud-native platforms.

Responsibilities

• Architect, build, and own complex data pipelines for high-volume, critical enterprise workstreams.
• Lead ELT/ETL framework design using SQL, Python, Azure Data Factory, Databricks, and Azure Synapse Analytics.
• Establish pipeline reliability: monitoring, alerting, error handling, recovery protocols.
• Design scalable data models for dimensional warehousing and data lake architectures on Azure.
• Drive data governance including metadata, lineage, data cataloging (Purview), and access control.
• Mentor Data Engineers with code reviews, architectural feedback, and best practices.

Skills

SQL

Python

PySpark

Databricks

Azure Data Factory

Azure Synapse Analytics

Data Modeling

Data Quality

Data Governance

ML Pipelines

Education

Bachelor's degree in CS/Data Science/IT

Tools

Databricks

Azure Data Factory

Azure Synapse

SQL Server

Oracle

Microsoft Purview

Job description

PRI Technology seeks a Senior Data Engineer to own the design and delivery of complex data platforms powering analytics, AI, and reporting. You will mentor engineers, set standards, and guide cloud-native migrations across an enterprise data fabric.

Your deep SQL and Python expertise will drive ELT/ETL architectures using Azure Data Factory, Databricks, and Synapse. You will champion data quality, governance, and scalable models for enterprise decisions.