Azure Data Engineer: Scalable Pipelines & BI Analytics

Veriipro; Bellevue (WA); On-site; USD 110,000 - 160,000; Full time

Job summary

Veriipro seeks an experienced Azure Data Engineer to build scalable ingestion pipelines and deliver reliable datasets for analytics. You will transform data using Python, PySpark, and SQL, standardize partner data, and implement quality checks across systems.

You will collaborate with analysts and stakeholders, manage data pipelines, and work with Azure Cosmos DB and related services to support BI reporting and AI-enabled solutions.

Qualifications

• 4–6 years of experience in data engineering and data pipeline development.
• Hands-on experience with Microsoft Azure data services.
• Experience with Azure Databricks, PySpark, and Python for large-scale processing.
• Proficiency in SQL/PLSQL for data transformation and validation.
• Knowledge of Microsoft Fabric and Power BI for analytics integration.
• Familiarity with ETL/ELT, data modeling, governance, and quality checks.

Responsibilities

• Design, develop, and maintain scalable data ingestion pipelines using Azure and Databricks.
• Transform, cleanse, validate, and normalize data with Python, PySpark, and SQL.
• Ingest and standardize internal and partner data with accurate mapping.
• Implement data quality checks, reconciliation, and validation rules.
• Monitor pipelines, troubleshoot failures, and perform root-cause analysis.
• Manage data refresh schedules, orchestration, and operational monitoring.
• Support onboarding of new data feeds and enterprise integrations.
• Develop standardized data models for analytics, reporting, and BI needs.
• Collaborate with analysts and stakeholders to understand data requirements.
• Explore Foundry capabilities to support AI-enabled data solutions when required.
• Ensure data governance, security, compliance, lineage, and auditability.

Skills

Azure Data Services

Azure Databricks

PySpark

Python

SQL/PLSQL

Power BI

ETL/ELT

Data Modeling

Tools

Azure Databricks

Python

Power BI

SQL

PL/SQL

Microsoft Fabric

Azure Cosmos DB

NoSQL

Microsoft Foundry

Job description

Veriipro seeks an experienced Azure Data Engineer to build scalable ingestion pipelines and deliver reliable datasets for analytics. You will transform data using Python, PySpark, and SQL, standardize partner data, and implement quality checks across systems.

You will collaborate with analysts and stakeholders, manage data pipelines, and work with Azure Cosmos DB and related services to support BI reporting and AI-enabled solutions.