Senior Azure Data Engineer - Hybrid | Databricks Lakehouse

VeeRteq Solutions Inc.; Philadelphia (Philadelphia County); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Hybrid work model

Onsite presence three days per week

Job summary

VeeRteq Solutions Inc. in Philadelphia is seeking a senior Data Engineer to build and optimize enterprise Azure and Databricks data platforms in a hybrid role.

You will design scalable ETL/ELT pipelines, ingest, transform, and orchestrate data using Azure-native tools, Databricks, PySpark, and Delta Lake, while ensuring data quality and governance. The role requires onsite presence three days per week and collaboration with business stakeholders.

Qualifications

• Bachelor’s degree in Computer Science or a related field.
• 7+ years in Data Engineering.
• 5+ years hands-on experience with Azure data technologies.
• 2+ years experience in Healthcare, Managed Care, Health Plans, or Payer organizations.
• Strong expertise in Azure Databricks, ADLS Gen2, ADF, PySpark, Python, SQL, Delta Lake, and Data Modeling.
• Experience building enterprise-scale data pipelines and data integration.
• Familiarity with Data Warehousing, Data Lake, and Lakehouse concepts.
• Experience with Git, CI/CD, and DevOps practices.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for enterprise data and analytics initiatives
• Build data ingestion, transformation, and orchestration frameworks using Azure-native technologies
• Develop and optimize data processing solutions using Databricks and PySpark
• Implement and maintain Delta Lake and Lakehouse architectures
• Ensure data quality, accuracy, lineage, and reliability across data assets
• Perform root cause analysis and troubleshoot data-related issues
• Collaborate with Product Owners, Architects, QA teams, and business stakeholders
• Implement CI/CD processes for data engineering solutions and support automated deployment and release management
• Develop monitoring, logging, and observability capabilities for data pipelines
• Follow enterprise data governance and security standards
• Participate in Agile/Scrum ceremonies including sprint planning, daily stand-ups, retrospectives, and backlog refinement
• Contribute to continuous improvement and engineering best practices

Skills

Azure Databricks

Azure Data Lake

Azure Data Factory

PySpark

Python

SQL

Delta Lake

Data Modeling

ETL/ELT Dev

Azure Cloud Platform

Git

CI/CD

Agile/Scrum

Azure Synapse Analytics

Azure SQL Database

Education

Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field

Tools

Azure Databricks

Azure Data Lake Gen2

Azure Data Factory

Databricks

Azure Synapse Analytics

Power BI

Job description

VeeRteq Solutions Inc. in Philadelphia is seeking a senior Data Engineer to build and optimize enterprise Azure and Databricks data platforms in a hybrid role.

You will design scalable ETL/ELT pipelines, ingest, transform, and orchestrate data using Azure-native tools, Databricks, PySpark, and Delta Lake, while ensuring data quality and governance. The role requires onsite presence three days per week and collaboration with business stakeholders.