Data Engineer

VeeRteq Solutions Inc.; Philadelphia (Philadelphia County); Hybrid; USD 150,000 - 190,000; Full time

Job summary

VeeRteq Solutions Inc. is seeking a Senior Data Engineer in Philadelphia, PA, to design enterprise-scale data platforms on Azure and Databricks in a hybrid role.

You will lead the development and optimization of ETL/ELT pipelines, drive cloud modernization, and mentor data teams to follow best practices. This role collaborates with stakeholders and product teams to enable analytics, AI/ML initiatives, and data-driven decision making.

Qualifications

• Minimum 10+ years in data engineering.
• 7+ years with Azure Data Services.
• 5+ years with Azure Databricks.
• Experience leading enterprise cloud data modernization projects.
• Hands-on experience with Azure Databricks, ADLS Gen2, ADF, PySpark, Python, SQL, Delta Lake.

Responsibilities

• Design and build scalable data platforms, data lakes, and lakehouse solutions.
• Develop and optimize ETL/ELT pipelines using Azure and Databricks.
• Lead data architecture, data modeling, and cloud modernization initiatives.
• Mentor data engineering teams and establish best practices.
• Improve platform performance, security, and cost efficiency.
• Implement CI/CD, monitoring, and production support processes.
• Collaborate with business leaders, architects, analysts, and product teams.
• Support analytics, reporting, AI/ML, and data-driven business initiatives.

Skills

Data engineering

Team leadership

Agile/Scrum

Tools

Azure Databricks

ADLS Gen2

ADF

PySpark

Python

SQL

Delta Lake

Power BI

Git

Azure DevOps

Terraform

Azure Synapse Analytics

Kafka

Job description

Join VeeRteq Solutions Inc. as a Senior Data Engineer in a hybrid role based in Philadelphia, PA 19160, focused on enterprise-scale Azure and Databricks data platforms.

Responsibilities

• Design and build scalable data platforms, data lakes, and lakehouse solutions
• Develop and optimize ETL/ELT pipelines using Azure and Databricks
• Lead data architecture, data modeling, and cloud modernization initiatives
• Mentor data engineering teams and establish best practices
• Improve platform performance, scalability, security, and cost efficiency
• Implement CI/CD, monitoring, and production support processes
• Collaborate with business leaders, architects, analysts, and product teams
• Support analytics, reporting, AI/ML, and data-driven business initiatives

Requirements

• Minimum 10+ years in data engineering
• 7+ years with Azure Data Services
• 5+ years with Azure Databricks
• Experience leading enterprise cloud data modernization projects
• Hands-on experience with:
  • Azure Databricks
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure Data Factory (ADF)
  • PySpark
  • Python
  • Advanced SQL
  • Delta Lake
  • Data lakehouse architecture
  • Data modeling
  • ETL/ELT development
  • Azure cloud services
  • Git & CI/CD
  • Agile/Scrum

Preferred Skills

• Azure Synapse Analytics
• Azure Event Hub
• Kafka
• Power BI
• Azure DevOps
• Terraform
• Data governance & metadata management
• Monitoring & observability tools
• AI/ML data pipelines

Nice to Have

• Healthcare payer domain experience (strong preference)
• Experience working directly with business stakeholders and leadership teams

Tech Stack

• Azure, Databricks, Azure Databricks
• Azure Data Lake Storage (ADLS Gen2)
• Azure Data Factory (ADF)
• PySpark, Python, Advanced SQL
• Delta Lake
• ETL/ELT, Data lakehouse architecture
• Azure Synapse Analytics, Azure Event Hub, Kafka
• Power BI
• Azure DevOps, Terraform
• Data governance & metadata management
• Monitoring & observability tools
• AI/ML data pipelines
• Git, CI/CD, Agile/Scrum