Overview
We are seeking expert Azure Data Engineers proficient in ADF, Azure Databricks, PySpark, and Python to design and optimize scalable cloud data solutions. Join our IT staffing team to deliver enterprise-grade data pipelines, ETL processes, and analytics platforms for leading clients across industries.
Role Summary
As an Azure Data Engineer, you'll architect robust data solutions using Azure Data Factory, Azure Databricks, and Synapse. With 5+ years of experience handling large-scale SQL data marts and cloud connectivity, you'll drive data extraction, transformation, and analytics for business-critical applications.
Key Responsibilities
Responsibilities include designing, developing, and optimizing data pipelines and analytics platforms in cloud environments, leveraging Azure Data Factory, Azure Databricks, Synapse, and related technologies to support business needs.
Required Technical Skill Set
- Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQL
Desired Competencies
- Strong experience in Azure Data Factory, Azure Databricks (ADB), Synapse, PySpark; establishing cloud connectivity between systems like ADLS, ADF, Synapse, Databricks.
- Minimum 5 years\' experience with large SQL data marts; expert relational database skills with ability to navigate massive data volumes for efficient extraction, design, load, and reporting solutions.
- Minimum 5 years troubleshooting/supporting large databases, testing activities; identifying/managing database security, user access; designing backup/archiving/storage, performance tuning, ETL for large data volumes, capacity planning.
- Experience in T-SQL programming with Azure Data Factory framework and Python scripting.
Required Skills
- Core Technical Skills:
- Azure Data Factory (ADF) pipeline development and orchestration
- Azure Databricks (Spark - PySpark/Scala) for data processing
- Azure Synapse Analytics integration
- Python scripting for data transformation/automation
- PL/SQL and T-SQL programming
- ADLS, cloud connectivity across Azure services
Skills: data,sql,data marts,python,data solutions,cloud,analytics,azure