Azure Sr. Data Lead

TechDigital Group; Jersey City (NJ); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology solutions provider in New Jersey is seeking a Senior Technical Lead to oversee projects focusing on data integration using Azure Data Factory and Azure Databricks. The role involves developing and managing efficient ETL processes and mentoring junior team members. Candidates should possess strong skills in SQL and Python, along with a solid understanding of data warehousing concepts. Relevant certifications are a plus. This position offers a dynamic work environment with opportunities for growth.

Qualifications

• 5+ years of experience with Azure Data Factory and Azure Databricks.
• Strong SQL skills for complex data manipulation and analysis.
• Experience with Oracle PL/SQL and Python programming.

Responsibilities

• Lead end-to-end technical implementation of data projects.
• Design and develop efficient ETL processes for large datasets.
• Collaborate with cross-functional teams to understand business requirements.

Skills

Azure Data Factory

Azure Databricks

SQL

Oracle PL/SQL

Python

ETL processes

Data warehousing concepts

Problem-solving skills

Communication skills

Education

Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python

Job description

Skill

• Azure Data Databricks
• Azure DevOps
• Azure DevOps pipelines
• YAML builds
• Azure release workflows
• Databricks Asset Bundles
• PowerShell
• Terraform
• Python
• Azure data factory
• ADLS Gen2
• Data API Builder (DAB)
• Key Vault
• Databricks notebooks

Job Summary

The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and maintaining data pipelines and ETL processes while ensuring high performance and scalability of data solutions.

Key Responsibilities

• Lead the end-to-end technical implementation of data projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.
• Design and develop efficient and reliable etl processes for large datasets.
• Collaborate with cross functional teams to understand business requirements and translate them into technical solutions.
• Optimize data workflows, troubleshoot issues, and ensure data quality and integrity.
• Implement best practices for data security, governance, and compliance.
• Provide technical guidance, mentoring, and support to junior team members.
• Stay uptodate with thelatest trends and technologies in data engineering and analytics.

Skill Requirements

• Proficiency in azure data factory (adf) and azure databricks for data integration and processing.
• Strong skills in writing complex sql queries for data manipulation and analysis.
• Experience with oracle pl/sql for database development and management.
• Proficient in python programming language for automation and scripting tasks.
• Solid understanding of data warehousing concepts, etl processes, and data modeling.
• Ability to work in a fast paced environment and manage multiple priorities effectively.
• Excellent problem-solving skills and attention to detail.
• Strong communication and interpersonal skills for effective collaboration with team members and stakeholders.

Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python would be a plus.