Azure Data Engineer

TechDigital Group; West Chester (Chester County); On-site; USD 120,000 - 180,000; Full time

Job summary

A leading tech firm in Chester County seeks an Azure Senior Data Lead. This role involves leading the technical aspects of projects, optimizing data workflows, and providing guidance to junior members while utilizing Azure Data Factory, SQL, and Python. Ideal candidates will have strong problem-solving skills and up-to-date knowledge in data engineering practices.

Qualifications

• Proficiency in Azure Data Factory (ADF) and Azure Databricks.
• Strong SQL query writing skills.
• Experience with Oracle PL/SQL.
• Proficient in Python programming.
• Solid understanding of ETL processes.

Responsibilities

• Lead technical implementation of data projects using Azure tools.
• Design and develop efficient ETL processes.
• Collaborate with teams to translate business needs into solutions.
• Optimize data workflows and ensure data quality.
• Provide mentoring and technical guidance.
• Provide technical guidance and mentorship to junior engineers.
• Stay current with evolving data engineering and analytics trends.

Skills

Azure Data Factory (ADF)

Azure Databricks

SQL

Oracle PL/SQL

Python

Data warehousing concepts

ETL processes

Problem-solving skills

Tools

Azure Data Factory (ADF)

Azure Databricks

SQL

Oracle PL/SQL

Python

Job description

Azure Senior Data Lead with Azure Data Factory (ADF),Azure Databricks,SQL,Oracle PL/SQL,Python

Job Summary
The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and maintaining data pipelines and ETL processes while ensuring high performance and scalability of data solutions.

Key Responsibilities
1. Lead the end-to-end technical implementation of data projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.
2. Design and develop efficient and reliable etl processes for large datasets.
3. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions.
4. Optimize data workflows, troubleshoot issues, and ensure data quality and integrity.
5. Implement best practices for data security, governance, and compliance.
6. Provide technical guidance, mentoring, and support to junior team members.
7. Stay uptodate with thelatest trends and technologies in data engineering and analytics.

Skill Requirements
1. Proficiency in azure data factory (adf) and azure databricks for data integration and processing.
2. Strong skills in writing complex sql queries for data manipulation and analysis.
3. Experience with oracle pl/sql for database development and management.
4. Proficient in python programming language for automation and scripting tasks.
5. Solid understanding of data warehousing concepts, etl processes, and data modeling.
6.Ability to work in a fast paced environment and manage multiple priorities effectively.
7. Excellent problem-solving skills and attention to detail.
8. Strong communication and interpersonal skills for effective collaboration with team members and stakeholders.

Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python would be a plus.