Data Lead with Azure Data Factory (ADF), DataBricks

TechDigital Group; Dallas (TX); On-site; USD 90,000 - 150,000; Full time

Job summary

An established industry player is seeking a Data Lead to oversee the implementation and support of Snowflake, Azure Data Factory, and Data Bricks solutions. In this pivotal role, you will lead the design and development of data pipelines, ensuring data quality and integrity while mentoring team members on best practices. This position offers the opportunity to stay at the forefront of data engineering and integration, working with cutting-edge technologies in a dynamic environment. If you are passionate about data and eager to drive improvements in data processes, this role is perfect for you.

Qualifications

• Proficiency in Snowflake architecture and optimization.
• Hands-on experience with Azure Data Factory (ADF) and Data Bricks.

Responsibilities

• Lead design and deployment of Snowflake and Azure Data Factory solutions.
• Collaborate with teams to gather data requirements and ensure data quality.

Skills

Snowflake architecture

Azure Data Factory (ADF)

Data Bricks

ETL processes

Data modeling techniques

Problem-solving

Communication skills

Leadership skills

Job description

Data Lead with Azure Data Factory (ADF), DataBricks

Job Summary

The Technical Lead will be responsible for leading and managing the implementation, maintenance, and support of Snowflake, Azure Data Factory (ADF), and Data Bricks solutions. The role involves overseeing the technical aspects of projects related to data engineering, data integration, and data processing using these platforms.

Key Responsibilities

1. Lead the design, development, and deployment of Snowflake, Azure Data Factory (ADF), and Data Bricks solutions according to project requirements.
2. Collaborate with cross-functional teams to gather data requirements, design data pipelines, and ensure data quality and integrity.
3. Provide technical guidance and mentorship to team members on best practices for utilizing Snowflake, Azure Data Factory (ADF), and Data Bricks.
4. Troubleshoot and resolve technical issues related to data pipelines, data transformation, and data storage in Snowflake, Azure Data Factory (ADF), and Data Bricks.
5. Stay updated on industry trends and best practices related to Snowflake, Azure Data Factory (ADF), and Data Bricks to recommend and implement improvements in existing data processes.

Skill Requirements

1. Proficiency in Snowflake architecture, implementation, and optimization.
2. Hands-on experience with Azure Data Factory (ADF) including data pipeline development, integration, and monitoring.
3. Strong knowledge of Data Bricks for big data processing, data engineering, and machine learning workflows.
4. In-depth understanding of data warehousing concepts, ETL processes, and data modeling techniques.
5. Excellent problem-solving skills and ability to work in a fast-paced environment.
6. Strong communication and leadership skills to effectively collaborate with team members and stakeholders.