Senior Data Lead - Azure Data Factory (ADF), Databricks

Sapsf; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

Sapsf is seeking a Senior Technical Lead to guide technical teams delivering data solutions built on Snowflake, Azure Data Factory (ADF), and Databricks. You will design, optimize, and oversee data pipelines to meet business requirements while collaborating with stakeholders across the organization.

The role requires strong leadership, hands-on experience with data engineering, and the ability to drive performance improvements in complex ETL environments.

Qualifications

• Experience delivering data solutions with Snowflake and Databricks.
• Strong ETL design and pipeline optimization skills.
• Proven leadership of technical teams and stakeholder collaboration.
• Familiarity with agile methodologies in projects.
• Snowflake/ADF/Databricks certifications are a plus.

Responsibilities

• Lead and manage technical teams for Snowflake/ADF/Databricks projects.
• Design, develop, and maintain data pipelines to meet requirements.
• Collaborate with stakeholders to gather requirements and propose data-driven solutions.
• Monitor and troubleshoot data pipelines for quality and performance.
• Stay updated on data management trends and best practices.
• Collaborate with cross-functional teams to integrate data solutions.
• Provide technical mentorship to team members.

Skills

Snowflake modeling

Snowflake querying

Snowflake performance

ADF orchestration

Databricks

ETL design

Data pipelines troubleshooting

Stakeholder communication

Leadership

Agile project management

Tools

Snowflake

Azure Data Factory (ADF)

Databricks

Job description

The Senior Technical Lead will be responsible for leading technical teams and overseeing the implementation of projects related to Snowflake, Azure Data Factory (ADF), and Data Bricks. The role involves ensuring the successful delivery of data solutions and optimizing data pipelines for efficient performance.

Key Responsibilities

• Lead and manage technical teams, providing guidance and support in the implementation of snowflake, azure data factory (adf), and data bricks projects.
• Design, develop, and maintain data pipelines using snowflake, azure data factory (adf), and data bricks to support business requirements.
• Work closely with stakeholders to gather requirements, identify opportunities for data analytics, and propose data driven solutions.
• Monitor and troubleshoot data pipelines, ensuring data quality, reliability, and performance.
• Stay updated with the latest trends and technologies in data management and analytics, incorporating best practices into projects.
• Collaborate with cross functional teams to integrate data solutions with existing systems and applications.
• Provide technical expertise and mentorship to team members, promoting a culture of learning and innovation.

Skill Requirements

• Proficiency in snowflake, including data modeling, querying, and performance optimization.
• Strong experience in azure data factory (adf) for data integration and orchestration.
• Handson knowledge of data bricks for data engineering, data processing, and machine learning.
• Ability to design, develop, and optimize complex data pipelines for etl processes.
• Strong problem-solving skills and the ability to troubleshoot data pipeline issues.
• Excellent communication skills to interact with technical and nontechnical stakeholders effectively.
• Strong leadership skills to guide and motivate technical teams towards project delivery and success.
• Experience in agile methodologies and project management practices for efficient project execution.

Other Requirements

• Relevant certifications in Snowflake, Azure Data Factory (ADF), DataBricks are a plus.