Senior Databricks Devolper

TechDigital Group; California; Hybrid; USD 140,000 - 180,000; Full time

Job summary

TechDigital Group is seeking a Senior Technical Lead to guide teams building data solutions with Snowflake, Azure Data Factory, and Databricks. You will oversee design, development, and optimization of data pipelines, ensuring high performance and data quality. You will mentor staff, collaborate with stakeholders, and drive agile project delivery.

The role emphasizes leadership, hands-on data engineering, and ongoing adoption of best practices in data management and analytics.

Qualifications

• Lead and manage technical teams implementing snowflake, adf, and databricks projects.
• Design, develop, and maintain data pipelines to support business requirements.
• Collaborate with stakeholders to gather requirements and propose data-driven solutions.
• Monitor and troubleshoot data pipelines for quality, reliability, and performance.
• Stay updated with data management trends and best practices.

Responsibilities

• Lead and manage technical teams, guiding the implementation of Snowflake, ADF, and Databricks projects.
• Design, develop, and maintain data pipelines to meet business requirements.
• Collaborate with stakeholders to gather requirements and propose data-driven solutions.
• Monitor and troubleshoot data pipelines ensuring quality, reliability, and performance.
• Stay updated with trends in data management and analytics, applying best practices.
• Collaborate with cross-functional teams to integrate data solutions with existing systems.
• Provide technical mentorship to team members and promote learning.

Skills

Snowflake data modeling

ADF data integration

Databricks engineering

ETL design

Data pipeline troubleshooting

Stakeholder communication

Leadership

Agile methodologies

Tools

Snowflake

Azure Data Factory

Databricks

Job description

Mandatory - Databricks, ADF, Snowflake

The Senior Technical Lead will be responsible for leading technical teams and overseeing the implementation of projects related to Snowflake, Azure Data Factory (ADF), and Data Bricks. The role involves ensuring the successful delivery of data solutions and optimizing data pipelines for efficient performance.

Key Responsibilities

• 1. Lead and manage technical teams, providing guidance and support in the implementation of snowflake, azure data factory (adf), and data bricks projects.


• 2. Design, develop, and maintain data pipelines using snowflake, azure data factory (adf), and data bricks to support business requirements.


• 3. Work closely with stakeholders to gather requirements, identify opportunities for data analytics, and propose data driven solutions.


• 4. Monitor and troubleshoot data pipelines, ensuring data quality, reliability, and performance.


• 5. Stay updated with the latest trends and technologies in data management and analytics, incorporating best practices into projects.


• 6. Collaborate with cross functional teams to integrate data solutions with existing systems and applications.


• 7. Provide technical expertise and mentorship to team members, promoting a culture of learning and innovation.

Skill Requirements

• 1. Proficiency in snowflake, including data modeling, querying, and performance optimization.


• 2. Strong experience in azure data factory (adf) for data integration and orchestration.


• 3. Handson knowledge of data bricks for data engineering, data processing, and machine learning.


• 4. Ability to design, develop, and optimize complex data pipelines for etl processes.


• 5. Strong problem-solving skills and the ability to troubleshoot data pipeline issues.


• 6. Excellent communication skills to interact with technical and nontechnical stakeholders effectively.


• 7. Strong leadership skills to guide and motivate technical teams towards project delivery and success.


• 8. Experience in agile methodologies and project management practices for efficient project execution.

Other Requirements

• 1.Relevant certifications in Snowflake, Azure Data Factory (ADF), DataBricks are a plus.