ADF Sr. Data Lead

TechDigital Group; United States; On-site; USD 80,000 - 110,000; Full time

Job summary

An established industry player is seeking a Senior Data Engineer/Analyst to lead technical teams and oversee the implementation of innovative data solutions. This exciting role involves designing and optimizing data pipelines using cutting-edge technologies like Snowflake and Azure Data Factory, ensuring data quality and performance. The successful candidate will collaborate with cross-functional teams, providing mentorship and fostering a culture of learning. If you are passionate about data management and analytics, and eager to make an impact in a dynamic environment, this opportunity is perfect for you.

Qualifications

• Experience with unstructured data ingestion patterns and data pipelines.
• Strong analytical skills and ability to handle customer communication.

Responsibilities

• Lead technical teams in implementing Snowflake and Azure Data Factory projects.
• Design and maintain data pipelines to support business requirements.

Skills

Snowflake

Azure Data Factory (ADF)

Data Bricks

ETL processes

Problem-solving skills

Communication skills

Leadership skills

Agile methodologies

Education

Relevant certifications in Snowflake, ADF, and Data Bricks

Tools

Azure

PowerBI

Job description

Data Engineer/Analyst

1. Experience with unstructured data ingestion patterns, Azure and Databricks
2. Experience with log tables, dashboards, AI gateway monitoring, Databricks and PowerBI
3. Execute continuous improvement activities to improve the team's performance
4. Flexible to work under PST overlap hours
5. Excellent communication and logical analytical skills
6. Good in customer communication and able to handle offshore and onshore working model

The Senior Technical Lead will be responsible for leading technical teams and overseeing the implementation of projects related to Snowflake, Azure Data Factory (ADF), and Data Bricks. The role involves ensuring the successful delivery of data solutions and optimizing data pipelines for efficient performance.

Key Responsibilities

1. Lead and manage technical teams, providing guidance and support in the implementation of Snowflake, Azure Data Factory (ADF), and Data Bricks projects.
2. Design, develop, and maintain data pipelines using Snowflake, Azure Data Factory (ADF), and Data Bricks to support business requirements.
3. Work closely with stakeholders to gather requirements, identify opportunities for data analytics, and propose data-driven solutions.
4. Monitor and troubleshoot data pipelines, ensuring data quality, reliability, and performance.
5. Stay updated with the latest trends and technologies in data management and analytics, incorporating best practices into projects.
6. Collaborate with cross-functional teams to integrate data solutions with existing systems and applications.
7. Provide technical expertise and mentorship to team members, promoting a culture of learning and innovation.

Skill Requirements

1. Proficiency in Snowflake, including data modeling, querying, and performance optimization.
2. Strong experience in Azure Data Factory (ADF) for data integration and orchestration.
3. Hands-on knowledge of Data Bricks for data engineering, data processing, and machine learning.
4. Ability to design, develop, and optimize complex data pipelines for ETL processes.
5. Strong problem-solving skills and the ability to troubleshoot data pipeline issues.
6. Excellent communication skills to interact with technical and non-technical stakeholders effectively.
7. Strong leadership skills to guide and motivate technical teams towards project delivery and success.
8. Experience in agile methodologies and project management practices for efficient project execution.

Certifications: Relevant certifications in Snowflake, Azure Data Factory (ADF), and Data Bricks are a plus.