Tech Lead - Azure Data Factory (ADF) Job

YASH Technologies; Hyderabad; On-site; INR 15,00,000 - 20,00,000; Full time

Job summary

A leading technology integrator is seeking Azure Data Factory Professionals in Hyderabad. The successful candidate will design complex data pipelines, integrate with various Azure services, and ensure data security. Candidates should have over 7 years of experience in database technologies, strong SQL and Python skills, and hands-on experience with Azure Data Factory. We offer a flexible work environment and focus on continuous learning.

Qualifications

• 7+ years of experience in database technologies and ETL tools.
• 5+ years of hands-on experience with Azure Data Factory.
• Strong proficiency in SQL, Python, and PySpark.

Responsibilities

• Design and build complex data pipelines using Azure Data Factory.
• Integrate ADF with Azure SQL Database and Databricks.
• Ensure security and compliance in data orchestration processes.

Skills

Database technologies

ETL tools

Azure Data Factory

SQL

Python

PySpark

Azure Databricks

Azure Blob Storage

Azure Data Lake

HDInsight

REST APIs

Azure API Management

Azure Functions

OOP concepts

Version control systems

CI/CD pipelines

Education

Bachelor’s or Master’s degree in Computer Science

Data Engineering or related field

Job description

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hiring Azure Data Factory (ADF) Professionals in the following areas:

• Design and build complex data pipelines and dataflows using Azure Data Factory.
• Integrate ADF with Azure SQL Database, and Databricks.
• Develop custom ETL processes using Python, and SQL.
• Document architecture, data flows, and transformation logic.
• Conduct impact assessments and provide high-level design based on business requirements.
• Monitor and optimize performance of data pipelines.
• Ensure security and compliance in data orchestration processes.
• Collaborate with cross-functional teams to ensure alignment with business goals.
• Mentor junior developers and contribute to architectural improvements.

Required Skills & Experience:

• 7+ years of experience in database technologies and ETL tools.
• 5+ years of hands-on experience with Azure Data Factory.
• Strong proficiency in SQL, Python, and PySpark.
• Experience with Azure Databricks, Azure Blob Storage, Azure Data Lake, and HDInsight.
• Familiarity with REST APIs, Azure API Management, and Azure Functions.
• Knowledge of object-oriented programming (OOP) concepts.
• Experience with version control systems and CI/CD pipelines.
• Excellent communication and documentation skills.

Preferred Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
• Exposure to Agile/Scrum methodologies.
• Certifications in Azure Data Engineering or related areas.

Soft Skills:

• Strong analytical and problem-solving abilities.
• Ability to work independently and in a team environment.
• Effective communication with technical and non-technical stakeholders.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles:

• Flexible work arrangements, Free spirit, and emotional positivity.
• Agile self-determination, trust, transparency, and open collaboration.
• All Support needed for the realization of business goals.
• Stable employment with a great atmosphere and ethical corporate culture.