Lead Data Engineer(Legends)

Righttalentrightnow; Hyderabad; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

Righttalentrightnow is seeking a Lead Data Engineer in Hyderabad, India. In this role, you will design, build, and optimize scalable data solutions for the sports industry using Azure tools such as ADF, Databricks, and Python. Your responsibilities include collaborating with teams for data-driven insights and continuously improving data workflows. Ideal candidates have strong skills in Python, SQL, and Azure tools, along with a proactive attitude and a passion for continuous learning. This position offers the opportunity to make a significant impact in an innovative environment.

Qualifications

• Experience designing, building, and testing solutions within a data lakehouse environment.
• Hands-on experience with Azure tools, preferably ADF, Databricks, and Function Apps.
• Strong teamwork skills and a proactive attitude towards continuous learning.

Responsibilities

• Design, build, and test scalable data platform solutions in Azure.
• Collaborate with product and marketing teams to provide data-driven insights.
• Continuously improve and optimize data workflows to drive innovation.

Skills

Python

Data processing with PySpark

SQL skills

Azure tools (ADF, Databricks, Function Apps)

CI/CD pipelines with Azure DevOps

Collaboration skills

Job description

Two Circles – Lead Data Engineer

We are looking for a talented Data Engineer to join our squad of more than 100 Data & BI Engineers, working on our Audience Intelligence Platform. You will help build the leading data management and analytics platform for the sports industry. In this role, you’ll design, build, and optimize scalable data solutions using Azure tools such as ADF, Databricks, Function Apps, and Python. If you are passionate about data engineering, enjoy collaborating in a fast‑paced environment, and want to make an impact in the sports industry, we’d love to hear from you!

Responsibilities

• Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python.
• Develop high‑quality data products, ensuring efficiency, reliability, and performance across our data pipelines.
• Collaborate closely with product and marketing teams to deliver data‑driven insights and solutions that provide high business value.
• Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards.
• Continuously improve and optimize data workflows, monitoring performance and implementing enhancements to drive innovation.

Requirements

• Experience designing, building, and testing solutions within a data lakehouse environment.
• Proficiency in Python and PySpark for data processing and analytics.
• Hands‑on experience with Azure, preferably ADF, Databricks, and Function Apps.
• Familiarity with CI/CD pipelines using Azure DevOps or similar tools.
• Ability to work within established development frameworks and adhere to coding standards.
• Excellent communication skills, with an ability to articulate blockers and timelines to non‑technical stakeholders.
• Strong teamwork skills, with a collaborative mindset and desire to learn from others.
• Strong SQL skills for querying and managing data.
• A proactive attitude with a passion for continuous learning and growth.
• High attention to detail and commitment to delivering quality work.
• Comfortable working in a fast‑paced environment, with the ability to estimate tasks and deliver incremental value effectively.