Data Engineer (Audience Intelligence)

Two Circles; Hyderabad; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Two Circles in Hyderabad, India, is seeking a Data Engineer to join our Fan Intelligence Platform squad of 50+ Data & BI Engineers. You will design, build, and optimize scalable data solutions in Azure, focusing on data lakes and lakehouse style architectures to empower leagues, teams, and partners.

You will work with Python, PySpark, SQL, and Databricks, collaborating with product and marketing to deliver data‑driven insights and high‑value analytics.

Qualifications

• Experience in designing, building, and testing data lakehouse solutions.
• Proficiency in Python and PySpark for data processing and analytics.
• Strong SQL skills for querying and managing data.
• Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps.
• Familiarity with CI/CD pipelines using Azure DevOps or similar tools.

Responsibilities

• Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python.
• Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines.
• Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value.
• Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards.
• Continuously improve and optimize data workflows, monitoring performance and implementing enhancements to drive innovation.

Skills

Python

PySpark

SQL

Azure

ADF

Databricks

CI/CD

Azure DevOps

Tools

Azure

Databricks

ADF

Function Apps

Job description

We are Two Circles. We are a Sports & Entertainment Marketing business. We grow audiences and revenues. We do that by knowing fans best. We work with clients to help them understand & influence what their fans are doing - the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. Grow their audiences and grow their revenues - both direct to consumer and business to business revenues. Our platforms and services are trusted by over 1000 clients globally, including the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike and Amazon. We are over 1000 people, based out of 15 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world.

We're looking for a talented Data Engineer to join our squad of >50 Data & BI Engineers, working on our Fan Intelligence Platform. You will be helping to build the leading data management and analytics platform for the sports industry. In this role, you'll work with cutting-edge technologies to design, build, and optimize scalable data solutions, enabling teams, leagues, and organizations to unlock the full potential of their data. If you're passionate about data engineering, enjoy collaborating in a fast-paced environment, and want to make an impact in the sports industry, we'd love to hear from you!

Responsibilties

Your role will be varied and evolve as quickly as you can learn and develop. Your initial duties will involve:

• Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python.
• Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines.
• Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value.
• Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards.
• Continuously improve and optimize data workflows, monitoring performance and implementing enhancements to drive innovation.

Requirements

• Experience in designing, building, and testing solutions within a data lakehouse environment.
• Proficiency in Python and PySpark for data processing and analytics.
• Strong SQL skills for querying and managing data.
• Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps.
• Familiarity with CI/CD pipelines using Azure DevOps or similar tools.
• Ability to work within established development frameworks and adhere to coding standards.

While the above skills are important to this role, we believe that attitude and ability to learn new skills are the most important factors for success in this team. If you are missing some of the experience listed above but this sounds like you, we'd love to hear from you.

• Strong teamwork skills, with a collaborative mindset and desire to learn from others.
• A proactive attitude with a passion for continuous learning and growth.
• High attention to detail and commitment to delivering quality work.
• Comfortable working in a fast-paced environment, with the ability to estimate tasks and deliver incremental value effectively.