Big Data Developer

Demandbase

Hyderabad

On-site

INR 1,200,000 - 1,800,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading company is seeking a Software Engineer to develop a high-performance reporting platform. You will work with technologies like BigQuery, Spark, and Python to create robust ETL pipelines and APIs, ensuring data quality and performance. This role offers the chance to collaborate with cross-functional teams and make impactful decisions in a fast-paced environment. Ideal candidates will have a strong background in big data and API development.

Qualifications

5+ years of experience in software engineering with a focus on big data, ETL, and API development.
Strong expertise in Python, including experience with Flask for building APIs.

Responsibilities

Design, develop, and maintain ETL pipelines using BigQuery, Spark, and Airflow.
Build APIs using Python and Flask to make reporting data accessible.

Skills

Python

Big Data

ETL

API Development

Data Modeling

Performance Tuning

Scalability

Tools

BigQuery

Spark

Airflow

Flask

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Demandbase

Technology Recruiter || Hiring for top product based companies

About the Role

We are looking for a Software Engineer to join our team and help build a high-performance reporting platform that powers data-driven decision-making. This is an opportunity to work with BigQuery, Spark, Airflow, and Python, designing and developing robust ETL pipelines and APIs that ensure high data quality, reliability, and performance.

Qualifications & Skills

5+ years of experience in software engineering with a focus on big data, ETL, and API development.
Strong expertise in Python, including experience with Flask for building APIs.
Experience working with BigQuery and Spark for processing large-scale data.
Proficiency in Airflow for orchestrating data workflows.
A deep understanding of data modeling, performance tuning, and scalability considerations in a reporting environment.
A strong owner mindset—you take pride in your work, prioritize data quality, and are proactive in solving problems.
Ability to work independently and collaboratively in a fast-paced environment.

Key Responsibilities

Design, develop, and maintain ETL pipelines using BigQuery, Spark, and Airflow to process and transform large datasets efficiently.
Build APIs using Python and Flask to make reporting data easily accessible to internal and external stakeholders.
Ensure data quality, accuracy, and consistency, establishing best practices for monitoring and validation.
Collaborate with cross-functional teams, including data analysts and product managers, to understand reporting needs and translate them into scalable solutions.
Optimise performance and scalability of the reporting platform to support growing data volumes and business requirements.
Maintain and improve the orchestration of data workflows using Airflow.
Take ownership of the platform’s architecture, making key decisions to build a solid and future-proof foundation.

Nice to have experience in the advertising industry, working with ad-related data and reporting needs.

About Us

Demandbase is the Smarter GTM company for B2B brands. We help B2B companies hit their revenue goals using fewer resources. How? By aligning their sales and marketing teams around a combination of their data, our data, and artificial intelligence — what we call Account Intelligence — so they can identify, engage, and focus their time and money on the accounts most likely to buy.

As a company, we’re as committed to growing careers as we are to building world-class technology. We invest heavily in people, our culture, and the community around us. We have offices in the San Francisco Bay Area, Seattle, and India, as well as a team in the UK. We have also been continuously recognized as one of the best places to work in the San Francisco Bay Area including, “Best Workplaces for Millennials” and “Best Workplaces for Parents”!

Seniority level