Data Engineer

Proximity Works; India; On-site; INR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Best in class salary

Proximity Talks

Continuous learning opportunities

Job summary

An innovative tech company in India is seeking a highly skilled Software Engineer to join their Ads Data Engineering team. The candidate will work with Big Data technologies and develop large-scale data pipelines, ensuring the quality and integrity of data sources. A strong programming background in Scala, Java, or Python is required, along with experience in Apache Spark, Hive, and Kafka. This full-time role offers competitive compensation and opportunities for continuous learning.

Qualifications

• Strong programming experience in Scala, Java, or Python.
• Hands-on experience with Apache Spark for large-scale data processing.
• Proficiency in Hive, SQL, and data modeling for analytical workloads.
• Experience working with Kafka for real-time event streaming.
• Solid understanding of Big Data ecosystems.
• Strong debugging, performance tuning, and problem-solving skills.

Responsibilities

• Design, develop, and maintain large-scale data pipelines.
• Work extensively with Hive, Spark, SQL, Scala, and Kafka.
• Optimize data workflows for performance and scalability.
• Partner with data scientists and engineers to deliver reliable datasets.
• Ensure data quality and troubleshoot issues in pipelines.

Skills

Scala

Apache Spark

Hive

SQL

Kafka

Big Data ecosystems

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related field

Tools

AWS EMR

GCP BigQuery

Databricks

Job description

We are looking for a highly skilled Software Engineer to join our Ads Data Engineering team. The ideal candidate will have hands‑on expertise in Big Data technologies, with a strong foundation in distributed data processing, real‑time pipelines, and large‑scale data systems. You will design, build, and optimize data solutions that power insights, reporting, and decision‑making for our advertising ecosystem.

Key Responsibilities

• Design, develop, and maintain large-scale data pipelines to support Ads reporting, attribution, and analytics use cases.
• Work extensively with Hive, Spark, SQL, Scala, and Kafka to process and manage petabyte‑scale datasets.
• Optimize data workflows for performance, scalability, and cost efficiency.
• Partner with data scientists, product managers, and platform engineers to deliver high-quality, reliable datasets and APIs.
• Ensure data quality, integrity, and consistency across multiple data sources. Troubleshoot and resolve issues in real-time streaming pipelines and batch data jobs.
• Continuously evaluate new technologies to enhance the Ads Data platform.

Requirements

• Strong programming experience in Scala (preferred), Java, or Python.
• Hands‑on experience with Apache Spark (batch & streaming) for large‑scale data processing.
• Proficiency in Hive, SQL, and data modeling for analytical workloads.
• Experience working with Kafka for real‑time event streaming.
• Solid understanding of Big Data ecosystems (S4, Hive, Presto, Delta, etc.).
• Strong debugging, performance tuning, and problem‑solving skills.
• Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Nice to Have

• Experience in AdTech, Attribution, or Campaign Analytics.
• Familiarity with cloud-based big data solutions (AWS EMR, GCP BigQuery, Databricks, etc.).
• Familiarity with scheduling services like AirFlow.
• Knowledge of data governance, security, and compliance best practices.

Benefits

• Best in class salary: We hire only the best, and we pay accordingly.
• Proximity Talks: Meet other designers, engineers, and product geeks — and learn from experts in the field.
• Keep on learning with a world‑class team: Work with the best in the field, challenge yourself constantly, and learn something new every day.

Seniority level

• Mid‑Senior level

Employment type

• Full‑time

Job function

• IT Services and IT Consulting