Lead Data Engineer - Spark / Scala

V2 Solutions; Pune District; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

V2 Solutions in Pune requires a data analytics professional with 6+ years of BI experience. You will build ETL pipelines, fetch data from flat files, relational DBs and APIs, and implement transformations using Python.

The role emphasizes strong SQL, hands-on with Power BI, Tableau or Looker, Airflow for pipelines, and effective communication to collaborate across teams.

Qualifications

• 6+ years of experience in Data Analytics and BI.
• Experience in Spark, Hive, Scala.
• Build data pipelines for ETL from flat files, relational databases and APIs.
• Python scripting for data transformation using Pandas and NumPy.
• Strong SQL, able to write advanced queries.
• Hands-on with visualization tools: Power BI, Tableau, Looker.
• Experience with data engineering pipeline management tools such as Airflow.
• Good communication skills.

Responsibilities

• Design and build end-to-end ETL data pipelines from diverse sources.
• Collaborate with stakeholders to deliver dashboards and data insights.
• Optimize data models and complex SQL queries for performance.

Skills

Data Analytics

BI

Spark

Hive

Scala

Python

SQL

Power BI

Tableau

Looker

Airflow

Communication skills

Tools

Spark

Hive

Scala

Python

SQL

Power BI

Tableau

Looker

Airflow

Job description

Notice Period : Immediate to 15 Days.

Job Description :

• 6+ years of overall Data Analytics and BI experience
• Experience in Spark, Hive, Scala.
• Build data pipelines for ETL that fetch data from variety of sources such as flat files relational databases and APIs
• Python scripting with focus on data transformation and manipulation libraries such as Pandas and numpy
• Strong knowledge and hands-on experience of SQL (should be able to write advance level SQL queries)
• Good hands-on experience on data visualization tools such as Power BI, Tableau, Looker
• Good understanding and hands-on experience of Data engineering pipeline management tools such as Airflow
• Good Communication skills.