Lead Data Engineer - Spark / Scala

Forward Eye Technologies; Pune District; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Forward Eye Technologies in Pune is seeking a senior data analytics professional with 6+ years of BI and analytics experience. You will build ETL pipelines, work with Spark, Hive and Scala, and transform data using Python libraries such as Pandas and NumPy.

You will design and optimize SQL queries, create dashboards in Power BI, Tableau or Looker, and manage data workflows with Airflow. Strong communication is required to collaborate with cross-functional teams.

Qualifications

• 6+ years in data analytics and BI.
• Experience with Spark, Hive, and Scala.
• Experience building ETL data pipelines from multiple sources.
• Proficiency in Python for data transformation (Pandas, NumPy).
• Strong SQL skills for complex queries.
• Hands-on with Power BI, Tableau or Looker.
• Experience with Airflow for data pipeline management.
• Strong communication skills.

Responsibilities

• Build data pipelines for ETL from diverse sources (flat files, relational DBs, APIs).
• Develop data transformations using Python (Pandas, NumPy).
• Write advanced SQL queries for analytics.
• Create dashboards in Power BI, Tableau or Looker.
• Work with Airflow for pipeline orchestration.
• Collaborate and communicate effectively.

Skills

Data analytics

Spark

Hive

Scala

ETL pipelines

Python

Pandas

NumPy

SQL

Power BI

Tableau

Looker

Airflow

Communication

Tools

Spark

Hive

Scala

Airflow

Power BI

Tableau

Looker

Job description

Notice Period : Immediate to 15 Days.

Job Description :

• 6+ years of overall Data Analytics and BI experience
• Experience in Spark, Hive, Scala.
• Build data pipelines for ETL that fetch data from variety of sources such as flat files relational databases and APIs
• Python scripting with focus on data transformation and manipulation libraries such as Pandas and numpy
• Strong knowledge and hands-on experience of SQL (should be able to write advance level SQL queries)
• Good hands-on experience on data visualization tools such as Power BI, Tableau, Looker
• Good understanding and hands-on experience of Data engineering pipeline management tools such as Airflow
• Good Communication skills.