Data Engineer

Photon; Bengaluru; On-site; INR 1,100,000 - 1,600,000; Full time

Job summary

Photon is seeking a Data Analyst with hands-on Databricks experience to analyse large datasets, build analytical models, create dashboards, and generate actionable business insights. The role requires strong SQL skills, cloud platform experience, and collaboration with stakeholders to translate data into recommendations.

Responsibilities include building data pipelines, developing KPIs, and delivering scalable reports using Power BI, Tableau, or Looker.

Qualifications

• 4+ years of experience as a Data Analyst.
• Hands-on Databricks experience and SQL proficiency.
• Experience with PySpark and Spark SQL.
• Knowledge of cloud platforms (Azure/AWS/GCP) and BI tools (Power BI/Tableau/Looker).

Responsibilities

• Analyse structured and semi-structured data to identify trends, patterns, and business opportunities.
• Work with Databricks to process, transform, and analyse large-scale datasets.
• Write complex SQL queries for data extraction, validation, and reporting.
• Build and optimise data pipelines using Databricks notebooks and workflows.
• Create dashboards and reports using Power BI, Tableau, or similar BI tools.
• Perform data quality checks, cleansing, and validation.
• Collaborate with Data Engineers, Data Scientists, and business teams to understand reporting requirements.
• Develop KPIs, metrics, and ad hoc reports to support business decisions.
• Optimise query performance and improve reporting efficiency.
• Document data definitions, business rules, and analytical processes.

Skills

Databricks

SQL

PySpark

Spark SQL

Data warehousing concepts

ETL processes

Python

Tools

Databricks

Power BI

Tableau

Looker

Azure

AWS

GCP

Azure Data Factory (ADF)

Job description

We are looking for a skilled Data Analyst with hands-on experience in Databricks to analyse large datasets, build analytical models, create dashboards, and generate actionable business insights. The ideal candidate should have strong SQL skills, experience working with cloud-based data platforms, and the ability to collaborate with business stakeholders to translate data into meaningful recommendations.

Key Responsibilities

• Analyse structured and semi-structured data to identify trends, patterns, and business opportunities.
• Work with Databricks to process, transform, and analyse large-scale datasets.
• Write complex SQL queries for data extraction, validation, and reporting.
• Build and optimise data pipelines using Databricks notebooks and workflows.
• Create dashboards and reports using Power BI, Tableau, or similar BI tools.
• Perform data quality checks, cleansing, and validation.
• Collaborate with Data Engineers, Data Scientists, and business teams to understand reporting requirements.
• Develop KPIs, metrics, and ad hoc reports to support business decisions.
• Optimise query performance and improve reporting efficiency.
• Document data definitions, business rules, and analytical processes.

Required Skills

• 4+ years of experience as a Data Analyst.
• Strong hands-on experience with Databricks.
• Hands on SQL skills.
• Experience with PySpark and Spark SQL.
• Good understanding of data warehousing concepts.
• Experience with ETL processes and data transformation.
• Knowledge of cloud platforms such as Azure, AWS, or GCP.
• Experience with BI tools such as Power BI, Tableau, or Looker.
• Strong analytical, problem-solving, and communication skills.

Preferred Skills

• Experience with Azure Data Factory (ADF) or similar ETL tools.
• Knowledge of Delta Lake architecture.
• Understanding of data governance and data quality frameworks.
• Experience with Python for data analysis and automation.
• Exposure to machine learning or predictive analytics is an added advantage.