Data Engineering & Analytics Lead

Reflections Info Systems Pvt Ltd; Thiruvananthapuram; On-site; INR 2,200,000 - 3,600,000; Full time

Job summary

Reflections Info Systems Pvt Ltd in Thiruvananthapuram is seeking a Data Engineering & Analytics Lead with 10+ years of hands-on experience to design, build, and operationalize scalable data pipelines, data models and analytics solutions using Databricks, SQL, PySpark, Python and Power BI.

You will own end-to-end data platforms, apply Medallion and Lakehouse patterns, and collaborate with stakeholders to deliver reliable reporting and insights.

Qualifications

• Proficient in SQL with advanced data transformation
• Hands-on PySpark, Python and data processing workflows
• Experience with data modeling and analytics platforms

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, and Azure Data Factory.
• Build and optimize enterprise-grade data solutions with Lakehouse architecture and Delta Lake.
• Develop data transformation workflows and implement data quality controls.
• Create and maintain logical and physical data models for reporting and BI.
• Write and optimize complex SQL queries, views, and procedures.
• Implement Medallion Architecture (Bronze/Silver/Gold) for analytics platforms.
• Develop dashboards and analytics with Power BI.
• Collaborate with stakeholders to gather reporting requirements.
• Ensure data governance, metadata management, and cataloguing best practices.
• Apply performance optimization across pipelines and reporting solutions.
• Leverage AI/LLM-enabled tools for data analysis and insights.
• Work with Data Architects, Analysts, and Product Owners.
• Support CI/CD and version control for data solutions.

Skills

SQL

PySpark

Python

Data Modeling

Lakehouse Architecture

Medallion Architecture

AI Analytics

Tools

Databricks

Azure Data Factory

Delta Lake

Power BI

Job description

We are looking for a strong Data Engineering & Analytics professional with 10+ years of experience in building data pipelines, data models and analytics solutions, with hands‑on expertise in Databricks, SQL, PySpark, Python and Power BI.

Work Timing -9:00 am-6:00 pm/ 6:30 PM - 3:30 AM

Responsibilities include:

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, and Azure Data Factory.
• Build and optimize enterprise‑grade data solutions using Databricks Lakehouse architecture and Delta Lake.
• Develop high‑performance data transformation workflows and implement data quality controls.
• Create and maintain logical and physical data models to support reporting, analytics, and business intelligence requirements.
• Write and optimize complex SQL queries, stored procedures, views, and data transformation logic.
• Design and implement Medallion Architecture (Bronze, Silver, Gold layers) for modern analytics platforms.
• Develop interactive dashboards, reports, and analytical solutions using Power BI.
• Collaborate with business stakeholders to understand reporting and analytics requirements.
• Ensure data governance, metadata management, and data cataloging best practices are followed.
• Implement performance optimization strategies across data pipelines, Databricks workloads, and reporting solutions.
• Leverage AI/LLM-enabled tools for data analysis, insight generation, and analytics acceleration.
• Work closely with cross-functional teams including Data Architects, Business Analysts, and Product Owners.
• Support CI/CD and version control practices for data engineering solutions.

Primary Skills :

• SQL (advanced queries, joins, window functions, performance tuning, data transformation)
• PySpark (transformations, joins, aggregations, window functions, deduplication, optimization)
• Python
• Data Modeling & Schema Design
• Data Lake / Lakehouse Architecture / Medallion Architecture
• AI-assisted Data Analysis & Analytics (leveraging AI/LLMs for data analysis, insight generation and analytics development)

Secondary Skills :

• ADLS Gen2
• Data Quality & Validation
• Data Governance / Metadata / Data Cataloguing
• Exposure to Process / Operational Analytics or Process Intelligence is a plus

Role:

Data Engineering & Analytics Lead

Location :

Close Date :

09-10-2026