Data Engineer

Intellics Global Services; Hyderabad, Pune District, Chennai District; On-site; INR 600,000 - 900,000; Full time

Job summary

Intellics Global Services is seeking a Senior Data Analyst to lead end-to-end analysis of large-scale multisource datasets, leveraging Big Data technologies to drive strategic insights.

You will design and optimize analytical queries with Starburst Trino/Presto, build analytics workflows in Databricks using SQL, PySpark and Python, and collaborate with Data Engineering and Platform teams to improve data models and governance.

Qualifications

• 10+ years of experience as a Data Analyst in large-scale enterprise data environments
• Hands-on with Hadoop, Hive and Spark ecosystems
• Proven experience using Starburst Trino/Presto for complex queries
• Extensive experience with Databricks SQL, Spark notebooks
• Strong SQL with performance tuning and complex joins
• Proficient in Python / PySpark for data transformation
• Experience with Cloud platforms (AWS/Azure/GCP) and BI tools
• Knowledge of data governance and analytics architecture

Responsibilities

• Lead end-to-end analysis of large-scale multisource datasets using Big Data technologies
• Design, develop and optimize complex analytical queries for fast federated access
• Build, manage and optimize analytics workflows in Databricks for scalable processing
• Partner with Data Engineering, Architecture and Platform teams to optimize data models
• Translate business problems into analytical approaches and communicate findings to leadership
• Define and enforce data quality validation, reconciliation and governance practices
• Mentor junior and midlevel analysts with technical guidance
• Support executive dashboards and ad-hoc analysis as required
• Contribute to continuous improvement of analytics processes and frameworks

Skills

SQL

Python

PySpark

Big Data

Data analysis

Stakeholder communication

Mentoring

Agile DevOps

Cloud (AWS/Azure/GCP)

Tools

Starburst Trino/Presto

Databricks

Power BI

Tableau

Hadoop

Hive

Spark

Job description

Lead endtoend analysis of largescale multisource datasets using Big Data technologies driving insights for strategic and operational decisionmaking

Design develop and optimize complex analytical queries using Starburst TrinoPresto to enable fast federated access across enterprise data sources

Build manage and optimize analytics workflows in Databricks using SQL PySpark and Python for scalable data processing

Partner closely with Data Engineering Architecture and Platform teams to influence data models analytics architecture and performance optimization

Translate ambiguous business problems into structured analytical approaches and clearly communicate findings trends and recommendations to senior stakeholders

Define and enforce best practices for data quality validation reconciliation and governance within analytics solutions

Mentor junior and midlevel analysts providing technical guidance code reviews and analytical best practices

Support executive reporting dashboards and advanced adhoc analysis as required

Contribute to continuous improvement of analytics processes standards and reusable frameworks710 years of experience as a Data Analyst Senior Data Analyst working in largescale enterprise data environments

Strong handson experience with Big Data ecosystems Hadoop Hive Spark distributed data platforms

Proven experience using Starburst TrinoPresto for complex highperformance analytical queries

Extensive experience with Databricks including Databricks SQL Sparkbased analytics and notebook development

Expertlevel SQL skills query optimization performance tuning complex joins

Strong proficiency in Python andor PySpark for data analysis and transformation

Solid understanding of data warehousing data modeling and analytics architecture concepts

Excellent analytical problemsolving and stakeholder communication skillsExperience working on cloud platforms such as AWS Azure or GCP

Exposure to BI and visualization tools Power BI Tableau or equivalent

Knowledge of enterprise data governance metadata management and data quality frameworks

Experience working in Agile DevOps delivery modelsStrong ownership and ability to lead quality outcomes endtoend

Clear communication and stakeholder management

Mentoring mindset and collaboration across QA Dev and DevOps teams

Skills

Mandatory Skills :