Big Data Engineer

Tekskills; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tekskills is seeking a senior data engineer to join our data platform team in Chennai. The candidate should have 3-7 years on big data platforms and at least 2 years of experience implementing DWH on Snowflake, with strong SQL and programming skills.

Expertise in Azure data services, Apache Spark and Hadoop, and hands-on experience migrating data from on-premise systems to Snowflake are essential. You will design robust ELT/ETL pipelines, optimize performance, and mentor data engineering

Qualifications

• 3–7 years on big data platforms and 2+ years implementing DWH on Snowflake.
• Experience with Azure cloud data services.
• Strong SQL proficiency; knowledge of Scala or Python.
• Proven ability to design ELT/ETL processes and tune data pipelines in Snowflake.
• Experience in data integration, data modelling, and mentoring teams.

Responsibilities

• Analyze and architect data solutions in Snowflake.
• Migrate data from on-premise systems to Snowflake.
• Develop and optimize ELT/ETL pipelines.
• Collaborate with teams and stakeholders.
• Provide guidance to the data engineering team.

Skills

Big data platform experience

Snowflake

Azure data services

Apache Spark

Hadoop

SQL

Scala

Python

ELT/ETL development

Data modeling

Mentoring data engineering teams

Job description

JD:

• At least 3 to 7 Years of experience on big data platform and at least 2 years of experience in implementing DWH on Snowflake
• Proven experience with cloud platforms preferable Azure particularly on data services
• Good understanding of distributed computing frameworks like Apache Spark, Hadoop etc
• Perform Analysis on existing data storage systems Big Data & development of data solutions in Snowflake
• High Proficiency in SQL and at least one of the following languages Scala / Python &
• Experience in working on migrating data from on-premise databases preferably Big Data platform to Snowflake
• Expertise in building robust ELT/ETL processes , performance tuning of the data pipelines in Snowflake and should be able to trouble shoot the issues quickly
• Strong Knowledge on Integration concepts and design best practices
• Data Modelling & data integration, Advanced SQL skills for analysis, standardizing queries
• Proven experience in managing and mentoring data engineering teams
• Excellent interpersonal skills, with the ability to work across teams and communicate effectively with technical and non-technical stake holders
• Strong analytical and trouble shooting skills with proven ability to find solutions in complex data environments