Big Data Engineer

Tekskills; Bengaluru; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Tekskills is seeking a data engineering professional with 3–7 years of experience to design and implement data solutions on Snowflake in a cloud environment. You will work with Azure data services and distributed computing frameworks like Spark and Hadoop to build robust ELT/ETL pipelines, perform data analysis, and migrate data from on-premise systems.

The role requires strong SQL skills, proficiency in Python or Scala, and the ability to mentor data engineering teams while communicating

Qualifications

• Strong SQL skills and at least one of Scala or Python
• Experience building ELT/ETL pipelines and tuning data pipelines
• Experience migrating data from on-premise to Snowflake
• Mentoring data engineering teams and cross-team collaboration
• Proven experience with Snowflake and cloud data platforms (Azure preferred)
• Understanding of distributed computing frameworks (Spark, Hadoop)
• Data modelling and data integration proficiency
• Excellent stakeholder communication across technical and non-technical teams

Responsibilities

• Analyze existing data storage systems and develop data solutions in Snowflake
• Migrate data from on-premise systems to Snowflake
• Build robust ELT/ETL processes and optimize performance of data pipelines
• Troubleshoot data issues and ensure data quality
• Lead and mentor data engineering teams and collaborate with stakeholders

Skills

Snowflake

Big data

Azure

Spark

SQL

Python/Scala

ETL/ELT

Data modelling

Mentoring

Communication

Troubleshooting

Job description

JD:

• At least 3 to 7 Years of experience on big data platform and at least 2 years of experience in implementing DWH on Snowflake
• Proven experience with cloud platforms preferable Azure particularly on data services
• Good understanding of distributed computing frameworks like Apache Spark, Hadoop etc
• Perform Analysis on existing data storage systems Big Data & development of data solutions in Snowflake
• High Proficiency in SQL and at least one of the following languages Scala / Python &
• Experience in working on migrating data from on-premise databases preferably Big Data platform to Snowflake
• Expertise in building robust ELT/ETL processes , performance tuning of the data pipelines in Snowflake and should be able to trouble shoot the issues quickly
• Strong Knowledge on Integration concepts and design best practices
• Data Modelling & data integration, Advanced SQL skills for analysis, standardizing queries
• Proven experience in managing and mentoring data engineering teams
• Excellent interpersonal skills, with the ability to work across teams and communicate effectively with technical and non-technical stake holders
• Strong analytical and trouble shooting skills with proven ability to find solutions in complex data environments