Data Engineer Opening

Acesoft Labs; Bengaluru; Hybrid; INR 1,500,000 - 2,500,000; Full time

Job summary

Acesoft Labs is hiring a Data Engineer for our Bangalore location. We seek 3-6 years of hands-on experience in Azure, Snowflake, DBT and Hadoop ecosystem to design robust data pipelines.

You will work on data modeling in Snowflake, DBT transformations, and ensure high-performance data processes while collaborating with data scientists and analysts to deliver reliable data assets for analytics and reporting.

Qualifications

• Experience with MS Azure, Snowflake, DBT & Hadoop ecosystem components.
• Understanding of Hadoop Architecture and underlying framework including Storage Management.
• Strong understanding and implementation experience in Hadoop, Spark, Hive/Databricks.
• Experience implementing Data lake solutions using Scala as well as Python.
• Experience with orchestration tool like Azure Data Factory.
• Strong SQL and programming skills.
• Experience with DataBricks is desirable.
• Understanding / Implementation experience Hive role & responsibilities.

Responsibilities

• Design, build and optimize data pipelines using Azure Databricks, Snowflake and DBT.
• Develop and manage data models in Snowflake for efficient access.
• Implement DBT transformations to standardize data for analysis.
• Monitor and optimize pipeline performance; troubleshoot issues.
• Collaborate with data scientists and analysts to provide reliable data.

Skills

MS Azure

Snowflake

DBT

Hadoop ecosystem

Spark

Hive

Databricks

Python

Scala

SQL

Azure Data Factory

Data Lake

Tools

Azure Databricks

Snowflake

DBT

Job description

Hi

We are hiring for Data Engineer, for Bangalore Location. Looking for immediate joiner.

Exp 3-6 years

Key Responsibilities:

• Data Pipeline Development: Design, build, and optimize data pipelines to ingest, transform, and load data from multiple sources, using Azure Databricks, Snowflake, and DBT.
• Data Architecture: Develop and manage data models within Snowflake, ensuring efficient data organization and accessibility.
• Data Transformation: Implement transformations in DBT, standardizing data for analysis and reporting.
• Performance Optimization: Monitor and optimize pipeline performance, troubleshooting and resolving issues as needed.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to support data-driven projects and provide access to reliable, well-structured data.

Qualifications:

• Having relevant Experience in MS Azure, Snowflake, DBT& Big Data Hadoop eco-system components
• Understanding of Hadoop Architecture and underlying framework including Storage Management.
• Strong understand and implementation experience in Hadoop, Spark, Hive/Databricks
• Expertise in implementing Data lake solution using Scala as well as Python.
• Expertise with orchestration tool like Azure Data Factory
• Strong SQL and Programing skills
• Experience with DataBricks is desirable
• Understanding / Implementation experience Hive Role & responsibilities