Data Engineer- ETL/Python

Glan Management Consultancy; Pune District; On-site; INR 700,000 - 1,100,000; Full time

Job summary

A leading consultancy firm is looking for a Data Engineer specializing in ETL and Python. The role involves developing and managing data integration tools and systems, running complex queries, and deploying data models into production. Candidates should have 2-4 years of experience in data engineering, a Bachelor's degree in Computer Science, and a solid understanding of the ETL cycle. Familiarity with cloud platforms like Azure or AWS is also desired.

Qualifications

• 2-4 years of experience in data engineering.
• Excellent understanding of ETL processes.
• Good scripting and programming skills, especially with Python.
• Experience with ETL processes and data integration.
• Knowledge of data warehouses and analytics pipelines.

Responsibilities

• Develop and manage integration tools and databases.
• Run complex queries and automation scripts.
• Deploy data models into production environments.
• Mentor and train colleagues when necessary.

Skills

ETL cycle

Python

Spark

Kafka

Data visualization tools

Education

Bachelor Degree in Computer Science

Tools

Azure Data Factory

AWS Snowflake

PowerBI

Tableau

Spark

Kafka

Flask

Job description

Share Job :# Data Engineer- ETL/Python **Company:** Glan Management Consultancy **Location:** Pune **Experience:** 2-4 year **Salary:** 0 **Employment Type:****Job Description:****Position**: Data Engineer- ETL/Python**Experience**: 2-3 year**Location**: Pune**Salary**: Negotiable**Industry**: IT**Qualification**: Bachelor Degree in Computer Science, Computer Engineering or similar **KeyResponsibilities:**• Development, customize and manage integrationtools, databases, warehouses, and analytical• systems with the use of data relatedinstruments/instances• Create and run complex queries and automationscripts for operational data processing.• Test the reliability and performance of eachpart of a system and cooperate with the testing team• Deploying data models into productionenvironments. This entails providing the model with data• stored in a warehouse or coming directly fromsources, configuring data attributes, managing• computing resources, setting up monitoringtools, etc.• Responsible for setting up tools to view data,generate reports, and create visuals• Monitoring the overall performance andstability of the system. Adjust and adapt the automated• pipeline as data/models/requirements change.• Mentor and train colleagues where necessary byhelping them learn and improve their skills, as• well as innovate and iterate on bestpractices.• Solve complex issues with minimal supervision.• Make improvement and process recommendationsthat have an impact on the business.**TechnologyStack Used & Required Knowledge:**• Excellent understanding of ETL cycle• Experience in using Python/ PySpark and/orScala for data engineering.• Understanding of data types/ handling ofdifferent data models.• Desirable to have experience with Spark,Kafka, Flask• Experience with the Microsoft Azure or AWSdata management tools such as Azure Datafactory,• Datalake, and Databricks, or AWS Snowflake isa plus• Knowledge of data visualization tools is aplus (PowerBI, Tableau).• Good scripting and programming skills. **Mail updated resume with below details-****Current ctc-****Expected ctc-****Notice period-****Current location-****Email- [e-mail]****Satish- 8851O 18162** Website: Google search: GlanManagement consultancy**Key Skill:** data engineer, python, ETL, AWS, Kafka, spark, data analyst**Posted on:**23rd Dec, 2022### Apply for Data Engineer- ETL/Python