Data Engineer

Arrow Electronics India Pvt Ltd; Maan; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Arrow Electronics India Pvt Ltd in Pune seeks a Data Engineer with Azure expertise at Senior Engineer level to design and deliver scalable ETL solutions and enterprise reports.

You will develop and maintain ETL pipelines using Azure Data Factory, Databricks, PySpark, and SQL databases; collaborate with cross-functional teams, and ensure data quality and governance across large data warehouses. This role is full-time in Pune, India.

Qualifications

• 5+ years of experience in data engineering with Azure stack.
• Strong skills in ETL design and large-scale data warehouses.
• Proficient in Power BI reporting and data governance basics.

Responsibilities

• Develop, tune, automate, and maintain ETL pipelines with Azure Data Factory, Databricks, PySpark, and SQL Server.
• Create ETL solutions interfacing source applications with the Enterprise Data Warehouse.
• Document data mappings, dictionaries, and governance-related artifacts.
• Integrate ETL development with existing projects for reusable components.
• Create, execute, and document unit tests for ETL and data integration.
• Collaborate with data team to identify and resolve data quality issues at intake.
• Performance tune ETL processes and queries.
• Develop transformation queries, views, and stored procedures.

Skills

ETL design

Data modeling

Agile methodologies

Communication

Data analysis

Collaborative teamwork

Tools

Azure Data Factory

Azure Databricks

Azure SQL Database

SQL Server Stored Procedures

Power BI

SQL

Job description

Data Engineer with Azure- Senior Engineer (Level 1)

Job Description: JD

Experience

5 Years

Tools

Azure Data Factory, Azure Databricks, Azure SQL Database, SQL, Python (PySpark), Microsoft Power BI

Mandatory Skills

• Should be well-versed in the design and development of ETL solutions using Azure Data Factory, Azure Databricks, Python (PySpark), and SQL for large-scale data warehouses.
• Should be able to work collaboratively with other team members, as well as users for operational support
• Expertise in Azure Data Factory, Azure Databricks, Python (PySpark), Azure SQL Database, SQL Stored Procedure development, and performance tuning.
• Should possess very good communication with strong business and data analysis skills
• Experience in using Agile methodologies
• Experience in developing and working on Power BI reports for enterprise level reports.

Key Responsibilities

• Develop, fine-tune, automate, and maintain ETL pipelines using Azure Data Factory, Azure Databricks, Python (PySpark), Azure SQL Database, and SQL Server Stored Procedures.
• Develop ETL solutions using data integration tools for interfacing between source application and the Enterprise Data Warehouse
• Document ETL data mappings, data dictionaries, processes, programs, and solutions as per established standards for data governance
• Integrate ETL development with existing projects to maximize object reuse
• Create, execute, and document unit test plans for ETL and data integration processes and programs
• Work with the peers in data team to assess and troubleshoot potential data quality issues at key intake points such as validating control totals at intake.
• Troubleshoot data issues and defects to determine root cause
• Performance tuning of the ETL process and SQL queries, and recommend and implement ETL and query tuning techniques
• Develop and create transformation queries, views, and stored procedures for ETL processes, and process automations

Location

IN-MH-Pune, India-Blue Ridge-Hinjewadi (eInfochips)

Time Type

Full time

Job Category

Engineering Services

Experience Level

Senior Level