Azure Data Engineer - SQL / Python

Forward Eye Technologies; Pune District; On-site; INR 600,000 - 1,200,000; Full time

Benefits offered by this job

Azure Certification prep

Databricks access

Fabric tools

Job summary

Forward Eye Technologies in India seeks a data engineer to design, develop, and optimize ETL pipelines using Azure data services. You will collaborate with data scientists and engineers to meet data requirements and ensure production-ready code.

Responsibilities include data cleansing, mapping, transformation, deployment with CI/CD, and loading data into data warehouses and real-time analytics systems. Experience with Py-Spark, Spark-SQL, Python, SQL, and Git is valued.

Qualifications

• 2-3 years of experience in Azure Data Analytics, Synapse, DevOps.

Responsibilities

• Design, develop, and implement ETL pipelines for deployment and integration.
• ],
• CoT_job_summary_short
• job_summary_short
• contract_type
• location_type
• remote_scope
• perks
• stated_min
• stated_max
• stated_absolute
• salary_estimation_cot
• estimated_low
• estimated_medium
• estimated_high
• currency
• frequency
• bonus
• tax
• application_email
• job_end_date
• contact_person
• hiring_department_name

Skills

Azure Data Analytics

Synapse

DevOps

Python

SQL

Py-Spark

Spark-SQL

CI/CD pipelines

Git

Monitoring tools

Cross-functional collaboration

Tools

Azure Synapse

Azure ADLS

Azure Stream Analytics

SQL Data Warehouse

Analysis Services

Serverless Architecture

ARM Templates

Databricks

Fabric

Job description

Main Roles and Responsibilities :

• Design, develop, and implement ETL pipelines for the continuous deployment and integration.
• Collaborate with other data engineers and data scientists to understand data requirements and optimize data solution processes.
• Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements
• The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
• Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
• Build data pipelines to collectively bring data together
• Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse
• Implement best practices for pipeline building and governance.
• Troubleshoot and resolve issues related to pipeline deployment and performance.
• Ensure compliance with security and data privacy standards
• Solution design using Microsoft Azure services and other tools

Required skills and experience :

• 2-3 years of experience in Azure Data Analytics, Synapse, DevOps.
• Proficiency in programming languages such as Python, SQL, Py-Spark, Spark-SQL.
• Experience with Azure: ADLS, Synapse, Stream Analytics, SQL DW, Analysis Services, Serverless Architecture, ARM Templates
• Experience with cloud platforms like Azure, AWS or and their respective services.
• Knowledge of CI/CD pipelines, automation tools and version control systems like Git.
• Strong problem-solving skills and ability to troubleshoot complex issues.
• Experience with monitoring tools.
• Ability to work collaboratively in cross-functional teams.

Nice to have:

• Should have Data Engineer certification from any discipline - Azure, AWS.
• Azure Synapse Studio, Data bricks, Fabric
• Familiarity with agile software development lifecycle (SCRUM, Kanban, etc.)

Location - Hyderabad,Ahmedabad,pune,chennai,kolkata.