Azure Data Engineer for Remote Freelance Job in India

Global Business Ser. 4u; Delhi Cantonment; Remote; INR 1,400,000 - 1,800,000; Full time

Job summary

Global Business Ser. 4u is seeking an experienced Data Engineer for a freelancer full-time project focused on India. The role involves designing and maintaining data pipelines using Azure Databricks, Python, Spark, and leveraging Azure Power Apps and Azure Power BI for analytics and visualization.

You will collaborate with cross-functional teams, optimize data workflows, and ensure data quality while staying current with cloud data platforms and best practices in Azure.

Qualifications

• Bachelor's or Master's degree in CS, Data Eng, or related field.
• Proven experience as a Data Engineer on large-scale Azure projects.
• Strong Python programming and Spark distributed processing.
• Solid SQL skills and data modeling/ETL knowledge.
• Experience with Azure cloud services and Power Platform is a plus.

Responsibilities

• Design, develop, and implement data pipelines and ETL processes using Azure Databricks and Spark.
• Collaborate with data scientists and analysts to translate data requirements into scalable solutions.
• Optimize data workflows for performance, scalability, and data quality.
• Integrate data from various sources and formats for ingestion and transformation.
• Develop and maintain data models and data warehouses for reporting and analytics.
• Create dashboards and visuals with Azure Power BI.
• Monitor and troubleshoot data pipelines and resolve issues promptly.
• Stay updated with emerging data engineering technologies and best practices.

Skills

Azure Databricks

Python

Spark

SQL

Data modeling

ETL principles

Cloud platforms

Data pipelines

Data engineering concepts

Azure

Education

Bachelor's or Master's degree in CS/Data Eng

Tools

Azure Databricks

Azure Power Apps

Azure Power BI

Spark

Job description

Azure Data Engineer for a freelancer full time project to work India

Location: India - Remote

Duration: 6+ Months

Job Title: Data Engineer

Job Description: We are seeking an experienced Data Engineer with expertise in Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure and processing pipelines. You will work closely with cross-functional teams to ensure efficient data workflows, optimize data processing, and enable data-driven decision-making throughout the organization.

Responsibilities

• Design, develop, and implement data pipelines and ETL processes using Azure Databricks and Spark.
• Collaborate with data scientists and analysts to understand data requirements and translate them into scalable data solutions.
• Optimize data workflows for performance, scalability, and reliability, ensuring data quality and integrity.
• Integrate data from various sources and formats, ensuring seamless data ingestion and transformation.
• Develop and maintain data models and data warehouses to support business reporting and analytics needs.
• Collaborate with software developers to build data-driven applications using Azure Power Apps.
• Work with Azure Power BI to create interactive dashboards, reports, and visualizations to communicate data insights effectively.
• Monitor and troubleshoot data pipelines, addressing any data processing or integration issues promptly.
• Stay updated with emerging technologies, tools, and best practices in the data engineering and analytics space, and propose innovative solutions to enhance data processing capabilities.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• Proven experience as a Data Engineer, working on large-scale data projects using Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI.
• Strong programming skills in Python and proficiency in working with Spark for distributed data processing.
• In-depth knowledge of data engineering concepts, data modeling, and ETL principles.
• Experience with cloud-based data platforms and services, particularly Microsoft Azure.
• Familiarity with Azure Power Apps for building custom applications and Azure Power BI for data visualization.
• Strong SQL skills for data manipulation and querying.
• Ability to work in a collaborative and cross-functional environment, effectively communicating complex technical concepts to both technical and non-technical stakeholders.
• Strong problem-solving and analytical skills, with a focus on delivering high-quality data solutions.

If you are a passionate Data Engineer with expertise in Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI, and you thrive in a fast-paced, data-centric environment, we would love to hear from you.