Data Engineer - Freelancer

VVV Infotech Pvt. Ltd.; India; Remote; INR 700,000 - 1,200,000; Full time

Job summary

A tech solutions company in India is seeking a skilled Data Engineer to design and maintain scalable data solutions using Microsoft Azure technologies. The ideal candidate will collaborate with business stakeholders and ensure high-quality data pipelines with strong attention to optimizing performance. A Bachelor's degree and experience with Azure environments and large datasets are essential. This role offers an exciting opportunity to work on innovative data solutions.

Qualifications

• Proven experience as a Data Engineer in Azure environments.
• Hands-on experience with large-scale enterprise data solutions.

Responsibilities

• Design, develop, and enhance data engineering solutions based on business requirements.
• Build and maintain automated SQL-based data pipelines.
• Implement and optimize ETL/ELT workflows using Azure services.
• Ensure performance optimization and scalability of data solutions.
• Work with large datasets from SAP and SQL databases.
• Validate and ensure data accuracy, consistency, and reliability.

Skills

PySpark / Python

Advanced SQL

Understanding of Lakehouse architecture

Education

Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field

Job description

We are seeking a skilled and experienced Data Engineer with strong expertise in Microsoft Azure technologies to design, develop, and maintain scalable data solutions. The ideal candidate will work closely with business stakeholders, Data & AI teams, and IT governance teams to deliver high-quality data pipelines and reporting solutions.

This role requires hands‑on experience in handling large datasets, optimizing performance, and working with SAP and SQL‑based data sources.

Key Responsibilities

• Design, develop, and enhance data engineering solutions based on business requirements.
• Build and maintain automated SQL-based data pipelines.
• Implement and optimize ETL/ELT workflows using Azure services.
• Ensure performance optimization and scalability of data solutions.

2. Data Processing & Integration

• Work with large datasets from SAP and SQL databases.
• Implement business rules in collaboration with functional teams.
• Validate and ensure data accuracy, consistency, and reliability.
• Optimize data refresh cycles and query performance.

3. Documentation & Governance

• Prepare and maintain:
  • Data Dictionary
  • Report Logic Documentation
  • User Guides
• Follow data governance standards and IT compliance guidelines.
• Sprint planning, Daily stand‑ups, Coordinate with Business stakeholders, Data & AI teams, IT Governance team, and track tasks, update progress and manage risks/issues effectively.

Technical Skills Required

• PySpark / Python
• Advanced SQL
• Understanding of Lakehouse architecture

Good to Have

• Experience working with SAP data
• Knowledge of Agile methodologies
• Experience with data gateways and enterprise data integration

Experience & Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field.
• Proven experience as a Data Engineer in Azure environments.
• Hands‑on experience with large-scale enterprise data solutions.