Data Engineer

Retail Insights; India; On-site; INR 1,200,000 - 2,200,000; Full time

Job summary

Retail Insights seeks a data engineer to design, develop, and maintain scalable data pipelines in Azure, enabling reliable data flows across the organization. The role emphasizes building robust data solutions, collaborating with data scientists and analysts, and ensuring data quality and security.

You will work with SQL, PySpark, Python, and Databricks to ingest and structure data, support data-driven decisions, and contribute to data lakehouse architectures.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field
• 3+ years of experience in data engineering roles
• Expertise in Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, and Databricks
• Strong experience in SQL, PySpark, and Python
• Proficiency in building and managing data pipelines in cloud environments
• Familiarity with Delta Lake, Parquet, and modern data Lakehouse architectures
• Solid understanding of data modeling, data warehousing, and ETL/ELT frameworks
• Experience with version control tools like Git and CI/CD pipelines for data

Responsibilities

• Design, develop, and maintain robust data pipelines using Azure technologies
• Ingest, transform, and structure data from various structured and unstructured sources
• Implement and manage scalable data solutions using Azure Data Lake, Azure Data Factory, Azure Synapse, and Databricks
• Ensure data quality, security, and compliance across all data solutions
• Collaborate with data scientists, analysts, and other stakeholders to enable data-driven decision-making
• Optimize performance of data workloads and troubleshoot bottlenecks
• Participate in code reviews, documentation, and continuous improvement of data engineering best practices

Skills

SQL

PySpark

Python

Data pipelines

Data modeling

ETL/ELT

CI/CD

Cloud data

Education

Bachelor's degree in CS/Engineering

Tools

Azure Data Lake

Azure Data Factory

Azure Synapse Analytics

Databricks

Delta Lake

Parquet

Job description

Retail Insights delivers scalable, innovative, and cost-effective IT solutions through centers in India, Dubai, and the U.S. We specialize in Full Stack Development, Data & AI/ML, Mobile, DevOps, and digital platforms like Adobe, Salesforce, Shopify, Snowflake, and Blue Yonder.

Responsibilities

• Design, develop, and maintain robust data pipelines using Azure technologies
• Ingest, transform, and structure data from various structured and unstructured sources
• Implement and manage scalable data solutions using Azure Data Lake, Azure Data Factory, Azure Synapse, and Databricks
• Ensure data quality, security, and compliance across all data solutions
• Collaborate with data scientists, analysts, and other stakeholders to enable data-driven decision-making
• Optimize performance of data workloads and troubleshoot bottlenecks
• Participate in code reviews, documentation, and continuous improvement of data engineering best practices

Qualifications & Experience

• Bachelor's degree in Computer Science, Engineering, or a related field
• 3+ years of experience in data engineering roles
• Expertise in Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, and Databricks
• Strong experience in SQL, PySpark, and Python
• Proficiency in building and managing data pipelines in cloud environments
• Familiarity with Delta Lake, Parquet, and modern data Lakehouse architectures
• Solid understanding of data modeling, data warehousing, and ETL/ELT frameworks
• Experience with version control tools like Git and CI/CD pipelines for data