Azure Data Engineer - Azure Data Platform

Persistent Systems Limited; Pune District; Hybrid; INR 2,200,000 - 3,800,000; Full time

Benefits offered by this job

Flexible work hours

Company-sponsored higher education and

Long Service awards

Job summary

Persistent Systems Limited is seeking an experienced Azure Data Engineer to design and optimize enterprise data pipelines. The role focuses on building scalable data workflows using Azure Data Factory, ingesting data from MySQL and Oracle into ADLS Gen2, and enabling Power BI analytics across the organization.

You will collaborate with analytics teams, ensure data quality and security, and support deployment and production operations for high-performing data platforms.

Qualifications

• 6–12 years of experience in Data Engineering and data integration.
• Hands-on expertise in Azure Data Factory with pipeline orchestration and triggers.
• Experience loading data into ADLS Gen2 from MySQL and Oracle.
• Strong SQL, data modeling, and performance tuning skills.
• Experience supporting Power BI reporting and enterprise dashboards.
• Knowledge of data quality, governance, and security practices.

Responsibilities

• Design, develop, and optimize scalable Azure-based data pipelines.
• Build ADF workflows with Lookup, Copy, Triggers, and Scheduling.
• Ingest data from MySQL and Oracle into ADLS Gen2 and store as Parquet.
• Collaborate with business and analytics teams to support BI dashboards.
• Monitor production pipelines and troubleshoot data issues promptly.
• Ensure data quality, governance, and security in all pipelines.
• Participate in deployment, release management, and operational support.
• Work with architects and stakeholders to deliver scalable data solutions.

Skills

SQL

Data Modeling

Data Integration

Tools

Azure Data Factory

ADLS Gen2

Power BI

MySQL

Oracle

Parquet

Job description

Job Description

About Persistent

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 20 Fortune 50 companies and 4 of the 5 top banks in both the US and India, and numerous innovators across the healthcare ecosystem.

We are seeking an experienced Azure Data Engineer with strong expertise in Azure Data Factory, SQL, MySQL, Oracle, ADLS Gen2, and Power BI. The ideal candidate will be responsible for designing, developing, and supporting enterprise-scale data pipelines and cloud-based data integration solutions. You will play a critical role in enabling analytics, reporting, and business intelligence initiatives through scalable, secure, and high-performance data platforms.

• Location: All Persistent Locations
• Experience: 6 to 12 Years
• Job Type: Full Time Employment

What You’ll Do:

• Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF).
• Build and manage ADF workflows including Lookup Activities, Copy Activities, Triggers, and Scheduling.
• Develop robust data ingestion frameworks to extract and load data from MySQL and Oracle databases into ADLS Gen2.
• Process and store large-scale datasets in Parquet format to support analytics and reporting workloads.
• Collaborate with business users, analytics teams, and reporting teams to support Power BI dashboards and enterprise reporting requirements.
• Monitor, troubleshoot, and optimize production data pipelines to ensure reliability, scalability, and performance.
• Develop and implement data integration, transformation, validation, and reconciliation processes.
• Ensure adherence to data quality, governance, security, and compliance standards.
• Perform root cause analysis and resolve production issues impacting data availability and reporting.
• Work closely with architects, stakeholders, and engineering teams to deliver scalable Azure-based data solutions.
• Support platform enhancements, automation initiatives, and continuous improvement efforts.
• Participate in deployment, release management, and operational support activities.

Expertise You’ll Bring:

• 6-12 years of experience in Data Engineering and Data Integration projects.
• Strong hands-on expertise in Azure Data Factory including Lookup Activities, Copy Activities, Triggers, Pipeline Scheduling, and Workflow Orchestration.
• Experience ingesting data from MySQL and Oracle databases into Azure Data Lake Storage Gen2 (ADLS Gen2).
• Strong knowledge of Parquet file formats and cloud-based data storage solutions.
• Advanced SQL expertise including query development, optimization, troubleshooting, and performance tuning.
• Strong understanding of data modeling, data integration patterns, and enterprise data architecture principles.
• Experience supporting Power BI reporting, dashboards, and business intelligence solutions.
• Proven experience building, monitoring, and optimizing production-grade data pipelines.
• Knowledge of data quality frameworks, governance standards, and data security practices.
• Strong troubleshooting, analytical, and problem-solving capabilities.
• Experience working within global support and enterprise production environments.
• Ability to work independently while collaborating effectively with cross-functional teams.
• Excellent communication and stakeholder management skills.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."