Azure Data Engineer - Azure Data Factory - contractor in USD

All European Careers; Chennai District; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

An international recruitment agency is urgently seeking a hybrid Azure Data Engineer in Chennai, Tamil Nadu. The ideal candidate will have over 5 years of software development experience, with strong expertise in managing Azure ADF pipelines and troubleshooting API integrations. Responsibilities include overseeing data ingestion processes and ensuring operational observability using Azure tools. Fluency in English is a must. This role offers a chance to contribute to impactful projects in risk management and analytics.

Qualifications

• +5 years of professional experience in software development.
• Strong experience in Azure ADF and API troubleshooting.

Responsibilities

• Support and enhance Azure ADF pipelines conducting API calls.
• Manage Azure Storage and data movement.
• Maintain and secure secrets using Azure Key Vault.
• Monitor application logs to identify issues.
• Troubleshoot failures with API authentication and data processing.

Skills

Fluent in English

API Integration with OAuth 2.0 authentication

REST/JSON/XML data structures

Log monitoring and operational observability

Strong SQL skills

Managing configuration across multiple environments

Tools

DBeaver

Azure Key Vault

Job description

For an international project in Chennai, we are urgently looking for a hybrid Azure Data Engineer to monitor daily Azure ADF pipeline execution, scheduled jobs, troubleshoot application issues, API failures, data ingestion errors, access problems, and enhance and maintain pipelines. The selected candidate will work on the IFC Risk Management & Analytics portfolio projects.

We are looking for a motivated contractor. Candidates need to be fluent in English.

Tasks and responsibilities

• Supporting and enhancing Azure ADF pipelines that orchestrate API calls and data ingestion;
• Managing Azure Storage containers, folders, data movement, and retention structures.
• Maintaining and rotating secrets, credentials, and integration tokens through Azure Key Vault;
• Monitoring application and ADF pipeline logs, identifying issues, and escalating to vendor as required;
• Troubleshooting failures across API calls, OAuth authentication flows, pipelines, connectivity, and data processing;
• Working with the vendor to debug issues, validate fixes, and coordinate deployments.
• Overseeing environment synchronization (Dev/QA/Prod) including keys, endpoints, config files, and credentials;
• Participating in weekly discussions with business teams and vendors to ensure stable;

Profile

• +5 years of professional experience in software development;

Strong experience in

• API Integration with OAuth 2.0 authentication;
• REST/JSON/XML data structures and API troubleshooting;
• Experience in log monitoring and operational observability using Azure (ADF monitor, Log Analytics, App Insights, etc.);
• Strong SQL skills: familiarity with DBeaver for database querying and debugging is a plus;
• Experience working with SaaS vendors, reviewing tickets, validating defects, and coordinating fixes;
• Ability to manage configuration across multiple environments (keys, URLs, parameters, schema changes, variables);
• Expected to have good understanding of COTS products, cloud-based products and environments, including Microsoft Azure;