Azure Data Factory Engineer

JR United Kingdom; Warwick; On-site; GBP 45,000 - 65,000; Full time

Job summary

A leading company in engineering seeks an Azure Data Factory Engineer in Warwick to design and manage data pipelines. The role involves data transformation, integration, and operational support, requiring expertise in Azure and SAP technologies. Join a global team dedicated to innovation and excellence in product development.

Qualifications

• Experience with Azure Data Factory connectors, especially SAP-specific ones.
• Strong understanding of data integration and cloud solutions.
• Proficiency in WEB API, C#, ADO.NET, .NET Core, ASP.NET, SQL.

Responsibilities

• Creating and managing data pipelines using Azure Data Factory.
• Converting raw data into structured datasets and validating data transformations.
• Collaborating with teams to ensure system reliability and availability.

Skills

Data Integration

ETL Processes

Data Validation

Troubleshooting

Cloud Solutions

Azure Functions

Security Best Practices

Tools

Azure Data Factory

Docker

Kubernetes

Azure DevOps

Git

Job description

Social network you want to login/join with:

About Tata Technologies

At Tata Technologies, we make product development dreams a reality by designing, engineering, and validating the products of tomorrow for the world’s leading manufacturers.

Job Opportunity: Azure Data Factory Engineer

Due to our continued growth, we are recruiting an Azure Data Factory Engineer to be based at our site in Warwick.

Key Accountabilities

1. Pipeline Design and Management: Creating, scheduling, and managing data pipelines using Azure Data Factory.
2. Data Transformation: Converting raw data into structured datasets using data flows.
3. Use of Azure Data Factory Activities: Utilizing activities like Stored procedures, IfElse, etc.
4. Operational Support: Ensuring smooth operation of data pipelines and resolving issues.
5. Data Integration: Working with APIs, connectors, and integration runtimes for seamless data flow.
6. Data Validation: Performing checks and validating data transformations for accuracy.
7. Documentation: Recording pipeline designs and operations for future reference.
8. Collaboration: Working closely with development and operations teams to troubleshoot and ensure system reliability and availability.

Knowledge and Experience

• Experience with Azure Data Factory connectors, especially SAP-specific ones like SAP S/4HANA.
• Understanding of SAP data structures and integration methods.
• Proficiency with Azure Data Factory's Mapping Data Flow for SAP data transformation and processing.
• Strong understanding of data integration, ETL processes, and cloud-based data solutions.
• Ability to troubleshoot and optimize data pipelines for performance and reliability.
• Solid understanding of Azure cloud platform and containerization tools like Docker or Kubernetes.
• Knowledge of Azure Functions and Azure Logic Apps.
• Experience with monitoring tools like Azure Monitor.
• Proficiency in WEB API, C# code, ADO.NET, .NET Core, ASP.NET, SQL.
• Experience with version control systems such as Git.
• Familiarity with security best practices for cloud infrastructure and DevOps pipelines.
• Understanding of CI/CD tools and processes.
• Experience with Azure DevOps and Agile methodologies.

If you are passionate about innovation and want to join a global company, this is the place for you.

Tata Technologies: Engineering a better world.

We thank all applicants for their interest. Only candidates under consideration will be contacted. If you do not hear from us within 10 working days after the closing date, it means your application was not successful. We will retain your details for future opportunities.