Data Engineer, Azure Experience

Jobtailor; Karachi Division; On-site; PKR 1,800,000 - 3,000,000; Full time

Job summary

Jobtailor is seeking a Data Engineer to evaluate and migrate SSIS packages to Azure Data Factory. The role focuses on designing modular pipelines, creating reusable components, and implementing robust CI/CD for ADF in a data engineering context.

You will categorize existing pipelines, estimate effort, and guide migration strategies, ensuring best practices and scalable solutions for data ingestion, transformation, and validation.

Qualifications

• Bachelor's degree in a technical field.
• At least 2 years of experience in Data Engineering.
• Strong hands-on experience with Azure Data Factory.
• Design pipelines, parameterized templates, and reusable datasets.
• CI/CD for ADF using ARM, Bicep, Terraform, Azure DevOps, or GitHub.
• Migration of pipelines to ADF.

Responsibilities

• Review ~115 existing SSIS packages and categorize complexity.
• Design Azure Data Factory equivalents.
• Consolidate pipelines into reusable components.
• Build and deploy pipelines in phased batches.
• Provide testing support and handover.
• Advise on ADF architecture and best practices.
• Provide rough effort estimates and resource planning.
• Assess existing pipelines and propose migration approaches.

Skills

Azure Data Factory

SQL Server Integration Services

Data Migration

ETL/ELT Design Patterns

CI/CD for ADF

Azure DevOps

Azure Storage

Education

Bachelor's degree in Computer Science, IT, Data Science, Software Engineering, or related field

Tools

ARM

Bicep

Terraform

Azure DevOps

GitHub

Azure Virtual Machines

Blob Storage

Job description

• Review approximately 115 existing SSIS packages
• Categorize packages as simple, medium, or complex
• Design Azure Data Factory equivalents
• Consolidate similar jobs into reusable pipelines where feasible
• Build and deploy pipelines in phased batches
• Provide testing support and handover
• Advise on ADF architecture and best practices
• Provide rough effort estimates and resource planning
• Assess existing pipelines and produce migration approaches
• Make lift-and-shift versus refactor decisions
• Design modular, reusable ADF components
• Support unit testing and data validation
• Prepare documentation and knowledge transfer
• Provide best-practice guidance and mentoring

Requirements

• Bachelor's degree in Computer Science, IT, Data Science, Software Engineering, or a related technical field
• At least 2 years of experience in the Data Engineering field
• Strong hands-on experience with Azure Data Factory
• Experience designing pipelines, parameterized templates, reusable datasets, linked services, triggers and scheduling
• Experience with monitoring, logging, and error handling in ADF
• Experience with CI/CD for ADF using ARM, Bicep, Terraform, Azure DevOps, or GitHub
• Deep experience with SQL Server Integration Services
• Proven experience migrating pipelines to ADF
• Knowledge of ETL/ELT design patterns
• Experience with data transformation and ingestion from Excel, CSV, and flat files
• Experience working with Azure Virtual Machines
• Experience with Azure Storage accounts, Blob Storage, or ADLS
• Experience assessing existing pipelines and producing migration approaches
• Experience making lift-and-shift versus refactor decisions
• Experience consolidating similar jobs into parameterized pipelines
• Experience with batch delivery and phased releases
• Experience with unit testing and data validation
• Experience with documentation and knowledge transfer
• Experience providing best-practice guidance and mentoring
• Availability for 8:00 AM–5:00 PM UK time

Core Competencies

Demonstrates expertise in Azure Data Factory, including pipeline design, parameterized templates, and reusable components. Proficient in SQL Server Integration Services and experienced in data migration, transformation, and best practices in data engineering.

Highest-signal resume keywords

• Azure Data Factory
• SQL Server Integration Services
• Data Migration
• CI/CD for ADF
• ETL/ELT Design Patterns

ATS Optimization Keywords

Hard Skills

• Pipeline Design
• Parameterized Templates
• Reusable Datasets
• Triggers and Scheduling
• Monitoring and Logging
• Error Handling
• Data Transformation
• Data Ingestion
• Unit Testing
• Data Validation

Soft Skills

• Best-Practice Guidance
• Mentoring

Industry Keywords

• Data Engineering
• Migration Approaches
• Lift-and-Shift Decisions
• Phased Releases
• Documentation
• Knowledge Transfer

Tools & Technologies

• Azure DevOps
• GitHub
• ARM
• Bicep
• Terraform
• Azure Virtual Machines
• Azure Storage Accounts
• Blob Storage
• ADLS