The Senior Data Engineer / Data Analyst is responsible for designing, implementing, and managing data migration initiatives while ensuring data integrity, traceability, governance, and compliance through robust audit trail mechanisms.
The role acts as a bridge between business stakeholders and technical teams, translating business requirements into scalable data solutions and ensuring successful delivery of data transformation and migration projects.
This role is suitable for a Senior Data Engineer / Data Analyst that combines data migration expertise, audit trail governance, and strong stakeholder engagement capabilities across both business and technical audiences.
Key Responsibilities
Data Migration
Planning and Analysis
- Assess source and target systems to determine migration scope, complexity, and dependencies.
- Conduct data profiling, reconciliation, and quality assessments.
- Define migration strategies, mappings, transformation rules, and validation criteria.
- Prepare migration runbooks and rollback plans.
Migration Delivery
- Design, develop, and execute ETL/ELT processes.
- Perform full, incremental, and delta data migrations.
- Manage cutover activities and post-migration support.
- Ensure data consistency between legacy and target platforms.
Data Validation and Reconciliation
- Validate record counts, balances, transactions, and business rules.
- Investigate and resolve migration discrepancies.
Audit Trails and Data Governance
Audit Framework Design
- Design and implement data lineage and audit tracking mechanisms.
- Ensure traceability from source systems through transformation layers to reporting outputs.
- Maintain detailed audit logs for data movement and changes.
Compliance and Governance
- Support regulatory and governance requirements.
- Implement controls for:
- Data access management
- Data privacy and security
Monitoring & Reporting
- Track migration status, exceptions, and remediation activities.
- Support internal and external audit processes.
Business and Stakeholder Engagement
Requirements Gathering
- Facilitate workshops with business and technical stakeholders.
- Elicit and document:
- Business requirements
- Functional requirements
- Non-functional requirements
- Data requirements
- Reporting requirements
Stakeholder Management
- Act as the primary liaison between business users, project teams, and technology teams.
- Present technical concepts in business-friendly language.
- Manage stakeholder expectations throughout project delivery.
Documentation
- Produce and maintain:
- Business Requirement Documents (BRDs)
- Functional Specifications
- Data Mapping Documents
- Technical Design Documents
- Migration Runbooks
Technical Responsibilities
Data Integration
- Design and implement ETL/ELT pipelines.
- Build scalable and reusable data integration solutions.
- Integrate data from cloud, on-premises, and third-party systems.
- Create conceptual, logical, and physical data models.
- Design data warehouses, data marts, and reporting structures.
- Implement dimensional and relational modelling techniques.
Database Development
- Develop and optimize SQL queries and stored procedures.
- Perform performance tuning and query optimization.
- Maintain database integrity and availability.
Required Technical Skills
Databases
- Microsoft SQL Server
- Oracle
Programming and Scripting
- SQL (Advanced)
- Python
- PowerShell
- Shell Scripting
ETL / Integration Tools
- SSIS
- Informatica
- Talend
- Databricks
Cloud Platforms (advantageous)
Reporting and Analytics (advantageous)
- Tableau
- Excel Advanced Analytics
Data Governance
- Metadata Management
- Data Quality Frameworks
- Master Data Management (MDM)
- Audit Controls
Required Business Analysis Skills
- Requirements elicitation and analysis
- Process mapping
- Gap analysis
- Data mapping and transformation analysis
- User story development
- Workshop facilitation
- Business process improvement
- Stakeholder engagement and management
- Change impact assessment
Experience Requirements
- 5+ years in Data Engineering or Data Analytics roles.
- 3+ years delivering data migration projects.
- Experience with large-scale enterprise data migration initiatives.
- Proven experience implementing audit and data lineage solutions.
- Experience engaging both technical teams and business stakeholders.
- Experience documenting business and technical requirements.
Preferred
- Regulatory reporting and compliance exposure.
The successful candidate should be able to produce:
- Data Mapping Specifications
- Source-to-Target Mapping Documents
- Data Quality Assessment Reports
- Audit Trail Frameworks
- Data Validation Reports
- Business Requirements Documents (BRDs)
- Functional Specifications
- Technical Design Documents
- Migration Cutover Plans
- Data Analysis
- Data Governance
- ETL Development
- Cloud Data Platforms (Advantageous)
- Data Quality Management
- Problem-solving mindset
- Analytical thinking
- Influencing and negotiation skills
- Project delivery focus
- Ability to work across technical and business domains
Success Measures
The role will be measured on:
- Data migration accuracy (>99.5%)
- Compliance with governance standards
- Accuracy of data reconciliation and validation results
Skills
Python AWS SQL Tableau SSIS Azure Data Factory Oracle Data Architecture Powershell Data Analysis Microsoft SQL Server Stakeholder Management BRD Analytical Thinking Workshop Facilitation Attention to detail Metadata Management Data Governance Data Quality Management Microsoft Azure Functional Specifications gap analysis master data management shell scripting google cloud platform process mapping business requirements documents informatica talend business process improvement Strong communication skills Databricks MDM Requirements Elicitation and Analysis Data Engineering Cloud Data Platforms ETL Development ADF Stakeholder Engagement and Management data quality frameworks Data Lineage Data Migration Strategy Problem-solving mindset User Story Development Change Impact Assessment Audit Controls Excel Advanced Analytics Data Mapping and Transformation Analysis Influencing and Negotiation Skills Project Delivery Focus Data Mapping Specifications Ability to work across technical and business domains Source-to-Target Mapping Documents Data Quality Assessment Reports Audit Trail Frameworks Data Validation Reports Technical Design Documents Data Lineage Diagrams Migration Cutover Plans Reconciliation Reports