Senior Data Integration Engineer

iDbase Software; Johannesburg; On-site; ZAR 600,000 - 800,000; Full time

Job summary

iDbase Software is looking for a highly specialized Senior Data Integration Engineer in Johannesburg to design and maintain robust integrations within a complex enterprise ecosystem. Responsibilities include implementing integration patterns, building ETL pipelines, and ensuring data integrity and security.

The candidate should have 6+ years of experience, deep skills in Qlik Talend, and strong SQL capabilities. This position is a full-time opportunity located in South Africa.

Qualifications

• 6+ years of professional experience in data integration, ETL development.
• Deep expertise with Qlik Talend for complex workflows.
• Strong SQL skills for data mapping and validation.

Responsibilities

• Design and implement enterprise integration patterns.
• Build high-throughput ETL/ELT pipelines.
• Ensure data integrity and high availability of integration services.

Skills

Qlik Talend

SQL

Denodo

API design

Data Integration

Education

Bachelor's degree in Computer Science or related field

Tools

Qlik Replicate

AWS Glue

Azure Data Factory

Job description

About the Role

We are seeking a highly specialized Senior Data Integration Engineer to design, build, and maintain robust, scalable integrations across a complex enterprise ecosystem. This role focuses on enabling seamless system-to-system data flows, ensuring high availability, and providing real-time access to data across legacy, cloud, and SaaS platforms.

You will act as a subject matter expert in enterprise data movement and virtualization, bridging the gap between disparate technologies while ensuring integration reliability, governance, and performance at scale.

Key Responsibilities

1. Integration Architecture & Design
   • Design and implement complex enterprise integration patterns, including API-led connectivity, event-driven architectures, and batch ETL
   • Architect scalable, secure, and resilient system-to-system data flows across heterogeneous environments
   • Develop reusable integration frameworks and enforce enterprise integration standards
   • Collaborate with enterprise architects and business stakeholders to align integrations with strategic objectives
2. Pipeline Development & Real-Time Data Movement
   • Build and maintain high-throughput ETL/ELT pipelines using Qlik Talend (Cloud or On-Premise)
   • Implement and optimize log-based Change Data Capture (CDC) and low-latency replication using Qlik Replicate
   • Support zero-downtime migrations and real-time streaming integrations
   • Perform complex data mapping, transformation, validation, and reconciliation across source and target systems
   • Optimize performance and ensure scalability of integration pipelines
3. Data Virtualization & System Connectivity
   • Leverage Denodo (or similar platforms) to create enterprise data virtualization layers for real-time data access without physical movement
   • Design and implement semantic layers and virtual data services
   • Integrate diverse platforms including on-premise databases, legacy mainframes, cloud data warehouses, and SaaS applications (e.g., Salesforce, Workday, SAP)
   • Design and consume REST and SOAP APIs and manage integrations across multiple protocols (SFTP, JDBC, messaging queues)
4. Reliability, Governance & Leadership
   • Implement robust error handling, monitoring, logging, and alerting mechanisms
   • Ensure data integrity, security, and high availability of integration services
   • Enforce governance standards including data lineage, metadata management, and compliance controls
   • Provide technical leadership, define coding standards, and promote best practices in integration design
   • Mentor junior engineers and support continuous improvement within integration teams

Requirements & Qualifications

Must-Have Skills & Experience:
• 6+ years of professional experience in data integration, ETL development, middleware administration, or enterprise application integration
• Deep, hands-on expertise with Qlik Talend (Cloud or On-Premise) for designing complex workflows and transformations
• Proven experience configuring and tuning Qlik Replicate for log-based CDC and real-time replication across heterogeneous systems
• Strong experience with Denodo (or similar enterprise data virtualization platforms)
• Expert-level SQL skills with advanced data mapping, transformation, and validation capabilities
• Strong understanding of enterprise integration patterns including batch processing, messaging, and API-led connectivity
• Experience ensuring high availability, monitoring, and operational stability of integration services

Highly Desirable Skills:
• Experience with cloud integration services such as AWS Glue, Azure Data Factory, or Google Cloud Dataflow
• Experience designing RESTful APIs and working with API gateways (Apigee, MuleSoft, Kong)
• Familiarity with messaging and streaming platforms such as Kafka, RabbitMQ, or IBM MQ
• Proficiency in scripting languages (Python, Shell) for automation and enhancement of integrations
• Understanding of data governance principles, data lineage, and metadata management
• Experience implementing CI/CD pipelines for integration deployments using Git, Jenkins, or Azure DevOps

Education

• Bachelor’s degree in Computer Science, Information Technology, Software Engineering, or related field

Additional Information

• Employment Type: Full-time
• Salary: Market Related/Negotiable
• Location Options: Johannesburg / Cape Town / Remote
• Must be located in South Africa or have a valid work permit for South Africa