SQL Data Engineer

Recru-it; Centurion; On-site; ZAR 650,000 - 850,000; Full time

Job summary

A leading company in data management is seeking a skilled data engineer to contribute to innovative data strategies in a dynamic work environment. This role requires advanced SQL, ETL development, and financial industry expertise to enhance data-driven decision-making processes.

Qualifications

• 5+ years of hands-on SQL development experience, especially in data warehousing.
• Experience with ETL/ELT pipeline development using SSIS and AWS Glue.
• Familiarity with Agile methodologies like Scrum and Kanban.

Responsibilities

• Develop and maintain ETL/ELT data pipelines for large-scale data ingestion.
• Implement database solutions for improved query execution.
• Elicit and document business requirements directly from data clients.

Skills

SQL Transact

SQL Server

SSIS

SSRS

AWS

GitLab

Python

ETL / ELT

Education

BSc IT or similar

Tools

Power BI

Visual Studio

Job description

Our client offers a collaborative and dynamic work environment. By joining their team, you'll have the opportunity to contribute meaningfully to their data-driven strategies while growing in a culture that values innovation, excellence, and service.

Requirements

Technical Skills :

• Advanced proficiency in SQL Transact, SQL Server, SSIS, and SSRS, including performance tuning and query optimization.
• Experience in data warehouse, data lake, or data vault development using SSIS and SQL Transact.
• Strong knowledge of AWS services related to data management.
• Proficiency in GitLab for version control, CI / CD automation, and deployment pipelines.
• Experience with Python libraries such as Pandas, NumPy, PySpark, and SQLAlchemy for data manipulation and integration.
• Knowledge of Visual Studio, MDS, and Power BI.
• Experience in ETL / ELT pipeline development, data integration strategies, and best practices in data engineering.
• Database administration (DBA) experience, including index management, query optimization, and performance tuning.

Financial Industry Expertise :

• At least 5 years’ experience in financial services (preferred)
• Strong understanding of regulatory compliance, data governance, and financial data structures.

Collaboration and Soft Skills :

• Strong ability to gather and document requirements directly from stakeholders.
• Exceptional collaboration and relationship-building skills.
• Agility in problem-solving and adapting to changing priorities.

Methodologies :

• Working experience in an Agile environment (Scrum, Kanban) with sprint planning and backlog grooming.
• Proficiency in implementing DevOps practices for automated deployments, monitoring, and alerting.

Duties and Responsibilities

Core Responsibilities :

• Elicit and document business requirements directly from data clients.
• Deliver innovative solutions aligned with business needs and strategies.
• Develop and maintain ETL / ELT data pipelines using SSIS and AWS Glue for large-scale data ingestion and transformation.
• Implement database solutions with partitioning, indexing, and stored procedures to improve query execution times.
• Automate deployment pipelines using GitLab CI / CD to streamline development and operational workflows.
• Implement data governance frameworks, access controls, and compliance protocols to meet financial industry regulations.
• Build and maintain effective relationships with stakeholders.
• Deliver consistent, high-quality service while managing expectations.
• Promote a feedback-driven and service-oriented culture.

Self-Management & Teamwork :

• Contribute to a positive and energizing workplace culture.
• Align individual performance with team and organizational goals.
• Encourage and embrace innovation, agility, and collaboration.
• Take ownership of personal development through effective performance planning and feedback.
• Relevant tertiary qualification (e.g., BSc IT or similar).Minimum 5 years of hands-on SQL development experience. (Experience in warehouse, data lake, or data vault development using SSIS and SQL Transact will be considered here – not just fluency in SQL for 10 years).5 years+ of Python for data processing, automation, and ETL / ELT pipeline development.
• Strong problem-solving skills with a focus on backend SQL development.
• Ability to work independently and in teams to deliver robust data solutions.
• Ability to translate a documented specification into a robust implemented solution.

POSITION INFO : Role Purpose

Our client offers a collaborative and dynamic work environment. By joining their team, you'll have the opportunity to contribute meaningfully to their data-driven strategies while growing in a culture that values innovation, excellence, and service.

Requirements

Technical Skills :

• Advanced proficiency in SQL Transact, SQL Server, SSIS, and SSRS, including performance tuning and query optimization.
• Experience in data warehouse, data lake, or data vault development using SSIS and SQL Transact.
• Strong knowledge of AWS services related to data management.
• Proficiency in GitLab for version control, CI / CD automation, and deployment pipelines.
• Experience with Python libraries such as Pandas, NumPy, PySpark, and SQLAlchemy for data manipulation and integration.
• Knowledge of Visual Studio, MDS, and Power BI.
• Experience in ETL / ELT pipeline development, data integration strategies, and best practices in data .
• Database administration (DBA) experience, including index management, query optimization, and performance tuning.

Financial Industry Expertise :

• At least 5 years’ experience in financial services (preferred)
• Strong understanding of regulatory compliance, data governance, and financial data structures.

Collaboration and Soft Skills :

• Strong ability to gather and document requirements directly from stakeholders.
• Exceptional collaboration and relationship-building skills.
• Agility in problem-solving and adapting to changing priorities.

Methodologies :

• Working experience in an Agile environment (Scrum, Kanban) with sprint planning and backlog grooming.
• Proficiency in implementing DevOps practices for automated deployments, monitoring, and alerting.

Duties and Responsibilities

Core Responsibilities :

• Elicit and document business requirements directly from data clients.
• Deliver innovative solutions aligned with business needs and strategies.
• Develop and maintain ETL / ELT data pipelines using SSIS and AWS Glue for large-scale data ingestion and transformation.
• Implement database solutions with partitioning, indexing, and stored procedures to improve query execution times.
• Automate deployment pipelines using GitLab CI / CD to streamline development and operational workflows.
• Implement data governance frameworks, access controls, and compliance protocols to meet financial industry regulations.
• Build and maintain effective relationships with stakeholders.
• Deliver consistent, high-quality service while managing expectations.
• Promote a feedback-driven and service-oriented culture.

Self-Management & Teamwork :

• Contribute to a positive and energizing workplace culture.
• Align individual performance with team and organizational goals.
• Encourage and embrace innovation, agility, and collaboration.
• Take ownership of personal development through effective performance planning and feedback.
• Relevant tertiary qualification (e.g., BSc IT or similar).Minimum 5 years of hands-on SQL development experience. (Experience in warehouse, data lake, or data vault development using SSIS and SQL Transact will be considered here – not just fluency in SQL for 10 years).5 years+ of Python for data processing, automation, and ETL / ELT pipeline development.
• Strong problem-solving skills with a focus on backend SQL development.
• Ability to work independently and in teams to deliver robust data solutions.
• Ability to translate a documented specification into a robust implemented solution.