Senior Data Engineer

GXBank; Selangor; On-site; MYR 150,000 - 270,000; Full time

Job summary

GXBank is seeking a skilled data engineer to design, build, and operate robust ELT pipelines using dbt for Snowflake. You will orchestrate data workflows with Airflow, develop Python data connectors, and implement batch and streaming ingestion.

The role emphasizes performance tuning, governance, and close collaboration with business teams. The ideal candidate has 5+ years in data engineering with strong SQL, Snowflake, and Python skills, and a solid understanding of data warehousing concepts and

Qualifications

• Mastery of complex SQL queries, analytical functions, and performance tuning.
• 5+ years hands-on experience with SQL or Data warehouse/Data Lake, including data loading and security features.
• Proven experience building data transformation pipelines using dbt (Jinja templating, macros, tests, docs).
• Experience with production-grade pipelines using Airflow (DAGs, Operators, Sensors, XComs).
• Strong Python scripting for data manipulation and API integrations.

Responsibilities

• Design, develop, test, deploy, and maintain robust ELT data pipelines with dbt for Snowflake.
• Orchestrate and schedule complex data workflows using Apache Airflow for timely data delivery.
• Develop connectors and scripts (Python) to extract data from APIs, databases, and files into Snowflake.
• Implement ingestion strategies (batch and streaming) using Snowflake (Snowpipe, external stages).
• Optimize Snowflake warehouse usage, performance, and overall data platform efficiency.
• Manage Snowflake resources cost-effectively and enforce data governance and security.
• Assist schema design, table optimization (clustering/partitioning), and data loading strategies.
• Communicate clearly across technical and business stakeholders; uphold best practices and documentation.

Skills

Analytical thinking

Problem solving

Attention to detail

Communication

Independent worker

Education

Bachelor/Master in Analytics/Data Science/CS/IS/CE or related

Tools

dbt

Snowflake

Apache Airflow

Python

SQL

Job description

Design, develop, test, deploy, and maintain robust and scalable ELT data pipelines using dbt (data build tool) for data transformation within Snowflake.

Orchestrate and schedule complex data workflows using Apache Airflow, ensuring timely and reliable data delivery.

Develop connectors and scripts (primarily in Python) to extract data from various source systems (APIs, databases, files, streaming platforms) and load it into Snowflake.

Implement data ingestion strategies (batch and streaming) using Snowflake's capabilities (e.g., Snowpipe, external stages).

Optimize Snowflake warehouse usage, query performance, and overall data platform efficiency.

Manage and monitor Snowflake resources, ensuring cost-effectiveness and scalability.

Implement and enforce data governance, security (e.g., RBAC, data masking), and privacy best practices within Snowflake.

Assist in schema design, table optimization (clustering, partitioning), and data loading strategies.

Solve key business problems through using an appropriate mix of strategic thinking and computational methods.

Develop and uphold best practices with respect to change management, documentation and data protocols.

Requirements

Bachelor/Master degree in Analytics, Data Science, Mathematics, Computer Science, Information Systems, Computer Engineering, or related technical field.

Demonstrated mastery of complex SQL queries, analytical functions, stored procedures, and performance tuning.

5+ years of hands‑on experience with SQL or any Data warehouse/Data Lake, including data loading, transformations, performance optimization, and security features.

Proven experience in building and managing complex data transformation pipelines using dbt, including Jinja templating, macros, tests, and documentation.

Solid experience in designing, developing, and deploying production‑grade data pipelines using Apache Airflow (DAGs, Operators, Sensors, XComs).

Strong Python scripting skills for data manipulation, API integrations, and Airflow DAG development.

Analytical and independent problem solver. Meticulous with high attention to detail.

Strong communicator with ability to switch hats between data/technical speak and business/layperson speak.

Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data lake architectures.

Deep understanding of Extract, Load, Transform (ELT) or ETL principles and best practices.

Familiarity with data quality frameworks, data lineage, and data governance principles.

Experience working in a digital banking or financial services environment is highly advantageous, with an understanding of financial data concepts and regulatory requirements.