Lead Data Engineer

Randstad (Schweiz) AG; Petaling Jaya; On-site; MYR 120,000 - 150,000; Full time

Job summary

A leading recruitment firm is seeking a highly skilled Lead Data Engineer to design and implement scalable data pipelines and data warehousing solutions. The ideal candidate will have over 8 years of experience in data engineering, strong proficiency in Python and SQL, and hands-on experience with Snowflake and Apache Airflow. This role offers opportunities to lead a team and collaborate with cross-functional groups for data-driven decision-making.

Qualifications

• 8+ years of experience in data engineering, ETL development, and data warehousing.
• Strong proficiency in Python and SQL.
• Hands-on experience with Snowflake, Airflow, and REST API development.

Responsibilities

• Lead the design, development, and maintenance of robust data pipelines.
• Architect and implement scalable data warehousing solutions using Snowflake.
• Develop and maintain REST APIs for data access and integration.
• Ensure high-quality code through unit testing and code reviews.
• Utilize Apache Airflow for workflow orchestration and scheduling.
• Collaborate with data scientists, analysts, and business stakeholders.

Skills

Data engineering

ETL development

Data warehousing

Python

SQL

Tools

Snowflake

Apache Airflow

REST APIs

Job description

Job Summary:

We are seeking a highly skilled and experiencedLead Data Engineerto join our team. The ideal candidate will have a strong background in designing and implementing scalable data pipelines, data warehousing solutions, and ETL frameworks. You will lead a team of data engineers and collaborate closely with cross-functional teams to support data-driven decision-making across the organization.

Key Responsibilities:

• Lead the design, development, and maintenance of robust data pipelines and ETL processes.
• Architect and implement scalable data warehousing solutions usingSnowflake.
• Develop and maintainREST APIsfor data access and integration.
• Ensure high-quality code throughunit testingand code reviews.
• UtilizeApache Airflowfor workflow orchestration and scheduling.
• Work withApple’s GBI frameworkto support data integration and analytics.
• Optimize and manageSQLqueries for performance and scalability.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
• Mentor junior data engineers and promote best practices in data engineering.
• Ensure data quality, integrity, and security across all systems.

Required Qualifications:

• 8+ years of experience indata engineering,ETL development, anddata warehousing.
• Strong proficiency inPythonandSQL.
• Hands-on experience withSnowflake,Airflow, andREST APIdevelopment.
• Familiarity withApple GBI frameworkis a strong plus.
• Experience withunit testingand CI/CD pipelines.
• Excellent problem-solving skills and attention to detail.