Lead Data Engineer

Placements24; Kimberley; Hybrid; CAD 120,000 - 180,000; Full time

Benefits offered by this job

Performance bonuses

Health, dental, and vision insurance

Professional development budget

Flexible remote hours

Job summary

Placements24 is seeking a Lead Data Engineer to design and steward scalable data pipelines and platforms in a fully remote setting. You will guide a team, shape technical direction, and ensure reliable data processing for data scientists and analysts.

The ideal candidate has 5+ years in data engineering, strong SQL, and experience with Spark/Hadoop/Kafka along with cloud platforms. You will drive data quality, performance, and collaboration across stakeholders.

Qualifications

• Bachelors in CS/Engineering or related quantitative field.
• 5+ years data engineering experience; 2+ years in lead role.
• Strong SQL and one of Python or Scala; hands-on coding.
• Experience with Spark, Hadoop, Kafka and data pipelines.
• Experience with cloud data platforms (AWS/Azure/GCP).
• Familiarity with data warehousing concepts and ETL/ELT.

Responsibilities

• Design, build, and maintain scalable data pipelines (ETL/ELT).
• Develop and manage data warehouses and data lakes with quality data.
• Lead and mentor a team of data engineers and set best practices.
• Optimize processing performance and data storage strategies.
• Collaborate with data scientists, analysts and stakeholders.
• Implement monitoring, alerting, and automated testing for pipelines.

Skills

SQL

Python/Scala

Leadership

Data warehousing

ETL/ELT

Education

Bachelor's degree in Computer Science / Engineering

Tools

Spark

Hadoop

Kafka

AWS Redshift

S3

Glue

Azure Data Lake / Synapse

GCP BigQuery

Job description

About the Role

Our client is seeking an experienced and motivated Lead Data Engineer to build and manage their data infrastructure, working remotely to support operations near Kimberley . This role is crucial for designing, developing, and maintaining scalable data pipelines and systems that empower data scientists and analysts. You will lead a team, set technical direction, and ensure the reliability and efficiency of our data platforms. The ideal candidate possesses a deep understanding of data warehousing, ETL processes, and big data technologies, and is passionate about enabling data-driven insights in a fully remote setting.

Key Responsibilities

• Design, build, and maintain robust, scalable, and reliable data pipelines (ETL/ELT) using modern tools and technologies.
• Develop and manage data warehouses and data lakes, ensuring data quality, integrity, and accessibility.
• Lead and mentor a team of data engineers, providing technical guidance and fostering best practices.
• Optimize data processing performance and implement strategies for efficient data storage and retrieval.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions.
• Implement monitoring, alerting, and automated testing for data pipelines and infrastructure.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering, with at least 2 years in a lead or senior role.
• Strong proficiency in SQL and experience with at least one programming language like Python or Scala .
• Hands-on experience with big data technologies such as Spark, Hadoop, or Kafka .
• Experience with cloud data platforms (AWS Redshift, S3, Glue; Azure Data Lake, Synapse; GCP BigQuery ).
• Familiarity with data warehousing concepts, ETL/ELT tools, and data modeling techniques.

Benefits

• Excellent remote salary package with performance bonuses.
• Comprehensive health, dental, and vision insurance.
• Significant budget for professional development and attending industry events.
• Flexible remote working hours and a supportive team culture.
• Opportunity to work with a diverse range of data technologies and solve complex challenges.