Principal Data Engineer

Placements24; Kimberley; Remote; CAD 150,000 - 210,000; Full time

Benefits offered by this job

Fully remote work arrangement

Competitive salary

Health insurance

Professional development support

Cutting-edge big data & cloud tech

Home office setup assistance

Job summary

Placements24 is seeking a Principal Data Engineer to design and lead scalable data pipelines, data warehouses, and data lakes for advanced analytics and ML. This is a remote-friendly leadership role.

You will own end-to-end data architecture, mentor engineers, ensure data quality and governance, and collaborate with data scientists and stakeholders while leveraging AWS, Azure, and GCP to deliver secure, high-performance data platforms.

Qualifications

• Master's or Ph.D. in Computer Science, Engineering, or a related quantitative field.
• Minimum of 10 years of experience in data engineering or a related role, with significant experience in data architecture.
• Expertise in SQL and experience with various database technologies (relational, NoSQL, columnar).
• Proficiency in programming languages commonly used in data engineering (e.g., Python, Scala, Java).
• Hands-on experience with big data technologies (e.g., Spark, Hadoop ecosystem).
• Experience with cloud data services on platforms like AWS (Redshift, S3, Glue), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow).
• Strong understanding of data modeling, data warehousing concepts, and ETL best practices.
• Experience with workflow management tools (e.g., Airflow).
• Excellent analytical, problem-solving, and communication skills.
• Demonstrated ability to lead complex data projects.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes.
• Develop and manage data warehousing solutions and data lake architectures.
• Optimize data retrieval and processing for large datasets using big data technologies.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
• Implement data quality checks and ensure data integrity and governance.
• Select and implement appropriate data technologies and tools.
• Automate data processes and monitor pipeline performance.
• Provide technical leadership and mentorship to junior data engineers.
• Ensure data security and compliance with relevant regulations.
• Contribute to the overall data strategy and architecture of the organization.

Skills

Data pipelines

SQL databases

Python/Scala/Java

Airflow

Data modeling

Leadership

Education

Master's or PhD in CS/Engineering

Tools

Spark

Hadoop

AWS

Azure

GCP

BigQuery

Job description

About the Role

Our client, a rapidly expanding telecommunications firm, is seeking a highly experienced Principal Data Engineer to establish and lead their data infrastructure initiatives. This role offers the flexibility of remote work and the opportunity to build robust, scalable data pipelines that fuel advanced analytics and machine learning capabilities. You will be responsible for the end-to-end design, development, and maintenance of data warehousing solutions, data lakes, and ETL processes. The ideal candidate will possess a deep understanding of big data technologies, cloud data services, and best practices in data engineering. Join us to architect the data foundation that will drive our client's future success.

Key Responsibilities

• Design, build, and maintain scalable and efficient data pipelines and ETL processes.


• Develop and manage data warehousing solutions and data lake architectures.


• Optimize data retrieval and processing for large datasets using big data technologies.


• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.


• Implement data quality checks and ensure data integrity and governance.


• Select and implement appropriate data technologies and tools.


• Automate data processes and monitor pipeline performance.


• Provide technical leadership and mentorship to junior data engineers.


• Ensure data security and compliance with relevant regulations.


• Contribute to the overall data strategy and architecture of the organization.

Requirements

• Master's or Ph.D. in Computer Science, Engineering, or a related quantitative field.


• Minimum of 10 years of experience in data engineering or a related role, with significant experience in data architecture.


• Expertise in SQL and experience with various database technologies (relational, NoSQL, columnar).


• Proficiency in programming languages commonly used in data engineering (e.g., Python, Scala, Java).


• Hands-on experience with big data technologies (e.g., Spark, Hadoop ecosystem).


• Experience with cloud data services on platforms like AWS (Redshift, S3, Glue), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow).


• Strong understanding of data modeling, data warehousing concepts, and ETL best practices.


• Experience with workflow management tools (e.g., Airflow).


• Excellent analytical, problem-solving, and communication skills.


• Demonstrated ability to lead complex data projects.

Benefits

• Highly competitive salary commensurate with your principal-level expertise.


• Fully remote work arrangement for optimal work-life balance.


• Comprehensive health, dental, and vision insurance plans.


• Generous allowance for professional development, including courses and conferences.


• Opportunity to work with cutting-edge big data and cloud technologies.


• A collaborative and innovative remote work culture.


• Company-provided equipment and home office setup support.