Senior Platform Engineer - Big Data & Cloud Data Pipelines

Net2Source (N2S); Toronto; On-site; CAD 120,000 - 180,000; Full time

Job summary

Net2Source (N2S) seeks a Senior Platform Engineer with deep Big Data and AWS experience to design, develop and support scalable data pipelines in a fast-paced enterprise. The role focuses on data platform modernization, cloud migrations, and real-time processing.

You will lead ETL/ELT efforts, implement AWS services like EMR, S3, Redshift, and Airflow, and work with Kafka/Spark Streaming to ensure data quality and performance.

Qualifications

• 10+ years in Data Engineering / Big Data / Platform Engineering.
• Hands-on AWS and Hadoop ecosystems experience.
• Experience with data migrations (Hadoop to AWS).
• Strong understanding of data warehousing and ETL design patterns.

Responsibilities

• Design, develop, and support scalable data pipelines using Big Data and AWS technologies.
• Lead data platform migration initiatives (On-Prem to AWS).
• Develop and manage ETL/ELT using SSIS or Pentaho.
• Implement and manage AWS services like EMR, S3, EC2, Redshift, Glue, and Airflow.
• Build and optimize data workflows and orchestration with Airflow.
• Work with real-time streaming tech such as Kafka and Spark Streaming.
• Ingest, transform, and validate data from multiple sources.
• Optimize SQL queries for performance.
• Monitor performance, troubleshoot issues, and ensure reliability.
• Collaborate with cross-functional teams.

Skills

Problem-solving

Analytical thinking

Communication

Leadership

Independent work

Education

Bachelor’s degree in CS/Engineering

Tools

SSIS

Pentaho

Airflow

Kafka

Spark Streaming

Netezza

SQL Server

PostgreSQL

Teradata

Redshift

Job description

Net2Source (N2S) seeks a Senior Platform Engineer with deep Big Data and AWS experience to design, develop and support scalable data pipelines in a fast-paced enterprise. The role focuses on data platform modernization, cloud migrations, and real-time processing.

You will lead ETL/ELT efforts, implement AWS services like EMR, S3, Redshift, and Airflow, and work with Kafka/Spark Streaming to ensure data quality and performance.