Platform Engineer

Net2Source (N2S); Toronto; On-site; CAD 120,000 - 180,000; Full time

Job summary

Net2Source (N2S) seeks a Senior Platform Engineer with deep Big Data and AWS experience to design, develop and support scalable data pipelines in a fast-paced enterprise. The role focuses on data platform modernization, cloud migrations, and real-time processing.

You will lead ETL/ELT efforts, implement AWS services like EMR, S3, Redshift, and Airflow, and work with Kafka/Spark Streaming to ensure data quality and performance.

Qualifications

• 10+ years in Data Engineering / Big Data / Platform Engineering.
• Hands-on AWS and Hadoop ecosystems experience.
• Experience with data migrations (Hadoop to AWS).
• Strong understanding of data warehousing and ETL design patterns.

Responsibilities

• Design, develop, and support scalable data pipelines using Big Data and AWS technologies.
• Lead data platform migration initiatives (On-Prem to AWS).
• Develop and manage ETL/ELT using SSIS or Pentaho.
• Implement and manage AWS services like EMR, S3, EC2, Redshift, Glue, and Airflow.
• Build and optimize data workflows and orchestration with Airflow.
• Work with real-time streaming tech such as Kafka and Spark Streaming.
• Ingest, transform, and validate data from multiple sources.
• Optimize SQL queries for performance.
• Monitor performance, troubleshoot issues, and ensure reliability.
• Collaborate with cross-functional teams.

Skills

Problem-solving

Analytical thinking

Communication

Leadership

Independent work

Education

Bachelor’s degree in CS/Engineering

Tools

SSIS

Pentaho

Airflow

Kafka

Spark Streaming

Netezza

SQL Server

PostgreSQL

Teradata

Redshift

Job description

We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands‑on experience in Big Data ecosystem tools, AWS services, and real‑time data processing.

This role involves working on data platform modernization, cloud migrations, Data Warehousing and ETL in a fast-paced enterprise environment.

Key Responsibilities

• Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies
• Lead and support data platform migration initiatives (On-Prem to AWS Cloud), ideally with Netezza background.
• Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar
• Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow
• Build and optimize data workflows and orchestration pipelines using Airflow
• Work with real‑time streaming technologies such as Kafka and Spark Streaming
• Perform data ingestion, transformation, and validation from multiple data sources
• Optimize SQL queries for performance and scalability
• Monitor system performance, troubleshoot issues, and ensure system reliability
• Collaborate with cross-functional teams including developers, architects, and infrastructure teams

Required Technical Skills

• Strong experience in AWS Cloud services:
• EMR, EC2, S3, VPC, RDS, Redshift
• Airflow (or AWS Managed Workflows)
• Databases

Experience working with:

• Netezza is mandatory
• SQL-based systems: SQL Server and PostgreSQL
• Data warehouses: Teradata, Redshift, Netezza
• ETL Tools

Hands-on experience with:

• SSIS
• Programming & Scripting

Strong proficiency in:

• SQL
• Shell scripting

Good to have:

• Python
• Operating Systems
• Strong experience in Unix/Linux environments

Key Qualifications

• 10+ years of experience in Data Engineering / Big Data / Platform Engineering
• Hands-on experience in AWS and Hadoop ecosystems
• Experience in data migration projects (e.g., Hadoop to AWS, DB migrations)
• Strong understanding of data warehousing concepts and ETL design patterns
• Expertise in query optimization and performance tuning
• Bachelor’s degree in Computer Science, Engineering, or related field

Preferred Qualifications

• Experience with data lake architecture and governance
• Knowledge of DevOps tools and CI/CD pipelines
• Experience in platform engineering and framework development

Soft Skills

• Excellent problem-solving and analytical skills
• Strong communication and collaboration abilities
• Ability to work independently and lead initiatives
• Experience mentoring team members

Nice to Have

• Experience with tools like Ansible, Git, JIRA
• Exposure to NoSQL databases (HBase, MongoDB)
• Experience in data masking and security frame