AWS Data Engineers

Virtusa; Toronto; On-site; CAD 90,000 - 120,000; Full time

Job summary

A leading technology company in Toronto is seeking a data engineer/architect with over 10 years of experience. The role involves migrating SSIS packages to AWS Glue, automating processes, and ensuring data quality while working with cross-functional teams. Ideal candidates will have a strong understanding of ETL processes and AWS services like Glue, EMR, and S3.

Qualifications

• Experience with AWS Glue and ETL processes.
• 10+ years of overall experience in data engineering or architecture.

Responsibilities

• Create, build, and maintain data processing systems on AWS.
• Construct and manage data warehouses and data lakes using AWS services.
• Develop and maintain ETL processes using AWS Glue.
• Implement data governance and security policies.
• Work with cross-functional teams to build solutions.

Skills

S3

Glue streaming

EMR

Spark

ETL Concepts

Job description

Overall 10+ years of Experience.

Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors.

Responsibilities

• Create, build, and maintain data processing systems and pipelines on AWS, using services like Glue, EMR, Lambda, and S3
• Construct and manage data warehouses and data lakes using AWS services such as Redshift, Lake Formation, and Glue.
• Develop and maintain Extract, Transform, and Load (ETL) processes using AWS Glue and Lambda.
• Implement data governance and security policies, and ensure data is clean, reliable, and optimized for analysis.
• Work with cross-functional teams, including data scientists and business analysts, to understand data requirements and build solutions.

Skill

• S3
• Glue streaming
• EMR
• Spark
• ETL Concepts