Senior AWS Data Engineer

Insight Global; Toronto; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A leading recruitment agency is seeking experienced AWS Data Engineers for a banking client in Toronto. This role involves supporting a large-scale SaaS to AWS transformation, with responsibilities including data transformation, data warehousing, and deploying ML models. Candidates should have significant experience with AWS services and data governance. This is a hybrid position on a 6-month contract with potential for extensions.

Qualifications

• 8-10+ years of experience in data engineering, ideally in large enterprise banking/financial services environments.
• 8+ years of experience with AWS Services for data ingestion and movement.
• Excellent experience with data storage in AWS including AWS S3, Redshift, and Aurora/RDS.
• Experience with efficient data processing and querying using AWS Athena and Lambda.
• Knowledge of metadata and governance using AWS Glue Catalog and Lake Formation.

Responsibilities

• Perform data/file transformation using AWS services.
• Utilize AWS Glue for batch processing.
• Implement data warehousing solutions using AWS services.
• Create operational dashboards using AWS QuickSight and Power BI.
• Deploy and manage ML models in AWS SageMaker.

Skills

Data engineering

AWS services

Data warehousing

Batch processing

Agile methodologies

Data governance

Data analytics

Communication skills

Tools

AWS Glue

AWS S3

Amazon Redshift

AWS SageMaker

Power BI

AWS QuickSight

Job description

Job Description

Insight Global is seeking skilled AWS Data Engineers to join our banking client to support a large scale SaaS to AWS transformation project. Candidates will be involved in an initiative to build a new cloud platform tool in AWS for Wealth Data Solutions and moving data from Hadoop to AWS. The ideal candidates will have a strong background in data engineering, AWS webservices, and a strong understanding of data warehousing and batch processing. These individuals should be confident to work in an agile environment (Scrum, Kanban) and to collaborate with other functional roles in delivery including testing, analysis, architecture, and business stakeholders. Main themes for these individuals to consider are data storage, data movement, meta data & governance, infrastructure, and security/IAM. This role will hybrid in Toronto, ON on a 6 month contract with potential for extensions and conversion to full time. \

Responsibilities:

- Perform data/file transformation using AWS services.

- Utilize AWS Glue for batch processing (Spark or Python).

- Implement data warehousing solutions using Amazon S3, Redshift (analytics and BI), Aurora/RDS (operational data stores).

- Ensure metadata and governance using AWS Glue Catalog, Lake Formation, and Macie.

- Create operational dashboards using AWS QuickSight and Power BI.

- Deploy and manage ML models in AWS SageMaker.

We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

• 8-10+ years of experience in data engineering, ideally in large enterprise banking/financial services environments.

  - 8+ years of experience with AWS Services for data ingestion and movement including AWS Glue (batch processing and ETL), AWS Data Sync, AWS Transfer Family (SFTP).

  - Excellent experience with data storage in AWS including AWS S3, Redshift (analytics and BI), Aurora/RDS (operational data stores).

  - Experience with efficient data processing, querying, and serverless computing using AWS Athena, Redshift Spectrum, Lambda.

  - Knowledge of metadata and governance using AWS Glue Catalog, Lake Formation (concepts/frameworks), and Macie (data recovery/protection)

  - Expertise with data analytics and visualizations using AWS Quicksight and Power BI.

  - Excellent communication skills with an ability to present ideas clearly to stakeholders. - Expertise with ML models and frameworks in AWS SageMaker and AWS Redshift ML is highly preferred to incorporate ML models in data solution. null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [e-mail].