Remote Data Engineer: Build Scalable AWS Data Pipelines

Insured Connect; Canada; Remote; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Remote or contract remote + benefits (

Work-from-home options and flexible...

Job summary

Insured Connect seeks a NIC Data Engineer to design and build scalable data pipelines on AWS, develop ETL processes, and create data-driven applications. You will work with teams to deliver POC solutions, ensure data services run reliably, and automate repetitive tasks for efficiency.

The role emphasizes collaboration across marketing, onboarding, client engagement, and other business functions, with remote or contract-remote options and favorable hours.

Qualifications

• Bachelor’s degree or equivalent work experience in CS/Engineering or related field
• Hands-on AWS data engineering experience with Glue/EMR, S3, Lambda, Step Functions, CloudFormation or CDK
• Strong skills in data engineering on AWS, with proficiency in Python
• Experience with batch job scheduling and managing data dependencies
• Knowledge of data processing tools like Spark, Hive, Kafka, and Airflow
• Experience using Jupyter Notebooks for ad-hoc data wrangling, data discovery, and data visualization
• Experience with DevOps automation tools for CI, automated testing, monitoring and alerting

Responsibilities

• Design and build scalable data pipelines using AWS services like Glue, S3, Step Functions, and Lambdas
• Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes
• Create and manage applications using Python, SQL, and various AWS technologies
• Quickly develop innovative POC solutions and services to address emerging needs
• Provide Run/DevOps support and manage the ongoing operation of data services
• Automate repetitive tasks and build reusable frameworks to improve efficiency
• Collaborate with teams to design and develop data products that support marketing, onboarding, client engagement, and other business functions
• Ensure our data services are reliable, maintainable, and seamlessly integrated with existing systems

Skills

AWS Glue/EMR

Python

Data pipelines

ETL

DevOps automation

Spark

Hive

Kafka

Airflow

Jupyter Notebooks

Education

Bachelor’s degree in Computer Science or related

Tools

Spark

Hive

Kafka

Airflow

Jupyter Notebooks

Job description

Insured Connect seeks a NIC Data Engineer to design and build scalable data pipelines on AWS, develop ETL processes, and create data-driven applications. You will work with teams to deliver POC solutions, ensure data services run reliably, and automate repetitive tasks for efficiency.

The role emphasizes collaboration across marketing, onboarding, client engagement, and other business functions, with remote or contract-remote options and favorable hours.