NIC Data Engineer

Insured Connect; Canada; Remote; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Remote or contract remote + benefits (

Work-from-home options and flexible...

Job summary

Insured Connect seeks a NIC Data Engineer to design and build scalable data pipelines on AWS, develop ETL processes, and create data-driven applications. You will work with teams to deliver POC solutions, ensure data services run reliably, and automate repetitive tasks for efficiency.

The role emphasizes collaboration across marketing, onboarding, client engagement, and other business functions, with remote or contract-remote options and favorable hours.

Qualifications

• Bachelor’s degree or equivalent work experience in CS/Engineering or related field
• Hands-on AWS data engineering experience with Glue/EMR, S3, Lambda, Step Functions, CloudFormation or CDK
• Strong skills in data engineering on AWS, with proficiency in Python
• Experience with batch job scheduling and managing data dependencies
• Knowledge of data processing tools like Spark, Hive, Kafka, and Airflow
• Experience using Jupyter Notebooks for ad-hoc data wrangling, data discovery, and data visualization
• Experience with DevOps automation tools for CI, automated testing, monitoring and alerting

Responsibilities

• Design and build scalable data pipelines using AWS services like Glue, S3, Step Functions, and Lambdas
• Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes
• Create and manage applications using Python, SQL, and various AWS technologies
• Quickly develop innovative POC solutions and services to address emerging needs
• Provide Run/DevOps support and manage the ongoing operation of data services
• Automate repetitive tasks and build reusable frameworks to improve efficiency
• Collaborate with teams to design and develop data products that support marketing, onboarding, client engagement, and other business functions
• Ensure our data services are reliable, maintainable, and seamlessly integrated with existing systems

Skills

AWS Glue/EMR

Python

Data pipelines

ETL

DevOps automation

Spark

Hive

Kafka

Airflow

Jupyter Notebooks

Education

Bachelor’s degree in Computer Science or related

Tools

Spark

Hive

Kafka

Airflow

Jupyter Notebooks

Job description

As a NIC Data Engineer, you’ll be at the heart of our data-driven initiatives. Your role will involve designing and building scalable data solutions that help us meet our business goals. You’ll dive into complex projects, working closely with multiple teams to develop and manage data pipelines, build data-driven applications, and streamline processes. Your contributions will be crucial in delivering meaningful data insights, crafting innovative Proof-of-Concept (POC) solutions, ensuring our data services run smoothly, and deriving value from our growing data ecosystem. If you enjoy collaborating with others to drive business success, creating business value from data, and are genuinely excited about all things data, this role is for you.

Responsibilities & Duties

• Design and build scalable data pipelines using AWS services like AWS Glue, S3, Step Functions, and Lambdas.
• Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.
• Create and manage applications using Python, SQL, and various AWS technologies.
• Quickly develop innovative Proof-of-Concept (POC) solutions and services to address emerging needs.
• Provide Run/DevOps support and manage the ongoing operation of data services.
• Automate repetitive tasks and build reusable frameworks to improve efficiency.
• Collaborate with teams to design and develop data products that support marketing, onboarding, client engagement, and other business functions.
• Ensure our data services are reliable, maintainable, and seamlessly integrated with existing systems.

Qualifications

Required skills and Experience:

• Bachelor’s degree in Computer Science, Engineering, or equivalent work experience
• Hands-on experience with AWS services including AWS Glue or EMR, S3, Lambda, Step Functions, CloudFormation or CDK
• Strong skills in data engineering on AWS, with proficiency in Python
• Experience with batch job scheduling and managing data dependencies
• Knowledge of data processing tools like Spark, Hive, Kafka, and Airflow
• Experience using Jupyter Notebooks for ad-hoc data wrangling, data discovery, and data visualization
• Experience with DevOps automation tools for continuous integration, automated testing, monitoring and alerting

Nice to have/Preferred skills and Experience (not required)

• Experience with streaming technologies like Kinesis, Kafka, or Flink
• Familiarity with data visualization tools such as Tableau, Power BI, or AWS Quicksight
• Experience with containerization technologies like Docker and Kubernetes

What We Offer

• Full-time remote or contract remote + benefits (US & Canada)
• Work-from-home options and flexible hours
• Paid time off for vacations, holidays, and sick leave

IC is poised to revolutionize the life insurance industry with its pioneering platform. Our platform will be the industry’s first and only single, shared solution that digitizes in force policy service for ALL Carriers, Distributors, Agents and Policy Owners. We are growing fast and are assembling a team of top performers to transform our potential into reality.