11694

Maarut; Toronto; On-site; CAD 90,000 - 140,000; Full time

Job summary

Zohorecruit in Toronto, Canada is seeking a Senior Software Developer - ETL to design, implement, and expand data pipelines across Azure and AWS ecosystems. You will translate complex specifications into scalable, tested ETL solutions and collaborate with IT professionals across the SDLC to deliver high-quality data processing applications.

Strong experience with Azure Data Factory, Databricks, and AWS data services is required, along with excellent SQL, data modeling, and problem-solving

Qualifications

• Experience designing and building ETL data pipelines to support data warehousing and analytics.
• Ability to translate business requirements into robust data processing solutions.
• Proficient in SQL and relational database concepts with performance tuning know-how.
• Experience with SDLC processes from development to deployment and support.
• Strong analytical and problem-solving skills with clear communication.

Responsibilities

• Design, implement, and expand data pipelines using ETL techniques.
• Translate technical specs into working, tested applications.
• Develop programming specifications, write and test code, and perform unit tests.
• Troubleshoot and resolve issues during use, implementation, and migrations.

Skills

ETL Development

Data Pipeline Design

SQL Proficiency

SDLC Knowledge

Analytical Thinking

Communication Skills

Tools

Azure Data Factory

Databricks

AWS (Aurora/Glue/OpenSearch)

Power BI

Job description

RQ11713 - Software Developer - ETL - Senior

• Assigned Recruiter(s) Madhumitha Mulakaluri
• Job Opening ID 11694
• City Toronto
• Country Canada
• Number of Positions 1
• Work Experience 7-10 Years

Job Description

Responsibilities

• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
• Required to translate technical systems specifications into working, tested applications.
• This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
• Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.

General Skills

• Experience in programming and analysis; specialized software package support at the specified experience level
• Ability to collaborate with IT Professionals throughout the Software Development Life Cycle
• Experience in structured methodologies for the development, design, implementation and maintenance of applications
• Experience in design, code, test, debug and document applications
• Experience in the use of object and/or third generation language development tools
• Experience in one or more programming languages
• Experience in application design, latest design patters, deployment and troubleshooting
• Experience with relational and hierarchical database technologies
• Experience in the use of information retrieval packages using query languages
• Experience with one or more communications protocols
• Experience in structured methodologies for the design, development, implementation and maintenance of applications
• Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts
• Excellent analytical, problem-solving and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills
• A team player with a track record for meeting deadlines

ETL Skills

• Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that’s geared toward the needs of end users Knowledge and experience maintaining and improving already existing processes.
• Knowledge and experience ensuring that the data architecture is scalable and maintainable
• Knowledge and experience working with the business in designing and delivering correct, high quality data
• Experience investigating data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions Experience preparing detailed documentation for further reference.
• Knowledge and experience with programming Internet-ready applications
• Knowledge and experience in rapid application development (RAD) methodologies
• Knowledge and understanding of Information Management principles, concepts, policies and practices
• Experience with middleware and gateways
• Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging
• Ability to provide post-implementation support and resolve any post-implementation technical issues
• Experience conducting design walkthrough sessions with project team
• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
• Ability to provide user and system documentation as required

Requirements

Experience and Skill Set Requirements

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with Databricks Platform
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for datamarts and data warehouses
• Experience in database management and administration
• Experience in constructing complex SQL queries and performance tuning
• Experience with Git and knowledge of source control strategies
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.
• Experience in eliciting, documenting, and validating business requirements
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.

Must Haves

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with Databricks Platform
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for datamarts and data warehouses
• Experience in database management and administration
• Experience in constructing complex SQL queries and performance tuning
• Experience with Git and knowledge of source control strategies
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.
• Experience in eliciting, documenting, and validating business requirements
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.

Nicetohaveskills

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
• Experience with programming languages such as C#, developing application codes such as APIs, Functions, etc.
• Experience writing scripts with PowerShell and otherscripting languages

Skill Set Requirements

• Designs, develops, and maintains database backend and ETL applications for Data Warehouse and Business Intelligence solutions.
• Uses knowledge of ETL languages and development techniques to build and expand application functionality
• by writing high quality code using appropriate patterns. Ensures applications remains scalable while complying to standards and following best practices.
• Tests and debug applications and ensures that software is properly documented. Collaborates clearly and professionally as part of a development team and communicates with clients.

MandatorySkills

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with Databricks Platform
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for datamarts and data warehouses
• Experience in database management and administration
• Experience in constructing complex SQL queries and performance tuning
• Experience with Git and knowledge of source control strategies
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.
• Experience in eliciting, documenting, and validating business requirements
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.

Nicetohaveskills

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
• Experience with programming languages such as C#, developing application codes such as APIs, Functions, etc.
• Experience writing scripts with PowerShell and otherscripting languages

Core Technical Skills

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for datamarts and data warehouses
• Experience in database management and administration
• Experience in constructing complex SQL queries and performance tuning
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.

Other Technical Skills

• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
• Experience with programming languages such as C#, developing application code such as APIs, Functions, etc.
• Experience writing scripts with PowerShell and otherscripting languages
• Experience with Git and knowledge of source control strategies
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery

Communications Skills

• Experience in eliciting, documenting, and validating business requirements
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.

Standards and Best Practices

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards