Data Engineer

LanceSoft, Inc.; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid work environment

On-site at Union Station Toronto

Job summary

LanceSoft, Inc. seeks a Data Engineer to design, develop, and maintain data pipelines and analytics-ready data sets to support enterprise BI solutions. The role adheres to TTC design methods and documentation standards.

Hybrid work environment at Union Station Toronto with minimum 2 days on-site. You will collaborate with the Enterprise Data project team to design, develop, and document SSIS/ADF packages and data warehousing components while delivering meaningful data insights.

Qualifications

• Requires 5+ years of experience in data engineering or related roles.
• Experience designing, developing and maintaining data pipelines and BI data sets.
• Strong understanding of DW/BI implementations and data warehouse concepts.
• Solid data modeling, data quality, data cleansing and data stewardship experience.
• Ability to convert requirements to technical specifications and estimate work.
• Excellent written and oral communication skills.

Responsibilities

• Design, develop and maintain the TTC enterprise data warehouse, data marts, and data lakes.
• Develop and document SSIS/ADF packages to integrate data from multiple systems.
• Create and optimize complex T-SQL objects (stored procedures, views, indexes).
• Implement data quality processes and support data modelling activities.
• Provide data-driven insights through advanced data analysis and BI reports.

Skills

Data modeling

Data quality

Analytical thinking

Problem solving

Time estimation

Interpersonal skills

Communication

Education

Bachelors in CS or equivalent

Tools

SSIS

Azure Data Factory

Azure Synapse

SQL Server

T-SQL

Power BI

Job description

Data Engineer will be responsible for supporting and developing data pipelines, analytics ready data sets and business intelligence solution(s).

Data Engineer will follow TTC design & development methodologies and documentation standards.

Hybrid work environment according to office policy. Currently at Union Station (61 Front St W, Toronto) with minimum 2 days on site.

Qualifications:

• Mandatory Requirements
• 5+ years of experience in:

Hands-on experience working with:

• SSIS and/or Microsoft Azure Data Factory (ADF) and other related Azure Services
• Microsoft Azure Synapse and/or SQL Data Warehouse and SQL Server 2016 or later.

Other Certifications / Skills:

• A university degree in Computer Science, or the equivalent, combined with directly related experience in a business or computer related discipline.
• Optimize, analyze and improve data integration packages
• Expert understanding and enterprise scale experience working with Data Warehouse (DW) and Business Intelligence (BI) implementations
• Strong understanding of data modelling techniques and data warehouse/data lake design
• Experience with data quality, data cleansing and data stewardship processes and techniques
• Ability to solve complex data problems by analysis, develop appropriate solutions and clearly communicate those solutions to the team.
• Ability to work efficiently and provide accurate time estimates for work to be undertaken.
• Well-developed interpersonal, oral and written communication skills, strong analytical and problem-solving skills.
• Developing Microsoft Power BI reports or other data visualization tools is an asset

Assignment Duties:

• Work with the Enterprise Data project team in designing, developing and maintaining the TTC enterprise data warehouse, data marts, data lakes
• Responsible for designing, developing, supporting, and documenting SSIS and/or Azure Data Factory (ADF) packages to integrate data from multiple systems
• Responsible for designing, developing and documenting complex T-SQL, stored procedures, views, triggers, indexes, etc.
• Responsible for designing and implementing data quality processes
• Assist in the data modelling of the data warehouse/data mart/data lake solution(s)
• Advanced data analysis to provide meaningful data driven insights
• Work closely with the business analyst(s), and other team members, to understand requirements
• Convert business requirements to technical specifications.
• Perform knowledge transfer meetings and sessions.
• Research, propose, document, and share technical solutions with the team.
• Recommend and implement improvements to data quality, automation, and workflows
• Provide accurate time estimates for work to be undertaken
• Detailed technical design and functional specifications.
• Completed system components 'unit tested' and ready for System, QA and User Acceptance testing.
• Technical support during the various stages of testing (system integration, QA, User Acceptance)