Azure Data Engineer

Tata Consultancy Services Limited; Toronto; On-site; CAD 100,000 - 120,000; Full time

Job summary

Tata Consultancy Services Canada Inc. is seeking a Data Engineer to design and implement data pipelines using cloud technologies across Azure services.

The role focuses on big data processing, relational datasets, and developing optimized queries to support analytics across multiple business units. You will collaborate with data architects, analysts, and stakeholders to translate requirements into scalable data solutions, maintain pipelines, and ensure robust CI/CD practices.

Qualifications

• Experience as a Data Engineer with focus on big data processing and/or relational databases, with SQL knowledge.
• Experience with Structured and Semi-Structured datasets and Azure Data Platform.
• Experience creating data pipelines and developing optimized queries.
• Experience with CI/CD pipelines and workflow tooling (Airflow, Crontab, CA Workload Automation).
• Experience integrating data from multiple sources into target systems and collaborating with business and tech teams.

Responsibilities

• Design and develop data pipelines on cloud-based platforms.
• Develop and optimize SQL/NoSQL jobs for data analysis in MS SQL/Oracle environments.
• Collaborate with Stakeholders, Analysts and Data Architects to translate requirements into technical solutions.
• Maintain and upgrade data workflows and technical documentation.
• Execute patches and updates for cloud and on-prem environments.

Skills

Big data processing

SQL and NoSQL

Azure Data Platform

Azure Data Factory

Azure Data Bricks

Data pipelines

CI/CD pipelines

GitHub/Jenkins

Python

Shell/Scala

Stakeholder collaboration

Tools

Airflow

Crontab

CA Workload Automation

Databricks

Job description

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.

TCS has been serving the Canadian marketplace for more than 35 years and today is the technology partner of choice for many of the country's leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence.

Rooted in the heritage and values of the Tata Group, TCS is focused on creating long-term value for its clients, investors, employees, and the communities it serves. With a highly skilled workforce supporting customers from coast to coast, TCS has consistently been recognized as a Top Employer by the Top Employers Institute, including a recent top ranking at the country level.

TCS also sponsors 14 of the world's most prestigious marathons and endurance events, including the TCS Toronto Waterfront Marathon, reflecting its commitment to health, sustainability, and community empowerment.

Skills and Responsibilities:

• Experience working as a Data Engineer with focus on big data processing and/or relational databases with good understanding of SQL
• Experienced with working on Structured and Semi-Structured datasets.
• Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps
• Experienced in creating data pipelines & developing complex and optimized queries.
• Experienced with Workflow Management Tools: Airflow, Crontab, CA Workload Automation Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP.
• Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments
• Experience with integrating into back-end/legacy environments
• Experience integrating business and technology teams
• Experienced in any of the following programming/scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities
• Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
• Collaborating with Stakeholders, Business Analysts and Data Architects to assist with and translate business requirements to technical solutions
• Develop big data and analytic solutions leveraging new or existing technology to advance all lines of business
• Exploratory data analysis by querying and processing data stores and databases and generating reports. 5 Design, upgrade and implement new data workflows.
• Write and maintain technical documentation
• Execute updates, patches, and other activities required to maintain and enhance the operations of on-premises or cloud-based environments.

Good to have:

• Good Knowledge and hands on experience in Azure Databricks, Data Factory, Synapse Analytics or SQL DB, ADLS Gen 2.
• Knowledge in any Python or object-oriented programming language.
• Write and maintain technical documentation.
• Good knowledge in Data warehousing concepts.
• Experience with data engineering projects, i.e., integration of data from multiple data sources to a target system.

Salary Range - CA$ 100,000 - CA$ 120,000 Per Year

Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodation during the recruitment and selection process, please inform Human Resources.

Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period.