Azure Data Engineer

Tata Consultancy Services; Toronto; On-site; CAD 70,000 - 110,000; Full time

Job summary

An established industry player is seeking a Data Engineer to join their innovative team in Toronto. This role focuses on big data processing and requires expertise in SQL and various Azure services. You will design and develop data pipelines, collaborate with business analysts, and implement CI/CD pipelines to enhance data workflows. The company is committed to diversity and inclusion, ensuring that you will be part of a supportive and equitable workplace. If you are passionate about data engineering and eager to drive transformation through technology, this opportunity is perfect for you.

Qualifications

• Experience as a Data Engineer focusing on big data and SQL.
• Proficient in Azure Data Platform and creating data pipelines.

Responsibilities

• Develop and maintain data pipelines using cloud technologies.
• Collaborate with stakeholders to translate business needs into technical solutions.

Skills

Big Data Processing

SQL

Azure Data Platform

Data Pipelines

Workflow Management Tools

CI/CD Pipelines

NoSQL

Python

Shell Scripting

Scala

Tools

Azure SQL Database

Azure Data Factory

ADLS Storage Account

Azure Data Bricks

GitHub

Jenkins

Job description

Inclusion without Exception:
Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.

About TCS:
TCS is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive-powered portfolio of business, technology, and engineering services and solutions is delivered through its unique Location Independent Agile delivery model, recognized as a benchmark of excellence in software development. A part of the Tata group, India's largest multinational business group, TCS employs over 612,000 of the world’s best-trained consultants in 55 countries. The company generated consolidated revenues of US $29 billion in the fiscal year ended March 31, 2024, and is listed on the BSE and the NSE in India. TCS' proactive stance on climate change and award-winning work with communities across the world have earned it a place in leading sustainability indices such as the MSCI Global Sustainability Index and the FTSE4Good Emerging Index.

Skills and Responsibilities:

1. Experience working as a Data Engineer with a focus on big data processing and/or relational databases with a good understanding of SQL.
2. Experienced with working on Structured and Semi-Structured datasets.
3. Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks, and DevOps.
4. Experienced in creating data pipelines & developing complex and optimized queries.
5. Experienced with Workflow Management Tools: Airflow, Crontab, CA Workload Automation.
6. Experience with implementing CI/CD pipelines on GitHub, Jenkins/JGP.
7. Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments.
8. Experience with integrating into back-end/legacy environments.
9. Experience integrating business and technology teams.
10. Experienced in any of the following programming/scripting languages: SQL, Python, Shell, Scala.
11. Excellent organizational and time management skills, strong business presence with the ability to multi-task and effectively deal with competing priorities.
12. Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
13. Collaborating with Stakeholders, Business Analysts, and Data Architects to assist with and translate business requirements to technical solutions.
14. Develop big data and analytic solutions leveraging new or existing technology to advance Manulife all lines of business.
15. Exploratory data analysis by querying and processing data stores and databases and generating reports.
16. Design, upgrade, and implement new data workflows.
17. Write and maintain technical documentation.
18. Execute updates, patches, and other activities required to maintain and enhance the operations of on-premises or cloud-based environments.

Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodations during the recruitment and selection process, please inform Human Resources. Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.