Sr. Data Engineer (Remote)

NTT DATA North America; Ottawa; Remote; CAD 100,000 - 130,000; Full time

Job summary

A global technology firm is looking for a Senior Data Engineer. This role involves designing and implementing data pipelines on a cloud-native platform. Candidates must have substantial experience with Spark, Scala, and Python, along with expertise in Azure environments. This full-time position is 100% remote within Canada, emphasizing collaboration with various stakeholders.

Qualifications

• 8+ years of programming experience in Spark using Scala or Python.
• Experience with Azure, including Data Lake Storage and Synapse.
• Knowledge of database modeling techniques like Data Vault.

Responsibilities

• Increase data onboarding speed to the Data and Analytics platform.
• Build robust data pipelines for larger data consumption.
• Collaborate with stakeholders to refine data requirements.

Skills

Spark

Scala

Python

Data modeling techniques

Azure Data Lake Storage

SQL Server

Kafka

Tools

Azure DevOps

Databricks

Event Hub

Job description

We are currently seeking a Senior Data Engineer to join our team 100% remote based anywhere in Canada .

Position Summary

The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with stakeholders to achieve the best results for our clients.

Job Responsibilities

• Increase the overall speed in which data is onboarded to the Data and Analytics platform.
• Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform.
• Increase the overall quality of data pipeline development through DevSecOps.
• Design, build and implementation of batch and real-time data pipelines.
• Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.
• Developing and proposing data models that conform to requirements.
• Ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.
• Working with various stakeholders across the business, data scientists and IT.
• Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements.

Basic Qualifications

• Must have 8+ years of programming experience in Spark using Scala, Python.
• Experience working with modern data architectures like Azure Data Lake Storage, Azure, Azure Synapse (formerly SQL Data Warehouse) and Databricks, Delta Lake, Delta Sharing, Unity catalog, DLT pipelines.
• Experience leading Data Engineering practice within an organization / team.
• Knowledge and expertise of database modeling techniques : Data Vaults, Star, Snowflake, 3NF, etc.
• Experience building Rest API integration using Denodo, SQL warehouse API.
• Experience working with streaming data architecture and technologies for real-time : Spark Streaming, Event hub,Kafka.
• Experience working with relational and non-relational database technologies : SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase.
• Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus.

Assets

• Experience within Azure environment.
• Strong Scala, python and Spark experience.
• Function Apps, C#.
• Experience modernizing data platforms.
• 2 to 3 projects developing Data Vault.

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

NTT DATA endeavors to make https : / / us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https : / / us.nttdata.com / en / contact-us . This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here . If you’d like more information on your EEO rights under the law, please click here . For Pay Transparency information, please click here .

Seniority level

Seniority level

Not Applicable

Employment type

Employment type

Full-time

Job function

Job function

Information Technology

IT Services and IT Consulting

Referrals increase your chances of interviewing at NTT DATA North America by 2x

Get notified about new Senior Data Engineer jobs in Ottawa, Ontario, Canada .

Senior Software Developer – Lab Integrations

Senior Software Engineer (SEO Team, Full Stack)

Python and Kubernetes Software Engineer - Data, AI / ML & Analytics

Python and Kubernetes Software Engineer - Data, Workflows, AI / ML & Analytics

Python and Kubernetes Software Engineer - Data, AI / ML & Analytics

Senior Software Engineer - Digital Workplace

Embedded Linux Senior Software Engineer - Optimisation

Intermediate Full Stack Developer (Data)

Senior Software Engineer - Digital Workplace

Senior Software Engineer (Identity Decisioning)

Python and Kubernetes Software Engineer - Data, Workflows, AI / ML & Analytics

Embedded Linux Senior Software Engineer - Optimisation

Senior Software Engineer - Infrastructure

Senior / Staff Software Engineer, Public Sector

Senior Software Engineer (Online Storage)

Senior Software Engineer (Capacity and Cloud Economics Engineering)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.