Remote AWS Data Engineer | ETL, Redshift & Spark

NTT DATA, Inc.; Halifax; Hybrid; CAD 86,000 - 133,000; Full time

Benefits offered by this job

Remote work option

Competitive compensation package

Benefits program in Canada

Job summary

NTT DATA is seeking an experienced AWS ETL Data Engineer for a REMOTE role to design, develop, and support enterprise data platforms in Halifax, NS, Canada. The role combines data engineering, analytics, and governance to ensure privacy compliance while delivering scalable data solutions for reporting and customer engagement.

You will lead ETL/ELT development, optimize queries, and collaborate with business and technical teams to manage Data Subject Requests and data governance initiatives, with

Qualifications

• Experience designing and building scalable data pipelines in AWS.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Spark (Scala/Python), AWS Glue, AWS Lambda, and Shell scripting.
• Build and support ETL/ELT processes across AWS platforms, including S3, Hive, Apache Iceberg, and Amazon Redshift.
• Develop and maintain Redshift SQL/PLSQL code, stored procedures, and data-processing frameworks.
• Perform query tuning, performance optimization, and data-sharing implementations.
• Support ingestion and processing of structured and semi-structured data formats including JSON, CSV, XML, ORC, Parquet, and Avro.
• Design, enhance, and support solutions that provide a unified view of customer data across systems.
• Integrate multiple data sources, applications, and business processes to support reporting, analytics, and customer engagement initiatives.
• Collaborate with business and technical teams to define and implement scalable data solutions.
• Manage and support Data Subject Requests (DSRs), including customer data erasure requests.
• Work closely with the DPO team to ensure compliance with privacy regulations and internal policies.
• Maintain and support the MicroStrategy Privacy Compliance module. (Very infrequent once in year or 2 years)
• Contribute to data governance initiatives that improve data quality, consistency, and compliance.
• Analyze and troubleshoot complex data issues using Redshift SQL, MySQL, Python/PySpark, Shell scripting, and Excel.
• Investigate data mismatches, reporting issues, and business data anomalies.
• Support business analysis related to customer tiers, loyalty programs, and email marketability.
• Provide production support and root-cause analysis for critical data platform issues.
• Participate in Customer 360, Privacy, Data Governance, and Phaedon initiatives.
• Conduct code reviews and design reviews.
• Provide cross-team technical support and problem resolution.
• Research, design, and develop next-generation data capabilities and products.
• Act as a subject matter expert for customer data platforms.

Skills

AWS

Spark (Scala/Python)

ETL/ELT

Data governance

Privacy/compliance

DPO collaboration

SQL/PLSQL

Redshift

MySQL

Python

Tools

AWS Glue

AWS Lambda

S3

Hive

Apache Iceberg

Redshift SQL

MySQL

Python

Spark

Airflow

Job description

NTT DATA is seeking an experienced AWS ETL Data Engineer for a REMOTE role to design, develop, and support enterprise data platforms in Halifax, NS, Canada. The role combines data engineering, analytics, and governance to ensure privacy compliance while delivering scalable data solutions for reporting and customer engagement.

You will lead ETL/ELT development, optimize queries, and collaborate with business and technical teams to manage Data Subject Requests and data governance initiatives, with