AWS ETL Data Engineer - HYBRID

NTT DATA, Inc.; Memphis (TN); Hybrid; USD 98,000 - 163,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Paid time off

Flexible spending or HSA

AD&D and life insurance

Job summary

NTT DATA is seeking a highly experienced data engineering leader to design, develop, and maintain scalable data pipelines using Spark (Scala/Python), AWS Glue and Lambda. You will optimize Redshift SQL/PLSQL, support ETL/ELT processes, and ensure data governance and privacy across multiple data sources.

With 12+ years in data warehouses/big data and 5+ years in a lead role, you will collaborate with business and technical teams to deliver enterprise data solutions and drive customer insights

Qualifications

• 12+ years of experience in Data Warehouse / Big Data ecosystems.
• 5+ years in a lead / SME role.
• 5+ years with AWS architecture and data engineering (S3, EC2, Redshift RA3/Serverless, S3 Hive, AWS Glue, Lambda, Kafka, Airflow, Iceberg).
• 3+ years with Spark (Scala/Python).
• 5+ years with SQL/PLSQL, MySQL.
• Strong understanding of ETL/ELT frameworks, distributed data processing, data governance and security.

Responsibilities

• Design, build, and maintain scalable data pipelines using Spark, AWS Glue, and Lambda.
• Develop and optimize Redshift SQL/PLSQL code, stored procedures, and data-processing frameworks.
• Perform query tuning and data-sharing implementations across AWS platforms (S3, Hive, Iceberg, Redshift).
• Integrate multiple data sources to support reporting, analytics, and customer engagement initiatives.
• Lead cross-team collaboration and contribute to data governance and privacy initiatives.

Skills

Spark (Scala/Python)

AWS Glue

AWS Lambda

Shell scripting

Redshift SQL/PLSQL

MySQL

Data Modeling

Query Optimization

ETL/ELT

Data governance

Education

Bachelor's degree in CS/IT

Tools

Apache Iceberg

Kafka

Airflow

Redshift

Job description

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Spark (Scala/Python), AWS Glue, AWS Lambda, and Shell scripting.
• Build and support ETL/ELT processes across AWS platforms, including S3, Hive, Apache Iceberg, and Amazon Redshift.
• Develop and maintain Redshift SQL/PLSQL code, stored procedures, and data-processing frameworks.
• Perform query tuning, performance optimization, and data-sharing implementations.
• Support ingestion and processing of structured and semi-structured data formats including JSON, CSV, XML, ORC, Parquet, and Avro.
• Design, enhance, and support solutions that provide a unified view of customer data across systems.
• Integrate multiple data sources, applications, and business processes to support reporting, analytics, and customer engagement initiatives.
• Collaborate with business and technical teams to define and implement scalable data solutions.
• Manage and support Data Subject Requests (DSRs), including customer data erasure requests.
• Work closely with the DPO team to ensure compliance with privacy regulations and internal policies.
• Maintain and support the MicroStrategy Privacy Compliance module. (Very infrequent once in year or 2 years)
• Contribute to data governance initiatives that improve data quality, consistency, and compliance.
• Analyze and troubleshoot complex data issues using Redshift SQL, MySQL, Python/PySpark, Shell scripting, and Excel.
• Investigate data mismatches, reporting issues, and business data anomalies.
• Support business analysis related to customer tiers, loyalty programs, and email marketability.
• Provide production support and root-cause analysis for critical data platform issues.

Technical Leadership & Collaboration

• Participate in Customer 360, Privacy, Data Governance, and Phaedon initiatives.
• Conduct code reviews and design reviews.
• Provide cross-team technical support and problem resolution.
• Research, design, and develop next-generation data capabilities and products.
• Act as a subject matter expert for customer data platforms.

Primary Technologies

• Spark (Scala/Python)
• Redshift SQL/PLSQL, MySQL
• Data Modeling and Query Optimization

Key Strengths

• Strong ownership and accountability
• Strong AWS Data Engineering stack awareness
• Ability to bridge business and technical teams
• Expertise across engineering, analytics, compliance, architecture, and operational support
• Adaptability and willingness to take on diverse data-related challenges
• 12+ years of experience in Data Warehouse / Big Data ecosystems.
• 5+ years in a lead /SME role
• 5+ years with AWS architecture and data engineering, including S3, EC2, Redshift (RA3/Serverless), S3 Tables, S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg
• 3+ years with Spark (Scala/Python)
• 5+ years with SQL/PLSQL, MySQL
• 5+ years strong understanding of:
• ETL/ELT frameworks
• Distributed data processing
• Data governance and security

Preferred Skills:

• Proven track record of delivering complex data programs.
• Excellent communication and stakeholder management abilities.
• Experience in large enterprise or global delivery environments.
• Exposure to data modernization and cloud transformation programs.
• Certifications in cloud platforms or data engineering.
• Experience in regulated industries (Hospitality, Finance, Healthcare, Telecom, etc.).

NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $97,725 – 162,875. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications.

This position may also be eligible for incentive compensation based on individual and/or company performance.

This position is eligible for company benefits including medical, dental, and vision insurance with an employer contribution, flexible spending or health savings account, lifeand AD&D insurance, short and long term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally-required benefits.

#LI-NorthAmerica

About NTT DATA

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners.NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.

Whenever possible, we hire locally to NTT DATA offices or client sites. This ensures we can provide timely and effective support tailored to each client’s needs. While many positions offer remote or hybrid work options, these arrangements are subject to change based on client requirements. For employees near an NTT DATA office or client site, in-office attendance may be required for meetings or events, depending on business needs. At NTT DATA, we are committed to staying flexible and meeting the evolving needs of both our clients and employees. NTT DATA recruiters will never ask for payment or banking information and will only use @nttdata.com, @nttdatafed.com and @talent.nttdataservices.com email addresses. If you are requested to provide payment or disclose banking information, please submit a contact us form, https://us.nttdata.com/en/contact-us .

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us . NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here . If you'd like more information on your EEO rights under the law, please click here . For Pay Transparency information, please click here .

Nearest Major Market: Memphis
Job Segment: Database, SQL, Telecom, Telecommunications, Business Analyst, Technology