Sr Data Engineer

NTT DATA North America; Plano (TX); On-site; USD 100,000 - 150,000; Full time

Job summary

An innovative firm is seeking a Sr Data Engineer to join its dynamic team in Plano, Texas. This role involves designing and developing scalable data pipelines, utilizing cutting-edge technologies such as Azure and Databricks. The ideal candidate will have extensive experience in data engineering and a strong background in programming languages like Python and Java. You will play a crucial role in implementing data validation processes and building robust data platforms for real-time applications. Join a forward-thinking organization that values creativity and offers opportunities for professional growth.

Qualifications

• 7+ years of experience in data engineering and software development.
• Expertise in designing scalable data pipelines and ETL processes.

Responsibilities

• Design and develop scalable data pipelines using Azure and Databricks.
• Implement data validation and cleansing processes.

Skills

Data Engineering

Software Development

Python

Databricks

ETL Processes

Agile Methodologies

SQL

NoSQL

Data Modeling

Azure Technologies

Tools

Azure Data Factory

Azure Databricks

Azure SQL Database

Azure Data Lake Storage

Azure Cosmos DB

Azure DevOps

Spark / PySpark

Git

Job description

Join to apply for the Sr Data Engineer role at NTT DATA North America

Company Overview

NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Sr Data Engineer to join our team in Plano, Texas (US-TX), United States (US).

Job Description

Responsibilities include designing and developing scalable data pipelines, working with Azure and Databricks technologies, and implementing data validation and cleansing processes.

Qualifications

• 7+ years of professional experience in data engineering and software development roles
• Experience in Medallion Architecture, Databricks Development, and building robust data platforms for streaming / real-time applications
• Hands-on experience with PySpark and Python, including multiple libraries
• Great understanding of data movement, validation, cleansing, etc.
• Proven track record in Agile software product development
• 5+ years in programming languages like Python, Java, or Scala
• Extensive experience with Databricks and Azure
• Experience with other data technologies such as Hadoop, Spark, Kafka (plus)
• Strong understanding of database technologies (SQL and NoSQL) and data modeling
• Expertise in designing scalable data pipelines and ETL processes
• Experience developing APIs for data access and integration
• Strong understanding of software engineering principles, design patterns, and version control

Critical Technologies for This Role

• Azure Data Factory (ADF)
• Azure Databricks
• Azure SQL Database
• Azure Data Lake Storage (ADLS)
• Azure Cosmos DB
• Azure DevOps
• Python
• SQL
• Spark / PySpark
• ETL Pipelines
• Data Modeling

Additional Technologies

• Scala
• Advanced Scripting with Bash/Powershell
• Object-Oriented Programming (OOP)
• Functional Programming
• Test-Driven Development (TDD)
• Clean Code Principles
• Version Control (Git)

Minimum Skills Required

• 3+ years of Python development
• 3+ years with Databricks
• 2+ years of ETL pipeline development

About NTT DATA

NTT DATA is a $30 billion global leader in business and technology services, serving 75% of the Fortune Global 100, with a presence in over 50 countries. We focus on innovation, digital transformation, and AI infrastructure.

For more information, visit us.nttdata.com.