Data Engineer

NTT DATA BUSINESS SOLUTIONS; Bengaluru; Hybrid; INR 1,500,000 - 2,600,000; Full time

Job summary

NTT DATA BUSINESS SOLUTIONS is seeking a seasoned Data Engineer to transform data into analytics-ready formats. You will design data models and develop scalable ETL pipelines, enabling reporting and data science capabilities across business units.

The role requires strong ETL, SQL, and cloud data platform experience, with collaboration across IT and business teams. Hybrid working arrangement offered in Bengaluru, with opportunities to work on ERP data migrations.

Qualifications

• Experience in data engineering and data mining in fast-paced environments.
• Ability to build modern analytics solutions on multi-terabyte data sets.
• Strong knowledge of data architecture, including physical and logical models.
• Proficiency with ETL tooling and scripting for automation.

Responsibilities

• Designs data models in structured formats for analysis.
• Develops scalable ETL packages from source systems and populates data.
• Contributes to database schemas within design constraints.
• Creates test scenarios and validates data transformations.
• Manages data migrations across databases and ERP systems like MS Dynamics, Oracle, SAP.
• Collaborates with IT and business teams to implement data models.
• Documents ETL and migration processes and roadmaps.
• Works with stakeholders to define scope and prioritize changes.

Skills

Analytical mindset

Problem-solving

Communication

Relationship-building

Attention to detail

Education

Bachelor's degree in computer science / software engineering / information technology

Certifications in SAP / Microsoft Azure preferred

Certified Data Engineer / Professional certification preferred

Tools

Microsoft Azure Data Factory

SQL Analysis Server

SAP Data Services

SAP BTP

Python

Perl

bash / Shell scripting

SQL / MySQL / Microsoft SQL

Excel (macros / pivots)

Job description

Make an impact with NTT DATA

Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.

Job Summary

The Data Engineer is a seasoned subject matter expert, responsible for the transformation of data into a structured format that can be easily analyzed in a query or report.

This role is responsible for developing structured data sets that can be reused or complimented by other data sets and reports.

This role analyzes the data sources and data structure and designs and develops data models to support the analytics requirements of the business which includes management / operational / predictive / data science capabilities.

Responsibilities

• Creates data models in a structured data format to enable analysis thereof.
• Designs and develops scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources,
• Participates in the transformation of object and data models into appropriate database schemas within design constraints.
• Interprets installation standards to meet project needs and produce database components as required.
• Creates test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations.
• Accountable for running data migrations across different databases and applications, for example MS Dynamics, Oracle, SAP and other ERP systems.
• Works across multiple IT and business teams to define and implement data table structures and data models based on requirements.
• Accountable for analysis, and development of ETL and migration documentation.
• Collaborates with various stakeholders to evaluate potential data requirements.
• Accountable for the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives.
• Collaborates with various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models.

Requirements

• Seasoned knowledge of the definition and management of scoping requirements, definition and prioritization activities.
• Seasoned understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models.
• Seasoned expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP.
• Seasoned understanding of data architecture landscape between physical and logical data models
• Analytical mindset with excellent business acumen skills.
• Problem-solving aptitude with the ability to communicate effectively, both written and verbal.
• Ability to build effective relationships at all levels within the organization.
• Seasoned expert in programing languages (Perl, bash, Shell Scripting, Python, etc.).

Qualifications

• Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field.
• Relevant certifications preferred such as SAP, Microsoft Azure etc.
• Certified Data Engineer, Certified Professional certification preferred.

Experience

• Seasoned experience as a data engineering, data mining within a fast-paced environment.
• Proficient in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale.
• Seasoned experience with architecture and design of secure, highly available and scalable systems.
• Seasoned proficiency in automation, scripting and proven examples of successful implementation.
• Seasoned proficiency using scripting language (Perl, bash, Shell Scripting, Python, etc.).
• Seasoned experience with big data tools like Hadoop, Cassandra, Storm etc.
• Seasoned experience in any applicable language, preferably .NET.
• Seasoned proficiency in working with SAP, SQL, MySQL databases and Microsoft SQL.
• Seasoned experience working with data sets and ordering data through MS Excel functions, e.g. macros, pivots.

Workplace type

Hybrid Working