Business Intelligence Specialist

NTT DATA, Inc.; Bengaluru; On-site; INR 1,200,000 - 2,200,000; Full time

Job summary

NTT DATA, Inc. is seeking an experienced Data Engineer in Bengaluru to design, build, and maintain scalable data pipelines using DBT, Apache Airflow, and Python. You will work across ETL/ELT development, workflow orchestration, and cloud-based data warehousing to deliver robust data platforms.

You will implement data quality checks, develop optimized DBT models, and collaborate with architects, analysts, and stakeholders to ensure data requirements are met in a fast-paced, Agile environment.

Qualifications

• 5+ years of data engineering experience.
• Hands-on with DBT, Airflow, Python.
• SQL with complex queries and tuning.
• Experience with Snowflake or cloud data warehouses.
• Knowledge of ETL/ELT and data modeling.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Python, DBT, and Airflow.
• Build and manage Airflow DAGs for workflow orchestration and monitoring.
• Develop reusable DBT models, snapshots, tests, and macros for data transformation.
• Implement data quality checks and reconciliation across pipelines.
• Develop Python scripts for ingestion, transformation, automation, and error handling.
• Handle JSON, CSV, Parquet data formats and integrate data sources into data warehouses.
• Monitor and troubleshoot pipeline failures and performance bottlenecks.
• Collaborate with Data Architects, Analysts, and stakeholders to meet data requirements.

Skills

DBT

Airflow

Python

SQL

ETL/ELT

Data Modeling

Git

Cloud Platforms

Snowflake

AWS

Data Warehousing

Education

Bachelors in CS/IT/Engineering

Tools

Snowflake

BigQuery

Redshift

CI/CD

Job description

Job Description: Data Engineer (DBT + Airflow + Python) | 5+ Years

Job Summary

We are looking for an experiencedData Engineerwith strong expertise inDBT, Apache Airflow, and Pythonto design, develop, and maintain scalable data pipelines and transformation frameworks. The ideal candidate will have hands-on experience in building modern data platforms, workflow orchestration, ETL/ELT development, and cloud-based data warehousing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines usingPython, DBT, and Apache Airflow.
• Build and manage Airflow DAGs for workflow orchestration, scheduling, monitoring, and dependency management.
• Develop reusable and optimized DBT models, snapshots, tests, and macros for data transformation.
• Implement data quality checks, validation frameworks, and reconciliation processes across data pipelines.
• Develop and optimize Python scripts for data ingestion, transformation, automation, and exception handling.
• Work with structured and semi-structured data formats such as JSON, CSV, and Parquet.
• Integrate data from multiple sources into enterprise data warehouses and analytics platforms.
• Monitor, troubleshoot, and resolve data pipeline failures and performance bottlenecks.
• Collaborate with Data Architects, Analysts, and Business stakeholders to understand and deliver data requirements.
• Ensure adherence to best practices around coding standards, version control, testing, and deployment.
• Participate in production support, incident resolution, and root cause analysis activities.

Mandatory Skills

• 5+ years of experience in Data Engineering.
• Strong hands-on experience withDBT (Data Build Tool).
• Strong experience withApache Airflowincluding DAG development, scheduling, monitoring, and workflow orchestration.
• Proficiency inPythonfor ETL development, automation, and data processing.
• Strong SQL skills with experience in writing complex queries and performance tuning.
• Experience developing and supporting enterprise-scale ETL/ELT pipelines.
• Knowledge of data modeling concepts including Star Schema and Dimensional Modeling.
• Experience with Git-based version control systems.

Preferred Skills

• Experience withSnowflake, Redshift, BigQuery, or other cloud data warehouses.
• Experience with AWS services such as S3, Glue, Lambda, or EMR.
• Exposure to CI/CD pipelines and DevOps practices.
• Experience working in Agile/Scrum environments.
• Familiarity with data quality, governance, and observability frameworks.

Nice to Have

• Snowflake Streams, Tasks, Snowpipe.
• DBT Cloud.
• PySpark or Spark.
• Terraform or Infrastructure as Code.
• Monitoring and alerting tools.

Qualification

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.

Key Skills

DBT, Apache Airflow, Python, SQL, ETL, ELT, Data Engineering, Snowflake, AWS, Data Warehousing, Data Modeling, CI/CD, Git, Cloud Data Platforms.

Job Segment: Business Intelligence, Data Warehouse, SQL, Database, Computer Science, Technology