Business Intelligence Specialist

NTT DATA, Inc.; Indianapolis (IN); On-site; USD 110,000 - 150,000; Full time

Job summary

NTT DATA, Inc. is seeking an experienced Data Engineer to design and maintain scalable data pipelines using DBT, Airflow, and Python. The role emphasizes ETL/ELT development, data quality, and collaboration with stakeholders to deliver analytics-ready data.

You will work with Snowflake, AWS services, and other cloud data warehouses to build enterprise-grade data solutions, ensuring performance and reliability across pipelines.

Qualifications

• Minimum 5+ years of data engineering experience.
• Hands-on with DBT, Airflow, and Python for ETL/ELT.
• Strong SQL skills and data modeling knowledge.
• Experience with enterprise-scale pipelines and Git versioning.

Responsibilities

• Design and maintain scalable ETL/ELT pipelines using Python, DBT, and Airflow.
• Develop DBT models, tests, and macros for data transformation.
• Manage Airflow DAGs for orchestration, scheduling, and monitoring.
• Implement data quality checks and reconciliation across pipelines.
• Collaborate with architects, analysts, and stakeholders to meet data needs.
• Work with JSON/CSV/Parquet formats and integrate data sources into warehouses.
• Troubleshoot pipeline failures and optimize performance.
• Follow best practices for coding, version control, testing, and deployment.

Skills

DBT

Airflow

Python

SQL

ETL/ELT

Data Modeling

Git

Cloud Data Platforms

Education

Bachelor's degree

Tools

Snowflake

Redshift

BigQuery

AWS

Job description

Job Description: Data Engineer (DBT + Airflow + Python) | 5+ Years

Role: Data Engineer

Experience: 5+ Years

Location: Bengaluru/Gurgaon

Employment Type: Full-Time

Job SummaryWe are looking for an experienced Data Engineer with strong expertise in DBT, Apache Airflow, and Python to design, develop, and maintain scalable data pipelines and transformation frameworks. The ideal candidate will have hands-on experience in building modern data platforms, workflow orchestration, ETL/ELT development, and cloud-based data warehousing solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python, DBT, and Apache Airflow.
• Build and manage Airflow DAGs for workflow orchestration, scheduling, monitoring, and dependency management.
• Develop reusable and optimized DBT models, snapshots, tests, and macros for data transformation.
• Implement data quality checks, validation frameworks, and reconciliation processes across data pipelines.
• Develop and optimize Python scripts for data ingestion, transformation, automation, and exception handling.
• Work with structured and semi-structured data formats such as JSON, CSV, and Parquet.
• Integrate data from multiple sources into enterprise data warehouses and analytics platforms.
• Monitor, troubleshoot, and resolve data pipeline failures and performance bottlenecks.
• Collaborate with Data Architects, Analysts, and Business stakeholders to understand and deliver data requirements.
• Ensure adherence to best practices around coding standards, version control, testing, and deployment.
• Participate in production support, incident resolution, and root cause analysis activities.

Mandatory Skills

• 5+ years of experience in Data Engineering.
• Strong hands-on experience with DBT (Data Build Tool).
• Strong experience with Apache Airflow including DAG development, scheduling, monitoring, and workflow orchestration.
• Proficiency in Python for ETL development, automation, and data processing.
• Strong SQL skills with experience in writing complex queries and performance tuning.
• Experience developing and supporting enterprise-scale ETL/ELT pipelines.
• Knowledge of data modeling concepts including Star Schema and Dimensional Modeling.
• Experience with Git-based version control systems.

Preferred Skills

• Experience with Snowflake, Redshift, BigQuery, or other cloud data warehouses.
• Experience with AWS services such as S3, Glue, Lambda, or EMR.
• Exposure to CI/CD pipelines and DevOps practices.
• Experience working in Agile/Scrum environments.
• Familiarity with data quality, governance, and observability frameworks.

Nice to Have

• Snowflake Streams, Tasks, Snowpipe.
• DBT Cloud.
• PySpark or Spark.
• Terraform or Infrastructure as Code.
• Monitoring and alerting tools.

Qualification

Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.

Key Skills

DBT, Apache Airflow, Python, SQL, ETL, ELT, Data Engineering, Snowflake, AWS, Data Warehousing, Data Modeling, CI/CD, Git, Cloud Data Platforms.