Data Engineer

Tekskills; Bulandshahr; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Tekskills is seeking a data engineering specialist to design and optimize large-scale data pipelines using Airflow and AWS services. The role emphasizes Redshift-based warehousing, efficient ETL/ELT processes, and robust data modeling.

You will work closely with telecom datasets, ensure data quality in production, and support analytics initiatives through SQL and Python automation. Agile collaboration and clear stakeholder communication are essential.

Qualifications

• Proficient in AWS services including Redshift, S3, EC2, Lambda and Glue of AWS for data engineering.
• Hands-on experience with Redshift data warehousing and optimization techniques.
• Strong SQL skills for querying and data manipulation in data warehouses (Redshift).
• Experience in building scalable ETL/ELT pipelines using Airflow for orchestration.
• Knowledge of data warehousing concepts and data modeling best practices.
• Nice to have DataVault methodology and scalable data models.
• Prior Telecom domain experience is a significant advantage for understanding data and processes.
• Experience in production support, incident resolution, and data quality troubleshooting.
• Strong Python skills for automation and integration tasks; Agile environment experience.
• Excellent communication to interact with stakeholders and translate tech concepts for business needs.

Responsibilities

• Maintain and build data pipelines for large-scale processing with Airflow.
• Design and implement data warehousing schemas and data models for analytics.
• Troubleshoot production issues and resolve data quality incidents promptly.
• Collaborate with stakeholders to translate requirements into technical specifications.
• Provide support across AWS data stack (Redshift, S3, Glue) and related services.

Skills

Python programming

AWS (Redshift, S3, EC2, Lambda, Glue)

ETL/ELT design

SQL

Airflow

Data warehousing

Data modeling

Data Vault (nice to have)

Telecom domain

Production support

Agile

Communication skills

Tools

Airflow

Redshift

S3

EC2

Lambda

Glue

DataVault

Job description

Role & responsibilities

• Offers/ Pipelines

Job Description:

Required Skills & Experience:

• Cloud Technologies (AWS):
  • Strong technical expertise with AWS services, specifically Redshift and Airflow for data engineering and orchestration.
  • Hands-on experience in Redshift for data warehousing and optimization.
  • Familiarity with AWS services like S3, EC2, Lambda, and Glue.
• Data Engineering & ETL/ELT Processes:
  • Solid understanding of ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes.
  • Experience in building scalable and efficient data pipelines to handle large-scale data processing using Airflow for orchestration.
  • Proficiency in SQL for querying and manipulating data in data warehouses, including Redshift.
• Data Warehousing & Data Modeling:
  • Strong background in data warehousing concepts and best practices.
  • Experience in data modeling, including designing and implementing schema for data warehousing solutions.
• DataVault Knowledge (Good to Have):
  • DataVault methodology knowledge is a plus. Understanding how to build scalable and flexible data models using the DataVault approach.
• Telecom Domain Expertise:
  • Prior experience working in the Telecom industry is a significant advantage. Familiarity with Telecom data, network operations, and relevant business processes.
• Incident Resolution & Production Support:
  • Ability to work in production support environments, resolve incidents, and troubleshoot data pipeline failures or data quality issues.
  • Flexibility to work during European Shift timings (till 9:30 PM/10:30 PM IST).
• Programming & Scripting:
  • Strong Python skills for automation, data processing, and integration tasks.
  • Experience with Airflow core concepts, operators, and building workflows for data pipeline orchestration.
• Agile Methodologies:
  • Comfortable working in an Agile environment, participating in sprint cycles, and contributing to iterative development.
• Communication & Customer Skills:
  • Excellent communication skills with the ability to interact with stakeholders and customers.
  • Ability to translate technical concepts into business-friendly language and manage customer expectations.

Preferred candidate profile