Data Engineer

Bdreamz Global Solutions; Chennai; Hybrid; INR 1,200,000 - 2,200,000; Full time

Job summary

Bdreamz Global Solutions in Chennai, India is seeking skilled Data Engineers to design, develop, and maintain scalable data pipelines and ETL processes. The role requires hands-on Python, SQL, PySpark, and cloud platform experience to deliver robust data engineering solutions.

Ideal candidates will work with Databricks, AWS/Azure, and data warehouses in distributed computing environments, ensuring data quality and reliable processing while collaborating with analysts, scientists, architects, and

Qualifications

• 2 to 7 years of relevant experience in Data Engineering.
• Strong hands-on experience with Python, SQL, and data processing.
• Experience building ETL pipelines and working with large datasets.
• Knowledge of cloud-based data engineering solutions (AWS / Azure).
• Good analytical, troubleshooting, and problem-solving skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Develop data processing solutions using Python, PySpark, and Apache Spark.
• Write optimized SQL queries and perform complex data transformations.
• Work with large datasets, data warehouses, and distributed computing environments.
• Build and manage data integration and processing solutions.
• Work with cloud-based data engineering platforms such as AWS and Azure.
• Develop and maintain data workflows using Databricks and related technologies.
• Ensure data quality, accuracy, performance, and reliability.
• Collaborate with data analysts, data scientists, architects, and development teams.

Skills

Python Programming

Advanced SQL

PySpark / Apache Spark

ETL / ELT Development

Data Warehousing

Data Pipeline Development

Data Integration

AWS / Azure Cloud

Databricks

Tools

Databricks

AWS / Azure Cloud

Hadoop / Big Data Technologies

Snowflake

Delta Lake

Apache Airflow

Job description

Job Overview

We are looking for skilled Data Engineers with hands-on experience in designing, developing, and maintaining scalable data pipelines, ETL processes, and data engineering solutions.

The ideal candidate should have strong knowledge of Python, SQL, PySpark, cloud platforms, and modern data engineering technologies.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Develop data processing solutions using Python, PySpark, and Apache Spark.
• Write optimized SQL queries and perform complex data transformations.
• Work with large datasets, data warehouses, and distributed computing environments.
• Build and manage data integration and processing solutions.
• Work with cloud-based data engineering platforms such as AWS and Azure.
• Develop and maintain data workflows using Databricks and related technologies.
• Ensure data quality, accuracy, performance, and reliability.
• Collaborate with data analysts, data scientists, architects, and development teams.

Required Technical Skills

• Python Programming
• Advanced SQL
• PySpark / Apache Spark
• ETL / ELT Development
• Data Warehousing
• Data Pipeline Development
• Data Integration
• AWS / Azure Cloud
• Databricks

Good to Have Skills

• AWS Glue, S3, Redshift
• Azure Data Factory
• Delta Lake
• Apache Airflow
• Hadoop / Big Data Technologies
• Snowflake
• CI/CD and Git

Eligibility

• 2 to 7 years of relevant experience in Data Engineering.
• Strong hands-on experience in Python, SQL, and data processing.
• Experience developing ETL pipelines and working with large datasets.
• Knowledge of cloud-based data engineering solutions.
• Good analytical, troubleshooting, and problem-solving skills.