Consultant Data Engineer

Crescendo Global Leadership Hiring India; Bengaluru; Hybrid; INR 2,400,000 - 3,600,000; Full time

Job summary

Crescendo Global is recruiting a Consultant Data Engineer in Bengaluru to design, build, and optimize scalable data solutions across ETL/ELT, cloud platforms, and big data technologies. The role emphasizes data warehousing, data lakes, and production data infrastructure while collaborating with cross-functional teams.

You will need 5+ years of experience in data engineering, strong SQL and Python skills, and hands-on AWS experience.

Qualifications

• 5+ years of experience in Data Engineering or a related role.
• Strong proficiency in SQL and Python, with Scala/Java experience also considered.
• Hands-on experience with AWS cloud platforms.
• Experience with big data technologies such as Spark, Kafka, or dbt.
• Strong understanding of data warehousing concepts and dimensional modeling.
• Good understanding of CI/CD and Git/version control.

Responsibilities

• Design, build, and optimize ETL/ELT pipelines for batch and streaming data.
• Develop and maintain data warehouses and data lakes.
• Build and manage data orchestration workflows.
• Implement data modeling, partitioning, and performance-tuning best practices.
• Monitor and troubleshoot data infrastructure issues in production.

Skills

SQL

Python

Scala/Java

Dimensional Modeling

CI/CD

Git/version control

AWS

Spark

Kafka

dbt

Tools

AWS

Spark

Kafka

dbt

Git

Job description

Consultant Data Engineer 5+ years - Bangalore

Location: Bengaluru

An exciting opportunity for a Consultant Data Engineer to design, build, and optimize scalable data solutions. The role involves working across data engineering, ETL/ELT, cloud platforms, big data technologies, data warehousing, and production data infrastructure.

Your Future Employer

A leading global AI and analytics organization working on data engineering, advanced analytics, data governance, MLOps, and Generative AI solutions. The organization offers a collaborative environment where professionals can work on complex data challenges and continuously develop their expertise.

Responsibilities

1. Design, build, and optimize ETL/ELT pipelines for batch and streaming data.
2. Develop and maintain data warehouses and data lakes.
3. Build and manage data orchestration workflows.
4. Implement data modeling, partitioning, and performance-tuning best practices.
5. Monitor and troubleshoot data infrastructure issues in production.

Requirements

1. 5+ years of experience in Data Engineering or a related role.
2. Strong proficiency in SQL and Python, with Scala/Java experience also considered.
3. Hands-on experience with AWS cloud platforms.
4. Experience with big data technologies such as Spark, Kafka, or dbt.
5. Strong understanding of data warehousing concepts and dimensional modeling.
6. Good understanding of CI/CD and Git/version control.

What is in it for you?

• Opportunity to work on large-scale data engineering initiatives.
• Exposure to cloud, big data, streaming, and modern data platforms.
• Opportunity to work with cross-functional teams including data scientists, analysts, and product teams.
• Collaborative environment focused on continuous learning and innovation.

Crescendo Global does not discriminate on the basis of race, religion, color, origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

We receive a large number of applications daily, so it may not be possible to respond to every candidate. Please assume that your profile has not been shortlisted if you do not hear from us within one week. Your patience is highly appreciated.

Profile Keywords: Consultant Data Engineer, Data Engineer, Data Engineering Jobs, Bengaluru Jobs, ETL, ELT, Python, SQL, AWS, Spark, Kafka, dbt, Data Warehouse, Data Lake, Data Modeling, CI/CD, Git, Streaming Data, Big Data Jobs