Data Engineer

Concentrix

Bengaluru

Presencial

INR 1 500 000 - 2 500 000

Tempo integral

Há 4 dias
Torna-te num dos primeiros candidatos

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Concentrix is seeking an experienced Data Engineer in Bengaluru to design, develop, and optimize scalable data solutions using Azure Databricks and Delta Lake. You will build robust ETL/ELT pipelines, implement data quality checks, and collaborate with cross-functional teams to translate requirements into production-grade data systems.

The role emphasizes cloud-based data platforms, performance optimization, and DevOps practices in a security-conscious environment across multiple business units.

Qualificações

  • 4–6 years of relevant experience in data engineering and cloud-based data platforms.
  • Strong hands-on experience with Azure Databricks, PySpark, Apache Spark, Python, and advanced SQL.
  • Proven expertise in developing scalable ETL/ELT pipelines for batch and large-scale data processing.
  • Solid understanding of Delta Lake, including ACID transactions, schema evolution, and table optimization.
  • Experience with Azure data services such as Azure Data Lake Storage and Azure Data Factory.
  • Strong knowledge of Spark and Databricks performance optimization, including partitioning, caching, join strategies, shuffle optimization, and cluster configuration.
  • Experience with Git-based version control, CI/CD pipelines, and DevOps practices for automated deployment across environments.
  • Good understanding of data quality, security, monitoring, troubleshooting, and production support.

Responsabilidades

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Databricks, PySpark, Python, and SQL.
  • Build and optimize batch and large-scale data-processing solutions using Apache Spark.
  • Develop data ingestion and transformation workflows for structured and semi-structured data.
  • Implement reliable data-processing frameworks using Delta Lake capabilities.
  • Perform data cleansing, validation, reconciliation, and quality checks to ensure accuracy and consistency.
  • Optimize Spark jobs, Databricks notebooks, SQL queries, clusters, and data pipelines for performance and cost efficiency.
  • Troubleshoot pipeline failures, data-quality issues, production incidents, and performance bottlenecks.
  • Implement incremental data processing, partitioning, caching, join optimization, and file-management techniques.
  • Develop reusable and configurable data-engineering components.
  • Implement version control and automated deployment processes using CI/CD and DevOps practices.
  • Collaborate with data architects, analysts, application teams, and business stakeholders to translate requirements into technical solutions.
  • Maintain technical documentation covering pipeline architecture, transformation logic, dependencies, and operational procedures.
  • Ensure solutions comply with organizational standards for security, governance, monitoring, and data protection.

Conhecimentos

Azure Databricks
PySpark
Apache Spark
Python
SQL

Ferramentas

Delta Lake
Azure Data Lake Storage
Azure Data Factory
Git
CI/CD

Descrição da oferta de emprego

Job Title: Data Engineer Job Description

We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled. The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we’re the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with. We shape new game-changing careers in over 70 countries, attracting the best talent. In our Information Technology and Global Security team, you will deliver the latest technology infrastructure, transformative software solutions and industry-leading global security for our staff and clients. You will work with the best in the world to design, implement and strategize IT, security, application development, innovation, and solutions in today’s hyperconnected world. You will be part of the technology team that is core to our vision of develop, build and run the future of Integrated Services. Our game-changers around the world have devoted their careers to ensuring every relationship is exceptional. And we’re proud to be recognized with awards such as "World's Best Workplaces," “Best Companies for Career Growth,” and “Best Company Culture,” year after year. We embrace our game-changers with open arms, people from diverse backgrounds, who are curious and willing to learn. Your natural talent to help others and go beyond WOW for our customers will fit right in with what we do and who we are. Join us and be part of this journey towards greater opportunities and brighter futures.

Job Overview

We are seeking an experienced and results-driven Data Engineer with 4–6 years of relevant experience in designing, developing, and optimizing scalable data solutions using Azure Databricks and related technologies. The ideal candidate should have strong hands‑on expertise in Azure Databricks, PySpark, Apache Spark, SQL, Python, ETL/ELT development, Delta Lake, Azure cloud services, CI/CD, and performance optimization. The role requires practical experience in building reliable, secure, and production‑grade data pipelines.

Key Responsibilities
  • Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Databricks, PySpark, Python, and SQL.
  • Build and optimize batch and large‑scale data‑processing solutions using Apache Spark.
  • Develop data ingestion and transformation workflows for structured and semi‑structured data.
  • Implement reliable data‑processing frameworks using Delta Lake capabilities.
  • Perform data cleansing, validation, reconciliation, and quality checks to ensure accuracy and consistency.
  • Optimize Spark jobs, Databricks notebooks, SQL queries, clusters, and data pipelines for performance and cost efficiency.
  • Troubleshoot pipeline failures, data‑quality issues, production incidents, and performance bottlenecks.
  • Implement incremental data processing, partitioning, caching, join optimization, and file‑management techniques.
  • Develop reusable and configurable data‑engineering components.
  • Implement version control and automated deployment processes using CI/CD and DevOps practices.
  • Collaborate with data architects, analysts, application teams, and business stakeholders to translate requirements into technical solutions.
  • Maintain technical documentation covering pipeline architecture, transformation logic, dependencies, and operational procedures.
  • Ensure solutions comply with organizational standards for security, governance, monitoring, and data protection.
Required Technical Skills
  • 4–6 years of relevant experience in data engineering and cloud‑based data platforms.
  • Strong hands‑on experience with Azure Databricks, PySpark, Apache Spark, Python, and advanced SQL.
  • Proven expertise in developing scalable ETL/ELT pipelines for batch and large‑scale data processing.
  • Solid understanding of Delta Lake, including Delta tables, ACID transactions, schema evolution, merge/upsert operations, and table optimization.
  • Experience with Azure data services such as Azure Data Lake Storage and Azure Data Factory.
  • Strong knowledge of Spark and Databricks performance optimization, including partitioning, caching, join strategies, shuffle optimization, file sizing, and cluster configuration.
  • Experience with Git‑based version control, CI/CD pipelines, and DevOps practices for automated deployment across environments.
  • Good understanding of data quality, security, monitoring, troubleshooting, and production support.
Location

IND Bangalore - MTP C4, 3rd Flr

Time Type

Full time

Mission

Hi, we're Concentrix. We’re a global technology and services leader that powers the brands of the future. We help well-known brands — the ones you use every day — improve their businesses with technology and integrated solutions, in over 70 countries.

Company Overview

We power the brands of the future. Some call us a global technology and services leader. But we’re so much more. Human-centered, tech-powered, intelligence fuelled. Every day we’re busy helping over 2000 of the world's best brands solve their toughest business challenges. Whether it’s…… designing game‑changing brand experiences, building and scaling secure AI technologies, or building loyalty to drive revenue. We’ve got them covered. But how? We design, build, and run fully integrated, end‑to‑end solutions across the entire enterprise, at speed and scale. We’re the strategic thinkers who design brand‑defining experiences. The technologists & engineers who build smarter solutions. And the operational experts who run it all and make it work seamlessly. By integrating strategy & design with data & analytics, enterprise technology, and digital operations. You could say, at the heart of everything we do lies a commitment to transform the way companies connect, interact, and grow across the world and into the future.

Concentrix CVG Corporation is an EEO/AA/M/F/Vet/Disability Employer.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer / Data Scientist
Data Engineer / Data Scientist

Concentrix • Bengaluru

Teletrabalho
INR 900 000 - 1 400 000
Data Engineer
Data Engineer

Cnx • Bengaluru

Presencial
INR 1 200 000 - 1 500 000
Data Engineer
Data Engineer

Concentrix • Hyderabad

Híbrido
INR 800 000 - 1 200 000
Data Engineer
Data Engineer

Accenture PLC • Pune District

Presencial
INR 1 400 000 - 2 000 000
Snowflake Data Engineer
Snowflake Data Engineer

Persistent Systems • Pune

Híbrido
INR 2 800 000 - 4 400 000
Competitive compensation & benefits
Talent development & education Spons
Cutting-edge technologies
+4
Data Engineer
Data Engineer

Cornerstone OnDemand • Hyderabad

Presencial
INR 1 200 000 - 2 400 000
Databricks
Databricks

Infosys • Bengaluru

Presencial
INR 3 000 000 - 5 500 000
Azure Data Engineer
Azure Data Engineer

Persistent Systems • Mumbai

Híbrido
INR 1 200 000 - 2 000 000
Higher education sponsorship
Flexible work hours
Long Service awards
+1
Data Platform Engineer
Data Platform Engineer

Accenture PLC • Indore District

Presencial
INR 1 200 000 - 2 400 000
IN_Senior Associate_ Databricks Senior Data Engineer_GCC_Advisory_Bangalore
IN_Senior Associate_ Databricks Senior Data Engineer_GCC_Advisory_Bangalore

PwC • Bengaluru

Presencial
INR 1 800 000 - 2 400 000