Data Engineer

Razorthink

Chennai, Bengaluru, Delhi

Híbrido

INR 1 500 000 - 2 100 000

Tempo integral

Há 5 dias
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Razorthink is seeking a Data Engineer to handle the collection, storage, processing, and analysis of large datasets. You will select optimal Big Data tools, implement ETL processes, and integrate these components with the existing architecture across the company.

The role emphasizes Python development, Spark-based transformations, and distributed computing concepts to ensure scalable data pipelines and reliable analytics platforms.

Qualificações

  • 3+ years of data engineering experience required.
  • Proficient in Python programming.
  • Strong understanding of distributed computing principles.
  • Experience with Spark SQL, Spark DataFrames, and data integration across sources.

Responsabilidades

  • Select and integrate Big Data tools and frameworks to provide required capabilities.
  • Implement ETL processes, including data import and transformation.
  • Develop Data API transformations using Spark and Hadoop clusters.

Conhecimentos

Python
LLMs
Distributed computing
Spark SQL
Spark DataFrames
Data integration
MySQL
Cassandra
MongoDB
Lambda Architecture

Descrição da oferta de emprego

We are looking for a Data Engineer with 3 years of expreience that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

Responsibilities
  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
  • Implementing ETL process like importing data etc.
  • Implementing Data API transformations using Spark and Hadoop cluster
Skills and Qualifications
  • Proficient in Python programming
  • Working knowledge with LLM's should be good to have Skill set
  • Proficient understanding of distributed computing principles
  • Experience with Spark SQL, Python, Spark Data frames.
  • Experience with integration of data from multiple data sources
  • Experience with SQL and NoSQL databases such as MySQL, Cassandra, MongoDB
  • Good understanding of Lambda Architecture/Functional programming,
    along with its advantages and drawbacks
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer
Data Engineer

Indium Software • Bengaluru

Presencial
INR 900 000 - 1 500 000
Data Engineer
Data Engineer

PW (PhysicsWallah) • Dadri

Presencial
INR 900 000 - 1 300 000
Data Engineer - Data Warehouse, BigData, Python and SQL
Data Engineer - Data Warehouse, BigData, Python and SQL

Tech ECS Limited • Kolkata District

Presencial
INR 1 400 000 - 2 100 000
Data Engineer
Data Engineer

Grid Dynamics • Bengaluru

Híbrido
INR 900 000 - 1 400 000
Data Engineer
Data Engineer

Imagevision • Hyderabad

Presencial
INR 1 200 000 - 1 800 000
BigData Engineer
BigData Engineer

Global Infovision Private Limited • Chennai

Presencial
INR 900 000 - 1 500 000
Data Engineer
Data Engineer

Bacancy Technology Inc • Ahmedabad District

Presencial
INR 1 500 000 - 3 000 000
Data Engineer
Data Engineer

Orangebitsindia • Chennai District

Presencial
INR 1 000 000 - 2 100 000
Data Engineer
Data Engineer

Wenger & Watson • Nagpur District

Presencial
INR 900 000 - 1 500 000
Data Engineer
Data Engineer

Coltigent Technology Services Pvt Ltd • Pune District

Presencial
INR 800 000 - 1 200 000