Data Engineer

DemandMatrix

India

Presencial

INR 2 000 000 - 3 000 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

A leading data analytics firm in India is seeking a Director-level Data Engineer to oversee the architecture and maintenance of large-scale big data platforms. Candidates should have over 7 years of relevant experience and expertise in technologies like Apache Hadoop and PySpark. This full-time position offers a chance to work with cutting-edge data processing systems and drive innovation in data analytics.

Qualificações

  • 7+ years of experience architecting, developing, releasing, and maintaining large-scale big data platforms.
  • 5+ years proficiency in configuring and deploying applications on Linux-based systems.
  • Expertise with data processing systems including streaming, event, and batch.

Responsabilidades

  • Oversee the development and maintenance of big data platforms.
  • Implement data processing models and optimize feature extraction.

Conhecimentos

Apache Hadoop
PySpark
Python
Design patterns
Data Structures and Algorithms

Descrição da oferta de emprego

Join to apply for the Data Engineer role at DemandMatrix

This range is provided by DemandMatrix. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range
  • Only a solid grounding in computer engineering, Unix, data structures and algorithms would enable you to meet this challenge.
  • 7+ years of experience architecting, developing, releasing, and maintaining large-scale big data platforms on AWS or GCP.
  • Understanding of how Big Data tech and NoSQL stores like MongoDB, HBase/HDFS, ElasticSearch synergize to power applications in analytics, AI and knowledge graphs.
  • Understanding of how data processing models, data location patterns, disk IO, network IO, shuffling affect large scale text processing - feature extraction, searching etc.
  • Expertise with a variety of data processing systems, including streaming, event, and batch (Spark, Hadoop/MapReduce).
  • 5+ years proficiency in configuring and deploying applications on Linux-based systems.
  • 5+ years of experience Spark - especially Pyspark for transforming large non-structured text data, creating highly optimized pipelines.
  • Experience with RDBMS, ETL techniques and frameworks (Sqoop, Flume) and big data querying tools (Pig, Hive).
  • Stickler of world class best practices, uncompromising on the quality of engineering, understand standards and reference architectures and deep in Unix philosophy with appreciation of big data design patterns, orthogonal code design and functional computation models.
  • Skills:- Apache Hadoop, PySpark, Python, Design patterns, Data Structures and Algorithms.
Seniority level

Director

Employment type

Full-time

Job function

Information Technology

Industries

IT Services and IT Consulting

Referrals increase your chances of interviewing at DemandMatrix by 2x

Get notified about new Data Engineer jobs in India.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer - Python / Big Data
Data Engineer - Python / Big Data

Kreditbee • Bengaluru

Presencial
INR 1 800 000 - 2 400 000
Big Data Developer
Big Data Developer

Demandbase • Hyderabad

Presencial
INR 1 200 000 - 1 800 000
Data Engineer
Data Engineer

Orangebitsindia • Chennai District

Presencial
INR 1 000 000 - 2 100 000
Data Engineer
Data Engineer

Coltigent Technology Services Pvt Ltd • Pune District

Presencial
INR 800 000 - 1 200 000
Data Engineers
Data Engineers

Growel Softech Pvt Ltd • Bengaluru Urban

Presencial
INR 1 400 000 - 2 800 000
Big Data Engineer
Big Data Engineer

Global Infovision • Chennai, Bengaluru

Híbrido
INR 1 500 000 - 2 600 000
Data Engineer (PySpark)
Data Engineer (PySpark)

Talent Basket • Bengaluru

Presencial
INR 1 200 000 - 1 800 000
Data Engineer
Data Engineer

Pipeline AI • Bengaluru

Presencial
INR 900 000 - 1 500 000
Data Engineer
Data Engineer

Crayon Data • Chennai District

Presencial
INR 800 000 - 1 200 000
Big Data Developer
Big Data Developer

Viraaj HR Solutions • Maharashtra

Presencial
INR 1 000 000 - 1 500 000
Collaborative engineering culture
Competitive compensation
Training in cloud and Big Data technologies