Data Engineer

Aviso, Inc.; India; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A leading analytics company in India is seeking a skilled professional to enhance their data capabilities. The ideal candidate will design and develop real-time data ingestion pipelines and transform raw data into reliable components. Candidates should have 4+ years of experience with Spark, preferably PySpark, and excellent programming skills in Python. Strong knowledge of databases like SQL and cloud technologies is beneficial. Join a team committed to equal opportunity and innovation.

Qualifications

• 4+ years of experience with Spark, preferably PySpark.
• Excellent programming/debugging skills in Python.
• Experience with any scripting language such as Python, Bash.
• Good experience in Databases such as SQL, MongoDB.

Responsibilities

• Grow analytics capabilities with faster, reliable tools.
• Design and develop a real-time events pipeline for data ingestion.
• Develop functions to transform raw data sources into reliable components.
• Make changes to diagnose problems across the entire technical stack.

Skills

Strong hands-on experience with Spark

Excellent programming skills in Python

Experience with scripting languages like Bash

Good experience in SQL and MongoDB

Experience with AWS and cloud technologies

Job description

The position grows our analytics capabilities with faster, more reliable tools, handling petabytes of data every day.

Brainstorm and create new platforms that can help in our quest to make available to cluster users in all shapes and forms, with low latency and horizontal scalability.

Make changes to our diagnosing any problems across the entire technical stack.

Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding.

Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake.

Design & implement new components and various emerging technologies in Hadoop Eco- System, and successful execution of various projects.

Skills that will help you succeed in this role

Strong hands‑on experience of 4+ years with Spark, preferably PySpark etc.

Excellent programming/debugging skills in Python.

Experience with any scripting language such as Python, Bash etc.

Good experience in Databases such as SQL, MongoDB etc

Good to have experience with AWS and cloud technologies such as S3

Our Commitment to Equal Opportunity

Aviso provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, veteran status, or any other characteristic protected by applicable local, state, or federal law.

This policy applies to all terms and conditions of employment, including, but not limited to, recruitment, hiring, placement, promotion, transfer, compensation, benefits, training, termination, and layoff.

To apply, please fill out the form below

Apply now