Data Engineer

Jash Data Sciences; Pune District; On-site; INR 700,000 - 1,300,000; Full time

Job summary

Jash Data Sciences, a cutting-edge Data Sciences and Data Engineering startup based in Pune, India, is seeking a motivated Data Engineer. You will build data pipelines, implement ETL/ELT processes in the cloud, and design data lakes, warehouses, and data marts across AWS, GCP, or Azure.

You will work with Python, SQL, and Big Data tools like PySpark/Hadoop to transform and optimize large datasets, collaborating closely with customers to translate requirements into actionable tasks.

Qualifications

• 3+ years of experience working on Data Engineering projects.
• Hands-on Python programming experience and knowledge of algorithms/data structures.
• Experience designing Data Lakes/Warehouses/Data Marts for terabytes-scale data.
• Track record of implementing data pipelines on AWS/GCP/Azure.
• Strong understanding of indexing, query performance, and database concepts.

Responsibilities

• Discover trends in data and develop algorithms to transform raw data.
• Create data pipelines from multiple sources and load to target databases.
• Implement ETL/ELT processes in the cloud using AirFlow, Glue, Stitch, Data Fusion, DataFlow.
• Design and implement Data Lake/Warehouse/Data Mart in AWS/GCP/Azure.
• Write efficient SQL queries and tune query performance.
• Perform OLAP/OLTP tuning via indices, tables, and views.
• Write Python scripts for orchestrating data pipelines.
• Discuss data engineering requirements with customers and break down tasks.

Skills

Python

ETL/ELT

Data Pipelines

Data Lakes/Warehouses

AWS/GCP/Azure

SQL

Big Data PySpark/Hadoop

Communication

Git/repo/blog

Tools

AWS

GCP

Azure

AirFlow

Job description

Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team! Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.

We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.

We believe in continuous learning and evolving together. And we let the data speak!

What will you be doing?

• You will be discovering trends in the data sets and developing algorithms to transform raw data for further analytics
• Create Data Pipelines to bring in data from various sources, with different formats, transforming it, and finally loading it to the target database.
• Implement ETL/ ELT processes in the cloud using tools like AirFlow, Glue, Stitch, Cloud Data Fusion, DataFlow.
• Design and implement Data Lake, Data Warehouse, and Data Marts in AWS, GCP, or Azure using Redshift, BigQuery, PostgreSQL, etc.
• Creating efficient SQL queries and understanding query execution plans for tuning queries on engines like PostgreSQL.
• Performance tuning of OLAP/ OLTP databases by creating indices, tables, and views.
• Write Python scripts for orchestration of data pipelines
• Have thoughtful discussions with customers to understand their data engineering requirements. Break complex requirements into smaller tasks for execution.

What do we need from you?

• Strong Python coding skills with basic knowledge of algorithms/data structures and their application.
• Strong understanding of Data Engineering concepts including ETL, ELT, Data Lake, Data Warehousing, and Data Pipelines.
• Experience designing and implementing Data Lakes, Data Warehouses, and Data Marts that support terabytes scale data.
• A track record of implementing Data Pipelines on public cloud environments (AWS/GCP/Azure) is highly desirable
• A clear understanding of Database concepts like indexing, query performance optimization, views, and various types of schemas.
• Hands-on SQL programming experience with knowledge of windowing functions, subqueries, and various types of joins.
• Experience working with Big Data technologies like PySpark/ Hadoop
• A good team player with an ability to communicate with clarity
• Show us your git repo/ blog!

Qualification

• 3+ years of experience working on Data Engineering projects
• 1-5 years of Hands-on Python programming experience... (The JSON output should continue as shown, ensuring all list items are correctly listed.)