Data Engineer

Black Box; India; On-site; INR 400,000 - 600,000; Full time

Job summary

Black Box is seeking an Associate Data Engineer to join its growing data team. You will work with senior engineers to build, maintain, and optimize data pipelines and gain hands-on experience with modern data infrastructure.

The role focuses on mentorship and hands-on production-grade skills, with opportunities to learn Airflow, Flink, and SQL-based data management in a collaborative environment. Fresh graduates are welcome.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, IT, Data Science, Mathematics, or related field.
• Solid foundational knowledge of Python programming.
• Basic understanding of PostgreSQL and SQL queries.
• Theoretical understanding or project exposure to Apache Airflow.
• Basic conceptual knowledge of distributed data processing with Apache Flink.
• Strong analytical thinking and eagerness to learn and adapt to new technologies.

Responsibilities

• Pipeline Development: Assist in writing and maintaining ETL scripts to move data across systems.
• Database Management: Write basic SQL queries, create tables, and interact with PostgreSQL databases.
• Data Orchestration: Schedule, monitor, and troubleshoot automated workflows with Airflow.
• Stream Processing: Build and monitor real-time data streaming applications with Flink.
• Coding & Debugging: Write clean, well-documented Python code.
• Continuous Learning: Participate in code reviews and stay updated on data engineering trends.

Skills

Analytical thinking

Problem-solving

Eagerness to learn

Education

Bachelor’s or Master’s degree in Computer Science/IT/Data Science/Mathematics

Tools

Python

PostgreSQL

Apache Airflow

Apache Flink

Pandas

Git/GitHub

Linux/Unix

SQL

Cloud basics (AWS/GCP/Azure)

Job description

Job Title: Associate Data Engineer

Job Type: Full-time

Experience Level: Fresher (1-4 Years)

About the Role:

We are looking for an enthusiastic and detail-oriented Associate Data Engineer to join our growing data team. If you are a recent graduate passionate about data and eager to build a career in data engineering, this is the perfect opportunity for you!

In this role, you will work closely with senior engineers to build, maintain, and optimize data pipelines. You will get hands‑on experience with modern data infrastructure, transitioning your basic academic or project-level knowledge into production‑grade skills. We focus heavily on mentorship, ensuring you have the support you need to grow as a professional.

Key Responsibilities:

• Pipeline Development: Assist in writing and maintaining ETL (Extract, Transform, Load) scripts to move data across various systems.
• Database Management: Write basic SQL queries, create tables, and interact with PostgreSQL databases to support data storage and retrieval.
• Data Orchestration: Help schedule, monitor, and troubleshoot automated data workflows using Apache Airflow.
• Stream Processing: Collaborate with the team to build and monitor real-time or near-real-time data streaming applications using Apache Flink.
• Coding & Debugging: Write clean, readable, and well-documented code in Python.
• Continuous Learning: Actively participate in code reviews, learn best practices from senior team members, and stay updated on the latest data engineering trends.

Must-Have Qualifications:

• Education: Bachelor’s or Master’s degree in Computer Science, IT, Data Science, Mathematics, or a related field (Recent graduates from batch [Year] are welcome).
• Python: Solid foundational knowledge of Python programming (data structures, loops, functions, basic libraries like Pandas).
• PostgreSQL (SQL): Basic understanding of relational databases, table design, and the ability to write standard SQL queries (SELECT, JOINs, GROUP BY).
• Apache Airflow: Theoretical understanding or project-level exposure to how Airflow works (DAGs, tasks, scheduling).
• Apache Flink: Basic conceptual knowledge of distributed data processing or stream processing using Flink.
• Soft Skills: Strong analytical thinking, problem-solving skills, and a genuine eagerness to learn and adapt to new technologies.

Good-to-Have (Bonus Points):

• Spatial Data: Knowledge of the PostGIS extension for PostgreSQL and a basic understanding of how to write geo/spatial queries.
• Version Control: Basic understanding of tools like Git/GitHub.
• Cloud Basics: Familiarity with cloud platforms (AWS, GCP, or Azure).
• OS: Comfortable with basic Linux/Unix command-line operations.
• Portfolio: Any personal or academic projects showcasing data pipelines or data processing.