Data Engineer

ProjectTree

Sarkhej, Surat

Hybrid

INR 900,000 - 1,400,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Team lunches
Annual trips
Cricket tournaments
Premium hardware

Job summary

Project Tree is seeking a Data Engineer to architect data pipelines and integrate systems for global clients. You will maintain ETL jobs, develop Airflow DAGs, and ensure data quality across Bronze, Silver, and Gold layers. The role emphasizes robust SQL, Python code, and secure data handling.

The position supports on-site, remote, and hybrid work models in Gujarat region, with opportunities to contribute to BI dashboards and production Rollouts.3+ years of experience preferred.

Qualifications

  • 3+ years hands-on data engineering or ETL experience.
  • Strong SQL skills including joins, window functions, MERGE/upserts; comfortable with SQL Server and PostgreSQL.
  • Proficient in Python for loaders, DAGs, and scripting; writing modular, production-grade code.

Responsibilities

  • Develop and maintain ETL jobs and SQL behind them.
  • Build and extend Airflow DAGs for Bronze/Silver/Gold layers; manage scheduling and retries.
  • Investigate failed runs; fix root causes like schema drift and NOT NULL violations.

Skills

Python
SQL
Airflow
ETL
Docker
PostgreSQL
T-SQL
Pandas
Git
CLI

Education

B.E./B.Tech/MCA/M.Sc. in Computer Science or related field

Tools

Airflow
Docker
Git
SQLAlchemy
pyodbc/pymssql
psycopg2

Job description

Data Engineer

Surat / Ahmedabad (On-Site, Remote, Hybrid)

Full-Time,

3+ Years Experience

About Project Tree

At Project Tree, we bridge the gap between complex business challenges and elegant technical solutions. As a premier IT service provider in Gujarat, we specialize in building scalable, future-ready applications. We are looking for a highly technical Data Engineer to architect robust data pipelines and seamless system integrations for our global enterprise clients.

Role Overview

As a Data Engineer at Project Tree, you will own the data pipelines that keep our systems accurate and in sync. You will build and maintain ETL jobs, author and extend Airflow DAGs across the Bronze, Silver and Gold layers, investigate and resolve pipeline failures, and ensure data quality through reconciliation and schema validation. Your work will directly support real-time analytics and business intelligence for our global enterprise clients.

Key Responsibilities
  • Add and maintain ETL jobs by editing job config (source and target tables, primary keys, column lists, filters, schedules) and writing the SQL behind them.
  • Build and extend Airflow DAGs for the Bronze, Silver and Gold layers, including scheduling, retries and failure alerting.
  • Investigate failed runs from DAG logs and the run-history tables, and fix the root cause. Typical causes are schema drift, NOT NULL violations, duplicate source rows and wrong keys.
  • Check data quality: row-count reconciliation, duplicate detection, and column-level schema comparison between source and target.
  • Maintain Grafana dashboards that show job and pipeline health.
  • Help prepare and run production rollouts: prerequisites, validation, cutover and rollback steps.
  • Document pipelines, runbooks and handoffs clearly.
  • Handle credentials and environments securely (secrets management, least-privilege access, no plaintext secrets in repos).
Technical Skills & Qualifications

Education:

  • B.E./B.Tech/MCA/M.Sc. in Computer Science, IT or a related field, or equivalent practical experience.

Required skills:

  • 2–3 years of hands‑on data engineering or ETL experience.
  • Strong SQL: joins, window functions, upserts/MERGE, and performance basics. You should be comfortable with SQL Server (T‑SQL) and PostgreSQL.
  • Python, for loaders, DAGs and scripting.
  • Python, in depth. This is a core skill for the role:
  • Write clean, modular, production‑quality Python 3 (functions, classes, typing, error handling, logging) rather than one‑off scripts.
  • Use pandas or similar for data transformation, and know when to stream or batch instead of loading everything into memory.
  • Connect to databases with SQLAlchemy, pyodbc/pymssql and psycopg2. Use parameterized queries, transactions, bulk inserts and batched upserts.
  • Build and maintain configuration‑driven loaders that generate SQL dynamically (primary keys, column lists, filters) without exposing it to SQL injection.
  • Write Airflow DAGs and custom operators or callbacks in Python, including retries, failure alerts and task dependencies.
  • Handle errors, retries and idempotency, and surface failures clearly in logs and run‑history tables.
  • Write unit and integration tests (e.g. pytest), including testing against sample or mock data. A dry run alone does not prove a job works.
  • Debug and profile Python code, and manage dependencies with venv/pip inside Docker images.
  • Use the command line, argument parsing (argparse/CLI tools) and environment-based configuration for secrets.
  • Working knowledge of Apache Airflow: DAGs, scheduling, operators, connections, and debugging failed tasks.
  • Understanding of ETL/ELT patterns: incremental loads, upsert versus full refresh, idempotency, and primary‑key design.
  • Comfort with Git and the command line.
  • Practical experience with Docker and Docker Compose.

Good to have

  • Experience with the medallion (Bronze/Silver/Gold) architecture.
  • Grafana or another BI/monitoring tool for operational dashboards.
  • Basic Linux administration and AWS EC2 experience.
  • Email/SMTP alerting setup and cron‑style scheduling.
  • Familiarity with data‑warehouse concepts and cross‑database access patterns.
  • Experience with CI/CD and with promoting changes from non‑production to production.
Soft Skills
  • AI‑Augmented Efficiency: A forward‑thinking mindset with the ability to leverage AI tools (e.g., Copilot for SQL, AI‑driven data mapping) to accelerate pipeline development and error detection.
  • Analytical Problem‑Solving: The ability to trace complex data flows and resolve architectural inconsistencies across multiple platforms.
What we look for in a person
  • You verify results against real runs and the data, not just a clean dry run.
  • You are careful with production data and credentials.
  • You write clear notes so the next person can pick up your work.
  • You are willing to work with business and application teams to understand source‑data quirks.
What We Offer
  • Career Evolution: We offer a merit‑based trajectory from Data Engineer → Senior → Lead, culminating in Principal Data Architect. Your journey is defined by transitioning from technical execution to Strategic Data Governance.
  • Project Tree Life: We believe in celebrating our wins together! Enjoy a vibrant culture with frequent team lunches, dinners, annual trips, and our signature Cricket tournaments.
  • The Advantage: Technical autonomy to shape our data strategy, premium hardware at our Iconic Shyamal (Ahmedabad) or Surat offices, and competitive salary benchmarks.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

DevsTree IT Services Pvt. Ltd. • Ahmedabad

On-site
INR 1,400,000 - 2,500,000
Data Engineer
Data Engineer

Jash Data Sciences Pvt. Ltd. • Pune District

On-site
INR 600,000 - 1,000,000
Data Engineer
Data Engineer

Crayon Data • Chennai District

On-site
INR 800,000 - 1,200,000
Data Architect
Data Architect

Infosys • Bengaluru Urban

On-site
INR 1,200,000 - 2,000,000
Cutting-edge cloud and data technologies
Collaborative culture focusing on innovation
Cross-functional project visibility
Python Data Engineer
Python Data Engineer

Dexian India • Chennai District

On-site
INR 1,000,000 - 1,500,000
Data Engineer
Data Engineer

Opvia • India

Remote
INR 2,400,000 - 2,800,000
Data Engineer - Python / Big Data
Data Engineer - Python / Big Data

Kreditbee • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Data Engineer
Data Engineer

Azilen Technologies • Gurugram District

On-site
INR 1,500,000 - 2,500,000
Data Engineer
Data Engineer

Exillar Infotech Pvt Ltd • Ahmedabad District

On-site
INR 1,200,000 - 1,800,000
Diverse data challenges
Cross‑functional collaboration
Growth opportunities
+1
Data Engineer
Data Engineer

PropMarker • Ernakulam

On-site
INR 1,200,000 - 1,800,000
Real AI product in PropTech space
Collaborate with data science & prod
Growth opportunities