The Data Engineer is the backbone of the Nutrabay analytics engine. Your mission is to ensure that data flows seamlessly and reliably from our production, third party channels, warehouse management system, ERP, Logistics, and Marketing APIs into our warehouse. You are responsible for the "Reliability" of the system. You will build the infrastructure that allows our analysts to work with clean, updated, and validated raw data every single morning.
You should apply if you have:
- Cloud Data Pipeline Mastery: Strong hands‑on experience with AWS Glue (Python/Spark) and S3.
- Database Administration: Experience managing Amazon Redshift, including performance tuning, vacuuming, and schema management.
- API Integration Skills: Ability to write robust Python scripts to fetch data from third‑party logistics, marketing platforms and marketplaces.
You should not apply if you:
- Are not proficient in Python and SQL.
- Do not have experience with the AWS data stack.
- Prefer building one‑off reports over building scalable, automated pipelines.
What will you do?
- Build Ingestion Pipelines: Own the AWS Glue jobs that sync data from RDS, Vinculum, ClickPost, and MoEngage into Redshift.
- Warehouse Administration: Ensure Redshift is optimized for query speed and cost. Manage staging and raw schemas.
- Data Reliability (QC): Implement automated checks to ensure the record counts in the warehouse match the source systems.
- dbt Infrastructure: Collaborate with the Senior Analyst to provide the server/environment (GitHub Actions/EC2) where dbt runs.
Skills Required
- AWS Stack: Expert in AWS Glue, S3, and Redshift.
- Python: Advanced scripting for ETL and API integrations.
- SQL: Expert‑level query writing and database performance optimization.
- DevOps: Basic understanding of Git/GitHub for version controlling ingestion scripts.
- API Integration, REST APIs
- DBT
Business & Soft Skills
- Reliability Mindset: Obsession with pipeline uptime and data accuracy.
- Problem Solving: Ability to debug complex sync issues between fragmented source systems.
Work Experience
2‑5 years
Location
Golf Course Road, Gurugram, Haryana (Work from Office)