Overview
Job Description & Requirements
- Developing and supporting of data pipelines to process data from various sources.
- Experience in BAU tasks and work closely with data platform users.
- Development of dashboards for multiple stakeholders
- Designing and Developing various ETL/ELT data pipelines, automation processes for data collection (including web data scraping).
- Extensive experience of building platform which are “horizontally
Primary Skills
- Hands-on experience of integrating open-source Big data technologies like Hive, Presto, Spark, Apache Ignite into traditional systems.
- Hands-on experience in any 1 modern programming language (Java/Python).
- Must have exp in Google cloud Platform.
- Extensive experience of building platform which are “horizontally scalable”, “highly available (Three 9s or higher)” and “fully automated maintenance” on top of AWS, GCP, Azure or Ali-Cloud.
- Strong system/schema design, SQL and ETL/ELT implementation skills
- Must have exp in e--commerce domain.
- Experience having developed data engineering capabilities for large and complex franchises