Data Engineer

KeyValue; Ernakulam; On-site; INR 900,000 - 1,500,000; Full time

Job summary

KeyValue in India is seeking an experienced data engineer to join our growing team of analytic experts. You will design and build scalable data pipelines, work closely with product and engineering teams to understand domains, features and metrics, and help turn raw data into actionable insights.

You will load data into data warehouses such as AWS Redshift or Google BigQuery, implement batch processing, create visualizations with Tableau, Metabase or Google Data Studio, and contribute to CI/CD

Qualifications

• Proficiency in database design and writing SQL queries.
• Experience in data warehouse solutions AWS Redshift / Google BigQuery / Snowflake.
• Knowledge on platforms such as Segment / HevoData / Stitch / Amplitude / Clevertap.
• Hands on experience in ApacheSpark / Python / R / Hadoop / Kafka.
• Knowledge on working with connectors (REST / SOAP etc.)
• Experience in BI platforms like Metabase / Power BI / Tableau / Google Data Studio.

Responsibilities

• Work closely with product and engineering team to understand the domains, features and metrics
• Design and build scalable data pipelines to handle data from different sources
• Extract data using ETL tools and load to data warehouse ( AWS Redshift / Google BigQuery)
• Implement batch processing for structured and unstructured data
• Analyse data and create visualizations using tools like Tableau/Metabase/GoogleDataStudio which helps in implementing business decisions
• Work on core data team which designs and maintain the Data warehouse
• Troubleshooting and resolving issues in data processing and pipelines.
• Should be able to anticipate problems and build processes to avoid them.
• Learn new technology in a short span of time.
• Setting up CI/CD.

Skills

SQL queries

Big data tools

ETL platforms

BI reporting

REST/SOAP connectors

CI/CD readiness

Tools

AWS Redshift

Google BigQuery

Snowflake

Tableau

Power BI

Google Data Studio

Metabase

Job description

Job Description

We are looking for an experienced and resilient person to join our growing team of analytic experts and willing to learn through bigger challenges.

What You Will Do

• Work closely with product and engineering team to understand the domains, features and metrics
• Design and build scalable data pipelines to handle data from different sources
• Extract data using ETL tools and load to data warehouse ( AWS Redshift / Google BigQuery)
• Implement batch processing for structured and unstructured data
• Analyse data and create visualizations using tools like Tableau/Metabase/GoogleDataStudio which helps in implementing business decisions
• Work on core data team which designs and maintain the Data warehouse
• Troubleshooting and resolving issues in data processing and pipelines.
• Should be able to anticipate problems and build processes to avoid them.
• Learn new technology in a short span of time.
• Setting up CI/CD.

What Makes You a Great Fit

• Proficiency in database design and writing SQL queries
• Experience in any of data warehouse solutions AWS Redshift / Google BigQuery / Snowflake
• Knowledge on platforms such as Segment / HevoData / Stitch / Amplitude / Clevertap
• Hands on experience in ApacheSpark / Python / R / Hadoop / Kafka
• Knowledge on working with connectors (REST / SOAP etc.)
• Experience in BI platforms like Metabase / Power BI / Tableau / Google Data Studio