Data Engineer

Demand AI; Pune District; On-site; INR 1,400,000 - 2,000,000; Full time

Job summary

Demand AI is seeking a Data Engineer in Pune, India with 3–5 years of experience to build and maintain data pipelines and Snowflake integrations. You will support database administration, performance, security and reliability across our systems.

You will design and optimize ETL/ELT processes, write complex SQL, and enable data pipelines with Snowflake features, stages and Snowpipe while collaborating with cross-functional teams in a growth environment.

Qualifications

• 3–5 years of Data Engineering experience.
• Strong hands-on Snowflake experience including Streams, Tasks, Stages and Snowpipe.
• Proficient SQL with complex queries and optimization.
• Experience with PostgreSQL or DynamoDB or similar databases.
• ETL/ELT pipeline development and data loading expertise.
• Familiarity with RBAC, security and access control.

Responsibilities

• Design, develop and maintain data pipelines and ETL/ELT processes using Snowflake.
• Develop complex SQL queries, transformations, views, stored procedures, tasks and streams.
• Build incremental ingestion and synchronization pipelines.
• Implement Snowflake integrations with external apps and cloud storage.
• Work with stages, file formats, COPY, Snowpipe and connectors.
• Monitor and troubleshoot pipelines and data quality issues.
• Optimize Snowflake queries for performance and cost.
• Support data modeling and analytical workloads.
• Manage databases across RDBMS and NoSQL environments.
• Perform admin tasks including user/role management and access control.
• Monitor health, performance and resource utilization; perform tuning.

Skills

Data engineering

SQL

ETL/ELT

Data modeling

Troubleshooting

Tools

Snowflake

PostgreSQL

DynamoDB

Snowpipe/Streams/Stages

Python

AWS

Job description

Pune, Maharashtra, India Full-time Mid-Senior 3-5 years

Build and maintain data pipelines, Snowflakeintegrations and data platforms, while supporting databaseadministration, performance, security and reliability across oursystems.

Role Overview

We are looking for a Data Engineer with 3–5 years ofexperience to build and maintain data pipelines, Snowflakeintegrations and data platforms, while supporting databaseadministration, performance, security and reliability.

Key Responsibilities

• Design, develop and maintain data pipelines and ETL/ELTprocesses using Snowflake.
• Develop complex SQL queries, transformations, views, storedprocedures, tasks and streams.
• Build incremental data ingestion and data synchronizationpipelines.
• Implement and maintain Snowflake integrations with externalapplications and cloud storage.
• Work with stages, file formats, COPY, Snowpipe, storageintegrations and connectors.
• Monitor and troubleshoot data pipelines and resolve dataquality issues.
• Optimize Snowflake queries for performance, scalability andcost.
• Support data modeling and schema design for analyticalworkloads.

Database Operations

• Manage databases across RDBMS and NoSQL environments.
• Perform database administration including user/rolemanagement and access control.
• Implement and maintain RBAC and least-privilege access.
• Monitor database health, performance, storage and resourceutilization.
• Perform query and database performance tuning.
• Support backup, recovery, disaster recovery andmaintenance activities.
• Troubleshoot production issues and participate inroot-cause analysis.
• Maintain database standards, documentation and operationalprocedures.

Experience and Qualifications

• 3–5 years in Data Engineering or a similar role.
• Strong hands-on experience with Snowflake, includingStreams, Tasks, Stages, Snowpipe, Stored Procedures, Viewsand Data Loading.
• Proficient in SQL, including complex queries and queryoptimization.
• Strong understanding of RDBMS and NoSQL database concepts,with hands-on experience in PostgreSQL, DynamoDB or similartechnologies.
• Experience building and troubleshooting ETL/ELT datapipelines.
• Understanding of database performance tuning, indexing,partitioning and query optimization.
• Experience with database users, roles, permissions andRBAC.
• Understanding of database security, monitoring, backup andrecovery concepts.
• Experience with Python or scripting for data engineeringand automation.

Skills and Attributes

• Strong troubleshooting and problem-solving skills.
• Knowledge of ClickHouse or other analytical databases is aplus.
• Experience with AWS cloud services and cloud-based dataplatforms is a plus.
• Experience with B2B SaaS/MarTech data platforms is aplus.