Specialist - Data Engineering

Vivantify; Pune District; Vor Ort; INR 1.400.000 - 2.100.000; Vollzeit

Zusammenfassung

Vivantify is seeking a Data Engineer with 5–7 years of experience to design and operate reliable data pipelines. The role emphasizes PostgreSQL and SQL performance optimization, data modeling, data quality, and scalable data integration for analytics and real-time consumption.

You will collaborate with data wranglers, data scientists, and development teams to deliver enterprise data assets and production-grade SQL solutions across Pan-India data ecosystems.

Qualifikationen

• 5–7 years of experience in data engineering with strong hands-on PostgreSQL and advanced SQL
• Experience in designing, building, and maintaining scalable data pipelines
• Knowledge of data modeling, data quality, and data integration best practices
• Ability to optimize PostgreSQL performance, including indexing, partitioning, and query tuning
• Familiarity with production-grade data engineering concepts and tooling

Aufgaben

• Design, build, and support scalable data pipelines across source and target systems
• Develop production-grade PostgreSQL SQL using CTEs, window functions, and set-based processing
• Optimize PostgreSQL performance through tuning, indexing, and execution plan analysis
• Use EXPLAIN ANALYZE BUFFERS to diagnose query performance and bottlenecks
• Design and maintain logical, physical, normalized, and dimensional data models
• Define and maintain data contracts covering schemas, keys, constraints, naming standards
• Implement resilient data pipelines with error handling, retries, idempotency, and reprocessing/backfill
• Implement data quality checks, monitoring, and reusable data assets for analytics and real-time consumption

Kenntnisse

PostgreSQL

Advanced SQL

Data pipelines

Data modeling

ETL

Data quality

Partitioning

Indexing

Query optimization

Explain Analyze

Jobbeschreibung

Location: Pan India

Experience: 5–7 Years

About the Role

We are looking for a Data Engineer with strong expertise in PostgreSQL and SQL to design, build, and support reliable data pipelines and enterprise data assets. The role focuses on data engineering, SQL performance optimization, data modeling, data quality, and scalable data integration for analytics and real-time consumption.

Job Description

The role involves designing and maintaining data pipelines that acquire, aggregate, refine, and securely move data between source and target systems. You will develop reusable data assets that support enterprise querying, analytics, feature engineering, APIs, and ingestion processes.

A key focus of the role is developing production-grade SQL and optimizing PostgreSQL performance through query tuning, execution plan analysis, indexing, partitioning, and database maintenance. You will also design logical and physical data models and establish standards for schemas, keys, constraints, naming conventions, and slowly changing dimensions.

The position requires building resilient pipelines with appropriate error handling, retry mechanisms, idempotency, and reprocessing capabilities. You will collaborate with data wranglers, data scientists, and technical development teams to deliver reliable and high‑quality data solutions.

Key Responsibilities

• Design, build, and support scalable data pipelines across source and target systems
• Develop production‑grade PostgreSQL SQL using CTEs, window functions, and set‑based processing
• Optimize PostgreSQL performance through query tuning, indexing, partitioning, and execution plan analysis
• Use EXPLAIN ANALYZE BUFFERS to diagnose query performance and identify I/O and execution bottlenecks
• Design and maintain logical, physical, normalized, and dimensional data models
• Define and maintain data contracts covering schemas, keys, constraints, naming standards, and business definitions
• Implement resilient data pipelines with error handling, retries, idempotency, and reprocessing/backfill capabilities
• Implement data quality checks, monitoring, and reusable data assets for analytical and real‑time consumption

Required Skills

• PostgreSQL
• Advanced SQL
• CTEs, window functions, and set‑based processing
• PostgreSQL query tuning and execution plan analysis
• Indexing strategies including B‑tree, Hash, GiST, and GIN
• Database partitioning and maintenance
• VACUUM/ANALYZE and table statistics management
• Locking and concurrency handling
• EXPLAIN ANALYZE BUFFERS
• Data modeling: logical, physical, normalized, and dimensional models
• Data contracts and schema evolution
• ETL and data integration
• Data quality and pipeline monitoring
• Error handling, retry logic, idempotency, and data reprocessing

Mandatory Skills

• PostgreSQL

Candidate Profile

The ideal candidate should have 5–7 years of experience in data engineering with strong hands‑on expertise in PostgreSQL and advanced SQL, including database performance optimization and data modeling. The candidate should be capable of building reliable data pipelines and reusable data assets while collaborating effectively with data scientists, data wranglers, and technical development teams.

Benefits Package

• Competitive salary and benefits package
• Opportunities for professional growth and development
• A collaborative and inclusive work environment
• The opportunity to work on exciting and challenging projects with leading clients