Senior Data Engineer

Prudent Technologies and Consulting, Inc.; Hyderabad; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Prudent Technologies and Consulting, Inc. is seeking a Senior Data Engineer to design and build scalable data pipelines on Snowflake, orchestrate integrations with SnapLogic, and implement dbt transformations with tests and CI/CD deployment.

The role emphasizes leveraging AI copilots and agentic tools to speed up development, debugging, and data quality tasks, while collaborating with data governance and analytics teams to ensure trustworthy data assets.

Qualifications

• 8+ years in data engineering with strong Snowflake and ELT tooling
• Experience designing scalable data pipelines and data models
• Fluent with SQL and at least one scripting language (Python preferred)
• Familiarity with CI/CD, Git workflows, and data quality practices

Responsibilities

• Design, build, and maintain ETL/ELT pipelines on Snowflake
• Build and manage integrations with SnapLogic
• Develop dbt models with tests and documentation
• Design medallion-style data architectures (Bronze/Silver/Gold)
• Use AI-assisted tools to accelerate development and code generation
• Collaborate with data quality, governance, and analytics teams
• Optimize Snowflake performance and cost
• Mentor engineers on AI tool usage and best practices

Skills

Snowflake

SnapLogic

dbt

Data Modelling

SQL

Python

Airflow/ADF

Git CI/CD

Tools

SODA

Collibra

Azure

AWS

GCP

Job description

Data Engineering team is looking for a Senior Data Engineer who combines strong data engineering fundamentals with a genuine curiosity for using AI tools to work smarter, not just harder. You will design and build scalable data pipelines and models on Snowflake, orchestrate integrations through SnapLogic, and use dbt to bring rigor and testability to our transformation layer — while also actively exploring how AI copilots and agentic tools can speed up development, debugging, documentation, and data quality work.

This is not an "AI engineer" role — it is a data engineering role for someone who is already fluent with tools like Cortex, GitHub Copilot, Claude, or ChatGPT in their daily workflow and sees them as a natural extension of good engineering practice, not a gimmick.

WHAT YOU'LL DO

• Design, build, and maintain robust ETL/ELT pipelines feeding a Snowflake-based data platform
• Build and manage integrations using SnapLogic to connect source systems, APIs, and downstream consumers
• Develop and maintain data models and transformations in dbt, including tests, documentation, and CI/CD-based deployment
• Design dimensional and/or medallion-style (Bronze/Silver/Gold) data architectures that balance performance, cost, and usability
• Use AI-assisted tools to accelerate development — generating boilerplate code, drafting SQL/dbt models, writing documentation, debugging pipeline failures, and summarising data quality issues
• Partner with data quality, governance, and analytics teams to ensure data is well-modelled, well-documented, and trustworthy
• Optimise Snowflake warehouse performance and cost (query tuning, clustering, resource monitors)
• Write clean, tested, version-controlled code and contribute to CI/CD pipelines
• Mentor junior engineers, including on how to use AI tools responsibly and effectively (e.g., reviewing AI-generated code, not blindly trusting output)
• Contribute to internal standards for prompt patterns, reusable AI workflows, or tooling that make the whole team faster

CORE SKILLS

• Snowflake — strong hands-on experience with data modelling, performance tuning, security/access, and cost management
• SnapLogic — building and maintaining integration pipelines and connecting heterogeneous source systems
• dbt — writing modular, tested transformations; managing dependencies, macros, and documentation
• Data Modelling — dimensional modelling, medallion/layered architectures, normalisation vs. denormalisation trade-offs
• Strong SQL and at least one scripting language (Python preferred)
• Familiarity with orchestration tools (Airflow, ADF, or similar)
• Working knowledge of git-based CI/CD workflows

AI-AUGMENTED WORKING STYLE (WHAT WE'RE LOOKING FOR)

• Regularly uses AI coding assistants (Copilot, Claude Code, Cursor, ChatGPT, etc.) as part of the daily workflow — not just for one-off snippets
• Comfortable prompting AI tools for tasks like generating dbt models, writing test cases, summarising data quality issues, or drafting documentation
• Applies good judgement about when AI output needs review vs. can be trusted — treats AI as a fast first draft, not a final answer
• Curious about applying AI to structural problems: pipeline debugging, anomaly detection, metadata generation, code review support
• Comfortable working in an environment where AI-usage practices are still evolving, and contributes ideas to shape them

NICE TO HAVE

• Experience with data quality tooling (SODA, Collibra, or similar)
• Exposure to cloud platforms (Azure, AWS, or GCP)
• Experience in a regulated or enterprise-scale data environment
• Prior experience mentoring or leading a small pod of engineers

EXPERIENCE

• 8+ years in data engineering, with at least 4+ years focused on Snowflake and modern ELT tooling (dbt)
• Track record of delivering production-grade pipelines at scale