Data Engineer

Prudent Technologies and Consulting, Inc.; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Prudent Technologies and Consulting, Inc. is seeking a Data Engineer to design, build, and maintain scalable data warehouse solutions across multiple platforms.

You will collaborate with developers, staff, and end-users to ensure data availability and quality for BI and analytics workflows. The role requires strong SQL and Python skills, DBT experience, and proficiency with ETL tools like SnapLogic or Informatica, plus Snowflake and data governance practices.

Qualifications

• Bachelor's degree in CS/IT or related field.
• 5–8 years of data platform experience.
• Strong data warehouse concepts and modeling.
• Proficient in Python, SQL, and ETL tooling.
• Experience with data governance and quality.

Responsibilities

• Design, develop, and maintain data warehouse solutions.
• Develop and maintain metadata frameworks.
• Manage reference data and dimensional models.
• Implement ETL processes using SnapLogic or Informatica.
• Use Python for data manipulation and automation.
• Optimize performance of data systems.
• Implement DBT transformations.
• Collaborate to develop reporting tools and dashboards.
• Implement data governance for integrity, security, compliance.
• Explore Generative AI integrations.

Skills

Data warehousing

SQL proficiency

Python programming

ETL tools

DBT usage

Data governance

Team collaboration

Generative AI

Education

Bachelor's degree in CS/IT

Tools

Snowflake

SnapLogic

Informatica

DBT

Tableau

Power BI

Job description

As a Data Engineer, you will work with developers, staff, and end-users to provide advanced technical support, maintenance, and logistical support to production and test systems. This job is part of the Database Engineering job function. They are responsible for the upkeep of databases across several company platforms and computing environments.

What You'll Do:

• Design, develop, and maintain robust data warehouse solutions to support business intelligence and analytics needs.
• Design, implement and manage metadata frameworks to ensure data consistency and quality.
• Develop and maintain reference data and dimensional data models to support various business processes.
• Design and implement ETL (Extract, Transform, Load) processes using tools like SnapLogic or Informatica to integrate data from multiple sources.
• Utilize Python for data manipulation, automation, and integration tasks.
• Optimize the performance of data systems and processes.
• Implement transformations in DBT (Data Build Tool) to streamline data workflows.
• Collaborate with cross-functional teams to develop and maintain reporting tools and dashboards.
• Implement data governance practices to ensure data integrity, security, and compliance.
• Stay updated with the latest advancements in Generative AI and explore opportunities to integrate AI solutions into data engineering processes.

What You'll Need:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5 to 8 years of experience in working with data platforms
• Strong knowledge of data warehouse concepts, metadata frameworks, reference data, and dimensional data modeling.
• Proficiency in ETL processes and tools like SnapLogic or Informatica.
• Advanced skills in Python programming, DBT and Snowflake.
• Advanced SQL knowledge.
• Experience with reporting tools such as Tableau, Power BI, or similar.
• Understanding of data governance principles and best practices.
• Knowledge of Generative AI and its applications is a plus.
• Experience with DBT (Data Build Tool) for data transformations.
• Ability to optimize the performance of data systems and processes.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.