Data Engineer

Ashirvad Pipes Private Limited; Bengaluru; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

Ashirvad Pipes Private Limited is seeking a data warehousing specialist to lead architecture, design, and development of scalable data solutions. You will mentor the data engineering team and ensure best practices in ETL/ELT, data integration, and data quality across multiple data sources.

The role involves designing Snowflake-based data platforms, leveraging AWS Glue for data tasks, and applying AI/ML concepts to extract business insights.

Qualifications

• 3 to 5 years total experience with 2+ years in Data Analytics and Digital solutions
• Exposure to Lake house architecture and data warehousing best practices
• Programming in Java and Python with hands-on SQL database design
• Exposure to Cortex AI, AWS Bedrock, and Copilot Studio is a plus
• Domain knowledge in Finance, Accounts, and Manufacturing helps translate business needs

Responsibilities

• Lead architecture, design, and development of data warehousing solutions.
• Provide technical guidance to the data engineering team.
• Ensure best practices in ETL/ELT, data integration, and data quality.
• Design, develop, and optimize ETL/ELT pipelines using industry-standard tools.
• Ensure data accuracy and consistency across data sources.
• Monitor and troubleshoot ETL/ELT processes for timely data loading.
• Implement and manage Snowflake-based data warehousing solutions.
• Utilize AWS Glue for data integration and ETL/ELT tasks.
• Optimize data storage and retrieval for performance.
• Apply AI/ML concepts to extract insights from large datasets.
• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
• Leverage domain knowledge in Finance, Accounts, and Manufacturing to gather business requirements.
• Collaborate with stakeholders to analyse business needs and translate into data solutions.

Skills

Data analytics

Lakehouse architecture

Java

Python

SQL

ETL/ELT

Cloud ETL

AI/ML concepts

Data modelling

Data mining

Data segmentation

Education

BTech in Computer Science or IT

Tools

Snowflake

AWS Glue

Cortex AI

AWS Bedrock

Copilot Studio

Job description

Responsibilities

• Lead the architecture, design, and development of data warehousing solutions.


• Provide technical guidance and mentorship to the data engineering team.


• Ensure best practices in data warehousing, ETL / ELT processes, and data integration.


• Design, develop, and optimize ETL / ELT pipelines using industry-standard tools.


• Ensure data accuracy, integrity, and consistency across data sources.


• Monitor and troubleshoot ETL / ELT processes to ensure timely and accurate data loading.


• Implement and manage data warehousing solutions using Snowflake.


• Utilize AWS Glue for data integration and ETL / ELT tasks.


• Optimize data storage and retrieval processes to enhance performance.


• Apply AI/ML concepts to extract insights from large datasets.


• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.


• Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.


• Develop data solutions that address specific needs within these domains.


• Collaborate with stakeholders to gather and analyse business requirements.

Requirement: Overall, 3 to 5 years' experience in which 2+ years of experience in Data Analytics and Digital solutions with exposure to Lake house architecture BTech in Computer Science or IT Technical expertise with data models, data mining, and segmentation techniques Knowledge of programming languages (e.g. Java and Python) and with hands-on experience with SQL database design Exposure to Cortex AI, AWS Bedrock, Copilot studio (good to have) Strong analytical and problem-solving skills. Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/ coach to internal team Should have exposure to Cloud ETL/ ELT, Cloud DWH, AI and ML tools Domain expertise in Finance, Accounts, and Manufacturing. Exposure to agile software development, and/or development management Positive attitude and motivation to deliver and ensure highest quality deliverables. Able to respond positively and calmly to shifting priorities, demands and timelines Ashirvad Pipes has been the benchmark of quality in the Indian water management industry since 1998. We adhere to the highest international standards set for manufacturing products for potable water supply through smart solutions and intelligent technologies that ensure sustainability and convenience. Ashirvad provides wide range of solutions for Building, Agriculture, Industrial and Infrastructure applications. With over 5 decades of history, our journey is all about providing people around the world with advanced plastic piping systems that is sustainable, innovative, and follow international standards of quality certifications. Innovation is the way of life for Ashirvad. From introducing 'The unique Wirelock system' in uPVC Column Pipes, to launching the Yellow Seal Technology in India for the first time, Ashirvad has always been at the forefront of technology.