Data Engineer

Ashirvad by aliaxis; Bengaluru Urban; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Ashirvad by aliaxis in Bengaluru seeks an experienced Data Engineering Lead to architect and oversee data warehousing solutions, mentoring the team and ensuring robust ETL/ELT processes.

You will work with Snowflake, AWS Glue, Cortex AI, and AWS Bedrock to extract insights from complex datasets, aligning data strategies with Finance, Accounts, and Manufacturing domain needs.

Qualifications

• 3 to 5 years overall, with 2+ years in data analytics and digital solutions.
• BTech in Computer Science or IT.
• Strong knowledge of data models, data mining, and segmentation.
• Proficiency in Java and Python with SQL DB design.
• Exposure to Cortex AI, AWS Bedrock, Copilot Studio is a plus.
• Excellent analytical, communication, and coaching abilities.

Responsibilities

• Lead architecture, design, and development of data warehousing solutions.
• Provide technical guidance and mentorship to the data engineering team.
• Ensure best practices in data warehousing, ETL/ELT, and data integration.
• Design, develop, and optimize ETL/ELT pipelines.
• Monitor data quality and troubleshoot loading processes.
• Collaborate with stakeholders to gather and analyse business requirements.

Skills

Data analytics

Analytical skills

Communication skills

Coaching / mentorship

Agile experience

Education

BTech in Computer Science or IT

Tools

Java

Python

SQL

Snowflake

AWS Glue

Cortex AI

AWS Bedrock

Copilot Studio

Job description

• Lead the architecture, design, and development of data warehousing solutions.
• Provide technical guidance and mentorship to the data engineering team.
• Ensure best practices in data warehousing, ETL / ELT processes, and data integration.
• Design, develop, and optimize ETL / ELT pipelines using industry-standard tools.
• Ensure data accuracy, integrity, and consistency across data sources.
• Monitor and troubleshoot ETL / ELT processes to ensure timely and accurate data loading.
• Implement and manage data warehousing solutions using Snowflake.
• Utilize AWS Glue for data integration and ETL / ELT tasks.
• Optimize data storage and retrieval processes to enhance performance.
• Apply AI/ML concepts to extract insights from large datasets.
• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
• Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.
• Develop data solutions that address specific needs within these domains.
• Collaborate with stakeholders to gather and analyse business requirements

Responsibilities

• Lead the architecture, design, and development of data warehousing solutions.
• Provide technical guidance and mentorship to the data engineering team.
• Ensure best practices in data warehousing, ETL / ELT processes, and data integration.
• Design, develop, and optimize ETL / ELT pipelines using industry-standard tools.
• Ensure data accuracy, integrity, and consistency across data sources.
• Monitor and troubleshoot ETL / ELT processes to ensure timely and accurate data loading.
• Implement and manage data warehousing solutions using Snowflake.
• Utilize AWS Glue for data integration and ETL / ELT tasks.
• Optimize data storage and retrieval processes to enhance performance.
• Apply AI/ML concepts to extract insights from large datasets.
• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
• Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.
• Develop data solutions that address specific needs within these domains.
• Collaborate with stakeholders to gather and analyse business requirements

Requirement

• Overall, 3 to 5 years’ experience in which 2+ years of experience in Data Analytics and Digital solutions with exposure to Lake house architecture
• BTech in Computer Science or IT
• Technical expertise with data models, data mining, and segmentation techniques
• Knowledge of programming languages (e.g. Java and Python) and with hands-on experience with SQL database design
• Exposure to Cortex AI, AWS Bedrock, Copilot studio (good to have)
• Strong analytical and problem-solving skills. Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/ coach to internal team
• Should have exposure to Cloud ETL/ ELT, Cloud DWH, AI and ML tools
• Domain expertise in Finance, Accounts, and Manufacturing.
• Exposure to agile software development, and/or development management
• Positive attitude and motivation to deliver and ensure highest quality deliverables. Able to respond positively and calmly to shifting priorities, demands and timelines