Data Engineer - Snowflake + AWS Glue

InfoCepts; India; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

InfoCepts in Nagpur/Pune is seeking a Data Engineer to design, develop, and maintain scalable data pipelines and Snowflake-based models for retail analytics across customer, sales, inventory, and workforce domains.

You will integrate data from MMS, CRM, Workday and other sources via S3, APIs, or staging, build ETL workflows using Talend, AWS Glue, and SQL procedures, and optimize performance while ensuring governance and documentation.

Qualifications

• Experience designing scalable data pipelines in Snowflake.
• Strong SQL, including stored procedures and optimization techniques.
• Proficiency in Python for data engineering and ETL tasks.
• Hands-on with AWS Glue, S3, Lambda and Step Functions.
• Familiar with Git, CI/CD, and cloud-based data environments.

Responsibilities

• Data Pipeline Development: Integrate data from MMS, CRM, Workday, Courion, and other sources via S3 files, APIs, or staging in Snowflake.
• ETL Development: Build and optimize ETL workflows using Talend, AWS Glue and SQL stored procedures.
• Data Modeling: Create and maintain Snowflake tables and layered views for business consumption.
• Collaboration: Work with data analysts and stakeholders to understand data needs and deliver solutions.
• Performance Optimization: Ensure efficient query performance and cost-effective processing in Snowflake.
• Documentation & Governance: Maintain data model documentation and lineage for audit compliance.

Skills

Snowflake

SQL (stored procedures)

Python development

AWS Glue

AWS services (S3, Lambda, Step Func)

ETL/ELT

Data modeling

Git & CI/CD

Cloud platforms (AWS/Azure/GCP)

Education

Bachelor's or Master's in CS/Data Science/related

Tools

Talend

Snowflake

Job description

Position:

Data Engineer

Location

Nagpur/Pune

Type of Employment

Full-time

Purpose of the Position

To design, develop, and maintain scalable data pipelines and models in Snowflake for retail operations, enabling accurate reporting and analytics across customer, sales, inventory, and workforce domains.

Key Result Areas and Activities

• Data Pipeline Development: Integrate data from different sources like MMS, CRM, Workday, Courion, and other sources via S3 files, APIs, or direct staging in Snowflake.


• ETL Development: Build and optimize ETL workflows using Talend , AWS Glue and SQL stored procedures.


• Data Modeling: Create and maintain Snowflake tables and layered views for business consumption.


• Collaboration: Work closely with data analysts, business stakeholders, and regulatory teams to understand data needs and deliver solutions.


• Performance Optimization: Ensure efficient query performance and cost-effective data processing in Snowflake.


• Documentation & Governance: Maintain clear documentation of data models, transformations, and lineage to support audit and compliance requirements.

Roles and Responsibilities

Essential Skills

• Strong hands-on experience with Snowflake (data warehousing, performance tuning, security).


• Strong SQL skills with stored procedure development.


• Solid understanding of SQL and advanced query optimization techniques.


• Strong experience in Python development for data engineering, automation, and ETL/ELT pipeline development.


• Hands-on experience in designing, developing, and maintaining AWS Glue pipelines, including Glue Jobs, Crawlers, Data Catalog, and workflow orchestration.


• Experience building scalable data integration and transformation solutions using AWS services such as S3, Glue, Lambda, and Step Functions.


• Familiarity with version control (Git) and CI/CD workflows.


• Experience with cloud platforms (AWS, Azure, or GCP), with strong preference for AWS.


• Knowledge of data pipeline monitoring, performance optimization, and troubleshooting in cloud-based data environments.

Desirable Skills

• Exposure/working knowledge


• Understanding of retail data structures (sales, customer, product, workforce).


• Experience with API-based data ingestion

Qualification

• 3?5 years in data engineering, with at least 1?2 years in Snowflake.


• Bachelor?s or master?s degree in computer science, Data Science, Bioinformatics, or related field.

Qualities

• Strong analytical and problem-solving mindset.


• Detail-oriented with a focus on data accuracy and compliance.


• Excellent communication and stakeholder management skills.


• Ability to work independently and collaboratively in cross-functional teams.