Data Engineer - Snowflake &Python

VMC Soft Technologies, Inc; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

VMC Soft Technologies, Inc. in Bengaluru, India, is seeking a Senior Data Engineer to design, build, and optimize advanced ETL/ELT pipelines with Snowflake as the data warehouse.

You will lead data integration efforts, collaborate with cross-functional teams, and ensure high data quality and security across the architecture. The role requires expertise in Snowflake, real-time streaming, containerization, and ERP integrations, with strong coding skills in Python/Java/Scala and hands-on cloud

Qualifications

• Expert in data warehousing with Snowflake for ELT/ETL.
• Proficient in Python, Java or Scala.
• Strong SQL/NoSQL DB experience across cloud platforms (AWS/Azure/GCP).
• Hands-on with GitHub and Jira for version control and project management.
• Design and optimize advanced ETL/ELT pipelines and data integration.
• Strong problem-solving, communication, and stakeholder collaboration.
• Nice-to-have Snowflake, AWS, or Azure certifications.
• Experience with real-time streaming (Kafka) and containerization (Docker/Kubernetes).
• Experience integrating with Oracle ERP; MES/Gen-AI data domain knowledge.
• Familiar with data orchestration, workflow tools, and large-scale data migrations.

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Snowflake.
• Lead data integration from diverse sources including Oracle ERP.
• Focus on Snowflake query performance and scalability improvements.
• Own delivery of significant data engineering projects and drive workstreams via Jira.
• Mentor junior engineers and promote best practices.
• Collaborate with data scientists, analysts, and operations teams.
• Ensure data availability, quality, reliability, and security.
• Deliver data-driven insights to enable strategic decisions.

Skills

Snowflake

Python

Java

Scala

SQL/NoSQL

AWS

Azure

GCP

GitHub

Jira

Apache Kafka

Docker

Kubernetes

Oracle ERP

MES/Gen-AI data

Education

Bachelor's degree in Computer Science / IT / Engineering

Master's degree in Computer Science / IT / Engineering

Tools

GitHub

Jira

Apache Kafka

Docker

Kubernetes

Oracle ERP

MES/Gen-AI data tooling

Job description

Job Description

1 Role* Senior Data Engineer

Required Technical Skill Set**

Expert proficiency in data warehousing concepts with deep hands-on experience in Snowflake for ETL/ELT processes; strong programming skills in Python, Java, or Scala; extensive experience with SQL/NoSQL database management systems and major cloud platforms (AWS, Azure, GCP); hands-on experience with GitHub and Jira; familiarity with real-time streaming (Apache Kafka), containerization (Docker, Kubernetes), Oracle ERP integration, and MES/Gen-AI data requirements.

No of Requirements** 01

Desired Experience Range**

Bachelor's degree with 7+ years, or Master's degree with 5+ years, of professional experience in Computer Science, Information Technology, Engineering, or a related field, including hands-on expertise in Snowflake, ETL/ELT pipelines, data warehousing, and cloud-based data engineering.

Location of Requirement Bangalore, India (Customer location) Data & AI Center of Excellence

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

• Expert proficiency in data warehousing concepts with deep hands-on experience in Snowflake for ELT/ETL processes
• Strong expertise in at least one modern programming language such as Python, Java, or Scala
• Extensive experience with database management systems (SQL, NoSQL) and demonstrable experience with major cloud platforms (AWS, Azure, GCP)
• Hands-on experience with version control systems (GitHub) and project management tools (Jira)
• Proven ability to design, develop, and optimize advanced ETL/ELT pipelines and drive complex data integration initiatives from diverse sources
• Strong problem-solving, communication, and stakeholder collaboration skills
• Good-to-Have Data engineering certifications (Snowflake, AWS, Azure)
• Experience with advanced data processing technologies, including real-time streaming (Apache Kafka) and containerization (Docker, Kubernetes)
• Demonstrated experience integrating with enterprise systems like Oracle ERP and an understanding of data requirements for Manufacturing Execution System (MES) and Gen-AI projects
• Familiarity with data orchestration and workflow management tools, coupled with experience in large-scale data migration projects

SN Responsibility of / Expectations from the Role

1. Design, develop, and optimize advanced ETL/ELT processes and robust data pipelines, utilizing Snowflake as the primary data warehouse and GitHub for version control
2. Drive complex data integration initiatives from diverse sources, including enterprise systems like Oracle ERP and data related to the ongoing MES project
3. Proactively identify, develop, and implement solutions for continuous data system performance and scalability improvements, with a focus on Snowflake query optimization
4. Take ownership of and successfully deliver significant data engineering projects or lead key workstreams from conception to deployment, utilizing Jira for project management
5. Provide technical guidance and mentorship to junior/less experienced engineers, fostering their development
6. Collaborate effectively with cross-functional teams to deliver innovative data products
7. Collaborate closely with data scientists, analysts, business leaders, and Operations/manufacturing stakeholders within the Data & AI Center of Excellence
8. Ensure the highest standards of data availability, quality, reliability, and security across the data architecture
9. Drive data-driven insights and enable strategic decision-making across the organization
10. Report to the Head of Digital Transformation as part of the Data & AI Center of Excellence, located in Bangalore, in an on-site capacity