Senior Specialist – Data Engineering

Vivantify Technology Solutions India Private Limited

Bengaluru

On-site

INR 2,500,000 - 4,200,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary and benefits
Growth opportunities and development
Collaborative and inclusive work env.
Challenging projects with leading cli

Job summary

Vivantify Technology Solutions India Private Limited in Bengaluru is seeking a Senior Specialist – Data Engineering to design scalable Data Lake/Lakehouse architectures for manufacturing data environments. You will build pipelines, implement governance, and enable analytics and AI use cases while ensuring ITAR-controlled data handling.

The role focuses on data lake architectures, data quality, lineage, and access controls, collaborating with technical teams and stakeholders to deliver scalable

Qualifications

  • 8+ years of data engineering experience in manufacturing, semiconductor, or industrial settings.
  • Strong expertise in data lake/l lakehouse architectures and distributed processing.
  • Proficiency in SQL and Python or Scala/Java; hands-on with Spark.
  • Experience with cloud/on-prem platforms and data governance practices.

Responsibilities

  • Design scalable Data Lake/Lakehouse architectures across cloud/on-prem environments.
  • Build and optimize pipelines for machine, MES, test and probe data.
  • Establish data quality, lineage, cataloguing, and governance practices.
  • Develop data processing solutions using SQL, Python, Scala/Java, Spark.
  • Implement data orchestration, streaming, CI/CD, and IaC.
  • Assess ITAR-controlled data classification, access, and security controls.
  • Enable analytics, reporting and ML/AI use cases in manufacturing data environments.
  • Collaborate with stakeholders and document assessments and recommendations.

Skills

Data Engineering
Data Lake/Lakehouse
SQL
Python
Scala/Java
Spark
Cloud Platforms
Orchestration/Streaming
DevOps
Data Governance
Analytics/BI
AI/ML
Security & Compliance

Education

Tools

Azure Data Lake
Azure DevOps
Delta Lake
Iceberg
Parquet
SQL
Python
Scala/Java
Spark
Azure Data Factory
Kafka
Airflow
Power BI
Tableau
Spotfire

Job description

Location: Bengaluru

Experience: 7–11 Years

Openings: 1

Employment Type: Permanent

About the Role

We are looking for an experienced Senior Specialist – Data Engineering to design and establish scalable Data Lake/Lakehouse architectures for manufacturing and industrial data environments. The role involves building reliable data pipelines, implementing data governance and quality practices, enabling analytics and AI use cases, and assessing the security and compliance of ITAR-controlled data across the data landscape.

Job Description

The position focuses on defining and implementing data lake architecture to support manufacturing analytics, reporting, and applicable AI/ML use cases. The candidate will work with machine, equipment, MES, test, and probe data, ensuring accurate lot-, wafer-, and die-level traceability.

The role also involves evaluating existing data environments, strengthening data quality, lineage, governance, and access controls, and ensuring appropriate handling of ITAR-controlled information. The candidate will collaborate with technical teams and senior stakeholders to document findings, recommend improvements, and deliver scalable data solutions.

Key Responsibilities
  • Design and implement scalable Data Lake/Lakehouse architectures across cloud or on-premises environments.
  • Build and optimize data pipelines for manufacturing, machine, equipment, MES, test, and probe data.
  • Establish data quality, governance, lineage, cataloguing, and traceability practices.
  • Develop data processing solutions using SQL, Python, Scala/Java, and Spark.
  • Implement data orchestration, streaming, CI/CD, and infrastructure automation.
  • Assess ITAR-controlled data classification, segregation, access, and security controls.
  • Enable analytics, reporting, and ML/AI use cases within manufacturing data environments.
  • Engage with stakeholders, document assessments, and communicate technical recommendations.
Required Skills
  • Data Engineering: Strong experience in enterprise data engineering, particularly in manufacturing, semiconductor, or industrial environments.
  • Data Lake/Lakehouse: Azure Data Lake, Delta Lake, Iceberg, Parquet-based storage, or equivalent architectures.
  • Programming: SQL and Python or Scala/Java.
  • Distributed Processing: Apache Spark.
  • Cloud Platforms: Azure, AWS, GCP, or on-premises data platforms.
  • Orchestration & Streaming: Airflow, Azure Data Factory, Kafka, or Event Hubs.
  • DevOps: CI/CD and Infrastructure as Code.
  • Data Governance: Data cataloguing, lineage, and data quality practices.
  • Analytics & BI: Power BI, Tableau, or Spotfire.
  • AI/ML: Understanding of ML/AI data pipelines and manufacturing analytics use cases.
  • Security & Compliance: ITAR/EAR export controls, IAM, RBAC/ABAC, encryption, network segmentation, and audit logging.
Mandatory Skills
  • Azure Data Lake
  • Azure DevOps
Candidate Profile

The ideal candidate should have 8+ years of data engineering experience, preferably in manufacturing, semiconductor, or industrial environments. They should possess strong hands‑on expertise in data lake architecture, distributed data processing, and cloud data platforms, along with an understanding of manufacturing data traceability, governance, and security compliance. Strong stakeholder management, assessment, and documentation skills are essential.

Benefits Package
  • Competitive salary and benefits package.
  • Opportunities for professional growth and development.
  • A collaborative and inclusive work environment.
  • The opportunity to work on exciting and challenging projects with leading clients.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Specialist - Data Engineering
Specialist - Data Engineering

Vivantify Technology Solutions India Private Limited • Bengaluru

On-site
INR 1,800,000 - 3,200,000
Competitive salary and benefits
Opportunities for professional growth
Collaborative and inclusive work环境
+2
Senior Specialist - Data Engineering
Senior Specialist - Data Engineering

Vivantify Technology Solutions India Private Limited • Pune District

On-site
INR 1,800,000 - 3,200,000
Competitive salary and benefits
Collaborative and inclusive team
Growth and development opportunities
Data Engineer | AI | Visualization
Data Engineer | AI | Visualization

Pashtek • Salesforce Partner | Data & AI • Chennai District

Hybrid
INR 400,000 - 800,000
Senior Specialist - Data Engineering
Senior Specialist - Data Engineering

Vivantify Technology Solutions India Pvt. Ltd. • Maharashtra

On-site
INR 1,500,000 - 2,100,000
Competitive salary
Growth opportunities
Collaborative environment
+1
Senior Data Engineer
Senior Data Engineer

Distilhire • Bengaluru

Hybrid
INR 2,500,000 - 4,000,000
Specialist - Data Engineering
Specialist - Data Engineering

LTM • Pune District

On-site
INR 900,000 - 1,500,000
Data Engineer
Data Engineer

Primesoft Solutions • Mumbai, Hyderabad, Bengaluru

On-site
INR 1,800,000 - 2,400,000
Lead AWS Data Engineer
Lead AWS Data Engineer

Weekday • Bengaluru

On-site
INR 1,000,000 - 1,500,000
Senior Data Engineer
Senior Data Engineer

Applied Materials, Inc. • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Senior Data Engineer
Senior Data Engineer

Kumaran Systems • Chennai

Hybrid
INR 900,000 - 1,600,000