Senior Data & Infra Engineer: Pipelines & Kubernetes

Value Innovation Labs Inc.; United States; On-site; USD 140,000 - 200,000; Full time

Job summary

Value Innovation Labs Inc. in the United States seeks a Senior Data and Infrastructure Engineer to design, deploy, and optimize enterprise-scale data pipelines and compute resources.

You will lead provisioning of VMs and Kubernetes clusters, collaborate with data science teams, define repository structure, and address governance and reconciliation across data sources. The role emphasizes software development best practices, documentation, and scalable architectures for large datasets, including

Qualifications

• 8+ years of data engineering experience delivering complex projects.
• Expert in ELT/ETL and data warehousing.
• Strong Python for data processing.

Responsibilities

• Provision, create, and operate VMs and Kubernetes clusters for load-balanced data processing for large data sets (~10 TB)
• Collaborate with business and data science personnel to define strategy and approach for data pipeline testing
• Define organization structure for code repository
• Troubleshoot complex data-related issues including data reconciliation across sources and governance.

Skills

Data Engineering

Python

SQL

ELT/ETL

Data Warehousing

Kubernetes

VM provisioning

Git

NET ecosystem

Tools

Git

Kubernetes

VMs

Data orchestration

Job description

Value Innovation Labs Inc. in the United States seeks a Senior Data and Infrastructure Engineer to design, deploy, and optimize enterprise-scale data pipelines and compute resources.

You will lead provisioning of VMs and Kubernetes clusters, collaborate with data science teams, define repository structure, and address governance and reconciliation across data sources. The role emphasizes software development best practices, documentation, and scalable architectures for large datasets, including