Data Engineering Engineer II

Tekwissen India; Chennai District; Hybrid; INR 1,200,000 - 2,500,000; Full time

Job summary

TekWissen Group is seeking a Data Engineering Engineer II in Chennai for a hybrid role, focusing on designing enterprise-grade cloud data architectures using Python, Spark, BigQuery, Airflow, and Terraform.

You will lead architectural decisions, establish CI/CD standards with Tekton and GitHub, implement security scanning with Checkmarx/FOSSA/SonarQube, govern Cloud Run audit signals and GCS archival frameworks, and mentor engineers for long-term platform value.

Qualifications

• Bachelor's degree in a related field is required.
• 4+ years of data engineering experience on cloud platforms.
• Proficiency in Python and distributed data processing.

Responsibilities

• Lead as the technical anchor, designing enterprise-grade cloud data architectures.
• Define and govern CI/CD standards and security controls across platforms.
• Mentor engineers and drive data governance, observability, and performance.

Skills

Cloud data architectures

Python

CI/CD

GCP services

Data engineering

Education

Bachelor's Degree

Tools

Terraform

Cloud Run

BigQuery

Dataproc

Airflow

Tekton

Checkmarx

SonarQube

Job description

Overview: TekWissen is a global workforce management provider throughout India and many other countries in the world. The below client is a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place one that benefits lives, communities and the planet

Job Title: Data Engineering Engineer II

Location: Chennai

Work Type: Hybrid (4 Days work From Office)

Position Description:

• We are seeking a highly accomplished and visionary Advanced Data Engineer / Technical Anchor to join our team.
• In this role, you will serve as the technical lead and architectural authority, designing enterprise-grade Cloud Data Solution Architectures leveraging Python, Cloud Dataproc (Spark), BigQuery, Astro (Airflow), and Terraform.
• You will act as a strategic partner between engineering teams and business leadership, establishing organizational CI/CD standards (Tekton, GitHub) and security scanning controls (Checkmarx, FOSSA, SonarQube).
• You will govern Cloud Run audit signals and GCS log archival frameworks, and mentor engineering talent to maximize the long-term strategic value of our data platform.

Skills Required:

• Google Cloud Platform (Biq Query, Dataproc, TERRAFORM, Tekton, Cloud Run, AIRFLOW, POSTGRES, Python)

Skills Preferred:

• Security scanning controls (Checkmarx, FOSSA, SonarQube)

Experience Required:

• Engineer II Exp: 4+ years Data Engineering work experience

Experience Preferred:

• Expert mastery of Python, distributed computing with Spark on Cloud Dataproc, and advanced BigQuery data modeling, query optimization, and cost management.

Education Required:

• Bachelor's Degree

Additional Information :

• Technical Anchor & Solution Architecture: Act as the lead engineer and domain expert, designing enterprise-grade Cloud Data Solution Architectures, implementing advanced design patterns, and guiding technology selection across the platform.
• Strategic Roadmap Alignment: Partner with business and engineering leaders to align technical roadmaps with organizational goals.
• Provide strategic advice on "build vs. buy" decisions to maximize long-term business value.
• IaC & CI/CD Strategy: Establish organizational standards for Infrastructure as Code using Terraform.
• Standardize automated release pipelines via GitHub and Tekton, embedding mandatory quality, security, and license compliance controls (Checkmarx, FOSSA, SonarQube).
• High-Performance Distributed Processing: Architect and optimize large-scale real-time and batch data processing systems leveraging BigQuery, Dataflow, Dataproc, Cloud Run, Pub/Sub, and distributed computing frameworks on GCP.
• Platform Health & Quality Metrics: Establish organizational coding patterns, reusable frameworks, and SLO compliance.
• Introduce and drive Software Engineering (SWE) metrics, including DORA metrics (lead time, deployment frequency, MTTR, change-failure rate), code coverage, cyclomatic complexity targets, and P99 latency standards.
• Data Governance & Enterprise Security: Drive the strategy and implementation for enterprise data governance, metadata management, data lineage, and strict GCP security controls (IAM, VPC Service Controls, encryption).
• Resilience, Observability & Incident Leadership: Establish deployment and observability standards; lead critical incident resolution and Root Cause Analysis (RCA) to implement permanent solutions and address technical debt.
• Mentorship & Culture: Mentor engineers across teams, conduct high-impact code reviews (Code Guardians), drive cultural change, and represent organizational technical excellence internally and externally (tech talks, blogs, open-source).

TekWissen Group is an equal opportunity employer supporting workforce diversity.