Lead Data Engineer /Solution Architect - Chennai & Bagalore

Teamplus Staffing Solution; Chennai District, Bengaluru; Hybrid; INR 3,200,000 - 3,600,000; Full time

Job summary

Teamplus Staffing Solution is seeking a Senior Data Engineer/Solution Architect to design, build, and own end-to-end production pipelines powering analytics across the org. Must have strong Python and SQL expertise, with experience in finance/risk/compliance data domains.

The role requires 8+ years of experience, a Bachelor's degree, and permanent full-time employment in a hybrid setup across Bangalore & Chennai. Immediate joining is preferred.

Qualifications

• Bachelor's degree in Computer Science, IT, Engineering or related field.
• 8+ years of experience in data engineering or data architecture roles.
• Strong Python and SQL expertise with production data pipelines.

Responsibilities

• Own data architecture and design decisions for pipelines and data models.
• Take end-to-end ownership of pipelines in production: design, build, deploy, monitor, operate.

Skills

Data architecture

Python

SQL

End-to-end ownership

Airflow-like orchestration

Education

Bachelor's degree in CS/IT/Engineering

Tools

MySQL

PostgreSQL

Airflow

Job description

Hi,We are having opening for Data Engineer Solution Architect / Lead

Job Summary:

We're looking for a Senior Data Engineer with strong data architecture and system design skills to design, build, and own end-to-end production pipelines powering analytics and decision-making across the org. The role centers on deep Python + SQL expertise, robust transaction-level fact tables, and rigorous data quality and auditability, ideally within a finance, risk, or compliance data domain

Working Days:

Monday Friday

Job Timing:

9AM 6PM Position / DesignationData Engineer Solution ArchitectQualificationBachelor's degree in Computer Science, Information Technology, Engineering, or a related technical fieldYears of Experience8+ Years Permanent / Contract (If contract, period ?)Permanent Full TimeOffice / Remote / Hybrid : Bnagalore & chennaiNumber of post2GenderMale / FemaleAnnual CTC / Salary 32 L.p.a Selection Process1- Total 3 Technical round 2- 2 rounds evaluation with LV (we can plan to take this together based on panel availability) & 1 with client

Job Role & Responsibility

Own data architecture and system design decisions for pipelines and data models - grain, partitioning, schema evolution, and scalability tradeoffs.Take end-to-end ownership of pipelines in production: design, build, deploy, monitor, and operate. Design and build transaction tables (append-only, immutable event/transaction-grain fact tables) alongside standard fact/dimension models using medallion (bronze/silver/gold) architecture. Build and support pipelines for finance, risk, or compliance use cases where accuracy, auditability, and data lineage are critical. Implement data quality and auditability controls: validation checks, reconciliation logic, anomaly detection, and audit trails for every pipeline you own. Write complex, cross-dialect SQL (MySQL + PostgreSQL): window functions, multi-layered CTEs, CASE-driven logic, COALESCE/NULLIF, type casting, and date/timestamp handling. Build idempotent reload patterns (DELETE+INSERT), UNION ALL/set operations, and templated (Jinja-style) SQL including handling for late-arriving/corrected transaction records without double-counting. Orchestrate Airflow-style DAGs (Pipeline/BaseTask, External TaskSensor for cross-pipeline deps) with secure credential handling via uSecret. Build Python ETL tooling: pandas (CSV DB), SQLAlchemy + raw drivers (MySQLdb, psycopg2), type hints/dataclasses, class-based pipeline design. Integrate with Google Drive/Sheets APIs; build YAML-driven pipeline configs; handle Piper staging/user_staging quirks. Own CI/CD for pipelines via standard Git workflows.

Skills

• Strong data architecture and system design skills to make sound tradeoffs on modeling, partitioning, and scalability, not just write queries.
• Demonstrated end-to-end production ownership of data pipelines from design through deployment, monitoring, and operational support.

Expert-level Python + SQL as the primary toolset. Hive/Hadoop is a nice-to-have only.

Robust data quality and auditability practices - validation, reconciliation, anomaly detection, audit trails. Experience working with finance, risk, or compliance data - comfort with the heightened accuracy, auditability, and data-lineage requirements typical of these domains. Proven experience designing and building transaction/fact tables. Expert SQL (window functions, CTEs, CASE logic, cross-dialect MySQL/PostgreSQL). Strong Python (pandas, SQLAlchemy, type hints/dataclasses, class-based pipelines). Airflow-like orchestration experience (Piper/uWorc a plus). Solid data modeling fundamentals (fact/dim, normalization, medallion architecture). YAML-based config experience; standard CI/CD and Git workflows

Joining Date

Need Immediate to 1 Month