Senior Data Engineer

OneMagnify; Chennai; On-site; INR 3,500,000 - 6,000,000; Full time

Benefits offered by this job

Medical Insurance

Provident Fund (PF)

Gratuity

Paid holidays

Job summary

OneMagnify is seeking a Senior Data Engineer to lead design, development, and implementation of enterprise-scale cloud data solutions on Google Cloud Platform. You will architect Data Lakes, Data Warehouses, and Analytics Platforms while building scalable ETL/ELT frameworks and high-volume data pipelines.

You will mentor engineers, drive best practices, and ensure data quality, observability, and governance across products. Strong leadership and stakeholder management are essential for success.

Qualifications

• 8+ years of experience in data engineering and data platform delivery.
• 5+ years hands-on experience in Google Cloud Platform (GCP).
• Experience designing and delivering enterprise Data Lakes, Data Warehouses, and Analytics Platforms.
• Expert-level SQL with performance tuning and optimization.
• Strong Python and modern data engineering frameworks.
• Hands-on with: BigQuery, GCS, Dataflow, Dataproc, Cloud Run, Pub/Sub, Airflow, Terraform, GitHub workflows.
• Knowledge of data governance, security, privacy, and compliance best practices.
• Experience working in Agile, Scrum, and Lean methodologies.

Responsibilities

• Design, develop, and maintain scalable cloud-native data platforms on Google Cloud Platform (GCP).
• Architect enterprise Data Lakes, Data Warehouses, Data Marts, and Analytics Platforms.
• Build robust, reusable ETL/ELT frameworks and high-volume data pipelines.
• Provide technical leadership, lead architecture reviews, and mentor engineers.
• Ensure data quality, observability, governance, and security across data products.
• Drive performance optimization for BigQuery and cloud infrastructure costs.

Skills

SQL

Python

GCP

Data Modeling

ETL/ELT

BigQuery

CI/CD

Leadership

Education

Bachelor’s or Master’s in CS/IS/Engineering

Tools

GCS

Dataflow

Dataproc

Cloud Run

Pub/Sub

Airflow

Terraform

GitHub

Job description

OneMagnify is an AI native, platform-enabled B2B digital agency operating at the intersection of data, technology, and creativity. We help complex organizations drive measurable business outcomes by building smarter customer experiences and delivering highly integrated solutions across digital, media, and technology. By combining deep industry expertise with advanced analytics and artificial intelligence, we enable our clients to make better decisions, move faster, and compete more effectively in dynamic markets.

We are seeking an experienced and highly skilled Senior Data Engineer to lead the design, development, and implementation of enterprise-scale cloud data solutions. This role is responsible for architecting modern data platforms, building scalable ETL/ELT frameworks, and delivering high-performance analytics solutions on Google Cloud Platform (GCP).

The Senior Data Engineer is a technical leader and strategic contributor responsible for designing and governing modern data solutions across the organization. You will collaborate closely with Product Managers, Product Owners, Software Engineers, Data Architects, Analytics Teams, and Business Stakeholders to transform complex business requirements into scalable, secure, and performant data platforms.

You have extensive experience architecting and operationalizing large-scale data ecosystems, including Data Lakes, Data Warehouses, Data Marts, and Analytics Platforms within GCP. You possess strong leadership capabilities, excellent stakeholder management skills, and a passion for mentoring engineering teams while driving technical excellence.

The Impact You’ll have:

As a Senior Data Engineer, you will provide technical leadership across the data ecosystem, drive engineering best practices, mentor team members, and collaborate with cross-functional stakeholders to transform business requirements into scalable, secure, and reliable data products. You will play a critical role in shaping the organization’s data strategy and enabling data-driven decision-making through modern cloud technologies and innovative engineering practices.

The ideal candidate possesses deep expertise across modern data engineering technologies, strong architectural skills, and proven experience leading teams in designing and delivering large-scale cloud data platforms.

What You’ll Do:

Data Platform Architecture & Engineering

• Design, develop, and maintain scalable cloud-native data platforms on Google Cloud Platform (GCP).
• Architect enterprise Data Lakes, Data Warehouses, Data Marts, and Analytics Platforms.
• Build robust, reusable, and metadata-driven ETL/ELT frameworks.
• Develop high-volume data pipelines capable of supporting large-scale analytics and reporting workloads.
• Implement event-driven and batch-processing architectures using modern cloud services.
• Collaborate with Data Architects to define enterprise data models, integration patterns, and platform strategies.
• Provide technical leadership, mentorship, and coaching to Data Engineers and ETL developers.
• Establish data engineering best practices, coding standards, CI/CD frameworks, and governance processes.
• Ensure data quality, observability, monitoring, lineage, governance, and security across all data products.
• Drive performance optimization initiatives for BigQuery workloads and cloud infrastructure costs.
• Evaluate emerging technologies, including AI/ML and Generative AI solutions, and recommend adoption strategies.
• Partner with business stakeholders to translate requirements into scalable technical solutions.
• Lead code reviews, architecture reviews, and technical design sessions.
• Identify and mitigate delivery risks while ensuring successful project execution.
• Support production environments through proactive monitoring, troubleshooting, and root-cause analysis.

Technical Leadership

• Provide technical leadership and architectural guidance to Data Engineers and ETL developers. Establish engineering standards, coding best practices, design patterns, and governance frameworks.
• Conduct architecture reviews, code reviews, and technical design sessions.
• Mentor team members and support skill development across the engineering organization.

What You’ll Need:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
• 8+ years of overall experience in Data Engineering, ETL/ELT development, and data platform delivery.
• 5+ years of hands‑on experience in Google Cloud Platform (GCP).
• Extensive experience designing and building enterprise-scale Data Warehouses, Data Lakes, and Analytics Platforms.
• Expert‑level SQL skills with experience in performance tuning and optimization.
• Strong expertise in Python and modern data engineering frameworks.
• Hands‑on experience with: BigQuery Google Cloud Storage (GCS) Dataflow Dataproc Cloud Run Pub/Sub Cloud Composer / Apache Airflow Cloud Functions. Experience building CI/CD pipelines using GitHub, Terraform, Tekton, and Infrastructure‑as‑Code practices.
• Strong understanding of distributed data processing and cloud‑native architectures.
• Experience implementing data quality, testing, observability, and monitoring frameworks.
• Knowledge of data governance, security, privacy, and compliance best practices.
• Experience working within Agile, Scrum, and Lean methodologies.
• Proven ability to manage multiple stakeholders and drive technical discussions.

Future-Ready Skills (Nice to Have):

• Google Cloud Professional Data Engineer Certification.
• Google Cloud Associate Cloud Engineer Certification.
• Experience with Qlik Sense, Looker, Power BI, or other BI and Analytics tools.
• Experience with Snowflake, Databricks, or other modern data platforms.
• Exposure to AI, Machine Learning, Generative AI, and Large Language Models (LLMs).
• Experience leading onshore and offshore engineering teams.

Benefits

We offer a comprehensive benefits package including Medical Insurance, PF, Gratuity, paid holidays, and more.

We are an equal opportunity employer

We believe that Innovative ideas and solutions start with unique perspectives. That’s why we’re committed to providing every employee a workplace that’s free of discrimination and intolerance. We’re proud to be an equal opportunity employer and actively search for like-minded people to join our team.