Senior Data Engineer

OneMagnify; Chennai District; On-site; INR 3,500,000 - 6,000,000; Full time

Benefits offered by this job

Medical Insurance

Provident Fund (PF)

Gratuity

Paid holidays

Job summary

OneMagnify in Chennai is seeking a Senior Data Engineer to design, develop, and implement enterprise-scale cloud data solutions on Google Cloud Platform. You will architect Data Lakes, Data Warehouses, and analytics platforms, and lead scalable ETL/ELT frameworks.

You will mentor engineers, govern data products, ensure quality, observability, and security, and collaborate with product managers, data architects, and stakeholders to translate requirements into scalable, reliable data solutions.

Qualifications

• Bachelor's or Master's in CS/IS/Engineering or related field.
• 8+ years in Data Engineering, ETL/ELT, and data platform delivery.
• 5+ years hands-on in Google Cloud Platform (GCP).
• Experience building Data Lakes/Warehouses and analytics platforms.
• Expert SQL with performance tuning.
• Strong Python and modern data engineering frameworks.
• Hands-on with BigQuery, GCS, Dataflow, Dataproc, Cloud Run, Pub/Sub, Airflow/Cloud Composer, Cloud Functions.
• CI/CD pipelines using GitHub, Terraform, Tekton, and IaC.
• Knowledge of data governance, security, privacy, and compliance.
• Experience in Agile/Scrum/Lean; stakeholder management.

Responsibilities

• Design and maintain scalable cloud-native data platforms on GCP.
• Architect Data Lakes, Data Warehouses, Data Marts, Analytics Platforms.
• Build robust ETL/ELT frameworks and high-volume data pipelines.
• Implement event-driven and batch processing architectures.
• Provide leadership, mentorship, and coaching to engineers.
• Establish CI/CD, governance, and engineering standards.
• Ensure data quality, observability, and security across data products.
• Drive performance optimization for BigQuery and cloud costs.
• Lead architecture and code reviews; collaborate with stakeholders.

Skills

SQL

Python

Data modeling

ETL/ELT

GCP data platforms

Data Lakes/Warehouses

Leadership

CI/CD

Stakeholder management

Education

Bachelor's or Master's in Computer Science, Information Systems, Engineering

Tools

BigQuery

GCS

Dataflow

Dataproc

Cloud Run

Pub/Sub

Airflow

Cloud Composer

Cloud Functions

GitHub

Terraform

Tekton

Infrastructure as Code

Job description

OneMagnify is an AI native, platform-enabled B2B digital agency operating at the intersection of data, technology, and creativity. We help complex organizations drive measurable business outcomes by building smarter customer experiences and delivering highly integrated solutions across digital, media, and technology. By combining deep industry expertise with advanced analytics and artificial intelligence, we enable our clients to make better decisions, move faster, and compete more effectively in dynamic markets.

We are seeking an experienced and highly skilled Senior Data Engineer to lead the design, development, and implementation of enterprise-scale cloud data solutions. This role is responsible for architecting modern data platforms, building scalable ETL/ELT frameworks, and delivering high-performance analytics solutions on Google Cloud Platform (GCP).

The Senior Data Engineer is a technical leader and strategic contributor responsible for designing and governing modern data solutions across the organization.

You will collaborate closely with Product Managers, Product Owners, Software Engineers, Data Architects, Analytics Teams, and Business Stakeholders to transform complex business requirements into scalable, secure, and performant data platforms.

You have extensive experience architecting and operationalizing large-scale data ecosystems, including Data Lakes, Data Warehouses, Data Marts, and Analytics Platforms within GCP.

You possess strong leadership capabilities, excellent stakeholder management skills, and a passion for mentoring engineering teams while driving technical excellence.

The Impact You’ll have:

As a Senior Data Engineer, you will provide technical leadership across the data ecosystem, drive engineering best practices, mentor team members, and collaborate with cross-functional stakeholders to transform business requirements into scalable, secure, and reliable data products. You will play a critical role in shaping the organization's data strategy and enabling data-driven decision-making through modern cloud technologies and innovative engineering practices. The ideal candidate possesses deep expertise across modern data engineering technologies, strong architectural skills, and proven experience leading teams in designing and delivering large-scale cloud data platforms.

What You’ll Do:

• Data Platform Architecture & Engineering Design, develop, and maintain scalable cloud-native data platforms on Google Cloud Platform (GCP).
• Architect enterprise Data Lakes, Data Warehouses, Data Marts, and Analytics Platforms.
• Build robust, reusable, and metadata-driven ETL/ELT frameworks.
• Develop high-volume data pipelines capable of supporting large-scale analytics and reporting workloads.
• Implement event-driven and batch-processing architectures using modern cloud services.
• Collaborate with Data Architects to define enterprise data models, integration patterns, and platform strategies.
• Provide technical leadership, mentorship, and coaching to Data Engineers and ETL developers.
• Establish data engineering best practices, coding standards, CI/CD frameworks, and governance processes.
• Ensure data quality, observability, monitoring, lineage, governance, and security across all data products.
• Drive performance optimization initiatives for BigQuery workloads and cloud infrastructure costs.
• Evaluate emerging technologies, including AI/ML and Generative AI solutions, and recommend adoption strategies.
• Partner with business stakeholders to translate requirements into scalable technical solutions.
• Lead code reviews, architecture reviews, and technical design sessions.
• Identify and mitigate delivery risks while ensuring successful project execution.
• Support production environments through proactive monitoring, troubleshooting, and root-cause analysis.
• Technical Leadership Provide technical leadership and architectural guidance to Data Engineers and ETL developers.
• Establish engineering standards, coding best practices, design patterns, and governance frameworks.
• Conduct architecture reviews, code reviews, and technical design sessions.
• Mentor team members and support skill development across the engineering organization.

What You'll Need:

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
• 8+ years of overall experience in Data Engineering, ETL/ELT development, and data platform delivery.
• 5+ years of hands-on experience in Google Cloud Platform (GCP).
• Extensive experience designing and building enterprise-scale Data Warehouses, Data Lakes, and Analytics Platforms.
• Expert-level SQL skills with experience in performance tuning and optimization.
• Strong expertise in Python and modern data engineering frameworks.
• Hands-on experience with: BigQuery Google Cloud Storage (GCS) Dataflow Dataproc Cloud Run Pub/Sub Cloud Composer / Apache Airflow Cloud Functions.
• Experience building CI/CD pipelines using GitHub, Terraform, Tekton, and Infrastructure-as-Code practices.
• Strong understanding of distributed data processing and cloud-native architectures.
• Experience implementing data quality, testing, observability, and monitoring frameworks.
• Knowledge of data governance, security, privacy, and compliance best practices.
• Experience working within Agile, Scrum, and Lean methodologies.
• Proven ability to manage multiple stakeholders and drive technical discussions.

Future-Ready Skills (Nice to Have):

• Google Cloud Professional Data Engineer Certification.
• Google Cloud Associate Cloud Engineer Certification.
• Experience with Qlik Sense, Looker, Power BI, or other BI and Analytics tools.
• Experience with Snowflake, Databricks, or other modern data platforms.
• Exposure to AI, Machine Learning, Generative AI, and Large Language Models (LLMs).
• Experience leading onshore and offshore engineering teams.

Benefits

• Medical Insurance, PF, Gratuity, paid holidays, and more.

We are an equal opportunity employer.

We believe that Innovative ideas and solutions start with unique perspectives.

That's why we're committed to providing every employee a workplace that's free of discrimination and intolerance.

We're proud to be an equal opportunity employer and actively search for like-minded people to join our team.

Whether it's awareness, advocacy, engagement, or efficacy, we move brands forward with work that delivers results. Through meaningful analytics, engaging communications and innovative technology solutions, we help clients tackle their most ambitious projects and overcome their biggest challenges.