Staff Data Engineer

Applied Systems India; Bengaluru; In loco; INR 4.000.000 - 6.500.000; Tempo pieno

Descrizione del lavoro

Applied Systems India is seeking a Staff Data Engineer to lead the data platform on Google Cloud Platform. You will design and implement scalable data pipelines and govern data quality, lineage, and metadata across teams.

This role emphasizes architecture ownership and mentoring engineers to raise the bar on data engineering practices. You will collaborate with engineering and product leadership to translate business problems into robust data solutions, leveraging BigQuery, Dataflow, Airflow,

Competenze

• 10+ years in Data/ETL engineering, with lead-level influence.
• 3+ years hands-on GCP experience with BigQuery and cost optimization.
• Proven track record building scalable cloud data platforms.
• Deep knowledge of SQL, DBT, Python, Airflow/Composer, and ETL tools.
• Experience with streaming architectures and data quality/testing frameworks.
• Ability to drive technical decisions across teams and mentor engineers.

Mansioni

• Design, develop and operate robust, scalable data pipelines with data quality checks.
• Lead data lifecycle governance, data lineage, and metadata management.
• Implement BigQuery procedures and optimize ETL for performance and cost.
• Own data platform architecture end-to-end across GCP stack.
• Work with DataProc/Dataflow, and ETL tools like Talend or Fivetran.
• Establish CI/CD for data workloads and promote best practices.
• Develop data models and schemas for analytics and reporting.
• Provide monitoring, observability and testing frameworks across platforms.
• Document data processes and mentor engineers toward promotions.

Conoscenze

Data Engineering

ETL

GCP

BigQuery

SQL

Python

Apache Airflow

DBT

Dataflow

DataProc

CI/CD for data

Data governance

Streaming architectures

Leadership influence

Formazione

Bachelor's degree in Computer Science or related field

Strumenti

BigQuery

DataProc

Dataflow

Talend

Fivetran

Python

Apache Airflow/Composer

DBT

Google Cloud Platform (GCP)

Descrizione del lavoro

Transforming the insurance industry is ambitious, we know. That's why at Applied Systems India Pvt Ltd., an Applied Systems company, we're building a team that shows up every day ready to learn, willing to try new things, and driven to deliver innovative software and services that make us indispensable to our customers - all within a culture built on values that make us indispensable to each other too. With 40+ years of experience in the Insurtech game, we're not just redefining what's achievable, we're creating a place where amazing career moments are made possible.

Position Overview

Applied Systems, Inc., a worldwide leader in insurance technology, is currently searching for an experienced Staff Data Engineer with proven experience in Google Cloud Platform (GCP)to join our growing Data team in India. We are on an exciting journey to scale our Data and Analytics capabilities to enable better data-driven decision making across the business. In this role you will contribute towards setting the technical direction for our data platform on Google Cloud Platform - defining architecture, establishing engineering standards, optimizing data processes, and ensuring the seamless integration of data from various sources. This is an individual contributor role with organization-wide influence: you will solve our hardest data problems and raise the bar for how we solve all of them. If you are passionate about data and excited to work on cutting-edge technologies, we want to hear from you!

What You will Do

• Design, develop, operationalize robust and scalable data pipelines with automated data quality checks to support business needs and demonstrate ownership of live data pipelines and establish the patterns other engineers use to build theirs.
• Proficiency understanding and implementing data life cycles, data lineage, custom metadata, and data governance.
• Proficiency implementing BigQuery SQL procedures, functions, and similar, with actionable logging
• Optimize ETL processes and data workflows to ensure abiding by performance constraints, for efficiency and scalability.
• Together with the Principal Engineer and Architect, own the architecture of our data platform end to end - ingestion through consumption - across GCP, BigQuery, dbt, Airflow, and Python.
• Expertise in JSON, XML, text parsing using Dataflow, Python, or batch jobs.
• Define and enforce engineering standards across data teams: code review norms, testing strategy, reusable frameworks, CI/CD for data.
• Design, develop and maintain robust, and scalable data models and schemas to support analytics and reporting requirements.
• Optimize data processing performance, ensure high availability, scalability of data systems and solutions.
• Implement monitoring and alerting mechanisms to proactively identify and resolve issues.
• Ensure data quality and consistency through rigorous testing and validation processes in development and production tiers.
• Create, update, and maintain technical documentation of the data processes, pipelines, and models.
• Mentor and grow engineers across teams through design review, pair programming, and structured technical feedback.
• Partner directly with Engineering, Product, and business leadership to translate ambiguous business problems into technical requirements.
• Identify systemic problems no one has asked you to fix, and build the case for addressing them.
• Evaluate emerging technologies and lead the technical roadmap for the data platform, including a multi-quarter view of what we build next and what we retire.

What You will Need to Succeed

• 10+ years of experience in Data / ETL Engineering, as well as Data / ETL Architecture and pipeline development, including 3+ years operating at senior or lead level with demonstrated technical influence beyond your immediate team.
• 3+ years hands-on with the Google Cloud Platform (GCP), including deep BigQuery expertise: partitioning and clustering strategy, slot and reservation management, cost optimization at scale, and query performance tuning.
• Proven track record architecting, building and scaling cloud data platform serving multiple consuming teams - with specifics on scale, latency, and cost.
• Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery etc.
• Deep expertise in SQL, DBT, Python (Apache Airflow, Composer) and hands-on experience with ETL tools like Talend, Fivetran or similar.
• Demonstrated experience with streaming and near real-time architectures, including delivery semantics, schema evolution, and late-arriving data.
• Strong dimensional modeling expertise, and the judgment to know when to depart from it.
• Experience establishing data quality, observability, and testing frameworks that other engineers adopt and maintain.
• Experience with infrastructure as code and CI/CD for data workloads.
• Demonstrated ability to influence without authority - driving technical decisions across teams that don't report to you.
• Track record of mentoring engineers to promotion.
• Excellent written communication, including design documents that create alignment among senior stakeholders.
• Bachelor's degree in Computer Science or a related field, or equivalent experience.

When You Join Team Applied, You Can Expect:

A culture that values who you are and recognizes that you aren't just an employee; you are a teammate, and you matter. We thrive on the benefits of our different experiences and celebrate the uniqueness our teammates bring to work with them every day.

We flex our time together, collaborating remotely and in-person to empower our teams to work in the ways that work best for them.

Learn more about the people behind our products at

• LinkedIn Page Applied Systems India
• https://www1.appliedsystems.com/en-us/about-us/jobs/

Your Security Matters:

Our candidates's personal information and online safety are top of mind for us. At Applied, we proactively protect your personal information and only communicate with candidates via a secure @appliedsystems.com email or through our official careers' portal.

EEO Statement

Applied Systems is proud to be an Equal Employment Opportunity Employer. Diversity and Inclusion is a business imperative and is a part of building our brand and reputation. At Applied, we don't discriminate, and we are committed to recruit, develop, retain, and promote regardless of race, religion, color, national origin, sexual orientation, gender identity, disability, age, veteran status, and other protected status as required by applicable law.