Data Engineer

Applied Systems; Bengaluru; Hybrid; INR 1,800,000 - 2,700,000; Full time

Job summary

Applied Systems India Pvt Ltd. is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines on Google Cloud Platform. You will own data quality, governance, and the end-to-end data flow from ingestion to analytics.

The role emphasizes building robust models and reusable components for analytics across business units. Ideal candidates bring 4+ years in data/ETL engineering, hands-on BigQuery and GCP experience, and strong skills in SQL, Python, DBT, and Airflow.

Qualifications

• 4+ years of experience in Data/ETL engineering and 1+ year with GCP.
• Experience building scalable data warehouses in Google BigQuery.
• Proficiency in SQL, Python, DBT, and ETL tooling.

Responsibilities

• Design, build, and maintain scalable data pipelines with data quality checks.
• Implement data life cycle, lineage, and governance practices.
• Develop BigQuery SQL procedures and logging for operability.
• Optimize ETL processes for performance and scalability.
• Lead development of data pipelines from ingestion to consumption using GCP, Python, Airflow, and DBT.
• Handle JSON/XML/text parsing with Dataflow or batch jobs and ensure data quality.
• Create robust data models and schemas to support analytics and reporting.
• Document pipelines and stay updated on industry trends.

Skills

SQL

Python

GCP

BigQuery

Airflow

DBT

ETL

Git

Data Modeling

Education

Bachelor's degree in CS/MIS

Tools

BigQuery

Dataflow

DataProc

Talend

Fivetran

Apache Airflow

Composer

DBT

Job description

Amazing Career Moments Happen Here

Transforming the insurance industry is ambitious, we know. That’s why at Applied Systems India Pvt Ltd., an Applied Systems company, we’re building a team that shows up every day ready to learn, willing to try new things, and driven to deliver innovative software and services that make us indispensable to our customers – all within a culture built on values that make us indispensable to each other too. With 40+ years of experience in the Insurtech game, we’re not just redefining what’s achievable, we’re creating a place where amazing career moments are made possible.

Job Description

Amazing Career Moments Happen Here

Transforming the insurance industry is ambitious, we know. That’s why at Applied Systems India Pvt Ltd., an Applied Systems company, we’re building a team that shows up every day ready to learn, willing to try new things, and driven to deliver innovative software and services that make us indispensable to our customers – all within a culture built on values that make us indispensable to each other too. With 40+ years of experience in the Insurtech game, we’re not just redefining what’s achievable, we’re creating a place where amazing career moments are made possible.

Position Overview

Applied Systems, Inc., a worldwide leader in insurance technology, is currently searching for an experienced Data Engineer with proven experience in Google Cloud Platform (GCP) to join our team.We are on an exciting journey to scale our Data and Analytics capabilities to enable better data-driven decision making across the business. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, optimizing data processes, and ensuring the seamless integration of data from various sources.

What You Will Do

• Design, develop, operationalize robust and scalable data pipelines with automated data quality checks to support business needs and demonstrate ownership of live data pipelines.
• Proficiency understanding and implementing data life cycles, data lineage, custom metadata, and data governance.
• Proficiency implementing BigQuery SQL procedures, functions, and similar, with actionable logging
• Optimize ETL processes and data workflows to ensure abiding by performance constraints, for efficiency and scalability.
• Comfortably lead designing and building of development to production data pipelines from data ingestion to consumption using GCP services, Python, BigQuery , DBT, SQL, Apache Airflow, Celigo .
• Expertise in JSON, XML, text parsing using Dataflow, Python, or batch jobs.
• Advocates and practices software best practices in leveraging reusable components in implementation.
• Design, develop and maintain robust, and scalable data models and schemas to support analytics and reporting requirements.
• Optimize data processing performance, ensure high availability, scalability of data systems and solutions.
• Implement monitoring and alerting mechanisms to proactively identify and resolve issues.
• Ensure data quality and consistency through rigorous testing and validation processes in development and production tiers.
• Troubleshoot and resolve data-related issues promptly.
• Create, update, and maintain technical documentation of the data processes, pipelines, and models.
• Stay updated with industry trends and technologies to continuously improve our data engineering practices.

What You Will Need To Succeed

• 4+ years of experience in Data / ETL Engineering, as well as Data / ETL Architecture and pipeline development with a minimum of 1 year of working experience as Google Cloud Platform (GCP) developer.
• Proven experience in building and maintaining a scalable Data Warehouse in a cloud-based data platform, preferably in Google’s BigQuery .
• Experience with the primary managed data services within GCP, including DataProc , Dataflow, BigQuery etc.
• Proficiency in SQL, DBT, Python (Apache Airflow, Composer) and hands-on experience with ETL tools like Talend, Fivetran or similar.
• Proficiency in Git for version control
• Experience with DBT for data transformation.
• Proven experience in high-quality designing, building and maintaining ETL processes, automated data quality checks and reusable ETL components .
• Familiarity with Data Lake and Data Warehousing concepts and Data Modelling techniques.
• Familiarity with concepts like star schema, snowflake schema, standardization, normalization, fact and dimension tables.
• Strong problem-solving skills and the ability to work independently as well as collaboratively.
• Excellent communication skills and the ability to articulate technical concepts to non-technical stakeholders.
• Bachelor-level degree in Computer Science, MIS, or CIS, or equivalent experience.

When You Join Team Applied, You Can Expect:

A culture that values who you are

and recognizes that you aren’t just an employee; you are a teammate, and you matter. We thrive on the benefits of our different experiences and celebrate the uniqueness our teammates bring to work with them every day.

We flex our time together

collaborating remotely and in-person to empower our teams to work in the ways that work best for them.

Learn more about the people behind our products at –

• LinkedIn Page Applied Systems India
• https://www1.appliedsystems.com/en-us/about-us/jobs/

Your Security Matters:

Our candidates’ personal information and online safety are top of mind for us. At Applied, we proactively protect your personal information and only communicate with candidates via a secure @appliedsystems.com email or through our official careers’ portal.

EEO Statement

Applied Systems is proud to be an Equal Employment Opportunity Employer. Diversity and Inclusion is a business imperative and is a part of building our brand and reputation. At Applied, we don’t discriminate, and we are committed to recruit, develop, retain, and promote regardless of race, religion, color, national origin, sexual orientation, gender identity, disability, age, veteran status, and other protected status as required by applicable law.