Data Engineer

IVANS Insurance Solutions; Bengaluru; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Applied Systems India Pvt Ltd. is seeking a Data Engineer to design, build and optimize scalable data pipelines on Google Cloud Platform. You will work on BigQuery-based data warehousing, ETL/ELT workflows with Airflow, and data modeling to support analytics and reporting.

The role requires 4+ years in data/ETL engineering, strong SQL, Python, and DBT skills, plus hands-on experience with Dataflow and related GCP services. Join a team that values modern data practices and scalable architectures.

Qualifications

• 4+ years of experience in Data/ETL Engineering and pipeline development
• Experience building scalable Data Warehouse in cloud platforms (preferably Google BigQuery)
• Proficiency with SQL, DBT, Python and ETL tools
• Hands-on with Dataflow, Dataflow SDK or similar for batch/streaming
• Experience with GCP managed data services: DataProc, Dataflow, BigQuery
• Experience in designing, building and maintaining ETL processes with reusable components
• Familiarity with Data Lake, Data Modeling and star/snowflake schemas

Responsibilities

• Design, build and maintain scalable data pipelines with automated data quality checks
• Implement data life cycles, data lineage and governance
• Develop BigQuery SQL procedures and similar functions with logging
• Optimize ETL processes for performance and scalability
• Lead end-to-end development from ingestion to consumption using GCP services and Airflow
• Create and maintain robust data models and schemas for analytics
• Ensure data quality and reliability through testing and validation

Skills

GCP (BigQuery)

SQL

Python

DBT

Apache Airflow

ETL pipelines

Data Warehousing

Data Lake concepts

Data quality checks

Education

Bachelor's degree in Computer Science, MIS, or CIS

Tools

Dataflow

DataProc

BigQuery

Talend/Fivetran

Git

Job description

Job Description

Amazing Career Moments Happen Here

Transforming the insurance industry is ambitious, we know. That’s why at Applied Systems India Pvt Ltd., an Applied Systems company, we’re building a team that shows up every day ready to learn, willing to try new things, and driven to deliver innovative software and services that make us indispensable to our customers – all within a culture built on values that make us indispensable to each other too. With 40+ years of experience in the Insurtech game,we’renot just redefiningwhat’sachievable,we’recreating a place where amazing career moments are made possible.

Position Overview

AppliedSystems, Inc., a worldwide leader in insurance technology, is currently searching for an experiencedData Engineerwith proven experience in Google Cloud Platform (GCP)to join our team.We are on an exciting journey to scale our Data and Analytics capabilities to enable better data-driven decision making across the business.In this role, you willbe responsible fordesigning, building, andmaintainingscalable data pipelines,optimizingdata processes, and ensuring the seamless integration of data from various sources. If you are passionate about data and excited to work oncutting-edgetechnologies, we want to hear from you!

What You will Do

• Design, develop,operationalizerobust and scalable data pipelineswith automated data quality checksto support business needsanddemonstrateownership oflive data pipelines.

• Proficiencyunderstanding and implementingdata life cycles,data lineage, custom metadata, and data governance.

• ProficiencyimplementingBigQuerySQLprocedures, functions, andsimilar, with actionablelogging

• OptimizeETL processes and data workflows to ensureabiding byperformanceconstraints, for efficiencyandscalability.

• Comfortably lead designing and buildingof development toproduction data pipelines from data ingestion to consumption using GCP services, Python,BigQuery, DBT, SQL, Apache Airflow,Celigo.

• Expertisein JSON, XML, text parsing usingDataflow,Python, orbatch jobs.

• Advocates and practicessoftware best practices inleveragingreusable componentsin implementation.

• Design, develop andmaintainrobust, and scalable data models and schemas to support analytics and reporting requirements.

• Optimizedata processing performance, ensure high availability, scalability of data systems and solutions.

• Implement monitoring and alerting mechanisms to proactivelyidentifyand resolve issues.

• Ensure data quality and consistency through rigorous testing and validation processesin development and production tiers.

• Troubleshoot and resolve data-related issues promptly.

• Create, update, andmaintaintechnical documentation of the data processes, pipelines, and models.

• Stay updated with industry trends and technologies to continuously improve our data engineeringpractices.

What You will Need to Succeed

• 4+years of experience inData/ETLEngineering,as well as Data /ETLArchitecture and pipeline developmentwith a minimum of1year of working experience as Google Cloud Platform (GCP) developer.

• Proven experience in building andmaintaininga scalable Data Warehouse in a cloud-based data platform, preferably in Google’sBigQuery.

• Experience with the primary managed data services within GCP, includingDataProc, Dataflow,BigQueryetc.

• Proficiencyin SQL,DBT,Python(Apache Airflow, Composer)and hands-on experiencewith ETL tools likeTalend,Fivetranor similar.

• Proficiencyin Git for version control

• Experience withDBT for data transformation.

• Proven experience inhigh-qualitydesigning,buildingand maintainingETL processes, automated data quality checks andreusable ETL components.

• Familiarity withDataLake and DataWarehousing concepts andDataModelling techniques.

• Familiarity with concepts like star schema, snowflake schema,standardization,normalization,factand dimension tables.

• Strong problem-solving skills and the ability to work independently as well as collaboratively.

• Excellent communication skills and the ability to articulate technical concepts to non-technical stakeholders.

• Bachelor-level degree in Computer Science, MIS, or CIS, or equivalent experience.

When You Join Team Applied, You Can Expect:

A culture that values who you areandrecognizesthat youaren’tjust an employee; you are a teammate, and you matter. We thrive on the benefits of our different experiences and celebrate the uniqueness our teammates bring to work with them every day.

We flex our time together, collaborating remotely and in-person to empower our teams to work in the ways that work best for them.

Learn more about the people behind our products at–

• LinkedIn Page Applied Systems India

• https://www1.appliedsystems.com/en-us/about-us/jobs/

Your Security Matters:

Our candidates’ personal information and online safety are top of mind for us. At Applied,we proactivelyprotect your personal information and only communicate with candidates via a secure @appliedsystems.com email or through our officialcareers’portal.

EEO Statement

Applied Systems is proud to be an Equal Employment Opportunity Employer. Diversity and Inclusion is a business imperative and is a part of building our brand and reputation. At Applied, we don’t discriminate, and we are committed to recruit, develop, retain, and promote regardless of race, religion, color, national origin, sexual orientation, gender identity, disability, age, veteran status, and other protected status as required by applicable law.