Cloud Data Engineer

Verisk

Gurugram District

Hybrid

INR 1,800,000 - 3,200,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Verisk seeks a Cloud Data Engineer to plan, design, develop, and maintain data models, pipelines, and standards for Data Lake and Data Warehouse projects in AWS. Hybrid work in Gurugram, India with in-office 2-3 days/week.

The role involves building robust ETL/ELT pipelines, applying best practices, and collaborating with cross-functional teams to deliver end-to-end data solutions.

Qualifications

  • Minimum 3 years experience as a Data Engineer.
  • Experience with cloud data platforms, data lakes and cloud DWs (Redshift/Snowflake).
  • Proficient with AWS core services (Glue, Bedrock, Athena, Lambda, Sagemaker, Lake Formation, IAM, SQS, S3).
  • Strong SQL skills and Python (Pandas/PySpark).
  • Experience integrating data from CRM/ERP/marketing platforms (Salesforce/Eloqua/Oracle).
  • Experience in data modelling, ELT and standard DWH/ETL concepts.
  • Knowledge of RBAC, monitoring, performance tuning and time travel concepts.
  • Experience deploying data sharing and lake-house patterns.
  • Strong analytical, troubleshooting and communication skills.
  • Exposure to DevOps tools and CI/CD (GitHub).
  • Experience with Power BI and ThoughtSpot in production pipelines.
  • Exposure to AI tools for daily tasks.
  • Ability to translate complex technical work to business users.

Responsibilities

  • Design, build and maintain data pipelines using AWS cloud-native platforms.
  • Develop and maintain data models and ETL/ELT processes.
  • Collaborate with cross-functional teams to deliver end-to-end solutions.
  • Monitor, optimize and troubleshoot data pipelines for reliability and security.
  • Migrate legacy pipelines to modern data architecture.
  • Document data architecture and flows for diverse audiences.

Tools

Redshift
Snowflake
AWS Glue
AWS Bedrock
Athena
AWS Lambda
Sagemaker
Lake Formation
IAM
SQS
S3
Salesforce
Eloqua
Oracle
Power BI
ThoughtSpot
Python
Pandas
PySpark

Job description

Job Description

We are looking for a Cloud Data Engineer, who will be responsible for planning, design, developing and maintaining data models, data pipelines and standards for various Data Integration & Data Lake and Data Warehouse projects in the AWS Cloud. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. Develop and maintain documentation of the data architecture, data flow, and data models of the data warehouse appropriate for various audiences. Adopt Cloud technologies and industry best practices in the field of data lakes and data warehouse architecture and modelling.

The role is based in our Gurugram, India location which has a flexible hybrid work model that has employees in-office 2-3 days per week and 2-3 days per week remote.

This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project.

Responsibilities
  • Demonstrated ability to have successfully complete multiple, complex technical data engineering projects and create high-level design and architecture of the solution.
  • Able to communicate the capabilities and improvements offered by data solutions with both the development teams and business user teams.
  • Participate in technical design discussions and implement solutions along with the team and assist in building/maintaining medallion data architecture.
  • Develop and maintain data pipelines using AWS cloud-native data platforms and services following established patterns and team standards.
  • Design, build and maintain robust ETL/ELT pipelines from multiple sources following the best practices.
  • Design data pipes and automate data ingestion and cleansing, transformation activities using the DevOps methodologies.
  • Contribute to migration of legacy pipelines to modern data architecture.
  • Write complex SQL/python/Pyspark transformations and build data models that support analytics, reporting and downstream applications.
  • Monitor, optimize and troubleshoot data pipelines to ensure reliability, scalability, security and compliance with the data quality and governance standards.
  • Collaborate with cross-functional project team to deliver end-to-end solutions.
Qualifications
  • Minimum 3 years of experience working as a Data Engineer
  • Must have experience with cloud-based data platforms, data lakes, cloud data warehouse (Redshift or Snowflake).
  • Proven direct experience with traditional databases, RedShift, AWS Glue, AWS Bedrock, Athena, AWS Lambda, Sagemaker, Lake Formation, IAM, SQS, S3 and other AWS core services.
  • Expertise in SQL and write optimized SQLs across platforms.
  • Expertise in writing python scripts and ability to manipulate data using Pandas/Pyspark. Familiarity and usage of different file formats in batch processing like Parquet/ORC and Open table formats.
  • Experience integrating data from CRM, ERP, and marketing platforms (Salesforce, Eloqua, Oracle) into data lake/warehouse.
  • Experience in data modelling, ELT, implementing complex stored Procedures and standard DWH and ETL/ELT concepts.
  • Experience in advanced concepts like setting up resource monitors, Role-based access controls (RBAC), query performance tuning, time travel and understanding how to use these features.
  • Experience in deploying features such as data sharing, events, and lake-house patterns.
  • Provide resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface.
  • Experience with data security and data access controls and design.
  • Strong analytical, troubleshooting, and critical thinking skills.
  • Familiarity with Devops tools for version control, CI/CD, GitHub.
  • Exposure to Enterprise BI tools like Power BI and ThoughtSpot.
  • Experience developing and supporting production data pipelines.
  • Exposure to AI and leveraging AI tools for daily tasks.
  • Effective communication skills with ability to translate complex technical work to business users.
Our People, Our Culture

For more than 50 years, Verisk has helped property and casualty insurers make smarter decisions about risk through AI-powered risk modeling, advanced analytics, and technology solutions spanning the entire policy lifecycle. We are a leading strategic data, analytics, and technology partner to the global insurance industry, guided by core values of learning, caring, and results while maintaining the highest ethical standards as stewards of the industrys most comprehensive datasets. Learn more about Verisk and what we are doing within the insurance industry.

For the eighth consecutive year, Verisk is proudly recognized as a Great Place to Work® for outstanding workplace culture in the US, the fourth consecutive year in the UK, Spain, and India, and the second consecutive year in Poland. In addition, we’ve been recognized by The Wall Street Journal as one of the Best-Managed Companies and by Forbes as a World’s Best Employer, testaments to the value we place on workplace culture.

Our Culture: Explore our inclusive, people-first culture that fosters innovation, collaboration, and belonging.

Awards & Recognition: See why Verisk is consistently recognized as a Great Place to Work™ around the world.

Our Businesses: Learn about the diverse industries we serve — from insurance and energy to financial services and beyond.

Life at Verisk: Discover what it’s like to work at Verisk through employee stories, team highlights, and culture moments.

Careers at Verisk: Join a global team of problem-solvers and innovators doing meaningful work that’s shaping the future of industries. Whether youre just starting out or looking to take your career to the next level, Verisk offers growth, purpose, and a people-first culture

Let’s build something meaningful together!

Verisk Analytics is an equal opportunity employer.

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veterans status, age or disability or any other characteristics protected by applicable law. Verisk’s minimum hiring age is 18 except in countries with a higher age limit subject to applicable law.

https://www.verisk.com/company/careers/

Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine, or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.

Verisk Employee Privacy Notice

Requirements
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Engineer
Lead Engineer

Krug-Sachverst • Hyderabad

Hybrid
INR 1,200,000 - 1,800,000
Short-term incentive
Hybrid work arrangement
Equal opportunity employer
.Net Lead Engineer
.Net Lead Engineer

Verisk Analytics, Inc. • Hyderabad

On-site
INR 1,800,000 - 3,200,000
Lead AI Engineer
Lead AI Engineer

Krug-Sachverst • Hyderabad

Hybrid
INR 1,800,000 - 3,000,000
Short-term incentive
Hybrid work arrangement
Lead AI Engineer
Lead AI Engineer

Maplecroft • Hyderabad

Hybrid
INR 2,400,000 - 3,800,000
Short Term Incentive
Lead AI Engineer
Lead AI Engineer

Verisk • Hyderabad

On-site
INR 1,500,000 - 3,000,000
Scrum Master
Scrum Master

Verisk • Hyderabad

On-site
INR 1,200,000 - 1,600,000
Sr. SQA Engineer I
Sr. SQA Engineer I

Verisk Careers | Verisk • India

Hybrid
INR 900,000 - 1,300,000
Sr SDET II
Sr SDET II

Maplecroft • Hyderabad

Hybrid
INR 1,500,000 - 3,500,000
Hybrid work arrangement
Short-term incentive
Lead Next JS Developer
Lead Next JS Developer

Maplecroft • Hyderabad

Hybrid
INR 4,200,000 - 7,000,000
Short Term Incentive
Sr. Data Engineer
Sr. Data Engineer

Applied Systems • Bengaluru

Hybrid
INR 2,000,000 - 4,000,000