IND Senior Engineer, Data

The Hartford; India; In loco; INR 1.800.000 - 3.000.000; Tempo pieno

Descrizione del lavoro

The Hartford is seeking a Senior Engineer in India to design and optimize large-scale data pipelines using Snowflake, GCP BigQuery, and AWS services. You will lead complex ETL development, craft SQL transformations, and build scalable data workflows with Vertex AI and Cloud Functions.

Collaborate with analysts to deliver robust reporting via ThoughtSpot and Tableau. You will write advanced Python scripts for automation, ensure data quality, validate AI outputs, and mentor junior engineers while

Competenze

• Bachelor’s degree in a technical field is required.
• 2-4 years of data engineering experience.
• Strong Python skills for data processing, automation, and integration tasks.
• Hands-on experience with AWS services (S3, EC2, Lambda, Fargate).
• Experience with GCP data tools such as BigQuery, Cloud Functions, Vertex AI is highly desirable.
• Experience managing and deploying CI/CD pipelines across data and cloud platforms using Jenkins, Terraform, Harness and ADK.
• Proficiency with data visualization tools (ThoughtSpot).
• Experience with ETL tools such as Informatica or similar, and data integration leadership.
• Experience implementing generative AI solutions and agentic AI frameworks.

Mansioni

• Develop and optimize large-scale data pipelines and workflows.
• Lead development of complex ETL processes and SQL transformations.
• Implement data solutions using AWS and GCP services for scalable ML and data workflows.
• Develop advanced Python scripts for automation and integration, including AI-driven interactions.
• Collaborate with analysts to support data visualization in ThoughtSpot and Tableau.
• Establish data quality standards and validate AI-generated outputs.
• Mentor junior engineers and lead best practices in AI-integrated data workflows.
• Perform code reviews and optimize data processing performance.
• Stay current with emerging data engineering and AI technologies.

Conoscenze

Snowflake

SQL

ETL

Python

AWS

GCP BigQuery

Cloud Functions

Vertex AI

ThoughtSpot

Tableau

CI/CD

Jenkins

Terraform

Informatica

Generative AI

Agentic AI frameworks

Data quality

Mentoring

Formazione

Bachelor’s degree in Computer Science, Data Science, Information Systems, or a related field

Strumenti

Snowflake

BigQuery

AWS

GCP data tools

CI/CD tools (Jenkins, Terraform, Harness, ADK)

ThoughtSpot

Tableau

Informatica

Descrizione del lavoro

IND Senior Engineer - GCC096We’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals – and to help others accomplish theirs, too. Join our team as we help shape the future.**Key Responsibilities:*** Develop and optimize large-scale data pipelines and workflows using Snowflake, Google Cloud, and AWS services to support data integration and storage needs.* Lead development of complex ETL processes and SQL-based transformations to support data analysis, reporting, and advanced insights across the organization.* Implement and enhance data solutions using AWS services (e.g., S3, EC2, Lambda, Fargate, SQS), and **GCP BigQuery**, STS, **Cloud Functions**, and **Vertex AI** for scalable ML and data workflows.* Develop advanced Python scripts to automate data processing and integration, including **prompt-driven interactions with generative AI models** and autonomous agents.* Collaborate with analysts and stakeholders to support data visualization needs in ThoughtSpot and Tableau, designing robust and scalable reporting solutions.* Establish data quality standards and perform thorough validation and testing, including validation of AI-generated outputs.* Mentor and guide junior and associate data engineers, providing technical direction and promoting best practices in AI-integrated data workflows.* Perform code reviews, troubleshoot performance issues, and lead optimization efforts to improve data processing efficiency and scalability.* Stay current with emerging technologies in data engineering and AI, including **generative AI principles**, **prompt engineering**, knowledge base creation, semantic layer generation, **agentic frameworks**, and **GCP data stack tools**.**Qualifications*** Bachelor’s degree in Computer Science, Data Science, Information Systems, or a related field* 2-4 years of experience in data engineering, with advanced expertise in Snowflake, SQL, and ETL processes.* Strong proficiency in Python for complex data processing, automation, and integration tasks, including **prompt engineering for generative AI workflows**.* Hands-on experience with AWS services (e.g., S3, EC2, Lambda, Fargate); experience with **GCP data tools** such as **BigQuery**, **Cloud Functions**, and **Vertex AI** is highly desirable.* Experience in managing and deploying CICD pipelines across data and cloud platform services using Jenkins, Terraform, Harness and ADK* Proficiency with data visualization tools, particularly ThoughtSpot, for supporting scalable and impactful reporting.* Experience in Informatica or similar ETL tools, with the ability to lead data integration and transformation efforts.* Experience implementing **generative AI solutions**, including model orchestration, output validation, and integration into data workflows.* Familiarity with **agentic AI frameworks** and autonomous data orchestration tools.* Strong problem-solving skills with a focus on data quality, accuracy, and efficiency.* Excellent communication skills, with the ability to work collaboratively across teams and present technical concepts to non-technical stakeholders.* Proven experience mentoring and leading junior team members, with a commitment to fostering a collaborative team environment.