Data Engineer II - Cloud & AI-Driven Pipelines

Travelers; Hartford (CT); On-site; USD 127,000 - 209,000; Full time

Job summary

Travelers is seeking a Data Engineer to join our Data Engineering team. You will design, build and deploy data solutions that support AI, ML and BI initiatives across the enterprise, leveraging AWS, Databricks and Snowflake.

In this role you will translate data stories into scalable pipelines, ensure data quality and governance, and collaborate with cross-functional teams to deliver high-impact analytics products that empower business decisions.

Qualifications

• Bachelor's Degree in STEM related field or equivalent.
• Eight years of related experience.
• Demonstrable experience architecting, designing and building scalable, secure data solutions using AWS, Databricks, Snowflake and AbInitio or similar platforms.
• A track record of leveraging AI assistants, create skills/tools to augment data engineering practices throughout the development lifecycle.
• The ability to lead technical direction for data engineering initiatives across cloud and on-premises infrastructure.
• Willingness to run mentoring sessions and offer technical guidance to the 20-person admin team.
• Ability to manage infrastructure deployment and optimize cloud resources.
• Drive to learn, identify and set technical standards and influence engineering practices and data governance policies.
• Ability to lead and take action even when there is no clear owner, inspire and motivate others, and be effective at influencing team members.

Responsibilities

• Build and operationalize complex data solutions, correct problems, apply transformations, and recommending data cleansing/quality solutions.
• Design complex data solutions
• Perform analysis of complex sources to determine value and use and recommend data to include in analytical processes.
• Incorporate core data management competencies including data governance, data security and data quality.
• Collaborate within and across teams to support delivery and educate end users on complex data products/analytic environment.
• Perform data and system analysis, assessment and resolution for complex defects and incidents and correct as appropriate.
• Test data movement, transformation code, and data components.
• Perform other duties as assigned.

Skills

AWS

Databricks

Snowflake

Ab Initio

AI assistants

Cloud leadership

Mentoring

Infrastructure as code

Data governance

Data security

Education

Bachelor's Degree in STEM

Tools

GitHub Actions

GitLab CI

Terraform

Jenkins

Job description

Travelers is seeking a Data Engineer to join our Data Engineering team. You will design, build and deploy data solutions that support AI, ML and BI initiatives across the enterprise, leveraging AWS, Databricks and Snowflake.

In this role you will translate data stories into scalable pipelines, ensure data quality and governance, and collaborate with cross-functional teams to deliver high-impact analytics products that empower business decisions.