Data Engineer II: Databricks & AWS for AI Pipelines

Travelers Canada; United States; On-site; USD 127,000 - 209,000; Full time

Benefits offered by this job

Health Insurance

401(k) match

Paid Time Off

Wellness program

Volunteer program

Job summary

Travelers is seeking a seasoned Data Engineer to design, build, and operate data solutions that empower AI, ML, and BI initiatives. You will translate data stories into scalable pipelines and collaborate across teams to deliver value-driven analytics across the enterprise.

The role emphasizes hands-on data processing, governance, and proactive problem solving within a complex data landscape, with a strong focus on quality and security.

Qualifications

• Bachelor's Degree in STEM related field or equivalent.
• Eight years of related experience.
• Highly proficient in Cloud platforms (AWS preferred, Azure considered), Databricks (5-6 years), Python, and SQL, with hands-on experience applying fundamental data engineering practices.
• Deep domain expertise in immediate systems and working knowledge of adjacent ones; adept at identifying industry trends and delivering complete solutions incrementally at a steady, predictable pace.
• Strong problem solver with a track record of building resilient, innovative systems while effectively navigating tradeoffs and balancing short- and long-term priorities; experience with AI assistants such as Claude and Databricks Genie is a plus.
• Excellent communicator and collaborative team player with demonstrated ability to partner with stakeholders and customers, foster a safe learning environment for engineers, and proactively identify opportunities while driving team accountability.

Responsibilities

• Build and operationalize complex data solutions, correct problems, apply transformations, and recommending data cleansing/quality solutions.
• Design complex data solutions
• Perform analysis of complex sources to determine value and use and recommend data to include in analytical processes.
• Incorporate core data management competencies including data governance, data security and data quality.
• Collaborate within and across teams to support delivery and educate end users on complex data products/analytic environment.
• Perform data and system analysis, assessment and resolution for complex defects and incidents and correct as appropriate.
• Test data movement, transformation code, and data components.
• Perform other duties as assigned.

Skills

AWS

Azure

Databricks

Python

SQL

Data engineering

Education

Bachelor's Degree in STEM

Tools

Databricks

AWS

Azure

Job description

Travelers is seeking a seasoned Data Engineer to design, build, and operate data solutions that empower AI, ML, and BI initiatives. You will translate data stories into scalable pipelines and collaborate across teams to deliver value-driven analytics across the enterprise.

The role emphasizes hands-on data processing, governance, and proactive problem solving within a complex data landscape, with a strong focus on quality and security.