Data Engineer – Databricks, AWS & Python for AI Solutions

Travelers Canada; Saint Paul (MN); On-site; USD 109,000 - 180,000; Full time

Benefits offered by this job

Health Insurance

401(k) employer match

Pension Plan

Paid Time Off

Job summary

Travelers Data Engineering team seeks a data engineer to build and scale data pipelines, enabling AI/ML and analytics across the enterprise. You will design, deploy, and optimize data solutions that capture, transform and serve data for insights.

You will leverage OpenAI and AWS Bedrock, with Python, SQL, and Databricks proficiency to advance our analytics landscape while collaborating with cross-functional teams and ensuring data governance and security compliance.

Qualifications

• Bachelor’s degree in STEM or equivalent required.
• 6 years of related experience.
• Experience with OpenAI and AWS Bedrock preferred.

Responsibilities

• Build and operationalize complex data solutions, apply transformations, and improve data quality.
• Design data solutions for enterprise analytics.
• Analyze sources to determine value for analytics processes.
• Incorporate data governance, security and quality across platforms.
• Collaborate within and across teams to support delivery and educate end users on data products.
• Test data movement, transformation code, and data components for defects.
• Address defects and incidents of moderate complexity and correct as appropriate.

Skills

Python

SQL

AWS

Databricks

Terraform

API design

Data engineering

Education

Bachelor's degree in STEM field

Tools

OpenAI

AWS Bedrock

Job description

Travelers Data Engineering team seeks a data engineer to build and scale data pipelines, enabling AI/ML and analytics across the enterprise. You will design, deploy, and optimize data solutions that capture, transform and serve data for insights.

You will leverage OpenAI and AWS Bedrock, with Python, SQL, and Databricks proficiency to advance our analytics landscape while collaborating with cross-functional teams and ensuring data governance and security compliance.