Data Engineer

Builders; Atlanta (GA); On-site; USD 110,000 - 140,000; Full time

Benefits offered by this job

Bonus Structure

Profit Sharing

Employer Paid Short Term Disability

Employer Paid Long Term Disability

Employer Paid Life Insurance

Voluntary Life Insurance

401K with Company Match

PTO

Job summary

Builders seeks a Data Engineer to design, develop, and maintain data pipelines powering our Azure Databricks lakehouse for property and casualty insurance. You will implement Bronze/Silver transformations in PySpark, support data migrations from Guidewire, and ensure governance with Unity Catalog while building durable, well-documented pipelines.

You will collaborate with underwriting, claims, actuarial, and finance teams, optimize performance and cost, and participate in code reviews,

Qualifications

• Associate degree or equivalent is required.
• Experience with Databricks (PySpark, Spark SQL, Delta Lake) is required.
• Experience with property and casualty insurance data, ideally Guidewire data, and migrating data from legacy sources.

Responsibilities

• Build pipelines for phased data migration from Guidewire and legacy systems into the Azure Databricks lakehouse.
• Develop bronze and silver layer transformations in PySpark and Spark SQL on Delta Lake.
• Support modeling of insurance data: policies, risks, exposures, coverages, premiums, claims, reserves, payments.

Skills

Databricks

PySpark

SQL

Python

Data modeling

Education

Associate degree or equivalent

Databricks certification

Tools

Azure Data Factory

Unity Catalog

Delta Lake

Git/GitHub

Databricks Workflows

Job description

• Location 2859 Paces Ferry Road Southeast,Atlanta, GA, 30339,United States
• Employee Type Full Time Exempt

Integrity. Care. Trust. Compassion. Expertise.
Do these words resonate with you?
These values of Builders culture create success in all we do. We strive to provide deeply supportive partnerships to our customers, agents, and each other.

Builders is proud to be named among the Great Places to Work. Our award-winning culture has earned top marks in Company Direction, Employee Appreciation, Work-Life Balance, Leadership, and Compensation and Benefits. Our strong culture keeps us Built Strong in a forever-changing world, and our AM Best A Rating is evidence of our financial strength.

Position Summary

The Data Engineer is responsible for designing, developing, and maintaining data pipelines that power the company’s Azure Databricks lakehouse for its property and casualty insurance business. Using technologies such as Delta Lake, Unity Catalog, Lakeflow pipelines, and Databricks SQL, the Data Engineer delivers reliable, high-quality, well-tested, and well-documented data to support key business functions, including underwriting, claims, actuarial, and finance.

A key responsibility is developing and supporting data pipelines for the phased migration of data from Guidewire and legacy policy, claims, and billing systems into the Azure Databricks lakehouse. The Data Engineer ensures solutions align with the Unity Catalog governance framework and adhere to the engineering standards and best practices established by the Data Engineering Lead. The role also emphasizes knowledge sharing, technical ownership, and long-term sustainability by progressively assuming responsibility for contractor-developed pipelines, strengthening internal expertise, and building lasting in-house platform capabilities.

Responsibilities

• Build pipelines for the phased data migration from Guidewire (PolicyCenter, ClaimCenter, BillingCenter) and legacy systems into the lakehouse on Azure Databricks, including historical loads, incremental/CDC (Change Data Capture) loads and reconciliation.
• Develop bronze and silver layer transformations in PySpark and Spark SQL on Delta Lake, following the medallion architecture.
• Support modeling of property and casualty insurance data: policies, insured risks and exposures, coverages, endorsements, premiums, claims, reserves, payments and recoveries.
• Integrate third-party data sources such as geospatial and weather data.
• Schedule and run production pipelines with Databricks Workflows (Lakeflow Jobs) or Azure Data Factory, including job dependencies, parameters, retries and alerting; investigate and resolve pipeline failures.
• Apply Unity Catalog controls defined by the Data Engineering Lead and Data Governance lead, including permissions, PII (Personally Identifiable Information) masking, tags and lineage.
• Implement data quality checks, error handling and monitoring.
• Tune pipeline performance and cost, including partitioning, liquid clustering and right-sized job compute.
• Use Git version control (GitHub or Bitbucket) and CI/CD (Continuous Integration/Continuous Deployment) with Databricks Asset Bundles to version, review and deploy code across development, test and production.
• Write documentation and runbooks, take part in code reviews, and take ownership of contractor-built pipelines over time.
• Perform other duties as assigned.

Qualifications

• Associate degree or an equivalent combination of education and experience
• Certification in Databricks engineering
• Three or more years in data engineering, including one or more years hands-on with Databricks (PySpark, Spark SQL, Delta Lake)
• Experience with property and casualty insurance data, ideally Guidewire data; experience migrating data from legacy source systems
• Knowledge of Python/PySpark and SQL (Structured Query Language)
• Knowledge of Unity Catalog: permissions, row/column-level security and lineage
• Experience with incremental loading patterns such as CDC, MERGE, SCD (Slowly Changing Dimension) and Auto Loader
• Experience scheduling and monitoring pipelines with Databricks Workflows and/or Azure Data Factory
• Experience with Git-based version control (GitHub or Bitbucket), including branching, pull request reviews and Databricks Git folders
• Experience with Azure data services such as ADLS (Azure Data Lake Storage) Gen2, Azure Data Factory and Key Vault
• Knowledge of CI/CD basics (Databricks Asset Bundles, Azure DevOps, GitHub Actions or Bitbucket Pipelines)
• Experience with streaming (Structured Streaming, Event Hubs)
• Experience with API (Application Programming Interface) and integration tools such as MuleSoft is an added advantage

Let’s talk benefits!

• Bonus Structure
• Profit Sharing
• Employer Paid Short Term Disability
• Employer Paid Long Term Disability
• Employer Paid Life Insurance
• Voluntary Life Insurance
• 401K with Company Match
• PTO

About Builders

Builders is a mid-sized mutual with remarkable strengths. Rated A by AM Best, Builders has forged rock-solid financial strength and a reputation for reliability and fairness in fulfilling our promises to customers. Kind, collaborative, and customer-centric, our experienced and passionate teams foster a rewarding atmosphere of excellence, trust, and mutual respect, meriting the “Culture Excellence” honors from Top Workplaces. Flexible and highly personal, our experts leverage deeply supportive partnerships with knowledgeable independent agencies to drive better services and protection for policyholders.

Our financial excellence, amazing people, and powerful partnerships build outstanding outcomes and peace of mind for our agents and their clients. This is what we mean by Insurance Built Strong®.

Builders Insurance Group is an Equal Opportunity Employer.We welcome applicants from all walks of life and don't discriminate based on any protected status. Join us in creating a diverse and inclusive workplace!