Data Engineer: ETL & Databricks Modernization

Carolina Casualty (a Berkley Company)

Jacksonville (FL)

On-site

USD 110,000 - 130,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Carolina Casualty, a Berkley Company, is seeking a Data Engineer to modernize our on-premises SQL Server environment and guide the move to a Databricks platform. You will redesign legacy ETL processes, build robust ODS and DWH pipelines, and embed data quality and governance into the engineering lifecycle.

Based in Jacksonville, FL, you will implement logs, monitoring, and automated deployment while collaborating with enterprise teams to meet security and architectural standards.

Qualifications

  • Strong SQL and Microsoft SQL Server development experience.
  • Hands-on experience designing, building and supporting ETL/ELT pipelines.
  • Knowledge of relational databases, data warehousing and incremental data processing.
  • Experience troubleshooting complex data issues and reconciling source-to-target results.
  • Experience with source control and disciplined software development practices.
  • Strong analytical, documentation and communication skills.

Responsibilities

  • Assess, document and rationalize existing SQL Server ETL pipelines, databases and data silos.
  • Refactor redundant or fragile SQL processes into standardized ETL/ELT pipelines.
  • Design and develop ingestion, transformation and reconciliation pipelines for governed ODS and DWH environments.
  • Implement logging, monitoring, error handling, auditability, lineage and repeatable deployment practices.
  • Develop Databricks notebooks and pipelines using SQL and Python/PySpark as appropriate.
  • Partner with corporate platform teams to align solutions with enterprise architecture and security standards.
  • Support source-to-target mapping, testing, production support and migration validation.
  • Perform other duties and/or projects as assigned.

Skills

SQL
Microsoft SQL Server
ETL/ELT pipelines
Relational databases
Data warehousing
Troubleshooting data issues
Source control practices
Analytical & documentation

Education

Bachelor's degree in CS/IS/Data Analytics

Tools

Databricks
Python
PySpark
Apache Spark

Job description

Carolina Casualty, a Berkley Company, is seeking a Data Engineer to modernize our on-premises SQL Server environment and guide the move to a Databricks platform. You will redesign legacy ETL processes, build robust ODS and DWH pipelines, and embed data quality and governance into the engineering lifecycle.

Based in Jacksonville, FL, you will implement logs, monitoring, and automated deployment while collaborating with enterprise teams to meet security and architectural standards.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Governed DWH, Databricks & SOX
Data Engineer - Governed DWH, Databricks & SOX

BERKLEY TECHNOLOGY SERVICES • Jacksonville (FL)

On-site
USD 110,000 - 150,000
Data Engineer - DWH & Data Quality in Insurance
Data Engineer - DWH & Data Quality in Insurance

Carolina Casualty (a Berkley Company) • Jacksonville (FL)

On-site
USD 90,000 - 120,000
Data Engineer - ETL
Data Engineer - ETL

Carolina Casualty (a Berkley Company) • Jacksonville (FL)

On-site
USD 110,000 - 130,000
Data Engineer
Data Engineer

Carolina Casualty (a Berkley Company) • Jacksonville (FL)

On-site
USD 90,000 - 120,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

DATAECONOMY Inc • New Jersey

On-site
USD 140,000 - 180,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

DATAECONOMY Inc • Raleigh (NC)

On-site
USD 120,000 - 190,000
Data Engineer
Data Engineer

BERKLEY TECHNOLOGY SERVICES • Jacksonville (FL)

On-site
USD 110,000 - 150,000
Senior Data Engineer: Snowflake/Databricks Modernization
Senior Data Engineer: Snowflake/Databricks Modernization

Jobo • United States

Remote
USD 120,000 - 180,000
Senior Data Engineer: Databricks, SQL, & Cloud Pipelines
Senior Data Engineer: Databricks, SQL, & Cloud Pipelines

Groundswell Corporation • Virginia (IL)

Hybrid
USD 120,000 - 180,000
Medical benefits (health)
Dental benefits
Vision benefits
+8
Databricks Data Engineer (ETL/ELT & Migration Lead)
Databricks Data Engineer (ETL/ELT & Migration Lead)

TechDigital Group • Bethlehem Township (NJ)

Hybrid
USD 150,000 - 210,000