Senior Data Engineer – Databricks & SQL

TechDigital Group; Princeton (NJ); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading technology firm in the United States is seeking a skilled Databricks professional to support a short-term migration initiative. The role involves analyzing data migration strategies and evaluating core business warehouse solutions. Ideal candidates will have proven expertise in Databricks and Microsoft SQL Server, combined with strong analytical and communication skills. This position offers an opportunity to optimize data workflows in a dynamic environment.

Qualifications

• Proven expertise in Databricks, Microsoft SQL Server, and Unity catalog.
• Strong analytical skills with experience in data migration and transformation projects.
• Ability to interpret and align with compliance and assurance documentation.

Responsibilities

• Conduct a comprehensive analysis of the existing data warehouse architecture and future migration strategy.
• Review and assess core business warehouse solutions in MARC and MLMC.
• Collaborate with ITPM and Business Owners to ensure process alignment.

Skills

Databricks

Microsoft SQL Server

Unity catalog

Analytical skills

Data migration experience

Enterprise data warehouse environments

Business intelligence tools

Compliance interpretation

Communication skills

Job description

Overview

We are seeking a skilled Databricks professional with strong analytical capabilities to support a short-term migration initiative. The project involves analyzing the current and future state of data migration to Databricks and reviewing core business warehouse solutions in MARC and MLMC (Product).

Responsibilities

• Conduct a comprehensive analysis of the existing data warehouse architecture and future migration strategy to Databricks.
• Review and assess core business warehouse solutions in MARC and MLMC.
• Understand and align with the Standard Assurance Agreement and One Essential documentation.
• Collaborate with ITPM and Business Owners to ensure process alignment and documentation compliance.
• Provide insights and recommendations to optimize data workflows and analytics post-migration.

Required Skills & Experience

• Proven expertise in Databricks, Microsoft SQL Server and Unity catalog.
• Strong analytical skills with experience in data migration and transformation projects.
• Familiarity with enterprise data warehouse environments andbusiness intelligence tools.
• Ability to interpret and align with compliance and assurance documentation.
• Excellent communication and stakeholder engagement skills.

Preferred Qualifications

• Comprehensive knowledge of Databricks internals, including RDDs, DLT, and Delta Lake. Expertise in Databricks Workflows, data access control management, lineage, auditing, and CI/CD processes.
• Prior involvement in short-term, high-impact migration projects.