Sr. Databricks Migration Engineer

LinTech Global, Inc.; Washington (District of Columbia); Remote; USD 120,000 - 150,000; Full time

Benefits offered by this job

Open Paid Time Off

Health Insurance

401k Plan with Company Match

Employee Recognition Program

Employee Referral Bonus

Annual Performance Bonus

Job summary

Dexian Government Solutions is seeking a Sr. Databricks Migration Engineer to support our contract with USPS. This role is fully remote and requires expertise in big data infrastructure.

As the authoritative resource, you will lead the migration of legacy SQL systems to the Databricks Lakehouse. Your responsibilities include designing scalable frameworks, optimizing SQL warehouses, and implementing robust data security models.

Qualifications

• 5+ years' experience in data engineering and cloud platforms.
• Bachelor's degree or higher in Computer Science, Engineering or related field.
• Public Trust Required to Start.

Responsibilities

• Lead the migration from SQL to Databricks Lakehouse.
• Design robust ETL/ELT frameworks using PySpark.
• Implement data security models within Delta Lake.

Skills

Databricks Lakehouse

Apache Spark

PySpark

Data engineering

Cloud platforms

Technical leadership

Data warehousing

Dimensional modeling

Data quality frameworks

Governance standards

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Azure

AWS

GCP

Job description

Dexian Government Solutions is recruiting for a Sr. Databricks Migration Engineer to support our contract with USPS in Arlington, VA.

Location:

100% Remote

Position Description:

The individual serves as the authoritative resource for the agency who specializes in preparing big data infrastructure for analytical or operational uses. They are responsible for designing and creating systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret and enables the agency to make smarter decisions and optimize operations.

Position Requirements:

• Lead the technical migration from legacy SQL Server stored procedures and ADF pipelines to Databricks Lakehouse (Delta Lake), ensuring best practice Lakehouse design.
• Translate traditional relational data warehousing paradigms into scalable, distributed Lakehouse frameworks (Bronze, Silver, Gold).
• Design robust, reusable ETL/ELT frameworks using PySpark, Delta Live Tables (DLT), and Databricks Workflows.
• Architect and refine the Gold Layer (dimensional models, star schemas) specifically to maximize Power BI performance.
• Optimize Databricks SQL Warehouses to support high-concurrency, low-latency Power BI queries (DirectQuery and Import modes).
• Implement advanced optimization techniques, including Z-Ordering, data skipping, liquid clustering, and materialized views.
• Define and enforce governance standards for cluster sizing, auto-scaling policies, and serverless SQL compute to balance performance with cost.
• Implement proactive monitoring dashboards to track Databricks Unit (DBU) consumption and identify cost-saving opportunities.
• Establish best practices for partition strategies and file size management within Delta Lake.
• Design and implement a robust data security model using Unity Catalog for centralized governance.
• Enforce row-level and column-level security policies to ensure compliant data access for Power BI consumers and internal analysts.
• Align the Lakehouse security architecture with existing enterprise Azure Active Directory (Microsoft Entra ID) and RBAC standards.
• Act as the primary technical lead, conducting dedicated pair-programming sessions, workshops, and code reviews to transition the team from SQL-centric to Spark-centric thinking.
• Create comprehensive technical documentation, including architecture diagrams, design patterns, and optimization playbooks.
• Build a foundational knowledge transfer framework to ensure the internal team is fully self-sufficient post-migration.
• Communicate effectively verbally and in written form to both technical and non-technical audience
• Work in an organized fashion, completing tasks timely while paying close attention to details

Experience:

• Bachelor's degree or higher from an accredited college or university in Computer Science, Engineering, or a related technical field
• Public Trust Required to Start
• 5+ years' experience in data engineering, data system development or related roles
• 5+ years' experience with cloud platforms (e.g. Azure, AWS, GCP)
• 1+ year leading complex, cross-functional data projects and technical teams
• Experience with Databricks Lakehouse, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
• Experience with data warehousing, dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark

Company Description

Dexian Government Solutions is an award-winning ISO 9001:2015 certified business and GSA contract holder providing diversified Information Technology services to both Civilian and Defense agencies. Services include Software Development, Systems Integration, Data Management, Project Management, Operations & Maintenance, Cybersecurity, and Training and Audio/Visual (AV) Solutions. Dexian Government Solutions has received several recognitions, including rankings on "Top 50 Companies to Watch", Washington Technology's Annual "FAST 50", and Inc. 500's List of "Fastest Growing Private Companies". The Dexian Government Solutions team is comprised of individuals who are dedicated to the success and sustainability of our customers and their missions. Our combination of technical expertise, big business experience, and small business agility allows us to promptly provide our customers with exceptional IT and engineering solutions.

Benefits

• Open Paid Time Off
• 11 Federal Paid Holidays & 5 Paid Sick Days
• Company-paid Life/AD&D
• Company-paid Short Term and Long-Term Disability
• Health Insurance with Company Contribution
• 401k Plan with Company Match
• Employee Recognition Program
• opportunity for Employee Referral Bonus
• opportunity for annual Performance Bonus
• and much more!

EEO Statement

Dexian Government Solutions is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment is decided based on qualifications, merit, and business need.

All applicants will be considered for employment without attention to race, religion, color, national origin, ancestry, physical or mental disability, medical condition, pregnancy (including childbirth, lactation and related medical conditions), marital status, genetic information (including characteristics and testing), gender, sexual orientation, gender identity or expression, military and veteran status, or any other status protected under federal, state, or local law in the locations where we operate.

If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact Human Resources. The Company invites any applicant and/or employee to review the Company's written Affi…

This role requires customer approval, suitability to hold a public trust and successful completion of a preemployment background screening.