SAS-to-Databricks Migration Engineer (Remote)

Improving South America; United States; Remote; MXN 900,000 - 1,500,000; Full time

Benefits offered by this job

Long-term contract

100% remote

Vacation PTO

Two bonuses/year

Salary reviews

English classes

Apple equipment

Online courses

Book budget

Materials budget

More perks

Job summary

Improving is seeking a senior Nearshore engineer to convert SAS-based logic into robust, governed Databricks pipelines using Python and SQL on Databricks, with modern CI/CD practices and production-grade delivery discipline.

You will own end-to-end delivery from pipelines to validation, leverage accelerators, ensure parity with SAS outputs, and collaborate with client and internal stakeholders for reliable, auditable results.

Qualifications

• 4+ years of professional data or software engineering experience.
• Strong Python and SQL skills.
• Hands-on Databricks experience with Unity Catalog, Workflows, and Databricks Asset Bundles.
• Proficiency with GitLab CI/CD and disciplined Git branching and code reviews.
• Clear written and spoken English for client-facing collaboration.
• Demonstrated ownership: scoping work, delivering outcomes, and proactively flagging risks.

Responsibilities

• Pipeline engineering: Build and run pipelines that process SAS inventories and produce converted outputs.
• Quality and parity validation: Validate converted code for parity against SAS outputs (row counts, checksums, schema, and data types).
• Deployment ownership: Own deployments through Databricks Asset Bundles (DABs) and GitLab CI/CD, ensuring repeatable releases.
• Databricks governance: Manage Unity Catalog objects, permissions, and promotion across environments.
• Operational excellence: Troubleshoot job failures and performance issues, and take preventive actions to improve pipeline stability.
• Performance tuning: Apply tuning techniques for Apache Spark and Delta Lake to meet reliability and execution-time expectations.
• Data reconciliation: Use data validation and reconciliation practices to ensure correctness and consistency.
• Infrastructure-as-code mindset: Implement DAB-based deployment patterns and support automated, testable delivery workflows.
• Client collaboration: Communicate progress, risks, and technical decisions clearly with client and partner stakeholders.

Skills

Python

SQL

Databricks

Unity Catalog

GitLab CI/CD

Code reviews

English proficiency

Ownership

Tools

Databricks Asset Bundles

Delta Lake

Azure

Job description

Improving is seeking a senior Nearshore engineer to convert SAS-based logic into robust, governed Databricks pipelines using Python and SQL on Databricks, with modern CI/CD practices and production-grade delivery discipline.

You will own end-to-end delivery from pipelines to validation, leverage accelerators, ensure parity with SAS outputs, and collaborate with client and internal stakeholders for reliable, auditable results.