1178 - Sr. Data Architect

GoFasti; United States; Remote; USD 78,000 - 98,000; Full time

Job summary

GoFasti is seeking a Senior Data Architect to design lakehouse architecture on Databricks and lead scalable pipelines using PySpark and Python. The role emphasizes governance, multi-cloud production, and mentorship, with a focus on cost and performance improvements.

The position is remote, with international collaboration, requiring strong communication in English and deep experience across AWS, Azure, and GCP platforms.

Qualifications

• 10+ years in data engineering.
• 5+ years hands-on with Databricks and Spark in production.
• Strong Python and PySpark; SQL and Scala knowledge help.
• Production experience on AWS, Azure or GCP.
• Hands-on data governance with Unity Catalog and auditing.
• Solid CI/CD practices and Terraform infrastructure as code.
• Ability to explain design trade-offs to non-technical stakeholders.
• English at C1 level or higher.
• Multi-cloud experience across AWS, Azure and GCP.

Responsibilities

• Design and own end-to-end lakehouse architecture on Databricks.
• Build scalable batch and streaming pipelines with PySpark and Python.
• Lead platform migrations and optimize for cost and runtime.
• Define governance, access controls and data lineage.
• Model data for analytics and operations, OLTP/OLAP.
• Set engineering standards, CI/CD, tests, and package reuse.
• Manage infrastructure as code with Terraform; drive FinOps.
• Explore AI use cases on the platform and advise teams.
• Mentor junior and mid-level engineers.

Skills

Databricks

PySpark

Python

SQL

Data governance

CI/CD

Terraform

Mentoring

English proficiency

Multi-cloud

Tools

Spark

AWS

Azure

GCP

Git

Databricks Platform

Job description

We Make Remote Work Remarkable TopTalent from LatAm Hello! We are GoFasti , a Talent-as-a-Service. GoFasti bridges the gap between world-class developers and designers from LatAm and first-class companies around the globe. We need an English-fluent Senior Sr. Data Architect , based in Latin America, available to work remotely. We are looking for someone with exceptional communication and relationship-building skills, who embraces changes while maintaining strong attention to detail. An interested and proactive person, who's constantly learning and improving their skills. Are you the one we are looking for?

Responsibilities:

• Design and own the end-to-end lakehouse architecture on Databricks, using Medallion (bronze/silver/gold) patterns.
• Build and optimize scalable batch and streaming pipelines in PySpark, Spark SQL and Python.
• Lead platform migrations (e.g., legacy data warehouse or Hadoop/EMR to Databricks) with measurable gains in cost and run time.
• Define data governance: Unity Catalog, fine-grained access control, auditing, lineage and compliance (GDPR and similar).
• Model data for analytics and operations (OLTP/OLAP, dimensional, SQL and NoSQL).
• Set engineering standards: CI/CD, unit and integration tests, code review, reusable Python packages, Databricks Asset Bundles.
• Manage infrastructure as code with Terraform and drive FinOps practices to control cloud spend.
• Evaluate and prototype AI use cases on the platform (LLMs, vector databases, agents, MLflow).
• Advise other teams on architecture and mentor junior and mid-level engineers.

Requirements:

• 10+ years in data engineering, including 5+ years hands-on with Databricks and Spark in production.
• Strong Python and PySpark; working knowledge of Scala and advanced SQL.
• Proven record designing data lakes, data warehouses and lakehouses, including at least one large migration you led.
• Production experience on at least one major cloud (AWS, Azure or GCP).
• Hands-on data governance with Unity Catalog, access controls, lineage and auditing.
• Solid software engineering practice: Git workflows, automated testing, CI/CD (Azure DevOps, GitHub Actions or similar).
• Infrastructure as code with Terraform.
• Ability to explain design trade-offs clearly to engineers and non-technical stakeholders.
• Experience mentoring engineers.
• English at C1 level or higher.
• It's a plus: Databricks certifications (e.g., Platform Administrator, Data Engineer Professional).
• AWS Solutions Architect or equivalent cloud architecture certification.
• Multi-cloud experience across AWS, Azure and GCP.
• Experience building agentic or RAG solutions with LangChain, LangGraph, MLflow, OpenAI APIs and vector databases.
• Real-time and IoT data processing at high volume.
• Background in finance, telecom, payments or SaaS data domains.
• Spanish or Portuguese.

Compensation:

The salary range offered for this position varies from (USD) $7,000 - $8,800 per month, depending on seniority and skillset. This position is for a full time contract, through a payroll platform. The talent will work remotely allocated at our client.