Databricks Architect

Anblicks Inc.; Dallas (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Anblicks Inc. is seeking an experienced Databricks Architect based in Dallas, Texas to lead the design, development, and implementation of scalable data platforms on Databricks. The ideal candidate will have strong expertise in Spark, Delta Lake, and cloud platforms including Azure, AWS, and GCP.

The role involves defining best practices, architecting solutions, and mentoring data engineers. A strong background in data engineering and data governance is essential, along with a willingness to optimize performance and ensure compliance.

Qualifications

• Strong hands-on experience with Databricks Platform.
• Expertise in Apache Spark (PySpark / Scala / SQL).
• Experience with Delta Lake, Unity Catalog, and Lakehouse architecture.
• Proficiency in data pipelines and ETL/ELT frameworks.

Responsibilities

• Design and implement end-to-end data architecture using Databricks Lakehouse platform.
• Define data engineering best practices and build scalable ETL/ELT pipelines.
• Architect solutions leveraging Apache Spark and Databricks workflows.
• Optimize performance, cost, and scalability of data pipelines.

Skills

Databricks Platform

Apache Spark (PySpark/Scala/SQL)

Delta Lake

SQL

Data pipelines

Data governance

Tools

Airflow

Kafka

Job description

We are looking for an experienced Databricks Architect to lead the design, development, and implementation of scalable data platforms on Databricks. The ideal candidate will have strong expertise in Spark, Delta Lake, data engineering, and cloud platforms (Azure/AWS/GCP), along with proven experience in architecting modern data solutions.

Key Responsibilities

• Design and implement end-to-end data architecture using Databricks Lakehouse platform
• Define data engineering best practices and build scalable ETL/ELT pipelines
• Architect solutions leveraging Apache Spark (PySpark/Scala) and Databricks workflows
• Implement Delta Lake for data reliability, performance, and governance
• Collaborate with stakeholders to understand business requirements and translate them into technical solutions
• Optimize performance, cost, and scalability of data pipelines
• Provide technical leadership, mentoring data engineers and developers
• Ensure data security, governance, and compliance standards are met
• Integrate Databricks with cloud services (Azure, AWS, or GCP) and other enterprise systems
• Support real-time and batch data processing use cases

Required Skills & Qualifications

Technical Skills

• Strong hands-on experience with Databricks Platform
• Expertise in Apache Spark (PySpark / Scala / SQL)
• Experience with Delta Lake, Unity Catalog, and Lakehouse architecture
• Proficiency in data pipelines, ETL/ELT frameworks
• Strong experience in SQL and data modeling
• Hands-on experience with cloud platforms:
  • Azure (ADF, ADLS, Synapse) OR
  • AWS (S3, Glue, EMR) OR
• Data warehousing and data lake solutions
• Data governance and security frameworks
• Performance tuning and optimization

Tools & Technologies

• Databricks Workflows / Jobs
• Airflow / ADF / Prefect (any orchestration tool)
• Streaming tools like Kafka (preferred)

Preferred Qualifications

• Databricks Certifications (e.g., Databricks Certified Professional / Associate)
• Experience in data migration to Databricks