Databricks Data Engineer

RTA US; Los Angeles (CA); Remote; USD 80,000 - 100,000; Full time

Job summary

An innovative company is seeking a skilled Databricks Data Engineer to join their dynamic team. This remote position focuses on leveraging the Databricks platform for efficient data processing, utilizing Spark and SQL for optimization. The ideal candidate will have experience with Azure Data Factory and a strong understanding of data governance and compliance. Join a forward-thinking organization that values analytical skills and offers a collaborative environment to enhance your career in data engineering.

Qualifications

• Expertise in Databricks platform and Spark for data processing.
• Proficiency in SQL optimization and Azure Data Factory for ETL.

Skills

Databricks platform expertise

Spark (PySpark/Scala)

SQL optimization

Azure Data Factory (ADF)

Python scripting

Data governance knowledge

Analytical skills

BI/reporting tools (Power BI, Tableau)

Data quality assurance skills

Job description

Job Description

Job Title: Databricks Data Engineer

Location: Remote (Local in CA)

Duration: 12 Months

Pay Range: $50-$60/h on DOE

Technical Skills:

• Expertise in Databricks platform (workspace management, clusters, job scheduling)
• Proficiency in Spark (PySpark/Scala), SQL optimization, and advanced querying skills
• Experience with Azure Data Factory (ADF) or equivalent ETL pipelines, data warehousing concepts, and architecture (Delta Lake)
• Proficiency in Python scripting for data manipulation and automation; familiarity with Azure Cloud environment (Blob Storage, ADLS)
• Knowledge of data governance, security, and compliance
• Strong analytical skills in data modeling and database design
• Experience with BI/reporting tools such as Power BI and Tableau
• Data quality assurance and validation skills