Databricks Data Engineer: Pipelines, Governance & Cloud

Amivero; Idaho; On-site; USD 110,000 - 170,000; Full time

Job summary

Amivero seeks a skilled Data Engineer to design, build, and support modern data pipelines using Databricks. You will work with architects, customers, and analysts to deliver scalable, governance-minded data solutions across cloud platforms.

You will implement ETL/ELT processes, manage Delta Lake and Unity Catalog, and ensure data quality, security, and reliability while collaborating on technical workshops and reviews.

Qualifications

• Hands-on experience as a Data Engineer or similar role.
• Strong Databricks experience and Databricks ecosystem knowledge.
• Experience building and maintaining ETL/ELT pipelines.
• Strong knowledge of Spark, PySpark, SQL, and Delta Lake.
• Experience with structured, semi-structured, and unstructured data.
• Understanding of data quality, validation, monitoring, and governance.
• Familiarity with Unity Catalog, permissions, access control, governance concepts.
• Ability to work within architected Databricks environments
• Experience with cloud platforms (AWS, Azure, GCP).
• Strong SQL skills and data transformations.
• Strong communication and customer-facing skills.
• Ability to translate business and technical requirements into data solutions.

Responsibilities

• Build, develop, and maintain scalable data pipelines using Databricks.
• Design and implement ETL/ELT processes to ingest, transform, validate, and deliver data.
• Work with Databricks notebooks, workflows, jobs, clusters, Delta Lake, and Spark-based processing.
• Support the implementation and management of Databricks environments.
• Develop and optimize batch and streaming data pipelines.
• Implement data quality checks, validation rules, reconciliation processes, and control frameworks.
• Support data governance, access controls, metadata management, and lineage using Unity Catalog.
• Collaborate with architects to implement platform standards and best practices.
• Support use cases involving Unity Catalog AI Gateway, Agent Bricks, and AI-enabled data solutions.
• Troubleshoot data pipeline issues, performance problems, and production defects.
• Monitor pipeline reliability, performance, and data accuracy.
• Provide customer-facing discussions, demos, and implementation reviews.
• Create and maintain technical documentation, including data flows and mappings.
• Work with cloud services and modern data platform tools to deliver secure solutions.

Skills

Databricks ecosystem

ETL/ELT pipelines

Apache Spark

PySpark

SQL

Delta Lake

Unity Catalog concepts

Cloud data platforms (AWS/Azure/GC)

Data quality and governance

Customer-facing communication

Education

Bachelor's or Master's degree in a relevant field

Tools

Databricks

Unity Catalog

Git

CI/CD pipelines

Spark/Structured Streaming tooling

Job description

Amivero seeks a skilled Data Engineer to design, build, and support modern data pipelines using Databricks. You will work with architects, customers, and analysts to deliver scalable, governance-minded data solutions across cloud platforms.

You will implement ETL/ELT processes, manage Delta Lake and Unity Catalog, and ensure data quality, security, and reliability while collaborating on technical workshops and reviews.