Data Engineer

Amivero; Idaho; On-site; USD 110,000 - 170,000; Full time

Job summary

Amivero seeks a skilled Data Engineer to design, build, and support modern data pipelines using Databricks. You will work with architects, customers, and analysts to deliver scalable, governance-minded data solutions across cloud platforms.

You will implement ETL/ELT processes, manage Delta Lake and Unity Catalog, and ensure data quality, security, and reliability while collaborating on technical workshops and reviews.

Qualifications

• Hands-on experience as a Data Engineer or similar role.
• Strong Databricks experience and Databricks ecosystem knowledge.
• Experience building and maintaining ETL/ELT pipelines.
• Strong knowledge of Spark, PySpark, SQL, and Delta Lake.
• Experience with structured, semi-structured, and unstructured data.
• Understanding of data quality, validation, monitoring, and governance.
• Familiarity with Unity Catalog, permissions, access control, governance concepts.
• Ability to work within architected Databricks environments
• Experience with cloud platforms (AWS, Azure, GCP).
• Strong SQL skills and data transformations.
• Strong communication and customer-facing skills.
• Ability to translate business and technical requirements into data solutions.

Responsibilities

• Build, develop, and maintain scalable data pipelines using Databricks.
• Design and implement ETL/ELT processes to ingest, transform, validate, and deliver data.
• Work with Databricks notebooks, workflows, jobs, clusters, Delta Lake, and Spark-based processing.
• Support the implementation and management of Databricks environments.
• Develop and optimize batch and streaming data pipelines.
• Implement data quality checks, validation rules, reconciliation processes, and control frameworks.
• Support data governance, access controls, metadata management, and lineage using Unity Catalog.
• Collaborate with architects to implement platform standards and best practices.
• Support use cases involving Unity Catalog AI Gateway, Agent Bricks, and AI-enabled data solutions.
• Troubleshoot data pipeline issues, performance problems, and production defects.
• Monitor pipeline reliability, performance, and data accuracy.
• Provide customer-facing discussions, demos, and implementation reviews.
• Create and maintain technical documentation, including data flows and mappings.
• Work with cloud services and modern data platform tools to deliver secure solutions.

Skills

Databricks ecosystem

ETL/ELT pipelines

Apache Spark

PySpark

SQL

Delta Lake

Unity Catalog concepts

Cloud data platforms (AWS/Azure/GC)

Data quality and governance

Customer-facing communication

Education

Bachelor's or Master's degree in a relevant field

Tools

Databricks

Unity Catalog

Git

CI/CD pipelines

Spark/Structured Streaming tooling

Job description

Description

The Amivero Team

Amivero’s team of IT professionals delivers digital services that elevate the federal government, whether national security or improved government services. Our human-centered, data-driven approach is focused on truly understanding the environment and the challenge, and reimagining with our customer how outcomes can be achieved.

Our team of technologists leverage modern, agile methods to design and develop equitable, accessible, and innovative data and software services that impact hundreds of millions of people.

As a member of the Amivero team you will use your empathy for a customer’s situation, your passion for service, your energy for solutioning, and your bias towards action to bring modernization to very important, mission‑critical, and public service government IT systems.

Special Requirements

• US Citizenship required to obtain Public Trust
• DHS ICE Public Trust preferred
• Master Degree +9 years of experience OR Bachelor Degree +12 years of experience

The Gist…

We are seeking a skilled Data Engineer with strong Databricks experience to design, build, and support modern data pipelines and data platform solutions. This role is ideal for someone who is hands‑on, detail‑oriented, and comfortable working with data engineering tools, ETL/ELT processes, data quality controls, and the Databricks ecosystem.

The Data Engineer will work closely with architects, customers, business stakeholders, analysts, and technical teams to build scalable data pipelines, support Databricks environments, implement governance controls, and help deliver reliable data solutions.

This person should have experience working with Databricks, Unity Catalog, ETL pipelines, data quality frameworks, and cloud‑based data platforms, with exposure to emerging Databricks capabilities such as Unity Catalog AI Gateway and Agent Bricks

What Your Day Might Include…

• Build, develop, and maintain scalable data pipelines using Databricks.
• Design and implement ETL/ELT processes to ingest, transform, validate, and deliver data.
• Work with Databricks notebooks, workflows, jobs, clusters, Delta Lake, and Spark‑based processing.
• Support the implementation and management of Databricks environments.
• Develop and optimize batch and streaming data pipelines.
• Implement data quality checks, validation rules, reconciliation processes, and control frameworks.
• Support data governance, access controls, metadata management, and lineage using Unity Catalog.
• Work with architects to implement platform standards, engineering patterns, and best practices.
• Support use cases involving Unity Catalog AI Gateway, Agent Bricks, and AI‑enabled data solutions.
• Troubleshoot data pipeline issues, performance problems, and production defects.
• Monitor pipeline reliability, performance, and data accuracy.
• Collaborate with customer teams to understand requirements and deliver technical solutions.
• Participate in customer‑facing discussions, technical workshops, demos, and implementation reviews.
• Create and maintain technical documentation, including data flows, pipeline logic, data mappings, and operational procedures.
• Work with cloud services and modern data platform tools to deliver secure, scalable, and reliable data solutions.

Qualifications

• Hands‑on experience as a Data Engineer or similar role.
• Strong experience with Databricks and the broader Databricks ecosystem.
• Experience building and maintaining ETL/ELT pipelines.
• Strong knowledge of Apache Spark, PySpark, SQL, and Delta Lake.
• Experience working with structured, semi‑structured, and unstructured data.
• Understanding of data quality, data validation, monitoring, and control processes.
• Experience with Unity Catalog, including permissions, access control, metadata, and governance concepts.
• Ability to support and work within architected Databricks environments.
• Familiarity with cloud data platforms such as AWS, Azure, or Google Cloud Platform.
• Strong SQL skills and experience optimizing queries and data transformations.
• Ability to troubleshoot pipeline failures, performance issues, and data integrity problems.
• Strong communication skills and ability to work directly with customers and stakeholders.
• Ability to translate business and technical requirements into working data solutions.

Preferred Qualifications

• Experience with API management and security (Mulesoft, Kong)
• Exposure to or experience with Unity Catalog AI Gateway.
• Exposure to or experience with Agent Bricks.
• Experience with Lakehouse architecture.
• Experience with CI/CD pipelines and source control tools such as Git.
• Experience with workflow orchestration tools and Databricks Workflows.
• Experience with streaming technologies such as Spark Structured Streaming, Kafka, or Event Hubs.
• Experience with data modeling, dimensional modeling, or medallion architecture.
• Knowledge of security, privacy, data governance, and compliance practices.
• Databricks certifications are a plus.
• Consulting or customer‑facing delivery experience is preferred.

EOE/M/F/VET/DISABLED

All qualified applicants will receive consideration without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. Amivero complies with applicable state and local laws governing non‑discrimination in employment in every location in which the company has facilities.