Databricks Data Engineer - Remote (DC/US)

HMG AMERICA LLC; Washington (District of Columbia); Remoto; USD 120.000 - 160.000; Tempo pieno

Descrizione del lavoro

HMG America LLC is seeking a Databricks Developer in Washington, DC (Remote) to build and maintain data pipelines, optimize Delta Lake tables, and orchestrate Databricks Workflows. You will collaborate with data engineers and analysts to deliver robust data solutions.

The role requires strong PySpark and SQL, hands-on Databricks experience, and cloud platforms (Azure, AWS, or GCP). You will write tests, review code, document architectures, and help implement CI/CD practices across the data

Competenze

• 5 years of experience in Data Engineering, including 3+ years with Databricks.
• Strong proficiency in PySpark and SQL.
• Working knowledge of Delta Lake and at least one major cloud platform (Azure, AWS, or GCP).
• Familiarity with Git-based source control and CI/CD practices.
• Ability to independently deliver well‑defined technical solutions from development through deployment.

Mansioni

• Develop and maintain ETL/ELT data pipelines using PySpark and SQL within the Databricks platform.
• Design, create, and optimize Delta Lake tables to support scalable and high-performance data processing.
• Build and manage Databricks Workflows jobs to orchestrate and automate data pipelines.
• Write and execute unit tests to ensure code quality, reliability, and maintainability.
• Investigate and resolve data quality issues, ensuring the accuracy and integrity of data assets.
• Produce clear technical documentation for developed solutions, processes, and pipeline configurations.
• Participate in peer code reviews and incorporate feedback to maintain coding standards and best practices.

Conoscenze

PySpark

SQL

Delta Lake

Git

CI/CD

Strumenti

Databricks

Descrizione del lavoro

HMG America LLC is seeking a Databricks Developer in Washington, DC (Remote) to build and maintain data pipelines, optimize Delta Lake tables, and orchestrate Databricks Workflows. You will collaborate with data engineers and analysts to deliver robust data solutions.

The role requires strong PySpark and SQL, hands-on Databricks experience, and cloud platforms (Azure, AWS, or GCP). You will write tests, review code, document architectures, and help implement CI/CD practices across the data