Senior Data Engineer - Databricks/PySpark/SQL | Remote

HumanIT Digital Consulting

United States

Remote

USD 28.000 - 37.000

Vollzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

15th month salary
Health insurance for family
Birthday off
Mobility program
Work-life balance
Full benefits

Zusammenfassung

HumanIT Digital Consulting seeks a Senior Data Engineer to design and maintain scalable data ingestion and transformation pipelines on a Databricks-based Lakehouse. You will develop Bronze, Silver and Gold layers, ingest data from enterprise systems and APIs, and ensure data quality, security and cost efficiency using PySpark and SQL.

Collaborate with Data Architects, BI and Analytics teams, and business stakeholders in an Agile environment, applying Git and CI/CD practices while enabling

Qualifikationen

  • At least 4 years of professional Data Engineering experience.
  • At least 2 years of hands-on Databricks development experience.
  • Strong practical skills in Databricks and PySpark for building and maintaining data processing pipelines.
  • Strong SQL development and optimisation skills.
  • Experience with Azure Data Platform services.
  • Proven experience designing and implementing ETL/ELT pipelines, including data ingestion and transformation.
  • Understanding of Lakehouse architecture and Medallion Architecture, including Bronze, Silver and Gold data layers.
  • Experience integrating data from multiple enterprise systems, APIs and external sources.
  • Knowledge of data quality, pipeline reliability, performance optimisation and data security principles.
  • Experience using Git and CI/CD practices in data engineering workflows.
  • Ability to collaborate effectively with Data Architects, BI and Analytics teams, and business stakeholders.
  • Professional working proficiency in English.
  • Availability to work remotely from Portugal or Spain.

Aufgaben

  • Design, develop and maintain scalable data ingestion and transformation pipelines on a Databricks-based Lakehouse platform.
  • Implement Bronze, Silver and Gold data layers, integrating data from enterprise systems, APIs and external sources.
  • Develop processing workflows using PySpark and SQL, implement reusable engineering frameworks and optimise pipelines for scalability and cost efficiency.
  • Collaborate with Data Architects; support data governance, lineage, cataloguing and access management.
  • Participate in Agile ceremonies and contribute to delivery through Git-based version control and CI/CD practices.

Kenntnisse

Databricks
PySpark
SQL
Azure Data Platform
ETL/ELT pipelines
Lakehouse architecture
Medallion Architecture
Data ingestion
Data quality
CI/CD
Git
English
Remote work Portugal/Spain

Tools

Databricks
Azure
Python

Jobbeschreibung

HumanIT Digital Consulting seeks a Senior Data Engineer to design and maintain scalable data ingestion and transformation pipelines on a Databricks-based Lakehouse. You will develop Bronze, Silver and Gold layers, ingest data from enterprise systems and APIs, and ensure data quality, security and cost efficiency using PySpark and SQL.

Collaborate with Data Architects, BI and Analytics teams, and business stakeholders in an Agile environment, applying Git and CI/CD practices while enabling

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Data Engineer - Databricks Lakehouse (Remote)
Senior Data Engineer - Databricks Lakehouse (Remote)

Stermedia • USA

Remote
USD 57.000 - 85.000
Flexible working hours
Remote work possible
Self-development budget
+2
Senior Data Engineer - Databricks Lakehouse Architect
Senior Data Engineer - Databricks Lakehouse Architect

UNAVAILABLE • McLean (VA)

Vor Ort
USD 120.000 - 160.000
Senior Databricks Engineer – Remote Data Pipelines
Senior Databricks Engineer – Remote Data Pipelines

Princeton IT Services, Inc • USA

Remote
USD 130.000 - 180.000
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)
Senior Data Engineer, Databricks Lakehouse (Onsite Atlanta)

Capgemini • Atlanta (GA)

Vor Ort
USD 89.000 - 166.000
Vacation: 12-25 days
Company paid holidays
Personal days
+5
Senior Databricks Data Engineer (Fully Remote)
Senior Databricks Data Engineer (Fully Remote)

Jobgether • USA

Remote
USD 110.000 - 160.000
Healthcare coverage
Meal vouchers
Life insurance
+4
Senior Data Engineer - Remote Databricks & Azure Data Pipelines
Senior Data Engineer - Remote Databricks & Azure Data Pipelines

Hylant • Ohio

Remote
USD 120.000 - 180.000
Senior Data Platform Engineer - Databricks Lakehouse Remote
Senior Data Platform Engineer - Databricks Lakehouse Remote

Buildertrend • Nebraska

Hybrid
USD 130.000 - 160.000
Health packages
Life insurance
Disability benefits
+9
Remote Databricks Data Engineer - AI Lakehouse Architect
Remote Databricks Data Engineer - AI Lakehouse Architect

Livefront • USA

Remote
USD 150.000 - 190.000
Senior Data Eng - Databricks Lakehouse & ELT (Remote)
Senior Data Eng - Databricks Lakehouse & ELT (Remote)

Buildertrend • USA

Hybrid
USD 120.000 - 180.000
Health, dental, vision insurance
401(k) matching
Generous PTO and holidays
+2
Senior Data Engineer
Senior Data Engineer

Veriipro • Atlanta (GA)

Vor Ort
USD 140.000 - 180.000