Data Engineer: Databricks, Python & DB Pipelines

Ethereum Technologies LLC; Jersey City (NJ); On-site; Full time

Job summary

A technology company is demanding a skilled Data Engineer to design and manage complex data activities using Databricks and Python. With responsibilities including the architecture of ETL/ELT workflows, development of scalable data pipelines, and ensuring data quality, the ideal candidate should possess robust SQL skills and experience in cloud platforms like AWS, Azure, or GCP. Opportunities for substantial growth await in this dynamic work environment.

Qualifications

• Strong expertise in Databricks, Python, and database engineering.
• Ability to design and optimize scalable data pipelines.
• Experience in data quality and advanced analytics initiatives.

Responsibilities

• Design, build, and maintain ETL/ELT workflows on Databricks.
• Develop data pipelines using Python and Spark.
• Implement data quality and monitoring frameworks.
• Collaborate with Data Scientists and Analysts.

Skills

Database Engineering

Strong SQL

Cloud Platforms (AWS/Azure/GCP)

ETL/ELT tools

Experience with large-scale datasets

Job description

A technology company is demanding a skilled Data Engineer to design and manage complex data activities using Databricks and Python. With responsibilities including the architecture of ETL/ELT workflows, development of scalable data pipelines, and ensuring data quality, the ideal candidate should possess robust SQL skills and experience in cloud platforms like AWS, Azure, or GCP. Opportunities for substantial growth await in this dynamic work environment.