Azure Databricks & ETL Data Engineer

Cloud Hybrid Technologies, LLC; San Ramon (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading tech company located in California is seeking a candidate to lead the full lifecycle of application development, focusing on the implementation of scalable solutions. The ideal candidate possesses strong ETL skills between various databases, including Oracle and Mongo DB, while being proficient in Python and Azure Databricks. Familiarity with Agile methodologies is required. This position offers a dynamic work environment with opportunities for growth and collaboration with data professionals.

Qualifications

• Lead the full lifecycle of application development.
• Proficiency in ETL between Oracle, Databricks, and NoSQL databases.
• Experience working with Mongo DB.

Responsibilities

• Optimize data pipelines for performance and scalability.
• Collaborate with data scientists to understand data needs.
• Design scalable data processing solutions.

Skills

ETL proficiency

Mongo DB experience

Python knowledge

PySpark knowledge

Scala knowledge

Azure Databricks

Agile/Scrum experience

Job description

A leading tech company located in California is seeking a candidate to lead the full lifecycle of application development, focusing on the implementation of scalable solutions. The ideal candidate possesses strong ETL skills between various databases, including Oracle and Mongo DB, while being proficient in Python and Azure Databricks. Familiarity with Agile methodologies is required. This position offers a dynamic work environment with opportunities for growth and collaboration with data professionals.