Databricks and ETL developer

Cloud Hybrid Technologies, LLC; San Ramon (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading tech company located in California is seeking a candidate to lead the full lifecycle of application development, focusing on the implementation of scalable solutions. The ideal candidate possesses strong ETL skills between various databases, including Oracle and Mongo DB, while being proficient in Python and Azure Databricks. Familiarity with Agile methodologies is required. This position offers a dynamic work environment with opportunities for growth and collaboration with data professionals.

Qualifications

• Lead the full lifecycle of application development.
• Proficiency in ETL between Oracle, Databricks, and NoSQL databases.
• Experience working with Mongo DB.

Responsibilities

• Optimize data pipelines for performance and scalability.
• Collaborate with data scientists to understand data needs.
• Design scalable data processing solutions.

Skills

ETL proficiency

Mongo DB experience

Python knowledge

PySpark knowledge

Scala knowledge

Azure Databricks

Agile/Scrum experience

Job description

Responsibilities

• Lead the full lifecycle of application development, from initial design and implementation to deployment of scalable solutions.
• Proficiency in ETL between different RDBMSs (e.g., Oracle) to Databricks and NoSQL databases
• Experience working with Mongo DB
• Working knowledge in Python, PySpark, and Scala
• Design and implement scalable data processing solutions using Azure Databricks
• Collaborate with data scientists and data analysts to understand data needs
• Optimize data pipelines and workflows for performance and scalability
• Bring experience working within Agile and Scrum team environments.

Possess excellent analytical, problem-solving, and interpersonal communication abilities.

Equal opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract