Python Pyspark Databricks Developer

Cloud Hybrid Technologies, LLC; Glendale (CA); On-site; USD 170,000 - 210,000; Full time

Job summary

Cloud Hybrid Technologies, LLC is seeking a senior backend engineer to design and maintain robust backend services and data pipelines using Python and PySpark. You will architect scalable APIs, work with PostgreSQL databases, and collaborate with cross-functional teams to ensure system reliability in a cloud environment.

Senior engineers will mentor juniors and lead design discussions in a fast-paced setting.

Qualifications

• 7+ years of professional software development experience, with a focus on backend systems.

Responsibilities

• Design, develop, and maintain backend services and high-performance data pipelines using Python and PySpark.
• Architect and implement scalable APIs and microservices to support business-critical applications and integrations.
• Design and optimize PostgreSQL data models and queries for performance and reliability.
• Collaborate with cross-functional teams including data engineers, architects, and DevOps to ensure system robustness and scalability.
• Lead technical design discussions, mentor junior engineers, and enforce best practices in backend development.
• Participate in performance tuning, debugging, and production support.
• Integrate with external systems such as OpenText (experience helpful but not required).

Skills

Python

PySpark

Backend development

Distributed systems

API design

Tools

PostgreSQL

Job description

• Design, develop, and maintain backend services and high-performance data pipelines using Python and PySpark.
• Architect and implement scalable APIs and microservices to support business-critical applications and integrations.
• Design and optimize PostgreSQL data models and queries for performance and reliability.
• Collaborate with cross-functional teams including data engineers, architects, and DevOps to ensure system robustness and scalability.
• Lead technical design discussions, mentor junior engineers, and enforce best practices in backend development.
• Participate in performance tuning, debugging, and production support.
• Integrate with external systems such as OpenText (experience helpful but not required).

Required Skills and Experience

• 7+ years of professional software development experience, with a focus on backend systems.
• Expert-level proficiency in Python and PySpark for backend and data processing workloads.
• Strong understanding of backend architecture, distributed systems, and API design.
• Experience with PostgreSQL or other relational databases.
• Familiarity with cloud-based environments (AWS, Azure, or GCP) and CI/CD pipelines.
• Strong problem-solving skills and ability to work independently on complex projects.

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract.