Remote-First Data Engineer (Graduate) - PySpark & Cloud ETL
Chrysos Corporation
A complete application in a minute
Tailored resume and cover letter, ready to send.
Benefits offered by this job
Job summary
Halo Labs is a data solutions firm that is building scalable cloud-native data platforms. We are hiring a data engineer to design, develop, and optimize data pipelines across Azure and AWS, using PySpark, Python, and Databricks to deliver production-ready solutions.
You will collaborate with software engineers to embed data services into the SaaS product, drive data modelling and governance, and implement observability and CI/CD for data workloads in a remote-first environment.
Qualifications
- Strong experience with Python, SQL and PySpark for large-scale distributed data processing.
- Hands-on with Azure Databricks, Azure Data Factory and related Azure services.
- Experience building production-grade data pipelines in a SaaS/product-led environment.
- Knowledge of data modelling, governance, and security for healthcare or regulated data environments.
Responsibilities
- Design, develop and maintain reusable in-house PySpark frameworks across the SaaS platform.
- Architect and implement scalable ETL/ELT pipelines on Azure and AWS.
- Build distributed data processing solutions using Python and PySpark on Databricks.
- Design secure data integration patterns (REST APIs, SFTP, event-driven ingestion, webhooks).
- Implement CI/CD pipelines for automated deployment and testing of data workloads.
Skills
Education
Tools
Job description
Halo Labs is a data solutions firm that is building scalable cloud-native data platforms. We are hiring a data engineer to design, develop, and optimize data pipelines across Azure and AWS, using PySpark, Python, and Databricks to deliver production-ready solutions.
You will collaborate with software engineers to embed data services into the SaaS product, drive data modelling and governance, and implement observability and CI/CD for data workloads in a remote-first environment.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
