Remote Data Engineer - Spark, Databricks, Terraform
emagine
An application made for this job — a tailored resume and cover letter that speak straight to the posting.
Job summary
emagine is seeking a data engineer to drive data pipeline development for an e-commerce fashion and home décor brand. The role focuses on PySpark, Databricks, Delta Live Tables, and orchestration, with a remote-first setup and ASAP start.
You will collaborate with data architects and project managers to deliver scalable data solutions and robust testing processes. Ideal candidates will have Terraform/GitOps experience, familiarity with Azure Data Lake Storage, and strong English communication.
Qualifications
- Minimum 1 year of experience with Terraform and GitOps practices for infrastructure deployment.
- Proficiency with PySpark and Spark SQL for data processing.
- Experience with Databricks and Delta Live Tables for ETL and orchestration.
- Familiarity with Azure Data Lake Storage for data storage and management.
Responsibilities
- Analyze business and technical challenges from a user perspective.
- Design, build, and deploy data pipelines with performance and scalability in mind.
- Collaborate with Data Architects and Project Managers to align solutions with data architecture.
- Document processes, tests, and results; participate in code and peer reviews.
Skills
Education
Tools
Job description
emagine is seeking a data engineer to drive data pipeline development for an e-commerce fashion and home décor brand. The role focuses on PySpark, Databricks, Delta Live Tables, and orchestration, with a remote-first setup and ASAP start.
You will collaborate with data architects and project managers to deliver scalable data solutions and robust testing processes. Ideal candidates will have Terraform/GitOps experience, familiarity with Azure Data Lake Storage, and strong English communication.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
