Senior Remote Big Data Engineer – Spark & Hadoop
Bright Vision Technologies
Aumenta le possibilità di ricevere una risposta da questo datore di lavoro
Il tuo curriculum e una lettera di presentazione personalizzati, che corrispondono esattamente a ciò che sta cercando.
Descrizione del lavoro
Bright Vision Technologies is seeking an experienced Big Data Engineer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive structured and unstructured data to support analytics, ML, and reporting workloads.
The ideal candidate combines deep Hadoop ecosystem expertise with strong software engineering fundamentals to deliver reliable, cost-efficient data platforms in production environments.
Competenze
- Bachelor's degree in CS, engineering, or related technical discipline.
- 5+ years designing and operating big-data pipelines on Hadoop.
- Hands-on Spark experience in production environments.
- Strong SQL and experience with relational and NoSQL stores.
- Experience with Airflow or Oozie.
- Scripting skills in Python or Shell.
Mansioni
- Design, build, and operate large-scale data pipelines on Hadoop ecosystems.
- Ingest, transform, and analyze massive structured and unstructured data.
- Deliver reliable, performant data platforms in production.
- Collaborate with analytics, ML, and reporting workloads.
Conoscenze
Formazione
Strumenti
Descrizione del lavoro
Bright Vision Technologies is seeking an experienced Big Data Engineer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive structured and unstructured data to support analytics, ML, and reporting workloads.
The ideal candidate combines deep Hadoop ecosystem expertise with strong software engineering fundamentals to deliver reliable, cost-efficient data platforms in production environments.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
