Senior Data Engineer & Tech Lead (Java/Scala, Spark)
SPAN Digital
14 days+
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
A premium software consultancy is seeking an experienced Data Engineering Lead to manage large-scale data migration projects and provide technical leadership. Ideal candidates should have over 8 years in data engineering, advanced proficiency in Scala and Java, and experience with cloud platforms such as AWS, GCP, or Azure. This role offers mentorship opportunities and the chance to work on innovative projects in a collaborative environment. Competitive compensation and flexible working arrangements are included.
Qualifications
- Minimum 8 years in data engineering or related engineering roles.
- Proven expertise in large-scale data migration and ETL pipeline development.
- Deep experience with Apache Spark and distributed file systems.
Responsibilities
- Design and implement large-scale data migration strategies.
- Mentor engineers through pair programming and code reviews.
- Provide technical leadership for data migration initiatives.
Skills
Data migration expertise
Apache Spark
Scala
Java
Kubernetes (AWS EKS)
Problem-solving
Data privacy understanding
Education
Bachelor's/Master's in Computer Science, Engineering, or equivalent
Tools
Gradle
Maven
AWS
GCP
Azure
Databricks
HDFS
S3
GCS
Apache Kafka
Prometheus
Grafana
Job description
A premium software consultancy is seeking an experienced Data Engineering Lead to manage large-scale data migration projects and provide technical leadership. Ideal candidates should have over 8 years in data engineering, advanced proficiency in Scala and Java, and experience with cloud platforms such as AWS, GCP, or Azure. This role offers mentorship opportunities and the chance to work on innovative projects in a collaborative environment. Competitive compensation and flexible working arrangements are included.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
