Lead Software Engineer
engineeringjobs.net, Inc.
A complete application in a minute — tailored resume and cover letter, ready to send.
Job summary
engineeringjobs.net, Inc. seeks a data engineer to design and build Python applications and PySpark workloads to process data within AWS environments. You will develop and maintain ETL pipelines and provision AWS infrastructure to support client modernization initiatives.
The role requires a bachelor's degree and at least 7 years of experience in Python and PySpark development, plus 5+ years building ETL pipelines using AWS Glue and Amazon S3. Strong SQL and cloud migration skills are essential.
Qualifications
- Bachelor's degree required.
- 7+ years of Python and PySpark development experience.
- 5+ years building ETL pipelines using AWS Glue and Amazon S3.
Responsibilities
- Design and build Python applications and PySpark workloads to process data within AWS environments.
- Develop and maintain ETL pipelines and provision AWS infrastructure to support client modernization initiatives.
Skills
Education
Job description
You will design and build Python applications and PySpark workloads to process data within AWS environments. Additionally, you will develop and maintain ETL pipelines and provision AWS infrastructure to support client modernization initiatives.
Requirements: Candidates must have a bachelor's degree and at least 7 years of experience in Python and PySpark development. You are also required to have 5+ years of experience building ETL pipelines using AWS Glue and Amazon S3.
Key Skills: Python, PySpark, AWS Glue, Amazon S3, SQL, AWS CloudFormation, ETL Pipelines, Data Engineering, Cloud Migration, API Integration, Database Management, Code Reviews, Production Support, Technical Documentation, Project Leadership
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
