Data Engineer (SQL, Python, Linux, AWS and PySpark)
Saxon AI
Hyderabad
On-site
INR 800,000 - 1,200,000
Full time
14 days+
Get more replies from employers
Send a job-specific resume in minutes.
Start fresh or import an existing resume
Job summary
A technology company in Hyderabad is seeking a Data Engineer with expertise in SQL, Python, and Linux. The role involves developing data-processing solutions, collaborating with teams, and improving processes. Ideal candidates should have over 5 years of experience in related technologies and a strong understanding of AWS and PySpark. This is a full-time position suitable for mid-senior level professionals.
Qualifications
5+ years of advanced working knowledge of SQL, Python, and PySpark.
Experience building and optimizing data pipelines in a distributed environment.
Experience supporting and working with cross-functional teams.
Responsibilities
Develop and enhance data-processing, orchestration, monitoring, and more.
Collaborate with product and technology teams to design and validate the capabilities of the data platform.
Identify, design, and implement process improvements.
Skills
SQL
Python
Linux
AWS
PySpark
Tools
Git/Bitbucket
Jenkins/CodeBuild
CodePipeline
Job description
Data Engineer (SQL, Python, Linux, AWS and PySpark)
Responsibilities
Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
Collaborate with product and technology teams to design and validate the capabilities of the data platform
Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
Provide technical support and usage guidance to the users of our platform’s services.
Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
Experience building and optimizing data pipelines in a distributed environment
Experience supporting and working with cross-functional teams
Proficiency working in Linux environment
5+ years of advanced working knowledge of SQL, Python, and PySpark
Knowledge on Palantir
Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
Experience with platform monitoring and alerts tools