Databricks Data Engineer - Performance & Incident Specialist
247Hire
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
247Hire is looking for a Data Application Support specialist who will focus on maintaining and optimizing data pipelines and Lakehouse architectures in Databricks. You'll resolve production incidents, tune SQL/PySpark jobs, manage Delta Lake assets, and collaborate with data engineering teams.
The ideal candidate will have strong experience in Apache Spark, Python, and SQL, along with proficiency in Databricks and Azure Data Lake technologies. If you excel in problem-solving and automation, this is the job for you!
Qualifications
- Strong hands-on experience with Apache Spark, Python/PySpark, and SQL.
- Proficiency with Databricks Unified Data Analytics Platform and Delta Lake.
- Experience with Azure Data Lake Storage (ADLS Gen2) or similar technologies.
- Experience with Git/Azure DevOps for code management.
- Strong analytical skills for diagnosing complex data issues.
Responsibilities
- Provide L2/L3 support for data applications, resolving production issues.
- Optimize Spark applications, SQL queries, and Delta Lake tables.
- Monitor and troubleshoot ETL/ELT pipelines in Databricks.
- Act as a liaison between users and data engineering teams.
- Create tools to automate routine support tasks.
Skills
Job description
247Hire is looking for a Data Application Support specialist who will focus on maintaining and optimizing data pipelines and Lakehouse architectures in Databricks. You'll resolve production incidents, tune SQL/PySpark jobs, manage Delta Lake assets, and collaborate with data engineering teams.
The ideal candidate will have strong experience in Apache Spark, Python, and SQL, along with proficiency in Databricks and Azure Data Lake technologies. If you excel in problem-solving and automation, this is the job for you!
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
