Data Specialist

Social network you want to login/join with:

Techyard is seeking a skilled and motivated Databricks professional. In this role, you will play a key part in designing, developing, and optimizing data solutions using the Databricks Lakehouse Platform. You will work closely with cross-functional teams to deliver high-performance data pipelines, enable advanced analytics, and drive business value through data.

Key Responsibilities:

1. Build and maintain scalable data pipelines using Databricks and Apache Spark.
2. Develop efficient data models and implement Lakehouse architecture (bronze/silver/gold layers).
3. Optimize data processing workflows for performance, reliability, and cost-efficiency.
4. Collaborate with data analysts, scientists, and stakeholders to deliver clean, trusted datasets.
5. Integrate data from various sources using native Databricks tools and/or orchestration frameworks.
6. Maintain high standards of code quality through version control, testing, and CI/CD practices.
7. Monitor, troubleshoot, and continuously improve data workflows in production environments.
8. Hands-on experience with Databricks and Apache Spark.
9. Proficiency in PySpark and SQL.
10. Strong understanding of data lakehouse concepts, data modeling, and data warehousing.
11. Familiarity with one or more cloud platforms (Azure, AWS, or Google Cloud).
12. Knowledge of orchestration tools (e.g., Airflow, dbt, or similar).
13. Awareness of data quality, security, and governance best practices.
14. Strong analytical, communication, and problem-solving skills.
15. Databricks certifications (e.g., Data Engineer Associate / Professional).
16. Experience with tools such as dbt, MLflow, or Unity Catalog.
17. Exposure to BI platforms (e.g., Power BI, Tableau) or machine learning workflows.
18. Experience working within Agile or DevOps environments.