Data Architect

Social network you want to login/join with:

Responsibilities

1. Manage end-to-end delivery by investigating problem areas and working cross-functionally with product managers and other stakeholders.
2. Follow the Agile development methodology; think strategically and execute methodically.
3. Develop and manage capacity and growth projection forecasts within budgets.
4. Create and maintain optimal data pipeline architecture, assembling large, complex data sets that meet business requirements.
5. Drive optimization, testing, and tooling to improve solution quality.
6. Manage teams building and operating high-volume distributed systems in a SaaS environment.
7. Devise efficient processes to increase velocity and quality.

Desired Experience/Skills

1. 8+ years of relevant experience.
2. At least 5 years of experience leading highly complex technical engineering teams.
3. Strong hands-on experience with Databricks.
4. Experience managing distributed teams is preferred.
5. Technical expertise in large distributed systems, Data Warehousing, and Data Lake at scale.
6. Project management skills including financial/budget management, scheduling, and resource management for medium and large-scale projects.
7. Comfortable working with ambiguity and multiple stakeholders.
8. Experience with medallion architecture, optimization, ingestion, and quality.
9. Experience working with Unity Catalog and leveraging its Data Governance and Observability capabilities.
10. Ability to work cross-functionally with product management and directly with customers to understand product and customer personas.
11. Architecture design experience for cloud and non-cloud platforms.
12. Expertise in Azure Cloud platform and orchestrating workloads on cloud.
13. Ability to set and lead the technical vision balancing business drivers.
14. Strong experience with PySpark and Python programming.
15. Proficiency with APIs, containerization, and orchestration is a plus.