Job Summary:
We are seeking an experienced IT Consultant specializing as a Big Data Architect to design, develop, and maintain an enterprise Big Data/Data Lake architecture. This role is integral to the Data Modernization Effort, supporting enterprise data operations such as IoT/Smart City projects, enterprise data warehouse, open data portal, and data science applications on a Databricks/Azure-based platform in collaboration with the Chief Data Officer team.
Responsibilities:
- Coordinate IT project management, engineering, maintenance, quality assurance, and risk management activities.
- Plan, coordinate, and monitor project activities across the data platform lifecycle.
- Develop technical applications and support real-time database, network, and graphics/logic systems.
- Establish and enforce standards and procedures for system design, development, and documentation.
- Perform application upgrades, troubleshoot issues, and provide user training.
- Ensure project lifecycle compliance with District standards and procedures.
- Integrate the data platform with enterprise tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle.
Required Skills & Certifications:
- Bachelor's degree in IT or related field, or equivalent experience.
- 16 years of experience in planning, coordinating, and monitoring projects ensuring standards compliance.
- 5 years of experience with Big Data platforms (Databricks, Data Lakes), Azure cloud architecture, security, and storage.
- Experience in data operations including runtime, warehousing, pipelines, cost, and user management.
- Proficiency with data visualization tools such as Tableau, MicroStrategy, ArcGIS, Kibana, and Oracle.
- Strong skills in SQL/NoSQL querying and data pipeline modeling and ingestion.
- 3 years of experience with REST/SOAP APIs and web services, real-time streaming/event processing, and data science tools (Notebooks, R).
- Experience with ETL and analytics using Python, Java, or R.
Preferred Skills & Certifications:
- Databricks Certified Data Engineer Professional certification.
- 2 years of experience deploying applications, gateways, agents, and models on Databricks.
Special Considerations:
- Work is onsite and requires close collaboration with internal teams.
- Compliance with District standards and procedures is mandatory throughout the project lifecycle.
Scheduling:
- Onsite location.
- Duration of assignment is 2 months.
- Interview process conducted in person.