About the Role
Our client, a leader in the agricultural technology sector, is seeking a dynamic Senior Solutions Architect - Big Data & Analytics to join their team in Upington, Northern Cape. This hybrid role offers the flexibility to balance remote work with crucial in-office collaboration, enabling you to design and implement advanced big data and analytics solutions. You will architect scalable platforms that ingest, process, and analyze vast amounts of data to drive business insights and innovation in agriculture. The ideal candidate possesses a deep understanding of big data technologies, cloud platforms, data warehousing, and data modeling, coupled with strong problem-solving and communication skills. You will collaborate closely with data scientists, engineers, and business stakeholders to translate complex data requirements into effective architectural designs. This is a significant opportunity to shape the data strategy of a key player in the agri-tech industry and contribute to data-driven advancements within the Upington region.
Key Responsibilities
- Design and architect scalable, end-to-end big data solutions on cloud platforms (e.g., AWS, Azure, GCP).
- Develop data models and schemas for data warehousing, data lakes, and analytical databases.
- Oversee the implementation of ETL/ELT pipelines for data ingestion, transformation, and processing.
- Evaluate and recommend big data technologies, tools, and frameworks (e.g., Spark, Hadoop, Kafka).
- Collaborate with data scientists and analysts to ensure data accessibility and usability for advanced analytics and machine learning.
- Define data governance policies, security measures, and best practices for data management.
- Optimize data storage, processing, and query performance for cost-efficiency and speed.
- Provide technical leadership and mentorship to data engineering teams.
- Ensure solutions align with business objectives and overall enterprise architecture strategy.
- Stay updated on emerging trends in big data and analytics technologies.
Requirements
- Master's degree in Computer Science, Data Science, Engineering, or a related quantitative field.
- Minimum of 8 years of experience in data architecture, data engineering, or a similar role with a strong focus on big data and analytics.
- Proven experience designing and implementing big data solutions using cloud-based services (e.g., AWS EMR, S3, Glue; Azure Data Factory, Synapse Analytics; GCP Dataproc, BigQuery).
- Strong understanding of distributed systems, data warehousing concepts, and data modeling techniques.
- Proficiency in SQL and experience with NoSQL databases.
- Hands-on experience with big data processing frameworks like Apache Spark.
- Familiarity with data visualization tools (e.g., Tableau, Power BI) and their integration.
- Excellent analytical, problem-solving, and communication skills.
- Experience working effectively in a hybrid work environment, demonstrating collaboration and autonomy.
Benefits
- Competitive salary package with performance-based bonuses.
- Comprehensive medical aid and retirement fund benefits.
- Generous annual leave and flexible hybrid work options.
- Opportunities for continuous learning, training, and professional certifications.
- Exposure to cutting-edge big data and analytics technologies in the agri-tech industry.
- A collaborative and supportive team environment in Upington.