Big data platform engineer in smart city

World Tech Enterprises; United States; Remote; USD 140,000 - 210,000; Full time

Benefits offered by this job

100% удаленная работа

Офисный график

23 дня отпуска + праздники

Job summary

World Tech Enterprises ищет двух старших специалистов по Big Data для длительного проекта по администрированию, эксплуатации и поддержке платформы в Smart City.

Кандидаты должны иметь 6–7 лет опыта в системном адмминистрировании Big Data, владение Linux, Kubernetes, Kafka, Airflow, ELK и Grafana, а также навыки Shell/Python и Java. Удаленная работа, гибкий график, конкурентная оплата.

Qualifications

• Требуется 6–7 лет опыта системного администрирования в проектах Big Data.
• Опыт управления открытыми Big Data платформами в Smart City не менее 5 лет.
• Практические навыки администрирования production-инфраструктуры: Linux, Kubernetes.
• Опыт работы с Kafka, Apache Airflow, ELK и Grafana на операционном уровне.
• Скрипты на Shell и/или Python; знание Java обязательно.
• Навыки сетей, сертификатов и подключения к сервисам.

Responsibilities

• Администрирование систем, приложений и окружений, мониторинг и анализ логов.
• Управление доступностью, восстановлением, бэкапами и восстановлением данных.
• Развертывания, обновления и управление емкостью и производительностью.
• Обеспечение оперативной безопасности, автоматизация задач и документация процедур.
• Конфигурация продуктов, тюнинг и L2/L3 поддержка.
• Интеграция между продуктами, анализ зависимостей и влияния.

Skills

Linux

Kubernetes

Kafka

Apache Airflow

ELK

Grafana

Shell scripting

Python

Java

Networking

Certificates

Connectivity

Tools

WSO2

Hive

Kudu

Phoenix

Apache Ranger

Solr

Job description

Описание:

At World Tech Enterprises, we are looking for two senior profiles for one of our clients to join a long-term project involving the administration, operation, and support of a Big Data platform in the Smart City field. Both profiles will work on the same environment, with distinct and complementary roles.

Задачи:

Administration of systems, applications, and environments. Monitoring and analysis of logs and traces. Management of availability, service recovery, backups, and restores. Deployments, updates, and management of capacity and performance. Operational security, task automation, and procedure documentation. Configuration and parameterization of products. Specialized troubleshooting and L3 support. Integration between products and analysis of dependencies and impact. Upgrades, validation of new versions, and technical evaluation of products. Specialized support for the operations team.

Требования:

At least 6–7 years of experience in systems administration in Big Data projects. At least 5 years with open-source Big Data platforms in the Smart City field. Hands-on experience administering systems, infrastructure, and applications in production environments. Proficiency in Linux and Kubernetes. Experience with Kafka, Apache Airflow, ELK (Elasticsearch / Kibana), and Grafana. Scripting in Shell and/or Python, and Java at an operational level. Knowledge of networking, certificates, and connectivity. Deployments, upgrades, troubleshooting, and L2/L3 production support. At least 5 years as a product specialist in Big Data projects in the Smart City field. Practical experience configuring, integrating, updating, and resolving incidents in data platform products. Knowledge of several of these components (you do not need to master them all): WSO2 (API Publisher, API Store, Identity Server), Kafka and Apache Airflow, data stack: Hive, Kudu, Phoenix, Apache Ranger, Solr, Kubernetes, ELK, and Grafana. Будет плюсом: A plus: Apache Jena Fuseki, GeoServer, Jupyter, HUE, R/RStudio, and Java; We will especially value a combination of WSO2 + Kafka/Airflow + data stack + Kubernetes

Условия:

Permanent employment contract. 100% remote work. Office hours. 23 days of vacation per year + December 24 and 31 as holidays. Competitive salary based on the experience you bring. Joining a stable, long-term technology project.