Data engineer for Tableau

Mática Partners; United States; Remote; USD 43,000 - 49,000; Full time

Benefits offered by this job

Training plan

Health insurance

Flexible hours

Cobee allowance

Extra holidays

Welcome kit

Office snacks

Pet-friendly offices

Job summary

Mática ищет Data Engineer для IT‑команды крупного мультинационального клиента. Вы будете обрабатывать логи и метрики, работать с Databricks, Delta Lake и Tableau Server, оптимизировать источники данных и обновления, а также обеспечивать соответствие требованиям мониторинга и эксплуатации.

Кандидат должен владеть Spark, SQL и PostgreSQL, разбираться в Tableau Server/Cloud и иметь хороший уровень английского. Работа предполагает удаленно-офисный режим и конкурентное вознаграждение.

Qualifications

• Опыт работы Data Engineer не менее 3 лет.
• Опыт работы с Spark (PySpark/Spark SQL) на больших данных и оптимизацией.
• Опыт с Databricks и Delta Lake.
• Продвинутый SQL.
• Опыт PostgreSQL и анализа метаданных Tableau Server.
• Знание Tableau Server/Tableau Cloud на уровне администратора.
• Опыт анализа проблем производительности в BI/данных.
• М независимость и инициативность в исследовании проблем.
• Уровень английского — хороший.

Responsibilities

• Извлекать и централизовать данные о производительности Tableau Server в Databricks (лог-файлы, репозиторий, инструменты мониторинга).
• Собирать метрики Azure VM из Azure Monitor/Log Analytics.
• Использовать метаданные Tableau для выявления источников чтения рабочих книг.
• Обрабатывать и моделировать большие логи в Delta-таблицах через Spark.
• Анализ узких мест: медленные представления, дорогостоящие запросы, обновления извлечений.
• Предлагать улучшения и внедрять их: дизайн рабочих книг/источников данных, расписание обновлений, конфигурацию сервера.
• Подготовить таблицы для агента Genie (описания, примеры запросов) и проверить отклик.

Skills

Spark

Databricks

Delta Lake

SQL

PostgreSQL

Tableau Server

Tableau Cloud

Tableau Metadata API

Azure Monitor

Log Analytics

English

Tableau Genie

Tools

Tableau Server

Azure Monitor

Log Analytics

Databricks

Job description

Описание: We are a technology company specializing in Artificial Intelligence, Generative AI, Analytics, Data Governance, Cloud and Event Driven architectures, but above all we are a team with knowledge, sound judgment and a strong desire to do things well. We are looking for a Data Engineer for the IT team of a large multinational client.

Задачи:

• Extract and centralize Tableau Server performance data in Databricks: process logs (VizQL, backgrounder, gateway), the internal Tableau repository and the Resource Monitoring Tool.
• Collect Azure virtual machine metrics (CPU, memory, disk) from Azure Monitor or Log Analytics.
• Use Tableau metadata to identify which tables and data sources each workbook reads, to relate performance problems to their source.
• Process and model large volumes of logs with Spark in optimized Delta tables.
• Analyze bottlenecks: slow views, costly queries, overlapping extract refreshes, user peaks and machine sizing.
• Propose improvements and work with the teams to implement them: workbook and data source design, refresh scheduling, server configuration and optimization of source tables.
• Prepare the tables for the Genie agent (descriptions, instructions and example queries) and check that it responds well.

Требования:

• At least 3 years as a Data Engineer or in a similar role.
• Experience with Spark (PySpark or Spark SQL) on very large tables, including performance optimization: partitioning, file sizes, execution plans, joins and caching.
• Experience with Databricks and Delta Lake.
• Advanced SQL.
• Experience with PostgreSQL, including querying and analyzing system or metadata databases (for example, the internal Tableau Server repository).
• Knowledge of Tableau Server or Tableau Cloud from a technical or administration perspective: logs, repository, administrative views or monitoring tools.
• Experience analyzing performance problems in data or BI platforms.
• Autonomy and initiative to investigate problems without a defined solution.
• Good working level of English.
• Будет плюсом: Experience with Azure Monitor, Log Analytics or Azure virtual machine metrics; Knowledge of the Tableau Metadata API or REST API; Experience optimizing Tableau workbooks and extracts (performance recording, Hyper, live connections versus extracts); Experience with log analysis tools (Logshark, Splunk, ELK or similar); Experience with Unity Catalog or Databricks Genie

Условия:

Joining a company at the forefront of technology and focused on People; we put the employee at the center of everything we do.

We believe in a horizontal culture, without egos, in an environment where both ideas and people are valued.

Permanent contract and a starting salary between 38,000 and 44,000 euros gross per year, adjusted according to your experience (our career plan includes annual reviews).

• specialized training plan, participation in ownership and Mática benefits: free Wetaca at the office two days a week, flexible hours with the option to work from wherever you want, health insurance, flexible compensation with Cobee, and, in addition to the usual vacation, an extra week at Christmas and three additional days at Easter.
• You will also receive a fun Welcome Kit with a laptop (you can choose from several Mac or Windows models), mobile phone, personalized bottle, Bluetooth headphones and sweets.
• When you are at our office in central Barcelona or Madrid, fruit, coffee and soft drinks are on Mática.
• Our offices are pet-friendly.