Data Engineer

MMDSmart Ltd; United States; Ibrido; USD 100.000 - 140.000; Tempo pieno

Vantaggi offerti da questo lavoro

Медицинская страховка

Спортивная карта

Обучение и курсы

Гибкий формат работы

Descrizione del lavoro

MMDSmart Ltd ищет инженера по данным для построения и поддержки масштабируемых дата-пайплайнов и хранилищ данных. Ваша задача — работать с крупными данными, проектировать эффективные обработки и обеспечивать надёжность и производительность платформы данных.

Ключевые требования включают 4+ года опыта, опыт работы с SQL и BigQuery, Airflow и Spark, а также владение русским и английским языками. Возможна гибридная/удаленная работа с конкурентным вознаграждением.

Competenze

• 4+ года опыта Data Engineer
• Опыт работы с SQL и Google BigQuery
• Опыт построения ETL-процессов и обработки больших наборов данных
• Навыки Python для обработки данных
• Практический опыт Airflow
• Опыт работы с Kafka или потоковыми пайплайнами
• Знание рус. и англ. языков

Mansioni

• Проектирование и поддержка потоковых и пакетных пайплайнов данных
• Разработка ETL на Python и SQL
• Настройка и поддержка DAG Airflow
• Оптимизация запросов в BigQuery и моделей данных
• Мониторинг пайплайнов и обеспечение их надёжности
• Сотрудничество с аналитиками и инженерами данных

Conoscenze

SQL

Python

Data modeling

Data warehousing concepts

Russian & English (B2+)

Strumenti

Google BigQuery

Apache Airflow

Apache Spark (PySpark)

Kafka / streaming pipelines

Descrizione del lavoro

Описание

We are looking for a Data Engineer to join our team and help build and maintain scalable data pipelines and data warehouse solutions. In this role, you will work with large datasets, design efficient data processing workflows, and ensure the reliability and performance of our data platform. Since 2007, MMDSmart has been a leading supplier in cloud-based business communications, delivering game-changing IT products to businesses in over 100 countries. Our success is fueled by the inspiration and innovative ideas of our team members, encouraging their growth and impacting our Messaging and Voice solutions. These empower our clients to communicate more effectively with their customers. Don’t miss this chance to excel in a rapidly expanding tech company, where your potential and ambitions are not just recognized, but celebrated.

Задачи

• Design, build, and maintain data pipelines for batch and streaming data processing
• Develop and optimize ETL workflows using Python and SQL
• Build and maintain Airflow DAGs for orchestration of data workflows
• Implement data transformations and data quality checks
• Optimize BigQuery queries and data models for performance and cost efficiency
• Troubleshoot and improve reliability of existing pipelines
• Collaborate with analysts and engineering teams to support data needs
• Building and maintaining data pipelines
• Batch and streaming data processing
• Data transformation and orchestration
• Performance and cost optimization

Tech Stack

• Google BigQuery
• Python
• Apache Airflow
• Apache Spark (PySpark)

Требования

• 4+ years of experience as Data Engineer
• Strong experience with SQL and Google BigQuery
• Experience building data pipelines and ETL processes
• Solid knowledge of Python for data processing
• Hands-on experience with Apache Airflow
• Experience working with large datasets
• Understanding of data modeling and data warehouse concepts
• Experience with query optimization and cost-efficient data processing
• Experience with data pipeline monitoring and observability
• Language knowledge: fluency in Russian and English
• Experience with Kafka or streaming data pipelines

Условия

Why do talents choose and stay at MMDSmart? Embrace the opportunity to work in a company that cares about:

• Your Wellness: Access to mental health programs, comprehensive medical insurance, and a sports card*
• Your Happiness: Enjoy the company of cool teammates, a friendly atmosphere, a strong mentorship, and a variety of bonuses & corporate gifts
• Your Development: Benefit from free educational events & courses, and English classes with native speakers
• Your Career: Focus on your professional development in a supportive environment
• Work-Life Balance: Choose your working format - remote, office-based, or hybrid and engage in team-building activities

Equal-Opportunity Employment We are an equal opportunity employer committed to creating a diverse and inclusive work environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

Medical Insurance and Sport Card perks are available for employees located in Bulgaria.