Data Engineer (Medior/Senior)

SmartCat; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Clear pay grades

Career path

Loyalty bonus

Flexible hours

Transparent company

Professional development

Job summary

SmartCat is seeking a Medior/Senior Data Engineer to build and optimize data lakehouse infrastructure using Spark and Databricks, delivering scalable data pipelines for analytics and ML workloads.

You will design data models, collaborate with data scientists, and ensure data quality and security while mentoring junior engineers and guiding best practices in a fast-paced, collaborative environment. Flexible work options and strong career growth are offered.

Qualifications

• Proficient in Python or Scala/Java with strong SQL skills.
• Experience building scalable data pipelines and lakehouse architectures.
• Knowledge of cloud data platforms (AWS/Azure/GCP) and distributed systems.
• Interest in learning and collaborating in a team, with good work-life balance.
• Mentor junior engineers as a senior level.

Responsibilities

• Design, build, and maintain scalable data pipelines using Spark and modern data platforms.
• Develop and optimize data lakehouse architectures to support analytics and ML workflows.
• Implement data models and structures ensuring data quality and accessibility.
• Collaborate with data scientists and analysts to understand data requirements.
• Help ensure data security and compliance with regulations.
• Monitor and troubleshoot pipeline performance and reliability; continuously improve processes.
• Collaborate with cross-functional teams and contribute to technical discussions.
• Senior level: provide technical guidance and mentor junior engineers.

Skills

Python

Scala/Java

SQL

Spark

Databricks

Snowflake

Microsoft Fabric

Data lakehouse

Distributed systems

Data modeling

Data warehousing

AWS / Azure / GCP

Learning mindset

Team collaboration

Tools

Spark

Databricks

Snowflake

Microsoft Fabric

Job description

SmartCat is an AI-driven company that tackles complex data challenges with innovative solutions. Our expert team collaborates on carefully selected projects that deliver measurable, positive impacts on businesses, everyday life, and society.

Position Overview

We are seeking a talented Medior/Senior Data Engineer to join our team. In this role, you will build and optimize our data lakehouse infrastructure using Spark and Databricks, designing and implementing robust, scalable data pipelines and ensuring the efficient processing and storage of large datasets.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using Apache Spark and modern data platforms.
• Develop and optimize data lakehouse architectures to support data analytics and machine learning workflows.
• Implement data models and structures that ensure data quality, consistency, and accessibility.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Help ensure data security and compliance with relevant regulations.
• Monitor and troubleshoot data pipeline performance and reliability.Continuously improve data engineering processes and best practices.
• Collaborate with cross-functional teams and contribute to technical discussions.
• At the Senior level, you'll also provide technical guidance and mentor junior engineers.

Requirements

• Experience with Python or Scala/Java.
• Advanced knowledge of SQL.
• Hands-on experience with Apache Spark, Databricks, Snowflake, or Microsoft Fabric.
• Understanding of data lakehouse concepts and architecture.
• Grasp of distributed systems fundamentals.
• Data modeling and data warehousing skills.
• Experience with cloud-native data architectures on AWS, Azure, or GCP.
• You enjoy learning new things and trying different solutions.
• You value a healthy work-life balance; we don't like overtime.
• You know when and how to ask for help; we work together as a team.

Nice to have

• Kafka, Flink, or similar streaming technologies.

What we offer

• Clearly defined pay grades: from L1 (talented junior) to L10 (principal)
• The career path that connects these grades — you know where your life is going (at least here with us)
• Loyalty coefficient: 10% on net compensation after 3 years in SmartCat, 20% after 5 years
• Flexible working hours and work from home
• We are transparent — from L-levels to salary, strategy, financial reports, and beyond
• You will have our full support towards gaining expertise