Senior Data Engineer — Spark, Lakehouse, Remote

SmartCat; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Clear pay grades

Career path

Loyalty bonus

Flexible hours

Transparent company

Professional development

Job summary

SmartCat is seeking a Medior/Senior Data Engineer to build and optimize data lakehouse infrastructure using Spark and Databricks, delivering scalable data pipelines for analytics and ML workloads.

You will design data models, collaborate with data scientists, and ensure data quality and security while mentoring junior engineers and guiding best practices in a fast-paced, collaborative environment. Flexible work options and strong career growth are offered.

Qualifications

• Proficient in Python or Scala/Java with strong SQL skills.
• Experience building scalable data pipelines and lakehouse architectures.
• Knowledge of cloud data platforms (AWS/Azure/GCP) and distributed systems.
• Interest in learning and collaborating in a team, with good work-life balance.
• Mentor junior engineers as a senior level.

Responsibilities

• Design, build, and maintain scalable data pipelines using Spark and modern data platforms.
• Develop and optimize data lakehouse architectures to support analytics and ML workflows.
• Implement data models and structures ensuring data quality and accessibility.
• Collaborate with data scientists and analysts to understand data requirements.
• Help ensure data security and compliance with regulations.
• Monitor and troubleshoot pipeline performance and reliability; continuously improve processes.
• Collaborate with cross-functional teams and contribute to technical discussions.
• Senior level: provide technical guidance and mentor junior engineers.

Skills

Python

Scala/Java

SQL

Spark

Databricks

Snowflake

Microsoft Fabric

Data lakehouse

Distributed systems

Data modeling

Data warehousing

AWS / Azure / GCP

Learning mindset

Team collaboration

Tools

Spark

Databricks

Snowflake

Microsoft Fabric

Job description

SmartCat is seeking a Medior/Senior Data Engineer to build and optimize data lakehouse infrastructure using Spark and Databricks, delivering scalable data pipelines for analytics and ML workloads.

You will design data models, collaborate with data scientists, and ensure data quality and security while mentoring junior engineers and guiding best practices in a fast-paced, collaborative environment. Flexible work options and strong career growth are offered.