Senior Data Engineer — Lakehouse & Spark, Remote

smartcat; United States; Remote; USD 130,000 - 190,000; Full time

Benefits offered by this job

Pay grades from L1 to L10

Career path alignment

Loyalty coefficient on net comp after

Knowledge budget

Flexible working hours and work from 홈

Transparency across salary and company

Support for gaining expertise

Job summary

SmartCat is seeking a Medior/Senior Data Engineer to build and optimize data lakehouse infrastructure using Spark and Databricks. You will design scalable pipelines and ensure efficient processing of large datasets.

You will collaborate with data scientists and analysts, implement robust data models, and help enforce security and compliance. Senior engineers mentor juniors and drive best practices across the team.

Qualifications

• Experience with Python or Scala/Java.
• Advanced knowledge of SQL.
• Hands-on experience with Spark, Databricks, Snowflake or Fabric.
• Understanding of data lakehouse concepts and distributed systems.
• Data modeling and data warehousing skills.
• Experience with cloud-native data architectures on AWS/Azure/GCP.
• Willing to learn, collaborate, and avoid overtime.

Responsibilities

• Design, build, and maintain scalable data pipelines using Apache Spark and modern data platforms.
• Develop and optimize data lakehouse architectures to support analytics and ML workflows.
• Implement data models that ensure quality, consistency, and accessibility.
• Collaborate with data scientists and analysts to meet data needs.
• Help ensure data security and regulatory compliance.
• Monitor and troubleshoot pipeline performance and reliability.
• Continuously improve data engineering processes and practices.
• Collaborate with cross-functional teams and contribute to technical discussions.
• At the Senior level, provide technical guidance and mentor junior engineers.

Skills

Python

Scala/Java

SQL

Distributed systems

Data modeling

Cloud-native data architectures

Tools

Apache Spark

Databricks

Snowflake

Microsoft Fabric

Job description

SmartCat is seeking a Medior/Senior Data Engineer to build and optimize data lakehouse infrastructure using Spark and Databricks. You will design scalable pipelines and ensure efficient processing of large datasets.

You will collaborate with data scientists and analysts, implement robust data models, and help enforce security and compliance. Senior engineers mentor juniors and drive best practices across the team.