Senior Data Engineer - Real-Time Lakehouse & Databricks

Remotedxb; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Remotedxb in the United States is seeking a data engineer to design, build, and maintain scalable data pipelines and products supporting Enterprise Credit Risk initiatives. You will work with cloud and lakehouse tech to process data at scale.

Collaborating with Risk, Product, Data Science, and Engineering teams, you will translate business requirements into robust technical solutions, implement data quality controls, and help migrate assets to Databricks and cloud-native platforms.

Qualifications

• Experience building data pipelines for enterprise-scale solutions.
• Experience with Databricks, Spark, PySpark, Hadoop, SQL and Python.
• Strong knowledge of ETL/ELT pipelines and large-scale data processing.
• Familiarity with data formats Parquet/Avro/ORC and cloud-native platforms.
• Ability to implement data quality, monitoring, and observability.

Responsibilities

• Design, develop, test, and maintain scalable data pipelines and data products.
• Build and optimize batch and real-time data processing using cloud and lakehouse tech.
• Collaborate with Risk, Product, Data Science, and Engineering teams to translate requirements into solutions.
• Develop reusable frameworks and patterns to improve efficiency and consistency.
• Implement data quality controls, monitoring, and observability.
• Support migration of assets to Databricks and cloud-native platforms.
• Maintain curated datasets supporting lending decisioning and risk management.
• Participate in architecture discussions and offer technical recommendations.
• Troubleshoot production issues and drive root cause analysis.
• Follow best practices for code quality, testing, deployment automation, security, and operations.
• Mentor junior engineers through reviews and knowledge sharing.
• Continuously improve scalability, performance, cost efficiency, and maintainability.

Skills

Data engineering

Mentoring

Testing & monitoring

Cloud data architectures

Tools

Databricks

Apache Spark

PySpark

Hadoop

SQL

Python

ETL/ELT pipelines

Parquet/ORC/Avro

Cloud platforms (AWS/GCP/Azure)

Job description

Remotedxb in the United States is seeking a data engineer to design, build, and maintain scalable data pipelines and products supporting Enterprise Credit Risk initiatives. You will work with cloud and lakehouse tech to process data at scale.

Collaborating with Risk, Product, Data Science, and Engineering teams, you will translate business requirements into robust technical solutions, implement data quality controls, and help migrate assets to Databricks and cloud-native platforms.