Remote Databricks Data Engineer – AWS, Spark & Python

Eliassen Group; Pierre (SD); Remote; USD 150,000 - 154,000; Full time

Benefits offered by this job

Medical insurance

Dental and Vision

401(k) with match

Sick time (where applicable)

Wellness programs

Job summary

Databricks Data Engineer at Eliassen Group (Remote, Anywhere). Full-time, permanent opportunity offering a competitive salary and comprehensive benefits.

You will design, build, and maintain scalable data pipelines and data platforms, collaborating with ML engineers, software engineers, and analysts to deliver data products for clients and internal needs. The role requires 5+ years in data engineering, strong Python/SQL/Databricks/Spark skills, and cloud data pipelines in AWS.

Qualifications

• Five or more years of data engineering experience.
• Expert proficiency in Python, SQL, Databricks, and Spark.
• Experience building cloud-based data pipelines in AWS.
• Knowledge of data governance, security, privacy, and retention practices.
• Strong communication, collaboration, and problem-solving skills.
• Experience working in agile environments using Jira.
• Proficiency with Git, Docker, and CI tools such as Jenkins.
• Passion for data and continuous improvement.
• Preferred: ability to work independently and proactively.
• Preferred: experience optimizing ETL workflows in Databricks.

Responsibilities

• Design, develop, and maintain data pipelines, infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Provide technical guidance and mentorship to junior data engineers.
• Develop and implement data engineering standards and best practices.
• Monitor and troubleshoot data pipelines to ensure data quality, integrity, and availability.
• Research industry trends and evaluate new data technologies.
• Build and maintain data lakes to support analytics and business intelligence.
• Manage the software development life cycle and DevOps activities.
• Partner with data scientists and analysts to deliver effective data solutions.
• Develop data validation and data analysis tools.

Skills

Python

SQL

Databricks

Spark

AWS

Jira

Git

Docker

CI tools

Education

Bachelor's degree in computer science / IT / related field

Master's degree in STEM (preferred)

Tools

PostgreSQL

Job description

Databricks Data Engineer at Eliassen Group (Remote, Anywhere). Full-time, permanent opportunity offering a competitive salary and comprehensive benefits.

You will design, build, and maintain scalable data pipelines and data platforms, collaborating with ML engineers, software engineers, and analysts to deliver data products for clients and internal needs. The role requires 5+ years in data engineering, strong Python/SQL/Databricks/Spark skills, and cloud data pipelines in AWS.