Remote Databricks Data Engineer: Pipelines & Data Lakes

Eliassen Group; Topeka (KS); Remote; USD 150,000 - 154,000; Full time

Benefits offered by this job

Medical: 3 plans to choose from

Dental insurance

Vision insurance

Pre-tax accounts

Life and disability insurance

401(k) with match

Sick time

Job summary

Eliassen Group is seeking a Databricks Data Engineer for remote work in a permanent role. You will design and maintain scalable data pipelines and infrastructure to support consulting services and SaaS solutions, collaborating with ML engineers, software engineers and data scientists.

The role requires 5+ years in data engineering, expert Python/SQL/Databricks/Spark skills, and AWS cloud experience. Competitive salary and full benefits are provided, with W2 employment.

Qualifications

• Five+ years in data engineering or related role.
• Expert proficiency in Python, SQL, Databricks and Spark.
• Experience building cloud-based data pipelines in AWS.
• Knowledge of governance, security, privacy and data retention.

Responsibilities

• Design, build, and maintain data pipelines, infrastructures and systems.
• Collaborate with cross-functional teams to translate requirements.
• Provide mentorship to junior data engineers.
• Develop data engineering standards and best practices.
• Monitor data pipelines for quality, integrity and availability.
• Build and maintain data lakes for analytics and BI.
• Manage SDLC and DevOps activities.
• Partner with data scientists and analysts to deliver data solutions.
• Develop data validation and analysis tools.

Skills

Python

SQL

Databricks

Spark

AWS

Jira

Git

Docker

CI tools

Data governance

Data security

Agile

ETL optimization

Data lineage

ML support

Education

Bachelor’s degree in computer science / IT

Master’s degree preferred

Tools

PostgreSQL

Databricks platform

Job description

Eliassen Group is seeking a Databricks Data Engineer for remote work in a permanent role. You will design and maintain scalable data pipelines and infrastructure to support consulting services and SaaS solutions, collaborating with ML engineers, software engineers and data scientists.

The role requires 5+ years in data engineering, expert Python/SQL/Databricks/Spark skills, and AWS cloud experience. Competitive salary and full benefits are provided, with W2 employment.