Remote Databricks Data Engineer | AWS, Spark & Data Lakes

Eliassen Group; Annapolis (MD); Remote; USD 150,000 - 154,000; Full time

Benefits offered by this job

Medical plans

Dental

Vision

Pre-tax accounts

Life & disability insurance

401(k) with match

Sick time

Job summary

Eliassen Group is seeking a Databricks Data Engineer to design and maintain scalable data pipelines and systems in a remote, permanent role. You will partner with ML engineers, software developers, data scientists, and analysts to deliver data products and support internal practices.

The position offers a competitive salary, comprehensive benefits, and W2 employment. Prior experience with Databricks, Spark, and cloud data architectures is essential for success in this role.

Qualifications

• Five or more years of experience in data engineering or a related role.
• Expert proficiency in Python, SQL, Databricks, and Spark.
• Experience building cloud-based data pipelines in AWS.
• Knowledge of data governance, security, privacy, and retention practices.
• Strong communication, collaboration, and problem-solving skills.
• Experience working in agile environments using Jira.
• Proficiency with Git, Docker, and CI tools such as Jenkins.
• Passion for data and continuous improvement.

Responsibilities

• Design, develop, and maintain data pipelines, infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Provide technical guidance and mentorship to junior data engineers.
• Develop and implement data engineering standards and best practices.
• Monitor and troubleshoot data pipelines to ensure data quality, integrity, and availability.
• Research industry trends and evaluate new data technologies.
• Build and maintain data lakes to support analytics and business intelligence.
• Manage the software development life cycle and DevOps activities.
• Partner with data scientists and analysts to deliver effective data solutions.
• Develop data validation and data analysis tools.

Skills

Python

SQL

Databricks

Spark

AWS

Data pipelines

Jira

Git

Docker

CI/CD

Education

Bachelor's degree in CS/IT or related field

Master's degree in STEM (preferred)

Tools

Jira

Git

Docker

Jenkins

Job description

Eliassen Group is seeking a Databricks Data Engineer to design and maintain scalable data pipelines and systems in a remote, permanent role. You will partner with ML engineers, software developers, data scientists, and analysts to deliver data products and support internal practices.

The position offers a competitive salary, comprehensive benefits, and W2 employment. Prior experience with Databricks, Spark, and cloud data architectures is essential for success in this role.