Remote Databricks Data Engineer - Build Data Pipelines

Eliassen Group; Richmond (VA); Remote; USD 150,000 - 154,000; Full time

Benefits offered by this job

Medical plans

Dental plans

Vision plans

401(k) with match

Sick time

Job summary

Eliassen Group is seeking a Databricks Data Engineer to design, build, and maintain scalable, secure data pipelines and infrastructure supporting consulting services and SaaS solutions. This remote, full-time role reports on a W2 basis with a competitive benefits package.

Responsibilities include building pipelines with AWS, Databricks, Spark, and PostgreSQL, mentoring juniors, and ensuring data quality and governance. Prior energy/utility experience is a plus.

Qualifications

• Five or more years of experience in data engineering or a related role.
• Proficiency in Python, SQL, Databricks, and Spark.
• Experience building cloud-based data pipelines in AWS.
• Knowledge of data governance, security, privacy, and retention practices.
• Strong communication, collaboration, and problem-solving skills.
• Experience with agile environments using Jira.
• Proficiency with Git, Docker, and CI tools such as Jenkins.
• Preference for independent and proactive work style.
• Preference for experience optimizing ETL workflows in Databricks.
• Preference for knowledge of data lineage and data quality practices.
• Preference for experience supporting data science and ML solutions.
• Preference for energy/utility industry experience.

Responsibilities

• Design, develop, and maintain data pipelines, infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Provide technical guidance and mentorship to junior data engineers.
• Develop and implement data engineering standards and best practices.
• Monitor and troubleshoot data pipelines to ensure data quality, integrity, and availability.
• Research industry trends and evaluate new data technologies.
• Build and maintain data lakes to support analytics and business intelligence.
• Manage the software development life cycle and DevOps activities.
• Partner with data scientists and analysts to deliver effective data solutions.
• Develop data validation and data analysis tools.

Skills

Python

SQL

Databricks

Spark

AWS

Data governance

Security

Communication

Collaboration

Agile

Education

Bachelor's degree

Master's degree

Tools

Databricks

PostgreSQL

Jira

Git

Docker

Jenkins

Job description

Eliassen Group is seeking a Databricks Data Engineer to design, build, and maintain scalable, secure data pipelines and infrastructure supporting consulting services and SaaS solutions. This remote, full-time role reports on a W2 basis with a competitive benefits package.

Responsibilities include building pipelines with AWS, Databricks, Spark, and PostgreSQL, mentoring juniors, and ensuring data quality and governance. Prior energy/utility experience is a plus.