Remote Databricks Data Engineer — Pipelines & Lakes

Eliassen Group; Atlanta (GA); Remoto; USD 150.000 - 154.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical plans

401(k) with match

Sick time

Descrizione del lavoro

Eliassen Group is seeking a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and SaaS solutions. You will partner with machine learning engineers, software engineers, data scientists, and analysts to deliver data products for clients and to support internal data practices.

This is a full-time, permanent opportunity, offering a competitive salary and comprehensive benefits package.

Competenze

• Five or more years of experience in data engineering or a related role.
• Expert proficiency in Python, SQL, Databricks, and Spark.
• Experience building cloud-based data pipelines in AWS.
• Knowledge of data governance, security, privacy, and retention practices.

Mansioni

• Design, develop, and maintain data pipelines, infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Provide technical guidance and mentorship to junior data engineers.
• Develop and implement data engineering standards and best practices.
• Monitor and troubleshoot data pipelines to ensure data quality, integrity, and availability.
• Research industry trends and evaluate new data technologies.
• Build and maintain data lakes to support analytics and business intelligence.
• Manage the software development life cycle and DevOps activities.
• Partner with data scientists and analysts to deliver effective data solutions.
• Develop data validation and data analysis tools.

Conoscenze

Python

SQL

Databricks

Spark

AWS

Jira

Git

Docker

Jenkins

Formazione

Bachelor's degree

Master's degree

Strumenti

PostgreSQL

Descrizione del lavoro

Eliassen Group is seeking a Databricks Data Engineer to design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and SaaS solutions. You will partner with machine learning engineers, software engineers, data scientists, and analysts to deliver data products for clients and to support internal data practices.

This is a full-time, permanent opportunity, offering a competitive salary and comprehensive benefits package.