Remote Data Engineer - Databricks and Cloud Data Platforms

Open Systems Technologies; New York (NY); Remote; USD 137,760 - 179,088; Full time

Job summary

A financial firm seeks a Data Engineer specializing in Databricks to develop scalable data solutions and manage cloud databases. The role emphasizes deep expertise in SQL, data modeling, and data governance, ideally suited for candidates with a Bachelor's degree and significant related experience. This is a remote position, requiring proficiency with tools like AWS and various Big Data technologies.

Qualifications

• 7+ years of experience in designing and building large-scale solutions.
• 3+ years designing and building solutions in the cloud.
• Expertise in cloud database management and data warehousing.

Responsibilities

• Develop data pipelines focusing on security, scalability, and reliability.
• Manage Cloud databases and solutions in Databricks Lakehouse.
• Work within Agile methodologies and CI/CD pipelines.

Skills

Data modeling

SQL

Cloud database management

Data governance

Scripting languages

Data warehousing concepts

Big Data technologies

Agile methodologies

Education

Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field

Tools

Databricks

AWS RDS

Vertica

SparkSQL

Hadoop

Job description

A financial firm seeks a Data Engineer specializing in Databricks to develop scalable data solutions and manage cloud databases. The role emphasizes deep expertise in SQL, data modeling, and data governance, ideally suited for candidates with a Bachelor's degree and significant related experience. This is a remote position, requiring proficiency with tools like AWS and various Big Data technologies.