Enable job alerts via email!

Data Engineer - Databricks

Open Systems Technologies

New York (NY)

Remote

USD 80,000 - 100,000

Full time

15 days ago

Generate a tailored resume in minutes

Land an interview and earn more. Learn more

Start fresh or import an existing resume

Job summary

A financial firm seeks a Data Engineer specializing in Databricks to develop scalable data solutions and manage cloud databases. The role emphasizes deep expertise in SQL, data modeling, and data governance, ideally suited for candidates with a Bachelor's degree and significant related experience. This is a remote position, requiring proficiency with tools like AWS and various Big Data technologies.

Qualifications

  • 7+ years of experience in designing and building large-scale solutions.
  • 3+ years designing and building solutions in the cloud.
  • Expertise in cloud database management and data warehousing.

Responsibilities

  • Develop data pipelines focusing on security, scalability, and reliability.
  • Manage Cloud databases and solutions in Databricks Lakehouse.
  • Work within Agile methodologies and CI/CD pipelines.

Skills

Data modeling
SQL
Cloud database management
Data governance
Scripting languages
Data warehousing concepts
Big Data technologies
Agile methodologies

Education

Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field

Tools

Databricks
AWS RDS
Vertica
SparkSQL
Hadoop

Job description

Data Engineer - Databricks

A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote.

Pay: $100-130/hr

US Citizens or GC Holders Only
No c2c - W2 Only

Qualifications:
  1. Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field
  2. 7+ years of experience in designing and building large-scale solutions in an enterprise setting
  3. 3+ years designing and building solutions in the cloud
  4. Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architectures
  5. Expertise in building Cloud Database Management Systems in Databricks Lakehouse or analogous architectures
  6. Deep SQL expertise, data modeling, and experience with data governance in relational databases
  7. Experience with data warehousing concepts, methodologies, and frameworks using technologies like Vertica, Teradata, SparkSQL, Hadoop, Kafka
  8. Refined skills using scripting languages (e.g., Python, bash)
  9. Ability to design and develop data pipelines considering security, scalability, uptime, and reliability
  10. Expertise in relational and dimensional data modeling
  11. UNIX administration and general server administration experience
  12. Experience with CI/CD pipelines
  13. Experience with Big Data query and transformation tools such as Presto, Hive, SparkSQL, Cassandra, Solr (plus)
  14. Experience using Spark, Kafka, Hadoop or similar distributed data technologies (plus)
  15. Experience with Agile methodologies (preferred)
  16. Experience with ETL/ELT tools like Talend, Informatica (plus)
  17. Experience with Cloud Data Warehouses such as Redshift, BigQuery or similar (plus)
Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.