Remote Data Engineer: Spark ETL & Cloud Data Pipelines

Kalani Consulting, Inc.; Leesburg (VA); On-site; USD 70,000 - 90,000; Full time

Job summary

Kalani Consulting, Inc. seeks a Junior Data Engineer who will build and maintain scalable automated data pipelines and cloud data solutions. The ideal candidate will have a BA or BS degree in Computer Science or a related field, with experience in ETL pipeline development using Apache Spark and SQL. A collaborative work culture rooted in integrity and excellence is offered, along with competitive benefits. This position is remote and requires a US citizenship for security clearance.

Qualifications

• BA or BS degree in CS, Information Systems, or related field.
• Experience developing and deploying ETL pipelines using Apache Spark and/or Databricks.
• Experience in SQL and/or Spark SQL.
• Familiarity with Informatica a plus.
• Knowledge of dimensional models in data warehouses.
• Experience working on loading data to the Star Schema.

Responsibilities

• Engineer, build and maintain scalable automated data pipelines.
• Build cloud data solutions and provide domain perspective on storage and big data platform services.
• Deploy, automate, maintain, and manage cloud-based production system.
• Implement best practices in the management of data including master data and data quality.
• Support regular and ad-hoc data querying and analysis.

Skills

Experience developing and deploying ETL pipelines using Apache Spark and/or Databricks

Experience in SQL and/or Spark SQL

Familiarity with Informatica

Knowledge of dimensional models in data warehouses

Experience working on loading data to the Star Schema

Education

BA or BS degree in CS, Information Systems, or related field

Job description

Kalani Consulting, Inc. seeks a Junior Data Engineer who will build and maintain scalable automated data pipelines and cloud data solutions. The ideal candidate will have a BA or BS degree in Computer Science or a related field, with experience in ETL pipeline development using Apache Spark and SQL. A collaborative work culture rooted in integrity and excellence is offered, along with competitive benefits. This position is remote and requires a US citizenship for security clearance.