Data Engineer Databricks / Python / Database

Cloud Analytics Technologies, LLC; Jersey City (NJ); On-site; USD 68,880 - 110,208; Full time

Job summary

Cloud Analytics Technologies, LLC in Jersey City, NJ is seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines. The ideal candidate should have a strong background in Databricks, Python, and database engineering.

In this role, you will work on ETL/ELT workflows, ensuring data quality and supporting analytics and ML initiatives while collaborating with various teams. The position offers varying hourly rates depending on experience and includes potential for contract extension.

Qualifications

• Strong expertise in Databricks and Python.
• Experience in database engineering and ETL/ELT processes.
• Ability to work with large-scale datasets.

Responsibilities

• Design, build, and maintain ETL/ELT workflows on Databricks.
• Develop scalable data pipelines using Python and Spark.
• Optimize data transformation logic for performance and cost efficiency.
• Collaborate with Data Scientists and Analysts.

Skills

Database Engineering

SQL

Cloud Platforms

ETL/ELT tools

Data Engineering

Python

Spark

Job description

Location: Jersey City, NJ

Duration: 12 months + extension

Hourly Rate: Depending on experience (DOE)

Overview

We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, and database engineering. The ideal candidate will design, build, and optimize scalable data pipelines, ensure data quality, and support advanced analytics and business intelligence initiatives across the organization.

Key Responsibilities

• Design, build, and maintain ETL/ELT workflows on Databricks.
• Develop scalable data pipelines using Python and Spark.
• Optimize data transformation logic for performance and cost efficiency.
• Work with structured and unstructured data from various sources.
• Develop and manage data models, schemas, and tables across databases (SQL/NoSQL).
• Implement data quality, validation, and monitoring frameworks.
• Collaborate with Data Scientists, Analysts, and Cloud Engineers to support analytics and ML workloads.
• Ensure data security, governance, and compliance in all solutions.
• Troubleshoot pipeline failures and continuously improve pipeline reliability.
• Integrate data from APIs, streaming sources, and cloud storage.

Required Skills

• Database Engineering – strong SQL, query tuning, schema design, stored procedures.
• Cloud Platforms (one or more): AWS / Azure / GCP.
• ETL/ELT tools: ADF, Glue, Dataflow, or equivalent.
• Experience working with large-scale datasets.

Equal Opportunity Employer

Cloud Analytics Technologies LLC is an equal opportunity employer inclusive of female, minority, disability, and veterans. Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status.