Data Engineer: Databricks, Python & Big Data Pipelines

Valiant Technologies LLC; Jersey City (NJ); On-site; USD 69,000 - 124,000; Full time

Job summary

VALIANT TECHNOLOGIES LLC is seeking an experienced Data Engineer in Jersey City, NJ to design, build, and optimize scalable data pipelines on Databricks using Python and SQL. The role emphasizes data quality, governance, and collaboration with data scientists and analysts.

You will develop data models, manage schemas across databases, and ensure secure, compliant data solutions supporting analytics and ML workloads with a focus on performance and cost efficiency.

Qualifications

• Expert level SQL with tuning and schema design.
• Experience with AWS/Azure/GCP cloud platforms.
• Proficient with ETL/ELT tools such as ADF, Glue, Dataflow.
• Experience handling large-scale datasets and data modeling.

Responsibilities

• Design, build, and optimize scalable data pipelines on Databricks.
• Develop data models and schemas across databases.
• Ensure data quality, validation, and monitoring.
• Collaborate with data scientists and analysts on analytics workloads.
• Implement data security and governance.

Skills

SQL & tuning

Cloud platforms

ETL/ELT tools

Big data experience

Job description

VALIANT TECHNOLOGIES LLC is seeking an experienced Data Engineer in Jersey City, NJ to design, build, and optimize scalable data pipelines on Databricks using Python and SQL. The role emphasizes data quality, governance, and collaboration with data scientists and analysts.

You will develop data models, manage schemas across databases, and ensure secure, compliant data solutions supporting analytics and ML workloads with a focus on performance and cost efficiency.