Databricks Engineer: Secure Cloud Data Pipelines

GD Information Technology, Inc.; United States; Hybrid; USD 140,000 - 190,000; Full time

Job summary

GD Information Technology, Inc. seeks a Databricks Engineer to design, build, and operate scalable data solutions for secure, mission-focused analytics. You will develop pipelines, notebooks, jobs, and data workflows in Databricks to support researchers and analysts working with sensitive datasets.

The role blends data engineering, cloud technology, and analytics with emphasis on data quality, security, and reliability. Strong experience with PySpark, SQL, Delta Lake, and Databricks is required.

Qualifications

• Bachelor’s degree in a related technical field.
• 5+ years of data engineering experience with Databricks.
• Strong experience with PySpark, SQL, Apache Spark, Delta Lake, and Databricks.
• Experience developing production-grade data pipelines and workflows.
• Experience with cloud-based data platforms and storage (AWS S3, Azure Data Lake Storage, or Google Cloud Storage).
• Experience with Git and CI/CD practices for data workloads.
• Understanding of distributed data processing, data modeling, data quality, and performance optimization.
• Experience troubleshooting production data workloads and security concepts.

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks, PySpark, SQL, and Delta Lake.
• Develop and maintain Databricks notebooks, jobs, and workflows for high-volume analytics.
• Build reliable data ingestion, transformation, validation, and integration processes.
• Help migrate and modernize existing data workloads for better scalability and performance.
• Optimize Spark workloads with partitioning, caching, and joins.
• Implement automated testing, data quality checks, monitoring, and logging.

Skills

Cloud Technology

Databricks Lakeflow

Databricks Platform

Databricks Unity Catalog

Data Lake

Education

Bachelor’s degree in computer science, software engineering, data engineering, or a related technical field

Job description

GD Information Technology, Inc. seeks a Databricks Engineer to design, build, and operate scalable data solutions for secure, mission-focused analytics. You will develop pipelines, notebooks, jobs, and data workflows in Databricks to support researchers and analysts working with sensitive datasets.

The role blends data engineering, cloud technology, and analytics with emphasis on data quality, security, and reliability. Strong experience with PySpark, SQL, Delta Lake, and Databricks is required.