Databricks Data Engineer

OldRex Technologies; Washington (District of Columbia); Remote; USD 120,000 - 150,000; Full time

Job summary

OldRex Technologies is seeking a Data Engineer for a fully remote role. You will design, implement, and optimize data pipelines in Databricks, building scalable ETL/ELT processes and data models for enterprise data warehouses.

Collaborate with data analysts, developers, and government stakeholders to deliver robust solutions and ensure data quality and security. Responsibilities include modeling, warehousing, and supporting analytics across mission-critical operations, while adhering to federal

Qualifications

• Must be a US Citizen.
• Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical field.

Responsibilities

• Design, develop, and maintain scalable data pipelines and workflows within the Databricks environment.
• Build and optimize ETL/ELT processes to support ingestion, transformation, and delivery of structured and semi-structured data.
• Engineer data fusion solutions that correlate operational, geospatial, sensor, and enterprise data from multiple sources to create a unified operational data layer supporting situational awareness, analytics, and AI/ML use cases.
• Develop and maintain data models and enterprise data warehouse solutions to support reporting, analytics, and mission operations.
• Collaborate with cross-functional teams including data analysts, developers, and government stakeholders to gather requirements and deliver data solutions.
• Perform data validation, data quality checks, and troubleshooting to ensure integrity and reliability of datasets.
• Support data analytics initiatives by preparing datasets and enabling stakeholders to derive actionable insights.
• Maintain technical documentation for data pipelines, models, and workflows and support ongoing enhancements.
• Follow federal data security, governance, and privacy requirements aligned to U.S. Coast Guard systems and policies.

Skills

Python

SQL

Scala

ETL development

Data pipeline design

Data modeling

Cloud platforms (AWS/Azure/GCP)

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

Structured Streaming

Job description

This full-time role of Data Engineer is a remote position. The Data Engineer will design, implement, and optimize data pipelines and workflows within the Databricks environment, ensuring the efficient collection, transformation, and storage of data. Responsibilities include building robust ETL processes, developing and maintaining data models, and creating highly scalable and reliable data warehouses. The engineer will analyze and interpret large datasets, enabling stakeholders to make data driven decisions and support strategic initiatives across the organization.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and workflows within the Databricks environment
• Build and optimize ETL/ELT processes to support ingestion, transformation, and delivery of structured and semi-structured data
• Engineer data fusion solutions that correlate operational, geospatial, sensor, and enterprise data from multiple sources to create a unified operational data layer supporting situational awareness, analytics, and AI/ML use cases.
• Develop and maintain data models and enterprise data warehouse solutions to support reporting, analytics, and mission operations
• Collaborate with cross-functional teams including data analysts, developers, and government stakeholders to gather requirements and deliver data solutions
• Perform data validation, data quality checks, and troubleshooting to ensure integrity and reliability of datasets
• Support data analytics initiatives by preparing datasets and enabling stakeholders to derive actionable insights
• Maintain technical documentation for data pipelines, models, and workflows and support ongoing enhancements
• Follow federal data security, governance, and privacy requirements aligned to U.S. Coast Guard systems and policies

Job Requirements:

• Must be a US Citizen
• Must have one of the Certified Databricks certification
• Demonstrated experience designing and implementing data fusion solutions that integrate, correlate, and enrich data from multiple structured, semi-structured, streaming, geospatial, or sensor-based sources.
• Ability to obtain and maintain a Public Trust background investigation (minimum requirement)
• Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical field
• 2-5 years of experience in data engineering, ETL development, or data platform engineering
• Hands-on experience building production-grade ETL/ELT pipelines and scalable data workflows
• Experience with Databricks, Apache Spark, or similar distributed data processing frameworks
• Strong proficiency in Python, SQL, or Scala for data engineering and pipeline development
• Experience designing and maintaining data warehouse and lakehouse architectures
• Working knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform Preferred:
• Experience implementing Databricks medallion architecture (bronze/silver/gold)
• Familiarity with Delta Lake, Unity Catalog, or structured streaming within Databricks
• Experience working in Agile/Scrum development environments supporting federal IT programs
• Exposure to federal data security standards and compliance frameworks (e.g., FISMA, NIST)