Databricks Data Engineer - Lakehouse & Cloud Pioneer

Big Impact Tech (BIT); Washington, Baltimore (District of Columbia, MD); Hybrid; USD 120,000 - 160,000; Full time

Job summary

Big Impact Tech (BIT) is seeking a Data Engineer with strong Databricks expertise to support Coast Guard data modernization and analytics initiatives. You will design, develop, and maintain scalable data pipelines, lakehouse solutions, and cloud platforms enabling secure data integration and analytics.

The role collaborates with data architects, analysts, and stakeholders to ensure reliable, high-performing data solutions and implements CI/CD for data engineering.

Qualifications

• Bachelor’s degree in CS, IS, Engineering, Data Science or related field.
• 5+ years of experience in Data Engineering.
• 3+ years of hands-on experience with Databricks.
• Strong experience with PySpark, Spark SQL, and SQL.
• Experience building large-scale data pipelines and ETL/ELT solutions.
• Experience with cloud platforms such as Azure, AWS, or Google Cloud.
• Strong understanding of data modeling, data warehousing, and Lakehouse architectures.
• Experience with relational and NoSQL databases.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and cloud-native tech.
• Build and optimize ETL/ELT processes for structured, semi-structured, and unstructured data.
• Develop and manage data ingestion from various source systems, APIs, databases, and files.
• Implement and maintain Delta Lake architecture and Lakehouse solutions.
• Develop PySpark, Spark SQL, and SQL-based transformations for large-scale data processing.
• Support data warehousing, data lakes, and enterprise analytics initiatives.
• Monitor and optimize data pipeline performance, reliability, and scalability.
• Ensure data quality, governance, lineage, and security across data platforms.
• Collaborate with stakeholders to deliver data solutions and implement CI/CD for data engineering.

Skills

Data engineering

ETL/ELT design

CI/CD practices

Data governance

Education

Bachelor’s degree in CS, IS, Engineering, Data Science or related

Tools

Databricks

PySpark

Spark SQL

SQL

Azure

AWS

Google Cloud

Delta Lake

Lakehouse

Databricks Workflows

Power BI

Job description

Big Impact Tech (BIT) is seeking a Data Engineer with strong Databricks expertise to support Coast Guard data modernization and analytics initiatives. You will design, develop, and maintain scalable data pipelines, lakehouse solutions, and cloud platforms enabling secure data integration and analytics.

The role collaborates with data architects, analysts, and stakeholders to ensure reliable, high-performing data solutions and implements CI/CD for data engineering.