Databricks Engineer

Techstra Solutions LLC; Pittsburgh (Allegheny County); On-site; USD 70,000 - 100,000; Full time

Benefits offered by this job

Relocation assistance

Job summary

Techstra Solutions LLC in Pittsburgh seeks a Junior Databricks Engineer to design, build, and optimize data pipelines on the Databricks Lakehouse Platform. You will work alongside senior engineers to deliver enterprise-scale data projects and gain hands-on experience under mentorship.

This role targets recent master's graduates who are eager to learn, solve technical challenges, and contribute to cross-functional teams including data analysts and AI engineers.

Qualifications

• Master's degree required or equivalent in a related technical field.
• Strong understanding of data engineering concepts and relational databases.
• Experience with Python and SQL through projects or internships.
• Familiarity with Apache Spark fundamentals.
• Knowledge of Databricks or cloud-based analytics platforms.

Responsibilities

• Develop and maintain data pipelines using Databricks and Spark.
• Assist in building scalable ETL/ELT processes from multiple sources.
• Collaborate with senior engineers to design Lakehouse solutions following best practices.
• Write PySpark and SQL code to process large datasets.
• Support data validation, testing, and data quality assurance.
• Contribute to CI/CD processes and deployment automation.
• Participate in Agile ceremonies and document data flows.

Skills

Python

SQL

Apache Spark

Git

Analytical thinking

Collaboration

Problem solving

Education

Master's degree in Computer Science, Data Engineering, Data Science, Information Systems, or related

Tools

Databricks

Azure/AWS/GCP

CI/CD

Job description

Role Overview

We are seeking a Junior Databricks Engineer to join our team. This role is ideal for a recent master's graduate who is passionate about big data, cloud technologies, and modern data platforms. The successful candidate will work alongside a senior data staff to design, build, and optimize data pipelines and analytics solutions using the Databricks Lakehouse Platform. We're looking for someone who is eager to learn, enjoys solving technical challenges, and thrives in a collaborative, team-oriented environment. This is an excellent opportunity to gain hands-on experience with enterprise-scale data engineering projects while being mentored by experienced professionals.

Key Responsibilities

• Develop and maintain data pipelines using Databricks and Apache Spark.
• Assist in building scalable ETL/ELT processes to ingest, transform, and curate data from multiple sources.
• Collaborate with senior engineers to design and implement Lakehouse solutions following Medallion Architecture best practices.
• Write efficient PySpark and SQL code to process large datasets.
• Support data validation, testing, and troubleshooting to ensure data quality and reliability.
• Participate in performance tuning and optimization of Databricks workloads.
• Assist with implementing data governance, security, and access controls.
• Work closely with data analysts, AI engineers, and business stakeholders to understand data requirements.
• Contribute to CI/CD processes, source code management, and deployment automation.
• Participate in Agile ceremonies including sprint planning, daily standups, retrospectives, and code reviews.
• Document technical designs, data flows, and implementation standards.

Required Qualifications

• Master's degree in Computer Science, Data Engineering, Data Science, Information Systems, or a related technical discipline.
• Strong understanding of data engineering concepts and relational databases.
• Experience with Python and SQL through academic projects, internships, or personal work.
• Knowledge of Apache Spark fundamentals.
• Familiarity with Databricks or cloud-based analytics platforms.
• Understanding of data modeling and ETL/ELT processes.
• Knowledge of Git and version control best practices.
• Strong analytical, problem-solving, and debugging skills.
• Excellent communication and collaboration abilities.

Preferred Qualifications

• Hands-on experience with Databricks through coursework, internships, certifications, or personal projects.
• Experience with Microsoft Azure, AWS, or Google Cloud Platform.
• Familiarity with Delta Lake and Medallion Architecture.
• Knowledge of Azure Data Factory, Microsoft Fabric, or similar data integration tools.
• Exposure to data warehousing concepts and dimensional modeling.
• Experience with Power BI or Tableau.
• Databricks certifications are a plus.
• Understanding of data governance and data quality principles.
• Passionate about modern data engineering technologies.
• Eager to learn from experienced engineers and continuously improve technical skills.
• Strong team player who enjoys collaborating across technical and business teams.
• Curious mindset with a willingness to explore new tools and technologies.
• Highly organized with strong attention to detail.
• Self-motivated, adaptable, and receptive to feedback.
• Committed to delivering high-quality, scalable solutions.

Location

Pittsburgh, PA (relocation assistance is offered)

About Techstra Solutions

Techstra Solutions is a certified woman-owned (WBENC) management consulting firm specializing in strategy, technology, and implementation services for large organizations undergoing digital and talent transformation. Our experienced team partners with clients to co-create innovative solutions in applications, data, AI, and automation that accelerate measurable, sustainable change. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results. For more information: www.techstrasolutions.com

Equal Employment Opportunity Statement

Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics.

This position is onsite 5 days a week.