Data Engineer: Scalable Pipelines for Analytics

JobCubby; Washington, Northern (District of Columbia, KY); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Business Technology Integrators (BTI) seeks a Data Engineer to design, build, and maintain scalable data pipelines and architectures for large datasets. You will work closely with data scientists and analysts to provide reliable data for analytics and reporting.

The role emphasizes data integration, governance, and security, with collaboration across cross-functional teams to understand data needs and optimize performance in a federal government context.

Qualifications

• 4+ years of data engineering experience with ETL and data warehousing.
• Proficiency in Python, Java, or Scala and SQL.
• Experience with data governance and data privacy standards.
• Experience with cloud platforms (AWS, Azure, GCP).
• Knowledge of databases and data modeling techniques.

Responsibilities

• Design, construct, and maintain scalable data pipelines.
• Collaborate with data scientists and analysts for accessible data.
• Ensure data quality and optimize database performance.
• Implement data governance strategies and stay current with industry trends.
• Support cross-functional teams on data needs.

Skills

Python

Java

Scala

SQL

Data warehousing

Communication with stakeholders

Education

Bachelor's degree in CS or related field

Tools

AWS

Azure

Google Cloud

Oracle

SQL Server

PostgreSQL

NoSQL databases

Job description

Business Technology Integrators (BTI) seeks a Data Engineer to design, build, and maintain scalable data pipelines and architectures for large datasets. You will work closely with data scientists and analysts to provide reliable data for analytics and reporting.

The role emphasizes data integration, governance, and security, with collaboration across cross-functional teams to understand data needs and optimize performance in a federal government context.