Senior Data Engineer — Government BI & Data Pipelines

Contact Government Services, LLC; City of Albany (NY); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health, Dental, Vision

Life Insurance

401k

Flexible Spending Account

Paid Time Off

Job summary

Contact Government Services (CGS) in Albany, NY is seeking a Sr. Data Engineer to build and maintain advanced data pipelines, leveraging Python, SQL, and big data tools.

You will collaborate with cross-functional teams in a fast-paced government contracting environment to deliver reliable data solutions and insights. The role requires US citizenship, ability to obtain a Public Trust, and 7+ years in data design and pipeline development.

Qualifications

• Must be a US Citizen.
• Must be able to obtain a Public Trust Clearance.
• 7+ years of IT experience including design, management, and solutioning of large, complex data sets and models.
• Experience with developing data pipelines from many sources from structured and unstructured data sets in a variety of formats.
• Proficiency in developing ETL processes, and performing test and validation steps.
• Proficiency to manipulate data (Python, R, SQL, SAS).
• Strong knowledge of big data analysis and storage tools and technologies.
• Strong understanding of the agile principles and ability to apply them.
• Strong understanding of the CI/CD pipelines and ability to apply them.
• Experience with relational database, such as, PostgreSQL.
• Work comfortably in version control systems, such as, Git Repositories.

Responsibilities

• Complete development efforts across data pipeline to store, manage, store, and provision to data consumers.
• Being an active and collaborating member of an Agile/Scrum team and following all Agile/Scrum best practices.
• Write code to ensure the performance and reliability of data extraction and processing.
• Support continuous process automation for data ingest.
• Achieve technical excellence by advocating for and adhering to lean-agile engineering principles and practices such as API-first design, simple design, continuous integration, version control, and automated testing.
• Work with program management and engineers to implement and document complex and evolving requirements.
• Help cultivate an environment that promotes customer service excellence, innovation, collaboration, and teamwork.
• Collaborate with others as part of a cross-functional team that includes user experience researchers and designers, product managers, engineers, and other functional specialists.

Skills

Python

R

SQL

SAS

Big data

Agile

CI/CD

PostgreSQL

Git

Data modeling

Tools

PostgreSQL

Git

Job description

Contact Government Services (CGS) in Albany, NY is seeking a Sr. Data Engineer to build and maintain advanced data pipelines, leveraging Python, SQL, and big data tools.

You will collaborate with cross-functional teams in a fast-paced government contracting environment to deliver reliable data solutions and insights. The role requires US citizenship, ability to obtain a Public Trust, and 7+ years in data design and pipeline development.