Sr. Data Engineer

Connsci; Gaithersburg (MD); On-site; USD 120,000 - 180,000; Full time

Job summary

Connsci seeks a Senior Data Engineer to own the cloud-based data anomaly detection app for a government customer. You will architect, lead and deliver on Databricks Medallion architecture, Power BI dashboards, and Azure Gov hosting, while providing hands-on expertise across data engineering, analytics and reporting.

You will design secure data pipelines, manage storage in ADLS Gen2, and mentor staff, ensuring technical quality and alignment with project milestones and contractual deliverables.

Qualifications

• Bachelor's degree in IT, CS, Engineering or related field or equivalent experience.
• 10+ years in software/data engineering or BI, with 5+ years building web-based apps.
• 5+ years designing, building, deploying web apps.
• 5+ years managing software dev projects with schedules and milestones.
• 5+ years Power BI, ETL/ELT, data modeling, dashboards, and secure cloud environments.
• 2+ years Databricks Medallion (Bronze, Silver, Gold).
• 3+ years data modeling and transformation with SQL and PySpark.

Responsibilities

• Design and maintain secure data ingestion pipelines using Azure Data Factory, API Management, and SFTP.
• Develop and implement the data anomaly detection system on Azure Gov. Cloud with Databricks Medallion architecture and Power BI reports.
• Create reports and documentation, mentor staff, resolve blockers, ensure quality across Databricks, Power BI, and hosted components.
• Analyze source data from multiple systems with varying schemas.
• Develop and process data ingestion, rationalization, and analytics for anomaly detection.
• Manage data storage in Azure Data Lake Gen2 with integrity controls (immutability, hashing, lineage).
• Optimize pipelines for performance, scale, and cost across DEV/TEST/POC/PROD.

Skills

SDLC

System architecture

Data integration

Project leadership

Power BI

Databricks Medallion

PySpark

SQL

Education

Bachelor's degree

Tools

Azure Data Factory

Databricks

Power BI

Azure

SFTP

Job description

Connsci is seeking a Senior Data Engineer to join our growing organization in support of one of our government customers. This individual will own the development and delivery of a cloud-based data anomaly detection application. This role will set up a hosted infrastructure and will architect, lead and manage development activities according to a formal project schedule and deliverables plan, while providing hands-on technical support and leadership across data engineering, software development, analytics, anomaly detection, reporting, and system delivery. The solution is built on the Databricks Medallion architecture, with complex business-rule logic used to identify, organize, and present anomalies in the data set through Power BI and related dashboard capabilities in an Azure Government virtual environment.

Key Responsibilities

• Design and maintain secure data ingestion pipelines using Azure Data Factory, API Management, and SFTP
• Development and implementation of the data anomaly detection system, which will be hosted on Azure Gov. Cloud and based on Databricks Medallion architecture, Power BI reporting, and related application components.
• Create reports and technical documentation, mentor staff, resolve blockers, and ensure technical quality across Databricks, Power BI, and hosted web application components.
• Analyze source data from multiple systems with varying schemas.
• Develop and process data ingestion, rationalization, and analytic programming to support accurate anomaly detection.
• Manage data storage in Azure Data Lake Storage Gen2 (bronze/silver/gold architecture) with evidentiary controls (immutability, hashing, lineage).
• Optimize pipelines for performance, scalability, and cost efficiency across DEV, TEST, POC, PROD environments.
• Support development of business-rule logic used to classify, flag, summarize, and display anomalies in the hosted dashboard application.
• Maintain system security in compliance with NIST 800-53, 800-171, and related standards.
• Maintain technical work plans aligned to project milestones, contract deliverables, customer priorities, and formal schedule requirements.
• Maintain development, documentation, and functional quality standards.
• Track, communicate, and report on technical status, risks, dependencies, and schedule compliance to project leadership and customer stakeholders.

Our Ideal Candidate Will Have

• Strong understanding of the software development lifecycle (SDLC), system architecture, application integration, and associated documentation requirements.
• Experience working with imperfect, inconsistent, incomplete, or high-volume datasets.
• Excellent written and verbal technical and professional communication skills.
• Strong leadership, organizational, planning, scheduling, documentation, and problem-solving abilities.

Required Qualifications

• Bachelor's degree in IT, Computer Science, Engineering, or related field; or an equivalent combination of education and experience.
• At least 10 years of experience in software engineering, data engineering, or business intelligence.
• At least 5 years of experience designing, building, and deploying web-based applications.
• At least 5 years of experience managing software development projects with formal schedules, milestones, and phased customer deliverables.
• At least 5 years of experience with Power BI, ETL/ELT development, data modeling, dashboard and reporting solutions, and secure cloud environments.
• At least 2 years of experience with Databricks Medallion architecture (Bronze, Silver, Gold).
• At least 3 years of experience with data modeling and transformation using SQL and PySpark.

Preferred Qualifications

• Prior experience supporting government, inspector general, audit, investigation, complaint, or other regulated case-management environments.
• Experience with Azure Government
• Relevant Microsoft Azure and Databrick certifications.
• Experience designing high-reliability intake solutions where incoming records must be traceable, recoverable, auditable, and processed without manual intervention.

About Connsci

At Connsci, our mission is to be a trusted strategic partner for our clients, helping them achieve impactful results by addressing mission-critical issues that affect their bottom line. We recognize the importance of customizing our services to best fit our clients' needs and understanding what it takes to propel their organizations forward. By implementing industry-leading best practices and leveraging our multifaceted experience and expertise, we deliver services that are essential for any organization aiming to reach its goals.

What You Can Expect:

• Collaboration and Innovation: Work in an environment where collaboration and innovation are key. You'll have the opportunity to contribute to projects that make a real difference for our clients.
• Professional Growth: Be part of a team that values professional development. We offer opportunities for growth and advancement, allowing you to enhance your skills and career.
• Impactful Work: Engage in meaningful work that addresses mission-critical issues and supports organizations in achieving their goals.

By joining Connsci, you'll become part of a dedicated team that is committed to delivering strategic, impactful solutions tailored to our clients' unique needs, enabling them to achieve their goals with confidence and efficiency. If you're passionate about cybersecurity and IT services, and eager to contribute to a dynamic team, we encourage you to explore opportunities with us.

At this time, Connsci will not sponsor a new applicant for employment authorization for this position.

Connsci is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.

This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. Connsci makes hiring decisions based solely on qualifications, merit, and business needs at the time.