Data Engineer (Active Secret Required)

Creative Global Consulting

United States

Presencial

USD 150.000 - 190.000

Jornada completa

hace 6 horas
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

Creative Global Consulting is seeking an experienced Data Engineer to design scalable database architectures and modern data platforms in a United States-based environment. The role emphasizes secure, compliant data models and event-driven architectures, with hands-on work in RedShift, AWS Glue, Spark/PySpark, and CDC using DMS.

You will collaborate with cross-functional teams, optimize ETL/ELT pipelines, and ensure robust data governance and metadata management across cloud-native services.

Formación

  • Active Top Secret clearance or TS eligibility with ability to complete adjudication/transfer requirements along with a Security Plus certification on day one.
  • 7+ years of experience designing, building, and supporting enterprise data engineering solutions and modern data platforms.
  • Strong expertise in relational databases (PostgreSQL, Oracle, SQL Server) and experience integrating semi-structured and NoSQL data sources (DynamoDB, JSON, APIs).
  • Extensive experience designing and implementing Medallion Architecture (Bronze, Silver, Gold) and dimensional data models for analytics and operational reporting.
  • Hands-on experience with RedShift
  • Hands-on experience developing scalable ETL/ELT pipelines using AWS Glue, Apache Spark/PySpark, SQL, and Python.
  • Experience implementing Change Data Capture (CDC) using AWS DMS to synchronize operational databases with analytical platforms such as RedShift.
  • Strong knowledge of cloud-native AWS data services, including Amazon S3, AWS Glue, Redshift, Lambda, EventBridge, SQS/SNS, IAM, CloudWatch, and Secrets Manager.
  • Experience designing metadata-driven ingestion frameworks, data lineage, and data quality validation processes.
  • Proficiency in data modeling, schema evolution, data versioning, and master/reference data management.
  • Strong understanding of event-driven architectures and application/database
  • Experience optimizing SQL, Spark jobs, partitioning strategies, indexing, and Redshift
  • Experience working within Agile/Scrum teams and collaborating with application developers, architects, and business stakeholders.

Responsabilidades

  • Design scalable, secure, and high-performance database architectures to support Mirador modernization
  • Define data models and storage strategies aligned with cloud migration goals
  • Optimize performance, availability, and disaster recovery across environments
  • Collaborate with IBM IVM team to identify data needs for use stories and update unified data model
  • Leverage data lake to capture functionality-specific data
  • Ensure compliance with data governance, security, and retention policies
  • Document database designs, configurations, and operational procedures
  • Active Top Secret (TS) clearance or TS eligibility with ability to complete adjudication/transfer requirements along with a Security Plus certification on day one.

Conocimientos

TS clearance
7+ years exp
RDBMS
NoSQL integration
Medallion Architecture
Dimensional data models
Analytics & reporting
Agile/Scrum
Data governance
Event-driven architecture
SQL optimization
Spark/PySpark

Herramientas

AWS Glue
Apache Spark
PySpark
SQL
Python
DynamoDB
Redshift
S3
IAM

Descripción del empleo

Under the general supervision, may include, but are not limited to, the following:

  • Design scalable, secure, and high-performance database architectures to support Mirador modernization
  • Define data models and storage strategies aligned with cloud migration goals
  • Optimize performance, availability, and disaster recovery across environments
  • Collaborate with IBM IVM team to identify data needs for use stories and update unified data model
  • Leverage data lake to capture functionality-specific data
  • Ensure compliance with data governance, security, and retention policies
  • Document database designs, configurations, and operational procedures
  • Active Top Secret (TS) clearance or TS eligibility with ability to complete adjudication/transfer requirements along with a Security Plus certification on day one.
  • 7+ years of experience designing, building, and supporting enterprise data engineering solutions and modern data platforms.
  • Strong expertise in relational databases (PostgreSQL, Oracle, SQL Server) and experience integrating semi-structured and NoSQL data sources (DynamoDB, JSON, APIs).
  • Extensive experience designing and implementing Medallion Architecture (Bronze, Silver, Gold) and dimensional data models for analytics and operational reporting.
  • Hands-on experience with RedShift
  • Hands-on experience developing scalable ETL/ELT pipelines using AWS Glue, Apache Spark/PySpark, SQL, and Python.
  • Experience implementing Change Data Capture (CDC) using AWS DMS to synchronize operational databases with analytical platforms such as RedShift.
  • Strong knowledge of cloud-native AWS data services, including Amazon S3, AWS Glue, Redshift, Lambda, EventBridge, SQS/SNS, IAM, CloudWatch, and Secrets Manager.
  • Experience designing metadata-driven ingestion frameworks, data lineage, and data quality validation processes.
  • Proficiency in data modeling, schema evolution, data versioning, and master/reference data management.
  • Strong understanding of event-driven architectures and application/database
  • Experience optimizing SQL, Spark jobs, partitioning strategies, indexing, and Redshift
  • Experience working within Agile/Scrum teams and collaborating with application developers, architects, and business stakeholders.
Required skills/Level of Experience
  • Active Top Secret (TS) clearance or TS eligibility with ability to complete adjudication/transfer requirements along with a Security Plus certification on day one.
  • 7+ years of experience designing, building, and supporting enterprise data engineering solutions and modern data platforms.
  • Strong expertise in relational databases (PostgreSQL, Oracle, SQL Server) and experience integrating semi-structured and NoSQL data sources (DynamoDB, JSON, APIs).
  • Extensive experience designing and implementing Medallion Architecture (Bronze, Silver, Gold) and dimensional data models for analytics and operational reporting.
  • Hands-on experience with RedShift
  • Hands-on experience developing scalable ETL/ELT pipelines using AWS Glue, Apache Spark/PySpark, SQL, and Python.
  • Experience implementing Change Data Capture (CDC) using AWS DMS to synchronize operational databases with analytical platforms such as RedShift.
  • Strong knowledge of cloud-native AWS data services, including Amazon S3, AWS Glue, Redshift, Lambda, EventBridge, SQS/SNS, IAM, CloudWatch, and Secrets Manager.
  • Experience designing metadata-driven ingestion frameworks, data lineage, and data quality validation processes.
  • Proficiency in data modeling, schema evolution, data versioning, and master/reference data management.
  • Strong understanding of event-driven architectures and application/database
  • Experience optimizing SQL, Spark jobs, partitioning strategies, indexing, and Redshift
  • Experience working within Agile/Scrum teams and collaborating with application developers, architects, and business stakeholders.
Nice to have skills:
  • AWS Certified Data Engineer – Associate or AWS Certified Solutions Architect.
  • Experience designing enterprise data lakes and lakehouse architectures.
  • Experience implementing enterprise metadata repositories and data catalogs.
  • Familiarity with data governance and integration platforms : Qlik and AWS Glue Data Catalog.
  • Experience supporting real-time and near-real-time data integration architectures.
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Data Engineer
Data Engineer

NewGen Technologies • EE. UU.

A distancia
USD 140.000 - 190.000
Data Engineer
Data Engineer

VTG Defense • McLean (VA)

Presencial
USD 100.000 - 130.000
Data Engineer Lead
Data Engineer Lead

VSE AVIATION INC (US) • Phoenix (AZ)

Presencial
USD 140.000 - 200.000
Data Engineer (USI8)
Data Engineer (USI8)

VSE Aviation • Florida

Presencial
USD 120.000 - 180.000
Data Engineer Lead
Data Engineer Lead

VSE AVIATION INC (US) • Florida

Presencial
USD 130.000 - 190.000
Data Engineer (USI8) (2400)
Data Engineer (USI8) (2400)

Kellstrom Aerospace • Augusta (KS)

Presencial
USD 120.000 - 160.000
Data Engineer
Data Engineer

The Value Maximizer • South Carolina

Presencial
USD 90.000 - 120.000
Data Engineer Lead (USI9)
Data Engineer Lead (USI9)

VSE Aviation • Phoenix (AZ)

Presencial
USD 140.000 - 210.000
Data Engineer
Data Engineer

Compunnel Inc. • Westlake (OH)

Presencial
USD 90.000 - 150.000
Data Engineer
Data Engineer

Compunnel Inc. • Boston (MA)

Presencial
USD 110.000 - 140.000