Data Archival lead

TechDigital Group; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

TechDigital Group is seeking experienced Data Archival professionals to lead the design and implementation of an enterprise-grade archival solution on Platform 3 (Archon). The role spans source-system discovery, retention-rule design, ETL build, archival execution, validation, and handover across Production and Non-Production environments.

You will deliver Warm and Cold archival tiers (with de-identification), aligning with security and compliance standards, and enable retrieval via Archon UI,

Qualifications

• Extensive experience with enterprise data archival and ETL design.
• Ability to translate retention policies into archival rules and de-identification strategies.
• Experience leading end-to-end archival program delivery across production environments.
• Preference for hands-on Archon Platform 3 experience or related archival tooling.

Responsibilities

• Define end-to-end archival architecture on Archon Platform 3 (ADS, ETL, Analyzer).
• Lead Platform 3 setup across Production and Non-Production, including DR/HA.
• Design and build archival ETL pipelines (extraction, transformation, indexing, load).
• Drive source-system connectivity, schema discovery, and dependency mapping.
• Oversee data validation, volumetric verification, and sign-off for archival scope.
• Develop monitoring dashboards and operational reports for archival jobs.

Skills

SQL expertise

ETL design

Data architecture

Regulatory compliance

Problem solving

Tools

Archon Platform 3

Archon ETL

Archon Analyzer

MuleSoft

Trino

Spark

REST APIs

Mainframe/AS400

Job description

Role Overview

We are seeking experienced Data Archival professionals to lead the design and implementation of an enterprise-grade archival solution on Platform 3 (Archon). Product-specific training on Archon will be provided; the role demands strong foundations in enterprise data archival, ETL design, and data-platform architecture. Scope spans end-to-end delivery — from source-system discovery and retention-rule design, through platform setup, ETL build, archival execution, validation, and operational handover. Candidates will work across Production and Non-Production environments, deliver Warm and Cold archival tiers (with de-identification), and align the solution to enterprise security and compliance standards.

Key Responsibilities

Solution Architecture & Design

• Define end-to-end archival architecture on Platform 3 (Archon), including Archon Data Store (ADS), Archon ETL, and Archon Analyzer components.


• Design Warm Archive, Cold Archive (de-identified), and Data Bunker tiers in line with retention, legal-hold, and WORM compliance requirements.


• Translate business retention, privacy, and regulatory policies into archival rules, data classification, tier-mapping logic, and de-identification/tokenization strategies.


• Produce reference architecture, data flow, integration, and security design artifacts aligned to the customer’s System Security Plan (SSP).


• Define retrieval patterns – predefined SQL/reports via the Archon UI, distributed query (Trino/Spark) and API-based access where required.

Implementation & Delivery

• Lead Platform 3 (Archon) setup and configuration across Production and Non-Production environments, including DR (and HA where in scope).


• Design and oversee build of archival ETL pipelines using Archon native ETL – extraction, transformation, indexing, and load into ADS.


• Drive source-system connectivity, schema discovery, and dependency mapping using Archon Analyzer.


• Own pilot execution on a defined data subset, then scale-up to full archival of in-scope source systems.


• Lead data validation, reconciliation, volumetric verification, and source-system archival sign-off.

Performance, Monitoring & Issue Resolution

• Develop monitoring dashboards and operational reports for archival jobs, ETL pipelines, and storage tiers.


• Troubleshoot and resolve issues across Archon ETL pipelines, archival workflows, source-system connectivity, and retrieval performance.


• Define SLAs, alerting thresholds, and run-book remediation steps for common failure modes; drive root-cause analysis for Sev1/Sev2 issues.

Governance, Compliance & Stakeholder Management

• Ensure archival design meets regulatory, audit, and information-governance requirements applicable to the customer’s industry.


• Partner with customer Architecture, Security, Compliance, Database Administrators (DBAs), application owners, IT infrastructure teams, and SMEs; represent delivery in design and architecture reviews.


• Define monitoring, runbooks, documentation, and knowledge-transfer artifacts; support warranty and operational handover.


• Provide technical guidance and structured training to stakeholders – DBAs, application owners, operations, and business users – on archival processes, retrieval workflows, and post-archival access patterns.


• Identify and manage technical risks; drive Change Control where scope or assumptions shift.

Required Technical Skills

Note: Platform 3 (Archon) product training will be provided. Prior Archon experience is desirable but not mandatory; strong fundamentals in data archival, ETL, and lakehouse / data-platform architecture are essential.

Data, Cloud & Integration

• Strong SQL and relational database expertise – DB2, Oracle, SQL Server (and ideally mainframe / AS-400 data sources).


• Solid grounding in data warehousing, data lakehouse, and ELT/ETL design patterns; familiarity with Parquet/ORC, Iceberg/Delta, and metadata-driven ingestion.


• Experience with Azure cloud storage (Blob, ADLS Gen2) for archival workloads – tiering, lifecycle policies, and cost optimization; AWS S3 exposure is a plus.


• Working knowledge of authentication / authorization patterns (SSO, SAML/OIDC), encryption in transit and at rest (AES-256, KMS), and secure credential handling.


• Comfort with REST APIs, file-based and CDC-based extraction patterns, and integration with downstream consumers (e.g., MuleSoft, iPaaS).

Governance, Compliance & Security

• Strong understanding of data retention, legal hold, audit trails, and information lifecycle management.


• Working knowledge of regulatory frameworks relevant to archival – GLBA, SOX, HIPAA, GDPR, NAIC Model Regulation #672, state record-retention requirements, and PII/PHI handling.


• Experience implementing WORM compliance, chain-of-custody controls, and role-based access for archived data.

Prior Archival / Decommissioning Implementation Experience

Candidates must be able to demonstrate hands‑on delivery on at least one – preferably multiple – prior archival or application decommissioning programs. Specifically:

• End-to-end delivery of one or more enterprise archival / decommissioning programs (preferably 2+ for Senior Architect).


• Experience archiving from at least two of the following source-system families: mainframe (AS/400, COBOL/DB2, VSAM), legacy ERP (SAP ECC, PeopleSoft, JD Edwards, Siebel, Lotus Notes), legacy policy administration / closed-block insurance systems, healthcare EHR, custom RDBMS-based applications.


• Demonstrable volume handled – ideally TB-scale archival, with clear evidence of volumetric estimation, throughput tuning, and reconciliation.


• Prior use of one or more archival tools – Archon / Platform 3 (strongly preferred), Informatica ILM, OpenText InfoArchive, Solix EDMS, Archive360, IBM Optim, or equivalent. Cross-tool experience (e.g., migrating off legacy archival tools onto Archon) is a strong plus.


• Experience defining and operationalising retention rule sets, legal‑hold workflows, and de‑identification rules in production.


• Track record of successful pilot-to-scale transitions, including go/no‑go criteria, defect triage, and sign‑off governance.


• Exposure to post‑archival application retirement / decommissioning sequencing – including infrastructure shutdown, license recovery, and audit closure.

Soft Skills

• Strong written and verbal communication – able to author design documents, runbooks, and present to customer architecture forums.


• Stakeholder management across business, application, security, and compliance teams.


• Structured problem‑solving with the ability to operate independently in ambiguous, multi‑stakeholder environments.

Preferred Qualifications

• Hands‑on or familiarity with Platform 3 (Archon) components – Archon Data Store (ADS) lakehouse, Archon native ETL, Archon Analyzer (source‑system discovery), Archon Data Bunker (air‑gapped isolation, tokenization), and Archon UI / Trino‑Spark‑based retrieval.


• Insurance domain experience, preferably Life & Annuity (L&A) and closed‑block administration.


• Exposure to modern Life & Annuity policy administration platforms (e.g., Verisk FAST, Oracle OIPA, LifePRO) as archival source systems.


• Certification in Archon, Informatica ILM, or equivalent archival / ETL tooling.


• Exposure to Gartner‑recognised archival platforms and broader information‑governance tooling (Collibra, Alation) is a plus.