Data Integration Analyst: ETL, AI-ready Data & NLP

Softek International; Arlington (VA); On-site; USD 130,000 - 170,000; Full time

Job summary

Softek International is seeking a senior data engineer to design and manage databases, lead transformation and migration projects, and prepare AI-ready data in a cloud-based environment. The role involves implementing Databricks pipelines and AWS data services to enable scalable data processing and analytics.

The candidate should have strong SQL/Python skills, experience with PySpark, and familiarity with NLP/LLM techniques for metadata tagging and data quality frameworks.

Qualifications

• 7+ years of relevant experience.
• Experience in database design and management of database transformation and/or migration projects for software applications.

Responsibilities

• Prepare AI-ready data: feature engineering, labeled training datasets, and semantic embeddings.
• Apply NLP/LLM techniques for automated metadata tagging, classification, and entity/relationship extraction.

Skills

SQL

Python

PySpark

ETL/ELT

NLP/LLM

Tools

Databricks

Delta Lake

Delta Live Tables

Unity Catalog

Workflows

Structured Streaming

SQL Warehouses

AWS S3

AWS Glue

AWS Lambda

PostgreSQL

Aurora

DynamoDB

Job description

Softek International is seeking a senior data engineer to design and manage databases, lead transformation and migration projects, and prepare AI-ready data in a cloud-based environment. The role involves implementing Databricks pipelines and AWS data services to enable scalable data processing and analytics.

The candidate should have strong SQL/Python skills, experience with PySpark, and familiarity with NLP/LLM techniques for metadata tagging and data quality frameworks.