Senior Data Engineer — Scalable Data Lakehouse & Pipelines

Vericast

San Antonio (TX)

On-site

USD 130,000 - 150,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical Insurance
Dental Insurance
Vision Coverage
401K
Paid Time Off

Job summary

Vericast is seeking a Senior Data Engineer to build big data pipelines, automate marketing campaigns, and support data requirements for our analytics, reporting, and AI applications. This role will expand our data infrastructure and pipeline architecture while optimizing data flow into our Data Lake environment.

The Senior Data Engineer will work closely with analytics, reporting, and data science teams on data initiatives, ensuring a consistent, optimal data delivery architecture across ongoing

Qualifications

  • 5+ years in Data Engineering or related field.
  • Experience with FI/Banking or marketing data ecosystems ideal.
  • Proficient in Python and PySpark for production pipelines.
  • Experience with Data Lakehouse architectures and data pipelines.

Responsibilities

  • Develop scalable data pipelines and integrations for growth in data volume.
  • Build a Data Lakehouse to support marketing solutions and clients.
  • Collaborate with AI/Analytics teams to improve data models for AI tools.
  • Monitor data quality and ensure production data availability.
  • Troubleshoot data-related issues and provide post-deployment support.
  • Partner with teams to shape long-term data platform architecture.

Skills

Python
PySpark
Data pipelines
Data quality
Airflow
Distributed systems
REST APIs
Linux/Unix

Education

Bachelor's degree in CS/IT or related field
Master's degree preferred

Tools

Airflow
Iceberg
Hive
S3
Trino
AWS/GCP/Azure
GitLab/ CI/CD
Kubernetes
Ranger
Data Lakehouse

Job description

Vericast is seeking a Senior Data Engineer to build big data pipelines, automate marketing campaigns, and support data requirements for our analytics, reporting, and AI applications. This role will expand our data infrastructure and pipeline architecture while optimizing data flow into our Data Lake environment.

The Senior Data Engineer will work closely with analytics, reporting, and data science teams on data initiatives, ensuring a consistent, optimal data delivery architecture across ongoing

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: Data Lakehouse & AI Pipelines
Senior Data Engineer: Data Lakehouse & AI Pipelines

Vericast • United States

Remote
USD 130,000 - 150,000
Medical, dental & vision coverage
401K with match
Paid time off
Senior Data Engineer — Scalable AI Data Pipelines
Senior Data Engineer — Scalable AI Data Pipelines

Castalia Systems • United States

On-site
USD 15,000,000 - 16,000,000
Medical insurance
Dental coverage
Vision coverage
+4
Senior Data Engineer: Scale Pipelines & Lakehouse Leadership
Senior Data Engineer: Scale Pipelines & Lakehouse Leadership

Survey Sampling International Hyderabad Private Ltd. (India) • Westport (CT)

On-site
USD 130,000 - 150,000
Medical benefits
Discretionary incentive program
Senior Data Engineer: Scale Data Pipelines & Quality
Senior Data Engineer: Scale Data Pipelines & Quality

Veriipro • Center Square (PA)

On-site
USD 120,000 - 160,000
Senior Data Architect & Engineer - Lakehouse & AI Pipelines
Senior Data Architect & Engineer - Lakehouse & AI Pipelines

Enexus Global Inc. • Cary (NC)

On-site
USD 120,000 - 180,000
Data Engineer: Build Scalable Lakehouse Pipelines
Data Engineer: Build Scalable Lakehouse Pipelines

InfoVision Inc. • Detroit (MI)

On-site
USD 105,000 - 155,000
Senior Data Engineer - Scalable AI/Data Pipelines
Senior Data Engineer - Scalable AI/Data Pipelines

Castalia Systems • Arlington (VA)

On-site
USD 150,000 - 160,000
Medical, dental, vision coverage
401k matching
Generous PTO
+3
Senior Data Engineer - Scalable Cloud Data Platforms
Senior Data Engineer - Scalable Cloud Data Platforms

Cast & Crew • United States

Remote
USD 135,000 - 165,000
Medical
Dental
Vision
+3
Senior Data Engineer - Lead Scalable Data Pipelines
Senior Data Engineer - Lead Scalable Data Pipelines

Audacy, Inc. • Philadelphia

On-site
USD 120,000 - 180,000
Senior Data Engineer: Scalable Pipelines & Lakehouse
Senior Data Engineer: Scalable Pipelines & Lakehouse

Total Wine & More • Bethesda (MD)

On-site
USD 130,000 - 170,000
Paid Time Off (PTO)
Health care plans
401(k)
+3