Senior Data Engineer

Vericast

San Antonio (TX)

On-site

USD 130,000 - 150,000

Full time

3 days ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Coverage

401K

Paid Time Off

Job summary

Vericast is seeking a Senior Data Engineer to build big data pipelines, automate marketing campaigns, and support data requirements for our analytics, reporting, and AI applications. This role will expand our data infrastructure and pipeline architecture while optimizing data flow into our Data Lake environment.

The Senior Data Engineer will work closely with analytics, reporting, and data science teams on data initiatives, ensuring a consistent, optimal data delivery architecture across ongoing

Qualifications

5+ years in Data Engineering or related field.
Experience with FI/Banking or marketing data ecosystems ideal.
Proficient in Python and PySpark for production pipelines.
Experience with Data Lakehouse architectures and data pipelines.

Responsibilities

Develop scalable data pipelines and integrations for growth in data volume.
Build a Data Lakehouse to support marketing solutions and clients.
Collaborate with AI/Analytics teams to improve data models for AI tools.
Monitor data quality and ensure production data availability.
Troubleshoot data-related issues and provide post-deployment support.
Partner with teams to shape long-term data platform architecture.

Skills

Python

PySpark

Data pipelines

Data quality

Airflow

Distributed systems

REST APIs

Linux/Unix

Education

Bachelor's degree in CS/IT or related field

Master's degree preferred

Tools

Airflow

Iceberg

Hive

Trino

AWS/GCP/Azure

GitLab/ CI/CD

Kubernetes

Ranger

Data Lakehouse

Job description

Company Description

Vericast is the financial institution (FI) performance partner. We help banks and credit unions drive growth, improve efficiency, increase engagement and navigate change through the power of data, technology and people. Our advanced analytics, data-driven insights and integrated solution set enable better execution with agility, precision and scale. That’s why thousands of financial institutions look to Vericast and our 150 years of financial services expertise to help them achieve more.

Company Description

Job Description

Vericast is seeking a motivated Senior Data Engineer to build big data pipelines, automate marketing campaigns, and support data requirements for our analytics, reporting, and AI applications. This role will expand our data infrastructure and pipeline architecture while optimizing data flow and collection into our Data Lake environment.

The Senior Data Engineer will work closely with our analytics, reporting, and data science teams on data initiatives, ensuring that a consistent, optimal data delivery architecture is available throughout ongoing projects. The ideal candidate is self-directed and comfortable supporting the data needs of multiple teams, systems, and products.

This role is a great fit for someone who enjoys working in an agile team environment and contributing to high-quality, data-driven marketing products in close collaboration with developers and business partners.

Key Duties & Responsibilities

Develop scalable data pipelines and build new integrations to support continued growth in data volume and complexity.
Build a robust Data Lakehouse that supports Vericast's marketing solutions business and financial institution clients, including pre-sales, campaign execution, and campaign performance analysis and benchmarking.
Collaborate with AI, Analytics, and business teams to improve data models that feed AI and analytics tools, increasing data accessibility and fostering data-driven decision-making across the organization.
Implement processes and systems to monitor data quality and ensure the availability and accuracy of production data for key stakeholders and dependent business processes.
Perform data analysis to troubleshoot data-related issues and support their resolution.
Provide post-deployment support, responding quickly to resolve unexpected production issues.
Partner with business units and engineering teams to shape long-term data platform architecture strategy.

Qualifications

Education

Bachelor's degree in Computer Science, Information Technology, or a related field, with 5+ years of relevant experience; or
Master's degree in Computer Science, Information Technology, or a related field (preferred).

Experience

5+ years of experience in Data Engineering, ETL development, or Data Platform Engineering.
Experience working within a Financial Institution (FI), Banking, FinTech, MarTech, AdTech, Marketing Services, or Marketing Agency environment.
Experience supporting customer, campaign, audience, marketing performance, attribution, advertising, or transactional data at scale.
Strong experience with Python and PySpark for building production-grade data pipelines.
Experience designing, building, and supporting Data Lakehouse environments.
Experience working with Apache Airflow, Iceberg, Hive, S3, and Trino.
Experience with cloud platforms such as AWS, Azure, or GCP.
Experience with Agile software development methodologies.
Experience with GitLab and CI/CD processes.
Experience supporting AI and machine learning applications.
Understanding of machine learning models and the data requirements needed to support Data Science teams. Preferred
Experience building REST APIs. Preferred

Knowledge, Skills & Abilities

Strong programming skills in object-oriented/functional scripting languages such as Python and PySpark for building data pipelines, with experience in testing, logging, and ensuring data observability.
Experience with distributed systems and parallel data processing using big data tools such as Spark, PySpark, Hadoop, Kafka, and Hive.
Proficiency with relational databases.
Strong knowledge of Linux/Unix-based systems.
Strong experience with Iceberg, Hive, S3, and Trino.
Experience building data pipelines with orchestration tools such as Apache Airflow.
Hands‑on experience with Apache Ranger and Rancher/Kubernetes.
Excellent analytical, conceptual, and problem-solving skills.
Strong communication skills that promote cross-team collaboration.
Experience supporting data requirements for AI applications. (Preferred)
Understanding of machine learning models and algorithms, with the ability to interface with the Data Science team. (Preferred)
Experience building REST APIs. (Preferred)

Additional Information

Salary range: $130,000 - $150,000
The ultimate compensation offered for the position will depend upon several factors such as skill level, cost of living, experience, and responsibilities
Vericast offers a generous total rewards benefits package that includes medical, dental and vision coverage, 401K and generous PTO allowance. A wide variety of additional benefits like life insurance, employee assistance and pet insurance are also available, not to mention smart and friendly coworkers!

At Vericast, we don’t just accept differences - we celebrate them, we support them, and we thrive on them for the benefit of our employees, our clients, and our community.As an Equal Opportunity employer, Vericast considers applicants for all positions without regard to race, color, creed, religion, national origin or ancestry, sex, sexual orientation, gender identity, age, disability, genetic information, veteran status, or any other classifications protected by law. Applicants who have disabilities may request that accommodations be made in order to complete the selection process by contacting our Talent Acquisition team at talentacquisition@vericast.com. EEO is the law. To review your rights under Equal Employment Opportunity please visit: www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf

Get your free, confidential resume review.

or drag and drop your file here.