Senior Data Engineer

Wissen Technology; Alpharetta (GA); Híbrido; USD 140 000 - 200 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Remote work stipend

Immigration support

Paid time off

Resumo da oferta

Wissen Technology is seeking a Senior Data Engineer (AVP/VP level) to join our expanding team in the USA with a hybrid work model. The role requires 8–12 years of enterprise data engineering experience and a strong background in Python, SQL, Spark, and cloud data pipelines within financial services.

Responsibilities include designing scalable data pipelines, building Python data components, and ensuring data governance and regulatory compliance.

Qualificações

• 8–12 years of Data Engineering experience in enterprise environments.

Responsabilidades

• Design, build, and maintain scalable data pipelines for ingestion, transformation, and processing of structured and unstructured data.
• Develop Python applications and data engineering components for automation, ETL, and analytics workflows.
• Architect and optimize data models, schemas, and database structures for performance and compliance.
• Work with distributed data technologies such as Spark, Kafka, Hadoop, Databricks.
• Implement data quality frameworks, validation rules, and monitoring dashboards.
• Collaborate with business, analytics, and engineering teams to translate banking requirements into technical solutions.
• Ensure governance, security, and regulatory standards compliance (SOX, PCI, Basel, AML/KYC).
• Troubleshoot production issues and drive remediation.
• Build CI/CD pipelines and contribute to DevOps for data deployments.
• Document data flows and architecture diagrams.

Conhecimentos

Python

SQL

Spark

Airflow

Cloud platforms

CI/CD

Docker/Kubernetes

NoSQL

Formação académica

Bachelor's or higher in CS/Engineering

Ferramentas

Databricks

Hadoop

Kafka

Descrição da oferta de emprego

The Wissen team continues to expand its footprint in the USA, Canada, UK, Australia, and India. More openings to come as we continue to grow the team!

Please read below for a brilliant career opportunity.

Title: AVP/VP

Mode of Work: 3 days/week onsite required

Required Experience: 8-12 years

Role Overview

We are seeking a Senior Data Engineer with 8–12 years of experience designing, building, and optimizing large‑scale data platforms within enterprise environments. The ideal candidate brings strong expertise in distributed data processing, Python engineering, database optimization, and cloud‑based data pipelines, along with hands‑on experience working in banking or financial services.

This role requires deep technical proficiency, strong problem‑solving skills, and the ability to collaborate with cross‑functional teams to deliver secure, scalable, and high‑performance data solutions.

Key Responsibilities

• Design, build, and maintain scalable data pipelines for ingestion, transformation, and processing of structured and unstructured data.
• Develop high‑quality Python applications and data engineering components for automation, ETL, and analytics workflows.
• Architect and optimize data models, schemas, and database structures for performance, reliability, and regulatory compliance.
• Work with distributed data technologies such as Spark, Kafka, Hadoop, Databricks, or equivalent platforms.
• Implement data quality frameworks, validation rules, reconciliation logic, and monitoring dashboards.
• Collaborate with business, analytics, and engineering teams to translate banking requirements into technical solutions.
• Ensure compliance with data governance, security, and regulatory standards (e.g., SOX, PCI, Basel, AML/KYC data flows).
• Troubleshoot production issues, perform root‑cause analysis, and drive long‑term remediation.
• Build CI/CD pipelines and contribute to DevOps practices for data engineering deployments.
• Document data flows, architecture diagrams, and operational runbooks.

Required Skills & Experience

• 8–12 years of experience in Data Engineering within enterprise environments.
• Strong programming skills in Python (Pandas, PySpark, FastAPI preferred).
• Hands‑on experience with SQL and relational databases (PostgreSQL, Oracle, SQL Server, MySQL).
• Experience with distributed data processing frameworks: Spark, Hadoop, Hive, Kafka.
• Strong understanding of ETL/ELT pipelines, data ingestion patterns, and workflow orchestration (Airflow, Prefect, etc.).
• Experience with cloud platforms (AWS, Azure, or GCP) — S3, Glue, EMR, Databricks, Synapse, BigQuery, etc.
• Familiarity with data governance, metadata management, and regulatory requirements in banking.
• Experience working with CI/CD pipelines, Git, Jenkins, Azure DevOps, or similar tools.
• Ability to analyze complex datasets and translate business requirements into scalable engineering solutions.
• Experience with NoSQL databases (MongoDB, Cassandra, Redis).
• Exposure to machine learning pipelines or feature engineering.
• Knowledge of containerization (Docker, Kubernetes).
• Experience with real‑time streaming and event‑driven architectures.
• Healthcare insurance for you and your family (medical, dental, vision).
• Short / Long term disability insurance.
• Life Insurance.
• Accidental death & disability Insurance.
• 3 weeks of Paid Time Off.
• Support and fee coverage for immigration needs.
• Remote office set up stipend.
• Support for industry certifications.
• Additional cash incentives.
• Re‑skilling opportunities to transition between technologies.

Schedule: Monday to Friday

Work Mode: Hybrid

Job Type: Full-time

We are: A high end technical consulting firm built and run by highly qualified technologists. Our workforce consists of 5000+ highly skilled professionals, with leadership from Wharton, MIT, IITs, IIMs, and NITs and decades of experience at Goldman Sachs, Morgan Stanley, MSCI, Deutsche Bank, Credit Suisse, Verizon, British Telecom, ISRO etc. Without any external funding or investments, Wissen Technology has grown its revenues by 100% every other year since it started as a subsidiary of Wissen Group in 2015. We have a global presence with offices in the US, India, UK, Australia, Mexico, and Canada.

You are: A true tech or domain ninja. Or both. Comfortable working in a quickly growing profitable startup, have a “can do” attitude and are willing to take on any task thrown your way.

You will:

• Develop and promote the company’s culture of engineering excellence.
• Define, develop and deliver solutions at a top tier investment bank or another esteemed client.
• Perform other duties as needed

Your Education and Experience:

• We value candidates who can execute on our vision and help us build an industry-leading organization.
• Graduate-level degree in computer science, engineering, or related technical field
• Wissen embraces diversity and is an equal opportunity employer. We are committed to building a team that represents a variety of backgrounds, skills, and abilities. We believe that the more inclusive our team is, the better our work will be. All qualified applicants, including but not limited to LGBTQ+, Minorities, Females, the Disabled, and Veterans, are encouraged to apply.

The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for diverse industries, including Banking, E-commerce, Telecom, Healthcare, Manufacturing, and Energy. We help clients build world-class products. We have offices in the US, India (Bangalore, Hyderabad, Chennai, Gurugram, Mumbai, Pune), UK, Australia, Mexico, Vietnam, and Canada.

We empower businesses with a dynamic portfolio of services and accelerators tailored to today’s digital demands and based on future ready technology stack. Our services include Industry Leading Custom Software Development, AI-Driven Software Engineering, Generative AI & Machine Learning, Real-Time Data Analytics & Insights, Interactive Data Visualization & Decision Intelligence, Intelligent Process Automation, Multi-Cloud & Hybrid Cloud Strategies, Cross-Platform Mobile Experiences, CI/CD-Powered Agile DevOps, Automated Quality Engineering, and cutting-edge integrations.

Certified as a Great Place to Work® for five consecutive years (2020-2025) and recognized as a Top 20 AI/ML vendor by CIO Insider, Wissen Group has delivered multimillion-dollar projects for over 20 Fortune 500 companies. Wissen Technology delivers exceptional value on mission-critical projects through thought leadership, ownership, and reliable, high-quality, on-time delivery.

Our industry-leading technical expertise stem from the talented professionals we attract. Committed to fostering their growth and providing top-tier career opportunities, Wissen ensures an outstanding experience and value for our clients and employees.

We Value:

• Perfection: Pursuit of excellence through continuous improvement.
• Curiosity: Fostering continuous learning and exploration.
• Respect: Valuing diversity and mutual respect.
• Integrity: Commitment to ethical conduct and transparency.
• Transparency: Open communication and trust.

Wissen Thought leadership: https://www.wissen.com/articles/

Employee Speak:

https://www.wissen.com/blog/we-work-on-highly-complex-technology-projects-here-is-how-it-changes-whom-we-hire/

Wissen: A Great Place to Work

https://www.wissen.com/blog/here-is-what-ownership-and-commitment-mean-to-wissenites/

A technology consultancy that drives digital innovation by connecting strategy and execution, helping global clients to strengthen their core technology.