Senior Data Engineer

OP; Orlando (FL); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

401(k)

Dental Insurance

Health insurance

Vision insurance

Job summary

OP in Orlando, FL seeks a Senior Data Engineer to design, build, and sustain data pipelines and platforms that drive analytics and revenue optimization. You will partner with architects, developers, and business stakeholders in a fast-paced transformation program.

The role emphasizes GenAI integration, cloud-based data solutions, scalable ETL/ELT pipelines, and data quality to support enterprise analytics and business outcomes.

Qualifications

• 5+ years of technology experience.
• Strong experience with ELT/ETL data pipeline development and maintenance.
• Proven expertise using Python and SQL.
• Strong understanding of database and data warehouse design with PostgreSQL/Snowflake.
• Solid understanding of GenAI concepts and tools (e.g., LLMs, embeddings, prompt engineering).
• Understanding of vector databases or RAG architectures.
• Experience with GenAI APIs or frameworks (OpenAI, LangChain, AWS Bedrock).
• Experience in multi-environment Dev, QA, Prod and DevOps code deployment using GitLab/GitHub.

Responsibilities

• Design, develop, and maintain scalable data pipelines and integrations.
• Build and support cloud-based data solutions using modern data engineering technologies.
• Collaborate with leads, architects, and stakeholders to gather requirements and translate them into technical solutions.
• Develop APIs and data services that support enterprise applications and analytics initiatives.
• Contribute to data architecture, data modeling, and platform modernization efforts.
• Leverage AI-enabled development tools to improve productivity and solution quality.
• Participate in design reviews, code reviews, and best-practice development.
• Support delivery of strategic initiatives through hands-on engineering and implementation.
• Work with project teams to ensure timely delivery aligned with business objectives.

Skills

Python

SQL

Data pipelines

PostgreSQL

Snowflake

GenAI

LLMs

Prompt engineering

Apache Airflow

DevOps

GitLab/GitHub

API development

AWS

Education

Bachelor's degree (CS/Math/SE or related)

Tools

Apache Airflow

GitLab/GitHub

LangChain

AWS Bedrock

OpenAI API

Job description

We are seeking a highly skilled Senior Data Engineer to support a large-scale transformation initiative focused on modernizing the Management Platform. This role will be instrumental in designing, building, and enhancing data solutions that support critical business operations and revenue optimization efforts. The project is a long-term strategic investment and requires engineers who can operate effectively in a fast-paced environment while partnering closely with architects, developers, and business stakeholders.

What You Will Do

The Data Engineering team is responsible for development and sustainment projects, ad-hoc requests, prototyping, and research initiatives by providing data pipeline and data engineering services. You will work with business, science, and technology teams to understand scope and requirements, business needs, and data from across the company in order to design and deliver the data pipelines necessary for our solutions. You will have tasks to design, develop, enhance, and implement systems for advanced analytic data solutions. This includes data aggregation and manipulation to make the data usable by science models, visualizations, and applications. You will be expected to leverage GenAI tools to be efficient in your work, and you will be delivering AI-based solutions. You will also support the exploration and integration of GenAI tools and techniques into data engineering processes to enhance automation and analytical capabilities. Other activities could include planning, estimating, design, development, testing, production rollout, and sustainment activities. In addition to technical capabilities, the role is responsible for developing an understanding of the business domain and processes, then applying that knowledge to the assigned deliverables.

Responsibilities Of The Role

Work assignments may cover activities such as participation in data requirements gathering, source-to-target mapping, data validation scripting and review, developing and monitoring ETL/ELT data pipelines, and producing datasets as input to science models and visualizations. As part of a data engineering team, this role will be included in technical reviews of the team to ensure quality deliverables.

In addition to technical capabilities, the role is responsible for developing an understanding of the business domain and processes, then applying that knowledge to the assigned deliverables. This role communicates data engineering progress to the project leadership team and actively participates in meetings and discussions.

Responsibilities

• Design, develop, and maintain scalable data pipelines and integrations.
• Build and support cloud-based data solutions using modern data engineering technologies.
• Collaborate with technical leads, architects, and business stakeholders to gather requirements and translate them into technical solutions.
• Develop APIs and data services that support enterprise applications and analytics initiatives.
• Contribute to data architecture, data modeling, and platform modernization efforts.
• Leverage AI-enabled development tools and practices to improve engineering productivity and solution quality.
• Participate in technical design reviews, code reviews, and best practice development.
• Support delivery of strategic initiatives through hands-on engineering and solution implementation.
• Work closely with project teams to ensure timely delivery of capabilities aligned with business objectives.

Basic Qualifications

• 5+ years of technology experience.
• Strong experience with ELT/ETL data pipeline development and maintenance.
• Proven expertise using Python and SQL.
• Strong understanding of database and data warehouse design, and proficiency utilizing various data platforms, such as PostgreSQL, Snowflake, etc.
• Solid understanding of GenAI concepts and tools (e.g., LLMs, embeddings, prompt engineering).
• Understanding of vector databases or RAG (Retrieval-Augmented Generation) architectures.
• Experience working with GenAI APIs or frameworks (e.g., OpenAI, LangChain, AWS Bedrock).
• Experience developing in a multi-environment (Dev, QA, Prod, etc.) and DevOps procedures for code deployment/promotion using a source control product such as GitLab or GitHub.
• Hands-on knowledge of job orchestration software like Apache Airflow.
• Experience and understanding of one or more business domains to assist in gathering/refining data requirements and data design solutions.
• Experience managing and deploying code using a source control product such as GitLab/GitHub.
• Able to effectively formulate solutions and communicate complex technical concepts to non-technical team members.
• Proven ability to work collaboratively in a multi-team environment.

Desired Qualifications

• Experience with analytic systems.
• Experience with infrastructure as Code, Docker, and containerization and elastic scaling with Kubernetes or a similar framework and with AWS.
• Experience working with large datasets and big data technologies such as Snowflake.
• Demonstrated proficiency with API development.
• Knowledgeable about cloud architecture and product offerings, preferably AWS.

Preferred Qualifications

• Experience supporting large enterprise transformation programs.
• Understanding of modern AI and Generative AI technologies as applied to software and data engineering workflows.
• Experience utilizing AI-assisted development tools to improve delivery efficiency.
• Familiarity with containerization technologies such as Kubernetes.
• Experience working within agile environments and cross-functional teams.
• Project Context.

Required Qualifications

• Extensive experience in Data Engineering, Data Integration, or related disciplines.
• Strong experience developing cloud-based data solutions.

Education

• Bachelor s degree (Computer Science, Mathematics, Software Engineering, or related field).

Expertise With

• AWS.
• Snowflake.
• API Development.
• Experience building and maintaining large-scale data pipelines and data platforms.
• Strong understanding of the software development lifecycle and engineering best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and stakeholder engagement capabilities.

Benefits

• 401(k).
• Dental Insurance.
• Health insurance.
• Vision insurance.
• We are an equal-opportunity employer and value diversity, equality, inclusion, and respect for people.
• The salary will be determined based on several factors, including, but not limited to, location, relevant education, qualifications, experience, technical skills, and business needs.

Additional Responsibilities

• Participate in OP monthly team meetings and participate in team-building efforts.
• Contribute to OP technical discussions, peer reviews, etc.
• Contribute content and collaborate via the OP-Wiki/Knowledge Base.
• Provide status reports to OP Account Management as requested.

About Us

At OP, we help you harness the power of technology for maximum impact. A technology consulting and solutions company, we offer advisory and managed services, innovative platforms, and staffing solutions across a wide range of fields including AI, cyber security, enterprise architecture, and beyond. For nearly two decades, we ve have been challenging the status quo of the consulting industry serving up fresh, ingenious thinking through a radically lean structure. Together, this strategy delivers unprecedented performance at an unparalleled pace for faster results that propel your business forward.