Senior Data Engineer

LyvWell Apartments; Charleston (SC); Presencial; USD 120 000 - 160 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Full benefits package

Generous paid time off

401(k) with company match

Growth and advancement opportunities

Resumo da oferta

LyvWell Apartments seeks a Senior Data Engineer to design, build, and optimize scalable data pipelines and cloud data systems across the organization. Expertise in data architecture, ETL development, and cloud technologies with Python, SQL, and AWS (S3, Redshift) is essential.

You will collaborate with data analysts, scientists, and business stakeholders to improve data accessibility and performance, while implementing DevOps and CI/CD practices in an agile environment.

Qualificações

• Undergraduate degree in MIS/CS/IT required.
• 5–7 years of ETL and system integration experience.
• 5–7 years with SQL, Redshift, Snowflake or similar data warehouses.
• 5–7 years writing Python for data integration and tooling.

Responsabilidades

• Design, build, and optimize scalable ETL/ELT pipelines and cloud data integrations (Yardi, Salesforce) into AWS analytics (Redshift, S3).
• Collaborate with analytics, data science, and business teams to deliver trusted datasets for reporting and analytics.
• Contribute to data platform architecture, CI/CD, DevOps, and infrastructure automation.
• Maintain data quality, governance, and documentation; support BI/AI initiatives.

Conhecimentos

Python

SQL

AWS

Airflow

ETL

Data modeling

Data warehousing

CI/CD

Formação académica

Bachelor's degree in MIS/CS/IT

Ferramentas

Airflow

AWS Glue

Terraform

Docker

Redshift

Snowflake

Tableau/Power BI

Descrição da oferta de emprego

Location

Charleston - 997 Morrison Drive, Suite 402

Business

We believe home is more than a place to live. It's where life happens; connections are made, and communities grow. That's why we're committed to creating welcoming places where our residents feel at home, and our people have the opportunity to make a meaningful impact.

Job Description

Position Summary

The Senior Data Engineer is responsible for designing, building, and optimizing scalable data pipelines and cloud-based data systems that support analytics and data-driven decision-making across the organization. This role requires expertise in data architecture, ETL development, and modern cloud technologies, with a focus on ensuring high-quality, reliable, and efficient data solutions. The ideal candidate will have strong proficiency in Python, SQL, AWS services such as S3 and Redshift. Experience integrating Salesforce data and working with orchestration tools such as Airflow or AWS Glue is also highly valued.

In this role, the Senior Data Engineer will collaborate closely with data analysts, scientists, software engineers, and business stakeholders to improve data accessibility, performance, and scalability. Key responsibilities include developing and maintaining automated ETL frameworks, managing enterprise data products, implementing DevOps and CI/CD practices, and ensuring data quality and governance standards are met. The position also involves researching and adopting emerging technologies to continuously enhance the organization’s data infrastructure and operational efficiency.

The ideal candidate will possess strong problem-solving abilities, excellent communication skills, and experience working within agile development environments. Preferred qualifications include certifications in cloud or data engineering platforms, familiarity with non-relational databases and OpenSearch technologies, and exposure to business intelligence tools such as Tableau or Power BI. Success in this role will be measured by pipeline performance, data reliability, cross-functional collaboration, and contributions toward innovation and infrastructure optimization.

1. Pipeline Development & Data Integration (50%)
   Design, develop, optimize, and maintain scalable ETL/ELT pipelines and cloud-based data integrations across enterprise systems, APIs, and operational platforms including Yardi and Salesforce. Build reliable, high-performance workflows that support the movement and transformation of data from SQL Server and other source systems into AWS-based analytics platforms including Redshift and S3.

Key Areas:

• ETL/ELT pipeline development and optimization
• SQL Server, API, Yardi, Salesforce, and third-party integrations
• AWS S3 and Redshift data workflows
• Airflow and AWS Glue orchestration
• Pipeline monitoring, reliability, and SLA management

1. Collaboration with Analytics, Data Science, and Stakeholders and Data Enablement 30%
   Develop and maintain enterprise datasets, models, and transformation frameworks while partnering with Analytics, Data Science, AI Initiatives, and Business teams to refine requirements, improve data accessibility, and deliver trusted datasets that support reporting, analytics, and operational decision-making.

Key Areas:

• Data modeling and warehousing
• Data quality, governance, and documentation
• Cross-functional collaboration with business, analytics and AI teams
• Dataset refinement and business requirements gathering
• Support for BI, AI/ML, and operational analytics initiatives

1. Architecture, Strategic Initiatives & Operational Excellence (20%)
   Contribute to enterprise data platform and strategy through participation in large-scale initiatives, complex integration design, and modernization of data infrastructure. Support scalable and reliable operations through DevOps, automation, CI/CD, and infrastructure management best practices.
   Key Areas:
   
   • Enterprise data architecture and integration design
   • Strategic technology evaluation and innovation
   • Infrastructure automation and CI/CD practices
   • Docker, Terraform, and deployment management
   • Agile/Scrum participation and operational support

Education

Undergraduate (Bachelor) Degree in MIS, Computer Science, Information Technology required

Work Experience

• 5 - 7 Years of experience developing ETL & System Integration pipelines required
• 5 - 7 Years of experience designing, building, and improving large data models in complex environments required
• 5 - 7 Years experience with Cloud Technologies like Airflow, Glue, or similar ETL Tools
• 5 - 7 Years of experience with SQL, Redshift, Snowflake or similar data warehouse solutions required
• 5 - 7 Years of experience developing complex Python code to support various integration needs

Travel

Travel up to 20% of the time; rarely travel

Great Incentives!

We care about the well-being and work-life balance of our valued associates! To show how much we care, we offer awesome incentives that include:

• Full benefits package
• Generous paid time off
• 401(k) with company match
• Growth and advancement opportunities

Equal Opportunity Employer: Minorities/Religion/Sex/Protected Veterans/Disability/Sexual Orientation/Gender Identity/Marital Status/Pregnancy/Age/National Origin/Genetic Information. Drug free workplace

#LI-JR1

We are proud to create a diverse environment and are proud to be an equal opportunity employer. We are grateful for your interest in this position, however, only candidates selected for pre-screening will be contacted.