Principal Data Engineer

Constant Contact; Waltham (MA); Hybrid; USD 138,000 - 172,000; Full time

Job summary

Constant Contact is seeking a Principal Data Engineer to lead the Enterprise Data Platform, shaping data strategies and building scalable data pipelines that empower customer insights. You will bridge business stakeholders and technical teams, driving architectural decisions across cloud platforms including AWS and GCP.

The role emphasizes leading multi-team platform architecture, mentoring engineers, and delivering end-to-end data solutions in a fast-paced environment.

Qualifications

• 12+ years of experience with data, SQL, Python, Snowflake, AWS, software engineering or database development.
• Ideal candidate has led platform architecture for a multi-team data organization.
• Experience developing end-to-end data pipelines to transform and process data for reporting layer.
• Production experience with at least two of: Trino/Presto, Iceberg/Delta/Hudi, Dagster/Airflow, dbt, Spark.
• Full grasp of continuous integration and delivery, including branching strategies, automated deployment and functional automation within CI and CD Pipelines.

Responsibilities

• Architect large-scale data intelligence solutions, evaluating Snowflake Data Warehouse and/or Google BigQuery.
• Design and evolve an open lakehouse on AWS: S3 with Iceberg/Delta formats, medallion architecture, and Trino federation.
• Develop data ingestion pipelines using AWS EMR, Snowpipe, AWS DMS, etc.
• Own orchestration patterns in Dagster: asset-based pipelines, code-location design, lineage, sensors and schedules.
• Set dbt standards for enterprise data model and CI for model changes.
• Hands-on building productionized data ingestion and processing pipelines using Java, Spark, Scala, Python.
• Tune Trino for performance and cost: catalog, resource groups, Kubernetes scaling.
• Set technical direction and write architecture decision records; mentor engineers across teams.

Skills

SQL development

Python

Snowflake

AWS

Dagster

dbt

Spark

Kubernetes

ETL pipelines

BigQuery

Education

Bachelor/Master in CS/IT

Tools

Dagster

Airflow

dbt

Spark

Trino

Iceberg/Delta

Kubernetes

Terraform

CDK

Glue/Hive

Job description

At Constant Contact, we are seriously awesome people who take ownership and make an impact by operating with the mindset, integrity and courage of a small business owner.There’s something so profoundly rewarding about knowing that your work is empowering people everywhere to pursue their dreams. Here, we all play an integral part in helping business owners, entrepreneurs, non-profits and individuals to succeed by giving them all the help and tools they need to grow online. We’re energized by new challenges and new possibilities-and we’re just getting started!

The Enterprise Data Platform team is looking for a Principal Data Engineer to help revolutionize how we think about and deliver customer insights, playing an important role in the future success of the company.

The ideal candidate will be a platform evangelist, having a deep appreciation for the business as well as strong technical skills. You should be self-directed, a creative problem solver, and able to adjust to a fast-paced environment. This position plays the important role of bridging the gap between our business stakeholders and our technical data teams.

What you'll do:

• Architecting large-scale data intelligence solutions, performing architectural assessments, crafting architectural options and analysis around Snowflake Data Warehouse and/or Google BigQuery
• Design and evolve an open lakehouse on AWS: S3 with Apache Iceberg/Delta table formats, a medallion architecture (bronze → silver → gold), and Trino as the federated query engine.
• Finalize preferred solution alternative working with IT and Business stakeholders to build data ingestion pipeline using tools like AWS EMR, Snowpipe, AWS DMS, etc.etc
• Need to have professional knowledge of cloud platforms like AWS, GCP, etc.
• Developing ETL pipelines in and out of data the warehouse using but not limited to Python, Scala,SnowSQL, etc.
• Own orchestration patterns in Dagster: asset-based pipelines, code-location design, cross-asset lineage, sensors and schedules, partitioning and backfills.
• Set dbt standards for the enterprise data model: layering (staging/intermediate/marts), testing, documentation, and CI for model changes.
• Hands on experience with building productionized data ingestion and processing pipelines using Java, Spark, Scala, Python
• In-depth understanding of Data Warehouse/ODS, ETL concept and modeling structure principles
• Tune Trino for performance and cost: query planning, catalog configuration (Glue/Hive/REST), resource groups, and scaling on Kubernetes.
• Set technical direction and write architecture decision records for review by peers and leadership.
• Mentor engineers across distributed teams in the US and India, and raise the bar through code and design reviews.

Who you are:

• 12+ years of experience working with data in the following ways: SQL development, Shell Scripting, Python, Snowflake, AWS, software engineering or database development
• Ideal candidate has led platform architecture for a multi-team data organization
• Experience developing end-to-end data pipelines to transform and process data for reporting layer
• Experience with large-scale data sets using both structured and unstructured data
• Production experience with at least two of: Trino/Presto, Iceberg/Delta/Hudi, Dagster/Airflow, dbt, Spark
• Full grasp of continuous integration and delivery, including branching strategies, automated deployment and functional automation within CI and CD Pipelines.
• Strong communication skills across both business and technical communities.
• Experience with Kubernetes (EKS), infrastructure as code (Terraform/CDK), and containerized data services.
• Bachelor or Master’s degree in Computer Science, Information Technology or Equivalent.
• Performing in an agile, self-directed team environment.
• Nice to have: experience with semantic layers (Cube, dbt Semantic Layer), data catalogs, ML/identity resolution, marketing or ad-tech data, and big data.
• Experience with billing data and systems is a big plus.

The specific salary offered to a candidate may be influenced by a variety of factors including the candidate’s experience, their education and work location. In addition, some roles may be eligible for additional on target commission pay or bonus. The compensation package includes health and welfare benefits including paid leave.

Pay Transparency - All Full Time Employees

$137,800 - $172,250 USD

Why You’ll Love Us:

• We celebrate one another’s differences. We are proud of our culture of diversity and inclusion, and we're always working hard to strengthen and improve this culture. We have programs in place that bring us together on important issues and provide educational opportunities for all employees.
• Join the experts. If you're passionate about supporting businesses and organizations, you won’t find a better spot to share your talent. We’re dedicated to improving the quality of our product from a customer standpoint and have a true desire to enable the success of businesses, non-profit organizations, and community groups.
• You’ll have opportunities to grow your career. We encourage and support our team members to learn different aspects of the business, take on stretch assignments, seek coaching opportunities and professional development opportunities.
• A generous paid time off policy and a competitive benefits package that supports the health and well-being of you and your family.

At Constant Contact, we’re all about work flexibility and are proud to serve our customers as a hybrid workforce. Our hybrid work model combines the convenience of remote work with access to our great office locations to collaborate in-person, participate in live trainings, and socialize with colleagues.

Application Deadline: 30 days. We may fill this job opening prior to the deadline if a candidate is selected by us.

Vision6 Pty Limited is an affiliate of Constant Contact, Inc. and a part of the Constant Contact group of brands.

Constant Contact is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, gender, gender identity, national origin, citizenship, age, disability, sexual orientation, genetic information, veteran status or any other status protected under applicable law. If you require accessibility assistance applying for open positions, please contact [e-mail].