Senior Software Engineer (Data Pipelines)

Wpromote; United States; On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Half-day Fridays

401(k) with company matching

Medical/dental/vision insurance

Unlimited PTO

Parental leave

Training & development access

Job summary

Wpromote is seeking a Senior Data Engineer to lead the development, optimization, and automation of data pipelines in our data ecosystem. You will architect scaleable solutions using Airflow, dbt, and Google Cloud data products, while mentoring engineers and driving best practices in CI/CD and testing.

You will collaborate with senior leadership to shape technical strategy and ensure delivery speed and quality, balancing innovation with governance and security constraints.

Qualifications

• 7+ years in software development with Python, SQL and data pipelines.
• Expert in ETL/ELT pipeline automation and orchestration.
• Experience with cloud data platforms (GCP) and BigQuery.
• Strong knowledge of dbt, Airflow, and Looker or BI tools.

Responsibilities

• Lead complex data projects and architect initiatives.
• Mentor engineers and participate in agile ceremonies.
• Design and maintain automated ETL/ELT pipelines using Airflow and dbt.
• Ensure scalability, performance, and data governance.
• Collaborate with senior management on technical strategy.

Job description

• As a Senior Engineer, you will play a crucial role in the development, optimization, and automation of our data pipelines.
• You will lead complex data projects, architect technical initiatives, and ensure the scalability and performance of our data solutions.
• Your role will involve strategic planning, collaboration with senior management, and mentoring other engineers.
• You will be responsible for pushing the delivery speed and quality of our data ELT, leading the implementation of innovative tooling and architecture patterns, and fostering a culture of data engineering excellence
• Acting as a technical leader and Subject Matter Expert (SME) in data pipeline automation and workflow orchestration
• Designing, implementing, and maintaining complex, reliable, data solutions with a focus on automation using Airflow, dbt, and Google Cloud data products
• Managing a large portfolio of dbt models, leveraging macros and DRY patterns
• Advocating for test-driven development and assisting QA in developing a robust and reliable process for continuous integration and delivery
• Monitoring, troubleshooting, and optimizing the performance of data pipelines and workflows
• Architecting solutions and reusable patterns that scale with business needs
• Providing implementation, configuration, and deployment documentation
• Proactively addressing issues and problems, generating and implementing innovative solutions
• Participating in all agile ceremonies, including daily standups and regular sprint planning
• Mentoring other engineers and fostering a culture of technical excellence
• Staying up-to-date with the latest industry trends and technologies to drive continuous improvement and innovation in data engineering practices
• Ensuring data security, governance, and compliance with relevant standards and privacy restrictions

Benefits

• Half-day Fridays every Friday
• 3 different medical plans to suit your needs, including a plan under $10 per month, as well as dental, vision, disability, and life insurance
• 401(k) with company matching
• Free, confidential Employee Assistance Program
• Free weekly virtual workout classes
• 100% paid parental leave policy for birth, adoption, and foster placement
• Medical and dependent care FSAs
• LinkedIn learning and access to internal training and development
• Unlimited PTO
• Organizational transparency - our c-suite and senior leadership are easily accessible to all employees, they share business updates, and recognize top employees through a monthly all-hands and a weekly CEO message
• Virtual experiences, from Slack cooking challenges to trivia tournaments and employee awards
• Wprotege mentorship program

Expertise in building and automating ETL/ELT pipelines using Airflow and DAG-based workflow management software. Airbyte for data ingestion is a plus, but not requiredFamiliarity with version control systems and CI/CD tools like GitHub ActionsAbility to influence and guide cross-functional teams and projectsExceptional problem-solving skills and technical leadershipMastery of Python or comparable scripting language, API integrations, and software architectureGood understanding of business intelligence tools like Looker or comparable alternativesStrong command of agile methodologies, continuous integration, and test-driven developmentDeep experience with databases like PostgreSQL and BigQuery, including query optimization for performance and costProficiency with advanced data formats (Parquet, Avro, Hive, JSONL) and data integration techniquesExperience with monitoring and logging tools (e.g., Prometheus, Grafana) is a plusDeep experience managing dbt models using macros and dbt testsExperience with Google Cloud Platform, Kubernetes, and managing infrastructure as code using TerraformMinimum 7+ years of experience in software development, with extensive experience in Python, SQL, and data pipelines