Data Engineer, Senior

Blackbaud India; Hyderabad; On-site; INR 3,000,000 - 5,000,000; Full time

Job summary

Blackbaud India seeks a Senior Data Engineer to design, implement, and operate scalable data pipelines powering Blackbaud Data Intelligence and analytics products.

You will mentor the team, help set coding standards for data engineering, and collaborate across data science, product, and software teams in a fast-paced cloud environment.

Qualifications

• 5+ years of data engineering experience.
• Experience with Spark, Databricks, Delta lakes, Hive.
• Proficiency in Python/Scala/Java (prefer Python).
• Hands-on experience with Azure public cloud.
• Knowledge of data governance, security and data pipelines.
• Experience building data pipelines (batch and streaming).
• Familiar with TDD, CI/CD concepts.
• Understanding of data security protocols.

Responsibilities

• Design, develop and operate high performance, large volume data structures for data-powered products and data science.
• Implement efficient, distributed and scalable pipelines and integrate data from multiple sources to create data products.
• Implement design patterns that support data ingestion, data movement, transformation, aggregation, and more.
• Collaborate with Product managers, Software engineers, and Data Scientists to achieve key results.
• Build high quality production level code, test and deploy data pipelines.
• Undertake complex tasks that are large and diverse in scope and/or critical in nature.
• Design and develop breakthrough products, services or technological advancements.
• Participate in code reviews and mentor junior engineers.
• Work in fast paced agile environment and participate in scrum ceremonies.
• Leverage AI-assisted tools to accelerate delivery and improve quality.

Skills

Data engineering

Big data

Python

Scala/Java

Azure

CI/CD

Tools

Spark

Databricks

Delta lakes

Hive

Job description

Data Engineering at Blackbaud is responsible for ingestion, transformation and processing of data that powers Blackbaud Data Intelligence and Advanced analytics products. The data managed by the team supports data science, data enrichment, research and data analysis as well as making data operationally able to be consumed by Blackbaud’s products and services.

As a Senior Data Engineer, you will take responsibility for technical design, implement complex features and provide mentorship in the Data Engineering discipline of Infrastructure Engineering & Cloud Operations (IECO). You build data intensive solutions that are highly available, scalable, reliable, secure, and cost-effective. You contribute to our common code repositories; help establish and enforce coding standards for data engineering teams.

What will You be doing:

• Design, develop and operate high performance, large volume data structures for data-powered products and data science.
• Implement efficient, distributed and scalable pipelines and integrate data from multiple sources to create data products
• Implement design patterns that support data ingestion, data movement, transformation, aggregation, and much more.
• Collaborate with Product managers, Software engineers, and Data Scientists, and work towards achieving key results.
• Build high quality production level code, test and deploy data pipelines
• Undertake complex tasks that are large and diverse in scope and/or critical in nature
• Design and develop breakthrough products, services or technological advancements that expand our business
• Participate in code reviews, brainstorm design approaches with peers and mentor junior engineers
• Work in fast paced agile environment, participate in scrum ceremonies and help ensure that the team meets sprint commitments.
• Leverage AI-assisted tools to accelerate delivery and improve quality and actively experiment with emerging capabilities as they evolve.

What You'll Bring

• Have 5+ years of data engineering experience
• Experience with big data technologies such as Spark, Databricks, Delta lakes, Hive, etc.
• 4+ years of experience in core languages such as Python, Scala or Java (Preferably Python)
• Hands-on experience leveraging PaaS offerings in a public cloud environment (Azure preferred)
• Experience with Big Data design patterns and distributed computing tools/frameworks
• Proven expertise building big data pipelines (batch processing, real-time streaming)
• Working knowledge of TDD, CI/CD concepts and tools (Preferably Azure DevOps)
• Advanced understanding of unit testing/integration testing/QA/Validation
• Knowledge of data security and authentication protocols
• Experience in areas of data governance, privacy and regulation and professional experience with architectural approaches to data security
• Have experience integrating multiple data sources into a common set of data assets

Stay up to date on everything Blackbaud, follow us on Linkedin, X, Instagram, Facebook and YouTube.

Blackbaud powers social impact through purpose-driven technology and responsible AI. Guided by our Intelligence for Good® vision, we’re building a culture where innovation, trust, and human expertise come together to help organizations make a greater difference in the world.

Blackbaud is proud to be an equal opportunity employer and is committed to maintaining an inclusive work environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, physical or mental disability, age, or veteran status or any other basis protected by federal, state, or local law.