Senior Observability Engineer (New Relic Consolidation)

EPAM Systems; Turkey; On-site; TRY 420,000 - 680,000; Full time

Benefits offered by this job

Continuous upskilling

Private health insurance

Referral bonuses

English courses

Job summary

EPAM Systems seeks an experienced Senior Observability Engineer to own the multi-tenant New Relic consolidation layer across the agent estate. You will consolidate telemetry from multiple project tenants via cross-account NRQL and design dashboards-as-code and alert-policy-as-code with Terraform and Crossplane.

Responsibilities include setting up policies routed to Opsgenie, migrating later to ServiceNow, and defining reporting processes for cross-account telemetry.

Qualifications

• 5+ years of experience in observability or SRE engineering.
• Hands-on with consolidating observability for AI agent estates in production.
• Expertise in New Relic administration at scale and cross-account configuration.
• Proficient NRQL for cross-account telemetry aggregation.
• Dashboards- and alert-policy-as-code using Terraform and Crossplane.
• Knowledge of OpenTelemetry/ADOT ingestion into New Relic.

Responsibilities

• Operate and administer the multi-tenant New Relic layer across the agent estate.
• Consolidate telemetry from multiple tenants using cross-account NRQL queries.
• Develop dashboards-as-code and alert-policy-as-code via Terraform and Crossplane.
• Set up alert policies routed to Opsgenie, with future migration to ServiceNow.
• Define cross-account telemetry aggregation and reporting processes.
• Partner with engineering teams to standardize observability practices.

Skills

Observability/SRE

NRQL queries

Dashboards as code

Alert policies

Terraform

Crossplane

OpenTelemetry

New Relic admin

Cost attribution

Multi-tenant

Tools

New Relic

Terraform

Crossplane

Opsgenie

ServiceNow

Kinesis Firehose

OpenTelemetry

Job description

We are seeking an experienced Senior Observability Engineer to take ownership of the multi-tenant New Relic consolidation layer that aggregates telemetry across our agent estate, as part of an Enterprise Agent Development Platform that empowers engineering teams to define, orchestrate, deploy, and observe AI agents at scale throughout the organization.ResponsibilitiesOperate and administer the multi-tenant New Relic consolidation layer across the agent estateConsolidate telemetry from multiple project tenants through cross-account NRQL queriesDevelop and maintain dashboards-as-code and alert-policy-as-code via Terraform and CrossplaneSet up New Relic alert policies routed to Opsgenie, with future migration to ServiceNowHandle OpenTelemetry / ADOT ingestion into New Relic through OTLP and Firehose pipelinesArchitect metric dimensions and low-cardinality facets for large-scale agent estatesDefine cross-account and cross-tenant telemetry aggregation and reporting processesPreserve segregation across Technical, Business, and Audit observability modelsPartner with engineering teams to standardize agent observability practices across the platformRequirements5+ years of experience in observability or SRE engineeringHands-on background in consolidating observability/telemetry for AI agent estates in a production agentic AI project, such as multi-tenant New Relic aggregation, cost/token attribution for GenAI workloads, or AgentCore GenAI Observability integrationExpertise in New Relic administration at scale, covering management account setup and cross-account configurationProficiency in NRQL for cross-account queries that aggregate telemetry from multiple project tenantsSkills in dashboards-as-code and alert-policy-as-code with Terraform New Relic provider and CrossplaneKnowledge of New Relic alert policies routed to Opsgenie, along with familiarity with ServiceNowUnderstanding of OpenTelemetry / ADOT consumption fundamentals, covering OTLP and Firehose ingestion into New RelicCompetency in metric dimension design for large agent estates, ensuring stable, low-cardinality facetsBackground in running New Relic or equivalent SaaS observability platforms as a multi-tenant consolidation layerExperience operating within a Technical / Business / Audit observability segregation modelEnglish proficiency at an Upper-Intermediate level (B2) or higherNice to haveFamiliarity with AWS Bedrock AgentCore observability, covering Transaction Search and GenAI ObservabilityUnderstanding of Kinesis Firehose metric and log forwarding pipelines from CloudWatch to New RelicExpertise in cost/token attribution modeling for GenAI workloadsKnowledge of Crossplane-based provisioning of observability resourcesWe offerCONTINUOUS UPSKILLING, LEARNING & DEVELOPMENTDiversity of tasks and projectsAssessment center for objective review of competency levelPersonal development planMentoring programs and leadership developmentCertification and professional development supportAccess to learning platforms including more than 2,500 internal coursesEnglish courses taught by certified teachersCORPORATE BENEFITSExtra leave daysReferral bonusesCOMPENSATION PACKAGECompetitive compensation paid in USDRegular salary and performance reviewsMEDICAL & HEALTHCAREPrivate health insuranceWell-being eventsWORKING ENVIRONMENTRecreation areas and kitchensTea, coffee and snacksSports equipment and game consolesIT EquipmentMicrosoft’s Software Assurance Home Use Program (HUP)Please note that our Talent Attraction Team reviews applications and CVs submitted in English.EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.