Skip to content

Entity Synthesis for OCI logs - #3189

Merged
bgalmesnr merged 19 commits into
newrelic:mainfrom
jashraf-hash:NR-601870-api-gateway-logs-entity-syntheisis
Sep 21, 2026
Merged

bgalmesnr merged 19 commits into
newrelic:mainfrom
jashraf-hash:NR-601870-api-gateway-logs-entity-syntheisis

Conversation

@jashraf-hash

@jashraf-hash jashraf-hash commented Aug 21, 2026 •

Copy link
Copy Markdown
Contributor

Relevant information

This PR adds entity synthesis definitions for API Gateway as part of the broader OCI entity expansion initiative.

Summary of work completed:

Collected raw logs for API Gateway, Network Load Balancer, VCN, and Network Firewall.

Analyzed payloads and created entity synthesis rules based on the spike documentation (Spike Document Reference).

Evaluated payload coverage across services currently being processed by metrics (including Object Storage, DNS, Database, Integration, and others).

Confirmed below doing testing via different oci payloads calling nr api .

a)Both identifier and name field required for entity synthesis
b)If we dont pass name field but pass OCID as identifier, event doesnot get attached to entity.
c)If we pass identifier and name field and if name field changes in payload from previously sent logs for same identifier ,then name is updated for entity

At present,its confirmed that we can take API Gateway for entity synthesis from logs side to production.

Api Review Board (ARB)
ARB Jira ticket:
https://new-relic.atlassian.net/browse/NR-613181
Checklist
[x] I've read the guidelines and understand the acceptance criteria.

[x] The value of the attribute marked as identifier will be unique and valid.

[x] I've confirmed that my entity type wasn't already defined.

[x] I've linked an ARB ticket & received approval from API Review Board in order to make these changes

@CLAassistant

CLAassistant commented Aug 21, 2026 •

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@entityBot entityBot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beep boop bop.

I have found some errors processing these changes:

  • No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

@entityBot
entityBot requested a review from a team August 21, 2026 05:38
@jashraf-hash
jashraf-hash marked this pull request as draft August 21, 2026 05:47
@jashraf-hash
jashraf-hash marked this pull request as ready for review August 24, 2026 10:24
@entityBot
entityBot dismissed their stale review August 24, 2026 10:24

Let's validate those changes.

@entityBot entityBot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beep boop bop.

I have found some errors processing these changes:

  • No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

@entityBot
entityBot dismissed their stale review August 24, 2026 10:24

Let's validate those changes.

@entityBot entityBot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beep boop bop.

I have found some errors processing these changes:

  • No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

@bgalmesnr
bgalmesnr requested a review from entityBot August 26, 2026 08:51
@entityBot
entityBot dismissed their stale review August 26, 2026 08:51

Let's validate those changes.

@entityBot entityBot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beep boop bop.

I have found some errors processing these changes:

  • No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

@entityBot
entityBot dismissed their stale review August 28, 2026 07:55

Let's validate those changes.

@entityBot entityBot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beep boop bop.

I have found some errors processing these changes:

  • No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

@entityBot
entityBot dismissed their stale review September 1, 2026 13:35

Let's validate those changes.

@entityBot entityBot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beep boop bop.

I have found some errors processing these changes:

  • No valid, approved ARB ticket found in the PR description. This PR has to be reviewed by the API Review Board, please include a link to the ticket of that review in the PR description. Check how to start the process here or reach #api-review-board channel in case of doubts

@jashraf-hash jashraf-hash changed the title Entity Synthesis for API Gateway logs Entity Synthesis for OCI logs Sep 1, 2026
Comment thread entity-types/infra-ociapigateway/definition.yml
Comment thread entity-types/infra-ocistreaming/definition.yml
@sseif-nr

sseif-nr commented Sep 3, 2026

Copy link
Copy Markdown
Collaborator

What is the e2e coverage for the proposed new features?

@entityBot
entityBot dismissed their stale review September 7, 2026 10:41

Let's validate those changes.

@entityBot entityBot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beep boop bop.

I have found some errors processing these changes:

  • ARB tickets not approved: NR-613181 (Status: Pending Response).
    The review process is not handled by Entity Platform, reach #api-review-board channel in case of doubts

@jashraf-hash

Copy link
Copy Markdown
Contributor Author

What is the e2e coverage for the proposed new features?

We will be testing end to end and need your approval for deploy in staging.We hope to cover it 100%

@entityBot entityBot left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

beep boop bop.

I have found some errors processing these changes:

  • Error PARSING domainType: 'infra-ocicloudevents' on entitydefinitionemitter.models.BaseEntityDefinition - jackson.databind.exc.ValueInstantiationException: Cannot construct instance of entitydefinitionsclientsynthesis.models.definitions.EntitySynthesisRule, problem: must contain a condition
    at [Source: (StringReader); line: 35, column: 4] (through reference chain: entitydefinitionemitter.models.BaseEntityDefinition["synthesis"]->entitydefinitionemitter.models.CustomEntitySynthesisRules["rules"]->ArrayList[1])

maya-jha
maya-jha previously approved these changes Sep 10, 2026
@entityBot
entityBot dismissed maya-jha’s stale review September 10, 2026 11:40

Dismissing reviews

entityBot
entityBot previously approved these changes Sep 10, 2026
@entityBot

Copy link
Copy Markdown
Collaborator

⚠️ Review Required ⚠️

👋 This PR has seen no activity in over 3 days and is still awaiting approval from: @newrelic/BEYOND

Please review or provide an update.

maya-jha
maya-jha previously approved these changes Sep 16, 2026
@entityBot
entityBot dismissed maya-jha’s stale review September 17, 2026 10:59

Dismissing reviews

pbhadra0112
pbhadra0112 previously approved these changes Sep 17, 2026

@pbhadra0112 pbhadra0112 left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@entityBot
entityBot dismissed pbhadra0112’s stale review September 18, 2026 09:14

Dismissing reviews

@entityBot
entityBot requested a review from a team September 21, 2026 08:52
@bgalmesnr
bgalmesnr merged commit 9096d6e into newrelic:main Sep 21, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants