Comments (5)
@cmgrote It looks like it's updating also the relationalColumnType entity. The operation was only a semantic assignment. I've attached some event samples.
event1.txt
event2.txt
event3.txt
event4.txt
event5.txt
event6.txt
from egeria-connector-ibm-information-server.
Yes, it's more of an optimisation issue, it doesn't break anything from what I've seen
from egeria-connector-ibm-information-server.
Hi @ruxandraRosu -- would be good if we can rule out that these are coming through from an environment where metadata pre-existed before the IGC Repository Connector was pointed at it (and possibly before event notification was enabled in the environment). In a scenario where metadata pre-existed, recall that the IGC Repository Connector's Event Mapper will automatically "catch-up" to ensure that all relationships (and entities at the ends of those relationships) for the asset you update in IGC also have events triggered...
Assuming that we first setup event notification in the environment, and connect the IGC Repository Connector to the same environment while it is empty (before any metadata has been populated), I would expect that making a SemanticAssignment relationship alone would result in the following:
- 2
UPDATED_ENTITY
events (one for theGlossaryTerm
, one for theReferenceable
assigned to it) - 1
NEW_RELATIONSHIP
event
If you can share details on the messages themselves it would be interesting to see if there might be something else happening: eg. another UPDATED_ENTITY
and UPDATED_RELATIONSHIP
s because of some other relationship also being triggered from some other property that was changed at the same time as the SemanticAssignment was setup. The 2+1 I mention above I would only expect if you modify eg. a database column in IGC and only change its assigned_to_terms
property (and nothing else). If other properties are also changed, and one of those properties represents a relationship, that will trigger other relationships as well...
All of that said, it's probably worth waiting until #544 is merged before re-testing, as that makes a number of other changes which may impact here as well.
from egeria-connector-ibm-information-server.
Thanks! That example is a good one, as currently changes aren't really distinctly identified between things like RelationalColumn
and RelationalColumnType
I'm likely outputting both when a property on IGC's database_column
(which effectively represents both OMRS entities) changes. I'll try to investigate how to better distinguish these to limit the messages. Is it safe to assume this is more of an optimisation than a breaking issue currently, though?
from egeria-connector-ibm-information-server.
Browsing through the latest set of sample payloads (after the type simplification from TypeEmbeddedAttribute
and NestedSchemaAttribute
) this duplication appears to be resolved -- at least for these SemanticAssignment
examples.
Will close for now, but suggest we open a new issue if we identify any duplication elsewhere.
from egeria-connector-ibm-information-server.
Related Issues (20)
- Lack of context for data_files without data_file_folders HOT 8
- NPE when trying to get EntityDetail for rid that is not present in IGC
- Implement a NOOP event mapper HOT 1
- findEntities with multiple conditions does not return entities HOT 1
- Add differentiation between primary and secondary categories HOT 1
- Property 'assigned_to_terms' no longer supported for searching using 'main_object' generic type HOT 1
- Implement new classification for primary category HOT 1
- IGC repository connector - validation for instance properties mapped with wrong primitive type HOT 3
- Data Stage connector support for high level lienage HOT 7
- Results for a relationship search by type (with multiple mappings) extend beyond pageSize
- Improve handling of complex search criteria for findEntities method HOT 2
- Searching for NEQ minCardinality on SchemaAttributes does not work
- repository-services getEntityDetail is ignoring MetadataCollectionId part of GUID HOT 2
- Move data_file_field mappings from TabularColumn to TabularFileColumn
- Data Stage connector batch processing sync state per instance
- Possible inconsistent behaviour HOT 2
- Data Stage connector capability to process virtual assets
- Mapping new typedef properties (Failed test ConnectorTest.verifySupportedTypes) HOT 2
- Can igc-adapter create anchor classifications for data asset types?
- SonarCloud Quality Gate Code duplication rule too restrictive HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from egeria-connector-ibm-information-server.