bayer-group / colid-setup

The setup repository is part of the Corporate Linked Data Catalog - short: COLID - application. It helps setting up a local environment based on Docker Compose.

Easy setup of the whole environment

The Setup is part of the Corporate Linked Data Catalog - short: COLID - application. Here you can find an introduction to the application. A description of all its functions is here.

The complete guide can be found at the following link.

This repository helps settings up a local environment based on Docker Compose.

Installation instructions

1. Install Docker Desktop for Windows from Docker Hub (latest test with Docker Desktop v2.2.0.3)

2. Clone this repository locally

   git clone --recursive [URL to this Git repo]

3. Pull all changes in all submodules

   git pull --recurse-submodules

4. Create a file .env in parallel to the file docker-compose.yml and insert the following variables (example values are shown):

   MESSAGEQUEUE_COOKIE=SWQOKODSQALRPCLNMEQG
   MESSAGEQUEUE_USERNAME=guest
   MESSAGEQUEUE_PASSWORD=guest
   GRAPHDATABASE_USERNAME=admin
   GRAPHDATABASE_PASSWORD=admin
   RELATIONAL_DATABASE_ROOT_PASSWORD=dbadminpass
   RELATIONAL_DATABASE_USERNAME=dbuser
   RELATIONAL_DATABASE_PASSWORD=dbpass
   SMTP_USERNAME=any
   SMTP_PASSWORD=any
   

5. Run docker-compose up to download and build all Docker images and startup the environment

6. Wait for docker-compose to start up

7. Open the COLID editor (see URL below). Go to the profile menu in the upper right corner and click on "Administration". Open the Metadata Graph Configuration sub-menu page and click the "Start reindex" button in the upper right corner.

8. If you just want to use the Knowledge Graph Explorer Application, then only fuseki, KGE-Frontend and KGE-Web-service docker images needs to be installed.

Known problems

• While building the frontend the following error could occur. In the Dockerfiles of the frontend applications node is used with an increased heap size while building the applications node --max_old_space_size=8000. Try to increase this, if the error occurs.

  FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
  

• After starting the application a second time, the fuseki database could throw exceptions. Delete the Docker container of the fuseki database with docker container rm fuseki. ATTENTION: This will remove all your created data and reload the database with the initial data.

• fuseki-loader/loader.sh could contain Carriage Return characters, remove them.

Application URLs

Component	URL for Docker environment	URL for local environment	Username	Password
COLID frontend	http://localhost:4200/	http://localhost:4201/	-	-
Data Marketplace frontend	http://localhost:4300/	http://localhost:4301/	-	-
COLID API Swagger documentation	http://localhost:51770/swagger	http://localhost:51771/swagger	-	-
COLID Indexing Crawler Service API Swagger documentation	http://localhost:51780/swagger	http://localhost:51781/swagger	-	-
COLID Search Service API Swagger documentation	http://localhost:51800/swagger	http://localhost:51801/swagger	-	-
COLID AppData Service API Swagger documentation	http://localhost:51810/swagger	http://localhost:51811/swagger	-	-
COLID Scheduler Service Hangfire	http://localhost:51820/hangfire	http://localhost:51821/hangfire	-	-
COLID Reporting Service API Swagger documentation	http://localhost:51910/swagger	http://localhost:51911/swagger	-	-
Apache Jena Fuseki Database Webinterface	http://localhost:3030/	-	admin	admin
RabbitMQ Webinterface	http://localhost:15672/	-	guest	guest
KGE-Editor-Frontend	http://localhost:4400/	http://localhost:4400/	-	-
KGE-Web-Service	http://localhost:8080/	http://localhost:8080/	-	-
Resource Relationship Manager-Service	http://localhost:51830/	http://localhost:51831/	-	-
Resource Relationship Manager-Frontend	http://localhost:7000/	http://localhost:7000/	-	-
COLID API Carrot2 Service	http://localhost:4305/	http://localhost:4305/	-	-

Quick Tips

Some quick tips and advices to work faster.

Docker

To purge all unused or dangling images, containers, volumes, and networks run the following command:

docker system prune -a

To remove all containers:

docker container rm $(docker container ls -aq)

Opensearch & Kibana

• After starting the first time, some indices and aliases need to be created
• Open http://localhost:5601, go to the Dev Tools in the left panel, enter and run the following commands

  PUT dmp-resource-1970-01-01_00.00.00
  
  PUT dmp-metadata-1970-01-01_00.00.00
  {
      "mappings": {
          "enabled": false 
      }
  }
  
  POST /_aliases
  {
      "actions" : [
          { "add" : { "index" : "dmp-resource-1970-01-01_00.00.00", "aliases" : ["dmp-search-resource", "dmp-update-resource"] } },
          { "add" : { "index" : "dmp-metadata-1970-01-01_00.00.00", "aliases" : ["dmp-search-metadata", "dmp-update-metadata"] } }
      ]
  }
  

App-wide customization for URL Domain (Optional)

On the Semantic Web, URIs identify not just Web documents, but also real-world objects like people and cars, and even abstract ideas and non-existing things like a mythical unicorn. We call these real-world objects or things. COLID uses the native bayer.com as default domain in each of its URI as the project was conceived for Bayer Ag. For example - https://pid.bayer.com/kos/19050/hasLabel

However you can also configure the custom domain in the URI if needed. In order to do that before building the docker containers, all the triples in the triplestore as well as the references to the URIs should be updated to use the custom domain. Multiple files references across the projects need to be changed from bayer.com to any custom specific domain - https://pid.orange.com/kos/19050/hasLabel Details are mentioned below.

File	Project	Variable	Comments
loader.sh	fuseki-staging	baseUrl	change baseUrl (example.com) as per your need in the shellscript before uploading triples
appsettings.json	AppData Service	ServiceUrl, HttpServiceUrl	change both variables as per your custom domain. "ServiceUrl": "https://pid.example.com/", "HttpServiceUrl": "http://pid.example.com/"
appsettings.json	Indexing Crawler Service	ServiceUrl, HttpServiceUrl	change both variables as per your custom domain. "ServiceUrl": "https://pid.example.com/", "HttpServiceUrl": "http://pid.example.com/"
appsettings.json	Registration Service	ServiceUrl, HttpServiceUrl	change both variables as per your custom domain. "ServiceUrl": "https://pid.example.com/", "HttpServiceUrl": "http://pid.example.com/"
appsettings.json	Reporting Service	ServiceUrl, HttpServiceUrl	change both variables as per your custom domain. "ServiceUrl": "https://pid.example.com/", "HttpServiceUrl": "http://pid.example.com/"
appsettings.json	Search Service	ServiceUrl, HttpServiceUrl	change both variables as per your custom domain. "ServiceUrl": "https://pid.example.com/", "HttpServiceUrl": "http://pid.example.com/"
appsettings.json	Scheduler Service	ServiceUrl, HttpServiceUrl	change both variables as per your custom domain. "ServiceUrl": "https://pid.example.com/", "HttpServiceUrl": "http://pid.example.com/"
appsettings.json	Resource Relationship Manager Backend Service	ServiceUrl, HttpServiceUrl	change both variables as per your custom domain. "ServiceUrl": "https://pid.example.com/", "HttpServiceUrl": "http://pid.example.com/"
environment.ts, environment.docker.ts	Editor Frontend	baseUrl, PidUriTemplate.baseUrl	change baseUrl (example.com) in both sections as per your custom domain
environment.ts, environment.docker.ts	Data Marketplace Frontend	baseUrl	change baseUrl (example.com) as per your custom domain
environment.ts, environment.docker.ts	Resource Relationship Manager Frontend	baseUrl	change baseUrl (example.com) as per your custom domain

COLID: Carrot2 clustering service

Carrot2 clustering service is an opensource for clustering text. It can automatically discover groups of related documents and label them with short key terms or phrases. Please publish few resources in your local COLID Setup and then you can view the clusters in the Data Marketplace. Refer link below for more details

Links

• Git Submodules
• Markdown Cheatsheet
• Apache Jena Fuseki tdbloader example
• wait-for-it Script
• Carrot2

colid-setup's Issues

RabbitMQ issue when running docker-compose

Dear Team,

I have been trying to try out the Docker containers that you provide, but I come across an issue that could be related to RabbitMQ. Would you perhaps be able to share some insights?

I have installed Docker Desktop on a Windows 10, and have followed the steps that you detail in the README. However, when I run docker-compose, the rabbitmq container seems to fail with the following messages:

The COLID services appear to be launching, but with errors:

When I try to "Start reindex" under Administration > Metadata Graph Configuration according to Step 7 of the Installation Instructions, I get an error:

Do you perhaps have some intuition on what is going on? Is there something I might have missed?

Many thanks for any help that you can give us, and keep up the good work!

Errors when cloning the repo

I am following the quick start guide to run the application and it's already failing at the 1st step (cloning the repo).

After running the command git clone --recursive https://github.com/Bayer-Group/COLID-Setup, I get the following errors (pasting the last 5 lines):

Submodule path 'COLID-Scheduler-Service': checked out 'dc344aee510b9ad06de7496f5985cd20bed72093'
Submodule path 'COLID-Search-Service': checked out 'e3852c75474cccd3b2079f27ac6193de71a81d5c'
fatal: remote error: upload-pack: not our ref 832018bfe5c199b88772fba3c2def2290996fdbf
fatal: Fetched in submodule path 'KGE-Frontend', but it did not contain 832018bfe5c199b88772fba3c2def2290996fdbf. Direct fetching of that commit failed.
fatal:

Also, in the instructions provided (https://github.com/Bayer-Group/COLID-Setup) the following step is not clear to me:

Create a file .env in parallel to the file docker-compose.yml and insert the following variables (example values are shown):

What does it mean "in parallel to the file docker-compose.yml"? Does it mean I should create the new file in the same directory as the .yml file and name it "docker-compose.env"?
And why do you say "example values are shown"? Does this mean that the correct values will be different for my setup? If so, where can I find them?

Many thanks

PS. I am trying this on Windows 11 using Docker version 20.10.16, build aa7e414.

KGE-Web-Service not running with docker-compose

Hello,

I tried out to install COLID via docker-compose. During the container creation phase the KGE-Web-Service failed to be built, showing the following error:

Looking at the Dockerfile:

`
FROM node:10-alpine as build-phase
ENV PORT=8080
ENV NODE_ENV="docker"
COPY package.json package-lock.json ./

##Storing node modules on a separate layer will prevent unnecessary npm installs at each build
RUN npm install
&& mkdir /ng-app
&& cp -R ./node_modules ./ng-app

##3 against vulnerable packages
RUN npm audit fix

WORKDIR /ng-app

COPY . .
`

it seems that only the package.json file is copied from host to the guest. Further, the dist folder based on the typescript sources folder is not generated.

Therefore, I modified a little bit the Dockerfile by copying the entire folder of the sources to the host and running the command for generating the dist folder:

`
FROM node:10-alpine as build-phase
ENV PORT=8080
ENV NODE_ENV="docker"

##COPY package.json package-lock.json ./
RUN mkdir /ng-app
COPY . ./ng-app

##Storing node modules on a separate layer will prevent unnecessary npm installs at each build
RUN cd ./ng-app \
&& npm install \
&& npm audit fix \
&& ./node_modules/.bin/tsc

##3 against vulnerable packages
##RUN npm audit fix

WORKDIR /ng-app

COPY . .
`

Now, it seems that the container can be with no issue.

Errors when running docker-compose

I am following the quick start guide and the step where you run docker-compose up gives me the following errors:

------
 > [colid-setup-colid-editor-frontend build-phase 8/8] RUN $(npm bin)/ng build --configuration=docker --build-optimizer=false --output-hashing=all:
#0 0.826 Node.js version v12.22.12 detected.
#0 0.826 The Angular CLI requires a minimum Node.js version of either v14.15, or v16.10.
#0 0.826 
#0 0.826 Please update your Node.js version or visit https://nodejs.org/ for additional instructions.
#0 0.826 
------
failed to solve: executor failed running [/bin/sh -c $(npm bin)/ng build --configuration=$ANGULAR_ENVIRONMENT --build-optimizer=false --output-hashing=all]: exit code: 3

This error probably occurs for all submodules that have Angular CLI as a dependency and uses node:12 in their corresponding Dockerfiles, meaning:

• COLID-Data-Marketplace-Frontend
• COLID-Editor-Frontend
• KGE-Frontend
• COLID-ResourceRelationshipManager-Frontend

Kind Regards,
Matthias

Docker Compose error with COLID.AppDataService.WebApi/WebApi.csproj

This step in RUN dotnet restore COLID.AppDataService.WebApi/WebApi.csproj: is failing with

Retrying 'FindPackagesByIdAsync' for source 'https://api.nuget.org/v3-flatcontainer/microsoft.extensions.logging.eventlog/index.json'.
176.1 Resource temporarily unavailable
189.0 Failed to download package 'Microsoft.Extensions.Logging.Debug.3.1.3' from 'https://api.nuget.org/v3-flatcontainer/microsoft.extensions.logging.debug/3.1.3/microsoft.extensions.logging.debug.3.1.3.nupkg'.

Installing COLID on a remote server

Hi,

we would like to install COLID on a remote server, with its alias name, like: server1.domain.com.

We have seen that each component has two different types of configuration files related to the component communication and redirection, namely: filename.local.ts and filename.docker.ts.

When using the docker environment, some of these filename.docker.ts have http://localhost:PortNumber and in some other ones is used http:/dockerName:PortNumber. We already tried to replaced the "http://localhost:PortNumber" with "http://server1.domain.com:PortNumber", but it seems that we are missing something. As a result, the COLID interface is always on loading mode and the console is printing the following error:

`

colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:30 +0000] "GET /resource/welcome HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:30 +0000] "GET /scripts.b8e5d1190db440f00190.js HTTP/1.1" 304 0 "http://serverName.domain.com:4200/resource/welcome" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:30 +0000] "GET /styles.b44528733417fc5406ce.css HTTP/1.1" 200 38931 "http://serverName.domain.com:4200/resource/welcome" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:30 +0000] "GET /runtime-es2015.8a25b1b8e8d848b9dd36.js HTTP/1.1" 304 0 "http://serverName.domain.com:4200/resource/welcome" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:30 +0000] "GET /polyfills-es2015.72382377d643e30d0520.js HTTP/1.1" 304 0 "http://serverName.domain.com:4200/resource/welcome" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:30 +0000] "GET /main-es2015.13a4023b4a9159c609e2.js HTTP/1.1" 304 0 "http://serverName.domain.com:4200/resource/welcome" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:31 +0000] "GET /assets/BAG_COLID-Visual_white_lh.svg HTTP/1.1" 200 3143 "http://serverName.domain.com:4200/resource/welcome" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:31 +0000] "GET /assets/BAG_COLID-Visual_coloured_with-Claim_lh.svg HTTP/1.1" 200 10092 "http://serverName.domain.com:4200/resource/welcome" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:31 +0000] "GET /assets/BAG-logo.svg HTTP/1.1" 200 2370 "http://serverName.domain.com:4200/resource/welcome" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-registration-service | fail: COLID.Exception.ExceptionMiddleware[0]
colid-registration-service | A HTTP Error occurred while trying to make the SPARQL Query, see inner exception for details
colid-registration-service | VDS.RDF.Query.RdfQueryException: A HTTP Error occurred while trying to make the SPARQL Query, see inner exception for details
colid-registration-service | ---> System.Net.WebException: The remote server returned an error: (403) Forbidden.
colid-registration-service | at System.Net.HttpWebRequest.GetResponse()
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.ExecuteQuery(Uri target, String postData, String accept)
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryInternal(String sparqlQuery, String acceptHeader)
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(ISparqlResultsHandler handler, String sparqlQuery)
colid-registration-service | --- End of inner exception stack trace ---
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(ISparqlResultsHandler handler, String sparqlQuery)
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(String sparqlQuery)
colid-registration-service | at COLID.Graph.TripleStore.Repositories.TripleStoreRepository.QueryTripleStoreResultSet(SparqlParameterizedString queryString) in /src/libs/COLID.Graph/TripleStore/Repositories/TripleStoreRepository.cs:line 34
colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.b__10_0() in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 127
colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry, TimeSpan expirationTime) in /src/libs/COLID.Cache/Services/CacheService.cs:line 150 colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry) in /src/libs/COLID.Cache/Services/CacheService.cs:line 135
colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.GetLatestConfiguration() in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 101
colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.GetGraphs(String graphType, String configIdentifier) in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 223
colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.GetGraphs(IEnumerable1 graphTypes) in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 235 colid-registration-service | at COLID.RegistrationService.Repositories.Implementation.TaxonomyRepository.GetTaxonomies(String type) in /src/src/COLID.RegistrationService.Repositories/Implementation/TaxonomyRepository.cs:line 84 colid-registration-service | at COLID.RegistrationService.Services.Implementation.TaxonomyService.<>c__DisplayClass4_0.<GetTaxonomies>b__0() in /src/src/COLID.RegistrationService.Services/Implementation/TaxonomyService.cs:line 55 colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry, TimeSpan expirationTime) in /src/libs/COLID.Cache/Services/CacheService.cs:line 150
colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry) in /src/libs/COLID.Cache/Services/CacheService.cs:line 135 colid-registration-service | at COLID.RegistrationService.Services.Implementation.TaxonomyService.GetTaxonomies(String taxonomyType) in /src/src/COLID.RegistrationService.Services/Implementation/TaxonomyService.cs:line 53 colid-registration-service | at lambda_method(Closure , Object , Object[] ) colid-registration-service | at Microsoft.Extensions.Internal.ObjectMethodExecutor.Execute(Object target, Object[] parameters) colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.SyncActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeActionMethodAsync() colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeNextActionFilterAsync() colid-registration-service | --- End of stack trace from previous location where exception was thrown --- colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context) colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeInnerFilterAsync() colid-registration-service | --- End of stack trace from previous location where exception was thrown --- colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeNextResourceFilter>g__Awaited|24_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Rethrow(ResourceExecutedContextSealed context) colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.InvokeFilterPipelineAsync() colid-registration-service | --- End of stack trace from previous location where exception was thrown --- colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Logged|17_1(ResourceInvoker invoker) colid-registration-service | at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger) colid-registration-service | at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context) colid-registration-service | at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context) colid-registration-service | at COLID.Exception.ExceptionMiddleware.InvokeAsync(HttpContext httpContext) in /src/libs/COLID.Exception/ExceptionMiddleware.cs:line 48 colid-appdata-service | dbug: COLID.Cache.Services.CacheService[0] colid-appdata-service | Get key colid:appdataservice:docker:welcomemessageservice:editor colid-registration-service | fail: COLID.Exception.ExceptionMiddleware[0] colid-registration-service | A HTTP Error occurred while trying to make the SPARQL Query, see inner exception for details colid-registration-service | VDS.RDF.Query.RdfQueryException: A HTTP Error occurred while trying to make the SPARQL Query, see inner exception for details colid-registration-service | ---> System.Net.WebException: The remote server returned an error: (403) Forbidden. colid-registration-service | at System.Net.HttpWebRequest.GetResponse() colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.ExecuteQuery(Uri target, String postData, String accept) colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryInternal(String sparqlQuery, String acceptHeader) colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(ISparqlResultsHandler handler, String sparqlQuery) colid-registration-service | --- End of inner exception stack trace --- colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(ISparqlResultsHandler handler, String sparqlQuery) colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(String sparqlQuery) colid-registration-service | at COLID.Graph.TripleStore.Repositories.TripleStoreRepository.QueryTripleStoreResultSet(SparqlParameterizedString queryString) in /src/libs/COLID.Graph/TripleStore/Repositories/TripleStoreRepository.cs:line 34 colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.<GetLatestConfiguration>b__10_0() in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 127 colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry, TimeSpan expirationTime) in /src/libs/COLID.Cache/Services/CacheService.cs:line 150
colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry) in /src/libs/COLID.Cache/Services/CacheService.cs:line 135 colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.GetLatestConfiguration() in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 101 colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.GetGraphs(String graphType, String configIdentifier) in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 223 colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.GetGraphs(IEnumerable1 graphTypes) in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 235
colid-registration-service | at COLID.Graph.TripleStore.Repositories.BaseRepository1.GetNamedSubGraphs(IEnumerable1 namedGraphs) in /src/libs/COLID.Graph/TripleStore/Repositories/BaseRepository.cs:line 370
colid-registration-service | at COLID.RegistrationService.Repositories.Implementation.ConsumerGroupRepository.GetConsumerGroupsByLifecycleStatus(String lifecycleStatus) in /src/src/COLID.RegistrationService.Repositories/Implementation/ConsumerGroupRepository.cs:line 45
colid-registration-service | at COLID.RegistrationService.Services.Implementation.ConsumerGroupService.b__9_0() in /src/src/COLID.RegistrationService.Services/Implementation/ConsumerGroupService.cs:line 80
colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry, TimeSpan expirationTime) in /src/libs/COLID.Cache/Services/CacheService.cs:line 150 colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry) in /src/libs/COLID.Cache/Services/CacheService.cs:line 135
colid-registration-service | at COLID.RegistrationService.Services.Implementation.ConsumerGroupService.GetActiveEntities() in /src/src/COLID.RegistrationService.Services/Implementation/ConsumerGroupService.cs:line 80
colid-registration-service | at lambda_method(Closure , Object , Object[] )
colid-registration-service | at Microsoft.Extensions.Internal.ObjectMethodExecutor.Execute(Object target, Object[] parameters)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.SyncActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeActionMethodAsync()
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeNextActionFilterAsync()
colid-registration-service | --- End of stack trace from previous location where exception was thrown ---
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeInnerFilterAsync()
colid-registration-service | --- End of stack trace from previous location where exception was thrown ---
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|24_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Rethrow(ResourceExecutedContextSealed context)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.InvokeFilterPipelineAsync()
colid-registration-service | --- End of stack trace from previous location where exception was thrown ---
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Logged|17_1(ResourceInvoker invoker)
colid-registration-service | at Microsoft.AspNetCore.Routing.EndpointMiddleware.g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
colid-registration-service | at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
colid-registration-service | at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
colid-registration-service | at COLID.Exception.ExceptionMiddleware.InvokeAsync(HttpContext httpContext) in /src/libs/COLID.Exception/ExceptionMiddleware.cs:line 48
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:31 +0000] "GET /assets/icons/icon-180x180.png HTTP/1.1" 200 9927 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-editor-frontend | 10.142.179.2 - - [08/Nov/2021:11:21:31 +0000] "GET /assets/BAG_COLID-Visual_coloured_Signet_lh.svg HTTP/1.1" 200 1654 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"
colid-registration-service | fail: COLID.Exception.ExceptionMiddleware[0]
colid-registration-service | A HTTP Error occurred while trying to make the SPARQL Query, see inner exception for details
colid-registration-service | VDS.RDF.Query.RdfQueryException: A HTTP Error occurred while trying to make the SPARQL Query, see inner exception for details
colid-registration-service | ---> System.Net.WebException: The remote server returned an error: (403) Forbidden.
colid-registration-service | at System.Net.HttpWebRequest.GetResponse()
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.ExecuteQuery(Uri target, String postData, String accept)
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryInternal(String sparqlQuery, String acceptHeader)
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(ISparqlResultsHandler handler, String sparqlQuery)
colid-registration-service | --- End of inner exception stack trace ---
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(ISparqlResultsHandler handler, String sparqlQuery)
colid-registration-service | at VDS.RDF.Query.SparqlRemoteEndpoint.QueryWithResultSet(String sparqlQuery)
colid-registration-service | at COLID.Graph.TripleStore.Repositories.TripleStoreRepository.QueryTripleStoreResultSet(SparqlParameterizedString queryString) in /src/libs/COLID.Graph/TripleStore/Repositories/TripleStoreRepository.cs:line 34
colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.b__10_0() in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 127
colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry, TimeSpan expirationTime) in /src/libs/COLID.Cache/Services/CacheService.cs:line 150 colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry) in /src/libs/COLID.Cache/Services/CacheService.cs:line 135
colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.GetLatestConfiguration() in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 101
colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataGraphConfigurationRepository.GetGraphs(String graphType, String configIdentifier) in /src/libs/COLID.Graph/Metadata/Repositories/MetadataGraphConfigurationRepository.cs:line 223
colid-registration-service | at COLID.Graph.Metadata.Repositories.MetadataRepository.GetLeafEntityTypes(String firstEntityType) in /src/libs/COLID.Graph/Metadata/Repositories/MetadataRepository.cs:line 261
colid-registration-service | at COLID.Graph.Metadata.Services.MetadataService.<>c__DisplayClass15_0.b__0() in /src/libs/COLID.Graph/Metadata/Services/MetadataService.cs:line 274
colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry, TimeSpan expirationTime) in /src/libs/COLID.Cache/Services/CacheService.cs:line 150 colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry) in /src/libs/COLID.Cache/Services/CacheService.cs:line 135
colid-registration-service | at COLID.Graph.Metadata.Services.MetadataService.GetLeafEntityTypes(String firstEntityType) in /src/libs/COLID.Graph/Metadata/Services/MetadataService.cs:line 273
colid-registration-service | at COLID.Graph.TripleStore.Services.BaseEntityService5.GetEntities(EntitySearch search) in /src/libs/COLID.Graph/TripleStore/Services/BaseEntityService.cs:line 121 colid-registration-service | at COLID.RegistrationService.Services.Implementation.PidUriTemplateService.<>n__0(EntitySearch search) colid-registration-service | at COLID.RegistrationService.Services.Implementation.PidUriTemplateService.<>c__DisplayClass4_0.<GetEntities>b__0() in /src/src/COLID.RegistrationService.Services/Implementation/PidUriTemplateService.cs:line 52 colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func1 addEntry, TimeSpan expirationTime) in /src/libs/COLID.Cache/Services/CacheService.cs:line 150
colid-registration-service | at COLID.Cache.Services.CacheService.GetOrAdd[T](String key, Func`1 addEntry) in /src/libs/COLID.Cache/Services/CacheService.cs:line 135
colid-registration-service | at COLID.RegistrationService.Services.Implementation.PidUriTemplateService.GetEntities(EntitySearch search) in /src/src/COLID.RegistrationService.Services/Implementation/PidUriTemplateService.cs:line 52
colid-registration-service | at lambda_method(Closure , Object , Object[] )
colid-registration-service | at Microsoft.Extensions.Internal.ObjectMethodExecutor.Execute(Object target, Object[] parameters)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.SyncActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeActionMethodAsync()
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeNextActionFilterAsync()
colid-registration-service | --- End of stack trace from previous location where exception was thrown ---
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeInnerFilterAsync()
colid-registration-service | --- End of stack trace from previous location where exception was thrown ---
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|24_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Rethrow(ResourceExecutedContextSealed context)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.InvokeFilterPipelineAsync()
colid-registration-service | --- End of stack trace from previous location where exception was thrown ---
colid-registration-service | at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Logged|17_1(ResourceInvoker invoker)
colid-registration-service | at Microsoft.AspNetCore.Routing.EndpointMiddleware.g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
colid-registration-service | at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
colid-registration-service | at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
colid-registration-service | at COLID.Exception.ExceptionMiddleware.InvokeAsync(HttpContext httpContext) in /src/libs/COLID.Exception/ExceptionMiddleware.cs:line 67
colid-registration-service | Error: Unable to submit event {@logentry}
colid-registration-service | Error: Unable to submit event {@logentry}
colid-registration-service | Error: Unable to submit event {@logentry}
colid-registration-service | Error: Unable to submit event {@logentry}
colid-registration-service | Error: Unable to submit event {@logentry}
colid-registration-service | Error: Unable to submit event {@logentry}

`

Best,
Lavdim