Comments (4)
I have found the problem, I split the code into two stages and load the optimal model to generate latent vector for SVC. But actually the weight of AD-GCL changes as the SVC training. Is my expression correct? I have save the latent vector and then load the latent vector, then training SVC. The performance is getting close to your report. Thank you for your kind suggestion and your work is excellent~
from adgcl.
Thanks for looking into our work.
So the protocol we use for unsupervised learning is that during training, model (GNN) is only trained using self-supervised AD-GCL. During evaluation we use the frozen GNN and train a linear classifier on top. These are the reported values.
In your case, it is possible to train both AD-GCL and linear head together as long as you introduce a stop gradient right before the linear head to match the unsupervised protocol. Did you try this way ?
Thanks,
Susheel
from adgcl.
Thanks for your reply~
Yes. I have tried this way. I would see the latent vector distribution, such as TSNE for visualization.(I thought this training strategy is nearly the same as your code). After self-supervised learning (AD-GCL), which doesn't introduce the label information. And I could obtain the latent vector (embeded dim x 1) for each graph. Then I train a linear SVC for the downstream task(supervised). But the performance is not good enough.
from adgcl.
Hi, it would be great if you could be a little more specific. Which dataset? did you train linear svc at different epochs of AD-GCL training? What were the hyperparameters? Like for e.g., TU dataset we do k-fold evaluation. Did you do that ?
from adgcl.
Related Issues (7)
- Questions about the transfer learning HOT 2
- Question about ablation study in unsupervised learning HOT 7
- How to reproduce the results of baselines on OGBG? HOT 2
- Can adgcl be used on single graph for node-level task? HOT 2
- Some questions concerning \lambda_{reg} and drop rate
- About pretraining models
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from adgcl.