Comments (6)
@zhouzx17 Please help @y0ngjaenious find our processing scripts.
from aw_nas.
And one more thing! How did you feed ENAS and NB301 data to GCN?
Did you do the line-graph conversion trick on those datasets? And did you use shared GCN on each cell in a cell group(and concat the final embedding?)?
Thank you for reading this issue.
I am very appreciated of your good research.
from aw_nas.
Many thanks for your interest!
And one more thing! How did you feed ENAS and NB301 data to GCN? Did you do the line-graph conversion trick on those datasets?
No, we didn't do the line-graph conversion trick. We build TA-GATES based on our previous study GATES. I personally recommend reading GATES, it gives a very simple-to-understand description of predictor-based NAS as well as the idea of designing proper encoding for data-processing NN architectures. GATES designs corresponding GCNs for "op-on-the-edge" graphs (such as graphs in ENAS, NB301) as well as "op-on-the-node" graphs (such as graphs in NB101). Different code is used to implement the GCN for these two types of spaces. For example, this is the TA-GATES code for architectures in NB301, and this is the TA-GATES code for architectures in NB101. Despite the separate implementation, the underlying "idea" of encoding an architecture is the same, that is, to mimic the information processing (an operation --- no matter whether it is on an edge or on a node --- is modeled as a "transformation" of the propagating information) in GATES, and to also mimic the back-propagating information processing in TA-GATES.
We compare with the "line-graph conversion + GCN" solution on NB201 in both our GATES and TA-GATES papers. You can refer to the GATES paper (search for "line graph" keyword in the paper) for the discussion.
And did you use shared GCN on each cell in a cell group(and concat the final embedding)?
Yes, we use a shared GCN for different cell types (i.e., the normal cell and the reduce cell), and then concatenate the final embedding. The concatenation is implemented by a simple reshape here.
If you have any further questions, please do not hesitate to ask.
from aw_nas.
Dear TA-GATES authors,
I'm trying to figure out how your pre-processed pickle file of ENAS, NB301 dataset for TA-GATES is formed. Can you provide pre-processing codes for theses datasets?
Cheers.
Hi, y0ngjaenious, you can find our preprocess scripts in here.
Specifically, these two scripts can help to convert the original format of architectures' to the adjacency matrix in ENAS and NB301 search spaces.
Let us know if you have other questions.
from aw_nas.
@walkerning Oh, what I mean by "GCN" is your baseline method GCN[10]! How can you feed architectures into it?
@zhouzx17 Thank you for your reply! That will be very helpful for me!
BTW, I really appreciate your fast reply!! :)
from aw_nas.
Oh, what I mean by "GCN" is your baseline method GCN[10]! How can you feed architectures into it?
For the "GCN" encoder on NB301 and ENAS, we implement it following the cited NeurIPS'19 work, here is the implementation https://github.com/walkerning/aw_nas/blob/master/aw_nas/evaluator/arch_network.py#L128
This encoder cannot get the same representation for isomorphic graphs, we have discussed two of its simple failure cases in the GATES's appendix Fig.1.
from aw_nas.
Related Issues (20)
- Hardware: Profiling Network Generation Problem
- About FTT-NAS GPU search problem... HOT 3
- I seem to found a small bug in your FTT-NAS project... HOT 4
- After you revised the project last time, I tried to run FTT-NAS search. It was normal at first, but after 10epochs were found, an error was reported when running the test() method... HOT 3
- ray_dispatcher
- ray version HOT 1
- Adversarial Supernet training HOT 5
- Similar DAG encoding scheme to an existing paper HOT 1
- Generate sample config error and FBNet support? HOT 1
- nasbench.api.OutOfDomainError: unsupported op none HOT 1
- The program is stuck in an endless loop, when run awnas search examples/nasbench/nasbench-101_gates_sa.yaml HOT 1
- How to tune each rollout and how to use the Pareto-based EA HOT 2
- In aw_nas/aw_nas/objective/zerocost.py, the module foresight cannot be imported. HOT 2
- How to change the environment variable “AWNAS_HOME“ HOT 2
- Missing data dumping code for NAS-Bench-201 in gates. HOT 2
- Question about the supernet training?
- question about supernet training.
- Code for TA-GATES HOT 3
- Regrading TA-GATES dataset HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aw_nas.