Comments (2)
After delete req/res pointers in edge_sampler.py and neighbor_sampler.py, memory leak is gone.
diff --git a/graphlearn/python/sampler/edge_sampler.py b/graphlearn/python/sampler/edge_sampler.py
index 4103ca1..79ab314 100644
--- a/graphlearn/python/sampler/edge_sampler.py
+++ b/graphlearn/python/sampler/edge_sampler.py
@@ -83,6 +83,8 @@ class EdgeSampler(object):
src_ids,
dst_ids)
edges.edge_ids = edge_ids
+ pywrap.del_get_edge_req(req)
+ pywrap.del_get_edge_res(res)
return edges
diff --git a/graphlearn/python/sampler/neighbor_sampler.py b/graphlearn/python/sampler/neighbor_sampler.py
index 1757f12..b912e50 100644
--- a/graphlearn/python/sampler/neighbor_sampler.py
+++ b/graphlearn/python/sampler/neighbor_sampler.py
@@ -124,6 +124,8 @@ class NeighborSampler(object):
current_batch_size = nbr_ids_flat.size
src_ids = nbr_ids
+ pywrap.del_nbr_req(req)
+ pywrap.del_nbr_res(res)
return layers
def _make_req(self, index, src_ids):
@@ -200,4 +202,6 @@ class FullNeighborSampler(NeighborSampler):
current_batch_size = nbr_ids_flat.size
src_ids = nbr_ids
+ pywrap.del_nbr_req(req)
+ pywrap.del_nbr_res(res)
return layers
When I want to provide feedback,i see this #46 , more modifications. Awesome!
from graph-learn.
@fff-2013 Sorry to trouble you and thanks for pointing out the problem. We've fixed it and you can try again.
from graph-learn.
Related Issues (20)
- Current Version whether support Caching Neighbors of Important Vertices HOT 5
- 是否支持pyspark数据格式的输入? HOT 1
- About quick start issue HOT 1
- 请问在执行tutorial的过程中helm install dgs-u2i dgs/dgs报错是为什么
- 执行tutorial的时候k8s中有些pod启动失败 HOT 10
- Provide Instructions for macOS installation?
- [BUG] GraphLearn doesn't work with Python 3.10 & Python 3.11
- GraphLearn动态图在线推理仅支持TopK采样吗? HOT 3
- 与其他GNN框架的性能对比 HOT 1
- 目前Graph-learn是用vineyard的哪个结构来存储图拓扑 HOT 1
- dgs部署失败 HOT 1
- 使用当前tutorial中的代码示例无法完成载图操作,在进行string类型特征的时候,导入出现问题。
- 参考tutorial中进行dist.yaml的分布式训练时,worker产生了Unimplemented和Unavailable的报错 HOT 4
- Training process triggered core dump
- 相同参数情况下 分布式和单机训练模型精度出现差异 HOT 1
- Cannot use pip3 to install graph-learn HOT 1
- graph-learn 引入 pywrap_graphlearn包报错, 咨询是因为 Mac M1芯片不兼容, 有没有其他的兼容方案?
- Error occurs when running gl on ps mode
- readthedocs 文档格式紊乱
- 项目更新不太活跃
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from graph-learn.