Comments (2)
Hi, which branch of hugectr did you use? I can't reproduce the problem on branch 'release-23.02' and image 'nvcr.io/nvidia/merlin/merlin-hugectr:23.02'.
from hugectr.
Thanks!
I will check the version and retry later.
Currently I'm using ETC to train 1TB criteo data with, could you please check this issue? I'm kind of stuck in training multiple day's of data. It seems some problem with my slot_size_array
setting.
from hugectr.
Related Issues (20)
- [Question] How to serve TF2 SOK model in Triton Inference and convert it to ONNX? HOT 1
- [Question] Difference between Embedding Training Cache and GPU Embedding Cache HOT 9
- Support for configuration issues HOT 1
- [Question] How can I pre-calculate the GPU memory required for embedding cache size? HOT 2
- [Question] nv_gpu_cache compiling problem HOT 1
- [BUG] Encountered ETC error of din model when training with multiple keyset. HOT 3
- Trouble installing hugectr_backend for Triton Server HOT 1
- sok-experiment static_map empty_key_sentinel and reclaimed_key_sentinel is not right for int64 [BUG] HOT 4
- [BUG] CUDNN_STATUS_MAPPING_ERROR with cudnnSetStream HOT 21
- build docker failed with 401 Unauthorized (Set Up the Development Environment With Merlin Containers) HOT 4
- [BUG]preprocess.sh 1 criteo failed with 'Schema' object has no attribute 'write' HOT 1
- [Question] Is there pipeline mechanism to help the lookup requests always be handled on device cache in HugeCTR? HOT 1
- [Question] How to dump incremental model to kafka in Release 23.12? HOT 2
- [BUG] Run sok tests error HOT 1
- [BUG] Seg Fault When Deploying TF+HPS Model with merlin-tensorflow HOT 9
- [BUG] cudaErrorIllegalAddress: an illegal memory access was encounteredThread HOT 4
- [BUG]build failed on gtest! HOT 5
- [Question] Can i read parquet data from HDFS? HOT 6
- [Question] Is there any related architecture design or documentation for embedding collection HOT 2
- [BUG] Enabling regularization causes CUDNN_STATUS_MAPPING_ERROR for deepfm example HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hugectr.