neclow / serab Goto Github PK
View Code? Open in Web Editor NEWSERAB: a multi-lingual benchmark for speech emotion recognition
License: MIT License
SERAB: a multi-lingual benchmark for speech emotion recognition
License: MIT License
Hi @Neclow,
I failed to build AESDD dataset using your recipe
(serab) bagus@pc-omen:aesdd$ tfds build
2022-11-16 16:56:17.762030: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-11-16 16:56:17.850300: E tensorflow/stream_executor/cuda/cuda_blas.cc:2981] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2022-11-16 16:56:18.243007: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/home/bagus/miniconda3/envs/serab/lib/:/var/lib/docker/overlay2/b2c6c735b823297983b5e6d11c64147f8307a4ece255c7f36276dd9066cf8142/diff/usr/lib/x86_64-linux-gnu/
2022-11-16 16:56:18.243052: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/home/bagus/miniconda3/envs/serab/lib/:/var/lib/docker/overlay2/b2c6c735b823297983b5e6d11c64147f8307a4ece255c7f36276dd9066cf8142/diff/usr/lib/x86_64-linux-gnu/
2022-11-16 16:56:18.243059: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
2022-11-16 16:56:19.449061: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:980] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-11-16 16:56:19.454121: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/home/bagus/miniconda3/envs/serab/lib/:/var/lib/docker/overlay2/b2c6c735b823297983b5e6d11c64147f8307a4ece255c7f36276dd9066cf8142/diff/usr/lib/x86_64-linux-gnu/
2022-11-16 16:56:19.454137: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1934] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
INFO[build.py]: Loading dataset from path: /home/bagus/github/SERAB/tensorflow_datasets/aesdd/aesdd.py
2022-11-16 16:56:19.457076: W tensorflow/core/platform/cloud/google_auth_provider.cc:184] All attempts to get a Google authentication bearer token failed, returning an empty token. Retrieving token from files failed with "NOT_FOUND: Could not locate the credentials file.". Retrieving token from GCE failed with "FAILED_PRECONDITION: Error executing an HTTP request: libcurl code 6 meaning 'Couldn't resolve host name', error details: Could not resolve host: metadata".
INFO[build.py]: download_and_prepare for dataset aesdd/1.0.0...
INFO[dataset_builder.py]: Generating dataset aesdd (/home/bagus/tensorflow_datasets/aesdd/1.0.0)
Downloading and preparing dataset Unknown size (download: Unknown size, generated: Unknown size, total: Unknown size) to /home/bagus/tensorflow_datasets/aesdd/1.0.0...
INFO[download_manager.py]: Reusing extraction of /home/bagus/tensorflow_datasets/downloads/manual/Acted Emotional Speech Dynamic Database.zip at /home/bagus/tensorflow_datasets/downloads/extracted/ZIP.Acted Emotional Speech Dynamic Database.zip.
Extraction completed...: 0 file [00:00, ? file/s]
Generating splits...: 0%| Traceback (most recent call last): | 0/3 [00:00<?, ? splits/s]
File "/home/bagus/miniconda3/envs/serab/bin/tfds", line 8, in <module>
sys.exit(launch_cli())
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/scripts/cli/main.py", line 126, in launch_cli
app.run(main, flags_parser=_parse_flags)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/absl/app.py", line 308, in run
_run_main(main, args)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/absl/app.py", line 254, in _run_main
sys.exit(main(argv))
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/scripts/cli/main.py", line 121, in main
args.subparser_fn(args)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/scripts/cli/build.py", line 199, in _build_datasets
_download_and_prepare(args, builder)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/scripts/cli/build.py", line 355, in _download_and_prepare
builder.download_and_prepare(
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/dataset_builder.py", line 439, in download_and_prepare
self._download_and_prepare(
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/dataset_builder.py", line 1155, in _download_and_prepare
split_info_futures = [
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/dataset_builder.py", line 1156, in <listcomp>
split_builder.submit_split_generation( # pylint: disable=g-complex-comprehension
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/split_builder.py", line 291, in submit_split_generation
return self._build_from_generator(**build_kwargs)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/split_builder.py", line 361, in _build_from_generator
utils.reraise(e, prefix=f'Failed to encode example:\n{example}\n')
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/split_builder.py", line 359, in _build_from_generator
example = self._features.encode_example(example)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/features/features_dict.py", line 198, in encode_example
utils.reraise(
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/features/features_dict.py", line 196, in encode_example
example[k] = feature.encode_example(example_value)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/features/audio_feature.py", line 97, in encode_example
utils.reraise(e, prefix=f'Error for {filename}: ')
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/features/audio_feature.py", line 95, in encode_example
return self._encode_file(audio_f, file_format)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/tensorflow_datasets/core/features/audio_feature.py", line 75, in _encode_file
audio_segment = lazy_imports_lib.lazy_imports.pydub.AudioSegment.from_file(
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/pydub/audio_segment.py", line 728, in from_file
info = mediainfo_json(orig_file, read_ahead_limit=read_ahead_limit)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/site-packages/pydub/utils.py", line 279, in mediainfo_json
info = json.loads(output)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/json/__init__.py", line 357, in loads
return _default_decoder.decode(s)
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/home/bagus/miniconda3/envs/serab/lib/python3.8/json/decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Failed to encode example:
{'audio': '/home/bagus/tensorflow_datasets/downloads/extracted/ZIP.Acted Emotional Speech Dynamic Database.zip/Acted Emotional Speech Dynamic Database/anger/a16 (2).wav', 'label': 'anger', 'speaker_id': '2'}
In <Audio> with name "audio":
Error for /home/bagus/tensorflow_datasets/downloads/extracted/ZIP.Acted Emotional Speech Dynamic Database.zip/Acted Emotional Speech Dynamic Database/anger/a16 (2).wav: Expecting value: line 1 column 1 (char 0)
I am wondering what tensorflow version you used to build the dataset. Mine used TF 2.10. Also, the requirement of tensorflow is not stated in serab.yaml
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.