hulatang / ceres-combineharvester Goto Github PK

Would it be possible to add a new coin and generate the ca/ssl and load them without restarting the entire harvester process? Especially if you have a lot of plots to load and forks which are already running, this would be highly valuable.

Cheers,
duderino999

When running “git clone https://github.com/hulatangeric/Ceres-CombineHarvester.git” command it asks for username and password.

While the previous version worked fine for me, I updated to the newest version to let more coins to be managed by ceres. However, now I encountered a weird problem for almost all coins from the log. A example is:

2021-10-29T18:10:57.724 farmer mogua.farmer.farmer        : ERROR    Harvester did not respond. You might need to update harvester to the latest version
2021-10-29T18:12:42.455 farmer mogua.farmer.farmer        : ERROR    Harvester did not respond. You might need to update harvester to the latest version
2021-10-29T18:14:28.804 farmer mogua.farmer.farmer        : WARNING  Respond plots came too late
2021-10-29T18:14:28.809 farmer mogua.farmer.farmer        : ERROR    Harvester did not respond. You might need to update harvester to the latest version
2021-10-29T18:15:29.556 farmer mogua.farmer.farmer        : WARNING  Respond plots came too late
2021-10-29T18:15:30.565 farmer mogua.farmer.farmer        : WARNING  Respond plots came too late
2021-10-29T18:31:27.160 farmer mogua.farmer.farmer        : ERROR    Harvester did not respond. You might need to update harvester to the latest version
2021-10-29T18:33:08.699 farmer mogua.farmer.farmer        : WARNING  Respond plots came too late
2021-10-29T18:33:12.700 farmer mogua.farmer.farmer        : ERROR    Harvester did not respond. You might need to update harvester to the latest version
2021-10-29T18:33:32.796 farmer mogua.farmer.farmer        : WARNING  Respond plots came too late

How could this problem be resolved?

When using vanilla chia, harvester peer_node_id can be obtained in:
the last line of chia/harvester/harvester.py: (function setServer)

def set_server(self, server):
        self.server = server

node_id can be found in: server.node_id

This peer_node_id correspond to data returned in get_harvesters RPC call.

But now, with ceres-combineharvester, the correct peer_node_id can NOT be obtained in the same way.

How to get the peer_node_id of chia(or any other coin) when using ceres?

Hi,

first of all, thanks for your work, its great.

I updated Goldcoin to v1.3, which already uses v2 database. It seems that ceres isn't working anymore with this update.

I guess Chia/other Forks will also soon update to this version, are there updates planned?

Br Raldemar

I follow these steps:
git clone https://github.com/hulatang/ceres-combineharvester.git
cd ceres-combineharvester/
sudo chmod +x install.sh
./install.sh
. ./activate
ceres init
vim ~/.ceres/mainnet/config/coins_config.yaml # uncomment -flax
ceres init --coins
ceres generate_ssl

Then, when I try to add plot directory, I get KeyError for "plot_directories":
ceres coin plots add -d /plots/$dir

Unable to check permissions for /home/dong/.ceres/mainnet/config/ssl/ca/chia_ca.crt: file /home/dong/.ceres/mainnet/config/ssl/ca/chia_ca.crt does not exist
Unable to check permissions for /home/dong/.ceres/mainnet/config/ssl/ca/chia_ca.crt: file /home/dong/.ceres/mainnet/config/ssl/ca/chia_ca.crt does not exist
Unable to check permissions for /home/dong/.ceres/mainnet/config/ssl/ca/chia_ca.key: file /home/dong/.ceres/mainnet/config/ssl/ca/chia_ca.key does not exist
Unable to check permissions for /home/dong/.ceres/mainnet/config/ssl/ca/chia_ca.key: file /home/dong/.ceres/mainnet/config/ssl/ca/chia_ca.key does not exist
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@             WARNING: UNPROTECTED SSL FILE!              @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
Permissions 0664 for '/home/dong/ceres-combineharvester/mozilla-ca/cacert.pem' are too open. Expected 0644
One or more SSL files were found with permission issues.
Run `ceres init --fix-ssl-permissions` to fix issues.
Traceback (most recent call last):
  File "/home/dong/ceres-combineharvester/venv/bin/ceres", line 33, in <module>
    sys.exit(load_entry_point('ceres-blockchain', 'console_scripts', 'ceres')())
  File "/home/dong/ceres-combineharvester/ceres/cmds/ceres.py", line 144, in main
    cli()  # pylint: disable=no-value-for-parameter
  File "/home/dong/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/home/dong/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/home/dong/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/dong/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/dong/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/dong/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/home/dong/ceres-combineharvester/venv/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/home/dong/ceres-combineharvester/ceres/cmds/plots.py", line 190, in add_cmd
    add_plot_directory(ctx.obj["root_path"], final_dir)
  File "/home/dong/ceres-combineharvester/ceres/plotting/util.py", line 74, in add_plot_directory
    if str(Path(str_path).resolve()) not in get_plot_directories(root_path, config):
  File "/home/dong/ceres-combineharvester/ceres/plotting/util.py", line 57, in get_plot_directories
    return config["plot_directories"]
KeyError: 'plot_directories'

I tried to add ['harvester'] after config to fix the error message, but I am not sure whether this would successfully add the directory. To check it, however, I get KeyError on harvester when running ceres plots show:

Traceback (most recent call last):
  File "venv/bin/ceres", line 33, in <module>
    sys.exit(load_entry_point('ceres-blockchain', 'console_scripts', 'ceres')())
  File "/ceres-combineharvester/ceres/cmds/ceres.py", line 144, in main
    cli()  # pylint: disable=no-value-for-parameter
  File "/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/ceres-combineharvester/venv/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/ceres-combineharvester/ceres/cmds/plots.py", line 212, in show_cmd
    show_plots(ctx.obj["root_path"])
  File "/ceres-combineharvester/ceres/cmds/plots.py", line 23, in show_plots
    for str_path in get_plot_directories(root_path):
  File "/ceres-combineharvester/ceres/plotting/util.py", line 58, in get_plot_directories
    return config['harvester']["plot_directories"]
KeyError: 'harvester'

By the way, why is it still looking for "chia_ca.crt" which is set in ceres/util/initial-config.yaml and should be fixed.

Describe the bug
Ceres does not work with the newest version of Seno and Littlelambocoin. Additionally, does ceres work with Silicoin forks (Gold, Profit, Petroleum and Ecostake)? There seems to be Silicoin configuration but I cannot get it to work.

To Reproduce

Just clone each of the above git repos. Set up in ceres following instructions here. It seems that the ceres harvester cannot connect to the farmers. I have written a script to set things up (so the setup should be similar with other coins) and other dozens of coins I am farming are working properly.

When I run "ceres init --coins", it fails with the following error:

(venv) nameless@harvester:~/.ceres/mainnet$ ceres init --coins Unable to check permissions for /home/nameless/.ceres/mainnet/config/ssl/ca/chia_ca.crt: file /home/nameless/.ceres/mainnet/config/ssl/ca/chia_ca.crt does not exist Unable to check permissions for /home/nameless/.ceres/mainnet/config/ssl/ca/chia_ca.crt: file /home/nameless/.ceres/mainnet/config/ssl/ca/chia_ca.crt does not exist Unable to check permissions for /home/nameless/.ceres/mainnet/config/ssl/ca/chia_ca.key: file /home/nameless/.ceres/mainnet/config/ssl/ca/chia_ca.key does not exist Unable to check permissions for /home/nameless/.ceres/mainnet/config/ssl/ca/chia_ca.key: file /home/nameless/.ceres/mainnet/config/ssl/ca/chia_ca.key does not exist @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @ WARNING: UNPROTECTED SSL FILE! @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ Permissions 0664 for '/home/nameless/ceres-combineharvester/mozilla-ca/cacert.pem' are too open. Expected 0644 One or more SSL files were found with permission issues. Run ceres init --fix-ssl-permissionsto fix issues. ceres init cmd Traceback (most recent call last): File "/home/nameless/ceres-combineharvester/venv/bin/ceres", line 33, in <module> sys.exit(load_entry_point('ceres-blockchain', 'console_scripts', 'ceres')()) File "/home/nameless/ceres-combineharvester/ceres/cmds/ceres.py", line 149, in main cli() # pylint: disable=no-value-for-parameter File "/home/nameless/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 829, in __call__ return self.main(*args, **kwargs) File "/home/nameless/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 782, in main rv = self.invoke(ctx) File "/home/nameless/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/home/nameless/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "/home/nameless/ceres-combineharvester/venv/lib/python3.8/site-packages/click/core.py", line 610, in invoke return callback(*args, **kwargs) File "/home/nameless/ceres-combineharvester/venv/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func return f(get_current_context(), *args, **kwargs) File "/home/nameless/ceres-combineharvester/ceres/cmds/ceres_init.py", line 21, in ceres_init_cmd ceres_init(ctx.obj["root_path"], init_coins=coins) File "/home/nameless/ceres-combineharvester/ceres/cmds/ceres_init_funcs.py", line 20, in ceres_init create_ceres_all_ca_path(root_path) File "/home/nameless/ceres-combineharvester/ceres/cmds/ceres_init_funcs.py", line 52, in create_ceres_all_ca_path coin_names = get_mining_coin_names(root_path) File "/home/nameless/ceres-combineharvester/ceres/util/ceres_config.py", line 15, in get_mining_coin_names coins = farmer["farmer_peer"]["coins"] TypeError: 'NoneType' object is not subscriptable (venv) nameless@harvester:~/.ceres/mainnet$

Windows Client:

All Steps done. But i cannot starting harvester

Error below:

Traceback (most recent call last):
File "C:\Users\RG\develop\ceres-combineharvester\venv\Lib\site-packages\ceres\server\start_harvester.py", line 74, in
File "C:\Users\RG\develop\ceres-combineharvester\venv\Lib\site-packages\ceres\server\start_harvester.py", line 68, in main
File "C:\Users\RG\develop\ceres-combineharvester\venv\Lib\site-packages\ceres\server\start_harvester.py", line 47, in service_kwargs_for_harvester
File "ceres\harvester\harvester_api.py", line 30, in init
File "ceres\util\ceres_all_coins_config.py", line 33, in get_all_coins_config_constants
File "ceres\util\ceres_all_coins_config.py", line 50, in get_coin_default_constants
File "importlib_init_.py", line 127, in import_module
File "", line 1030, in _gcd_import
File "", line 1007, in _find_and_load
File "", line 984, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'ceres.consensus.all_coins_default_constants.cryptodoge_default_constants'
[8068] Failed to execute script 'start_harvester' due to unhandled exception!

给你点个赞！