tapewerm / mcscripts Goto Github PK

On our server, even though it has internet access the 'network-online.target' service does not automatically start, which causes the 'getzip' oneshot to fail...

Nov 17 14:10:49 myhost.domain.com systemd[1]: Network is Online is not active.
Nov 17 14:10:49 myhost.domain.com systemd[1]: Dependency failed for Automatically download Minecraft Bedrock Edition server ZIP.
-- Subject: Unit mcbe-getzip.service has failed
-- Defined-By: systemd
-- Support: http://www.ubuntu.com/support
--
-- Unit mcbe-getzip.service has failed.
--
-- The result is RESULT.
Nov 17 14:10:49 myhost.domain.com systemd[1]: mcbe-getzip.service: Job mcbe-getzip.service/start failed with result 'dependency'.

I worked around this momentarily by simply starting the 'network-online.target' service manually. I think another workaround would be to enable 'systemd-networkd-wait-online.service' which would delay the boot process until the network was detected to be online, but I haven't tried this.

From my understanding, by default 'network-online.target' won't be pulled in unless it is required by another unit. Since the getzip unit uses 'Requisite=' instead of 'Requires=', getzip fails rather than trying to actually start 'network-online.target'. From the docs:

Note that normally, if no service requires it, and if no remote mount point is configured this target is not pulled into the boot, thus avoiding any delays during boot should the network not be available.

I believe the preferred way to do this would simply be to use 'Requires=' rather than 'Requisite=', but I could be wrong.

Dear TapeWerm,

So I am very confused or I may just be very tired. Your instructions are quite confusing. I have now been able to get my server up and running finally using your program. My only issue is, 1) How do I know the script is running, 2) How can I view the server terminal/command prompt, 3) What commands are available to use with this software if there are any, and 4) I felt that it would be better to end on an even number of bullets. Thank you for making this software, I just feel like some stuff is missing. This may be completely my fault, but the guide is confusing and there is no good documentation, I may just be missing something.

Sorry for this rather long message, the issue I am having is using this software, I typed in the commands to install the software and to get it working (or so I think), but I don't know what they do or if it worked. Some more documentation would be great.

Thank you for your time.

-ArduinoUno17

Current verbosity dominates journalctl logs making them hard to read. Default verbosity should be lowered and current behavior can be restored with a --verbose flag.

Trying to set up MCBE with the setup script and I can't get passed the EULA accept.

root@minecraft:/opt# sudo /opt/MCscripts/mcbe_setup.sh --import /opt/MCBE MCBE
Enter Y if you agree to the Minecraft End User License Agreement and Privacy Policy
Minecraft End User License Agreement: https://minecraft.net/terms
Privacy Policy: https://go.microsoft.com/fwlink/?LinkId=521839
y
curl: (23) Failed writing body (0 != 6871)

When following the tutorial for the Bedrock server; at this line:
sudo mv "$server_dir" ~mc/MCBE
the system asks me for the mc account's password, which is not set I believe?
I'm not a linux guru, so maybe I'm doing something wrong?
OS: Ubuntu 18.04LTS x64

I'm not sure if this is an actual issue or more of a PSA, as I don't think anything can be done from our end. Mojang has started publishing 1.19 previews to the BDS download page instead of versions of the server that actually work with released versions of the client. This means the update (which will be picked up by the autoupdate script) will break playability for most players. From the download page:

From now until The Wild Update releases, this page will be serving up builds from the future! The Microsoft Build 2022 Conference will include a special demo that uses unreleased Minecraft features while connecting to a special Preview Dedicated Server (1.19.10). When The Wild Update releases, we will update the download page to offer a compatible Dedicated Server (1.19.0) which will still support the Build 2022 demo.
This does mean that we do not have a Dedicated Server that works with today's Minecraft release (1.18.33), and we apologize for this inconvenience.

Based on this messaging, it seems like players using BDS are SOL until 1.19 drops unless they prevent updates on both the server and client, or opt into the beta/preview.

In the most recent download of BDS for linux, the "bedrock_server" file does not have execute permissions for some reason. This means after the autoupdate the server will fail to start without manual intervention to add the permission on the file (via chmod +x).

Apr 06 11:18:19 myserver.com systemd[1]: Stopped Minecraft Bedrock Edition server @ MyServer.
Apr 06 11:18:19 myserver.com systemd[1]: Started Minecraft Bedrock Edition server @ Myserver.
Apr 06 11:18:19 myserver.com bash[6011]: /bin/bash: ./bedrock_server: Permission denied

My guess is it was just a mistake by Mojang when building the download. It might be best to set the permission as part of the update script to ensure the issue does not reoccur in the future.

This line:

Fails, because the backup service is no longer running when this one starts. It is programmed to start after. Maybe you wanted to depend on the timer instead of the service?

You might add a note to the readme that folks moving servers from Windows to Ubuntu need to scrub the server.properties file of the ^M characters. dos2unix does this quickly and easily.

Without conversion, the backups fail because the ^M fouls the bit of the script testing for the existence of the world directory.

Thanks for the awesome tool!

Cheers,
Tim

Aforementioned line says that you can't access a Bedrock dedicated server via Nintendo Switch, but I just found out you can by using Pugmatt's BedrockConnect (https://github.com/Pugmatt/BedrockConnect) project as essentially a serverlist/proxy. It utilizes DNS rewrites to redirect the built in featured servers to this piece of software, which is a serverlist you can use to then jump over to a custom server, i.e. a dedicated server (or potentially even a Java edition server...i've not tried this though, i've heard it can be hit or miss whether it works).

Hi,
Minecraft told me, that my Server ist out of Date and so i started looking for the Problem.
Turned out that the mcbe-getzip Service isn't downloading the current Version for some time.
Got the exact some Problem as #42
So i tried figuring out by myself by setting some echo-command in mcbe_getzip.sh.
The script stops at line webpage=$(wget --user-agent MCscripts --prefer-family=IPv4 -nv https://www.minecraft.net/en-us/download/server/bedrock/ -O -)
For debugging i tried wget -d --user-agent MCscripts --prefer-family=IPv4 https://www.minecraft.net/en-us/download/server/bedrock/ -O - directly from bash and get

Setting --user-agent (useragent) to MCscripts
Setting --user-agent (useragent) to MCscripts
Setting --prefer-family (preferfamily) to IPv4
Setting --prefer-family (preferfamily) to IPv4
Setting --output-document (outputdocument) to -
Setting --output-document (outputdocument) to -
DEBUG output created by Wget 1.20.3 on linux-gnu.

Reading HSTS entries from /root/.wget-hsts
URI encoding = ‘UTF-8’
--2021-07-14 12:54:31--  https://www.minecraft.net/en-us/download/server/bedrock/
Resolving www.minecraft.net (www.minecraft.net)... 2.16.186.19, 2.16.186.27, 2.16.186.8
Caching www.minecraft.net => 2.16.186.19 2.16.186.27 2.16.186.8
Connecting to www.minecraft.net (www.minecraft.net)|2.16.186.19|:443... connected.
Created socket 3.
Releasing 0x00005575ca429f90 (new refcount 1).
Initiating SSL handshake.
Handshake successful; connected socket 3 to SSL handle 0x00005575ca42a180
certificate:
  subject: CN=*.minecraft.net,O=Mojang AB,L=Stockholm,C=SE
  issuer:  CN=DigiCert SHA2 Secure Server CA,O=DigiCert Inc,C=US
X509 certificate successfully verified and matches host www.minecraft.net

---request begin---
GET /en-us/download/server/bedrock/ HTTP/1.1
User-Agent: MCscripts
Accept: */*
Accept-Encoding: identity
Host: www.minecraft.net
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...

and thats it.

Any ideas?

Dear TapeWerm,

So I am very confused or I may just be very tired. Your instructions are quite confusing. I have now been able to get my server up and running finally using your program. My only issue is, 1) How do I know the script is running, 2) How can I view the server terminal/command prompt, 3) What commands are available to use with this software if there are any, and 4) I felt that it would be better to end on an even number of bullets. Thank you for making this software, I just feel like some stuff is missing. This may be completely my fault, but the guide is confusing and there is no good documentation, I may just be missing something.

Sorry for this rather long message, the issue I am having is using this software, I typed in the commands to install the software and to get it working (or so I think), but I don't know what they do or if it worked. Some more documentation would be great.

Thank you for your time.

-ArduinoUno17

I have got an Azure Ubuntu and grabbed Bedrock server. Found your scripts to allow cron backups. However when I try to start the bedrock server via the dethatched tmux it wont start. I think its because the tmux sessions is starting in a random directory so the bedrock server command D_LIBRARY_PATH=. ./bedrock_server fails. any ideas? the output log is below.

[email protected] - Minecraft Bedrock Edition server
Loaded: loaded (/etc/systemd/system/[email protected]; indirect; vendor preset: enabled)
Active: failed (Result: exit-code) since Mon 2019-01-21 20:49:59 UTC; 40min ago
Process: 1466 ExecStop=/opt/MC/MCstop.sh MCBE /tmp/MCBE (code=exited, status=2)
Process: 1021 ExecStart=/usr/bin/tmux -S /tmp/MCBE new -ds MCBE LD_LIBRARY_PATH=. ./bedrock_server (code=exited, s
Main PID: 1043 (code=exited, status=0/SUCCESS)

Jan 21 20:49:52 bedrock-ubt systemd[1]: Starting Minecraft Bedrock Edition server...
Jan 21 20:49:53 bedrock-ubt systemd[1]: Started Minecraft Bedrock Edition server.
Jan 21 20:49:59 bedrock-ubt MCstop.sh[1466]: no server running on /tmp/MCBE
Jan 21 20:49:59 bedrock-ubt MCstop.sh[1466]: No session MCBE on socket /tmp/MCBE
Jan 21 20:49:59 bedrock-ubt systemd[1]: [email protected]: Control process exited, code=exited status=2
Jan 21 20:49:59 bedrock-ubt systemd[1]: [email protected]: Failed with result 'exit-code'.

I have minecraft running on an HP laptop on Ubuntu. the ubuntu is updated to the most recent version.

I am trying to get minecraft to auto update properly. when minecraft attempts to update, the two Ipads are successfully updated. but the Hp laptop running ubuntu does not update properly.

If anyone has answers, please advise. Thank you very much.

I was hoping to get an example of how to use the MCBEbackup script...

I am running on Ubuntu and I followed the instructions from the readme for Setup and Bedrock Edition Setup (i skipped Java edition setup). It seems like the bedrock_server is running but i am unable to figure out the correct syntax for the MCBEbackup.sh script - can you provide a simple example?

MCBE 1.16.100 was released today, after updating we are getting the xuid values in our discord channel from the webhook rather than usernames. Seems maybe they changed the order in which they are printed?

When I log in, this is the current format from the server console:
[INFO] Player connected: <player name>, xuid: <xuid value>

Sometimes when I systemctl stop mcbe@MCBE it fails because systemd stopped the socket before the service, even though the ordering both implicitly according to the systemd docs as well as explicitly in the unit files says to do otherwise. I can't repeat this everytime, it seems to only happen when you stop the server for the first time in a while. I do not know if I am doing something wrong or if this is systemd being broken. Making this issue to log its existence, to show I am aware. I thought my recent changes would fix it but it happened again.
Edit: The IRC bot successfully stops before the socket dies, possibly related.

https://www.minecraft.net/en-us/download/server/bedrock is the affected URL. I have a feeling Mojang may not have liked a script polling its site once an hour, but that is conjecture. The systemd timer was based on boot time anyways, so it would not have all been at once, granted boot time tends to not be too long.

Not sure if this is something you want to support or at least check for but might save someone else some time someday. Our server.properties file ended up with windows style (CRLF) line terminations, and while this doesn't cause an issue for the minecraft server, the backup script fails with the following:

Jun 13 23:45:30 rockbottom.bedrockorbust.com systemd[1]: Starting Back up Minecraft Bedrock Edition server world @ BedrockOrBust...
Jun 13 23:45:30 rockbottom.bedrockorbust.com mcbe_backup.sh[2671294]: [102B blob data]
Jun 13 23:45:30 rockbottom.bedrockorbust.com systemd[1]: [email protected]: Main process exited, code=exited, status=1/FAILURE
Jun 13 23:45:30 rockbottom.bedrockorbust.com systemd[1]: [email protected]: Failed with result 'exit-code'.
Jun 13 23:45:30 rockbottom.bedrockorbust.com systemd[1]: Failed to start Back up Minecraft Bedrock Edition server world @ BedrockOrBust.

It took some debugging to track down the cause. I resolved the issue by just using the dos2unix utility to convert the server.properties file. Basically the cut command grabs the CR character:

You could instead use:
world=$(basename -- "$(grep ^level-name= "$properties" | cut -d = -f 2- -s | tr -d '\r')")
And just use that method any time you need to parse something from the settings file. Or maybe just check if the file contains CR characters and throw an error.

I imagine it's just my lack of knowledge about coding, as I am just starting, but I can't understand the instructions, I don't know if "Terminal" means Command Prompt on Windows or I have to download something called "Tmux", nor do I know what it means by clone, etc, and I'm just unfamiliar with programming in general (It'd be nice if there as a video tutorial or something). I apologize for my impudence and any help would be welcome.

Hey, stumbled upon your scripts. Nice, however tmux is not needed at all, systemd can create FIFO for STDIN:

# cat /etc/systemd/system/[email protected]
[Unit]
Description=Minecraft Bedrock: %i
After=network.target

[Service]
Sockets=minecraft@%i.socket
WorkingDirectory=/opt/minecraft/bedrock/%i
User=minecraft
Group=minecraft
ProtectHome=true
Type=simple
ExecStart=/opt/minecraft/bin/start-mc
ExecStop=/usr/bin/sh -c "echo 'say Server shutdown in 5 seconds' >/run/minecraft@%i/stdin"
ExecStop=/usr/bin/sleep 5
ExecStop=/usr/bin/sh -c "echo stop >/run/minecraft@%i/stdin"
TimeoutStopSec=30
Restart=always
RestartSec=600s
StandardInput=socket
StandardOutput=journal
StandardError=journal

[Install]
WantedBy=multi-user.target

# cat /etc/systemd/system/[email protected]
[Unit]
BindsTo=minecraft@%i.service

[Socket]
RuntimeDirectory=%N
ListenFIFO=%t/%N/stdin
FileDescriptorName=control
RemoveOnStop=true
SocketMode=0660
SocketUser=minecraft
SocketGroup=minecraft

# echo "say HELLO WITHOUT TMUX" >/run/minecraft@survival_easy1/stdin

This is much more secure, I am working on implementing SELinux policy on top of that. With tmux that is not possible. FYI if you want to simplify your scripts a bit.

It was mentioned in some previous comments that nobody uses this for Java. That being the case, would it make sense to simply remove Java support? It might make maintenance and documentation a bit easier.

Hi I am trying to understand how to use this set of scripts fully, I have MCBE running as a service which is running great! but how can i trigger it to run an update of Minecraft? I have some clients that have updated and can no longer connect to the server.
I found /opt/MCscripts/mcbe_autoupdate.sh but not 100% sure of the usage?
I also have ran sudo systemctl enable mcbe-getzip.timer [email protected] --now

Looks like mcbe-rmbackup service was never updated when the directory naming convention was switched from CamelCase to snake_case, it still points to "%i_Backups" instead of "%i_backups"

Any thoughts on adding the ability to schedule a server restart once a day or so?
I think it would just involve a timer that activates a one shot service that runs "systemctl restart mcbe@foobar", to ensure that the service restarts cleanly.

They are of the correct size and show the correct name, but upon putting them into the singleplayer worlds directory, the world is vanilla of that seed - unchanged.

Am I right in thinking that, if I wanted to run a 2nd (or more) Bedrock server, that I should just follow the standard commands listed, changing "MCBE" to some other folder name in the setup directions, and update the server.properties file to point to a different UDP port for the clients to connect to?

My children started their own worlds on their devices, and I have saved a copy of their worlds so I can run it and not have them worried about who is online or not to run things, so I'd like to set up multiple running instances if I can easily, and your scripts have been a wonder in doing just that with 1 other world/server so far.

shouldn't this have a |g in the end?

I had a bedrock server world that got corrupted, but when I went to load the backups they did not have everything. There were missing chunks and chunks that had been recreated to original. The server had been rebooted recently so I know the world wasn't corrupt before (at least not visibly). I think this might be similar to Issue #12, and that bedrock server is not creating live backup files correctly in the current release.

I think it did not wait for the 10seconds shutdown of the server? Exit code was not clear.

Aug 11 19:16:05 instance-2 sudo[113858]: pam_unix(sudo:session): session closed for user root
Aug 11 19:16:05 instance-2 systemd[1]: [email protected]: Found left-over process 113843 (bash) in control group while starting unit. Ignoring.
Aug 11 19:16:05 instance-2 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Aug 11 19:16:05 instance-2 systemd[1]: [email protected]: Found left-over process 114794 (sudo) in control group while starting unit. Ignoring.
Aug 11 19:16:05 instance-2 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Aug 11 19:16:05 instance-2 systemd[1]: Starting Automatically update Minecraft Bedrock Edition server @ MCBE...
Aug 11 19:16:05 instance-2 systemd[1]: Starting Automatically remove Minecraft Bedrock Edition server world backups more than 2-weeks-old @ MCBE...
Aug 11 19:16:05 instance-2 sudo[114794]:     root : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/bin/systemctl stop mcbe@MCBE
Aug 11 19:16:05 instance-2 sudo[114794]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 11 19:16:05 instance-2 systemd[1]: Stopping Minecraft Bedrock Edition server @ MCBE...
Aug 11 19:16:05 instance-2 bash[74243]: Changes to the level are resumed.
Aug 11 19:16:05 instance-2 MCBEautoUpdate.sh[114795]: Service mcbe@MCBE not active
Aug 11 19:16:05 instance-2 systemd[1]: [email protected]: Main process exited, code=exited, status=1/FAILURE
Aug 11 19:16:05 instance-2 systemd[1]: [email protected]: Failed with result 'exit-code'.
Aug 11 19:16:05 instance-2 systemd[1]: Failed to start Automatically update Minecraft Bedrock Edition server @ MCBE.
Aug 11 19:16:05 instance-2 MCstop.sh[114817]: Server stopping in 10 seconds
Aug 11 19:16:05 instance-2 systemd[1]: [email protected]: Succeeded.
Aug 11 19:16:05 instance-2 systemd[1]: Finished Automatically remove Minecraft Bedrock Edition server world backups more than 2-weeks-old @ MCBE.
Aug 11 19:16:12 instance-2 MCstop.sh[114817]: Server stopping in 3 seconds
Aug 11 19:16:13 instance-2 MCstop.sh[114817]: Server stopping in 2 seconds
Aug 11 19:16:14 instance-2 MCstop.sh[114817]: Server stopping in 1 seconds
Aug 11 19:16:15 instance-2 bash[74243]: [2020-08-11 19:16:15 INFO] Server stop requested.
Aug 11 19:16:15 instance-2 bash[74243]: [2020-08-11 19:16:15 INFO] Stopping server...

[1]   Exit 1                  sudo systemctl restart mcbe-autoupdate@MCBE
Job for [email protected] failed because the control process exited with error code.
See "systemctl status [email protected]" and "journalctl -xe" for details.

Hey! I know that using screen is not recommended cause of obvious reasons, but it happens that, I need to log into the server console and run some maintenance commands, also I've tried it running as service, but systemd seems to be troublesome, I'm using amazon-linux, I've created a script myself, but needed a robust solution, If you could extend the functionality a bit or guide me into the right direction, I'll be very grateful.

I suspect it may not be possible to workaround this, but wanted to document it just in case someone had an idea.
If a user logs out while the mcbe service is being stopped, the disconnect won't get picked up by the discord webhook script. I assume this is because since the discord webhook service depends on the mcbe service, so the webhook stops as well when the server stops.
I guess simply removing the dependency might work around this. Possibly combined with a kick command in the server shutdown right before the server stops to ensure players show up as getting disconnected before they reconnect after the server restarts.
Though I don't think the discord webhook currently picks up player kicks either :P

Any thoughts on adding a centralized configuration file of some type?
Specifically we give the users 60s warning before the server stops, so I edited the mcbe unit file to pass the '-s' parameter to the stop script. This works great, but it's easy to accidentally overwrite the modified file when updating.
Or maybe there is a better way to make this configurable in systemd?

So, I'm not really understanding what am I supposed to do in the instruction of open nano <that file webhooks.txt> and fill this in.
Do I need to copy that text and put it on there or I'm supposed to fill with my own info?

Running Ubuntu 18.04 Server
Minecraft Bedrock Edition 1.11.2.1
Running the server for a few months now without MCscripts

Likely an issue on my end. I am going to blow my minecraft instance entirely and start over and hopefully it'll fix it. However, while I am working through that, I wanted to see if any of these issues are familiar or if you could clarify some comments/commands.

I followed the instructions on the description, but I believe I missed some instructions. For example, the basic 'how do you start the server' seems lost to me. This may be why I am running into a few issues.

1. Followed common setup, no issues and everything successfully installed
2. Transitioned to Bedrock Edition Setup and all steps worked properly

At this point, where is the 'go' button? As the server files were moved, new account was created, and tmux added, I guess opening the server directly through LD_LIBRARYPATH=. ./bedrock_server is no longer the proper way to open the server. I assume the notes section is where I am to go.

1. sudo su mc -s /bin/bash - no issues
2. tmux -S /tmp/tmux-mc/minecraft a - returns no session

Questions: Is $instance any name I want to give it? Is minecraft not an option? Does it need to be something in particular?

I then followed the closed issue and it discussed tmux -S /tmp/MCBE new -ds MCBE 'LD_LIBRARY_PATH=. ./bedrock_server'

It seems this was a better command and was sending me in the right direction. I could use an amalgamation of this command and get the server to start up. However, I believe due to the previous commands, it would shut the server down due to the port being in use. Although, after checking all ports, it was in fact not in use. Not sure why this issue occurred. After reboot and running the server directly from the folder with LD_LIBRARY_PATH=. ./bedrock_server, it continues to toss the "port in use" error.

Ultimately the question I have is which command is the proper command -- the first command from the Description page or the second command on the issues page. I assume the /tmp directory differences does not matter, but it seems the first command includes a /$instance (not quite sure what this is for) and the second command ignores this altogether and instead creates a new session and calls the server directly.

Additionally, if I just run the server the normal way, will the systemctl services I set up earlier auto run and continue to update and backup the server without the tmux session? Or is the way the new user mc is set up that the systemctl sessions will only work if the minecraft server is started from the mc user?

Thanks for any information you provide. Good work on the scripts... will be a massive time saver when they are up and running. Bedrock updates are a slight annoyance.

All setup deleted, I do have world backups....
Error was:
mkdir: cannot create directory ‘/opt/MC/backup_dir/bedrock’: File exists