Magisk asks for Additional setup after fresh patched OTA sideload

avbroot

(This page is also available in: Russian (Русский).)

avbroot is a program for patching Android A/B-style OTA images for root access while preserving AVB (Android Verified Boot) using custom signing keys. It is compatible with both Magisk and KernelSU. If desired, it can also just re-sign an OTA without enabling root access.

Having a good understanding of how AVB and A/B OTAs work is recommended prior to using avbroot. At the very least, please make sure the warnings and caveats are well-understood to avoid the risk of hard bricking.

NOTE: avbroot 2.0 has been rewritten in Rust and no longer relies on any AOSP code. The CLI is fully backwards compatible, but the old Python implementation can be found in the python branch if needed.

Requirements

Only devices that use modern A/B partitioning are supported. This is the case for most non-Samsung devices launched with Android 10 or newer. To check if a device uses this partitioning scheme, open the OTA zip file and check that:
- payload.bin exists
- META-INF/com/android/metadata (Android 10-11) or META-INF/com/android/metadata.pb (Android 12+) exists
The device must support using a custom public key for the bootloader's root of trust. This is normally done via the fastboot flash avb_custom_key command.

A list of devices known to work can be found in the issue tracker at #299.

Patches

avbroot applies the following patches to the partition images:

The boot or init_boot image, depending on device, is patched to enable root access. For Magisk, the patch is equivalent to what would be normally done by the Magisk app.
The boot, recovery, or vendor_boot image, depending on device, is patched to replace the OTA signature verification certificates with the custom OTA signing certificate. This allows future patched OTAs to be sideloaded from recovery mode after the bootloader has been locked. It also prevents accidental flashing of the original unpatched OTA.
The system image is also patched to replace the OTA signature verification certificates. This prevents the OS' system updater app from installing an unpatched OTA and also allows the use of custom OTA updater apps.

Warnings and Caveats

Always leave the OEM unlocking checkbox enabled when using a locked bootloader with root. This is critically important. Root access allows the boot partition to potentially be overwritten, either accidentally or intentionally, with an image that is not properly signed. In this scenario, if the checkbox is turned off, both the OS and recovery mode will be made unbootable and fastboot flashing unlock will not be allowed. This effectively renders the device hard bricked.

Repeat: ALWAYS leave OEM unlocking enabled if rooted.
Any operation that causes an improperly-signed boot image to be flashed will result in the device being unbootable and unrecoverable without unlocking the bootloader again (and thus, triggering a data wipe). A couple ways an improperly-signed boot image could be flashed include:
- The Direct install method for updating Magisk. Magisk updates must be done by repatching the OTA, not via the app.
- The Uninstall Magisk feature in Magisk. If root access is no longer needed, Magisk must be removed by repatching the OTA with the --rootless option, not via the app.
If the boot image is ever modified, do not reboot. Open an issue for support and be very clear about what steps were done that lead to the situation. If Android is still running and root access works, it might be possible to recover without wiping and starting over.

Usage

Make sure the caveats listed above are understood. It is possible to hard brick by doing the wrong thing!
Download the latest version from the releases page. To verify the digital signature, see the verifying digital signatures section.

avbroot is a standalone executable. It does not need to be installed and can be run from anywhere.
Follow the steps to generate signing keys.
Patch the OTA zip. The base command is:
```
avbroot ota patch \
    --input /path/to/ota.zip \
    --key-avb /path/to/avb.key \
    --key-ota /path/to/ota.key \
    --cert-ota /path/to/ota.crt \
```
Add the following additional arguments to the end of the command depending on how you want to configure root access.
- To enable root access with Magisk:
```
--magisk /path/to/magisk.apk \
--magisk-preinit-device <name>
```
  If you don't know the Magisk preinit partition name, see the Magisk preinit device section for steps on how to find it.
  
  If you prefer to manually patch the boot image via the Magisk app instead of letting avbroot handle it, use the following arguments instead:
```
--prepatched /path/to/magisk_patched-xxxxx_yyyyy.img
```
- To enable root access with KernelSU:
```
--prepatched /path/to/kernelsu/boot.img
```
- To leave the OS unrooted:
```
--rootless
```
For more details on the options above, see the advanced usage section.

If --output is not specified, then the output file is written to <input>.patched.
The patched OTA is ready to go! To flash it for the first time, follow the steps in the initial setup section. For updates, follow the steps in the updates section.

Generating Keys

avbroot signs several components while patching an OTA zip:

the boot images
the vbmeta images
the OTA payload
the OTA zip itself

The first two components are signed with an AVB key and latter two components are signed with an OTA key. They can be the same key, though the following steps show how to generate two separate keys.

When patching OTAs for multiple devices, generating unique keys for each device is strongly recommended because it prevents an OTA for the wrong device being accidentally flashed.

Generate the AVB and OTA signing keys.

avbroot key generate-key -o avb.key
avbroot key generate-key -o ota.key

Convert the public key portion of the AVB signing key to the AVB public key metadata format. This is the format that the bootloader requires when setting the custom root of trust.
```
avbroot key extract-avb -k avb.key -o avb_pkmd.bin
```
Generate a self-signed certificate for the OTA signing key. This is used by recovery to verify OTA updates when sideloading.
```
avbroot key generate-cert -k ota.key -o ota.crt
```

The commands above are provided for convenience. avbroot is compatible with any standard PKCS#8-encoded 4096-bit RSA private key and PEM-encoded X509 certificate, like those generated by openssl.

If you lose your AVB or OTA signing key, you will no longer be able to sign new OTA zips. You will have to generate new signing keys and unlock your bootloader again (triggering a data wipe). Follow the Usage section as if doing an initial setup.

Initial setup

Make sure that the version of fastboot is 34 or newer. Older versions have bugs that prevent the fastboot flashall command (required later) from working properly.
```
fastboot --version
```
Reboot into fastboot mode and unlock the bootloader if it isn't already unlocked. This will trigger a data wipe.
```
fastboot flashing unlock
```
When setting things up for the first time, the device must already be running the correct OS. Flash the original unpatched OTA if needed.
Extract the partition images from the patched OTA that are different from the original.
```
avbroot ota extract \
    --input /path/to/ota.zip.patched \
    --directory extracted \
    --fastboot
```
If you prefer to extract and flash all OS partitions just to be safe, pass in --all.
Flash the partition images that were extracted.
```
ANDROID_PRODUCT_OUT=extracted fastboot flashall --skip-reboot
```
Note that this only flashes the OS partitions. The bootloader and modem/radio partitions are left untouched due to fastboot limitations. If they are not already up to date or if unsure, after fastboot completes, follow the steps in the updates section to sideload the patched OTA once. Sideloading OTAs always ensures that all partitions are up to date.

Alternatively, for Pixel devices, running flash-base.sh from the factory image will also update the bootloader and modem.

Set up the custom AVB public key in the bootloader after rebooting from fastbootd to bootloader.

fastboot reboot-bootloader
fastboot erase avb_custom_key
fastboot flash avb_custom_key /path/to/avb_pkmd.bin

[Optional] Before locking the bootloader, reboot into Android once to confirm that everything is properly signed.

Install the Magisk or KernelSU app and run the following command:
```
adb shell su -c 'dmesg | grep libfs_avb'
```
If AVB is working properly, the following message should be printed out:
```
init: [libfs_avb]Returning avb_handle with status: Success
```
Reboot back into fastboot and lock the bootloader. This will trigger a data wipe again.
```
fastboot flashing lock
```
Confirm by pressing volume down and then power. Then reboot.

Remember: Do not uncheck OEM unlocking!

WARNING: If you are flashing CalyxOS, the setup wizard will automatically turn off the OEM unlocking switch. Make sure to manually reenable it again from Android's developer settings. Consider using the OEMUnlockOnBoot module to automatically ensure OEM unlocking is enabled on every boot.
That's it! To install future OS, Magisk, or KernelSU updates, see the next section.

Updates

Updates to Android, Magisk, and KernelSU are all done the same way by patching (or repatching) the OTA.

If Magisk or KernelSU is being updated, first install their new .apk. If you happen to open the app, make sure it does not flash the boot image. Cancel the boot image update prompts if needed.
Follow the step in the usage section to patch the new OTA.
Reboot to recovery mode. If the screen is stuck at a No command message, press the volume up button once while holding down the power button.
Sideload the patched OTA with adb sideload.
That's it!

Reverting to stock firmware

To stop using avbroot and revert to the stock firmware:

Reboot into fastboot mode and unlock the bootloader. This will trigger a data wipe.
Erase the custom AVB public key.
```
fastboot erase avb_custom_key
```
Flash the stock firmware.
That's it! There are no other remnants to clean up.

OTA updates

avbroot replaces /system/etc/security/otacerts.zip in both the system and recovery partitions with a new zip that contains the custom OTA signing certificate. This prevents an unpatched OTA from inadvertently being installed both when booted into Android and when sideloading from recovery.

Disabling the system updater app is recommended to prevent it from even attempting to install an unpatched OTA. To do so:

Stock OS: Turn off Automatic system updates in Android's Developer Options.
Custom OS: Disable the system updater app (or block its network access) from Settings -> Apps -> See all apps -> (three-dot menu) -> Show system -> (find updater app).

This is especially important for some custom OS's because their system updater app may get stuck in an infinite loop downloading an OTA update and then retrying when signature verification fails.

To self-host a custom OTA server, see Custota.

Repair mode

Some devices now ship with a Repair Mode feature that boots the system with a fresh userdata image so that repair technicians are able to run on-device diagnostics without needing the user's credentials to unlock the device.

When the device is rooted, it is unsafe to use Repair Mode. Unless you are using release builds of Magisk/KernelSU signed with your own keys, it's trivial for someone to just install the Magisk/KernelSU app while in repair mode to gain root access with no authentication.

To safely use Repair Mode:

Unroot the device by repatching the OTA with the --rootless option (instead of --magisk or --prepatched) and flashing it.
Turn on Repair Mode.
After receiving the repaired device, exit Repair Mode.
Flash the (rooted) patched OTA as normal.

Because the unrooting and rooting are done by flashing OTAs, the device's data will not be wiped.

Magisk preinit device

Magisk versions 25211 and newer require a writable partition for storing custom SELinux rules that need to be accessed during early boot stages. This can only be determined on a real device, so avbroot requires the partition to be explicitly specified via --magisk-preinit-device <name>. To find the partition name:

Extract the boot image from the original/unpatched OTA:

avbroot ota extract \
    --input /path/to/ota.zip \
    --directory . \
    --boot-only

Patch the boot image via the Magisk app. This MUST be done on the target device or a device of the same model! The partition name will be incorrect if patched from Magisk on a different device model.

The Magisk app will print out a line like the following in the output:
```
- Pre-init storage partition device ID: <name>
```
Alternatively, avbroot can print out what Magisk detected by running:
```
avbroot boot magisk-info \
    --image magisk_patched-*.img
```
The partition name will be shown as PREINITDEVICE=<name>.

Now that the partition name is known, it can be passed to avbroot when patching via --magisk-preinit-device <name>. The partition name should be saved somewhere for future reference since it's unlikely to change across Magisk updates.

If it's not possible to run the Magisk app on the target device (eg. device is currently unbootable), patch and flash the OTA once using --ignore-magisk-warnings, follow these steps, and then repatch and reflash the OTA with --magisk-preinit-device <name>.

Verifying OTAs

To verify all signatures and hashes related to the OTA installation and AVB boot process, run:

avbroot ota verify \
    --input /path/to/ota.zip \
    --cert-ota /path/to/ota.crt \
    --public-key-avb /path/to/avb_pkmd.bin

This command works for any OTA, regardless if it's patched or unpatched.

If the --cert-ota and --public-key-avb options are omitted, then the signatures are only checked for validity, not that they are trusted.

Tab completion

Since avbroot has tons of command line options, it may be useful to set up tab completions for the shell. These configs can be generated from avbroot itself.

bash

Add to ~/.bashrc:

eval "$(avbroot completion -s bash)"

zsh

Add to ~/.zshrc:

eval "$(avbroot completion -s zsh)"

fish

Add to ~/.config/fish/config.fish:

avbroot completion -s fish | source

PowerShell

Add to PowerShell's profile.ps1 startup script:

Invoke-Expression (& avbroot completion -s powershell)

Advanced Usage

Using a prepatched boot image

avbroot can replace the boot image with a prepatched image instead of applying the root patch itself. This is useful for using a boot image patched by the Magisk app or for KernelSU. To use a prepatched Magisk boot image or a KernelSU boot image, pass in --prepatched <boot image> instead of --magisk <apk>. When using --prepatched, avbroot will skip applying the Magisk root patch, but will still apply the OTA certificate patch.

Note that avbroot will validate that the prepatched image is compatible with the original. If, for example, the header fields do not match or a boot image section is missing, then the patching process will abort. The checks are not foolproof, but should help protect against accidental use of the wrong boot image. To bypass a somewhat "safe" subset of the checks, use --ignore-prepatched-compat. To ignore all checks (strongly discouraged!), pass it in twice.

Skipping root patches

avbroot can be used for just re-signing an OTA by specifying --rootless instead of --magisk/--prepatched. With this option, the patched OTA will not be rooted. The only modification applied is the replacement of the OTA verification certificate so that the OS can be upgraded with future (patched) OTAs.

Replacing partitions

avbroot supports replacing entire partitions in the OTA, even partitions that are not boot images (eg. vendor_dlkm). A partition can be replaced by passing in --replace <partition name> /path/to/partition.img.

The only behavior this changes is where the partition is read from. When using --replace, instead of reading the partition image from the original OTA's payload.bin, it is read from the specified file. Thus, the replacement partition images must have proper vbmeta footers, like the originals.

This has no impact on what patches are applied. For example, when using Magisk, the root patch is applied to the boot partition, no matter if the partition came from the original payload.bin or from --replace.

Booting signed GSIs

Android's Dynamic System Updates (DSU) feature uses a different root of trust than the regular system. Instead of using the bootloader's avb_custom_key, it obtains the trusted keys from the first_stage_ramdisk/avb/*.avbpubkey files inside the init_boot or vendor_boot ramdisk. These files are encoded in the same binary format as avb_pkmd.bin.

avbroot can add the custom AVB public key to this directory by passing in --dsu when patching an OTA. This allows booting Generic System Images (GSI) signed by the custom AVB key.

Clearing vbmeta flags

Some Android builds may ship with a root vbmeta image with the flags set such that AVB is effectively disabled. When avbroot encounters these images, the patching process will fail with a message like:

Verified boot is disabled by vbmeta's header flags: 0x3

To forcibly enable AVB (by clearing the flags), pass in --clear-vbmeta-flags.

Non-interactive use

avbroot prompts for the private key passphrases interactively by default. To run avbroot non-interactively, either:

Supply the passphrases via files.

avbroot ota patch \
    --pass-avb-file /path/to/avb.passphrase \
    --pass-ota-file /path/to/ota.passphrase \
    <...>

On Unix-like systems, the "files" can be pipes. With shells that support process substituion (bash, zsh, etc.), the passphrase can be queried from a command (eg. querying a password manager).

avbroot ota patch \
    --pass-avb-file <(command to query AVB passphrase) \
    --pass-ota-file <(command to query OTA passphrase) \
    <...>

Supply the passphrases via environment variables. This is less secure since any process running as the same user can see the environment variable values.

export PASSPHRASE_AVB="the AVB passphrase"
export PASSPHRASE_OTA="the OTA passphrase"

avbroot ota patch \
    --pass-avb-env-var PASSPHRASE_AVB \
    --pass-ota-env-var PASSPHRASE_OTA \
    <...>

Use unencrypted private keys. This is strongly discouraged.

Extracting the entire OTA

To extract all images contained within the OTA's payload.bin, run:

avbroot ota extract \
    --input /path/to/ota.zip \
    --directory extracted \
    --all

Signing with an external program

avbroot supports delegating all RSA signing operations to an external program with the --signing-helper option. When using this option, the --key-avb and --key-ota options must be given a public key instead of a private key.

For each signing operation, avbroot will invoke the program with:

<helper> <algorithm> <public key>

The algorithm is one of SHA{256,512}_RSA{2048,4096} and the public key is what was passed to avbroot. The program can use the public key to find the corresponding private key (eg. on a hardware security module). avbroot will write a PKCS#1 v1.5 padded digest to stdin and the helper program is expected to perform a raw RSA signing operation and write the raw signature (octet string matching key size) to stdout.

By default, this behavior is compatible with the --signing_helper option in AOSP's avbtool. However, avbroot additionally extends the arguments to support non-interactive use. If --pass-{avb,ota}-file or --pass-{avb,ota}-env-var are used, then the helper program will be invoked with two additional arguments that point to the password file or environment variable.

<helper> <algorithm> <public key> file <pass file>
# or
<helper> <algorithm> <public key> env <env file>

Note that avbroot will verify the signature returned by helper program against the public key. This ensures that the patching process will fail appropriately if the wrong private key was used.

Building from source

Make sure the Rust toolchain is installed. Then run:

cargo build --release

The output binary is written to target/release/avbroot.

Debug builds work too, but they will run significantly slower (in the sha256 computations) due to compiler optimizations being turned off.

By default, the executable links to the system's bzip2 and liblzma libraries, which are the only external libraries avbroot depends on. To compile and statically link these two libraries, pass in --features static.

Android cross-compilation

To cross-compile for Android, install cargo-android and use the cargo android wrapper. To make a release build for aarch64, run:

cargo android build --release --target aarch64-linux-android

It is possible to run the tests if the host is running Linux, qemu-user-static is installed, and the executable is built with RUSTFLAGS=-C target-feature=+crt-static and --features static.

Verifying digital signatures

To verify the digital signatures of the downloads, follow the steps here.

Contributing

Contributions are welcome! However, I'm unlikely to accept changes for supporting devices that behave significantly differently from Pixel devices.

License

avbroot is licensed under GPLv3. Please see LICENSE for the full license text.

	/// The interleaving access pattern can be visualized by placing the file
	/// offsets in a two-dimensional grid. For example, when reading a 2072576-byte
	/// file for calculating RS(255, 253):
	///
	/// ```text
	/// \| <-------- Round 0 --------> \| <-------- Round 1 --------> \|
	/// \|-----------------------------\|-----------------------------\|
	/// ^ \| 0 1 ... 4095 \| 4096 4097 ... 8191 \|
	/// \| \| 8192 8192 ... 12287 \| 12288 12289 ... 16383 \|
	/// rs_k \| 16384 16385 ... 20479 \| 20480 20481 ... 24575 \|
	/// \| \| ....... ....... ... ....... \| ....... ....... ... ....... \|
	/// v \| 2064384 2064385 ... 2068479 \| 2068480 2068481 ... 2072575 \|
	/// ```
	///
	/// A regular sequential read of the file is traversing the grid row-by-row,
	/// while an interleaving read is traversing the grid column-by-column. Each
	/// column is always `rs_k` items tall, so each column forms the data portion of
	/// an RS codeword. The number of columns is always a multiple of the FEC block
	/// size. Since RS operates on fixed-size codewords and a file size might not
	/// always fill the grid completely, out-of-bounds offsets are treated as if
	/// they contain a `\0` byte.
	///
	/// All operations are multithreaded with I/O operations parallelized at the
	/// "round" level and RS operations parallelized at the column level.

chenxiaolong / avbroot Goto Github PK

avbroot's Introduction