gyz0072004 / testbase

Samples and Tools for Test Base for M365.

Test Base for Microsoft 365

Test Base for Microsoft 365 is an Azure service that facilitates data-driven testing of applications. Backed by the power of data and the cloud, it enables IT professionals to take advantage of intelligent testing from anywhere in the world. It will help you test your applications without the hassle, time commitment, and expenditure of setting up and maintaining complex test environments. Most importantly, it will give you access to pre-release Windows Updates on secure virtual machines (VMs) and world-class intelligence for your applications.

This repository contains various samples and utilities to build a Test Base package.

Best Practices

Provide you with some useful samples of Test Base integration, which are best practices to use Test Base, such as

• Construct Test Base scripts with your project
• Build and upload test base package
• Monitor the test results of Test Base

Sample app source code

It contains the source code of the sample app. This app is a sample/test app to try out the functionality of Test Base.

Sample List

Two types of samples are included in this repository: Package and SDK.

Package Samples

We provide many package samples with different test types and different languages. Most of the samples use Calculator as the test target.

Out of Box

An OOB test performs an install, launch, close, and uninstall of your application. After the install, the launch-close routine is repeated 30 times before a single uninstall is run. The OOB test provides you with standardized telemetry on your package to compare across Windows builds.

Two OOB samples are provided, click the links to find more details:

• Calculator-OOB-Sample
• StoreApp-OOB-Sample

Functional

A Functional test executes your uploaded test script(s) on your package. The scripts are run in the sequence you specified and a failure in a particular script will stop subsequent scripts from executing.

Appium is levaraged to do UI automation test. And MSTest is levaraged to do CLI test. Also C#, Java, Python are used in the samples.

Here is the list of current functional test samples, click the links to find more details:

• Calculator-Appium-CSharp-Sample
• Calculator-Appium-Java-Sample
• Calculator-Appium-Python-pytest-Sample
• Calculator-Appium-Python-unittest-Sample
• Calculator-MSTest-Sample

Flow Driven

Flow driven test allows you to arrange your test scripts with enhanced flow control. To help you comprehensively validate the impact of an in-place Windows upgrade, you can use flow driven tests to execute your tests on both the baseline OS and target OS with a side-by-side test result comparison.

The Flow driven test samples will be available soon.

SDK Samples

Test Base provides APIs/SDK to help you manage Test Base resources, get test results programmatically, and integrate them with our CI tools. SDK samples show how to use Test Base SDK in different ways.

• Samples of how to use Python SDK

Utilities

Utilities contain tools and scripts to help integrate with CICD, build and verify the Test Base package.

Issues and Feedback

To report an issue, visit Issues page.

To provide feedback, make feature proposals, or participate in polls, visit Discussions page.

Useful links

• Test Base Blog - Get the latest news about Test Base
• Test Base for Microsoft 365 documentation - Microsoft documentation on details of Test Base.