notalib / test Goto Github PK

The testing of this issue is exactly the same, just checking that the player also works with the english books.

Conclusion
No real problems.

test.m.e17.dk benytter nu en nyere version af DODP, bla. er hele sessionstyringen samlet under NotaSecure hvilket øger overskueligheden og hastigheden.

Den nye udgave af DODP er forberedt til brug af den nye DCSOnline server/master, men kører pt. på det nuværende (i drift) system.

Det ønskes at få testet at afspilleren fungerer som forventet på test.m.e17.dk. Jeg vil dog mene at det er i orden kun at teste på et mindre udvalg af enheder da det 100% backend funktionalitet der testes.. Der er ingen ændringer i forhold til funktion udaftil - med mindre vi har en dybere liggende fejl..

Efter afsluttet test med godt resultat, kan vi opgradere produktions platformen til at benytte den nye version.

Min side skal gennemgå en generel test.

• Virker knapperne som de skal?
• Hvad sker der når man bestiller bøger i Vubis - bliver de tilføjet Mine bestillinger og historikken på E17?

tester..

En usability test af Min side spredt over alle typer af brugergrupper. Specifikation følger.

På test.m.e17.dk/daniel er en ny tegneseriefunktion slået til hvor billedet preloader inden lyden sættes i gang. Her er umiddelbare testresultater:

Det kører ret nice mange steder, fx i Scott Pilgrimm: http://test.m.e17.dk/daniel/#book-play?book=36758&section=7&autoplay=true

Men der virker som om der kan være et problem med frem tilbagespoling, mens loaderen er i gang; Fx i indledningen til Opikayana, hvor persongalleriet præsenteres. Du kan ikke rigtig spole i tegneserien, mens der afspilles, prøv fx her:

http://test.m.e17.dk/daniel/#book-play?book=36738&section=2.2&autoplay=true

-det den gør i safari (mac) er i hvert fald at aktuere spolefunktionen - den springer kortvarigt videre til næste afsnit - men springer så tilbage til det afsnit man kom fra. Måske kan man deaktivere loaderen indtil brugeren har spolet færdig..?

Problemet er ikke det samme på iPhone, omend spoling virker noget sløjt (langsomt) og at den her synes at springe først et afsnit for langt frem - og SÅ tilbage til det rigtige afsnit.. Det er måske noget med det særlige i at der her er billeder på ca hveranden side..?

Dvs der er forskel på hvordan indholdet er formatteret eller hvordan..? I hvert fald skal forskellen mellem de forskellige tegneserier lige tjekkes ud. Tintin kører også fint..

Issues so far: VoiceOver does not catch the text in the error messages.

Test the notification mail i various mail-readers.
Includes test of the links in the mail.

I need to be informed which test borrowers (with a registered mail address) to send to, or alternatively which email addresses to send test mails to.

Being able to play a book consists of being able to hear the recordings it contains, pausing it, jumping around in chapters via the forwards and backwards buttons, viewing and jumping to the elements listed in the contents page.
When stopped and exited at a particular chapter or paragraph, the player should resume playing from that position when asked to play again.

Point, however: When a book is done playing, I am not sure how the player should react. Should it return the user to the book shelf?

Borderline cases for testing include:

1. Click 'play', and 'pause'
2. Click 'forward' and 'backward'
3. Exit the book at a chapter, and resume playing it
4. Exit the book at paragraph and resume playing it

Conclusion
No problems (with the obvious exception of the fact that IE9 does not skip to the right chapter after being closed and re-opened – but I think this problem has been reported sufficiently). 

Men får du en mail..?

As there is significant difference between the different currently available comics in the player, we have postponed coming up with a standardized form of testing until there is more clarity as to how exactly the player and material is supposed to act and what they need to be able to do.

Until such time, we test all comics individually, on all platforms. The tests carried out consist only of playing the cartoon, checking to see that sound and images are coordinated, that all the images are actually shown, that basic player functionality (jumping from place to blace, stopping, starting) works and that picture scaling works.

Problems regarding picture scaling are reported to under LYT/issues to Marius (GitHub user name: Malebarius)

Problems regarding the functionality of the player itself are reported o LYT/issues to Lars as usual.

Problems regarding syncronization of pictures and sound etc. are reported under Materialer/issues. @simmoe to whom? Marius still, or one of the people working with the actual recording?

----- ::Conclusion:: -----

This test has been carried out, but as it is decidedly more complex than any of the other test issues, we direct the interested reader to either the Materialer repository or the LYT issues list, respectively for issues reported regarding the markup of the comics themselves or issues regarding the player's dealings with the materials.

----:: Update ::----
Since the test results did not fit in well in the ' Materials' section of the Notalib organization, we are moving the results back to this issues - the results for each individual comic can be found as a comment below.

Basically, testing first time login consists of making sure that the only way to log onto the sit is by giving a correct registered username and password. On all manner of disallowed input to the user/passwd-fields, the system should give the same error message and not log in.

The only way of loggin out should be by clicking the 'log out'-button. Thus, if logged on, the user will not be logged out by closing the tab or turning off the device.

A special case is the guest login, which is described as a separate issue.

Suggested borderline cases for testing are, so far:
Log on using correct username + password

Log on using incorrect username + correct password

Log on using correct username + incorrect password

Log on using password/username with non-UTF8 characters

Log on, close tab, return to m.e17.dk. Are you still logged on?

Log on, log out, return to m.e17,dk. Still logged on?

Conclusion
As described below in the comments the test has been done, and no serious problems appeared. With the exception of the fact that some browsers use different names for the user, everything seems to work as intended.

Testing the settings feature consists mainly of making sure that all the pre-set options are registered when clicked, and that they still exist between loggins on and loggins off.

Assumption: In context of the guest logon, changes should not persist between sessions.

Borderline cases:

1. Log on, change background colour, etc and play a book, checking that the changes are registered.
2. Log out again, log on and check that the changes still persist
3. Log on as a guest, change background colour, text size, and font, play a book.
4. Log out, log on as guest again and check that the changes are not registered,

To problems occurred while testing the settings. 

1. When changing the settings while logged on as a guest the changes remain.
2. When changing the settings in IE9 the screen freezes.  

Conclusion
As it turns out the first problem described above is not a problem. Nothing else to report.

A guest login is used to give access to a limited amount of books to try the mobile player without an e17 account;
It can either be used by

Logging on with the credentials: guest/anypassword

By following a deeplink with the guest=true parameter set; ie http://m.e17.dk/#book-play?book=38277&guest=true
The test includes both options, where it is taken into consideration that

If a user following a deeplink is allready logged in with an e17 account, he is NOT logged on to the guest account.
There is sufficient error messages that explains to the guest user why he can't listen to other books that those on the shelf - this is in part solved because the buttons are not there, but still - if someone should get the idea of writing another bookid in the URL for instance.

Assumption: When logged on as a user, one should be able to find and add books to the book shelf, assuming that these books are freely available.

Borderline test cases:

1. Log on with credentials as described above.
2. Log on by following a deep link as described above.
3. Log on following a deep link to a non-free book (by just adding the '&guest=true'-parameter to the address)
4. Search for a random (non-free) book and try to add it to the book shelf
5. Search for a free book and add it to the book shelf
6. Play a book on the book shelf
7. Change one of the settings and start the book
8. Use the 'Del bog' feature by sending a mail to yourself - does the link to the book work?
9. Log on as a normal user, and click the guest deep link. Are you logged on as normal user or guest?
10. Log out as guest

Issues so far: When loggin on as a guest, an error message is presented to the user. After clicking 'Annulér' on the message, the user is logged in as a guest as intended.

Furthermore, when logged in as guest, none of the books on the book shelf are actually playable, this supposedly because they are carried in from the wrong catalogue.

Test general usability (readability) of the notification text message ('SMS') and asses the phones ability to follow the 'links' to mobile player and e17-website.

In order to test I need phone numbers to send to on each of the platforms (phone numbers with ability to receive sms).

Helt elementært skal det testes om tidsskrifter kan afspiles i E17 afspilleren.

This is a special case of the playing books-testing, and as such does not differ greatly in its border cases. When testing this particular type of book it is simply necessary to check that no errors in the usual functionalities occur due t the inclusion of both text and images.

Borderline cases for testing thus include:
.

1. Click 'play', and 'pause'
2. Click 'forward' and 'backward'
3. Exit the book at a chapter, and resume playing it
4. Exit the book at paragraph and resume playing it
5. Click the pictures whilst playing

Conclusion
Only one problem:
IE9 was unable to display the letters "Æ", "Ø", and "Å"

Testing the this feature might require setting up accounts for all the different clients to see if the mails received are actually working.

Testing the add + remove feature consists obvously of making sure of the basics (that the user is able to add any given book in the player and remove it again) and that the contents of the book shelf persists between sessions.

I am making this a separate issue, since it would otherwise likely be tested during both the testing of the search function and the actual playing of the books.

Borderline cases for testing:

1. Log on, find a book without text and add it to the book shelf
2. Find a book with text and add it
3. Find a book with text + images and add it
4. Find a very long book and add it
5. Find an english (or just foreign) book and add it.
6. Remove all the books that have just been added.
7. Log out, close the tab and log back in to check that the book shelf doesn't contain the above books
8. Try the above with the player open on two separate devices simultaneously - does the book shelf still register the correct changes?
9. Fin

Stress testing will consist of a compilation of all the existing border case test jobs, and given to a larger group of people working on all the different platforms. I am thinking that we do it in two batches with half of the platforms bein tested in each.

This is a reasonably difficult way of testing, but helpful in uncovering oddities not found in more regulated test scenarios. As we need a more general view of where we stand on functionality as the first thing, stress test is pushed till after the launch.

This needs to be tested on all platforms as well. It hasn't been tried out systematically.

I consider this test issue as fundamentally different from the other issues in this repository. What we would like to test is not whether the basic functionality works - that is, that entering a search phrase returns some output to
the user in the expected way. What we need to test is how well our search algorithm is working, and whether the choices it makes corresponds to the intentions of our users.

I think we need to test search a) first when it has been definitively decided what type of search engine we would like to have, b) with users.

Der skal testes om synkroninseringen virker de tre platforme imellem.

• E17 afspiller
• LYT
• E17

Same as testing the books without text, just making sure that the text in the file does not cause trouble and follows the recording.

Borderline cases for testing include:

1. Click 'play', and 'pause'
2. Click 'forward' and 'backward'
3. Exit the book at a chapter, and resume playing it
4. Exit the book at paragraph and resume playing it

Conclusion
Almost everything worked out as it was supposed to. Only two problems:

1. IE9 did not skip ahead to the right paragraph
2. The Windows Phone did neither skip ahead to the right chapter nor the right paragraph
   Both problems have been posted as issues

Conclusion
No real problems

Den enkelte bruger skal kun have de kanpper tilgængelige, som de har rettigheder til.

• Anonyme brugere
• Brugere med ret til punkt
• Brugere med ret til cd-bestlling
• E17 assistenter
• Digitale brugere - må kun downloade og streame bøger
• Undervisere - er udelukkende digitale brugere

We need to know how the player works with JAWS. So far this has not been tested at all.

I am assuming that we will have plenty of immediately demanding things to test, so I have placed the deadline of this further into the future than the other issues.

Men får jeg en mail..?

Lidt generisk test-beskrivelse, men i den storstilede Aprøvning 2.0 skal vi også huske at teste på 3G-netværk, og ikke udelukkende på wifi.

Naja

Deeplinks should direct to the login page, if the user is not already logged in, and then proceed directly to the book. Example deep link: http://m.e17.dk/#book-play?book=19645. It is not possible to link to a specific part of a book, e.g. a chapter or paragraph.

Issues so far: Loading stalls when using all deep links on all available platforms (counting all but the Windows phone, which hasn't been tried today), but as for now (14/03/2012) it seems that the code base is being fiddled with.

Borderline cases for test include:

1. Enter the address in the search bar whilst not logged in.
2. Enter the address the search bar whilst logged in as a normal user.
3. Enter the address whilst logged in as a guest user.
4. Log in as a normal user, log out, enter the address in the search bar.
5. Try deeplinking to a comic.
6. Add paragraph or chapter to the address and try to enter it.

Det skal undersøge, hvordan m.e17.dk virker, hvis linket tilgås på en platform der ikke understøtter HTML5,
dvs. fx Android 2.2, IOS3 osv, osv.

Er der ikke behov for en (fejl-)meddelelse om at afspilning ikke understøttes på disse platforme?

Testing the this feature might require setting up accounts for all the different clients to see if the mails received are actually working.

---- :: Conclusion :: ----
This feature seems to work without issues. One remark: When trying to send a link to a non-free book to someone who then logs in as a guest user, the guest is simply logged in to the default guest book shelf - the fact that the book from the original link is not there is not made explicit to him/her.