Questions and discussions about the testing procedure

[Henrik]

Please post questions and comments here ...

[bdmurray]

What is the criteria for a Pass or a Fail? Is it a matter of the install method working or not working? Or does any failure in the short test program constitute a Fail?

[Henrik]

Good question!
(the answer is unfortunately not straight forward ...)

It basically fails if there is a release critical issue, and the threshold for that varies at different stages.

At Herd 1 everything was quite unstable, so when the installer worked for most people and didn't wipe anyone's drive we were OK to go. A non-working OpenOffice might even have passed at that stage.

For Herd 2 we want the overall quality to be higher, and so on for Herd 3, until Beta which we want to be as bug free as swe can get it. The same goes for RC really. But for final we will only fix really critical bugs and so cosmetic things will be deferred for later updates.

Hope that helps. Please ask if you are in doubt on a specific case.

[davmor2]

May I recommend using sysinfo or hardinfo(i think is the alternative) to create a nice human readable hardware log file, setting up a separate section here where a copy of the log file can be pasted and then one copy of the hardware info for each tester is available. It would just mean that if there was a regular fault you may be able to pin it down to a specific piece of hardware. Just a thought.

[Henrik]

Yes, perhaps they can do that in the post where they register and then blink to that post in the testing posts.

About PASS/FAIL: The important thing is to log the bugs you discover and then someone with more experience to judge it that qualifies as PASS or FAIL. Ultimately it's up to the release manager (Tollef) and the Ubuntu dev team lead (Matt Zimmerman) to decide when a release is ready to go.

[Frak]

How is the Image ID found? Sorry if this is a stupid question...

[pochu]

The ID is the number of the daily-build. When you download the daily-build, it is on a folder with the ID. For example, 20070111.1 (the latest at this moment on http://cdimage.ubuntu.com/daily-live/ )

Regards
Pochu

[Frak]

Yeah I figured it out, as if you uncompress the ISO and read the .disc file it contains the same text. Thanks.

[STREETURCHINE]

okay i think i may have goofed i downloaded the fiesty desktop iso overnight but for the love of it i cant find the version number,or is it hidden in a file somewhere.
i downloaded the daily build _(current)

if some one can tell me how to find the number it would be great

[Frak]

Unpack the iso to your desktop, then look at .disk, and open the file inside of it.