This is the mail archive of the
gdb-patches@sources.redhat.com
mailing list for the GDB project.
RFC: Known Failures [Was: RFD: Testsuite cases for inferior function calls]
- To: "Peter.Schauer" <Peter dot Schauer at regent dot e-technik dot tu-muenchen dot de>
- Subject: RFC: Known Failures [Was: RFD: Testsuite cases for inferior function calls]
- From: Fernando Nasser <fnasser at cygnus dot com>
- Date: Mon, 18 Sep 2000 16:42:47 -0400
- CC: gdb-patches at sourceware dot cygnus dot com
- Organization: Red Hat , Inc. - Toronto
- References: <200009182021.WAA26338@reisser.regent.e-technik.tu-muenchen.de>
"Peter.Schauer" wrote:
>
> As the usage of XFAILs throughout the testsuite increased during the last
> two years, you might as well XFAIL the test on the affected targets.
>
We've been discussing this for ages. I would like to introduce the KFAIL
(or known failures) category so we keep those separate. XFAIL should be used
when we expect something to fail on a platform/target because there is a limitation
on the environment or a bug in the operating system (note the difference: not a bug
in the software being tested, but in something we do not have control over).
If a test does not apply to a target at all because it does not have the capabilities
it should be marked as "unsupported" (we currently just skip the tests).
We would like to create a database to keep track of tests, so we would need to
improve our output a bit. For instance, I plan to change things so that tests have
the same identifier when they pass and for each of the reasons they can fail.
The idea is to split the text into id and reason.
Other suggestions? Comments?
--
Fernando Nasser
Red Hat - Toronto E-Mail: fnasser@cygnus.com
2323 Yonge Street, Suite #300 Tel: 416-482-2661 ext. 311
Toronto, Ontario M4P 2C9 Fax: 416-482-6299