This is the mail archive of the
mailing list for the Mauve project.
Re: [Kissme-general] Re: Should I or not submit changes?
- From: Dalibor Topic <robilad at yahoo dot com>
- To: Mark Wielaard <mark at klomp dot org>, Andrew Haley <aph at cambridge dot redhat dot com>
- Cc: Brian Jones <cbj at gnu dot org>, Stephen Crawley <crawley at dstc dot edu dot au>, John Leuner <jewel at pixie dot co dot za>, Alex Lau <alex at dentonlive dot com>, kissme-general at lists dot sourceforge dot net, mauve-discuss at sources dot redhat dot com
- Date: Thu, 18 Jul 2002 07:07:43 -0700 (PDT)
- Subject: Re: [Kissme-general] Re: Should I or not submit changes?
--- Mark Wielaard <firstname.lastname@example.org> wrote:
> On Wed, 2002-07-17 at 16:13, Andrew Haley wrote:
> > If mauve wasn't such a pain to use and hack on I
> certainly would have
> > contributed more to it. Dejagnu, although
> horrible in its own special
> > way, at least allows individual tests to be
> developed and used without
> > needing the framework.
> I was thinking of having very simple support for
> "output comparison"
> tests. You write a bla/test.java class with a normal
> static main method
> that just prints to System.out.println and there is
> a bla/test.out file
> that contains the correct output of the test. The
> only drawback is that
> when people explicitly use Testlet.check() it is
> much more clear what it
> is they are precisely testing.
Kaffe's regression testing suite relies mostly on
output comparison. While it's a great way to create
tests in a minute, it's not that great in the end.
Sometimes the output depends on the locale you are in,
so people get erraneous failures. Sometimes people
will include toString() output in the expected
results, which is quite painful when you test for
exceptions. Unless you want to match Sun's messages
literally, of course.
In my opinion, explicit check methods that verify
single properties are more useful, as it is easier to
extract context information about failures, most
importantly which test failed. That is really hard if
something messes up your tests output beyound the
region matching capabilities of diff.
Do You Yahoo!?
Yahoo! Autos - Get free new car price quotes