One thing that comes to my mind as a possible improvement is somewhat better integration of Java functions returning java.math.BigInteger.
All Java functions which manipulate large numbers operate on these, and I've been bitten several times by things which display as a large number in Kawa but are not Kawa objects (i.e. Scheme + or - obviously don't work on them).
But I don't know whether it would be a good idea to automatically transform a java.math.BigInteger into a gnu.math.BigInteger when entering Scheme. They may have different semantics (shared or not, immutable or not byte[]).
I vaguely remember mentioning a biginteger problem with JDBC last year, but I don't have access to an Oracle DB anymore for testing.