/* Tokeniser Module!                                            Version 1.0 
All items in this module subject to change.
So THERE!
                          ©1995 Michael Sparks. 
result:=wordup(string)
   converts string to uppercase.

token,next_char:=get_token(string)
   gets a token from the string provided, returns the token, and a pointer
   to the first character past the token in the string

token_list,num_tokens:=tokenise(string)
   returns a list of the tokens in the string. Also returns the number
   of tokens in the string

num_tokens:=count_tokens(line)
   returns the number of tokens in the string.

outputlist(tokenlist)
   outputs a tokenlist. (Uses WriteF() should you wish to redirect it...)
*/