This site's content was compiled from 1993 to 2006. Beyond that, Google is your friend.
Steven White
This class breaks a string into tokens.
local
token : STRING
tokens : STRING_TOKENS
do
from
!!tokens.make
tokens.set_delimiters(",")
tokens.set("this is a string")
until
tokens.is_empty
loop
token := tokens.next
print(token)
end
end