Public Member Functions

WhitespaceTok Class Reference

Splits the words from a text by whitespace characters. More...

Inheritance diagram for WhitespaceTok:
Inheritance graph
[legend]
Collaboration diagram for WhitespaceTok:
Collaboration graph
[legend]

Public Member Functions

 tokenise (&$text)

Detailed Description

Splits the words from a text by whitespace characters.

Punctuation marks are also split from accompanying words.

Author:
Alexandre Trilla (atrilla)

Definition at line 47 of file WhitespaceTok.php.


Member Function Documentation

WhitespaceTok::tokenise ( &$  text  ) 
See also:
Tokeniser::tokenise(&$text)

Implements Tokeniser.

Definition at line 52 of file WhitespaceTok.php.


The documentation for this class was generated from the following file: