Path: | lib/scoped_search/query_language/tokenizer.rb |
Last Update: | Tue Feb 05 18:48:12 -0500 2013 |
The Tokenizer module adds methods to the query language compiler that transforms a query string into a stream of tokens, which are more appropriate for parsing a query string.