home << dhlab reference << dhlab.text.nbtokenizer
tokenize_timer#
from dhlab.text.nbtokenizer import tokenize_timer
- tokenize_timer(text)[source]#
Time the
tokenize()
function and return the resulting tokens.
home << dhlab reference << dhlab.text.nbtokenizer
from dhlab.text.nbtokenizer import tokenize_timer
Time the tokenize()
function and return the resulting tokens.