Combines expressions in single word. For instance, climate change will become climatechange.

tokenization(x, token)

Arguments

x

a vector of characters. Typically a vector of titles/abstracts in which expressions listed in token must be replaced.

token

a vector of characters. Words expression to convert in single words

Examples

x <- "funrar: An R package to characterize functional rarity"
tokenization(x, token = c("R package", "functional rarity"))
#> [1] "funrar: An Rpackage to characterize functionalrarity"