alla flaggor
bookworm  ] [  trixie  ] [  sid  ]
[ Källkod: r-cran-tokenizers  ]

Paket: r-cran-tokenizers (0.3.0-1)

Länkar för r-cran-tokenizers

Screenshot

Debianresurser:

Hämta källkodspaketet r-cran-tokenizers:

Ansvariga:

Externa resurser:

Liknande paket:

GNU R fast, consistent tokenization of natural language text

Convert natural language text into tokens. Includes tokenizers for shingled n-grams, skip n-grams, words, word stems, sentences, paragraphs, characters, shingled characters, lines, tweets, Penn Treebank, regular expressions, as well as functions for counting characters, words, and sentences, and a function for splitting longer texts into separate documents, each with the same number of words. The tokenizers have a consistent interface, and the package is built on the 'stringi' and 'Rcpp' packages for fast yet correct tokenization in 'UTF-8'.

Andra paket besläktade med r-cran-tokenizers

  • beror
  • rekommenderar
  • föreslår
  • enhances

Hämta r-cran-tokenizers

Hämtningar för alla tillgängliga arkitekturer
Arkitektur Paketstorlek Installerad storlek Filer
armel 636,2 kbyte860,0 kbyte [filförteckning]