libcudf  23.12.00
Namespaces | Functions
ngrams_tokenize.hpp File Reference
#include <cudf/column/column.hpp>
#include <cudf/scalar/scalar.hpp>
#include <cudf/strings/strings_column_view.hpp>

Go to the source code of this file.

Namespaces

 nvtext
 NVText APIs.
 

Functions

std::unique_ptr< cudf::columnnvtext::ngrams_tokenize (cudf::strings_column_view const &input, cudf::size_type ngrams, cudf::string_scalar const &delimiter, cudf::string_scalar const &separator, rmm::cuda_stream_view stream=cudf::get_default_stream(), rmm::mr::device_memory_resource *mr=rmm::mr::get_current_device_resource())
 Returns a single column of strings by tokenizing the input strings column and then producing ngrams of each string. More...