类 QwenLocalTokenizerUsage

java.lang.Object

QwenLocalTokenizerUsage

public class QwenLocalTokenizerUsage
extends Object

构造器概要

构造器

构造器和说明
QwenLocalTokenizerUsage()

方法概要

限定符和类型	方法和说明
static void	main(String[] args)
static void	testEncode()
static void	testEncodeOrdinary()

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

QwenLocalTokenizerUsage

public QwenLocalTokenizerUsage()

方法详细资料

testEncodeOrdinary

public static void testEncodeOrdinary()

testEncode

public static void testEncode()
                       throws NoSpecialTokenExists,
                              UnSupportedSpecialTokenMode

抛出:

NoSpecialTokenExists

UnSupportedSpecialTokenMode

main

public static void main(String[] args)