Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Ethosoft
/
NedoTokenizer
like
1
Follow
Ethosoft
8
Rust
Turkish
nedotokenizer
tokenizer
turkish
morphology
lossless
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
NedoTokenizer
9.77 MB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
nmsofficial
Publish NedoTokenizer 32K tokenizer and source mirror
f00e721
verified
3 days ago
.github
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
THIRD_PARTY_LICENSES
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
assets
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
crates
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
python
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
.gitattributes
Safe
250 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
.gitignore
Safe
53 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
Cargo.lock
Safe
7.71 kB
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
Cargo.toml
Safe
647 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
HF_UPLOAD_SHA256SUMS
Safe
5.89 kB
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
LICENSE
Safe
724 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
README.md
Safe
1.2 kB
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
REPOSITORY_COMMIT
Safe
41 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
SHA256SUMS
Safe
382 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
SOURCE_COMMIT
Safe
41 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
pyproject.toml
Safe
1.55 kB
Publish NedoTokenizer 32K tokenizer and source mirror
3 days ago
