Top Tweets for #Tokenizers
#DeSci Meets #Healthcare Enterprise: Why Come?
1. Unlike #crypto native events, this one’s trusted by hospitals, academia, pharma, and government.
2. Launchpad for Builders: We’re giving DAO founders, R&D #tokenizers, and #DePIN leaders a stage to show real world health impact.
3. Global #Policy & Industry Reach: Past participants from WHO, FDA, NIH, pharma companies, and academic institutions.
4. Get published: Speakers may be featured in Blockchain in Healthcare Today Platform Approaches Journal (BHTY) — the most cited journal in this space. DM us, contact the publisher, or reach out to an editor for speaking & demos opportunities.
Early Birds can register now at https://t.co/rj236t4u5m #ConV2X #DeSci
Want to speak or demo?
DM @BHTYJournal or email [email protected]
#Web3Health #ConV2X #BlockchainHealth #CryptoPharma #HealthTech
@DeSciWorld
@DeSciCollective
@vitadao
@gwei_sha
@SeiNetwork
@ReneeDiResta
@michelemillar1
@BioProtocol
@athena_DAO_
@psy_dao
@cryodao
@HairDAO_ @Healthunchaind

#DeSci Meets #Healthcare Enterprise: Why Come?
1. Unlike #crypto native events, this one’s trusted by hospitals, academia, pharma, and government.
2. Launchpad for Builders: We’re giving DAO founders, R&D #tokenizers, and #DePIN leaders a stage to show real world health impact.
3. Global #Policy & Industry Reach: Past participants from WHO, FDA, NIH, pharma companies, and academic institutions.
4. Get published: Speakers may be featured in Blockchain in Healthcare Today Platform Approaches Journal (BHTY) — the most cited journal in this space.
DM us, contact the publisher, or reach out to an editor for speaking & demos opportunities.
Early Birds can register now at https://t.co/6jpmiz5B6V
#ConV2X #DeSci #Web3Health #ConV2X #BlockchainHealth #CryptoPharma #HealthTech @DeSciWorld @DeSciCollective @vitadao @gwei_sha @SeiNetwork @ReneeDiResta @michelemillar1 @BioProtocol @athena_DAO_ @psy_dao @cryodao @HairDAO_

Just dropped C ABI for @huggingface Tokenizers. encode/decode/count tokens:
https://t.co/FtnZEu5aOA
It's designed for simple FFI implementations like this one I released in #RakuLang:
https://t.co/zCD33TVQkc
#Tokenizers #BuildInPublic
Excited for ICLR 2025 in Singapore? Join our BoF Social (24 Apr, 12:30 p.m., Opal 103-104) on tokenizer-free, end-to-end architectures. Ready for insightful discussions and networking? Sign up here https://t.co/x7szBWOCg2
#ICLR2025 #AIResearch #EnterpriseAI #Tokenizers

Training LLMs over Neurally Compressed Text
Brian Lester, Jaehoon Lee, Alexander A Alemi et al..
Action editor: Robert Gower.
https://t.co/kiPyEyTcXv
#compression #compressed #tokenizers
New #FeaturedCertification:
Training LLMs over Neurally Compressed Text
Brian Lester, Jaehoon Lee, Alexander A Alemi et al.
https://t.co/caRzEPpPwG
#compression #compressed #tokenizers
Tokenizers are unsung heroes play a crucial role in powering Large Language Models (LLMs), breaking down text into tokens that the models can understand and process. Wrote a blog on Tokenizers with Tamil and Selva https://t.co/CE8LluiOA2
#LLMs #tokenizers #GenAI
📢Forget about classical #tokenizers! Embed words via sparse activations over character triplets. (1) Similar downstream performance with fewer parameters. (2) Significant improvements in cross-lingual transfer learning. Joint work with @Aleph__Alpha
👉https://t.co/iuLFQ0oGqM

Congratz @credefi_finance, this is a great value-add for #tokenizers issuing their Digital Assets using @Brickken's Digital Asset Suite directly on @BNBCHAIN!
Hello Credefians,
We're thrilled to announce that @BNBCHAIN is now officially live on the Credefi Finance Platform! 🚀
This milestone reinforces our commitment to delivering top-notch service on a multi-chain basis. ⛓
Binance Smart Chain is a favorite among many users and businesses due to its fast transactions and low fees, making transfers quick and cost-efficient. ⚡️
We'll continue to push forward, enhancing your experience and providing you with the freedom of choice that everyone desires! 🤝
Stay tuned for more exciting updates! 🚀
#BSC #BinanceSmartChain #Credefi #CREDI #xCREDI #DeFi #TradFi #CeDeFi #RWA #RWFA #Borrowing #Lending #P2P #SME #FirstMovers #Web3 #NFTBonds

A huge thanks to Ankit Yadav and Hitesh Lodwal for their incredible presentation on "#Tokenizers and #Deduplication in #LLMs" in our #LLM #Marathon series! ✨
Your insights on preparing the data for the data-hungry LLMs were invaluable. 💯
#AI #ML #NLProc #TechTalks

I've just spent 3 hours on the #token process for #LLM as I really wanted to understand how it was working. Nice playground in #python with #Tiktoken from @openai and from #Tokenizers from @huggingface. Very good resources from there 😉🚀
New @YouTube video is out!🎥In this one, I explain three tokenizers that are commonly used when training LLMs: BPE encoding, wordpiece and sentencepiece.
Video link: https://t.co/5tceDnBln5
#LLM #GPT #ChatPT #Tokenizers #DeepLearning
Announcing our latest partnership with @technolawgeek
Techno Law Advisors is a law firm specializing in blockchain enterprises, particularly on decentralized financial entities like #tokenizers, DeFi, and exchanges. They offer legal guidance for companies venturing into #blockchain businesses in #Mexico or targeting the Mexican market.
➡️https://t.co/BCfYvFJIMO
--
Brickken partners both provide the Token Suite Solution as well as their assistance of their niche; from Legal to Financial & Marketing assistance

Another wonderful read from @simonw on how the #tokenizers used by the various #GPT models actually work, including an interactive tool for experimenting with their output.
🔑 Some of the key takeaways: -
• Most common English words have a single token assigned.
• Some words have tokens with a leading space, enabling more efficient encoding of full sentences.
• Non-English languages may have less efficient tokenization.
• Glitch tokens can lead to unexpected behavior.
Read more about it here: https://t.co/R37Cka63x3

So, let’s start talking about who we are and our key benefits for #tokenizers, #exchanges and #OTCDesks.
Preprint: https://t.co/88DIMtVuN4
Code (soon!): https://t.co/1kMvsD1LKz
Work with @JotyShafiq @lrvarshney @knmnyn @SFResearch @wing_nus @NUSComputing
#fairness #adversarial #AI #NLProc #world #englishes #tokenizers 6/6
Doing #SequenceLabeling with #Transformers for #NLProc ?
We just put out two blog posts and a repo about aligning offset annotations with @huggingface #tokenizers.
https://t.co/Ki5qt4vDwJ.
Why does this need two blog posts ? Thread below 👇
@Thom_Wolf You’re very welcome, Thomas! 100% agreed, @JuliaLanguage is great :)
Imagine #tokenizers for example: we could write them all in #Julialang instead of #Rust + a #Python binding
Faster than training from scratch - #Tutorial on how to fine-tune the English #GPT2 in any language with #Transformers, #Tokenizers & #fastai v2 (use case with Portuguese). Thanks to @huggingface, @jeremyphoward, @GuggerSylvain & @ailab_unb #NLP #DL #AI
https://t.co/O21oSlW0OA
@tfugmumbai
#tfugmumbai
Day 3 Task for Advanced users
Use #LSTM s, built #Keras models, used #Tokenizers
#seaborn https://t.co/xJX1Tznf12
Used #GLoVe 300dims in colab ,100 dims on kaggle
#10DaysofMLChallenge
Day 4 is on :)
#DeepLearning
Will add a screencast
Last Seen Hashtags on Sotwe
Most Popular Users

Elon Musk 
@elonmusk
240.2M followers

Barack Obama 
@barackobama
119.3M followers

Donald J. Trump 
@realdonaldtrump
111.6M followers

Cristiano Ronaldo 
@cristiano
109.1M followers

Narendra Modi 
@narendramodi
107M followers

Rihanna 
@rihanna
97.3M followers

NASA 
@nasa
92.1M followers

Justin Bieber 
@justinbieber
90.6M followers

KATY PERRY 
@katyperry
86.9M followers

Taylor Swift 
@taylorswift13
80.7M followers

Lady Gaga 
@ladygaga
72.3M followers

Kim Kardashian 
@kimkardashian
69.4M followers

Virat Kohli 
@imvkohli
68.7M followers

YouTube 
@youtube
68.6M followers

Bill Gates 
@billgates
63.5M followers

The Ellen Show
@theellenshow
62.5M followers

CNN 
@cnn
61.9M followers

Neymar Jr 
@neymarjr
61.3M followers

X 
@x
60.9M followers

Selena Gomez 
@selenagomez
60M followers






















