Bai Li

ML Engineer & PhD in NLP

[Bai Li @libai_94]

@basvanopheusden Thanks for sharing!

[Bai Li @libai_94]

Voice Writer is live on Product Hunt 👍🔼 Check it out and show your support by giving an upvote if you find it useful! https://t.co/bHHOj8cPvO

[Bai Li @libai_94]

@joshalbrecht Great work team and kudos to the very fast progress! 👏

[Bai Li @libai_94]

@isabelpapad @UBCLinguistics @KempnerInst Welcome to Vancouver! I’d love to catch up sometime once you’re here!

[Bai Li @libai_94]

Try out Voice Writer today: https://t.co/wJLi4wmTR9

[Bai Li @libai_94]

Now, with voice technology and and AI for grammar correction, I find I can produce 3-4x more content without worrying about minor language issues — between 2,000 to 3,000 words! 🚀This has allowed me to express my ideas more fully and creatively.

[Bai Li @libai_94]

I've been using Voice Writer for my blog posts, and I am much more productive. 🌟 Before, my posts averaged around 750 words.

[Bai Li @libai_94]

I built a voice writer tool to help you write things quickly. ⚡️ It uses AI for speech recognition and grammar correction. I have been using it for my book reviews, emails, Slack messages, and more. Here is a demo video. 😊

Try it out here: https://t.co/wJLi4wmTR9

[Bai Li @libai_94]

In this video, I cover the top 10 most cited papers in the history of natural language processing, ranked by number of Google Scholar citations. 📚 We cover milestones like the Transformer model, RNN, word vectors, and even go back to the roots with WordNet!

[Bai Li @libai_94]

New NLP video 🎥
https://t.co/QzGa7zQ1hI

[Bai Li @libai_94]

Challenges we faced:
- Teochew is related to Mandarin, a high-resource language, but how do we apply transfer learning?
- With zero resources for training, we had to build our dataset from scratch. 🛠️
- Teochew doesn't even have a writing system! How do we model that? 🤔

[Bai Li @libai_94]

🎥 New Video! In this video, we train a speech recognition model (using OpenAI's Whisper) to recognize our family's Chinese dialect, Teochew, or Chaozhou dialect (潮州话). It has about 10 million speakers and is a part of the Min Nan language family.

https://t.co/0BIpHngtAA

[Bai Li @libai_94]

More seriously - we'll use the RAG pattern, indexing HuggingFace metadata, integrating OpenAI embeddings with pgvector and chat models. I'll also explain some tips on how to rerank the chatbot's suggestions, deploy the project efficiently, and more.

[Bai Li @libai_94]

📹 New Video! Ever had trouble deciding which AI to use for your projects? Let's solve that with AI. In this video, I will build an AI to find the best AI for you 🤯
https://t.co/YniD6lUbrQ

[Bai Li @libai_94]

@osanseviero I've made a video about the KV cache, and I've also got videos on other LLM topics like RoPE embeddings, speculative sampling, quantization, etc. If you like learning through colorful animated videos, check them out! https://t.co/Bva2ctztqI

[Bai Li @libai_94]

It's a new technique called speculative sampling. A smaller LLM generates the easier tokens and a larger LLM checks them. And using a rejection sampling trick, there is no difference in accuracy!

Check out my video on how this works ➡️https://t.co/eTwLIGh75R

[Bai Li @libai_94]

📹 New Video! #LLMs can be slow, so this @GoogleDeepMind paper proposed to speed it up by running two LLMs at the same time. 😕 Wait what?

[Bai Li @libai_94]

Just published a comprehensive video highlighting EVERY area of Natural Language Processing research, in 24 categories. From Phonology to Translation to Summarization to LLMs, explore all of of NLP in 30 minutes!

[Bai Li @libai_94]

📺 New video: Map of Natural Language Processing

https://t.co/mtZDzgymid

[Bai Li @libai_94]

@sherwinwu ChatGPT clearly states that sensitive information should not be fed to it. My question to you is: if OpenAI does not train on user data, then why is this warning in place?