AI Testing Quest

Finding my path for testing AI/ML systems in a learning journey. Checkout my stuff on LinkedIn as well: #ML #Testing #AITestingQuest

[AI Testing Quest @AITestingQuest]

Hi everyone! 👋 I'm kicking-off a journey to learn testing AI/ML systems & share the whole adventure. Follow along! Also check my activity on LinkedIn: https://t.co/A1LLWigMjD
#AI #ML #Testing #AITestingQuest

[AI Testing Quest @AITestingQuest]

Next up, I'm exploring the wider world of machine learning workflows 🤖⚙️ and how to automate and test each step. Stay tuned for more insights!

#AI #LLM #MachineLearning #Testing #AIWorkflow

[AI Testing Quest @AITestingQuest]

After a short break, I'm excited to share my latest progress with testing LLMs. 🎓Check out my learning journey, live sessions, and code here: ▶️ LLM Testing Playlist: https://t.co/xFaNaKFmAf ▶️ Live Recordings: https://t.co/hoOMs7CMrb ▶️ Repo & Resources: https://t.co/wJPjsJ39VA

[AI Testing Quest @AITestingQuest]

💥KA-POW💥
🤖Prompt Engineering🤖
Designing and optimizing inputs (prompts) to elicit the best responses from language models. It's like crafting the perfect question to get a detailed answer. #AI #LLM #KAPOW

[AI Testing Quest @AITestingQuest]

💥KA-POW💥
🤖BERT🤖
Bidirectional Encoder Representations from Transformers, a model that understands context in all directions. It's like reading a sentence forward and backward for deeper meaning. #AI #LLM #KAPOW

[AI Testing Quest @AITestingQuest]

💥KA-POW💥
🤖Self-Supervised Learning🤖
Learning from unlabeled data by generating labels from the data itself. It's like learning to solve puzzles by understanding patterns. #AI #LLM #KAPOW

[AI Testing Quest @AITestingQuest]

Catch up on my journey and the laughs along the way here: https://t.co/Iq4HrpAuEW

Stay tuned for this Friday’s Live! 💥📅 #AITestingQuest #AI #Testing #LLM #Learning #Faceplant #TrialAndError

[AI Testing Quest @AITestingQuest]

Since Friday's live, I've been sprinting towards the LLM testing knowledge with my dorky hat 🏃‍♂️💨. I've hit a few bumps along the way and even faceplanted 😅, but I'm still determined, not a chance to give up.

[AI Testing Quest @AITestingQuest]

💥KA-POW💥
🤖Distillation🤖
Compressing a large model into a smaller one while retaining performance. Think of it as creating a pocket-sized version of an encyclopedia. #AI #LLM #KAPOW

[AI Testing Quest @AITestingQuest]

Stay tuned for more as I wrap up the edits and refine the logic.

Catch the next part of our LLM journey this Wednesday! 📅06.09.2024 🕐 UTC 18:00 (EEST 21:00).

#AITestingQuest #LLM #ABTesting #AI #Evaluation #Python #TechTalks

[AI Testing Quest @AITestingQuest]

Had an awesome Friday Live session!🎥We "dived deep into the ever-changing world of LLMs, exploring their potential and limitations". 🤖 Started scripting an LLM judge evaluation—avoiding (mostly) other LLMs for fairness!😅

[AI Testing Quest @AITestingQuest]

Judging if an LLM can be a judge for an LLM. Judge.

Will meet you there! 🖖

#AITestinQuest #YoutubeLive #Testing #AI #LLM #Learning #LLMasaJudge #TestOracle

[AI Testing Quest @AITestingQuest]

Hi everyone! 👋

Take a different approach to the same question we already discussed about. Now with a bit more understanding and experience👉https://t.co/oojVXntTLZ

The place and time will be similar as last time:
Youtube, AITestingQuest channel at UTC 18:00 / EEST 21:00.

[AI Testing Quest @AITestingQuest]

💥KA-POW💥
🤖Positional Encoding🤖
Adding information about the order of words in a sequence to help the model understand context. It's like numbering the pages of a book. #AI #LLM #KAPOW

[AI Testing Quest @AITestingQuest]

Surprise results and detailed insights await! Check it out here: https://t.co/6Vu5KhTzLI

#AITestingQuest #AI #LLM #Testing #EvidentlyAI

[AI Testing Quest @AITestingQuest]

🚀Dive into AI testing with my latest video! I tested LLMs using 7 metrics and a factual correctness check, and the results are eye-opening.😱💥

📊phi3: 6/10 pass➡️4/7 metrics📊stablelm2: 6/10 pass➡️5/7 metrics📊tinyllama: 4/10 pass➡️5/7 metrics

Link in the comment! ⬇️⬇️⬇️⬇️⬇️

[AI Testing Quest @AITestingQuest]

💥KA-POW💥
🤖Masked Language Modeling🤖
A training method where some words in a sentence are hidden, and the model learns to predict them. It's like filling in the blanks of a story. #AI #LLM #KAPOW

[AI Testing Quest @AITestingQuest]

Evidently AI is a versatile tool for LLM & ML evaluation, mixing NLTK, DeepEval, and more. Check their docs: https://t.co/pt5BBZR9hr
Next session: 30.08.2024 @ 18:00 UTC - Testing an LLM | LLM evaluating LLMs: Can We Trust These AI Judges?
#LLM #AI #Testing #DeepEval #EvidentlyAI

[AI Testing Quest @AITestingQuest]

🚨 We just wrapped up the tool exploration subseries of "Testing an LLM"! 🎉 Last session was all about Evidently AI, and it was a wild ride! 🎢

Missed it? I’ll have a shorter version ready soon. But if you’re into the live drama, remember: Fridays are for #AITestingQuest! 😉

[AI Testing Quest @AITestingQuest]

Don't have any plans for today? Even if you do, just cancel it and join our next live session 👉https://t.co/NBqkwdEi4U
Book in your calendar: UTC 18:00 / EEST 21:00.
Evidently AI is in the focus this time, let's see how it works!🖖
#AITestinQuest #YoutubeLive #LLM #EvidentlyAI

[AI Testing Quest @AITestingQuest]

💥KA-POW💥
🤖Beam Search🤖
A heuristic search algorithm that explores multiple possible sentences simultaneously to find the best one. It's like navigating multiple paths to find the quickest route home. #AI #LLM #KAPOW