2/2 Using an unsupervised alignment method (Gromov-Wasserstein Optimal Transport), we show the similarity structures between visual judgment and verbal description align on the coarse categorical level but lack precise one-on-one stimulus-level mapping.
How is vision and language related in human material perception? New paper from my lab is now out at
@PLOSCompBiol. We find verbal descriptions capture material appearance at a coarse level, but precise alignment is still lacking. @liao_oial@mswym8
https://t.co/pvyFpgDQqY
1/2. Comparing representations of vision and language we find colorfulness, material name, and softness are the key features across participants. We also found that removing the “material names” from the text embeddings significantly decreased the correlation.
@jeroenerne@OpenlifesciAI@SaulehSiddiqui Could have several indications : 1) Clinical trial protocols have design issues that can be improved 2) The connections between drug classes across trials revealed by historical trial data could be explored before running the trial to allowing the exclusion of drugs.
🚨 Medical AI Research alert! 🚨
Can LLMs predict clinical trial outcomes from protocol documents?
American University Presents, CTP-LLM: Clinical Trial Phase Transition Prediction Using Large Language Models by @SaulehSiddiqui@XiaoMaterialLab
A Large Language Model & Benchmark for Clinical Trials
Here's why it's exciting: 1/9 👇🧵
#ClinicalTrials #MedicalAI #NLP #AI #Bioinformatics #GenAI #MachineLearning #HealthTech #Medical #LLM #GPT #Healthcare #pubmed #arxiv #vision #nlp #research #pathology #Radiology
Analyzing the image representation of materials obtained from various pre-trained deep neural networks, we find that similarity structures in human visual judgments align more closely with those of the vision-language models than purely vision-based models.
Our first model, CTP-LLM, is a specialized version of GPT-3.5 Turbo, trained on our PhaseTransition (PT) Dataset. Our second model, BERT+RF, combines a clinical Bidirectional Encoder Representations from Transformers (BERT) with a Random Forest (RF).
Very happy to share that our paper "CTP-LLM: Clinical Trial Phase Transition Prediction Using Large Language Models" is accepted by IEEE BIBM . https://t.co/Z57pCKBGqz
We predict #ClinicalTrials phase transition outcome from protocols using fine-tuned LLM.
I’m over the moon happy to celebrate the promotion to tenure of my colleague & office neighbor Hendrikje Nienborg @nienborglab. Her promotion shows that rigorous, careful science is rewarded, which is especially welcome news in today’s world of flashy but evanescent sound bites
🚨 Paper submission alert for BMVC 2024! 📅 Mark your calendars — the final deadline is this Friday, 10 May 2024. Don't miss your chance to showcase your latest research in computer vision.🔍✨
#BMVC2024#ComputerVision#PaperDeadline
🧠At NACS Seminar tomorrow, Dr. Hendrikje Nienborg (@nienborglab) will tell us about "Perceptual decisions as action-perception loops in neural circuits." The talk is at 10:15am in BRB 1103. Please check the flyer below for more info!
Of course, the investigator has to be excellent. But it does need a ton of luck and support. How do we give this support in earlier days? From day one?
Someone wrote us to encourage the nomination of a female scientist for YIA for @VSSMtg . To be impactful within 10 years of PHD. One needs 1) a supportive (optimal) family, 2) effective mentoring, and 3) supportive institutes. All posed extra challenges for female scientists.