This week's journal club had us reading "The functional specialization of visual cortex emerges from training parallel pathways with self-supervised predictive learning."
#SMILEJournalClub
https://t.co/K2hkTPxif7
and movement. In particular, they show that a self-supervised model with two pathways can accomplish this task. Of interest, the paper discuss how a naive supervised model with two pathways cannot accomplish this task. What about the self-supervised approach enables...
Do the authors believe that it should be up to authors or journals to establish this type of structure? Who is to say which metrics are most insightful? Moreover, opinions about which metrics to report are constantly evolving for good reason, such as effect sizes > p-value.
A great paper reminding everyone to be critical when reviewing journal papers. The authors demonstrate how, even among experts, data leakage is a serious concern and question the usefulness of journal paper models due to reproducibility.
https://t.co/JcUGLkPuLU
#SMILEJournalClub
The paper advocates for a more well defined basis, structure, metric reporting scheme, and image preprocessing for all machine learning models, especially deep learning models. It seems reasonable for the future of machine learning research to have such guidelines in place.
The authors claim that this means that the common practice of using a single, "best" model should be challenged. If we should use multiple models when making prediction, should prediction be done with an ensemble method or simply report each model's output?
A paper discussing the "stability" of deep neural networks (DNN) to changes in initial weights. They analyze how the internal layers of DNNs with different initial weights represent the same image differently.
https://t.co/tILNBP0wbH
#SMILEJournalClub
The authors claim that this means that the common practice of using a single, "best" model should be challenged. If we should use multiple models when making prediction, should prediction be done with an ensemble method or simply report each model's output?
A wonderful time for our SMILE Lab's BBQ party and rock climbing at Lake Wauburg in the beautiful Gainesville's autumn sunshine! Happy Birthday to @kylebsee and @gcfullerton!
I would be interested in seeing how a dimension reduction technique, a LASSO method to identify SNPs associated with fundus as a subroutine, or a feature selection technique which allows for interaction such as subset selection would perform with respect to the p-value method.
Fun (?) read about how utilizing genetic information along with colour fundus images can provide an improvement over just colour fundus in the diagnosis of late age-related macular degeneration (AMD).
https://t.co/xGFkbmFhI7
#SMILEJournalClub
The authors briefly discussed using p-value <1x10^-5 feature selection technique to identify associated SNPs (about 1000) but that this model performed worse. I believe that this feature selection technique suffers from not accounting for interaction between SNPs.