like “his” and “her,” and word-like patterns. It obviously can’t use them coherently yet, but seeing these structures emerge from simple next-character prediction is pretty cool.
Built a small character-level RNN from scratch and trained it on Immortal Stories by Ruskin Bond — about 253,563 characters of text. Even with such a tiny model and limited training data, it has already started picking up spaces, punctuation, common pronouns
-Learning OS from cs 162 and dinosaur book book
-gained +103 in div2 contest ...currently 1370 rated
-implementing rnn
-more on transformers and attention
-trying to comfortable with vim and bash
Building a fully connected neural network clf from scratch for CS231n Assignment 1, then adding Momentum, AdaGrad, RMSProp, Adam, dropout, and normalization. Also finished Lecture 8 on attention and transformer,next up is reading and implementing “Attention Is All You Need.”
-create a two layer fully connected neural network from scratch , writing backpropogation from scratch is a nice way to understand thing better
-currently getting arroung 40% accuracy in training set (with batch size of 64)
-will try to improve this
#machinelearning#deeplearning
-watched the first lecture video of cs 162 by John Kubiatowicz .... even defining the os was crazy
- almost completed the basic pytorch form pytorch docs
will now complete the cs231n
- Reached pupil in codeforces next is blue😃.
- will try to complete cs231n lectures by aug10
- almost done with assign 1 will complete the rest by aug10
- will try to start a vision based project ,will share the info
- learnign bash scripting language and a bit about os
@ujjwalbeast And one non-solvable python implementation question which takes 10-15 mins to understand and another 15 mins to decide that whether u should attempt it or not
@ujjwalbeast Naa ...just try to login a few times and everything will be sorted and for the coding part there will probably be 2 DSA (easy to mid mostly easy questions) if u r decent u will pass all the test cases except one and this one will scare the hell out of u ...a simple SQL que
Went through the AlexNet research paper(first paper for me) will implement it next.
Next will go through the research papers of other architectures and will implement one or two of them.
Learned about different optimization algorithms today:
Momentum
AdaGrad
RMSProp
Adam
Next, I’ll implement each of them from scratch to understand how they work instead of just using them through a library.