Fukushima's video (1986) shows a CNN that recognises handwritten digits [3], three years before LeCun's video (1989).
CNN timeline taken from [5]:
★ 1969: Kunihiko Fukushima published rectified linear units or ReLUs [1] which are now extensively used in CNNs.
★ 1979: Fukushima published the basic CNN architecture with convolution layers and downsampling layers [2]. He called it neocognitron. It was trained by unsupervised learning rules. Compute was 100 times more expensive than in 1989, and a billion times more expensive than today.
★ 1986: Fukushima's video on recognising hand-written digits [3].
★ 1988: Wei Zhang et al had the first "modern" 2-dimensional CNN trained by backpropagation, and also applied it to character recognition [4]. Compute was about 10 million times more expensive than today.
★ 1989-: later work by others [5].
REFERENCES (more in [5])
[1] K. Fukushima (1969). Visual feature extraction by a multilayered network of analog threshold elements. IEEE Transactions on Systems Science and Cybernetics. 5 (4): 322-333. This work introduced rectified linear units or ReLUs, now widely used in CNNs and other neural nets.
[2] K. Fukushima (1979). Neural network model for a mechanism of pattern recognition unaffected by shift in position—Neocognitron. Trans. IECE, vol. J62-A, no. 10, pp. 658-665, 1979. The first deep convolutional neural network architecture, with alternating convolutional layers and downsampling layers. In Japanese. English version: 1980.
[3] Movie produced by K. Fukushima, S. Miyake and T. Ito (NHK Science and Technical Research Laboratories), in 1986. YouTube: https://t.co/MUyH81L5wD
[4] W. Zhang, J. Tanida, K. Itoh, Y. Ichioka. Shift-invariant pattern recognition neural network and its optical architecture. Proc. Annual Conference of the Japan Society of Applied Physics, 1988. First "modern" backpropagation-trained 2-dimensional CNN, applied to character recognition.
[5] J. Schmidhuber (AI Blog, 2025). Who invented convolutional neural networks? https://t.co/chfcmk253b
A function ℝᵘ→ℝᵛ is rarely linear—yet locally it always is.
The Jacobian packs every first partial into one matrix:
𝐉(𝐱)=[∂fᵢ/∂xⱼ] (v×u)
so f(𝐱+Δ𝐱)≈f(𝐱)+𝐉(𝐱)Δ𝐱.
This matrix drives gradient steps in deep learning, joint-to-end-effector maps in robotics, and volume scaling |det 𝐉| under coordinate change.
Local change, fully captured by derivatives.
🚨 WOW. This brave Christian migrant from Iran walked up and WENT BERSERK on the proposed Islamic Center in McKinney, TX — straight to the council's face
The whole building ERUPTED after his dire warning:
"I'm a Sharia law survivor from Iran."
"I'm TELLING YOU, this is a BAD idea and you're going to REGRET not listening to people like us who lived under Sharia law!"
"I'm here to tell you this is a DANGEROUS ideology you're allowing in your country. Every country that is Islamic now, it used to be a Christian country and we were soft Christians."
"And we allowed these people to come in, bring their Sharia law into our countries and slowly k*ll us off left and right!"
"Let me make it very clear to you. Christianity is a personal relationship with God...Islam is Sharia law. Religion and state, which is not even compatible with the American thing and when these people will lie to you, to manipulate you."
"Because whenever Islam is little, they will lie to you and tell you they come in peace. This is level one!"
"Level two is what's happening in UK right now, where you have two-tier policing, where you have the blasphemy laws, Islamophobia, racism, all this nonsense that they talk about."
"Any time you criticize Islam, they will use the race card, but every country has this disgusting ideology inside their country, including my own country, Iran, Russia, Islamophobia is another made up bullsh*t because they don't want you to criticize their death cult!"
"If you question that disgusting book, they're get k*lled over it, just like my friends were apostates imprisoned or dead right now in Iran!"
HE NAILED IT!!!
@heisHIM3694 There’s no such thing as a “funny” racial slur. Barco can dress it up as banter all he wants, but calling someone a black monkey is pure racism. Bellingham’s reaction was justified.