Skip to content

Latest commit

 

History

History
35 lines (24 loc) · 1.22 KB

File metadata and controls

35 lines (24 loc) · 1.22 KB

Forward-Forward-Algorithm

the algorithm was produced by hinton in 2022 , using two forward passes to minic the learning in the cortex at sleeping (hinton statement).

Forward Forward Algorithm Paper

architecture

use contrastive learning , positive and negative pass including label of image correctly in positive and wrong label in negative images.

data
  • use 2 layer (512) network with softplus function (smoother than ReLU)
softplus

Result :

loss of testset 0.67% and accuracy 93.27%

loss



Arabic Summarization of the paper : here

Read More :