/sci/ - Science & Math » Thread #12926963

6KiB, 337x149, nkjhkj.jpg

View Same Google iqdb SauceNAO

Anonymous Sun 04 Apr 23:47:12 2021 No.12926963 View Reply Original Report

Quoted By: >>12928552 >>12928555 >>12928569 >>12928766 >>12929583 >>12929627

BREAKTHROUGH IN NEURAL NETWORKS:
https://arxiv.org/pdf/2006.04182.pdf

Holy shit, backpropagation and predictive coding have been unified...This is IT...skynet is around the corner
Will you welcome our new robot overlords, sci?

Anonymous

View Same Google iqdb SauceNAO 2xr4bj.gif, 3MiB, 360x202

Anonymous Mon 05 Apr 2021 02:38:44 No.12927543 Report

Quoted By:

Anonymous

Anonymous Mon 05 Apr 2021 08:16:00 No.12928552 Report

Quoted By: >>12928577

>>12926963
>arxiv
this isn't another schizo post is it?
>"On the nature of infinity hats when applied to neural networks"

Anonymous

Anonymous Mon 05 Apr 2021 08:16:19 No.12928555 Report

Quoted By: >>12928565

>>12926963
this approach doesn't seem to offer any advantages. predictive coding performs similarly well to backpropagation.

Anonymous

Anonymous Mon 05 Apr 2021 08:21:39 No.12928565 Report

Quoted By:

>>12928555

From my reading it uses only local information, thus enables neuromorphic architectures.

Anonymous

Anonymous Mon 05 Apr 2021 08:24:12 No.12928569 Report

Quoted By:

>>12926963
looks retarded

Anonymous

Anonymous Mon 05 Apr 2021 08:28:23 No.12928577 Report

Quoted By:

>>12928552
arxiv is usually decent quality, vixra is where the schizos congregate. Both are still pre-pub.

Anonymous

Anonymous Mon 05 Apr 2021 09:20:17 No.12928766 Report

Quoted By:

>>12926963
"Due to the need to iterate the vs until convergence, the
predictive coding network had roughly a 100x greater computational cost than the backprop network."
oof

Anonymous

Anonymous Mon 05 Apr 2021 13:53:39 No.12929583 Report

Quoted By:

>>12926963
Lol, this has been know for a while now and know in more specific contexts for the last couple of years. In fact, it's so underwhelming it didn't even get great reviews on openreview

Anonymous

Anonymous Mon 05 Apr 2021 14:08:41 No.12929627 Report

Quoted By:

>>12926963
I don't get it desu. Wtf is predictive coding?

Anonymous

Anonymous Mon 05 Apr 2021 16:16:34 No.12930095 Report

Quoted By:

This is cool but it doesn't improve actual models.

Capcode	All Only User Posts Only Moderator Posts Only Admin Posts Only Developer Posts
Show Posts	All Only With Images Only Without Images
Deleted Posts	All Only Deleted Posts Only Non-Deleted Posts
Ghost Posts	All Only Ghost Posts Only Non-Ghost Posts
Post Type	All Only Sticky Threads Only Opening Posts Only Reply Posts
Results	All Grouped By Threads
Order	Latest Posts First Oldest Posts First

Your latest searches