/sci/ - Science & Math » Thread #12273078

85KiB, 500x492, unnamed.jpg

View Same Google iqdb SauceNAO

SICP for neural nets

Anonymous Sun 25 Oct 22:04:13 2020 No.12273078 View Reply Original Report

Quoted By: >>12273236 >>12273251 >>12273273 >>12274656

What is the SICP for neural networks? Does it even exist yet?

Anonymous

View Same Google iqdb SauceNAO 51wKDy1RWIL._SX377_BO1,204,203,2 (...).jpg, 46KiB, 379x499

Anonymous Sun 25 Oct 2020 22:51:28 No.12273236 Report

Quoted By:

>>12273078

Anonymous

Anonymous Sun 25 Oct 2020 22:58:48 No.12273251 Report

Quoted By: >>12273849

>>12273078
training a network is just minimization and the output of the trained network is just matrix arithmetic.

ML is just a very lazy way to do fitting. the hallmark of NNs is that you use a fit that has way too many parameters with highly nonlinear terms and rely on huge statistics in the training to get a fit that’s not shit. anyone who ever did human-tier science or statistics knows exactly why this is a very shitty way to do things and why even using the word “model” to describe what they are doing is severely deluded

Anonymous

Anonymous Sun 25 Oct 2020 23:09:12 No.12273273 Report

Quoted By: >>12273530

>>12273078
>SICP for neural nets
what do you mean by this? You mean an introductory text that's good, and in some instances great, but by far does not teach nor demonstrate the depth or breadth of its subject, despite codemonkeys holding it as the bible of all things related to computers?

Anonymous

Anonymous Mon 26 Oct 2020 00:28:47 No.12273530 Report

Quoted By: >>12273849 >>12273877 >>12274686

>>12273273
I learned a lot from SICP, like "oh that's what a computer is doing" in a more profound way. Was hoping for a similarly enlightening book about NNs. I see a few textbooks on Amazon but they're ~$hundos and I don't wanna buy garbage. Until then I'm just working on calc and vector algebra in spare time. I guess if one can progress to literacy in vector calculus that's enough to start doing things on your own in this space.

Anonymous

Anonymous Mon 26 Oct 2020 02:16:26 No.12273849 Report

Quoted By:

>>12273251
>this is a very shitty way to do things
Oh Jeez, guess all the success of the last decade is delusional.

>>12273530
I was also looking for a comprehensive source, but found none. I read Bishop, Goodfellow, Deisenroth and some other one I can't remember because it sucked, several blog posts and papers. The mixture of all of these sources gave me good understanding, but I'm 99% that a comprehensive guide doesn't exist yet. The reason might be that the field is advancing so quickly that information today is already outdated next month.

Anonymous

View Same Google iqdb SauceNAO 7de3ccc6-716f-4dd3-bd7b-16342f2e (...).jpg, 43KiB, 1500x1000

Anonymous Mon 26 Oct 2020 02:26:32 No.12273877 Report

Quoted By:

>>12273530
>buying books

Anonymous

View Same Google iqdb SauceNAO ddd.png, 115KiB, 1356x851

Anonymous Mon 26 Oct 2020 10:22:18 No.12274656 Report

Quoted By:

>>12273078
i am using as a starting point

https://cs.stanford.edu/people/karpathy/convnetjs/index.html
https://cs.stanford.edu/people/karpathy/convnetjs/demo/automatic.html

everything in browser and lots of ui to understand what's going on, i hope when i get my bearings i'll have an easier time moving forward to a "heavy" cuda enabled environment. with preference to some sort of array language.

Anonymous

Anonymous Mon 26 Oct 2020 10:36:16 No.12274686 Report

Quoted By:

>>12273530
>I learned a lot from SICP, like "oh that's what a computer is doing" in a more profound way.
there is no such book, not just because it hasn't been written, but because we don't know what NNs do in a similar way to the SICP explanations.
How exactly NNs do and why they are effective is still an active and arduous area of research(frankly moving at snails pace, as it's legit difficult).

Anonymous

Anonymous Mon 26 Oct 2020 15:07:09 No.12275060 Report

Quoted By: >>12275103 >>12275832

Why has nobody asked what SICP is?
What the hell is SICP?

Anonymous

View Same Google iqdb SauceNAO SICP_cover.jpg, 50KiB, 400x579

Anonymous Mon 26 Oct 2020 15:20:45 No.12275103 Report

Quoted By: >>12275472 >>12275955

>>12275060
A really fucking good book.

Anonymous

Anonymous Mon 26 Oct 2020 17:08:31 No.12275472 Report

Quoted By:

>>12275103
Ah I see, thanks.

Anonymous

Anonymous Mon 26 Oct 2020 18:46:55 No.12275832 Report

Quoted By: >>12275925

>>12275060
if you cant google "SICP" you dont have enough intelligence to read the book so dont bother

Anonymous

Anonymous Mon 26 Oct 2020 19:13:44 No.12275925 Report

Quoted By:

>>12275832
>hurrr durrr Google know eberthing
>just Google everything I'm too lazy to communicate normally
You're the LIP of the SC.

Anonymous

Anonymous Mon 26 Oct 2020 19:24:05 No.12275955 Report

Quoted By:

>>12275103
so good that even its author said the book is irrelevant

Capcode	All Only User Posts Only Moderator Posts Only Admin Posts Only Developer Posts
Show Posts	All Only With Images Only Without Images
Deleted Posts	All Only Deleted Posts Only Non-Deleted Posts
Ghost Posts	All Only Ghost Posts Only Non-Ghost Posts
Post Type	All Only Sticky Threads Only Opening Posts Only Reply Posts
Results	All Grouped By Threads
Order	Latest Posts First Oldest Posts First

Your latest searches