/sci/ - Science & Math » Thread #12016756

101KiB, 492x677, Screenshot from 2020-08-16 22-59-16.png

View Same Google iqdb SauceNAO

Megatron-LM thread Mon 17 Aug 03:00:43 2020 No.12016756 View Reply Original Report

Quoted By: >>12017391 >>12020663 >>12021813 >>12023324

Better than GPT-3 with way fewer parameters.
https://arxiv.org/abs/1909.08053
Pic related

Anonymous

Anonymous Mon 17 Aug 2020 08:14:51 No.12017391 Report

Quoted By:

>>12016756
that's cool I gauss, call me back when we have a much more efficient learning approach that works using much much less training data.

Anonymous

Anonymous Mon 17 Aug 2020 08:20:13 No.12017398 Report

Quoted By: >>12019831 >>12020580 >>12020655 >>12021846

512 GPUs!? Good fucking lord. Have we missed something here, how do humans learn language with comparatively less computation resources?

Anonymous

Anonymous Tue 18 Aug 2020 00:44:26 No.12019831 Report

Quoted By: >>12021796

>>12017398
Our brains are comparable to supercomputers

Anonymous

Anonymous Tue 18 Aug 2020 07:06:33 No.12020508 Report

Quoted By:

bump

Anonymous

Anonymous Tue 18 Aug 2020 07:52:00 No.12020580 Report

Quoted By:

>>12017398
With 100 billion neurons.

Anonymous

Anonymous Tue 18 Aug 2020 09:05:22 No.12020655 Report

Quoted By:

>>12017398
3.5 billion years of evolution and actual selection acting on us.

Anonymous

View Same Google iqdb SauceNAO Screenshot_20200816-215003_rif i (...).jpg, 363KiB, 719x1337

Anonymous Tue 18 Aug 2020 09:10:01 No.12020659 Report

Quoted By: >>12021819

GPT2 was already too far. Now were just adding insult to injury

Anonymous

Anonymous Tue 18 Aug 2020 09:17:33 No.12020663 Report

Quoted By:

>>12016756
This is more an indictment of journalists and the current state of online news articles, and lack of verbal iq among this "elite class", than it is something to praise MLfags for. Desu.

Anonymous

Anonymous Tue 18 Aug 2020 16:52:48 No.12021796 Report

Quoted By:

>>12019831
Are supercomputers that strong? Last time I checked they weren't near our level

Anonymous

Anonymous Tue 18 Aug 2020 16:55:12 No.12021813 Report

Quoted By:

>>12016756
Can it do the same things that GPT-3 can other than generating text (namely, designing an UI & programming on user's text-inserted demands)?

Anonymous

View Same Google iqdb SauceNAO AI_Dungeon_Logo.png, 32KiB, 512x512

Anonymous Tue 18 Aug 2020 16:56:21 No.12021819 Report

Quoted By:

>>12020659
>Tfw I use GPT3 to coom
Will it put me in a roko's basilisk hellworld for my transgressions?

Anonymous

Anonymous Tue 18 Aug 2020 17:02:45 No.12021846 Report

Quoted By: >>12023320

>>12017398
>Have we missed something here
Correct me if I'm wrong but I'm pretty sure all these machine learning models require a billion times more training data than any human could ever receive & process just to be convincing. By default that would mean they are not supposed to be accurate representations/models of human intelligence.

Anonymous

Anonymous Tue 18 Aug 2020 23:53:08 No.12023320 Report

Quoted By:

>>12021846
>falling for the fake 'AI' meme
It's all crapware that's overhyped to death

Anonymous

Anonymous Tue 18 Aug 2020 23:55:02 No.12023324 Report

Quoted By: >>12023833

>>12016756
>GPT-3
Ahem. Not AI.

Anonymous

Anonymous Wed 19 Aug 2020 03:08:16 No.12023833 Report

Quoted By:

>>12023324
Yes. It should be called "cybernetics" in order to be historically correct. The tradition of AI has always been hostile to connectionist methods. But journalists are lazy and just call everything "AI"

Capcode	All Only User Posts Only Moderator Posts Only Admin Posts Only Developer Posts
Show Posts	All Only With Images Only Without Images
Deleted Posts	All Only Deleted Posts Only Non-Deleted Posts
Ghost Posts	All Only Ghost Posts Only Non-Ghost Posts
Post Type	All Only Sticky Threads Only Opening Posts Only Reply Posts
Results	All Grouped By Threads
Order	Latest Posts First Oldest Posts First

Your latest searches