/sci/ - Science & Math » Thread #10809198

115KiB, 635x588, MLG.jpg

View Same Google iqdb SauceNAO

/MLG/ - Machine Learning General

Anonymous Mon 15 Jul 18:09:03 2019 No.10809198 View Reply Original Report

Quoted By: >>10809393 >>10809711 >>10811188 >>10814311 >>10816549 >>10819693

Studying, trying and discussing everything related to machine learning, neuronal networks and AGI.

Old thread >>10769848

Ongoing projects:
Different DeepNude implementations with czechcasting dataset ( https://mega.nz/#!IKwxXAgI!YpI648jsxvPdyfKwlAyypVEm_jnUgWXde8MJmjNgSBI )
Pepe generation with StyleGAN

Related links:
>dreamscopeapp.com - recreates an image in the style of another image (made pic related using this)
>deepart.io - same as above but it takes longer
>thispersondoesnotexist.com - generates portraits of people
>thiswaifudoesnotexist.net - generates portraits of anime girls
>thiscatdoesnotexist.com - generates (mostly terrible) pictures of cats
>ganbreeder.app - generates images of certain "topics"
>waifu2x.booru.pics - doubles the size of images and helps with noise reduction
>talktotransformer.com - generates several paragraphs of text from a prompt
>https://make.girls.moe/ - another anime character generator

Anonymous

Anonymous Mon 15 Jul 2019 19:42:26 No.10809368 Report

Quoted By:

why are you linking waifu AI?

It's not SOTA.

http://forums.qhimm.com/index.php?topic=18798.0

Try this ESRGAN-for-retards GUI
or directly https://github.com/xinntao/ESRGAN

There are manga dataset trained versions that will do better than waifu

Anonymous

View Same Google iqdb SauceNAO 2019-03-01-stylegan-twdne-64best (...).jpg, 514KiB, 1800x1800

Anonymous Mon 15 Jul 2019 19:50:54 No.10809393 Report

Quoted By: >>10809482 >>10809927

>>10809198
>thiswaifudoesnotexist.net - generates portraits of anime girls
Why can't I hold all these waifus?!

Anonymous

Anonymous Mon 15 Jul 2019 20:24:10 No.10809482 Report

Quoted By: >>10809663

>>10809393
Why not? I have $G_{64}\underbrace{\uparrow\uparrow...\uparrow}_{G_{64}} G_{64}$ waifus. Doing pretty fine.

Anonymous

Anonymous Mon 15 Jul 2019 22:00:52 No.10809663 Report

Quoted By:

>>10809482
I have tree(3) waifus

Anonymous

Anonymous Mon 15 Jul 2019 22:23:49 No.10809711 Report

Quoted By: >>10809736 >>10811418

>>10809198
>>thispersondoesnotexist.com - generates portraits of people

What sort of training/architecture is required for generating images with this quality? I've been trying for days on the celeba dataset with a keras GAN model, but couldn't get them to look nowhere near as good as this

Anonymous

View Same Google iqdb SauceNAO 3.png, 172KiB, 1040x711

Anonymous Mon 15 Jul 2019 22:25:44 No.10809714 Report

Quoted By: >>10809731 >>10809851

I spent the better half of the day stripping down the feed forward neural network (the pure python implementation for digit recognition, from that popular online book) to a more concise script. Mostly for the sake of making a video about it, maybe tomorrow.

https://gist.github.com/Nikolaj-K/ecb7cde9aadbf4efa08cf1b0456a17ee

https://www.youtube.com/c/NikolajKuntner

Anonymous

Anonymous Mon 15 Jul 2019 22:31:40 No.10809731 Report

Quoted By: >>10811185

>>10809714
I had already found your YT channel by pure coincidence. Glad to know you are from /sci/.

I'm a sub

Anonymous

Anonymous Mon 15 Jul 2019 22:34:29 No.10809736 Report

Quoted By:

>>10809711
It's the pretrained StyleGAN model.

Anonymous

Anonymous Mon 15 Jul 2019 23:09:00 No.10809814 Report

Quoted By: >>10809844

Damn, I didn't know we even had a general for this, I haven't been on /sci/ in over a year
Fuck I need to start bosting

Anonymous

Anonymous Mon 15 Jul 2019 23:22:16 No.10809844 Report

Quoted By: >>10813163

>>10809814
This is only a second thread, so you hadn't missed much.

Anonymous

Anonymous Mon 15 Jul 2019 23:26:44 No.10809851 Report

Quoted By: >>10809900

>>10809714
Theory is a good thing for sure, but at this point it mostly the waste of time. Smart people already made all libraries needed to make really cool things without thinking too much how exactly it works on the background.

Anonymous

View Same Google iqdb SauceNAO fake_img_0064_134000.jpg, 60KiB, 512x512

Anonymous Mon 15 Jul 2019 23:42:19 No.10809887 Report

Quoted By: >>10810146 >>10810369 >>10811195 >>10812835 >>10817564

Cherry picked some pepes from last generations. What do you think boys, is it good enough?

Anonymous

View Same Google iqdb SauceNAO hqdefault.jpg, 22KiB, 480x360

Anonymous Mon 15 Jul 2019 23:47:56 No.10809900 Report

Quoted By: >>10813163

>>10809851
I think theory is necessary for innovation and understanding - but even beyond any argument of that sort, the math of it is more fun to me than the use of it (my PhD is in statistical physic theory)

Anonymous

Anonymous Mon 15 Jul 2019 23:59:33 No.10809927 Report

Quoted By: >>10811021

>>10809393
Can't tell if I am a flawed fleshy pattern recognition machine or all red eye brown hair waifus are just trained from a single holo image set.

Anonymous

Anonymous Tue 16 Jul 2019 00:14:26 No.10809967 Report

Quoted By: >>10810588 >>10810642 >>10813169

How important is data structures/algs to ML? I haven't had a course in them but I am pretty good at learning on the fly.

Anonymous

Anonymous Tue 16 Jul 2019 01:43:51 No.10810146 Report

Quoted By: >>10810369

>>10809887
Wow, that's way better than any pics I saw previously of PepeGan

It's not good enough yet though keep improving

Anonymous

Anonymous Tue 16 Jul 2019 03:37:56 No.10810369 Report

Quoted By: >>10810637 >>10825887

>>10809887
>>10810146
Ok, training the machine to draw pepe is one thing..but training the machine to come up with rare pepes that are doing certain tasks or in different poses are another.

Anonymous

Anonymous Tue 16 Jul 2019 06:14:06 No.10810588 Report

Quoted By:

>>10809967
not too important

Anonymous

Anonymous Tue 16 Jul 2019 07:02:50 No.10810637 Report

Quoted By: >>10825887

>>10810369
Task like this isn't well understood yet. There is conditional GANs, but they require manual labeling. Rare pepes may be achieved by mixing different datasets and then looking for unique pepes in latent space.

Anonymous

Anonymous Tue 16 Jul 2019 07:05:33 No.10810642 Report

Quoted By:

>>10809967
Depending of what you gonna do with it. If you want to invent new engines loss function, then you probably need some understanding of crucial ML algorithms. If yoh wanna just play with you barely have to understand programming at all.

Anonymous

View Same Google iqdb SauceNAO dougie.jpg, 55KiB, 1280x720

Anonymous Tue 16 Jul 2019 11:03:52 No.10810900 Report

Quoted By: >>10810925 >>10810999

>be Data analyst
>softer education background with business masters (some financial analysis, stats etc)
>end up being breddy good at Python, knows Pandas etc inside out
>company makes Data Science team, get put on it, title change to Data Scientist
>we're slowly looking into ML projects
>beginning to realise programming is the easy bit here

I need to git gud, I'm a fraud DS atm.

I have the programming skills but not the stats knowledge to know what I'm really doing when fucking around with Sklearn.

I have a vague idea of how decision trees and random forests works, and know the difference between supervised/unsupervised, classification/regression etc but that's about all.

What do /mlg/? I want to live the data meme for real

Anonymous

Anonymous Tue 16 Jul 2019 11:13:54 No.10810925 Report

Quoted By: >>10810938 >>10811261

>>10810900
Commit to read statistics texts for at least 30 minutes a day (after 30 you can stop and do something else, without bad conscious, or - if you're still interested - read on). This way you read 15 hours a month or more.
Search for book recommendations in book recommendations threads on StackExchange and use libgen to download it.

Anonymous

Anonymous Tue 16 Jul 2019 11:18:55 No.10810938 Report

Quoted By: >>10810987

>>10810925
I'm up for that

Give me a book to start with and I'll go from there

Anonymous

View Same Google iqdb SauceNAO 1_O9HyohP5spct_XgxvG6PDg.jpg, 156KiB, 768x1024

Anonymous Tue 16 Jul 2019 11:44:37 No.10810987 Report

Quoted By:

>>10810938
Read this

Anonymous

Anonymous Tue 16 Jul 2019 11:48:32 No.10810994 Report

Quoted By:

>Evolution of Face Generation | Evolution of GANs
https://www.youtube.com/watch?v=C1YUYWP-6rE

Anonymous

Anonymous Tue 16 Jul 2019 11:52:52 No.10810999 Report

Quoted By:

>>10810900
Also watch this https://www.youtube.com/watch?v=1lxHH1UBTBU

Anonymous

Anonymous Tue 16 Jul 2019 12:03:54 No.10811021 Report

Quoted By:

>>10809927
kek you're right

Anonymous

View Same Google iqdb SauceNAO 0.webm, 1MiB, 256x256

Anonymous Tue 16 Jul 2019 12:41:34 No.10811122 Report

Quoted By: >>10811192 >>10812172 >>10812984 >>10814164 >>10825889

I think I'm done with it for now. Results are pretty shitty, but I think you could do much better if use checkpoint from anime face generation models instead of training it completely from scratch. And better graphics card would be helpful for sure. Don't even try it on the average laptop like I did.

Here is the dataset I collected along with the script for data augmentation: https://mega.nz/#!QeAHFSgB!3DNv5MAjM-_g2gDX7IyQtU8lDpbWOmZ88vtiXya7BTA
This is the implementation of StyleGAN I used: https://github.com/taki0112/StyleGAN-Tensorflow but I would rather recommend to use original one.

Anonymous

Anonymous Tue 16 Jul 2019 13:05:52 No.10811185 Report

Quoted By:

>>10809731
>I'm a sub
Very forward anon, he does look like a big ol bear though.

Anonymous

Anonymous Tue 16 Jul 2019 13:08:39 No.10811188 Report

Quoted By:

>>10809198
Thank you for not calling this:
>Artificial Intelligence General
That's good of you.

Anonymous

Anonymous Tue 16 Jul 2019 13:13:08 No.10811192 Report

Quoted By:

>>10811122
That's great anon

Good to see actual projects appearing on /sci/

Anonymous

Anonymous Tue 16 Jul 2019 13:14:18 No.10811195 Report

Quoted By:

>>10809887
Some of them are about the level of shitposters on paint here

Which means it's pretty damn good

Anonymous

Anonymous Tue 16 Jul 2019 13:23:24 No.10811217 Report

Quoted By: >>10811246 >>10811401 >>10813228

I want to actually get started with ML. What's a simple project that's more original than reading digits?

Anonymous

View Same Google iqdb SauceNAO Tetration_by_escape.png, 26KiB, 1000x600

Anonymous Tue 16 Jul 2019 13:32:07 No.10811246 Report

Quoted By: >>10811401 >>10811455 >>10814230

>>10811217
Try to predict function from it's graph. Like you feed the network set of points and spits the underlying function like so [(0, 0), (0.4, 0.389), (1.3, 0.964),...] -> sin(x). It does not require huge amount of memory or processing and all data points might be generated on the fly, so it should be super easy even for beginners.

Anonymous

Anonymous Tue 16 Jul 2019 13:37:22 No.10811261 Report

Quoted By:

>>10810925
>Commit to read statistics texts for at least 30 minutes a day (after 30 you can stop and do something else, without bad conscious, or - if you're still interested - read on). This way you read 15 hours a month or more.
Side off topic post but this is a very good advice. I too wasted most of my life inefficiently trying to force myself to study stuff for 6 hours a day without interruptions because dude stoicism lmao, but every single time I burned out just a week later and had to revert to two weeks of mediocrity and impulse satisfaction before I could even go back to studying reliably for more than an hour. The reason for this is that our brains haven't evolved for long-term reward evaluation and will always seek short-term rewards for whatever you're about to lose your precious energy on, and if you fail to provide that reward and instead whip yourself like an autistic stoic, yes, you will be able to lose your energy and stare at the text but your brain would shut down and most likely even associate this task with negative stimuli as it is not rewarding, up until one day you forget about it and start seeking short-term rewards again.

The only way to avoid this is either associating studying with short term rewards (good fucking luck with that), or rewarding yourself every 30 or so minutes before the brain starts realizing that you're not getting anything off of this and shuts down again.

Anonymous

Anonymous Tue 16 Jul 2019 14:26:13 No.10811365 Report

Quoted By: >>10811423

If this general is going to survive we need a pasta

I suggest some good ML blogs would be a good thing to have in there. Not the million 'how to do Big Data Machine Learnin' by pajeets but actual good ones doing interesting things with their data

This kind of thing:
https://invenia.github.io/blog/2018/07/18/EIA-coal/

Though maybe more interesting than that

Anonymous

Anonymous Tue 16 Jul 2019 14:45:30 No.10811401 Report

Quoted By: >>10811413 >>10814230

>>10811217

i'd try to train a 9x9 mini alphago, or whatever your favorite board game is as long as the rules aren't too complicated. maybe start off with a simple cnn model, bootstrap it with a supervised pretraining on real 9x9 games, and then see if you can improve it with reinforcement learning via adversarial self-play.

you could even start out with tic-tac-toe as a sort of sanity check

>>10811246

neural networks aren't good regression models. they're really more suited for discrete classification tasks

Anonymous

Anonymous Tue 16 Jul 2019 14:52:49 No.10811413 Report

Quoted By:

>>10811401
>neural networks aren't good regression models. they're really more suited for discrete classification tasks
[spoiler:lit]Everything much simpler. This task is impossible.[/spoiler:lit]

Anonymous

Anonymous Tue 16 Jul 2019 14:53:57 No.10811418 Report

Quoted By: >>10812702

>>10809711
If I recall correctly, the authors used multiple super-expensive Nvidia Tesla cards and the training still took several days. If you're running a normal computer with a normal GPU (even if it was 2080 Ti) you're out of luck.

Anonymous

Anonymous Tue 16 Jul 2019 14:57:19 No.10811423 Report

Quoted By:

>>10811365
There are various awesome-deep-learning github repos and some are quite extensive and good

Anonymous

Anonymous Tue 16 Jul 2019 15:11:26 No.10811455 Report

Quoted By:

>>10811246
Good one.

Anonymous

Anonymous Tue 16 Jul 2019 20:36:22 No.10812172 Report

Quoted By:

>>10811122
It's an infinite continuum of Pepes!!

Anonymous

Anonymous Wed 17 Jul 2019 00:44:18 No.10812702 Report

Quoted By: >>10812758

>>10811418
I know, i don't expect to get the same result. But there's a tutorial for PyTorch, where a regular GAN is used, it's available here: https://pytorch.org/tutorials/beginner/dcgan_faces_tutorial.html

I'm trying to adapt the same model for Keras. It should be able to run on a regular GPU and generate reasonably good looking images, but still mine look like total crap and are taking too many epochs of training... I'm starting to believe that it's some limitation of Keras, since I'm using the exact same architecture.

Anonymous

Anonymous Wed 17 Jul 2019 01:06:42 No.10812758 Report

Quoted By: >>10812824

>>10812702
>Keras
Bad idea. Keras was built with feed-forward networks in mind. You can make GAN with it, but it will work 10 times slower than tensorflow. And keras not make much sense standalone now, because it's a official part of tensorflow. So my advice to you, if you wanna learn GANs, take any relatively simple models and try to manually convert it from tf1 to tf2. That would be not only a good way to learn tf2, but will actually do useful job for the community.

Anonymous

Anonymous Wed 17 Jul 2019 01:30:42 No.10812824 Report

Quoted By:

>>10812758
thx for the advice. But I don't think it's solely a running time problem because, as I said, my model takes too many epochs (something like 10) to generate the shitty pictures, while the PyTorch implementation takes about 3 or 4, using the same minibatch size. I suspect it's because Keras doesn't allow us to calculate the gradients for the discriminator with both fake and real images, and then update the weights simultaneously, as its done in the PyTorch tutorial. Don't know if TF will allow this, but I might try it. I understand that Keras isn't the best option, but I'd still like to know why it's not working anyway...

Also, is there any reason for using TF2 instead of PyTorch for pure research? Most of my colleagues at uni only use Keras and PyTorch. No one touches TF for some reason. I've used TF1 a while ago, but it was for GRUs, which are terrible to implement with Keras.

Anonymous

Anonymous Wed 17 Jul 2019 01:35:17 No.10812835 Report

Quoted By: >>10812984

>>10809887
Neat. Can you share the project and dataset?
That would be awesome.
You're using some gan?

Anonymous

Anonymous Wed 17 Jul 2019 02:47:55 No.10812984 Report

Quoted By: >>10812999

>>10812835
Here it is. >>10811122

Anonymous

Anonymous Wed 17 Jul 2019 02:54:24 No.10812999 Report

Quoted By:

>>10812984
Oh, thanks mate!

Anonymous

Anonymous Wed 17 Jul 2019 03:40:30 No.10813163 Report

Quoted By: >>10813852 >>10821932

>>10809844
Well I had a data scientist job interview today, for a big bank. They seemed really impressed but I have my technical interview (i hope) later with some of their quants.

>>10809900
Don't listen to that guy. If you don't know the theory behind your ML algorithms you are utter garbage.
Btw nice field, were you doing statistical mechanics? A lot of good data scientists seem to come from stat mech and solid state physics.

Anonymous

Anonymous Wed 17 Jul 2019 03:41:47 No.10813169 Report

Quoted By:

>>10809967
It depends!
For running your ML algorithm, like the other guy said you barely need any programming.

For DEPLOYMENT and big data you need to know a lot of programming and IT stuff in general. Even some basic web development is really useful.

Anonymous

Anonymous Wed 17 Jul 2019 03:54:49 No.10813228 Report

Quoted By:

>>10811217
Clean some data and learn Pandas.
Then try to predict something with linear regression.

Anonymous

View Same Google iqdb SauceNAO Idris_ava.png, 9KiB, 200x200

Anonymous Wed 17 Jul 2019 08:23:03 No.10813852 Report

Quoted By: >>10814177

Is there a way where we can raise the participation in this thread - maybe get some more collaborative work going? Those 10 posts a day that the thread gets are surprisingly disappointing.

>>10813163
Despite having had jobs in augmented reality, quantum computing and the blockchain space, I never got deep into machine learning and data science. I was doing statistical physics for chemical kinetics, actually.

Anonymous

Anonymous Wed 17 Jul 2019 11:16:35 No.10814159 Report

Quoted By: >>10823992

I've noticed almost everybody here has a background in a meme field. Guess serious scientists should avoid the trash can that is Data Science.

Anonymous

Anonymous Wed 17 Jul 2019 11:18:28 No.10814164 Report

Quoted By:

>>10811122
It's actually super fucking cool

Anonymous

Anonymous Wed 17 Jul 2019 11:33:32 No.10814177 Report

Quoted By: >>10814415 >>10814432 >>10818337

>>10813852
Last thread was one of very few that reached bump limit and not die like of the threads on /sci/. So it's not so bad. We still have a guy who was working on different DeepNude implementation. By the way original version is up on the air again https://github.com/lwlodo/deep_nude

You can also try to do better pepe generator, or just expand the dataset it if you have some rare pepes.

Anonymous

Anonymous Wed 17 Jul 2019 12:19:37 No.10814230 Report

Quoted By: >>10814245 >>10814470

>>10811246
Sounds like basic linear regression if you want to detect linear combinations of basic functions.

>>10811401
Yup adversarial stuff sounds interesting, but I have no idea where to start. Tic-tac-toe is so simple even minimax is overkill, but big games like chess and go require big hardware.

Anonymous

Anonymous Wed 17 Jul 2019 12:26:17 No.10814245 Report

Quoted By:

>>10814230
>Sounds like basic linear regression if you want to detect linear combinations of basic functions.
Linear regression will give you polynomial of high orders what is boring. Here is you have to find as elegant solution as possible.

Anonymous

Anonymous Wed 17 Jul 2019 13:18:05 No.10814311 Report

Quoted By:

>>10809198
is this Norvig book in your image?

Anonymous

Anonymous Wed 17 Jul 2019 14:09:53 No.10814415 Report

Quoted By:

>>10814177
I was thinking of an engaging collaborative effort - doesn't need to be a product

Anonymous

View Same Google iqdb SauceNAO vag.png, 131KiB, 862x537

Anonymous Wed 17 Jul 2019 14:18:31 No.10814432 Report

Quoted By: >>10814449

>>10814177
literally
>bobs or vagene - the program

It's also pig disgusting Python style, but so be it.

Anyway..
I was thinking of an engaging collaborative effort - doesn't need to be a product

Anonymous

Anonymous Wed 17 Jul 2019 14:28:18 No.10814449 Report

Quoted By: >>10814733

>>10814432
>I was thinking of an engaging collaborative effort - doesn't need to be a product
What was your idea? I willing to listen.

Anonymous

Anonymous Wed 17 Jul 2019 14:39:43 No.10814470 Report

Quoted By:

>>10814230
>Yup adversarial stuff sounds interesting, but I have no idea where to start. Tic-tac-toe is so simple even minimax is overkill

write function that takes the board state and returns the winner, e.g. 1 if player won, 0 if it's a draw, -1 if they lost.

design a cnn, or a fully-connected net to take tic-tac-toe board and output a distribution over possible moves

randomly initialize network

play network against itself, randomly sampling moves from output distribution.

update weights to make network more likely to pick the moves the winner picked at each turn

Anonymous

Anonymous Wed 17 Jul 2019 16:21:29 No.10814698 Report

Quoted By: >>10814730

I’m doing a project to predict gentrification in neighborhoods of Nashville, based on publicly-available building permit data from Davidson County. I’m gonna pair the public data with info from the ATTOM API which is for real estate.

Southeastern US cities are extremely interesting to study because they’re undergoing a big change.
Generally in planning and deal estate, we expect mixed-use buildings to cause gentrification and I’m going to see if that’s true.

Anonymous

Anonymous Wed 17 Jul 2019 16:34:44 No.10814730 Report

Quoted By: >>10814794

>>10814698
Why is this machine learning and not plain statistics?

Anonymous

Anonymous Wed 17 Jul 2019 16:35:52 No.10814733 Report

Quoted By: >>10815333

>>10814449
Err, I didn't actively think about about.

Might be that the interests in this group diverge but one could imagine, for example, a reading group.

Anonymous

Anonymous Wed 17 Jul 2019 17:07:17 No.10814794 Report

Quoted By: >>10815492

>>10814730
I'm using data to train a machine learning algorithm to predict things so we can apply this algorithm to other datasets. You might use statistical methods in a machine learning algorithm (linear regression) or more modern stuff like boosted decision trees.
Also lots of NLP and data-wrangling.

Anonymous

Anonymous Wed 17 Jul 2019 20:53:15 No.10815333 Report

Quoted By:

>>10814733
I don't really understand what you are talking about. What exactly are you gonna read? New papers?

Anonymous

Anonymous Wed 17 Jul 2019 21:12:20 No.10815372 Report

Quoted By: >>10815392

Does anybody have experience with StyleGAN's latent space? I generated a face with the pretrained FFHQ model and want to find nearby faces. I think the lower latents are supposed to be coarse and the higher ones finer details, but when I randomize some latents in the 175-200 range, I still get completely different faces.

Has anybody made something like this for FFHQ?
https://colab.research.google.com/drive/1LiWxqJJMR5dg4BxwUgighaWp2U_enaFd#offline=true&sandboxMode=true

Anonymous

Anonymous Wed 17 Jul 2019 21:21:41 No.10815392 Report

Quoted By:

>>10815372
Take two different latent representations. Interpolate between them. Profit!

Anonymous

Anonymous Wed 17 Jul 2019 21:30:01 No.10815405 Report

Quoted By: >>10815418 >>10815546 >>10815744 >>10816812

Damn, be glad you’re not a fresh grad looking for an entry-level data science job.
I have a bunch of projects, tons of MOOCs, MS Mathematics, and I still can’t get hired. My city is shit but if I apply out of state they don’t want a candidate from far away.

Anonymous

Anonymous Wed 17 Jul 2019 21:35:21 No.10815418 Report

Quoted By: >>10815572

>>10815405
Imagine living in 3th-world country, bro. Better yet in the shithole with 80 average IQ.

Anonymous

Anonymous Wed 17 Jul 2019 22:12:52 No.10815492 Report

Quoted By: >>10815665 >>10815742

>>10814794
Fair warning: I love NLP work but finding that work is a bit of a ballache.

Anonymous

Anonymous Wed 17 Jul 2019 22:36:55 No.10815546 Report

Quoted By:

>>10815405
So don't tell them where you live you fucking retard

Anonymous

Anonymous Wed 17 Jul 2019 22:48:24 No.10815572 Report

Quoted By:

>>10815418
>3th-world country
>Treeth world country
LMAO at your refugee tier English.
I'll turn 360 and walk away.

Anonymous

Anonymous Wed 17 Jul 2019 23:35:03 No.10815665 Report

Quoted By:

>>10815492
Ironically I have a good connection for getting hired as an NLP guy at a big company, I just want to make sure I know NLP really well before I apply/get referred.
Just need to find time to finish up this sentiment analysis project I'm doing along with my other stuff

Anonymous

Anonymous Thu 18 Jul 2019 00:21:50 No.10815742 Report

Quoted By: >>10817124

>>10815492
Ex-linguist that's been wanting to move into tat area for a while now

What makes it suck?

Currently working as a Data Scientist (really more like a Data Analyst though), trying to move in that direction, so I'm considering doing the degree in Edinburgh for Speech & Language Processing

Anonymous

Anonymous Thu 18 Jul 2019 00:22:39 No.10815744 Report

Quoted By: >>10815995

>>10815405
Could always try Data Analyst first and move in

Could take a while though

Anonymous

View Same Google iqdb SauceNAO pentti.jpg, 58KiB, 615x350

Anonymous Thu 18 Jul 2019 00:24:38 No.10815747 Report

Quoted By: >>10816923

Buddy of mine recommended this for ML learning:

https://www.fast.ai/

Anyone heard of them?

NLP seems to be a big thing with them

Anonymous

Anonymous Thu 18 Jul 2019 02:31:06 No.10815995 Report

Quoted By: >>10816174 >>10816565

>>10815744
Kek tried that a bunch.
Every time they thought I was overqualified because of the MS (which I think is a really stupid reason). I have some more connections I'm gonna try though. I honestly haven't used any of my connections yet.

Anonymous

Anonymous Thu 18 Jul 2019 02:32:19 No.10815998 Report

Quoted By:

could I train a model to do eye tracking using images from a webcam? I was thinking of using 5 images, one for each corner and then one for the current image. this way I could calibrate it, then just refeed it the 4 images to give it more data to work with.

What kinda accuracy do you think I could get? How much data would I need to gather and how long would it take to train? I'm a programmer with a small bit of ML knowledge and read a book on keras. I don't want to sink too much time into this if it's hopeless. If I could get within a few centimeters of screen position that would be enough for what I'm doing.

Anonymous

Anonymous Thu 18 Jul 2019 04:28:11 No.10816174 Report

Quoted By:

>>10815995
>overqualified
There is no such thing. This excuse is ridiculous. Just say you don't wanna have incels in your team. Is it so hard?

Anonymous

View Same Google iqdb SauceNAO 68747470733a2f2f64656570.gif, 974KiB, 512x288

Anonymous Thu 18 Jul 2019 08:48:12 No.10816549 Report

Quoted By: >>10820113

>>10809198
https://gen.studio/

Anonymous

Anonymous Thu 18 Jul 2019 09:00:36 No.10816565 Report

Quoted By:

>>10815995
I know a guy who worked for a starup for 3 montha and now works for another company full time being paid 80k and he hasn't even finished his degree yet.

Maybe you just need to apply to more places?

Anonymous

Anonymous Thu 18 Jul 2019 11:01:35 No.10816715 Report

Quoted By: >>10817019 >>10817576

Very interesting talk about weird way of learning that ANN often use, and how to get rid of it.
https://www.youtube.com/watch?v=mUt7w4UoYqM

Anonymous

Anonymous Thu 18 Jul 2019 12:13:48 No.10816812 Report

Quoted By:

>>10815405
Which city?

Anonymous

Anonymous Thu 18 Jul 2019 13:57:44 No.10816923 Report

Quoted By:

>>10815747
This is for someone who already knows essential machine learning and wants to pick a specialization.
I wouldn’t say this is where you start to learn ML.
If you want to learn machine learning very well and on the cheap, dataquest.io is the way to go.

Anonymous

Anonymous Thu 18 Jul 2019 15:51:34 No.10817019 Report

Quoted By: >>10817034 >>10817123 >>10817129

>>10816715

tl;dr?

i wonder whether this robustness, or lack thereof has anything to do with the linear nature of resnet and other modern architectures. would a l2-regularized net with tanh activations be as sensitive? i haven't done any work on adversarial perturbations

Anonymous

Anonymous Thu 18 Jul 2019 16:04:39 No.10817034 Report

Quoted By: >>10817062 >>10817123

>>10817019
cont.

most numerical optimization methods rely on having some way to locally approximate the loss function. gradient descent, newtons method, and so forth. but there are many areas in the parameter space of an ReLU activated resnet where these approximations are very poor, of course due to the non-analytic, non-smooth ReLU. i have a hunch that this is why ReLU activated resnets are sensitive to small perturbations after training.

Anonymous

Anonymous Thu 18 Jul 2019 16:22:13 No.10817062 Report

Quoted By: >>10817123

>>10817034
cont.

what's interesting is that these nets can still achieve very good performance, due to their non-linearity, the ability of each neuron to 'classify", but this is basically just because they're so over-parameterized that random initialization usually doesn't leave them far from a solution. gradient descent is blind to the negative inputs.

Anonymous

Anonymous Thu 18 Jul 2019 16:52:54 No.10817123 Report

Quoted By:

>>10817019
>>10817034
>>10817062
cont.

didn't watch the whole presentation but it looks like they suggest adding noise to the input. this would increase the range of activation patterns encountered during training and somewhat mitigate the problem but i still think the issue has to do at least partly with the ReLU.

call me an idiot but i still think it's likely that ReLUs and excessively deep (>50 layers) CNNs will fall out of favor, at least in applications where inference speed is a priority.

Anonymous

Anonymous Thu 18 Jul 2019 16:53:59 No.10817124 Report

Quoted By:

>>10815742
That might be a good degree (I know Edinburgh's a great school) but don't get the impression you need another degree.

NLP is still a young field where there's lots of room for innovation. If I were you I'd pull up a Yelp review dataset or something and get hacking with NLTK then move on to Word2Vec and other packages to test the waters.

Anonymous

Anonymous Thu 18 Jul 2019 16:55:08 No.10817129 Report

Quoted By: >>10817412 >>10819540

>>10817019
>tl;dr?
Most cool part to me that you can actually distinguish robust and non-robust features and force the network to learn only robust ones. I wonder if it can be applied to GAN's discriminator and therefore achieve better results with same training time and processing consumption.

> wonder whether this robustness, or lack thereof has anything to do with the linear nature of resnet and other modern architectures. would a l2-regularized net with tanh activations be as sensitive?
They say that it cannot be the only answer. Somehow these non-robust features encoded into our datasets and have positive predictive value. i.e. noise that can fool a model contain some useful information that people just cannot see, but model overvalued this features and this is the problem.

Anonymous

View Same Google iqdb SauceNAO of_sorts.gif, 219KiB, 899x455

Anonymous Thu 18 Jul 2019 17:11:13 No.10817163 Report

Quoted By: >>10817192

As planned (>>10806532) I made that introductory neural network video, elaborating on a version of the pure Python implementation in the Nielson book

https://youtu.be/z2aq21lMw40

Anonymous

Anonymous Thu 18 Jul 2019 17:22:37 No.10817192 Report

Quoted By:

>>10817163
I admire your enthusiasm, but please, try to compact you videos into 10-15 minutes range. Not so much people have time to watch more than half-hour long videos, so you essentially limit your potential audience significantly. Ofc, this only the advice.

Anonymous

Anonymous Thu 18 Jul 2019 18:39:23 No.10817328 Report

Quoted By: >>10824798

Anyone have any experience in pipelining?
I’m trying to transform some datasets in Luigi

Anonymous

Anonymous Thu 18 Jul 2019 19:31:53 No.10817412 Report

Quoted By:

Anonymous

Anonymous Thu 18 Jul 2019 21:00:14 No.10817564 Report

Quoted By:

>>10809887
Damn dude, keep up the good work there.

Anonymous

View Same Google iqdb SauceNAO zzz.png, 1MiB, 1308x564

Anonymous Thu 18 Jul 2019 21:08:28 No.10817576 Report

Quoted By: >>10817595

>>10816715
I just took a look at the paper (https://arxiv.org/pdf/1805.12152.pdf ) and damn this shit is amazing. Adversarial examples that actually make sense! Do you understand what it means anon? You can take any video from youtube and make a fucking nightmare out of it. Look at page 23.

Anonymous

View Same Google iqdb SauceNAO 333.png, 940KiB, 640x695

Anonymous Thu 18 Jul 2019 21:15:37 No.10817595 Report

Quoted By: >>10817717

>>10817576
Also you can generate images like that, that super easy to misinterpreted.

Anonymous

Anonymous Thu 18 Jul 2019 21:25:37 No.10817630 Report

Quoted By: >>10817668

What exactly is Machine Learning? Is it related to AI?

Anonymous

Anonymous Thu 18 Jul 2019 21:40:54 No.10817668 Report

Quoted By:

>>10817630
This might help you.
https://www.google.com/search?client=urmum&q=machine+learning&sourceid=dudetrustme&ie=UTF-8&oe=UTF-8

Anonymous

View Same Google iqdb SauceNAO pepe.png, 292KiB, 1402x717

Anonymous Thu 18 Jul 2019 22:04:29 No.10817717 Report

Quoted By: >>10817769 >>10818162

>>10817595
You can even make pepe with it!
http://gradientscience.org/robust_apps/

Anonymous

View Same Google iqdb SauceNAO pepe2.png, 259KiB, 320x320

Anonymous Thu 18 Jul 2019 22:25:02 No.10817769 Report

Quoted By: >>10817805 >>10818540

>>10817717

Anonymous

Anonymous Thu 18 Jul 2019 22:37:07 No.10817805 Report

Quoted By:

>>10817769
Fuckin saved, you made a nightmare fren

Anonymous

Anonymous Fri 19 Jul 2019 00:49:22 No.10818162 Report

Quoted By:

>>10817717
Bleeding out of my eyes but still happy.

Anonymous

Anonymous Fri 19 Jul 2019 02:15:11 No.10818337 Report

Quoted By: >>10818861

>>10814177
I've only recently started to into programming, and for the life of me I cannot get torch and torchvision to work on PyCharm, despite installing them through CMD and verifying that the files are in the site-packages directory. I get a module not found error for torchvision. Any advice on finishing this installation?

Anonymous

Anonymous Fri 19 Jul 2019 04:05:25 No.10818540 Report

Quoted By:

>>10817769
Try for moonman

Anonymous

Anonymous Fri 19 Jul 2019 04:28:19 No.10818579 Report

Quoted By: >>10818665

Anyone know the approximate difference in processing time between a dynamic and static computational graph?

Anonymous

Anonymous Fri 19 Jul 2019 05:23:18 No.10818665 Report

Quoted By: >>10819100

>>10818579
It depends on what you're processing. Is this a homework question?

If you have a computation graph processing framework and it can produce either static or dynamic computation graphs, then the determination of which one will execute faster is based on the nature of what you are processing, specifically whether the parameter space of the description of the computation to process is sparse or dense. If it's sparse, dynamic computation graphs are faster. If it's dense, static computation graphs are faster. I can explain to you why if you're interested and don't already understand.

Anonymous

Anonymous Fri 19 Jul 2019 07:47:44 No.10818861 Report

Quoted By:

>>10818337
Complete at least couple of python guides before trying ML

Anonymous

Anonymous Fri 19 Jul 2019 12:21:41 No.10819100 Report

Quoted By:

>>10818665
No this is for research. Currently I’m using a dynamic graph (executing tensorflow code in eager mode) due to the constraints of the graph (monotonic and lower triangular structure) which make it hard to build a static computational graph. But this will eventually be used to process a ton pictures at very high resolution so I’m wondering if this will fuck me later down the road. How would you define a dense parameter space?

Anonymous

Anonymous Fri 19 Jul 2019 13:37:25 No.10819200 Report

Quoted By: >>10819622

Tensorflow has those embedded TPU.
What about pytorch? Jetson nano?

Anonymous

Anonymous Fri 19 Jul 2019 14:30:15 No.10819257 Report

Quoted By: >>10819487 >>10819498 >>10819510

Serious question: why do so many people go straight to deep learning instead of learning the ropes of machine learning?

Coming from a pure math background this is bizarre to me; you skipped thousands of steps. How are you supposed to even evaluate your models or understand the algorithms without a solid foundation in statistics?

Anonymous

Anonymous Fri 19 Jul 2019 16:56:26 No.10819487 Report

Quoted By: >>10819664

>>10819257
I'm not sure if deep learning is a harder model than others. I.e. I'm tempted to argue that among machine learning frameworks, deep learning is one generally conceptually simple one.

Anonymous

Anonymous Fri 19 Jul 2019 17:00:16 No.10819497 Report

Quoted By: >>10819502

How can computers learn when all they do is shuffle symbols around?

Anonymous

Anonymous Fri 19 Jul 2019 17:00:26 No.10819498 Report

Quoted By:

>>10819257
Deep learning is popular because of how easy it is. Many people do deep learning without understanding how it even works. That's how you know it's a powerful abstraction.

Anonymous

Anonymous Fri 19 Jul 2019 17:01:28 No.10819502 Report

Quoted By:

>>10819497
How can humans learn when all they do is move electrons and ions around?

Anonymous

Anonymous Fri 19 Jul 2019 17:03:47 No.10819510 Report

Quoted By:

>>10819257
Because it's the trendy new thing and people want to put it on their resumes

Anonymous

Anonymous Fri 19 Jul 2019 17:14:35 No.10819540 Report

Quoted By: >>10819657

>>10817129
>They say that it cannot be the only answer. Somehow these non-robust features encoded into our datasets and have positive predictive value. i.e. noise that can fool a model contain some useful information that people just cannot see, but model overvalued this features and this is the problem.

i have to wonder. take their example with two gaussians, and train an relu-activated neuron to separate them. without relu, the gradients would oppose each other, and the separating hyperplane would fall into the middle between the two, probably with some margin on either side, ensuring robustness. but with an relu, wouldn't the separating hyperplane be forced right up against one class, because it's "pushed" that way by the other and there are no opposing gradients until some of the inputs become positive?

correct me if i'm wrong, but i think that relu probably does not encourage wide separating margins. i'll go out on a limb and guess that this might contribute to its sensitivity to seemingly imperceptible perturbations.

Anonymous

Anonymous Fri 19 Jul 2019 17:54:13 No.10819622 Report

Quoted By: >>10820342 >>10820389

>>10819200
TPUs are compute devices in Google's data center. There's support for them in Tensorflow, but you have to adapt your code to actually use them and rent TPU compute. Most people use it with GPU. Torch used to be faster than Tensorflow on GPU.

Anonymous

Anonymous Fri 19 Jul 2019 18:13:38 No.10819657 Report

Quoted By:

>>10819540
cont.

in a way, the ReLU wouldn't so much learn a separator but rather, it would ignore inputs that very likely belong to one of the classes. perhaps DCNNs with relus do something akin to the process of elimination.

Anonymous

Anonymous Fri 19 Jul 2019 18:16:05 No.10819664 Report

Quoted By:

>>10819487
I guess you’re right. I always “look up” to it because I’m so focused on stats but I guess if you can engineer it it works.

Anonymous

Anonymous Fri 19 Jul 2019 18:28:04 No.10819693 Report

Quoted By: >>10820622

>>10809198
Is anyone here into NLP? That's by far the most useful AI tool. Highest potential, for sure. Imagine the day you could type in a few tags, and an AI generates a book, or something similar.

I'm making a summarizer in pytorch as my bachelor degree "master thesis" (what would this even become..? Bachelor thesis..?). It's great fun!

Anonymous

Anonymous Fri 19 Jul 2019 21:56:40 No.10820113 Report

Quoted By:

>>10816549
How dis ?

Anonymous

Anonymous Sat 20 Jul 2019 00:09:26 No.10820342 Report

Quoted By: >>10820389

>>10819622
I meant those tpu edge stuff. But it works only with tensorflow lite.
In contrast those Jetson nano are cuda enabled

Anonymous

Anonymous Sat 20 Jul 2019 00:29:55 No.10820389 Report

Quoted By:

>>10819622
>>10820342
You can't train the model on the TPU. So they basically useless.

Anonymous

Anonymous Sat 20 Jul 2019 02:23:00 No.10820622 Report

Quoted By: >>10820680 >>10820725

>>10819693
I'm gonna suck off someone at openai for the gpt2 source

Anonymous

Anonymous Sat 20 Jul 2019 03:01:45 No.10820679 Report

Quoted By: >>10822336

I have a 2.6 GPA in Math from an average school. Am I smart enough for machine learning? I'm just a lowly c++ programmer right now.

Anonymous

Anonymous Sat 20 Jul 2019 03:02:06 No.10820680 Report

Quoted By:

>>10820622
https://github.com/openai/gpt-2
Where can I get my suck? Also, are you qt?

Anonymous

Anonymous Sat 20 Jul 2019 03:33:06 No.10820725 Report

Quoted By:

>>10820622
>It started out with some harmless handwritten digit image recognition in his spare time
>now he's sucking off post docs in the alley behind Chili's for gpt2 source code
AI, not even once

Anonymous

Anonymous Sat 20 Jul 2019 10:31:19 No.10821347 Report

Quoted By: >>10821431 >>10821590 >>10821910

Last thread I started labeling the czech casting dataset by pose, but I only got about 1/4 through before I get too lazy. I'll upload what I got in two archives. The first is 9268 pictures with manually checked labels. Second is 32626 pictures that were labeled automatically. The classifier works well, but there will be some errors. I hope somebody can finish checking the labels. Some stats from the checked label part:

face 420
dressed_facing_front 1178
dressed_facing_back 51
dressed_facing_back_looking_over_shoulder 79
dressed_facing_left 469
dressed_facing_right 561
dressed_facing_front_upper_body 584
dressed_facing_left_upper_body 15
dressed_facing_right_upper_body 81
topless_facing_front 436
topless_facing_back 144
topless_facing_back_looking_over_shoulder 147
topless_facing_left 225
topless_facing_right 303
topless_facing_front_upper_body 214
topless_facing_left_upper_body 4
topless_facing_right_upper_body 35
naked_facing_front 504
naked_facing_back 380
naked_facing_back_looking_over_shoulder 409
naked_facing_left 236
naked_facing_right 307
naked_facing_front_upper_body 339
naked_facing_left_upper_body 10
naked_facing_right_upper_body 70
naked_sitting 426
naked_sitting_spread_hiding_pussy 59
naked_sitting_spread_showing_pussy 442
left_tit 399
right_tit 394
pussy 329
unclassified 18

The filenames contain the girls name and number. There are 2042 girls in the whole dataset. The checked label archive is here:
https://mega.nz/#!IbpVTYaB!NnfNi8M2TyLOOvQR28izDSenrvQPCU-OVpqihcNO1EI
I post the second archive in a second post when it's uploaded.

Anonymous

Anonymous Sat 20 Jul 2019 11:28:54 No.10821431 Report

Quoted By: >>10821590

>>10821347
Here is the second part with labels that need to be checked:
https://mega.nz/#!AL4knSyD!uE2JFHluoLnAGytlwT3VA3JwZUb_O5kS1PtadZZJRz4

face 1473
dressed_facing_front 4321
dressed_facing_back 55
dressed_facing_back_looking_over_shoulder 74
dressed_facing_left 2087
dressed_facing_right 2039
dressed_facing_front_upper_body 1869
dressed_facing_left_upper_body 7
dressed_facing_right_upper_body 82
topless_facing_front 1631
topless_facing_back 395
topless_facing_back_looking_over_shoulder 362
topless_facing_left 831
topless_facing_right 1048
topless_facing_front_upper_body 672
topless_facing_left_upper_body 3
topless_facing_right_upper_body 26
naked_facing_front 1610
naked_facing_back 1554
naked_facing_back_looking_over_shoulder 1792
naked_facing_left 945
naked_facing_right 973
naked_facing_front_upper_body 1213
naked_facing_left_upper_body 5
naked_facing_right_upper_body 54
naked_sitting 1608
naked_sitting_spread_hiding_pussy 297
naked_sitting_spread_showing_pussy 1242
left_tit 1602
right_tit 1627
pussy 1129

Anonymous

View Same Google iqdb SauceNAO 1467069577329.jpg, 128KiB, 1080x1350

Anonymous Sat 20 Jul 2019 13:16:39 No.10821590 Report

Quoted By: >>10821617 >>10821650

>>10821347
>>10821431
>Last thread I started labeling the czech casting dataset by pose
>9268 pictures with manually checked labels

Most Autistic Person 2019

Anonymous

Anonymous Sat 20 Jul 2019 13:32:21 No.10821617 Report

Quoted By:

>>10821590
Not autistic enough, because I didn't finish the job. Also it's basically just looking at porn.

Anonymous

View Same Google iqdb SauceNAO yann-lecun-facebook-03-10-17_493 (...).jpg, 2MiB, 2508x2558

Anonymous Sat 20 Jul 2019 13:52:14 No.10821650 Report

Quoted By: >>10821744

>>10821590
And now imagine how mnist or cfar10 was made somewhere in middle ages. And they was labeled by very few people, in case of mnist just one.

Anonymous

Anonymous Sat 20 Jul 2019 14:42:07 No.10821744 Report

Quoted By:

>>10821650
I don't know, doing monkey work labelling at the but paid a premium to do so is pretty based when you don't feel like working hard
And we label things for free with captcha

Anonymous

Anonymous Sat 20 Jul 2019 15:51:55 No.10821910 Report

Quoted By:

>>10821347
Looking at those body part folders is kind of weird.
https://files.catbox.moe/60frrz.jpg

Anonymous

Anonymous Sat 20 Jul 2019 15:59:07 No.10821932 Report

Quoted By:

>>10813163
what's your background?

Anonymous

Anonymous Sat 20 Jul 2019 19:02:00 No.10822336 Report

Quoted By: >>10823851

>>10820679
You have a math degree and experience programming in a low-level language. I'd say you could get a machine learning engineer job if you started knocking out MOOCs.

Anonymous

Anonymous Sun 21 Jul 2019 01:47:44 No.10823524 Report

Quoted By: >>10823852

Quite a good review of neuralink by actuall neuroscientists/machine learning people. Not much new if you seen the presentation, except of potential problems that was purposefully omitted.

https://youtu.be/B2-YiXuXdp8

Anonymous

Anonymous Sun 21 Jul 2019 04:03:10 No.10823851 Report

Quoted By: >>10823952 >>10824519 >>10826192

>>10822336
The machine learning jobs I found require PhD and an outstanding on your GitHub.
And most of them are no-name small startup companies.
Maybe different on larger companies, but the hiring process there is a pain in the ass and looks like a black box lottery system.

Anonymous

Anonymous Sun 21 Jul 2019 04:03:48 No.10823852 Report

Quoted By:

>>10823524
what do you mean I'm banned from digital agriculture

Anonymous

Anonymous Sun 21 Jul 2019 05:01:41 No.10823952 Report

Quoted By: >>10823963 >>10823976

>>10823851
I got an ML job with just a CS degree and no projects. Just talk about regressions and tensorflow and it's all good.

Anonymous

Anonymous Sun 21 Jul 2019 05:06:40 No.10823963 Report

Quoted By:

>>10823952
What company? What's your role? How much is the pay?

Anonymous

Anonymous Sun 21 Jul 2019 05:12:38 No.10823976 Report

Quoted By: >>10823991

>>10823952
What city?
I'm pretty confident in my ML skills (I like pytorch better tho), but my home projects are not impressive because I lack good hardware. I am in a PhD course in robotics and not AI and my job applications get ignored basically.

Anonymous

Anonymous Sun 21 Jul 2019 05:21:00 No.10823991 Report

Quoted By: >>10824029

>>10823976
Don't bother with ML. You don't have any relevant experience. The PhD course is not that quantitative anyway. Competition is too fierce in this industry.

Anonymous

Anonymous Sun 21 Jul 2019 05:21:39 No.10823992 Report

Quoted By:

>>10814159
>data science team at my work is comprised of people in non STEM degrees
>literally someone from hr in the team
>no one knows sql and can barely even use excel
>only can manage python if it's following an online tutorial to the t
>projects go months over the time line because they can just throw around buzzwords to out of touch managers
>ends up copy and pasting some python library tutorial
>praised for their innovation

This area is filled to the brim with retards and its unbelievable

Anonymous

Anonymous Sun 21 Jul 2019 05:42:10 No.10824029 Report

Quoted By:

>>10823991
I was getting rejected at the job I was really looking for and figured out "fuck this, I'm gonna try my luck at those ML stuff too". Now that I am relatively indifferent regarding which job I get, I might as well surf with the hype.

Anonymous

Anonymous Sun 21 Jul 2019 06:36:10 No.10824096 Report

Quoted By:

So how I learn what a good architecture is? When I'm playing in PyTorch it feels like I'm just guessing what layers and filters to throw in at random.

Anonymous

Anonymous Sun 21 Jul 2019 06:36:38 No.10824097 Report

Quoted By: >>10824802

Hey guys, is a course in Reinforcement Learning worth taking beyond that standard ML and DL courses?

Anonymous

Anonymous Sun 21 Jul 2019 07:47:35 No.10824152 Report

Quoted By:

Were there any progress on the pepe or deepnude project itt appart from the release of the pepe program?

Anonymous

Anonymous Sun 21 Jul 2019 12:09:17 No.10824519 Report

Quoted By: >>10824637 >>10824647

>>10823851
>>and an outstanding on your GitHub
Huh? Is there some rating?

Anonymous

Anonymous Sun 21 Jul 2019 13:25:11 No.10824637 Report

Quoted By:

>>10824519
He means a Github that is instantly recognised as belonging to a very intelligent person.

Anonymous

Anonymous Sun 21 Jul 2019 13:27:44 No.10824647 Report

Quoted By:

>>10824519
I meant outstanding project.
Like your dotfiles don't count.
I mean that's what I've been asked for. And since my GitHub is basically shitposting and basic but trivial scripts, it didn't count. And I was denied the programming interview, and straight refused because I lacked computer science skills as they said.

Anonymous

Anonymous Sun 21 Jul 2019 14:01:55 No.10824691 Report

Quoted By: >>10824703 >>10824728

are there any datesets from HR departments, like applications + pictures? with y = 1 if good employee?

Anonymous

Anonymous Sun 21 Jul 2019 14:05:50 No.10824698 Report

Quoted By:

I’m working on implementing neat from scratch in java, and also have the only open source fully ndimensional es hyperneat algorithm that I’m training to trade shitcoin if your interesting in helping or looking at these projects reply to this post and I’ll link them

Anonymous

Anonymous Sun 21 Jul 2019 14:09:12 No.10824703 Report

Quoted By:

>>10824691
There should be because I seen some generated employee profiles, but too lazy to search for it right now.

Anonymous

Anonymous Sun 21 Jul 2019 14:24:54 No.10824728 Report

Quoted By:

>>10824691
Here's a dataset for you:

Bisexual black woman: y=1
Heterosexual white man: y=-1

Anonymous

Anonymous Sun 21 Jul 2019 15:14:14 No.10824798 Report

Quoted By: >>10824915

>>10817328

Still wondering if anyone has Luigi experience

Anonymous

Anonymous Sun 21 Jul 2019 15:15:45 No.10824802 Report

Quoted By:

>>10824097
Udacity has a bunch of stuff like that.
You don't have to pay for it if you don't want, the content's publicly available.

Anonymous

View Same Google iqdb SauceNAO 50a87a5c0d09c.jpg, 58KiB, 489x700

Anonymous Sun 21 Jul 2019 16:07:56 No.10824915 Report

Quoted By:

>>10824798
My whole life is Luigi experience.

Anonymous

Anonymous Sun 21 Jul 2019 16:13:45 No.10824940 Report

Quoted By: >>10824983

I'm on the last chapter on "introduction to statistical learning", I skipped all the exercises in R.

Is this a bad idea?
Do anybody know where I can find a book which implements basic ML concepts (Linear regression, Logistic regression, Cross validation, Polynomial regression, Decision trees, Support vector machines and methods for unsupervised learning such as K-nearest neighbor) with Python.

Anonymous

Anonymous Sun 21 Jul 2019 16:25:56 No.10824983 Report

Quoted By: >>10825026

>>10824940
here are the exercises and chapters implemented in python

https://github.com/a-martyn/ISL-python
https://github.com/JWarmenhoven/ISLR-python
https://github.com/emredjan/ISL-python
there is more

Anonymous

Anonymous Sun 21 Jul 2019 16:37:54 No.10825026 Report

Quoted By:

>>10824983
This is perfect, thanks!

Anonymous

View Same Google iqdb SauceNAO deeplearning.jpg, 65KiB, 375x499

Anonymous Sun 21 Jul 2019 18:24:53 No.10825329 Report

Quoted By: >>10825990

What are the most relevant chapters in Goodfellow? I plan to go through all of it eventually.

Anonymous

Anonymous Sun 21 Jul 2019 20:50:16 No.10825700 Report

Quoted By: >>10825865

How to get into python for machine learning projects?

Anonymous

Anonymous Sun 21 Jul 2019 22:16:09 No.10825865 Report

Quoted By:

>>10825700
Just start doing guides. That's it.

Anonymous

Anonymous Sun 21 Jul 2019 22:23:21 No.10825887 Report

Quoted By:

>>10810369
>>10810637
You could create set pivot points like how animators do with 3d models, and then just generate angles for the pivots

Anonymous

Anonymous Sun 21 Jul 2019 22:25:19 No.10825889 Report

Quoted By:

>>10811122
I'm gonna dab on other boards with this webm

Anonymous

Anonymous Sun 21 Jul 2019 23:08:17 No.10825990 Report

Quoted By:

>>10825329
after the math chapters, why not just read the chapters in order?

Anonymous

Anonymous Mon 22 Jul 2019 00:26:10 No.10826137 Report

Quoted By: >>10826162

Am I schitzo or is this pure fucking kino?
Prompt
>The lords of starfell would send forth adventurers to collect the remains of fallen stars, in the hopes to stave off the inevitable Eternal Night.
Generated text
>The lords of starfell would send forth adventurers to collect the remains of fallen stars, in the hopes to stave off the inevitable Eternal Night. The night was short-lived, however—the gods soon realized that the dead starlings had no use for the endless cycles of sleep and rise, and were unwilling to keep them in a mindless prison. They banished the beasts and their inhabitants to the nightlands, where, while the stars did not wane, the stars themselves began to wane, and the gods were forced to summon the star-watchers and prepare to send forth the night, only to find that while the stars once existed—they were not needed. The stars are not still, and their presence has long since faded from this realm. The night is here in the sky for everyone with a soul."
—The Nightwatch
>"The sky over the moon is the starlight. The night has no power or purpose here. You stand on a cliffside watching your home fall under the spell of the stars...but there is more at play than simply falling in love with an empty sky."
—Gods, Stars

I must be insane, because I'm feeling some deeper meaning in this block of text that couldn't possibly actually be there.

Anonymous

Anonymous Mon 22 Jul 2019 00:37:52 No.10826162 Report

Quoted By:

>>10826137
Damn, now it's doing nothing just ripping off entire blocks of text from established settings like GoT or D&D

Anonymous

Anonymous Mon 22 Jul 2019 00:49:06 No.10826192 Report

Quoted By: >>10826520 >>10827106

>>10823851
Ask someone working on applied ML at Google anything lmao.

Anonymous

View Same Google iqdb SauceNAO 0A853B7C-507B-4048-865F-7760C684 (...).jpg, 57KiB, 270x385

Anonymous Mon 22 Jul 2019 01:19:53 No.10826247 Report

Quoted By:

Did you learn optimal transport today /MLG/?

https://arxiv.org/abs/1803.00567
https://optimaltransport.github.io/book/

Anonymous

Anonymous Mon 22 Jul 2019 03:35:51 No.10826490 Report

Quoted By:

Can someone link the Machine Learning reading list?

I know PRML but what are some other books?

Anonymous

Anonymous Mon 22 Jul 2019 03:53:00 No.10826520 Report

Quoted By:

>>10826192
do you have to wear a buttplug to work

Anonymous

View Same Google iqdb SauceNAO god.jpg, 25KiB, 1024x683

Anonymous Mon 22 Jul 2019 09:37:17 No.10827106 Report

Quoted By:

>>10826192
How much of your time is waiting for new hardware and trying to turns screws till it's actually as fast as the designers claim?

More interestingly, do you make use of ML for something that's not on every bodies mind just yet?

Anonymous

View Same Google iqdb SauceNAO 1451e7f9-3c34-436e-972c-49b2f032 (...).png, 262KiB, 439x583

Anonymous Mon 22 Jul 2019 13:14:15 No.10827456 Report

Quoted By:

https://twitter.com/OpenAI/status/1153289143964725249
based

Anonymous

Anonymous Mon 22 Jul 2019 13:24:17 No.10827474 Report

Quoted By: >>10827491 >>10827493 >>10827540

What are the research areas of machine learning that uses advanced math (more than basic LA or stats)?

The only ones I know are topological data analysis and hyperbolic embeddings.

Anonymous

Anonymous Mon 22 Jul 2019 13:33:11 No.10827491 Report

Quoted By:

>>10827474
I heard a lot of ideas how to build autproofer with AI. But presumably all of them failed.

Anonymous

Anonymous Mon 22 Jul 2019 13:34:21 No.10827493 Report

Quoted By:

>>10827474
The optimisation of the a neural network can involve some interesting math. That's if you're looking beyond the typically used stochastic gradient descent.

Anonymous

View Same Google iqdb SauceNAO Ds0vDceVsAA_zZW.jpg, 61KiB, 675x1200

Anonymous Mon 22 Jul 2019 13:41:48 No.10827507 Report

Quoted By: >>10827745

I've been learning from MIT's deep learning basics course, any recommendations for where to go after?

Anonymous

Anonymous Mon 22 Jul 2019 14:09:08 No.10827540 Report

Quoted By:

>>10827474
Convex analysis, Riemann geometry, functional analysis in statistics learning, optimal transport.

http://geometricdeeplearning.com/
https://github.com/yao-lab/yao-lab.github.io/blob/master/book_datasci.pdf

Hamiltonian Monte carlo methods
https://arxiv.org/abs/1701.02434
Using jets operators for higher order automatic differentiation.
https://arxiv.org/abs/1812.11592

Anonymous

Anonymous Mon 22 Jul 2019 16:11:15 No.10827745 Report

Quoted By:

>>10827507
This lexeis guy (or whatever his name) with the short hairs?
Man what a poser. Same tier as this YouTubeIndian guy with the white hair spot and the soiboi faces on the thumbnails that keeps popping up in the recommend videos.

Capcode	All Only User Posts Only Moderator Posts Only Admin Posts Only Developer Posts
Show Posts	All Only With Images Only Without Images
Deleted Posts	All Only Deleted Posts Only Non-Deleted Posts
Ghost Posts	All Only Ghost Posts Only Non-Ghost Posts
Post Type	All Only Sticky Threads Only Opening Posts Only Reply Posts
Results	All Grouped By Threads
Order	Latest Posts First Oldest Posts First

Your latest searches