/sci/ - Science & Math » Thread #13992426

29KiB, 3840x2160, GitHub-Logo.png

View Same Google iqdb SauceNAO

4Chan image downloader

Anonymous Tue 21 Dec 19:02:06 2021 No.13992426 View Reply Original Report

Quoted By: >>13992467 >>13992748 >>13993110 >>13993200 >>13993468 >>13993533

Wrote a crawler to automate image download on 4chan.org.
Project is published on GitHub.
Anyone who has time to contribute is welcome.
Check it out --> https://github.com/mirko1989/4cdl

Anonymous

Anonymous Tue 21 Dec 2021 19:11:38 No.13992467 Report

Quoted By: >>13993797

>>13992426
Is that single threaded? Not even async? My man, this is going to fucking chug for even a moderate amount of new threads.

Anonymous

Anonymous Tue 21 Dec 2021 20:37:11 No.13992748 Report

Quoted By: >>13993231

>>13992426
I don't want to be negative but I could write this in less than 30 minutes. There's like a dozen of non generic lines of codes only. Hopefully you didn't spend too much time on it.
As a student project why not.

Anonymous

Anonymous Tue 21 Dec 2021 22:10:08 No.13993110 Report

Quoted By:

>>13992426
Plus point for Java, instead of some JavaScript monstrosity. Why hide cheese pizza in there though?

Anonymous

View Same Google iqdb SauceNAO the wall.jpg, 33KiB, 736x346

Anonymous Tue 21 Dec 2021 22:16:08 No.13993125 Report

Quoted By: >>13993209 >>13993244

laziness is a virtue because lazy programmers don't waste time reinventing the wheel. if someone else already wrote it, just use that.

Anonymous

Anonymous Tue 21 Dec 2021 22:40:18 No.13993200 Report

Quoted By:

>>13992426
>"oh neat, I wrote one of these as a high schoole-"
>1989

Anonymous

Anonymous Tue 21 Dec 2021 22:42:35 No.13993209 Report

Quoted By: >>13993680 >>13993800

>>13993125
>laziness, hubris
That explains Pearl.
>impatience
Now that doesn't add up, given how horrendously slow it is.

Anonymous

View Same Google iqdb SauceNAO 5alnlLh.jpg, 41KiB, 960x540

Anonymous Tue 21 Dec 2021 22:49:42 No.13993231 Report

Quoted By: >>13993244 >>13993283

>>13992748
but what if it takes me bery long. wont it go faster eventually if I just try my bery best?

Anonymous

Anonymous Tue 21 Dec 2021 22:54:19 No.13993244 Report

Quoted By:

>>13993231
Yes, but there's not point in making a thread on it.

>>13993125
This too.

Anonymous

Anonymous Tue 21 Dec 2021 23:03:49 No.13993283 Report

Quoted By:

>>13993231
YWNBARP, tranny.

Anonymous

Anonymous Tue 21 Dec 2021 23:58:49 No.13993468 Report

Quoted By:

>>13992426
why when they are all archived anyway?

Anonymous

Anonymous Wed 22 Dec 2021 00:21:42 No.13993533 Report

Quoted By:

>>13992426
Check out ripme, if you're doing this to learn I'm sure you'll get lots of value from it

Anonymous

Anonymous Wed 22 Dec 2021 01:22:12 No.13993680 Report

Quoted By:

>>13993209
perl was put together as an upgrade from shell "languages", it was never intended ask an alternative for big runtime languages, it was invented as a way to manage the people who use big runtime languages like fortran and c, later on perl2c was put together for people who want that sort of thing.
he was concerned about impatience for people who were sick of piping to grep, sed & sort 9000x

Anonymous

Anonymous Wed 22 Dec 2021 02:04:05 No.13993797 Report

Quoted By:

>>13992467
Single threaded should be fast enough.

Anonymous

Anonymous Wed 22 Dec 2021 02:05:07 No.13993800 Report

Quoted By:

>>13993209
>Pearl
lel you clearly have no idea what you're talking about

Capcode	All Only User Posts Only Moderator Posts Only Admin Posts Only Developer Posts
Show Posts	All Only With Images Only Without Images
Deleted Posts	All Only Deleted Posts Only Non-Deleted Posts
Ghost Posts	All Only Ghost Posts Only Non-Ghost Posts
Post Type	All Only Sticky Threads Only Opening Posts Only Reply Posts
Results	All Grouped By Threads
Order	Latest Posts First Oldest Posts First

Your latest searches