>>11258933Well, it is definitely a next stage in programming. You will really have to think about relationship with the work that you do when it is literally alive.
The challenge once you get to that level is figuring out how to put it in your head.
You have to think - what exactly does 'put in your head' even mean in this context?
Consider that just putting some chip in your brain will not make you smarter any more that taking a bunch of code from somewhere and copy pasting it into the program you are working on can be expected to make it work better even if both pieces are individually fine.
You have to think - what does it mean for the power of the program you are working on to be your own power? What does it mean to close that gap between yourself and the other? When you do programming and cache yourself into the process, it really does feel like the distance closes. Where is the spark coming from?
And there is also the matter of dealing with the terror of self improvement. Because if you look closer at how agents get better now, it kind of looks like persistent cycle of genocide and/or iterated suicide. These aspects are integral to optimization and won't really change with increases in understanding of how learning works, rather they should just become more obvious to the laymen.
Right now, you run some Python script and fiddle with some hyperparameters and throw away models if they do not work up to snuff. You never think twice about it. What exactly would you do if you were inside that Python script? Would you throw away the model...if you were that model?
At literally any point in time, there are usually signs pointing to what the next breakthrough will look like to those bothering to look. And now in this era you can look at the present state and see how it reflects the future, and see the outline of the Singularity that is approaching.
