Can you explain your thought process when doing proofs?

I'm doing the exercises in the books, I understand the topics and can answer most of the question but the tough ones near the end always fuck me up.
The author always just pulls out something I would never think of, and they never explain why they chose to do that, or how they came up with it.

Is it trial and error?