I don't like the Windows folder selector, either.
Workaround: FlashFolder is a utility that makes it easier. You can copy/paste text in the edit field above the selector. You can create and recall favorites. Except when the folder selector is of the NastyFolderSelector variety - there isn't an editable field. Just tendon-ripping mousing.
I think Reaper's folder selectors are mostly of the OrdinaryFolderSelector variety, so I don't feel the pain anymore, but I do remember.
https://sourceforge.net/projects/flashfolder/