Reaper doesn't do pre-roll like I expect so I rolled my own. Here are my 3 punch in scripts attached. Adjust them for the amount of pre-roll and post-roll you want.
For this one it's going to time select an area up to and past your last media item so I just put a filler item at the end of the song so it works.
Punch in time selection.......