Select a track, press SHIFT+T, and the "fx" plugin window comes up. All available VSTi / AUi are in there, and there are some JS instruments too.
The term "FX" is misused a bit in REAPER, it actually means all plugins, both effects and instruments. Just so you know.
And welcome here.