From the sticky at the top,
3. Making a REAPER theme
https://forum.cockos.com/showthread.php?t=181913
Link to Theme Images SDK
https://www.reaper.fm/sdk/walter/images.php
Under the Item images: item_volknob (sliced-button) and
item_volknob_stack (knob-stack).