js_ReaScriptAPI extension

[cohler]

Originally Posted by Edgemeal

So what about the OK button? You still can't click it? Sending left mouse down/up messages on Mac should work...

function ClickWindow(hwnd)
  reaper.JS_WindowMessage_Send(hwnd, "WM_LBUTTONDOWN", 1, 0, 0, 0)
  reaper.JS_WindowMessage_Send(hwnd, "WM_LBUTTONUP", 0, 0, 0, 0)
end

function Main()  
  main_hwnd = reaper.JS_Window_FindTop("Project Settings", true) 
  if main_hwnd then   
    --  Do stuff once the window is found ---
    reaper.ShowConsoleMsg('Window found!\n')
    -- find & click the OK button
    OK_button = reaper.JS_Window_FindChildByID(main_hwnd, 1)
    if OK_button then
      reaper.ShowConsoleMsg('OK button found, Clicking OK button\n')
      ClickWindow(OK_button) 
    end 
  else
    reaper.ShowConsoleMsg('Window not yet found, trying again\n')    
    reaper.defer(Main)
  end 
end

-- Run action "File: Project settings..." without blocking this script,
reaper.JS_WindowMessage_Post(reaper.GetMainHwnd(), "WM_COMMAND", 40021,0,0,0)
Main()

Nope, as I said clicking the OK button does not work by ANY method, including:

WM_LBUTTONDOWN/WM_LBUTTONUP
WM_KEYDOWN/WM_KEYUP (using either space or return/enter)
BM_CLICK
etc...

It also does not work no matter how the message is sent

JS_WindowMessage_Send
JS_WindowMessage_Post
BR_WIN32_SendMessage

Clearly, this is another bug.

[juliansader]

I tried this myself on Linux and on MacOS, both of which use WDL/swell. On Linux, emulating clicks with WindowMessage_Send works fine on any button in any (modeless) window. On MacOS, no luck in any windows outside the script IDE.

However, even in Linux, I couldn't get it to work on modal windows such as Project Settings.

[cohler]

Originally Posted by juliansader

I tried this myself on Linux and on MacOS, both of which use WDL/swell. On Linux, emulating clicks with WindowMessage_Send works fine on any button in any (modeless) window. On MacOS, no luck in any windows outside the script IDE.

However, even in Linux, I couldn't get it to work on modal windows such as Project Settings.

Yes, that's my experience as well. Can this bug be fixed?

[juliansader]

Originally Posted by cohler

Yes, that's my experience as well. Can this bug be fixed?

I reported it here: WDL/swell on macOS: emulating mouseclicks with WM_LBUTTONDOWN doesn't work.

[cohler]

Originally Posted by juliansader

I reported it here: WDL/swell on macOS: emulating mouseclicks with WM_LBUTTONDOWN doesn't work.

Thanks. I posted there that sending SPACE using WM_KEYDOWN/WM_KEYUP to "click" the selected OK button also doesn't work on Mac.

[Edgemeal]

I rem reading on MSDN, to click a button on a dialog window you may need to activate the button first, anyone try that?

function ClickWindow(hwnd)
  reaper.JS_WindowMessage_Send(hwnd, "WM_ACTIVATE", 1, 0, 0, 0) -- 1=WA_ACTIVE 
  reaper.JS_WindowMessage_Send(hwnd, "WM_LBUTTONDOWN", 1, 0, 0, 0)
  reaper.JS_WindowMessage_Send(hwnd, "WM_LBUTTONUP", 0, 0, 0, 0)
end

FWIW, I tried WA_CLICKACTIVE like I used to change REAPER topmost pins on that OK button but that didn't work here on Win10.


Also, SWS has action to send left mouse click to whatever visible window is under the mouse pointer, '_S&M_MOUSE_L_CLICK', IOW what code that using?

[cfillion]

Originally Posted by Edgemeal

Also, SWS has action to send left mouse click to whatever visible window is under the mouse pointer, '_S&M_MOUSE_L_CLICK', IOW what code that using?

void SimulateMouseClick(COMMAND_T* _ct)
{
	POINT p;
	GetCursorPos(&p);
	mouse_event(MOUSEEVENTF_LEFTDOWN, p.x, p.y, 0, 0);
	mouse_event(MOUSEEVENTF_LEFTUP, p.x, p.y, 0, 0);
	WinWaitForEvent(WM_LBUTTONUP);
}

(That SWS action is only available on Windows)

[cohler]

Originally Posted by Edgemeal

I rem reading on MSDN, to click a button on a dialog window you may need to activate the button first, anyone try that?

function ClickWindow(hwnd)
  reaper.JS_WindowMessage_Send(hwnd, "WM_ACTIVATE", 1, 0, 0, 0) -- 1=WA_ACTIVE 
  reaper.JS_WindowMessage_Send(hwnd, "WM_LBUTTONDOWN", 1, 0, 0, 0)
  reaper.JS_WindowMessage_Send(hwnd, "WM_LBUTTONUP", 0, 0, 0, 0)
end

FWIW, I tried WA_CLICKACTIVE like I used to change REAPER topmost pins on that OK button but that didn't work here on Win10.


Also, SWS has action to send left mouse click to whatever visible window is under the mouse pointer, '_S&M_MOUSE_L_CLICK', IOW what code that using?

Still doesn't work on Mac with WM_ACTIVATE using wParam WA_ACTIVE or WA_CLICKACTIVE.

The SWS action mentioned is a solution to a different problem, because it requires the user to move the mouse over the button. The whole point here is to click the button without user action.

[Edgemeal]

Originally Posted by cohler

Still doesn't work on Mac with WM_ACTIVATE using wParam WA_ACTIVE or WA_CLICKACTIVE.

The SWS action mentioned is a solution to a different problem, because it requires the user to move the mouse over the button. The whole point here is to click the button without user action.

Ya I wouldn't use mouse_event in a publicly released app, but I did use it as a last resort in one of my personal apps years ago... Save mouse position, move mouse to target window, make sure the target window is topmost/foreground, call api to click mouse, move mouse back to where it was. Sorry I couldn't help, best of luck!

[Rodilab]

Hi guys

When using JS_Mouse_GetCursor() and JS_Mouse_LoadCursor(), are the cursors id the same on all OS and themes ?
For example, left edge is 417 and right edge is 418 at home.
This will work for everybody ? :

local reaper_cursors =
{
  {417,'EDGE L'},
  {418,'EDGE R'}
}

function MouseCursor()
  local cur_cursor = reaper.JS_Mouse_GetCursor()
  for i = 1, #reaper_cursors do
    local cursor = reaper.JS_Mouse_LoadCursor(reaper_cursors[i][1])
    if cur_cursor == cursor then
      return reaper_cursors[i][2]
    end
  end
  return nil
end

[Infrabass]

Hi everyone,
I'm still not sure if we can send keystrokes via reascript on Mac.
I think it's something around "reaper.JS_WindowMessage_Post" but I can't make it work.
Is it possible in the first place?
Thanks!

[juliansader]

Originally Posted by Rodilab

Hi guys

When using JS_Mouse_GetCursor() and JS_Mouse_LoadCursor(), are the cursors id the same on all OS and themes ?
For example, left edge is 417 and right edge is 418 at home.
This will work for everybody ? :

To the best of my knowledge, the IDs should work the same for everyone, but themes may change the appearance of the cursors.

[tack]

Originally Posted by Rodilab

are the cursors id the same on all OS and themes ?

There are some differences -- some cursors only work on Windows -- but otherwise they are consistent (except for width+height resize cursors which are swapped on Linux). Cursor ids below 2000 should be safe.

This is documented here for rtk:

https://reapertoolkit.dev/module/rtk....mouse.cursors

You can see what those rtk-specific constants translate to for your own non-rtk scripts here:

https://github.com/jtackaberry/rtk/b.../core.lua#L309

[dsyrock]

How to get the trackview window HWND in linux?
In windows, I can get it from this:

hwnd=reaper.JS_Window_Find('trackview', true)

But it doesn't work in linux. I try to print all child windows' name of main window:

local main=reaper.GetMainHwnd()
retval, list = reaper.JS_Window_ListAllChild(main)
for address in list:gmatch('[^,]+') do
  local hwnd= reaper.JS_Window_HandleFromAddress(address)
  reaper.ShowConsoleMsg(reaper.JS_Window_GetTitle(hwnd)..'\n')
end

But no "trackview" in them.

[juliansader]

Window and class names are not cross-platform reliable. Instead, use window IDs, with JS_Window_FindChildByID. You can get the ID with JS_Window_GetLong(win, "ID"). IIRC, the trackview's ID is 1000.

[dsyrock]

Originally Posted by juliansader

Window and class names are not cross-platform reliable. Instead, use window IDs, with JS_Window_FindChildByID. You can get the ID with JS_Window_GetLong(win, "ID"). IIRC, the trackview's ID is 1000.

Thanks. By the way, is there any way to print all the child ID of a parent window?

[cohler]

What happened to the JS_Actions functions?

[juliansader]

Originally Posted by dsyrock

Thanks. By the way, is there any way to print all the child ID of a parent window?

Sure. Use the same code as in your previous post, but replace reaper.JS_Window_GetTitle(hwnd) with reaper.JS_Window_GetLong(hwnd, "ID")

[juliansader]

Originally Posted by cohler

What happened to the JS_Actions functions?

Please jog my memory -- what were the JS_Actions functions?

[cohler]

Originally Posted by juliansader

Please jog my memory -- what were the JS_Actions functions?

• JS_Actions_CountShortcuts
• JS_Actions_DeleteShortcuts
• JS_Actions_DoShortcutDialog
• JS_Actions_GetShortcutDesc

[juliansader]

Sorry, I still don't quite understand what you are referring to. Did anything happen to these functions on your system?

[cohler]

Originally Posted by juliansader

Sorry, I still don't quite understand what you are referring to. Did anything happen to these functions on your system?

Sorry, my bad. The problem was that I was using v0.999 of js_ReaScriptAPI64.dylib. I've updated now to 1.220 and all is good.

[juliansader]

I am working on v1.300 of the extension, with the following updates:
* New: Zip/Unzip functions.
* LoadPNG/JPGFromMemory, which work nicely after Zip_Entry_ExtractToMemory.
* New: JS_LICE_SetFontFXColor, so that font shadows can be properly black.
* New: TabCtrl functions.
* Fixed: JS_ListView_SetItemState documentation.

I would appreciate it very much if some of you could check whether the new version loads and works properly -- particularly on Apple ARM, since I can't test that platform myself.

macOS
macOS ARM
Linux
Windows


EDIT: Added the LoadPNG/JPGFromMemory functions.

[amagalma]

Originally Posted by juliansader

I am working on v1.300 of the extension, with the following updates:
* New: Zip/Unzip functions.
* New: JS_LICE_SetFontFXColor, so that font shadows can be properly black.
* New: TabCtrl functions.
* Fixed: JS_ListView_SetItemState documentation.

I would appreciate it very much if some of you could check whether the new version loads and works properly -- particularly on Apple ARM, since I can't test that platform myself.

macOS
macOS ARM
Linux
Windows

Thank you so much for these additions!


I am testing the zip actions:

local function Error( ok, msg )
  if not msg then msg = "" 
  else msg = msg .. " : "
  end
  if ok < 0 then
    reaper.JS_Zip_Close( nil, zipHandle )
    error(msg .. reaper.JS_Zip_ErrorString( ok ))
  else
    reaper.ShowConsoleMsg( msg .. ok .. "\n")
  end
end

theme = reaper.GetResourcePath() .. "\\ColorThemes\\Default_5.0.ReaperThemeZip"
zipHandle, ok = reaper.JS_Zip_Open(theme, "READ",  6)
Error(ok,"openzip")
entries_cnt = reaper.JS_Zip_CountEntries( zipHandle )
entry_id = reaper.JS_Zip_Entry_OpenByName( zipHandle, "Default_5.0_unpacked\\rtconfig.txt")
ok, contents = reaper.JS_Zip_Entry_ExtractToMemory(zipHandle)
Error(ok,"extract2mem")
--reaper.ShowConsoleMsg( contents )
ok = reaper.JS_Zip_Entry_Close(zipHandle)
Error(ok,"entryclose")
ok = reaper.JS_Zip_Close( theme )
Error(ok,"zipclose")

JS_Zip_Entry_ExtractToMemory seems to return positive numbers on success while the documentation states that it would return 0.

[Meo-Ada Mespotine]

Originally Posted by juliansader

I am working on v1.300 of the extension, with the following updates:
* New: Zip/Unzip functions.
* New: JS_LICE_SetFontFXColor, so that font shadows can be properly black.
* New: TabCtrl functions.
* Fixed: JS_ListView_SetItemState documentation.

I would appreciate it very much if some of you could check whether the new version loads and works properly -- particularly on Apple ARM, since I can't test that platform myself.

macOS
macOS ARM
Linux
Windows

Oooh...this sounds very nice

[amagalma]

TabCtrl actions do not work with WDLTabCtrl class, right?

bay = reaper.JS_Window_Find("Project Bay", true)
tab = reaper.JS_Window_FindChildByID( bay, 1064 )
count = reaper.JS_TabCtrl_GetItemCount( tab )

[juliansader]

I forgot to mention that there are also new LoadPNG/JPGFromMemory functions, which work very nicely after Zip_Entry_ExtractToMemory.

[dsyrock]

Originally Posted by juliansader

I forgot to mention that there are also new LoadPNG/JPGFromMemory functions, which work very nicely after Zip_Entry_ExtractToMemory.

Hi, is there any plan about getting access in tree list? Like the tree list in Media Explorer?

[cohler]

Wondering if there are solutions to any of these questions using js_ReaScriptAPI? I have posted them each independently in the Developer forum and received lots of views but no responses:

• p=2512288
  
• p=2512057
  
• p=2511138

[reapero]

Hey!

I am trying to send a right click to a plugin window and using the following code, it doesnt work:

x, y = reaper.GetMousePosition()
w = reaper.JS_Window_FromPoint(x, y)
x, y = reaper.JS_Window_ScreenToClient(w, x, y)
reaper.JS_WindowMessage_Send(w, "WM_RBUTTONDOWN", 1, 0, x, y)
reaper.JS_WindowMessage_Send(w, "WM_RBUTTONUP", 0, 0, x, y)

This works when being in the main reaper window (soit sends the right click on the TCP, timeline, items, empty areas, etc) but it fails once the mouse is inside the VSTi UI. I am wondering if reaper.JS_Window_ScreenToClient is not the right thing to use here?

Thx!

EDIT: Sending a keystroke works so looks like its something related to mouse clicks?

[Meo-Ada Mespotine]

Is there a way to hijack mouse-messages from a hwnd?
I would like to rewire left-doubleclick and right-click on markers to use my code instead of opening the edit marker-dialog and the marker-context-menu.
But for that, I need to prevent them from being recognized by the marker-lane and be able to get, that the user tried to send left-doubleclick or right-click, so I can react to it.

Where should I look?

@JulianSader
Clipboards can also hold image-information at least on Windows. Would it be possible to make a function JS_Image_GetFromClipboard, that returns a handler, that I could blit or pass to the png/jpg-save-functions and JS_Image_PutToClipboard to put the contents of an image back into the clipboard of the os?

I would like to be able to get a coverimage from clipboard and write a script, that automatically saves it as png in my projectfolder.

That way, I can create the cover in an Photoshop, etc, and can put it in my projectfolder, without needing to choose the projectfolder in Photoshop to save it, I just put it into the clipboard and run my script.
And if I need to alter it again, I simply put it into the clipboard using Reaper and paste it back into Photoshop.

This would make some things like that go much faster, but I don't know, if that is possible in the first place...

What do you think?

[juliansader]

Originally Posted by Meo-Ada Mespotine

Is there a way to hijack mouse-messages from a hwnd?

Yes -- the WindowMessage_Intercept functions should hopefully do the job.

Originally Posted by Meo-Ada Mespotine

Would it be possible to make a function JS_Image_GetFromClipboard

I'm not sure, but I will look into it.

[juliansader]

Has anyone checked whether the Apple ARM version of the extension's v1.300 update loads correctly?

[juliansader]

Originally Posted by dsyrock

Hi, is there any plan about getting access in tree list? Like the tree list in Media Explorer?

I haven't looked into tree lists yet.

[juliansader]

Originally Posted by reapero

I am trying to send a right click to a plugin window and using the following code, it doesnt work:

Which VSTi and operating system are you using? I tested a few VSTs on Windows and Linux, and they all seem to work fine.

However, I suspect that if you're on Linux or macOS, and if the VST bypasses REAPER/swell to draw the windows by itself, the VST might not respond to REAPER's swell messages.

[reapero]

Originally Posted by juliansader

Which VSTi and operating system are you using?

Its Omnisphere2 with windows10. I just had a look at the problem again and turns out that i am receiving a left click instead of a right one. I tried with Massive and this does receive the right click correctly, so looks like its something specific from Omnisphere.

Can you think of why such a thing would happen? Could there be a workaround or shall i just let it go?

Thanks, you are awesome, as always!

[Edgemeal]

Originally Posted by reapero

Its Omnisphere2 with windows10. I just had a look at the problem again and turns out that i am receiving a left click instead of a right one.

Maybe try setting wParam to 0x2 (MK_RBUTTON), for down..

reaper.JS_WindowMessage_Send(w, "WM_RBUTTONDOWN", 2, 0, x, y)

[reapero]

Originally Posted by Edgemeal

Maybe try setting wParam to 0x2 (MK_RBUTTON), for down..

reaper.JS_WindowMessage_Send(w, "WM_RBUTTONDOWN", 2, 0, x, y)

Yes! That made it work, for TCP and inside Omnisphere! Thanks a ton Edgemeal!

Now i am facing another problem. I want the script to send the right click and then select one of this options from the dropdown menu:



I thought about sending cursor key down strokes once this dropdown menu shows up, since that works when using my keyboard, but it doesnt work since i guess (might be wrong here) the dropdown is a new window with different handle. So whats happening now is that once i get rid of the dropdown manually, the cursor down is sent to Omnisphere, which changes the patch

Using spyxx i cant seem to find the handle for that window cause i soon as i switch the app the dropdown menu disappears. Any suggestions are welcome

[Edgemeal]

Originally Posted by reapero

Yes! That made it work, for TCP and inside Omnisphere! Thanks a ton Edgemeal!

Cool!

Using spyxx i cant seem to find the handle for that window cause i soon as i switch the app the dropdown menu disappears. Any suggestions are welcome

You can detect menu by its classname ("#32768").
https://docs.microsoft.com/en-us/win...window-classes

AFAIK JS_API doesn't have the needed functions to interact with Menus, but maybe you can hack it by sending keys to the window to select the menu item?
Quick test worked here on the (TCP) Track context menu,..

-- Select context menu item example/hack

-- virtual keys -- https://docs.microsoft.com/en-us/windows/win32/inputdev/virtual-key-codes
local VK_DOWN = 0x28   -- DOWN ARROW key
local VK_RETURN = 0x0D -- ENTER key

function PostKey(hwnd, vk_code)
  reaper.JS_WindowMessage_Post(hwnd, "WM_KEYDOWN", vk_code, 0,0,0)
  reaper.JS_WindowMessage_Post(hwnd, "WM_KEYUP", vk_code, 0,0,0)
end

function FindMenu()
  local arr = reaper.new_array({}, 1024)
  local ret = reaper.JS_Window_ArrayAllTop(arr)
  --if ret < 1 then return end
  local childs = arr.table()
  for j = 1, #childs do
    local hwnd = reaper.JS_Window_HandleFromAddress(childs[j])
    if reaper.JS_Window_GetClassName(hwnd) == "#32768" then 
      -- context menu found, call another function or whatever...
      --> TEST: Send 3 Down Arrow keys, followed by an Enter key to select 3rd menu item.
      for i = 1, 3 do PostKey(hwnd, VK_DOWN) end
      PostKey(hwnd, VK_RETURN)
      return -- exit func.
    end
  end
  -- limit how long to wait for menu to be found
  if (reaper.time_precise() - init_time) >= 2.0 then -- 2 sec max wait.
    reaper.ShowConsoleMsg('Context menu not found!\n')
    return
  end
  reaper.defer(FindMenu)
end

init_time = reaper.time_precise()
FindMenu()

[Meo-Ada Mespotine]

Originally Posted by juliansader

Yes -- the WindowMessage_Intercept functions should hopefully do the job.




I'm not sure, but I will look into it.

Thnx