Thanks for your response. I put this in a discord channel:
not sure where to post this, but I am thinking, hey chatgpt " I want to create admin panels with appsmith only using my speech. So I need a way to go from speech to command, that then get ran in the browser, but it would have to have an understanding of appsmiths code and DOM to move things around"
I was thinking selenium commands, but there must be a good javascript level api to interact with, like maybe via user scripts
does anyone know of ideas of an entry point from the browser to manipulate the UI?
That’s for a little more color.
I don’t mind working on writing a layer or plugin or extension, just was trying to figure out the best way to go about it from you guys’ lead developer points of view.
So far as I can tell, it would be easier to NOT mess with the API or DSL direcly via voice, but rather just stick with actions in the DOM and let the underlying events handle the API calls. That I think would be a lot easier?