He never opens them. But they keep coming.
You have two inputs fighting (Physical mouse movement + Controller stick). Fix: Disable your physical mouse via Device Manager or use a "Mouse Disable" toggle in your controller software. pc remote xbox controller layout
The answer lies in understanding the .
When connected for Remote Play, your controller will follow the standard Xbox hardware configuration: Left Stick : Movement / Navigation. Right Stick : Camera control / Look. A / B / X / Y He never opens them
For advanced users who want to use their controller as a full mouse and keyboard replacement for remote control: pc remote xbox controller layout