showlab/computer_use_ootb

Control desktop interfaces via vision models

View on index · View in 3D Map

Related repos

• Automates macOS through keyboard, mouse, and screen control APIs
• Autopilot for computers using LLMs
• Automates Windows GUI tasks without computer vision models
• Gives AI agents computer control
• Vision-Language-Action model for GUI agents
• Tutorials for computer vision models
• Python library for USB-C displays
• Agent controls computers through visual language models
• Automates desktop and web GUIs with multimodal models