AI OSD: Selection
AI-first map of OSD-based selection services and selected window data.
OSD Selection Discovery Map
Reference map for interactive on-screen selection: window, region, point, or color picking.
Drawing persistent annotations belongs to osd/screen-overlay.md.
User Intents
- Let the user pick a target window.
- Pick a screen region.
- Pick a screen point.
- Pick a color under cursor.
- Use selected window PID for CV, memory, or input workflows.
Concept Model
IOsdSelectionServiceis the user-facing picker.- Selection is interactive and temporary.
PickWindow()returnsIWindowHandle.- Region/point/color picking can be scoped to a target window.
- Region selection can provide screen/window coordinate transforms.
API Details
IOsdSelectionServicePickWindow()PickRegion(IWindowHandle targetWindow = default)PickPoint(IWindowHandle targetWindow = default)PickColor(IWindowHandle targetWindow = default)
OsdRegionSelectionResult- selected region, transform matrices, and window under cursor.OsdRegionTransformationMatrices-ScreenToWindowandWindowToScreen.OsdPointSelectionResult- selected point.OsdColorSelectionResult- sampled color.
Prefer
- Prefer
IOsdSelectionServicefor user-driven selection. - Prefer
IWindowHandlefromPickWindow()over raw handles. - Prefer
windows-subsystems/window-handles.mdfor handle conversion/matching. - Prefer
osd/screen-overlay.mdfor drawing persistent overlays.
Avoid
- Avoid custom cursor polling or screenshots for picker behavior.
- Avoid using OSD selection as a persistent overlay renderer.
- Avoid assuming selected windows stay alive.
Research Anchors
IOsdSelectionService,PickWindow,PickRegion,PickPoint,PickColor,OsdRegionSelectionResult,WindowUnderCursor,OsdRegionTransformationMatrices.
Search Synonyms
- select window
- pick window
- OSD picker
- region picker
- point picker
- color picker
- screen selection
- window under cursor
Related Maps
osd/screen-overlay.mdwindows-subsystems/window-handles.mdcomputer-vision/images.mdmemory/processes.md