Computer vision in Screph
Computer vision operations create masks, contours, detections, recognized text, metrics, and other results. The main markup changes only after separate confirmation.
Available operations, markup types, and save targets depend on the program mode. Statuses and limitations are listed under “Program modes”.
Main process
- Select a source image or region of interest.
- Select one operation, a processing chain, or a processing graph.
- Configure settings and run preview.
- Compare source material, result, mask, contours and metrics.
- Attach the desired result to the project or confirm a supported markup change.
Source and area of interest
An operation receives the active image or selected area. Verify that the area belongs to the intended frame and that its scale and coordinates match the canvas display.
The result can be shown next to the source, on top of it, or as a separate mask. Selecting a view does not change the saved markup.
Operation categories
| Category | Examples |
|---|---|
| Preparing the image | Brightness, contrast, blur, resize, crop, rotate and straighten. |
| Borders and areas | Thresholding, boundaries, contours, components, morphology and segmentation. |
| Juxtaposition and movement | Pattern search, comparison, alignment, optical flow and tracking. |
| OCR | Text recognition with local setting Tesseract. |
| Model-based operations | YOLO, SAM, OmniParser |
The actual availability of an operation depends on the installed components, model files, and selected program mode.
One operation
Suitable for one transformation or analysis. After changing a parameter, refresh the preview and compare the result with the source. Saved parameters belong to the selected operation and material.
Processing chain
A linear sequence passes the result of each step to the next. It is suitable for predictable, branch-free processing such as cropping, contrast enhancement, thresholding, and edge extraction.
Check intermediate steps: an error in early processing affects all subsequent results.
Processing graph
The graph allows you to branch processing, combine compatible results, and select individual outputs for viewing. Relationships are created only between compatible data types.
- Give the steps clear names and test each output separately.
- For a complex graph, start with a small working part and add branches gradually.
- The experimental graph may differ in the available operations from the linear sequence.
Preview, save and apply
| Action | Output |
|---|---|
| Preview | Shows the result of the current parameters without changing the main markup. |
| Attach result | Saves the selected mask, image, or other result next to the project and associates it with an object. |
| Apply change | Once validated, adds or modifies a supported core markup object. |
Reviewing the proposed change
An operation proposal can be accepted, edited, rejected, or recalculated. Before applying it, check the source frame, object boundary, markup type, and absence of duplicates.
Industrial and UAV support a limited set of subject changes, but remain experimental and do not provide a production-ready review and export process.
Video and time results
For video and frame sequences, operations can create observations and trajectories over time. Such results must be reviewed across the full range, not just on one frame.
Hiding a result from the interface does not necessarily delete its files. Before transferring a project, review the associated temporary materials and save the desired results with the project.
Models and dependencies
YOLO, SAM, and OmniParser require suitable model files and prepared dependencies. An installed model is not selected automatically for all operations.
Typical problems
- Empty result: check the source, area of interest and parameter range.
- Invalid coordinates: check scale, cropping and selected view.
- Operation unavailable: check the dependencies and model files.
- The project has become large: remove unnecessary temporary results and attach only necessary materials.