Getting Started

A practical path from data to a working YOLO model

YoloEase

text
start: label 5-10 frames by hand -> first model
                                 |
                                 v
tens/hundreds of frames -> auto-annotation -> review and fixes
         ^                                         |
         |                                         v
         +------------ new model <- Trainer <------+
                                 |
                                 v
                  .pt/.onnx -> EyeAuras or another app

YoloEase is designed to help you train a YOLO model that finds the objects you need in your frames. The result is standard .pt weights for further training and an .onnx file you can run without Python.

In this guide, EyeAuras is just an example of where a finished model can be used. In the AimTrainer.io example, the model detects targets tgt and the button btn, then EyeAuras loads the ONNX model into ML Search and clicks the detected targets through Behavior Tree.

Start screen

Practical quick start

Do not begin with a huge perfect dataset. The fastest path is a small manual seed set, then your first model, then larger tasks with auto-annotation.

  1. Take the first 5-10 frames.
  2. Label them by hand.
  3. Start training.
  4. While the first model is training, add a bit more manual annotation if you have time.
  5. When the first model is ready, use it to auto-annotate the next task.
  6. If auto-annotation is already helping, increase the task size: first tens of frames, then hundreds.
  7. Review the model suggestions, fix mistakes, and send the task back into training.

Each cycle gives you a new model version. At first it will be weak, then it will help more and more. After a few generations, you stop drawing every box from scratch and mostly review and correct auto-annotation.

Read more about this workflow here: annotation and training, Trainer, annotation editor.

What gets created along the way

StepWhat you get
Video or folderSource frames that will become your dataset.
Extract framesCopies of frames inside the YoloEase project.
Create TaskAn annotation task: small at first, later tens or hundreds of frames.
Annotation editorObject boxes and labels such as tgt or btn.
Finish JobA completed task that can be used for training.
TrainerYOLO dataset, training runs, predictions, and model files.
Open on a modelFolder with .pt, .onnx, charts, and training results.
EyeAuras or another appReal automation that uses the finished .onnx.

Short glossary

TermMeaning
FrameA single image from a video or folder.
Label or classThe name of an object type: tgt, btn, enemy, loot.
TaskA batch of frames that is convenient to process in one pass.
.ptPyTorch weights for training and fine-tuning through YOLO/Ultralytics.
.onnxA file for running the model in EyeAuras or another compatible engine.
PredictionObjects found by the model: box, class, and confidence.
Auto-annotationUsing an already trained model to label new frames faster.
False positiveThe model detected an object where there is none.
MissThe model failed to detect an object it should have found.

What you will end up with

By the end, you will have:

  • a YoloEase project with source frames, tasks, annotations, and training history;
  • .pt weights for further training in YOLO/Ultralytics;
  • an .onnx model that runs without a Python environment;
  • optionally, finished EyeAuras logic that uses ML Search and Behavior Tree.

Final result

Main workflow

  1. Download the latest build from GitHub releases and start YoloEase.
  2. Create a project through New.... YoloEase will show the standard save dialog for .yeproj and create a project folder next to it. Read more: prepare data.
  3. Open Prerequisites, click Check all, then Install missing. Read more: prerequisites.
  4. Add labels such as btn and tgt. Read more: data sources.
  5. Add a video or a folder with images. Read more: data sources.
  6. If the source is a video, extract frames through Extract frames. Read more: extracting frames from video.
  7. In Trainer, create your first task. Read more: Trainer.
  8. Annotate the first frames manually and make sure to click Finish Job. Read more: annotation editor.
  9. Start Start automatic training and review the metrics. Read more: annotation and training.
  10. Use predictions and auto-annotation for the next tasks. Read more: annotation editor and Trainer.
  11. Enable augmentations if needed. Read more: augmentations.
  12. Review the files produced after training. Read more: YOLO ONNX and model weights.
  13. Plug the final .onnx into EyeAuras or another compatible recognition engine. Read more: EyeAuras integration.

Pages in this section

Main guides:

Detailed feature pages:

Ready-made materials

If you want to see the finished result or repeat the example without building everything from scratch:

See also

If this is your first time running YoloEase, start with prerequisites. If your environment is already ready, go straight to prepare data.