1.3.5397

Main focus

In June, the main focus was on improving scripting. Most of the results of this work will become available in August — behavior trees, pathfinding, and visualization.

I’m also actively working on a Diablo 4-related project that will bring together most of the current EyeAuras functionality to demonstrate what it is already capable of. Because of that, most of the systems I implement for that bot will also be released to all users as soon as their API is stable.

I’ll publish a detailed post once those features are ready for public use. If you’d like to try some of them earlier, feel free to contact me directly.

Wiki updates

A lot has changed in the Wiki: https://wiki.eyeauras.net/en/home

  • Added documentation for almost all action, trigger, and overlay types available in the app
  • Added documentation for the Coordinate System, which is used in some actions and triggers to define capture areas, clone areas, or click coordinates: https://wiki.eyeauras.net/en/coordinate-system
  • Added documentation for Text Match Expressions, which are used to evaluate recognized text or incoming network/Telegram messages: https://wiki.eyeauras.net/en/text-match-expressions
  • Added documentation for Window Matching Expressions, which are used to specify which window should be selected as the target window: https://wiki.eyeauras.net/en/window-matching-expressions
  • Take a look at the Dependencies Viewer, which is often overlooked but makes debugging complex aura setups much easier: https://wiki.eyeauras.net/en/overlays/dependencies-viewer
  • Added some technical information about Custom UI: https://wiki.eyeauras.net/en/overlays/custom-ui
  • Bindings: an extremely powerful mechanism that lets you connect trigger and action properties together — Bindings | EyeAuras Wiki
    • for example, you can find an inventory using Image Search and bind the detected area as the source region for another Image Search, which will then search only inside the inventory area
    • you can also bind overlay coordinates to Image/Text/Color Search and link the overlay lock state to HotkeyIsActive, allowing the user to quickly change the capture area by pressing a hotkey and dragging the overlay somewhere on the screen
  • Sync: a mechanism that makes it easier to share an aura set that you are actively working on

Anchor system improvements IMPORTANT CHANGE

Anchors are the coordinate system used anywhere you need to select an area — screen regions, image regions, and so on.

The idea is simple: by choosing different reference points, you can easily align capture or output areas relative to one another.

More details and examples are available here: https://wiki.eyeauras.net/en/coordinate-system

Input redirection improvements

This is a fairly niche feature available in the settings that lets you redirect all user input through a specific simulator.

  • You can now quickly enable or disable redirection from the main window, as long as a redirection simulator is configured in settings

Image

ML Search improvements

  • In the Effects window, you can now configure automatic screenshot capture/recording, which is very helpful when collecting a training dataset

Image

  • Performance improvements, especially noticeable in CPU mode
  • Fixed a crash related to loading an incompatible or broken model
  • Fixed a memory leak that occurred in Segmentation mode
  • Improvements to Segmentation and masks — a new "Group masks by class" mode has been added, allowing all masks of the same class to be merged into one, which makes them much easier to process
    • for example, if the neural network detects 6 different regions labeled as "Road", enabling "group by class" will merge all binary masks into a single "Road", along with their bounding boxes
    • Segmentation is the process of capturing not only object bounding boxes, but also their precise shape

Image

Bug fixes and improvements

  • Improved mouse capture — lower latency
  • Added status display
  • The 'New Clone' button has been removed. To create a clone now, go to: New Aura -> Overlays -> Clone and specify the area to capture/replicate
  • Startup speed optimizations
  • Drag'n'Drop should now feel more responsive
  • Fixed an AuraTree issue that caused sudden jumps while scrolling or selecting items