Working on GestureEvents for AI / ML recognition on the Web, early draft goes for 2D-one-handed aero events as follow:

hover ☝️ / 👆

Pointing index finger up just point over any area of the visual space to match the area of the SVG image.

blink ✊🤚✌️

This event consist of a sequence of 3 gestures: closed fist, open palm, closed fist again while keeping the same position of the hand.

swipe ✌️↔️✌️

Pointing up with index and middle finger closed, move hand left to right or right to left. derived from this event, swipeleft and swiperight are available, though not implemented yet. Although fingers can be in open position, event is considered for closed position.

Stay tuned for more on AI Events, follow @Devignia on X

For smoother and faster transitions and rendering, GPU is desired, although not required.

Time span

It is set at 4800 ms by now, optimised for 3000 ms. There are facts to take in count on this:

• Web & JS technologies, although they are fast, they are not low level implementations, so, fine tunning at hardware level can take more time.
• Recognition is being mande on the main thread, although it shall be deglegated to a Web Worker, there is a lag between video stream, wasm/arraybuffer recognition and event listeners timers.

💾 Download dev milestone
https://devignia.site/_archive/yakko-0.0.1.zip

📱 Preview at
https://devignia.site/yakko