Re: [Haskell-cafe] xmonad: eyes based navigation between monitors.

I've thought about this myself, although not seriously. At one point, I even considered buying a monitor with eye-tracking built in :). There's a commercial eye-tracking product from Tobii aimed at gamers, and my instinct is that starting from a purpose-built eye-tracker would work much better than using a webcam or Kinect. However, it seems the Tobii product is fundamentally limited to one monitor at a time and only has unofficial Linux support. If you do make something work, I'd love to hear about it. On Fri, Nov 20, 2020, 12:24 Ivan Perez wrote:

Hi all

In case it's useful, the following two projects I built a few years ago might help:

Kinect control for the game Haskanoid:

https://github.com/ivanperez-keera/haskanoid/blob/develop/src/Input.hs#L237-...

Webcam-based face position/distance detection module for a posture monitor:

https://github.com/keera-studios/keera-posture/blob/develop/src/AI/CV/Postur...

Either method could achieve something like what you want. I'd recommend playing with having the kinect/webcam in different positions (not just between the monitors, and potentially even slightly to the right of the rightmost monitor, or to the left of the leftmost one).

I never managed to make eye detection work on Kinect. I heard the very latest version of the kinect (under development in 2017) was able to detect eye movement well, but never tried it myself. It would have been a cool accessibility feature for haskanoid.

All the best,

Ivan

On Fri, 20 Nov 2020 at 14:10, John Z. wrote:

...

Don't have a ready solution, but this is such an interesting idea since I have same setup. I might try a toy weekend project using a random kinect I have lying around.

...

Hello,

I'm using xmonad in a setup with 3 monitors and I'm curious if anybody here got kind of eyes-based navigation working between monitors/workspaces.

Explanation: I need to type into windows on different monitors but in not specific order. Sometime I got too deep into thinking that I forget to switch workspace and then I type to different window in different workspace than is intended (and which I see with eyes). Basically I'd like some mode where xmonad will switch workspaces based on my eye/head position so only workspace I follow with eyes will be active.

I see that such software (following head/eyes) already exist in AI domain (E.g. NV's xavier NX developer kit demo: from 16:00: https://www.youtube.com/watch?v=aUz1bNGm04w) but I'm more interested in amd64/linux setup as this is for my workstation...

Any idea highly appreciated!

Thanks! Karel _______________________________________________ Haskell-Cafe mailing list To (un)subscribe, modify options or view archives go to: http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe Only members subscribed via the mailman list are allowed to post.

-- John Z. "Its too bad she won't live... but then again, who does?" _______________________________________________ Haskell-Cafe mailing list To (un)subscribe, modify options or view archives go to: http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe Only members subscribed via the mailman list are allowed to post.

_______________________________________________ Haskell-Cafe mailing list To (un)subscribe, modify options or view archives go to: http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe Only members subscribed via the mailman list are allowed to post.