I've thought about this myself, although not seriously. At one point, I even considered buying a monitor with eye-tracking built in :).

There's a commercial eye-tracking product from Tobii aimed at gamers, and my instinct is that starting from a purpose-built eye-tracker would work much better than using a webcam or Kinect. However, it seems the Tobii product is fundamentally limited to one monitor at a time and only has unofficial Linux support.

If you do make something work, I'd love to hear about it.

On Fri, Nov 20, 2020, 12:24 Ivan Perez <ivanperezdominguez@gmail.com> wrote:
Hi all

In case it's useful, the following two projects I built a few years ago might help:

Kinect control for the game Haskanoid:

https://github.com/ivanperez-keera/haskanoid/blob/develop/src/Input.hs#L237-L280

Webcam-based face position/distance detection module for a posture monitor:

https://github.com/keera-studios/keera-posture/blob/develop/src/AI/CV/PostureProcessors.hs#L40

Either method could achieve something like what you want. I'd recommend playing with having the kinect/webcam in different positions (not just between the monitors, and potentially even slightly to the right of the rightmost monitor, or to the left of the leftmost one).

I never managed to make eye detection work on Kinect. I heard the very latest version of the kinect (under development in 2017) was able to detect eye movement well, but never tried it myself. It would have been a cool accessibility feature for haskanoid.

All the best,

Ivan

On Fri, 20 Nov 2020 at 14:10, John Z. <johnz@pleasantnightmare.com> wrote:
Don't have a ready solution, but this is such an interesting idea since I
have same setup. I might try a toy weekend project using a random kinect
I have lying around.


> Hello,
>
> I'm using xmonad in a setup with 3 monitors and I'm curious if anybody
> here got kind of eyes-based navigation working between monitors/workspaces.
>
> Explanation: I need to type into windows on different monitors but in
> not specific order. Sometime I got too deep into thinking that I forget
> to switch workspace and then I type to different window in different
> workspace than is intended (and which I see with eyes). Basically I'd
> like some mode where xmonad will switch workspaces based on my eye/head
> position so only workspace I follow with eyes will be active.
>
> I see that such software (following head/eyes) already exist in AI
> domain (E.g. NV's xavier NX developer kit demo: from 16:00:
> https://www.youtube.com/watch?v=aUz1bNGm04w) but I'm more interested in
> amd64/linux setup as this is for my workstation...
>
> Any idea highly appreciated!
>
> Thanks!
> Karel
> _______________________________________________
> Haskell-Cafe mailing list
> To (un)subscribe, modify options or view archives go to:
> http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
> Only members subscribed via the mailman list are allowed to post.

--
John Z.
"Its too bad she won't live... but then again, who does?"
_______________________________________________
Haskell-Cafe mailing list
To (un)subscribe, modify options or view archives go to:
http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
Only members subscribed via the mailman list are allowed to post.
_______________________________________________
Haskell-Cafe mailing list
To (un)subscribe, modify options or view archives go to:
http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell-cafe
Only members subscribed via the mailman list are allowed to post.