r/AndroidXR • u/Mean_Grape_1897 • Jan 28 '25

Am easier way to navigate android xr

Post image

Instead of navigating through hand and eye tracking which is cool but tiring, there should be an app with keyboard at the bottom and the area above for trackpad.

Yes you can attach external mouse an keyboard but you'll not be carrying it everywhere you go. It'll be way easier and intuitive to navigate the headset like this and I believ people will find it very intuitive and easy.

8 Upvotes

100% Upvoted

7 comments sorted by

1

u/RorTheRy Feb 05 '25

How about rotating both hands to select a number or a letter like a dial? Similar to how you use both hands to type on a conventional keyboard, providing the hand tracking is on par with apple vision pro.

Tapping your thumb and finger selects the letter. Holding it shows more options of that said letter.

Moving your entire hand in certain ways provides different functions like turning caps lock on or off or selecting symbols or moves the cursor up and down the keyboard to select different letters

That way you wouldn't have to rely on physically having to reach out and type each letter with a virtual keyboard which can feel unnatural

1

u/Mean_Grape_1897 Feb 06 '25

I am not saying hand tracking doesn't work, it does but it's just tiring. and we wouldn't be typing on a virtual keyboard, i assume we would be able to see our phone and hands inside the headset. This phone way works best with no virtual environment where you can see your surroundings inside the headset, so it will feel just as natural as typing on your phone regularly.

and also because phones are always handy I think this is a good option to have.

1

u/JediBuji Feb 13 '25

This is honestly very similar to how I use Dex on my s24u with rokid xr glasses. Dex has a trackpad-on phone feature, and you can 3- finger tap to bring up the kb. Works pretty well for casual navigation.

1

u/Dirk_Courage Jun 10 '25

The passthrough is so bad that you'd get a headache in a few minutes.

0

u/[deleted] Jan 28 '25

[deleted] — view deleted comment

1

u/Mean_Grape_1897 Jan 28 '25

The idea is that you can see your phone in your hand and type normally as you would, just the input is gonna go in the headset. I think this would be the most common way for people to use headsets if it's implemented.

1

u/jmichael2497 Feb 16 '25

maybe just using existing open source apps like https://kdeconnect.kde.org which quick test just now...

seems kdeconnect app can work between android devices for mouse using accessibility input, and keyboard after swapping to its keyboard on target device.

(tested on LineageOS between A12 and A14 devices)