[mwiseman]

I have a Windows 11 PC and I cannot get MS to recognize the camera for facial gestures.

I have turned on MobileSheets permission in the camera privacy settings.

Also, MS recognizes and uses the camera for importing a photo of a work.

[Zubersoft]

The facial gesture feature requires a front-facing camera. A rear facing camera will not work, as it wouldn't be able to point at your face. So what type of camera are you using?

Mike

[mwiseman]

The facial gesture feature requires a front-facing camera. A rear facing camera will not work, as it wouldn't be able to point at your face. So what type of camera are you using?

Mike

It's a USB camera attached to a tower PC and is facing me. I read in the forums that the FastSpring version of the Windows app might work with the camera, so I installed it. The FastSpring version worked until I imported the backup from the Windows store version and then it could not find the camera for facial gestures, but still uses the camera for photographing sheet music.

[Zubersoft]

Go to Settings->Face Gesture Settings->Configure Gesture Actions, then change the Preferred camera dropdown to select the USB camera. I would like to know if this works for you. MobileSheets uses slightly different frameworks for capturing images with the camera vs capture video for the face gestures. Without going into too much technical detail, I'm requesting all available devices with MediaFrameSourceGroup.FindAllAsync (https://learn.microsoft.com/en-us/uwp/ap...inrt-26100) and then iterating over all devices and using any whose SourceInfos has a MediaStreamType that matches VideoPreview or VideoRecord and can capture color frames. So if the camera is designed by the OS as being able to capture color video, then it should work for the face gesture feature. If it is reported as only being able to capture images by the OS, then it would not work for the face gestures.

Mike

[mwiseman]

The drop down list is empty.

[Zubersoft]

That means the USB camera is not considered a valid device for capturing video. That's just based on what Microsoft's framework is reporting. I don't really know what can be done about that. If you want to test a build of the FastSpring version that will allow matching on devices that also report themselves as devices for capturing images, we can see if that will work, but there could be errors when I go to start receiving video frames from the camera if it does not actually support video.

Mike

[mwiseman]

Go to Settings->Face Gesture Settings->Configure Gesture Actions, then change the Preferred camera dropdown to select the USB camera. I would like to know if this works for you. MobileSheets uses slightly different frameworks for capturing images with the camera vs capture video for the face gestures. Without going into too much technical detail, I'm requesting all available devices with MediaFrameSourceGroup.FindAllAsync (https://learn.microsoft.com/en-us/uwp/ap...inrt-26100) and then iterating over all devices and using any whose SourceInfos has a MediaStreamType that matches VideoPreview or VideoRecord and can capture color frames. So if the camera is designed by the OS as being able to capture color video, then it should work for the face gesture feature. If it is reported as only being able to capture images by the OS, then it would not work for the face gestures.

Mike

That means the USB camera is not considered a valid device for capturing video. That's just based on what Microsoft's framework is reporting. I don't really know what can be done about that. If you want to test a build of the FastSpring version that will allow matching on devices that also report themselves as devices for capturing images, we can see if that will work, but there could be errors when I go to start receiving video frames from the camera if it does not actually support video.

Mike

I tried the FastSpring version and it worked until I restored a backup from the Microsoft store version.

[Zubersoft]

You can try going to Settings->Other Settings->Reset Settings to Default then to clear out any of the settings and see if that resolves the issue. 

Mike

[mwiseman]

You can try going to Settings->Other Settings->Reset Settings to Default then to clear out any of the settings and see if that resolves the issue. 

This worked and the camera is selected and does recognize facial gestures. Thank you.

However, I have lost all of my settings. I guess, this gives me the opportunity to review all my other settings as I reconstruct them.

[Zubersoft]

You can optionally restore the backup, then just delete the settings file associated with the face gesture feature to see if that fixes the problem (C:\Users\<your username>\AppData\Local\Packages\41730Zubersoft.MobileSheets_ys1c8ct2g6ypr\LocalState\face_gesture.xml). Or you can rebuild all the settings if that isn't a big deal for you.

Mike