#651: MediaStream Image Capture (wide review)

Visit on Github.

Opened Jun 22, 2021

Ya ya yawm TAG!

I'm requesting a TAG review of MediaStream Image Capture.

[One paragraph summary of idea, ideally copy-pasted from Explainer introduction]

Cameras on client platforms like mobile devices, tablets and laptops are increasingly adding advanced features. In many cases, users do use external cameras when the inbuilt cameras are not delivering the required experience, say on a video call. This specification exposes some of the advanced photography primitives in a standards compliant manner using media track constraints in MediaDevices.getUserMedia(). For manipulating video related capabilities, current settings and constraints are done via MediaStreamTrack.applyConstraints(). Photo-specific capabilities and current settings can be retrieved via getPhotoCapabilities()/getPhotoSettings() and configured via takePhoto()'s PhotoSettings argument. The produced image can be in the form of a Blob or as a ImageBitmap.

We'd prefer the TAG provide feedback as (please delete all but the desired option): GH issues

🐛 open issues in our GitHub repo for each point of feedback

Discussions

Discussed Jun 28, 2021 (See Github)

Reviewed briefly. Have some questions about PhotoSettings, posted to issue.

Comment by @plinss Jun 29, 2021 (See Github)

I'm wondering why the PhotoSettings passed to takePhoto only allow control over resolution and flash modes. Couldn't some of the other settings potentially be selected only for the photo without changing the underlying stream? e.g. exposure controls, white balance, etc

Discussed Sep 1, 2021 (See Github)

Peter: I asked some questions - no response... I will copy the feedback to their repo....

Sangwhan: interesting API.

[later on]

Rossen: I'm ok to close.

[closed]

Comment by @atanassov Sep 16, 2021 (See Github)

@plinss and I looked at this review again during our Gethen vf2f. We like use cases addressed by this proposed capability and the overall shape of the API. Apart from the one feedback that we cross-posted to your repo we are happy to close the review.

Thank you for working with TAG. We look forward to seeing further progress made with the WebRTC folks.