Room reset button

We've had fun playing with @Apple's new #RoomPlan API @Shopify

What if your room had a reset button? ✨ pic.twitter.com/H50aROpne7

— Russ Maschmeyer (@StrangeNative) July 6, 2022

AR makes it easy to try new couches, but the couch already in your space can get in the way. What if every room had a reset button? Space Eraser models spaces in high-fidelity—capturing room-defining objects, their size, position, orientation… [2/12] pic.twitter.com/JeXDFqd2W5

— Russ Maschmeyer (@StrangeNative) July 13, 2022

With an empty room, shoppers can now swipe through room sets which leverage the orientation of existing furniture to arrange themselves automatically… [4/12] pic.twitter.com/zv201bsWm4

— Russ Maschmeyer (@StrangeNative) July 13, 2022

To determine if this would be possible today we explored two questions: how do we align the model produced by #RoomPlan with your room and how do we texture the model? [6/12] pic.twitter.com/8YTbC9SU8R

— Russ Maschmeyer (@StrangeNative) July 13, 2022

Since RoomPlan exports untextured models, we explored ways we might texture it automatically. The best way would be to localize and map the texture when capturing, but we make do with an aligned model and a real-time camera feed. [8/12] pic.twitter.com/Bsyj6QnJ0j

— Russ Maschmeyer (@StrangeNative) July 13, 2022

This approach creates issues when furniture obscures a surface. In video above 👆, our couch obscured the wall. #RoomPlan provides bounding box references for room-defining objects. With this we can determine what parts of the texture to redact. [10/12] pic.twitter.com/gW7XgaIQXc

— Russ Maschmeyer (@StrangeNative) July 13, 2022

AR and #RoomPlan are exciting tools for commerce. The ability to select and remove real objects from a scene brings us one step closer to a fully editable reality. Speaking of… time to bring back the dog ✌️[12/12] pic.twitter.com/tYmyGp4hPn

— Russ Maschmeyer (@StrangeNative) July 13, 2022