Answering the question “What is Spatial AI?” with a 3D mindmap, outlining the connections between the wide range of topics that make up this emerging field. Fully editable by you via a GitHub-hosted public repository.
Another entrant in the backronym-of-the-year award, released in late 2023 is HaMeR: Hand Mesh Recovery, from the Universities of Berkeley, Michigan and New York.
Reconstructing hands is 3D space is an important component of our non-verbal communications. See above for the quintessential Italian experience.
This week, NVIDIA Research Labs unveiled WYSIWYG – What you See Is What You GAN – a model led by Alex Trevithick – an *intern* at the time.
The main focus on WYSIWYG is the ability to simultaneously generate super-resolution 2D RGB images AND massive polygon count/near-perfectly normalised 3D meshes.
New from researchers at Tsinghua University and Harvard University comes LangSplat – a method of integrating a natural language search capability over a segmented NeRF – some 200 times faster and orders of magnitude more accurate than its predecessor.
Streamable NeRFs (SMERFs) is/are the new concept of being able to reframe any user input or movement with a new high-fidelity Neural Radiance Field, on-the-fly.