Spatial computing

리더 인터뷰 ① : 공간에도 지능이 생긴다면

We introduce VSI-Bench, a novel benchmark of over 5,000 video-based visual-spatial intelligence questions, to evaluate and probe MLLMs, which revealed that their emerging spatial reasoning and local world modeling capabilities remain subhuman but promising.

Niantic's Scaniverse now has a WebXR app that lets you view user-created Gaussian splats, including your own, in your Quest 3's web browser.

This paper aims to address the challenge of reconstructing long volumetric videos from multi-view RGB videos.

At Niantic, we are pioneering the concept of a Large Geospatial Model that will use large-scale machine learning to understand a scene and connect it to millions of other scenes globally.

VR(가상현실) 및 생성형 AI(인공지능) 솔루션 전문기업 한국가상현실(대표 장호현)이 전국 아파트의 98%를 아우르는 15만개의 3D VR 평형 데이터를 확보했다고 12일 밝혔다. 한국가상현실 관계자는 "최근 3D VR 아파트 평형 데이터 규모를 15만3000개로 확장했다"며 "단지 2만677개, 동 14만658개를 포함하는 ...

Hiking for BLIND people was IMPOSSIBLE without human guidance. UNTIL NOW. With the .lumen glasses, hiking is just one of the many experiences now possible for the blind. What once required a human companion can now be done independently.

Varjo, the high-end XR headset creator, today announced the release of a new smartphone-based 3D scanning service for enterprise that promises to let users quickly build photorealistic environments and explore them in both VR and on traditional screens. Called Teleport, the paid app allows users to capture and recreate real-world locations, something the Finland-based company […]

Gracia's moving volumetric scenes, dynamic gaussian splats, are now available on Quest 3 and Pico 4 headsets standalone.

Niantic Spatial Platform helps companies build immersive experiences that redefine how humans and businesses connect.

Explore in this review the future of virtual experiences with Gracia's moving volumetric scenes. Step into a world of immersive storytelling.

Announcing a new file format that shrinks the filesize of splats by 90% with virtually no perceptible quality loss.

Canon today announced a more affordable lens option designed for social media creators and videographers interested in VR and 3D content creation. Back in June, Canon announced its RF-S3.9mm F3.5 STM Dual Fisheye lens, which was designed to allow its line of cameras to take spatial video and photos—priced at $1,099.00. Now the company is widening […]

삼성전자가 증강현실(AR) 경험을 다른 사람과 공유할 수 있는 AR 글래스 특허를 출원했다고 IT매체 샘모바일이 28일(현지시간) 보도했다.보도에 따르면, 삼성전자는 ‘복수의 AR 글래스를 그룹화 하기 위한 방법 및 시스템’이라는 제목의 특허를 지난 24일 미국 특허청에 등록했다. 해당 특...

Meta's impressive Hyperscape demo is now available outside the US. We tried it from Europe.

M. Doga Dogan, Student Researcher, and David Kim, Perceptive Experiences Lead, Google Augmented Reality

Reality Labs Research is releasing the Digital Twin Catalog (DTC), which we believe is the world’s largest and highest quality 3D object model dataset for 3D reconstruction research.

Onstage during its Connect 2024 developer conference, Meta showed Hyperscape, a feature that lets users scan real-life spaces and explore them in VR.

Using our methods SuGaR (CVPR 2024) or Gaussian Frosting (ECCV 2024), you can reconstruct editable meshes from RGB images or RGB videos, and render them using realistic Gaussian Splatting rendering. We now provide a Blender Add-On to edit, sculpt, combine or animate 3D scenes reconstructed with SuGaR of Frosting and render them with Gaussian Splatting without a single line of code. Please take a look at the following pages for downloading the code and get more information about the add-on: SuGaR webpage: https://anttwo.github.io/sugar/ Gaussian Frosting webpage: https://anttwo.github.io/frosting/ Blender Add-On GitHub page: https://github.com/Anttwo/sugar_frosting_blender_addon Thank you!

Apple announced its new iPhone 16 is getting a little more spatial with the addition of both spatial photos and audio, essentially putting it in line with Vision Pro’s capture capabilities. The company’s big event on Monday didn’t bring any giant revelations for Vision Pro, although the company announced a host of products, including its AI-infused iPhone 16 line, as […]

Mixed Reality Motifs are blueprints that can help you to implement common mechanics like conditional and contextual passthrough, and switch between fully immersive and Mixed Reality modes. Learn more about Passthrough and how to get started.

Last year, Pixar, Adobe, Apple, Autodesk, and NVIDIA announced the Alliance for OpenUSD, an organization to advance and proliferate the USD file format as the future standard for creating and distributing 3D content. The standard, which is a framework for constructing and packaging complex 3D scenes, was called the “HTML of the metaverse” by NVIDIA, […]

SIGGRAPH—NVIDIA today announced major advancements to Universal Scene Description, or OpenUSD, that will expand adoption of the universal 3D data interchange framework to robotics, industrial design and engineering, and accelerate developers’ abilities to build highly accurate virtual worlds for the next evolution of AI.

산업용 디지털트윈 전문기업 와이엠엑스(대표 박태욱) 컨소시엄이 '디지털트윈 기반 공공시설물 안전 실증 사업'을 수주했다. 실증 대상은 연간 100만 명 이상 이용하는 정부세종청사체육관으로 혁신 기술을 활용한 공공시설물 안전 강화가 기대된다. 와이...

Visualize your home like never before with Layout, powered by mixed reality on Meta Quest 3. Layout features a suite of tools designed to help you spatially measure, align and visualize real world objects directly in your physical space.

Quest 3's mixed reality dynamic occlusion is now higher quality, uses less CPU and GPU, and is slightly easier for developers to integrate.

Developers can now build Quest 3 mixed reality experiences that span across multiple rooms.

메타버스 플랫폼 전문 맥스트(대표 박재완)는 신규 서비스 ‘와이더스(Widearth)’를 출시, 누구나 쉽고 빠르게 디지털 트윈을 제작할 수 있도록 지원한다고 15일 밝혔다.와이더스는 디지털 트윈을 간단하게 제작할 수 있는 서비스로 공간 맵 생성, 관리 및 커스터마이징 등을 지원한다. 사용자들은 워크스페이스를 개설해 공간 맵을 생성, 관리 및 편집할 수 있고 콘텐츠를 저작할 수도 있다.완성 공간은 콘텐츠 뷰어로 확인할 수 있다. 특정 앱이나 플랫폼을 통하지 않고 URL을 통한 공유가 가능하다. 톱, 미니어처, 1인칭 뷰와 같이 다양

The 2D to 3D photo conversion feature coming to Vision Pro in VisionOS 2.0 makes a novel capability meaningful for the first time. Cue “Apple didn’t even do it first!” in the comments. You’re not wrong. There’s been seemingly a hundred different startups over the years that have promised to turn 2D photos into 3D. […]

Varjo Teleport lets you easily capture any scene with an iPhone and move around it in PC VR with photorealistic graphics.

[스포츠한국 조민욱 기자] 나이언틱은 현재와 미래의 혼합 현실을 위한 차세대 지도 구축을 위해 새로운 웹 기반 비주얼 플랫폼인 ‘나이언틱 스튜디오’를 공개했다고 20일 밝혔다.나이언틱 스튜디오는 개발자와 콘텐츠 제작자가 대부분의 장치에서 웹의 편의성을 활용해 몰입형 XR 경험을 신속하게 구축할 수 있는 플랫폼이다. 지난 18일 캘리포니아에서 열린 ‘Augmented World Expo 2024’에서 처음 공개했다.나이언틱 스튜디오는 모든 도구와 기능을 한 번만 클릭하면 포괄적인 3D 작업 공간에서 간소화된 워크플로우를 만들 수 있다

Transform your 3D architectural model to XR in just one-click. Enjoy fast, hassle-free XR transformations from your .fbx files with Space AI.

visionOS 2 adds the ability to track and augment 3D objects that app developers prespecify.

Capture your world like never before with the SpatialLabs Eyes Stereo Camera. Powered by advanced sensor technology and designed to bring every detail to life in stunning 3D. Prepare to elevate your photography and videography to the next dimension. 📸🌟🚀 Learn More: https://www.acer.com/us-en/accessories/cameras/acer-spatiallabs-eyes #Acer #SpatialLabs #3DStereoCamera Stay connected: Facebook: https://www.facebook.com/Acer/ Instagram: https://www.instagram.com/acer/ Twitter: https://twitter.com/acer LinkedIn: https://www.linkedin.com/company/acer

“한국, 부동산 시장 크지만 아직 맨파워에 의존 경향” “VR·AR 등 활용한 ‘디지털 트윈’, 갈수록 강력해질 것” “우리 기술은 ‘디지털 트윈(현실세계의 기계나 장비, 사물 등을 컴퓨터 속 가상세계에 구현한 것)

At Microsoft’s Build developer conference the company announced it was bringing Windows Volumetric apps to Quest, which Microsoft calls a way to “extend Windows apps into 3D space.” Pavan Davuluri, head of Windows and Devices at Microsoft, announced on stage at Build the company was “deepening [its] partnership with Meta to make Windows a first class […]

Google today announced it’s starting a pilot program that will soon allow select partners to create AR content and display it within Google Maps. While it seems like an important step for Google on the way to owning a piece of the ‘all-day AR glasses’ future, it’s unclear just where it’s all headed for the […]

Layout is a useful mixed reality application from Meta that helps with visualization and measurement. I have tried it out.

Meta's latest AI research makes headsets and glasses understand your room layout and furniture.

A project from researchers at Reality Labs, Meta’s XR division, shows a method for interacting with the real-world through augmented reality. I’m about as seasoned as they get when it comes to the XR space. I see research papers all the time that are interesting but ultimately one more step along a predictable path. It’s […]

The upcoming Quest 3 update will include something called augments and until this recent leak we only got as small glimpse but its clear it might be smoothing slightly more complex than expected. Meta spark seems to be the new development kit and in this quick showcase we get to see how this new desktop programme functions when it comes to quest 3 augments. Free Meta Credit with your new Quest here 👇👇 https://www.meta.com/referrals/link/VChap #quest3 #vr #vrnews #meta

Ray-Ban and Meta’s second-generation smartglasses are slated to get a lot smarter starting this week, as the company launched an opt-in beta in the US that will hook in the device’s camera into AI-powered object recognition, powered in part by Microsoft’s Bing. Ray-Ban Meta Glasses were released in October shortly after the company launched its […]

XR Today reports on the latest extended reality news from around the globe, including virtual reality, augmented reality and mixed reality.

Today, we're reviewing Unity's visionOS PolySpatial tools, including creating a fully immersive VR experience, a shared space MR experience, and a full MR experience. 📌 My experience with native visionOS vs Unity visionOS development available here: https://blog.learnxr.io/xr-development/unity-visionos-polyspatial-tools-are-here We'll also explore a demo I created by using a bounded volume camera for mixed reality, as well as a variety of demos created by Unity. 📢 Be sure to go over the visionOS requirements and Unity licensing requirements in this video before you start with visionOS in Unity. 📚 Unity VisionOS PolySpatial Video Chapters: 00:00 - 00:51 - Unity visionOS PolySpatial Tools Video Overview 00:51 - 03:08 - Unity visionOS PolySpatial Demos (Bounded Volume Camera Demos) 03:09 - 05:23 - Unity visionOS Platform Requirements 05:23 - 07:52 - Unity Licensing Requirements for visionOS Platform 07:52 - 12:54 - Creating Your First VisionOS Full Immersive VR Experience With Unity 12:54 - 13:25 - Installing visionOS PolySpatial Packages 13:25 - 23:56 - Creating A PolySpatial Experience For MR Apps (Bounded Volume Camera Versus Unbounded Volume Camera Is Covered In This Section) 23:56 - 29:25 - Testing visionOS Experiences In Unity With XR Simulated Environments & XR Device Simulator 💻 GitHub repo to help you get started available here: https://github.com/dilmerv/HelloVisionOS 📙 Unity VisionOS & PolySpatial Resources: - Unity VisionOS Platform Overview: https://docs.unity3d.com/Packages/com.unity.polyspatial.visionos@0.6/manual/visionOSPlatformOverview.html - Supported vs Unsupported Components: https://docs.unity3d.com/Packages/com.unity.polyspatial.visionos@0.6/manual/SupportedFeatures.html - FAQ (For Common VisionOS PolySpatial Issues): https://docs.unity3d.com/Packages/com.unity.polyspatial.visionos@0.5/manual/FAQ.html#q-skinned-meshes-are-not-animating 📣 Get the Character Controller visionOS demo from Patreon: (Thank you) https://www.patreon.com/dilmerv and GET MY “Full Source Code” Tier 📌 Support me by Subscribing to avoid missing future videos! https://www.youtube.com/@dilmerv 💡 What do you get from Patreon ? 👉 Access to this video GitHub repo + all code I work on for each video 👉 Access to special Patreon discord group where I can answer questions 📌 Get XR & game development tips from me in Twitter https://www.twitter.com/dilmerv 🥽 Learn & Get my XR Training from: https://www.learnxr.io 👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news) https://blog.learnxr.io #unity #visionos #apple #xr

Welcome to Unity’s visionOS beta community on Unity Discussions. We’re thrilled to invite you to learn more about Unity’s tools for visionOS. You can use the visionOS beta category to share feedback, ask for help, and have discussions about Unity’s support for Apple’s visionOS platform. We plan to communicate almost entirely through the Discussions platform category, so please set your alerts to be notified. In this beta, we’re excited to bring you familiar workflows and powerful authoring t...

Create spatial experiences for Apple’s visionOS with Unity. Apply for the beta now.

라이다(LiDAR) 전문 뷰런테크놀로지(대표 김재광)는 '스마트 크라우드 애널리틱스(SCA)' 솔루션 기술력을 인정받아 CES 2024 혁신상 수상 기업에 선정됐다고 16일 밝혔다.뷰런이 개발한 라이다 기반의 스마트시티 솔루션 SCA를 세계 최초로 서울시가 도입한 사례와 그 혁신성을 인정받아 스마트시티 부문에서 수상했다고 설명했다.뷰런의 SCA는 지난해 이태원 참사 이후 사고 예방 차원에서 개발됐다. 사고 위험이 급격히 높아지는 1㎡ 내 6명 이상의 검출이 가능한 기술력을 바탕으로, 서울 종로구에서 실증을 거쳐 실제 현장에 적용됐다

**The Oculus subreddit, a place for Oculus fans to discuss VR.**

Here's a closer look at some of the top examples of how spatial computing is being used today.