| DOI | Resolve DOI: https://doi.org/10.1109/BigData62323.2024.10825084 |
|---|
| Author | Search for: Shabanijou, Mohammadmasoud; Search for: Sharma, Vidit; Search for: Ray, Suprio; Search for: Lu, Rongxing; Search for: Xiong, Pulei1ORCID identifier: https://orcid.org/0000-0002-3460-6946 |
|---|
| Affiliation | - National Research Council of Canada. Digital Technologies
|
|---|
| Funder | Search for: National Research Council Canada |
|---|
| Format | Text, Article |
|---|
| Conference | 2024 IEEE International Conference on Big Data (BigData), December 15 - 18, 2024, Washington, DC, United States |
|---|
| Subject | three-dimensional displays; extended reality; smart cities; metaverse; large language models; natural languages; prototypes; spatial databases; cognition; digital twins |
|---|
| Abstract | With the technological advances in creation and capture of 3D spatial data, new emerging applications are being developed. Digital Twins, metaverse and extended reality (XR) based immersive environments can be enriched by leveraging geocoded 3D spatial data. Unlike 2D spatial queries, queries involving 3D immersive environments need to take the query user’s viewpoint into account. Spatio-visual queries return objects that are visible from the user’s perspective.In this paper, we propose enhancing 3D spatio-visual queries with large language models (LLM). These kinds of queries allow a user to interact with the visible objects using a natural language interface. We have implemented a proof-of-concept prototype and conducted preliminary evaluation. Our results demonstrate the potential of truly interactive immersive environments. |
|---|
| Publication date | 2024-12-15 |
|---|
| Publisher | IEEE |
|---|
| In | |
|---|
| Language | English |
|---|
| Peer reviewed | Yes |
|---|
| Export citation | Export as RIS |
|---|
| Report a correction | Report a correction (opens in a new tab) |
|---|
| Record identifier | 8135c5d8-bd54-41f6-92f5-516e00dca8f0 |
|---|
| Record created | 2025-02-25 |
|---|
| Record modified | 2025-11-03 |
|---|
