AR+ Mode and 3D Object Collaboration

AR+ Mode Collaboration

AR+ mode in VSight Remote is an augmented reality feature that allows users to place 3D annotations in a live stream. These annotations stay fixed in place, even if the user moves or changes perspective. This feature enhances remote support by providing hands-free guidance with precise visual instructions.

✅ Persistent 3D Annotations – Place 3D annotations that stay fixed despite movement or perspective changes.

✅ Surface Scanning – Mobile users scan surfaces until a virtual grid appears (blue for iOS, white dots for Android).

✅ 2D & 3D Markups – Add freehand drawings, text, and 3D arrows for enhanced guidance.

✅ Move & Lock Annotations – Adjust, resize, or lock annotations in place to prevent modifications.

✅ Undo, Redo & Delete – Modify or remove annotations with the undo/redo buttons or trash icon.

✅ Snapshots with Annotations – Capture annotated views for documentation and later reference.

📌 Important: AR+ mode is available only on mobile devices that support ARkit and have VSight Remote App installed. 

How to Use AR+ Mode

1️⃣ Activate AR+ Mode – Enable AR+ mode and start surface scanning on a mobile device. 

2️⃣ Pen Color and Width – Choose color and width for your freehand drawing. 

3️⃣ Freehand Drawing – Use the pen tool to create 2D freehand annotations. 

4️⃣ 3D Arrows – Place directional 3D arrows.

5️⃣ Text Annotations – Add free text by typing in the 'Add text' field, clicking the + symbol, and placing the text on the grid.

6️⃣ Scaling & Moving– Use the scale icon to move, resize, or delete 3D annotations.

7️⃣ Lock Annotations – Secure annotations in place with the lock icon to prevent accidental modifications.

8️⃣ Undo/Redo Actions – Use the arrow keys to revert or restore recent annotation changes.

9️⃣ Delete Annotations – Click the trash icon to remove all placed annotations at once.

🔟 Save Snapshots – Capture the annotated live view for documentation and reference.

✅ Tip: For accurate usage of 3D annotations:

•  Scan the environment slowly;
• Scan as much area surface as possible;
• Make sure to have a good lighting.

📌 Important: Object manipulation and ruler is currently supported only on iOS devices.

View from iOS Device

View from Web App

View from Android Device

3D Object Collaboration in AR+ Mode

3D Object Collaboration enables users to upload, place, and interact with 3D models in a live session. This functionality allows for real-time adjustments, accurate scaling, and object locking, ensuring a detailed and interactive collaboration experience in remote assistance scenarios.

✅ Supported 3D File Formats:

• iOS (ARKit): .obj, .gltf, .glb, .dae, .scn

• Android (ARCore): .gltf, .glb 

How to use 3D Object Collaboration

1️⃣ Enable AR+ – Upload file(s) to the chat and enable AR+

2️⃣ Select a 3D Object – Click the upload icon and choose a file from the drop-down menu and click on the desired location in the live stream to position the 3D object.

3️⃣ Scale & Move Object – Use the scale button to resize, reposition, or delete the object.

4️⃣ Lock Object – Click the lock icon to secure the object in place and prevent modifications by other users.

AR+ Mode for Smart Glasses

The AR+ mode enables smart glasses users to place 3D arrows in their live stream. These annotations stay fixed in place, even if the user moves or changes their perspective. To ensure maximum accuracy, users must scan the entire surface where annotations will be placed.

✅ Surface Scanning – Move the smart glasses camera to properly scan the entire surface. The scanning process is successful once a virtual grid appears.

✅ Full Surface Coverage – For best results, scan the entire area upfront instead of scanning in parts to avoid annotation displacement.

✅ Placing 3D Arrows – Define the arrow direction from the drop-down menu and click on the designated position on the screen to place the arrow.

✅ Audio Controls – Use the speaker icon to mute incoming audio and the microphone icon to mute your own audio stream.

✅ Exit AR+ Mode – Click the red “X” in the upper right corner to close AR+ collaboration.

✅ Tip: A detailed scan increases annotation accuracy and ensures precise placement.

📌 Need More Help? – See further information at VSight Help Center or contact support for assistance.