ARBI

AR Backend Interface

Client

• Recognize AR frames
• Send image of content of AR frame to backend, along with AR frame geometry
• Get app from backend, and reference AR for app
• Run app in AR frame
  • Handles occlusion masking

Backend

• Get AR frame and frame image from client
• Lookup frame image vs reference images for known app
• Return app and reference image for app

App

• Gets AR frame geometry
• Renders sound and imagery