Building an Interactive Virtual Human in Vision Pro (Software Project)

This is a personal test project of mine, with the goal of creating an interactive virtual human on Apple’s Vision Pro. (A friend of mine, an iOS developer @Forest, also participated in this project.)
The project uses Unity to build an unbounded Vision Pro application — a fully interactive virtual human that demonstrates Unity’s power and flexibility on the Vision Pro platform, and explores the possibilities for next-generation virtual human interaction.

召唤虚拟人出现
Summoning the virtual human
跟随、寻路及避障
Following, pathfinding, and obstacle avoidance
实时反馈外界物理变化
Real-time response to physical changes in the environment

It supports the following features:

  • Basic gesture interactions — the virtual human responds with corresponding reactions.
  • The virtual human can follow the user anywhere while staying within their field of view.
  • The virtual human perceives environmental changes and autonomously finds a surface to sit on.
  • It tracks the user’s gaze direction and reacts accordingly.
  • Persistent Vision Pro app environment — when the user leaves, the virtual human continues to exist without interfering with other VP applications.
  • And more.