Chalktalk VR/AR

  • Ken Perlin
  • Zhenyi He
  • Fengyuan Zhu


When people want to brainstorm ideas, currently they often draw their ideas on paper or on a whiteboard.  But the result of those drawings is a static visual representation.  Alternately, people often use various tools to prepare animations and simulations to express their ideas.  But those animations and simulations must be created beforehand, and therefore cannot be easily modified dynamically in the course of the brainstorming process. Chalktalk VR/AR is a paradigm for creating drawings in the context of a face to face brainstorming session that is happening with the support of VR or AR.  Participants draw their ideas in the form of simple sketched simulation elements, which can appear to be floating in the air between participants.  Those elements are then recognized by a simple AI recognition system, and can be interactively incorporated by participants into an emerging simulation that builds more complex simulations by linking together these simulation elements in the course of the discussion.


Download data is not yet available.


[1] K. Perlin, "The coming age of computer graphics and the evolution of language," in Proceedings of the 2nd ACM symposium on SUI, 2014.

[2] K. Perlin, "Future Reality: How emerging technologies will change language itself}," in IEEE computer graphics and applications, 2016.

[3] W. R. Sutherland, "The on-line graphical specification of computer procedures," 1966.
How to Cite
PERLIN, Ken; HE, Zhenyi; ZHU, Fengyuan. Chalktalk VR/AR. International SERIES on Information Systems and Management in Creative eMedia (CreMedia), [S.l.], n. 2017/2, p. 30-31, jan. 2018. ISSN 2341-5576. Available at: <>. Date accessed: 27 feb. 2024.
Share |