LOGIN TO YOUR ACCOUNT

Username
Password
Remember Me
Or use your Academic/Social account:

CREATE AN ACCOUNT

Or use your Academic/Social account:

Congratulations!

You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.

Important!

Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message

CREATE AN ACCOUNT

Name:
Username:
Password:
Verify Password:
E-mail:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Publisher: HAL CCSD
Languages: English
Types: Conference object
Subjects: Viewpoint computation, [INFO.INFO-MM] Computer Science [cs]/Multimedia [cs.MM], [INFO.INFO-GR] Computer Science [cs]/Graphics [cs.GR], [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], Virtual camera control, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], ACM, Film Editing, Cinematography, Virtual Camera Planning
International audience; Developers of interactive 3D applications, such as computer games, are expending increasing levels of effort on the challenge of creating more narrative experiences in virtual worlds. As a result, there is a pressing requirement to automate an essential component of a narrative – the cinematography – and develop camera control techniques that can be utilized within the context of interactive environments in which actions are not known in advance. Such camera control algorithms should be capable of enforcing both low-level geometric constraints, such as the visibility of key subjects, and more elaborate properties related to cinematic conventions such as characteristic viewpoints and continuity editing. In this paper, we present a fully automated real-time cinematography system that constructs a movie from a sequence of low-level narrative elements (events, key subjects actions and key subject motions). Our system computes appropriate viewpoints on these narrative elements, plans paths between viewpoints and performs cuts following cinematic conventions. Additionally, it offers an expressive framework which delivers notable variations in directorial style. Our process relies on a viewpoint space partitioning technique in 2D that identifies characteristic viewpoints of relevant actions for which we compute the partial and full visibility. These partitions, to which we refer as Director Volumes, provide a full characterization over the space of viewpoints. We build upon this spatial characterization to select the most appropriate director volumes, reason over the volumes to perform appropriate camera cuts and rely on traditional path-planning techniques to perform transitions. Our system represents a novel and expressive approach to cinematic camera control which stands in contrast to existing techniques that are mostly procedural, only concentrate on isolated aspects (visibility, transitions, editing, framing) or do not encounter for variations in directorial style.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • [AK01] AMERSON D., KIME S.: Real-time Cinematic Camera Control for Interactive Narratives. In The Wotking Notes of the AAAI Spring Symposium on Artificial Intelligence and Interactive Entertainment (Stanford, CA, 2001).
    • [Ari76] ARIJON D.: Grammar of the Film Language. Hastings House Publishers, 1976.
    • [AWD10] ASSA J., WOLF L., DANIEL C.-O.: The Virtual Director: a Correlation-Based Online Viewing of Human Motion. In Proceedings of the Eurographics Conference (2010).
    • [Bec02] BECKHAUS S.: Dynamic Potential Fields for Guided Exploration in Virtual Environments. PhD thesis, Fakultät für Informatik, University of Magdeburg, 2002.
    • [BL97] BARES W. H., LESTER J. C.: Cinematographic user models for automated realtime camera control in dynamic 3D environments. In Proceedings of the sixth International Conference on User Modeling (Vien New York, 1997), Springer-Verlag.
    • [BMBT00] BARES W., MCDERMOTT S., BOUDREAUX C., THAINIMIT S.: Virtual 3D camera composition from frame constraints. In Proceedings of the ACM international conference on Multimedia (MULTIMEDIA '00) (2000), ACM Press.
    • [CAwH∗96] CHRISTIANSON D. B., ANDERSON S. E., WEI HE L., SALESIN D. H., WELD D. S., COHEN M. F.: Declarative Camera Control for Automatic Cinematography. In Proceedings of the 13th National Conference on Artificial Intelligence and the 8th Innovative Applications of Artificial Intelligence Conference (1996), AAAI Press / MIT Press.
    • [CM01] COURTY N., MARCHAND E.: Computer animation: A new application for image-based visual servoing. In Proceedings of International Conference on Robotics and Automation (2001).
    • [CN05] CHRISTIE M., NORMAND J.-M.: A semantic space partitioning approach to virtual camera control. In Proceedings of the Eurographics Conference (2005), vol. 24, Computer Graphics Forum.
    • [COCSD00] COHEN-OR D., CHRYSANTHOU Y., SILVA C., DURAND F.: A survey of visibility techniques for walkthrough applications. Transations on Visualization and Computer Graphics (2000).
    • [CON08] CHRISTIE M., OLIVIER P., NORMAND J.-M.: Camera control in computer graphics. Computer Graphics Forum 27, 8 (2008).
    • [ER07] ELSON D. K., RIEDL M. O.: A lightweight intelligent virtual cinematography system for machinima production. In Proceedings of the 3rd Conf. on AI for Interactive Entertainment (2007).
    • [FF04] FRIEDMAN D. A., FELDMAN Y. A.: Knowledge-Based Cinematography and Its Applications. In Proceedings of the 16th European Conference on Artificial Intelligence (2004).
    • [HCS96] HE L., COHEN M. F., SALESIN D. H.: The virtual cinematographer: A paradigm for automatic real-time camera control and directing. In Proceedings of SIGGRAPH (Aug. 1996), ACM Computer Graphics.
    • [HHS01] HALPER N., HELBING R., STROTHOTTE T.: A camera engine for computer games: Managing the trade-off between constraint satisfaction and frame coherence. In Proceedings of the Eurographics Conference (2001), vol. 20, Computer Graphics Forum.
    • [Jha09] JHALA A.: Cinematic Discourse Generation. PhD thesis, Faculty of North Carolina State University, 2009.
    • [Lam09] LAMARCHE F.: Topoplan: a topological path planner for real time human navigation under floor and ceiling constraints. Computer Graphics Forum 28, 2 (2009).
    • [LC08] LI T.-Y., CHENG C.-C.: Real-time camera planning for navigation in virtual environments. In SG '08: Proceedings of the 9th international symposium on Smart Graphics (2008), Springer-Verlag.
    • [NO03] NIEUWENHUISEN D., OVERMARS M. H.: Motion Planning for Camera Movements in Virtual Environments. Tech. Rep. UU-CS-2003-004, Institute of Information and Computing Sciences, Utrecht University, 2003.
    • [OSTG09] OSKAM T., SUMNER R. W., THUEREY N., GROSS M.: Visibility transition planning for dynamic camera control. In Proceedings of Symposium on Computer animation (SCA) (2009).
    • [TS91] TELLER S. J., SÉQUIN C. H.: Visibility preprocessing for interactive walkthroughs. In SIGGRAPH '91: Proceedings of the 18th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1991), ACM.
    • [VFSH03] VÀZQUEZ P.-P., FEIXAS M., SBERT M., HEIDRICH W.: Automatic view selection using viewpoint entropy and its application to image-based modelling. Computer Graphics Forum 22, 4 (2003).
    • [You07] YOUNG R. M.: Story and discourse: A bipartite model of narrative generation in virtual worlds. Interaction Studies 8, 2 (2007).
    • [AK01] AMERSON D., KIME S.: Real-time Cinematic Camera Control for Interactive Narratives. In The Wotking Notes of the AAAI Spring Symposium on Artificial Intelligence and Interactive Entertainment (Stanford, CA, 2001).
    • [Ari76] ARIJON D.: Grammar of the Film Language. Hastings House Publishers, 1976.
    • [AWD10] ASSA J., WOLF L., DANIEL C.-O.: The Virtual Director: a Correlation-Based Online Viewing of Human Motion. In Proceedings of the Eurographics Conference (2010).
    • [Bec02] BECKHAUS S.: Dynamic Potential Fields for Guided Exploration in Virtual Environments. PhD thesis, Fakultät für Informatik, University of Magdeburg, 2002.
    • [BL97] BARES W. H., LESTER J. C.: Cinematographic user models for automated realtime camera control in dynamic 3D environments. In Proceedings of the sixth International Conference on User Modeling (Vien New York, 1997), Springer-Verlag.
    • [BMBT00] BARES W., MCDERMOTT S., BOUDREAUX C., THAINIMIT S.: Virtual 3D camera composition from frame constraints. In Proceedings of the ACM international conference on Multimedia (MULTIMEDIA '00) (2000), ACM Press.
    • [CAwH∗96] CHRISTIANSON D. B., ANDERSON S. E., WEI HE L., SALESIN D. H., WELD D. S., COHEN M. F.: Declarative Camera Control for Automatic Cinematography. In Proceedings of the 13th National Conference on Artificial Intelligence and the 8th Innovative Applications of Artificial Intelligence Conference (1996), AAAI Press / MIT Press.
    • [CM01] COURTY N., MARCHAND E.: Computer animation: A new application for image-based visual servoing. In Proceedings of International Conference on Robotics and Automation (2001).
    • [CN05] CHRISTIE M., NORMAND J.-M.: A semantic space partitioning approach to virtual camera control. In Proceedings of the Eurographics Conference (2005), vol. 24, Computer Graphics Forum.
    • [COCSD00] COHEN-OR D., CHRYSANTHOU Y., SILVA C., DURAND F.: A survey of visibility techniques for walkthrough applications. Transations on Visualization and Computer Graphics (2000).
    • [CON08] CHRISTIE M., OLIVIER P., NORMAND J.-M.: Camera control in computer graphics. Computer Graphics Forum 27, 8 (2008).
    • [ER07] ELSON D. K., RIEDL M. O.: A lightweight intelligent virtual cinematography system for machinima production. In Proceedings of the 3rd Conf. on AI for Interactive Entertainment (2007).
    • [FF04] FRIEDMAN D. A., FELDMAN Y. A.: Knowledge-Based Cinematography and Its Applications. In Proceedings of the 16th European Conference on Artificial Intelligence (2004).
    • [HCS96] HE L., COHEN M. F., SALESIN D. H.: The virtual cinematographer: A paradigm for automatic real-time camera control and directing. In Proceedings of SIGGRAPH (Aug. 1996), ACM Computer Graphics.
    • [HHS01] HALPER N., HELBING R., STROTHOTTE T.: A camera engine for computer games: Managing the trade-off between constraint satisfaction and frame coherence. In Proceedings of the Eurographics Conference (2001), vol. 20, Computer Graphics Forum.
    • [Jha09] JHALA A.: Cinematic Discourse Generation. PhD thesis, Faculty of North Carolina State University, 2009.
    • [Lam09] LAMARCHE F.: Topoplan: a topological path planner for real time human navigation under floor and ceiling constraints. Computer Graphics Forum 28, 2 (2009).
    • [LC08] LI T.-Y., CHENG C.-C.: Real-time camera planning for navigation in virtual environments. In SG '08: Proceedings of the 9th international symposium on Smart Graphics (2008), Springer-Verlag.
    • [NO03] NIEUWENHUISEN D., OVERMARS M. H.: Motion Planning for Camera Movements in Virtual Environments. Tech. Rep. UU-CS-2003-004, Institute of Information and Computing Sciences, Utrecht University, 2003.
    • [OSTG09] OSKAM T., SUMNER R. W., THUEREY N., GROSS M.: Visibility transition planning for dynamic camera control. In Proceedings of Symposium on Computer animation (SCA) (2009).
    • [TS91] TELLER S. J., SÉQUIN C. H.: Visibility preprocessing for interactive walkthroughs. In SIGGRAPH '91: Proceedings of the 18th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1991), ACM.
    • [VFSH03] VÀZQUEZ P.-P., FEIXAS M., SBERT M., HEIDRICH W.: Automatic view selection using viewpoint entropy and its application to image-based modelling. Computer Graphics Forum 22, 4 (2003).
    • [You07] YOUNG R. M.: Story and discourse: A bipartite model of narrative generation in virtual worlds. Interaction Studies 8, 2 (2007).
  • No related research data.
  • No similar publications.

Share - Bookmark

Funded by projects

  • EC | IRIS

Cite this article