virtualité, interaction, design, & art

>... New Interfaces For 3D Modelling Joint Program

Collaboration between LIMSI-CNRS (University of Paris 11) and Laboratory of Telecommunications Software and Multimedia (Helsinki University of Technology)


This document presents the existing collaboration between the Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur (LIMSI-CNRS) in France and the Telecommunications Software and Multimedia Laboratory in Finland. We apply for a financial support from the INTUITION network of excellence to cover the travel and accommodation fees of the PhDs students’ exchange.


Joint research program:

The combination of several research works done separately in LIMSI-CNRS and the Telecommunications Software and Multimedia Laboratory points out an interesting collaboration between both laboratories.


  • LIMSI-CNRS

The development of multimodal interactions is increasing in the Virtual Reality (VR) and Augmented Reality (AR) fields. We (Rami AJAJ et al.) focus on multimodal visual input and output by combining a 3D view with a 2D view offered to multiple users. The first view we consider is a 2D view browsed on a collaborative tabletop device. The second view is a 3D (possibly stereoscopic) view projected on a wall screen used by only one user (possibly already using the tabletop view). We are interested in this setting because it provides two complementary views and it allows concurrent 2D and 3D interactions on geometrical objects. Our main interests are the test of various 3D input devices combined with 2D direct manipulation interactions and the development of new combined interaction techniques for a given task. The application domain we use is architecture and urbanism.

The aim of the collaboration between Rami AJAJ (from LIMSI-CNRS) and the Laboratory of Telecommunications Software and Multimedia is mainly on using tracking for 3D interactions (through a 3D view) combined with 2D interactions (2D view). Another interesting issue is the work on 3D audio combined with both (2D and 3D) views. Two purposes arise from this type of combination. The first is to compensate the lack of 3D visual feedback when an interaction is made through the other view. The second is to facilitate the users cognitive map reconstruction.


  • Laboratory of Telecommunications Software And Multimedia

We (Mikko Multimäki et al.) are currently working on HandsOn project which concetrates on using genuine 3D-environments and gestural interactions on the fields of polygon modeling and animation. The proposal of the combination of 3D and 2D views and interactions offer several good research points which coincide with HandsOn work.

The testing of different 3D input devices, especially the possibility of using gesture based input and comparing it to other input methods, is interesting as it is also a main research problem in HandsOn. The application domain, architecture and urbanism, offers some interaction technicues. Polygon modeling is probably hard to mix with it, but animation offers quite readily several possibilities for content on architectural objects, for example the animation of users of the building.

On the collaborative work with 2D and 3D interactions HandsOn has some possibilities, as the current research implementation is extending an existing 2D-interaction based modeling software so that it can be used in genuine 3D environment. The possibility of two users using different interaction methods on the same object could be implemented on the modeling software, and experimented to test the collaborative work possibilities.

The most interesting aspect might be the 3D interaction technicues testing on the manipulation of objects in virtual reality. The architectural environment in use is not only static objects, so implementing an animation tool for presenting the dynamic aspects may allow the making of more informative models.


Expected results:

  • Implementing a (simple) method of inserting animation into architectural models.
  • Building a scenario with dynamic content.
  • Testing the usability of different 3D input devices.
  • Implementing the concurrent 2D and 3D interfaces on existing software.
  • Combination of 3D tracking interactions through a 3D view and 2D interactions through a 2D view.
  • Testing the use of concurrent 2D and 3D interfaces in collaborative work on existing modeling software.
  • Possible combination with 3D audio.


Research schedule:

  • 18 February 2008 → 04 April 2008: Visit to the Laboratory of Telecommunications Software And Multimedia by Rami AJAJ.
  • 15 April 2008 → 15 May 2008: Visit to LIMSI-CNRS by Mikko MULTIMAKI.


Budget:


Fee Type Visitor Description Price
Travel Rami Ajaj Paris → Helsinki → Paris 250 €

Mikko Multimäki Helsinki → Paris → Helsinki 280 €
Accomodation Rami AJAJ 2 month accomodation 1200€

Mikko Multimäki 3-bedroom family house 1400€


APPENDIX


CV of Rami AJAJ

Rami AJAJ

Born the 23rd of September 1983

Address: 7 passage du chemin de fer

91400 Orsay FRANCE

Email: Rami.ajaj@limsi.fr

Tel: 0033-1-69858111


EDUCATION

2006 - 2009: PhD student in computer science at University Paris 11 and in LIMSI-CNRS lab (France)

2004 - 2006: Master in computer science at University Paris 11 (France)

2003 – 2004: Third year university diploma in computer science at University Paris 11 (France)

2001 – 2003: Two-year university diploma in Mathematics and computer science at University Paris 11 (France)

Before 2001: School and high-school in Lycée Franco-Libanais Tripoli (Lebanon)


RESEARCH WORK

Study of the different possible combinations of multimodal visual interactions performed through a 2D horizontal view projected on a tabletop device and a 3D stereoscopic view projected on a wall screen affecting the same virtual scene.


RECENT PUBLICATIONS

Ajaj, R., Jacquemin, C., and Vernier, F. (2007). User collaboration for 3D manipulation through multiple shared 2D and 3D views. In Proceedings, Virtual Reality International Conference VRIC'07, Laval, France.

Jacquemin, C., Ajaj, R., Cahen, R., Ollivier, Y., and Schwarz, D. (2007). Plumage: Design d'une interface 3D pour le parcours d'échantillons sonores granularisés. In Proceedings, Conférence Francophone sur l'Interaction Homme-Machine IHM'07, Paris, France.

Jacquemin, C., Planes, B., and Ajaj, R. (2007). Shadow casting for soft and engaging immersion in augmented virtuality artworks. In Proceedings, 9th ACM Multimedia 2007, Augsburg, Germany.


CV of Mikko Multimäki

Mikko Ilmari Multimäki

Ansatie 18 B 11

02940 Espoo

Finland

+358 40 5058473

mikko.multimaki@tkk.fi

date of birth 5. September 1975


Education


2007- PhD Student at Laboratory of Telecommunications Software And

Multimedia, Helsinki University of Technology

2002- Master's student in mathematics, University of Helsinki

1994-2006 Master of Computer Science, Helsinki University of Technology

1994 Graduated from Tapiola High school, Espoo


Work experience


2007- Researcher at Laboratory of Telecommunications Software And

Multimedia, Helsinki University of Technology

2003-2007 Software developer, later product manager, at Elma OYj, later

part of Itella OYj.

2003 Research assistant at SoberIt (The Software Business and

Engineering Laboratory), Helsinki University of Technology

1997-2002 Software development and computer support in various companies


Research


Genuine 3D-environments and gestural interactions, currently on the fields of

polygon modeling and animation.