Collaboration between LIMSI-CNRS (University of Paris 11) and Laboratory of Telecommunications Software and Multimedia (Helsinki University of Technology)
This document presents the existing collaboration between the Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur (LIMSI-CNRS) in France and the Telecommunications Software and Multimedia Laboratory in Finland. We apply for a financial support from the INTUITION network of excellence to cover the travel and accommodation fees of the PhDs students’ exchange.
Joint research program:
The combination of several research works done separately in LIMSI-CNRS and the Telecommunications Software and Multimedia Laboratory points out an interesting collaboration between both laboratories.
The development of multimodal interactions is increasing in the Virtual Reality (VR) and Augmented Reality (AR) fields. We (Rami AJAJ et al.) focus on multimodal visual input and output by combining a 3D view with a 2D view offered to multiple users. The first view we consider is a 2D view browsed on a collaborative tabletop device. The second view is a 3D (possibly stereoscopic) view projected on a wall screen used by only one user (possibly already using the tabletop view). We are interested in this setting because it provides two complementary views and it allows concurrent 2D and 3D interactions on geometrical objects. Our main interests are the test of various 3D input devices combined with 2D direct manipulation interactions and the development of new combined interaction techniques for a given task. The application domain we use is architecture and urbanism.
The aim of the collaboration between Rami AJAJ (from LIMSI-CNRS) and the Laboratory of Telecommunications Software and Multimedia is mainly on using tracking for 3D interactions (through a 3D view) combined with 2D interactions (2D view). Another interesting issue is the work on 3D audio combined with both (2D and 3D) views. Two purposes arise from this type of combination. The first is to compensate the lack of 3D visual feedback when an interaction is made through the other view. The second is to facilitate the users cognitive map reconstruction.
We (Mikko Multimäki et al.) are currently working on HandsOn project which concetrates on using genuine 3D-environments and gestural interactions on the fields of polygon modeling and animation. The proposal of the combination of 3D and 2D views and interactions offer several good research points which coincide with HandsOn work.
The testing of different 3D input devices, especially the possibility of using gesture based input and comparing it to other input methods, is interesting as it is also a main research problem in HandsOn. The application domain, architecture and urbanism, offers some interaction technicues. Polygon modeling is probably hard to mix with it, but animation offers quite readily several possibilities for content on architectural objects, for example the animation of users of the building.
On the collaborative work with 2D and 3D interactions HandsOn has some possibilities, as the current research implementation is extending an existing 2D-interaction based modeling software so that it can be used in genuine 3D environment. The possibility of two users using different interaction methods on the same object could be implemented on the modeling software, and experimented to test the collaborative work possibilities.
The most interesting aspect might be the 3D interaction technicues testing on the manipulation of objects in virtual reality. The architectural environment in use is not only static objects, so implementing an animation tool for presenting the dynamic aspects may allow the making of more informative models.
|Travel||Rami Ajaj||Paris → Helsinki → Paris||250 €|
| ||Mikko Multimäki||Helsinki → Paris → Helsinki||280 €|
|Accomodation||Rami AJAJ||2 month accomodation||1200€|
| ||Mikko Multimäki||3-bedroom family house||1400€|
CV of Rami AJAJ
Born the 23rd of September 1983
Address: 7 passage du chemin de fer
91400 Orsay FRANCE
2006 - 2009: PhD student in computer science at University Paris 11 and in LIMSI-CNRS lab (France)
2004 - 2006: Master in computer science at University Paris 11 (France)
2003 – 2004: Third year university diploma in computer science at University Paris 11 (France)
2001 – 2003: Two-year university diploma in Mathematics and computer science at University Paris 11 (France)
Before 2001: School and high-school in Lycée Franco-Libanais Tripoli (Lebanon)
Study of the different possible combinations of multimodal visual interactions performed through a 2D horizontal view projected on a tabletop device and a 3D stereoscopic view projected on a wall screen affecting the same virtual scene.
Ajaj, R., Jacquemin, C., and Vernier, F. (2007). User collaboration for 3D manipulation through multiple shared 2D and 3D views. In Proceedings, Virtual Reality International Conference VRIC'07, Laval, France.
Jacquemin, C., Ajaj, R., Cahen, R., Ollivier, Y., and Schwarz, D. (2007). Plumage: Design d'une interface 3D pour le parcours d'échantillons sonores granularisés. In Proceedings, Conférence Francophone sur l'Interaction Homme-Machine IHM'07, Paris, France.
Jacquemin, C., Planes, B., and Ajaj, R. (2007). Shadow casting for soft and engaging immersion in augmented virtuality artworks. In Proceedings, 9th ACM Multimedia 2007, Augsburg, Germany.
Mikko Ilmari Multimäki
Ansatie 18 B 11
+358 40 5058473
date of birth 5. September 1975
2007- PhD Student at Laboratory of Telecommunications Software And
Multimedia, Helsinki University of Technology
2002- Master's student in mathematics, University of Helsinki
1994-2006 Master of Computer Science, Helsinki University of Technology
1994 Graduated from Tapiola High school, Espoo
2007- Researcher at Laboratory of Telecommunications Software And
Multimedia, Helsinki University of Technology
2003-2007 Software developer, later product manager, at Elma OYj, later
part of Itella OYj.
2003 Research assistant at SoberIt (The Software Business and
Engineering Laboratory), Helsinki University of Technology
1997-2002 Software development and computer support in various companies
Genuine 3D-environments and gestural interactions, currently on the fields of
polygon modeling and animation.