# VIDA

### Site Tools

wiki:new_interfaces_for_3d_modelling_joint_program

# Differences

This shows you the differences between two versions of the page.

 — wiki:new_interfaces_for_3d_modelling_joint_program [2012/02/28 13:16] (current) Line 1: Line 1: + ====== >... New Interfaces For 3D Modelling Joint Program ====== + ~~NOTOC~~ + + **Collaboration between LIMSI-CNRS (University of Paris 11) and Laboratory of Telecommunications Software and Multimedia (Helsinki University of Technology)**\\ + + \\ + + This document presents the existing collaboration between the Laboratoire d'​Informatique pour la Mécanique et les Sciences de l'​Ingénieur (LIMSI-CNRS) in France and the Telecommunications Software and Multimedia Laboratory in Finland. We apply for a financial support from the INTUITION network of excellence to cover the travel and accommodation fees of the PhDs students’ exchange. + + \\ + + __**Joint research program:​**__ + + The combination of several research works done separately in LIMSI-CNRS and the Telecommunications Software and Multimedia Laboratory points out an interesting collaboration between both laboratories. + + \\ + + * **LIMSI-CNRS** + + The development of multimodal interactions is increasing in the Virtual Reality (VR) and Augmented Reality (AR) fields. We (Rami AJAJ et al.) focus on multimodal visual input and output by combining a 3D view with a 2D view offered to multiple users. The first view we consider is a 2D view browsed on a collaborative tabletop device. The second view is a 3D (possibly stereoscopic) view projected on a wall screen used by only one user (possibly already using the tabletop view). We are interested in this setting because it provides two complementary views and it allows concurrent 2D and 3D interactions on geometrical objects. Our main interests are the test of various 3D input devices combined with 2D direct manipulation interactions and the development of new combined interaction techniques for a given task. The application domain we use is architecture and urbanism. + + The aim of the collaboration between Rami AJAJ (from LIMSI-CNRS) and the Laboratory of Telecommunications Software and Multimedia is mainly on using tracking for 3D interactions (through a 3D view) combined with 2D interactions (2D view). Another interesting issue is the work on 3D audio combined with both (2D and 3D) views. Two purposes arise from this type of combination. The first is to compensate the lack of 3D visual feedback when an interaction is made through the other view. The second is to facilitate the users cognitive map reconstruction. + + \\ + + * **Laboratory of Telecommunications Software And Multimedia** + + We (Mikko Multimäki et al.) are currently working on HandsOn project which concetrates on using genuine 3D-environments and gestural interactions on the fields of polygon modeling and animation. The proposal of the combination of 3D and 2D views and interactions offer several good research points which coincide with HandsOn work. + + The testing of different 3D input devices, especially the possibility of using gesture based input and comparing it to other input methods, is interesting as it is also a main research problem in HandsOn. The application domain, architecture and urbanism, offers some interaction technicues. Polygon modeling is probably hard to mix with it, but animation offers quite readily several possibilities for content on architectural objects, for example the animation of users of the building. + + On the collaborative work with 2D and 3D interactions HandsOn has some possibilities,​ as the current research implementation is extending an existing 2D-interaction based modeling software so that it can be used in genuine 3D environment. The possibility of two users using different interaction methods on the same object could be implemented on the modeling software, and experimented to test the collaborative work possibilities. + + The most interesting aspect might be the 3D interaction technicues testing on the manipulation of objects in virtual reality. The architectural environment in use is not only static objects, so implementing an animation tool for presenting the dynamic aspects may allow the making of more informative models. + + \\ + + __**Expected results:​**__ + + * Implementing a (simple) method of inserting animation into architectural models. + * Building a scenario with dynamic content. + * Testing the usability of different 3D input devices. + * Implementing the concurrent 2D and 3D interfaces on existing software. + * Combination of 3D tracking interactions through a 3D view and 2D interactions through a 2D view. + * Testing the use of concurrent 2D and 3D interfaces in collaborative work on existing modeling software. + * Possible combination with 3D audio. + + \\ + + __**Research schedule:​**__ + + * 18 February 2008 -> 04 April 2008: Visit to the Laboratory of Telecommunications Software And Multimedia by Rami AJAJ. + * 15 April 2008 -> 15 May 2008: Visit to LIMSI-CNRS by Mikko MULTIMAKI. + + \\ + + __**Budget:​**__ + + \\ + + | Fee Type | Visitor | Description | Price | + | Travel | Rami Ajaj | Paris -> Helsinki -> Paris | 250 € | + | \\ | Mikko Multimäki | Helsinki -> Paris -> Helsinki | 280 € | + | Accomodation | Rami AJAJ | 2 month accomodation | 1200€ | + | \\ | Mikko Multimäki | 3-bedroom family house | 1400€ | + + \\ + + **APPENDIX** + + \\ **CV of Rami AJAJ** + + **Rami AJAJ** + + Born the 23<​sup>​rd​ of September 1983 + + Address: 7 passage du chemin de fer + + 91400 Orsay FRANCE + + Email: ​ [[mailto:​Rami.ajaj@limsi.fr|Rami.ajaj@limsi.fr]] + + Tel: 0033-1-69858111 + + \\ + + __**EDUCATION**__ + + 2006 - 2009: PhD student in computer science at University Paris 11 and in LIMSI-CNRS lab (France) + + 2004 - 2006: Master in computer science at University Paris 11 (France) + + 2003 – 2004: Third year university diploma in computer science at University Paris 11 (France) + + 2001 – 2003: Two-year university diploma in Mathematics and computer science at University Paris 11 (France) + + Before 2001: School and high-school in Lycée Franco-Libanais Tripoli (Lebanon) + + \\ + + __**RESEARCH WORK**__ + + Study of the different possible combinations of multimodal visual interactions performed through a 2D horizontal view projected on a tabletop device and a 3D stereoscopic view projected on a wall screen affecting the same virtual scene. + + \\ + + __**RECENT PUBLICATIONS**__ + + Ajaj, R., Jacquemin, C., and Vernier, F. (2007). User collaboration for 3D manipulation through multiple shared 2D and 3D views. In Proceedings,​ Virtual Reality International Conference VRIC'​07,​ Laval, France//.// + + Jacquemin, C., Ajaj, R., Cahen, R., Ollivier, Y., and Schwarz, D. (2007). //Plumage: Design d'une interface 3D pour le parcours d'​échantillons sonores granularisés//​. In //​Proceedings,​ Conférence Francophone sur l'​Interaction Homme-Machine IHM'​07//,​ Paris, France. + + Jacquemin, C., Planes, B., and Ajaj, R. (2007). //Shadow casting for soft and engaging immersion in augmented virtuality artworks//. In //​Proceedings,​ 9th ACM Multimedia 2007//, Augsburg, Germany. + + \\ + + ===== CV of Mikko Multimäki ===== + + Mikko Ilmari Multimäki + + Ansatie 18 B 11 + + 02940 Espoo + + Finland + + +358 40 5058473 + + mikko.multimaki@tkk.fi + + date of birth 5. September 1975 + + \\ + + ==== Education ==== + + \\ + + 2007- PhD Student at Laboratory of Telecommunications Software And + + Multimedia, Helsinki University of Technology + + 2002- Master'​s student in mathematics,​ University of Helsinki + + 1994-2006 Master of Computer Science, Helsinki University of Technology + + 1994 Graduated from Tapiola High school, Espoo + + \\ + + ==== Work experience ==== + + \\ + + 2007- Researcher at Laboratory of Telecommunications Software And + + Multimedia, Helsinki University of Technology + + 2003-2007 Software developer, later product manager, at Elma OYj, later + + part of Itella OYj. + + 2003 Research assistant at SoberIt (The Software Business and + + Engineering Laboratory),​ Helsinki University of Technology + + 1997-2002 Software development and computer support in various companies + + \\ + + ==== Research ==== + + \\ + + Genuine 3D-environments and gestural interactions,​ currently on the fields of + + polygon modeling and animation.