projects
work
TARGET - Transformative, Adaptive, Responsive and enGaging EnvironmenT
Was a project with the goal of developing a platform for workplace learning, with a serious game in its core, where understanding is transformed through knowledge gateways, supporting rapid competence development. I was responsible for managing all the technical development of INESC workpackage incluing an IA platform, Serious Game platform and the integration with the work developed by the other partners of the project.
GaLA - Games and Learning Alliance
gathers the cutting-the-edge European Research & Development organizations on Serious Games, involving 31 partners from 14 countries. Partnership involves universities, research centers, and developer and education industries. In this project I was responsible to manage the work developed by INESC students and the partners of the project.
BlackBox - Arts & Cognition
Was a project that aimed at developing a cutting-edge model for a web-based collaborative platform, dedicated to the documentation of compositional processes by contemporary performing artists with a focus on dance and theatre. In this project I colaborated in developing tools to digitalize dance movement and using that data to document artistic processes, such as point-cloud segmentation algorithm and a virtual reality environment.
AWESOME - Awareness While Experiencing and Surfing On Movies through Emotions
was to investigate the emotional dimension of movies, to provide support for the classification, access, navigation and visualization of movie collections, not only by genre, rating, etc. but based on the emotions expressed in their content and felt by the viewers, while and after watching movies. where I was mainly involved in tasks related to the automatic detection of emotions in images through deep learning models and also in the development of interactive systems that allow emotional annotation of movies, self-reported and using bio sensors.
MUYA - The Multimedia Yasna
examines the performance and written transmission of the core ritual of the Zoroastrian tradition, the Yasna, whose oldest parts date from the second millennium BCE. In this project I was responsible for developing a method whose aim is to detect and track around 50 objects throughout the the Yasna film. This involved developing an annotation protocol that included how to annotate visible, occluded, and partially visible objects, as well as class correctness and completeness. For each new annotation dataset a YOLO model was trained and a new result of the film with bounding box and confidance levels was generated. Approaches based on Non-Max Suppression and Weighted Box Fusion were added to the detection algorithm in order to solve problems related to different class bounding box overlap.
fun
Two Tiny Girls
was a project that developed works in the intersection between digital and analog art and in the synergy of art and technology. Several projects were developed including VJing, live painting and video art.
Interactive Wall
Interactive Wall were two interactive instalations presented at Sirigaita association and Lux Frágil.
Choreographic Coding Lab
Cláudia Ribeiro, in collaboration with Michaela Honauer, has created the video “Memories”, based on Milan Kundera’s idea that gestures inhabit people. Using 3D data captured with multiple Kinect sensors from Rui Lopes Graça latest piece “Quinze Bailarinos e Tempo Incerto”, and video data capture during the Choreographic Coding Lab, they have explored the dichotomy between ballet movements and contemporary dance movements.
Apiário VR
Apiário VR was a Virtual Reality project consisted in developing a virtual tour through an apiary. These tour included 4 different scenarios and in each the user would learning important facts about bees and their natural habitat.
Existo
Existo is a project that aims to provide an analysis of the representation and visibility of Portuguese artists in the Portuguese press, namely in the Ípsilon supplement of the Público newspaper. For that Natural Language Processing... Besides this analysis, it also provides the most mentioned artists, the news where they were mentioned, the distribution by geographical area and the aggregation of the lexicon analysis (i.e., most repeated words) of the news text.