In this page, I show some projects where I was involved in since my undergraduate studies. These works are in descending cronological order.

A fully hierarchical approach for finding correspondences in non-rigid shapes

This research presents a hierarchical method for finding correspondences in non-rigid shapes. We propose a new representation for 3D meshes: the decomposition tree. This structure characterizes the recursive decomposition process of a mesh into regions of interest and keypoints. The internal nodes contain regions of interest (which may be recursively decomposed) and the leaf nodes contain the keypoints to be matched. We also propose a hierarchical matching algorithm that performs in a level-wise manner. The matching process is guided by the similarity between regions in high levels of the tree, until reaching the keypoints stored in the leaves. This allows us to reduce the search space of correspondences, making also the matching process efficient. We evaluate the effectiveness of our approach using the SHREC’2010 robust correspondence benchmark. In addition, we show that our results outperform the state of the art.

Key-component Detection on 3D Meshes using Local Features

We present a method to detect stable components on 3D meshes. A component is a region on the mesh which contains discriminative local features. Our goal is to represent a 3D mesh with a set of regions, which we called key-components, that characterize the represented object and therefore, they could be used for effective matching and recognition. As key-components are features in coarse scales, they are less sensitive to mesh deformations such as noise. In addition, the number of key-components is low compared to other local representations such as keypoints, allowing us to use them in efficient subsequent tasks. A desirable characteristic of a decomposition is that the components should be repeatable regardless shape transformations. We show in the experiments that the key-components are repeatable under several transformationsusing the SHREC'10 feature detection benchmark.

Data-aware 3D Partitioning for Generic Shape Retrieval

We present a new approach for generic 3D shape retrieval based on a mesh partitioning scheme. Our method combines a mesh global description and mesh partition descriptions to represent a 3D shape. The partitioning is useful because it helps us to extract additional information in a more local sense. Thus, part descriptions can mitigate the semantic gap imposed by global description methods. We propose to find spatial agglomerations of local features to generate mesh partitions. Hence, the definition of a distance function is stated as an optimization problem to find the best match between two shape representations. We show that mesh partitions are representative and therefore it helps to improve the effectiveness in retrieval tasks. We present exhaustive experimentation using the SHREC'09 Generic Shape Retrieval Benchmark.

Harris 3D: interest point detection on meshes

With the increasing amount of 3D data and the ability of capture devices to produce low-cost multimedia data, the capability to select relevant information has become an interesting research field. In 3D objects, the aim is to detect a few salient structures which can be used, instead of the whole object, for applications like object registration, retrieval, and mesh simplification. In this paper, we present an interest points detector for 3D objects based on Harris operator, which has been used with good results in computer vision applications. We propose an adaptive technique to determine the neighborhood of a vertex, over which the Harris response on that vertex is calculated. Our method is robust to several transformations, which can be seen in the high repeatability values obtained using the SHREC feature detection and description benchmark. In addition, we show that Harris 3D outperforms the results obtained by recent effective techniques such as Heat Kernel Signatures.

Partial Similarity Search in 3D Object Databases

The ability to store and manipulate large amounts of information have enabled the emergence of a number of applications. Generally, the information is given as text because it is easy to produce and understand text by a computer. However, there are situations where it is difficult to represent textually a need. For example, let us imagine the tourist's album with stories instead of photos. Thus, the multimedia information diffusion has increase considerably, on the one hand, to support new needs, and on the other hand, because of the proliferation of capture devices such as digital cameras and medical devices, which make possible an inexpensive production. With images, videos or three-dimensional models, a number of applications have benefited such as security, entertainment, engineering processes, and so on. Unlike text, multimedia information is difficult to be compared directly and therefore we require techniques to manipulate it effectively. We are interested in content-based 3D objects retrieval, where we aim to retrieve visually similar objects from a collections of 3D models given a 3D object as query. In particular, the objective in this work is to define techniques for Partial Similarity Retrieval, where a complete query model is not available and we require to retrieve objects that contains substructures visually similar to the query, as shown in the figure(at left, an incomplete query model, at right, the models that should be retrieved). There are many real-world scenarios, such as Computer Aided Desing, where this problem require attention.

Supervised Researches

When I was in National University of Trujillo as professor, I guided the researches listed below.

  • Content-Based Image Retrieval for Supporting the Medical Images Diagnosis. In this work, the authors proposed to use content-based image retrieval methods to help in diagnosis involving medical images. To achieve this, the authors developed feature vectors extraction techniques on images. Using Gabor Wavelets, the extraction algorithm provides orientation and scale robustness. In addition, after the extraction step, the feature vectors were organized in a metric index in order to efficiently retrieve similar images to a given query. Authors: Laura Florián Cruz and Fredy Carranza Athó.

  • Multidimensional Indexes to Organize High-Dimensional Patterns. In this work, the authors evaluated the performance of multidimensional indexes in the organization of high-dimensional data in order to provide a framework for task such as multidimensional data mining, image mining and queries by examples in multimedia objects. Authors: Percy Fhon Bautista and Carlos Romero Miñano.

Variational Segmentation of Digital Images

In this work, we implemented an algorithm for digital images segmentation, based on the Minimal Partition Problem as a limit case of Mumford-Shah functional. This functional provides a good characterization of the segmentation process. We compare the obtained results with those obtained with algorithms as multi-thresholding, region-growing and split-merge. The developed method is based on a functional energy minimization on a given image. The level-set method allow us to define an equivalent problem, which is numerically more appropiate. The application of Euler-Lagrage Variational procedure results in an multi-phase image segmentation algorithm. More details can be seen in the publications page. Below, I show some images with results.






Fingerprint Recognition with Deviation Standard Maps and Neural Networks

The goal of this work was to develop a fingerprint recognition system. First, we applied Gabor Filters to produce a set of images convolved with different filter orientations. Then, we calculated a Deviation Standard Map in a block-wise manner in order to decrease the amount of information. Finally, the set of maps is concatenated to build a high-dimensional feature vector. All feature vectors are used in a feed-forward neural network with backpropagation learning to identify people.

Expert System for Supermarket Customer Loyalty

In this project, we proposed the development of an expert system to evaluate the customer loyalty in a supermarket. If the customer preference and information on customer purchases are available, the system can predict whether a customer is likely to stop buying in the supermarket. The system was implemented in CLIPS as inference engine with user interfaces in Visual C++.