DESPOTA

DV blog

DESPOTA (DEndogram Slicing through a PermutatiOn Test Approach) is a novel approach exploiting permutation tests in order to automatically detect a partition among those embedded in a dendrogram. Unlike the traditional approach, DESPOTA includes in the search space also partitions not corresponding to horizontal cuts of the dendrogram.

The output of hierarchical clustering methods is typically displayed as a dendrogram describing a family of nested partitions. However, the exploitable partitions are usually restricted to those relying on horizontal cuts of the tree, missing the possibility to explore the whole set of partitions housed in the dendrogram. We introduced an algorithm, DESPOTA, exploiting the methodological framework of permutation tests, that permits a partition to be automatically found where clusters do not necessarily obey the above principle. Our solution adapts to every choice of the distance metric and agglomeration criterion used to grow the tree.

Papers

2018 DESPOTA: an algorithm to detect the partition in the extended hierarchy of a dendrogram.
In: (Eds.): Cira Perna Monica Pratesi Anne Ruiz-Gazen, Studies in Theoretical and Applied Statistics. p. 83-93, Cham:Springer
DOI LINK English
2015 DESPOTA: a permutation test algoritm to detect a partition from a dendrogram
Journal of Classification, (32), Springer DOI: 10.1007/s00357- 015-9179-x
DOI LINK English
2010 Cutting the dendrogram through permutation tests
Proceedings of Compstat'2010, Ed. by L. Y. S. G. EDS. NEW YORK: Physica-Verlag, HEIDELBERG, pp. 847– 854
DOI LINK English

Abstract, short papers and slides

2015 DESPOTA: an algorithm to automatically detect a reliable partition on a dendrogram.
CARME 2015, Naples, Italy, September 20–13
abstract English
2015 DESPOTA: a permutation test algorithm to detect a partition from a dendrogram.
IFCS 2015, Bologna, Italy, July 6–8
slides English
2013 DESPOTA: un approccio basato sui test di permutazione per la ricerca della partizione su un dendrogramma
AISC 2013, Associazione Italiana di Scienze Cognitive, X Convegno Annuale, Napoli 19-22 novembre
  prezi  
movie 1
movie 2
short paper Italian
2010 Cutting the dendrogram through permutation tests
Proceedings of Compstat'2010, Ed. by L. Y. S. G. EDS. NEW YORK: Physica-Verlag, HEIDELBERG, pp. 847– 854
slides short paper English
2009 Stairstep-like dendrogram cut: a permutation test approach
useR!, The R User Conference 2009, Agrocampus-Ouest, Rennes, France, July 8-10
slides abstract English
2009 Una procedura di taglio a gradini per l'estrazione della partizione ottimale da un dendrogramma
SISMEC 2009, Pavia, Italy, September 16-19
slides short paper Italian

Software code

At the moment there is no official code for Despota. The current version of the code is not very fast in case of big data, but it works.

A small tutorial including the main functions and some auxiliary plotting functions is available on this GITHUB page.

I would be very glad of having any (positive as well as negative) feedback if you use DESPOTA on your data. Moreover, let me known in case you are interested to start a collaboration on the topic.

comments powered by Disqus