SLMC //student projects: Dimensionality Reduction//

SLMC homeSLMC researchSLMC peopleSLMC projectsSLMC newsSLMC coursesSLMC hiringSLMC contactIPABSchool of InformaticsUniversity of Edinburgh
Project Leader
Justin W Rachels
MSc, School of Informatics, Univ. of Edinburgh
Project Supervisor
Sethu Vijayakumar, PhD
IPAB, School of Informatics, Univ. of Edinburgh

Project Title
Dimensionality Reduction Techniques: Algorithm Analysis and Investigation

Project Goal
Dimensionality Reduction and Manifold Learning are critical concerns for many of the subfields of Artificial Intelligence, from applied visual pattern recognition to knowledge-base data compression.  As such, there has been much attention to improving the classical algorithms used for minimising the dimensionality of a data set.  Many of these algorithms work impresively well on complicated-seeming examples presented in seminal papers and some seem to be designed for special situations which demand algorithmic modifications-- we would like to be able to test these algorithms on a neutral data set including realistic distributions and determine their applied comparative usefulness as well as attempting, if possible, to combine the greatest strengths of the algorithmic developments thus far in the field, knowledge of when exactly certain techniques are most useful, and algorithmic techniques from related statistical analysis subfields in order to create a strong hybrid algorithm or toolbox.  Also under consideration are any applications such a hybrid technique might motivate in some subfields of Artificial Intelligence (of specific concern are agent-based knowledge systems).

To specify the goal-concerns of this project,:

  • Research and implement (in Matlab) classical algorithms (PCA, MDS, Isomap, LLE)
  • Investigate and implement, where useful, recent modifications of classical algorithms
  • Compare implemented methods with other related statistical analysis fields and techniques
  • Create neutral test suite
  • Compare and analyse behaviours of implemented algorithms
  • Conjecture and test hybrid algorithms and techiniques

Project Timeline

Time Frame Task (completed or scheduled)
10 May 04 - 16 May 04 background research for pca, mds;  linear algebra review for relevant methods
17 May 04 - 23 May 04 matlab implementation of pca, mds
24 May 04 - 30 May 04 background research for isomap
31 May 04 - 06 June 04 matlab implementation of isomap
07 June 04 - 13 June 04 background research for lle
14 June 04 - 20 June 04 matlab implementation of lle
21 June 04 - 27 June 04 neutral data set creation and testing
28 June 04 - 11 July 04 research and implementation of extensions to isomap and lle
12 July 04 - 25 July 04 research and implementation of auxiliary methods
26 July 04 - 01 Aug. 04 method testing and analysis
02 Aug. 04 - 15 Aug. 04 hybridisation implementation and testing
16 Aug. 04 - 29 Aug. 04 implementation of implications for applicative senses of findings

Project Results & Conclusions
Thesis