Modeloptimizergui and Release Notes Version 8 5: Difference between pages

From Eigenvector Research Documentation Wiki
(Difference between pages)
Jump to navigation Jump to search
imported>Mathias
 
imported>Lyle
No edit summary
 
Line 1: Line 1:
=Model Optimizer=
__TOC__


=Introduction=
==Version 8.5==
Version 8.5 of PLS_Toolbox and Solo was released in September, 2017.


Optimizing modeling conditions and settings requires building and comparing multiple models. The Model Optimizer allows you to both automate building of models and visualize a comparison of models. See the [[modeloptimizer]] and [[comparemodels]] functions for more additional command line information.
For general product information, see [http://www.eigenvector.com/software/pls_toolbox.htm PLS_Toolbox Product Page]. For information on Solo, see [http://www.eigenvector.com/software/solo.htm Solo Product Page].


The interface is based around the idea of a "Snapshot" of the Analysis model building interface. Each snapshot contains all the settings for building the model. Once a set of snapshots has been created, the Model Optimizer can assemble all combinations of the settings into a collection of models to calculate. This collection can then be run at a convenient time or saved and run on new data.
(back to [[Release Notes PLS Toolbox and Solo]])


After all models have been calculated the results are displayed in a comparison table. By default the table shows only columns that differ between the models but it can be customized. Each column can be sorted to investigate results.
==Overview==


* The primary focus of version 8.5 has been in Calibration Transfer and additional importers.


'''Unsupported Model Types'''
* PLS_Toolbox/Solo 8.5 has been tested extensively with Matlab 2017b prerelease and should be compatible with the coming release.


* CLUSTER
* Simplified interface design changes. Various controls have been moved to simplify interfaces. Seldom used settings have been moved to options in several cases (e.g., simplified [[Svm|SVM]] panel).
* PURITY
* Batch Maturity


=Model Optimizer Interface=
* The Analysis window's confusion matrix and table toolbar icon now returns classification results for both [http://wiki.eigenvector.com/index.php?title=Sample_Classification_Predictions#Class_Pred_Most_Probable 'most probable'] and [http://wiki.eigenvector.com/index.php?title=Sample_Classification_Predictions#Class_Pred_Strict  'strict'] classifications. In the 'strict' case it also lists the 'strictthreshold' value used.
==Getting Started==
Snapshots can be take from the Analysis toolbar or the Model Optimizer toolbar by clicking the snapshot button (camera icon). Each time a snapshot is taken the settings are added to the snapshot list as well as the model list. The combinations are updated after each snapshot. A Model Optimizer window will open if it's not already.


Once you've added the desired snapshots you can either calculate the list of models immediately or click the '''Add Combinations''' button to add all unique combinations of the model settings to the models list then calculate.
==Calibration Transfer==
* [[MCCTTool | New Model-centric Calibration Transfer]] - Interface to develop instrument specific models with calibration transfer.


After the models are calculated the model comparison table will be updated showing the columns that differ between models. Sort the columns to find models with the desired value. For additional information on each model, expand it's leaf in the tree.
* [[nlstd| NLSTD]] - Create or apply non-linear instrument transfer models (PLS_Toolbox only).


==Taking Snapshots==
* [[sstcal| SST]] - Spectral Subspace Transformation calibration transfer.
A snapshot can be taken before or after a model is calculated (by clicking the Snapshot button).


* If the snapshot is taken before calculation it will be added to both the Snapshot List and Model List but no results will be available until it's calculated. Any additional combinations resulting from the Snapshot will not be added to the Model List, you must add those by by clicking Add Combinations button.
* [[Demonstration_Datasets|Corn DSO]] - New calibration transfer demonstration data set added. 80 samples of corn measured on 3 different NIR spectrometers with moisture, oil, protein and starch values for each of the samples is also included.
* If the snapshot is taken after calculation, the model will be added same as above but results will be displayed immediately in the Comparison Table.


If you have large data and or time-consuming model settings it's often useful to take a Snapshot '''without''' calculating the model. Then, adjust settings and continue assembling snapshots '''without''' calculating. Once you have all the models assembled you can create them (all at once) from the Model Optimizer.
==Importers==


Use Combinations to generate all unique combinations of model settings. For example, if you change the cross-validation and preprocessing, take a snapshot, then change cross-validation and preprocessing again and take a snapshot, there will be 4 possible combinations. Clicking the Add Combinations button will add all 4.
* [[shimadzueemreadr]] - Imports Shimadzu EEM formatted text files.
* [[visionairxmlreadr]] - Imports Vision Air formatted XML files (X- & Y-Blocks).
* [[pltreadr]] - Imports Vision Air model files (.plt).


==Model Optimizer Window==
* [[aqualogreadr]] - Improved capability of loading multiple files containing samples of varying sizes (PLS_Toolbox only).
The main Optimizer Window has 4 sections:


# Model comparison table.
* [[jascoeemreadr]] - Improved capability of loading multiple files containing samples of varying sizes (PLS_Toolbox only).
# Model list.
# Snapshot list.
# Combinations list.


[[Image:ModelOptimizerMain.png|700px|GUI Window]]
* [[hitachieemreadr]] - Improved capability of loading multiple files containing samples of varying sizes (PLS_Toolbox only).


==Managing Snapshots and Models==
* [[rawread|RAWREAD]] - Added support for new version format (3 & 4) (See MIA_Toolbox).


Clicking the snapshot button adds it to the snapshot list, updates the combinations list, and adds the snapshot to the model list. A snapshot or model can be removed by clicking the '''Remove''' node in the list tree or by using the right-click menu.
* [[spgreadr|SPGREADR]] Added new feature, options.spectrumindex now can be an integer, an array of integers (indices, & order doesn't matter), or 'all'. When loading multiple files, options.spectrumindex must be either a single value or 'all'.


The list right-click menu allows you to:
==Exporters==
* Collapse all leafs in the tree.
* Run all models.
* Add a single snapshot to the model list.
* Add all snapshots to model list.
* Clear a single snapshot or model from the list.
* Clear all snapshots or models from the list.
* Clear everything.


Expanding each node will "drill down" into the snapshot/model settings. Expand a node to get more information about the item.
* [[writeplt]] - Exports EVRI Model structures to Vision Air PLT files.
==Survey Preprocessing==


Preprocessing in a snapshot can be "surveyed" over a range of parameter values via the [[preprocessiterator | preprocess iteration]] function.
==Other Features and Improvements==
* [[Cooksd| Cook's Distance]] - Calculates Cooks Distance for samples in a regression model.


# Create a snapshot with the preprocessing you wish to survey.
* [[rpls| RPLS]] - A recursive PLS and PCR variable selection algorithm.  
# Right-click on the snapshot and select "Survey Preprocessing" from the menu.
# For each of the preprocessing methods available for surveying (see [[preprocessiterator]] for a list) select the min, max and interval to use. '''Note:''' a full factorial of the combinations will be created so the total number of models will be the product of the "count" column.
# Click '''OK''' and the new snapshots should appear. You can expand the snapshots to confirm preprocess settings.
# Click '''Add Combinations''' then '''Calculate Models'''.
<br>


Survey Menu:
* [[manhattandist| MANHATTANDIST]] - Calculate Manhattan Distance between rows of a matrix.


[[Image:SurveyPreprocessingMenu.jpg||300px| ]]
* [[Confusionmatrix]] and [[Confusiontable]] - Classification results formatting options added. Can now specify use of mostprobable or strict classification rule.  
 
* [[calcdifference]] - Calculate difference between two datasets.
Survey Figure:
* Added GLS Weighting to model optimizer.
 
[[Image:PreprocessIteratorFig.jpg| |500px| ]]
 
==Adding Models from Cache or Workspace==
 
Models can be added to the Optimizer from the cache or workspace by dragging and dropping them onto the window. If a model is added from the workspace the associated data is not added.
 
A model can be added from the cache using the right-click menu "Compare" item.
 
==Working with the Comparison Table==
Once models have been added and calculated the Comparison Table will be updated. By default, only the columns with differing values will be displayed (columns with the same value for all models will be hidden). Investigate the results by sorting columns.
 
The display of columns and table behavior can be modified via the Edit menu Include/Exclude Columns and the Options editor. Excluded columns do not appear in the include list so remove excluded columns from the exclude list before attempting to include them.
 
Right-click on the column header to display a context menu for sorting. Clicking on a particular row will expand the models corresponding node in the model tree. Double clicking the row number will open the model in analysis.
 
[[Image:OptimizerTable.jpg| |500px|Optimizer Table]]
 
Click the plot button to generate a plot of the table data.
 
[[Image:modeloptimizer_plot.jpg | |400px|Optimizer Plot]]
 
==Saving an Optimizer Model==
Optimizer models can be save from the '''File''' menu. These models are also "cached" in the model cache each time the '''Calculate''' button is pushed.
 
=Applying New Data=
 
New data can be applied to an Optimizer model by dragging and dropping new data onto a model in the [[Workspace_Browser | Workspace Browser]].
 
* Locate the Model Optimizer model in the model cache and double-click it to load it into the workspace.
* Load the data you want to apply.
* Drag and drop new data onto your model.
* Once the model is calculated you'll be prompted to save the model to the workspace.
* Double-click the new model to open it in the Model Optimizer window.
 
[[Image:ApplyModelOptimizer.jpg||600px|Apply Optimizer]]
 
=Applying Validation Data=
 
Validation data can be selected by clicking the Cal/Val button.  This will populate the RMSEP column for all models which have the appropriate number of variables.  The RMSEP entry for models who are expecting validation data with a different number of variables than the data seleceted by the user, will be blank.   
 
 
[[Image:modeloptimizer1.jpg||600px|Validate Optimizer]]

Revision as of 09:35, 7 February 2019

Version 8.5

Version 8.5 of PLS_Toolbox and Solo was released in September, 2017.

For general product information, see PLS_Toolbox Product Page. For information on Solo, see Solo Product Page.

(back to Release Notes PLS Toolbox and Solo)

Overview

  • The primary focus of version 8.5 has been in Calibration Transfer and additional importers.
  • PLS_Toolbox/Solo 8.5 has been tested extensively with Matlab 2017b prerelease and should be compatible with the coming release.
  • Simplified interface design changes. Various controls have been moved to simplify interfaces. Seldom used settings have been moved to options in several cases (e.g., simplified SVM panel).
  • The Analysis window's confusion matrix and table toolbar icon now returns classification results for both 'most probable' and 'strict' classifications. In the 'strict' case it also lists the 'strictthreshold' value used.

Calibration Transfer

  • NLSTD - Create or apply non-linear instrument transfer models (PLS_Toolbox only).
  • SST - Spectral Subspace Transformation calibration transfer.
  • Corn DSO - New calibration transfer demonstration data set added. 80 samples of corn measured on 3 different NIR spectrometers with moisture, oil, protein and starch values for each of the samples is also included.

Importers

  • aqualogreadr - Improved capability of loading multiple files containing samples of varying sizes (PLS_Toolbox only).
  • jascoeemreadr - Improved capability of loading multiple files containing samples of varying sizes (PLS_Toolbox only).
  • hitachieemreadr - Improved capability of loading multiple files containing samples of varying sizes (PLS_Toolbox only).
  • RAWREAD - Added support for new version format (3 & 4) (See MIA_Toolbox).
  • SPGREADR Added new feature, options.spectrumindex now can be an integer, an array of integers (indices, & order doesn't matter), or 'all'. When loading multiple files, options.spectrumindex must be either a single value or 'all'.

Exporters

  • writeplt - Exports EVRI Model structures to Vision Air PLT files.

Other Features and Improvements

  • RPLS - A recursive PLS and PCR variable selection algorithm.
  • MANHATTANDIST - Calculate Manhattan Distance between rows of a matrix.
  • Confusionmatrix and Confusiontable - Classification results formatting options added. Can now specify use of mostprobable or strict classification rule.
  • calcdifference - Calculate difference between two datasets.
  • Added GLS Weighting to model optimizer.