Release Notes Version 7 5 and Faq import three-way data: Difference between pages

From Eigenvector Research Documentation Wiki
(Difference between pages)
Jump to navigation Jump to search
imported>Jeremy
No edit summary
 
imported>Bob
No edit summary
 
Line 1: Line 1:
==New Features in Solo and PLS_Toolbox==
===Issue:===


===[[Modelselectorgui | Hierarchical Model Builder]]===
How do I import three-way data into Solo or PLS_Toolbox?
* New graphical interface to build Hierarchical Models based on [[Modelselector | Model Selector]] models.
* Allows building of complex classification trees, local model selectors, and input/output filters and tests.
* Branch decisions based on classification models, regression models, decomposition models, or tests on raw input variables.
* Output model predictions, fixed strings or numerical values, or throw errors for each branch.
* Drag and drop models and other objects from the Model Cache, workspace, or file system.
* Compatible with Solo_Predictor for immediate use in on-line applications.


===[[Modeloptimizergui | Model Optimizer]]===
===Possible Solutions:===
* Added ability to [[Modeloptimizergui#Survey_Preprocessing | automatically survey]] over preprocessing settings.
* Improved support for PLSDA and SVMDA, added support for new ANN models.
* Improved handling of options and modeling errors.


===Artificial Neural Networks===
'''Solution 1) Built in EEM importers :'''
* ANNs added to Analysis window and command-line tools. Build ANN models in the same familiar interface as other models.


===New/Improved Importers===
If applicable to your file type, use one of the built in EEM importers. There are importers for EEM data from Hitachi, Shimazdu, Horiba and Jasco. Please see this wiki entry for more information on [[Data_Importing_Formats | Data Importing Formats]]
* [[jcampreadr]] - Add peaktable support.
* Improved memory and speed performance for text parsing


===New/Improved Preprocessing Methods===
EEM data needs be configured in a specific way such that:
* [[EMSC_Toolbox_Manual|Extended Multiplicative Scatter Correction (EMSC)]] now included in base products without additional purchase.


===Analysis and Workspace Browser===
* '''mode 1''' corresponds to '''samples'''
* Completely revamped [[Optionseditor|options window]] allows easier saving and restoring of options.
* Export and Import models and calibration data directly from [[Analysis_Window:_Model_Cache_Pane#Exporting_and_Importing_Models | the Model Cache]] to simplify sharing of models and data with others.
* Easier access to build SVM classification models and SIMCA models on any class set.
* Improved control over SIMCA classification rules and options.
* Add '''Refine''' menu to Analysis to better organize menu items and provide access to new hierarchical model builder.
* Add option to browse (see Edit > Options > Workspace Browser Options) to do either concatenation or not when dropping multiple files.


===Plot Controls===
* <div>'''mode 2''' corresponds to '''emission'''</div>
* Added context-menu options to quickly select all members of a given sample's class
* Added ability to get [[summary|summary statistics]] on selected samples (e.g. get mean of all selected samples)


===Other===
* <div>'''mode 3''' corresponds to '''excitation'''</div>
* Add ability to access Sammon components ([[sammon|sammon mapping]]) in scores.


==New Command-line Features and Functions==
The built-in EEM importers will handle this configuration automatically. When importing manually (see below), further manipulation will likely be necessary. Use the Transform &rarr; Permute modes and Transform &rarr; Reshape smenu items to modify your imported data as appropriate.


===Misc New Functions===
'''Solution 2) For three-way data with few slabs:'''
* [[ann]] - Artificial Neural Network regression models.
 
* dataset/copy_clipboard - Copy data and labels to clipboard.
<ol style="list-style-type:lower-alpha">
* EGrid - Property grid control based on Jide Property Table.
  <li>Import the data slabs into the workspace (browser). The workspace browser is available from the main analysis user interface from the menu item FigBrowser.</li>
* [[emscorr]] - Extended Multiplicative Scatter Correction (EMSC).
  <li>Each slab, i.e. each matrix of data is imported individually. Hence, if you have a '''10x8x3''' array, you will import three slabs each of size '''10x8'''.</li>
* evritree - Wrapper object for working with jtree in Matlab.
  <li>Use the mouse to drag slab two onto slab one. In the window that opens choose Augment and then choose augment in the Slabs direction.</li>
* evritreefcn - Rename of old evritree function.
  <li>A two-slab three-way array has now replaced the first data matrix. More slabs can be added in the same fashion.</li>
* hideaxistext - Hides text objects which are outside the current axis limits.
</ol>
* [[importtool]] - GUI for designating column/row data types.
 
* [[modelselectorgui]] - Graphical Interface to build Hierarchical (modelselector) models.
Alternatively, you may also open one slab in the dataset editor and then add additional slabs using File &rarr; Import. After selecting the next slab to import, answer the same questions as in step c above. Repeat for each slab.  
* [[preprocessiterator]]- Create array of preprocessing combinations.
 
* [[sammon]] - Computes Sammon projection for data or map.
'''Solution 3) For larger three-way data:'''
* [[textreadr]] - Reads an ASCII or .XLS file in as a DataSet Object (formally xclreadr).
 
In the DataSet editor, you can import a full three-way array if you have it organized as a two-way matrix. Upon importing the two-way data, you can reshape to a three-way array using the menu item: Transform &rarr; Fold into 3-way.  
 
For example, you have the above matrices (three slabs) in one table/matrix:
 
  [ Slab1;
  Slab2;
  Slab3 ]
 
hence have the three slabs below each other. Upon importing, use the menu option described above to "Fold into 3-way" and choose three as the number of slabs and the data will be rearranged accordingly. If you are familiar with the MATLAB function <code>reshape</code>, you may also use Transform &rarr; Reshape for other types of rearrangements.  
 
Note: the result of this command will give you slabs in the 3rd mode of the DataSet. If these slabs are separate samples (such as with EEMs), you'll want to use the Transform &rarr; Permute menu to reorder the dimensions. For example, permuting to the order [3 2 1] would swap the order of the 1st and 3rd modes, putting slabs as the first mode.  
 
 
'''Still having problems? Please contact our helpdesk at [mailto:helpdesk@eigenvector.com helpdesk@eigenvector.com]'''
 
[[Category:FAQ]]

Revision as of 10:45, 20 June 2019

Issue:

How do I import three-way data into Solo or PLS_Toolbox?

Possible Solutions:

Solution 1) Built in EEM importers :

If applicable to your file type, use one of the built in EEM importers. There are importers for EEM data from Hitachi, Shimazdu, Horiba and Jasco. Please see this wiki entry for more information on Data Importing Formats

EEM data needs be configured in a specific way such that:

  • mode 1 corresponds to samples
  • mode 2 corresponds to emission
  • mode 3 corresponds to excitation

The built-in EEM importers will handle this configuration automatically. When importing manually (see below), further manipulation will likely be necessary. Use the Transform → Permute modes and Transform → Reshape smenu items to modify your imported data as appropriate.

Solution 2) For three-way data with few slabs:

  1. Import the data slabs into the workspace (browser). The workspace browser is available from the main analysis user interface from the menu item FigBrowser.
  2. Each slab, i.e. each matrix of data is imported individually. Hence, if you have a 10x8x3 array, you will import three slabs each of size 10x8.
  3. Use the mouse to drag slab two onto slab one. In the window that opens choose Augment and then choose augment in the Slabs direction.
  4. A two-slab three-way array has now replaced the first data matrix. More slabs can be added in the same fashion.

Alternatively, you may also open one slab in the dataset editor and then add additional slabs using File → Import. After selecting the next slab to import, answer the same questions as in step c above. Repeat for each slab.

Solution 3) For larger three-way data:

In the DataSet editor, you can import a full three-way array if you have it organized as a two-way matrix. Upon importing the two-way data, you can reshape to a three-way array using the menu item: Transform → Fold into 3-way.

For example, you have the above matrices (three slabs) in one table/matrix: 

 [ Slab1;
 Slab2;
 Slab3 ]

hence have the three slabs below each other. Upon importing, use the menu option described above to "Fold into 3-way" and choose three as the number of slabs and the data will be rearranged accordingly. If you are familiar with the MATLAB function reshape, you may also use Transform → Reshape for other types of rearrangements.

Note: the result of this command will give you slabs in the 3rd mode of the DataSet. If these slabs are separate samples (such as with EEMs), you'll want to use the Transform → Permute menu to reorder the dimensions. For example, permuting to the order [3 2 1] would swap the order of the 1st and 3rd modes, putting slabs as the first mode.


Still having problems? Please contact our helpdesk at helpdesk@eigenvector.com

Retrieved from "https://www.wiki.eigenvector.com/index.php?title=Release_Notes_Version_7_5&oldid=10020"