Importing Data and Release Notes Model Exporter Version 3 2: Difference between pages

From Eigenvector Research Documentation Wiki
(Difference between pages)
Jump to navigation Jump to search
imported>Donal
 
imported>Jeremy
(Created page with "Version 3.2 of Model_Exporter was released in June, 2015. For general product information, see Model_Exporter_User_Guide. ==NEW FEATURES / FIXES== * Add support for non-...")
 
Line 1: Line 1:
In addition to the Matlab functions to read various file types, PLS_Toolbox provides various functions for reading common data formats into DataSet Objects. Also see the [[editds|DataSet Editor]].
Version 3.2 of Model_Exporter was released in June, 2015. For general product information, see [[Model_Exporter_User_Guide]].


===High-Level File and Source Readers===
==NEW FEATURES / FIXES==
:[[areadr]] - Reads ascii data and strips header.
:[[autoimport]] - Automatically reads specified file. Handles all standard filetypes.
:[[asdreadr]] - Imports data from Analytical Spectral Devices (ASD) Indico (Versions 6 and 7) data files.
:[[asfreadr]] - Reads AIT ASF files.
:[[experimentreadr]] - Read an Experiment file and import corresponding files.
:[[getpidata]] - Uses the current PI connection to construct a DSO from 'taglist'.
:[[hjyreadr]] - Reads HORIBA Jobin Yvon files.
:[[hrmethodreadr]] - Converts HoloReact method into preprocessing structure.
:[[jcampreadr]] - Reads a JCAMP file into a DataSet object.
:[[mtfreadr]] - Read AdventaCT Multi-Trace Format (MTF) files.
:[[opusreadr]] - Read Bruker OPUS files.
:[[parsexml]] - Convert XML file to a MATLAB structure.
:[[querydb]] - Executes a query on a database defined by connection string.
:[[pereadr]] - Read PerkinElmer files.
:[[spcreadr]] - Reads a Galactic SPC file.
:[[snabsreadr]] - Reads Stellarnet ABS XY files.
:[[xclgetdata]] - Extracts matrix from an Excel spreadsheet.
:[[xclputdata]] - Write matrix to an Excel spreadsheet.
:[[xclreadr]] - Reads an ASCII or .XLS file in as a DataSet Object.
:[[xlsreadr]] - Reads .XLS files from MS Excel and other spreadsheets.
:[[xyreadr]]  - Reads one or more ASCII XY or XY... files into a DataSet object.


===Other Reading and Writing Utilities===
* Add support for non-negative least squares CLS models IF outputting to m-file format (requires function be enabled as sub-functions are added to accomplish the NNLS calculation)
:[[autoexport]] - Exports a DataSet object to a file of the specified format.
* Add support for approximate nearest neighbor distance via distancemetric option. This is an approximation of the NN distance, but is NOT exact.
:[[lddlgpls]] - Dialog to load variable from workspace or MAT file.
* Add support for application of most preprocessing methods to MATRICES
:[[svdlgpls]] - Dialog to save variable to workspace or MAT file.
** Allows use of PLS, PCR, PCA, CLS, and PLSDA on x-block of MATRICES (not just vectors) with basically all supported preprocessing methods
:[[builddbstr]] - Builds a database connection string.
* Add basic support for arithmetic on X-block (only - undo on y-block not supported)
:[[parsemixed]] - Parse numerical and text data into a DataSet Object.
* Change "prob" to "probs" in SVMDA so it matches PLSDA outputs
:[[autoexport]] - Exports a DataSet object to a file of the specified format.
* Fix bug where placeholder variables were not removed from data if SavGol preprocessing was the one and only preprocessing method
:[[writecsv]] - Export a DataSet object to a comma-separated values (CSV) file.
* Fix bug which would lead to indexing error in SavGol preprocessing if variables at the END of the spectrum are excluded
:[[writespc]] - Export a DataSet object to a Galactic SPC file.
   
   
(Sub topic of [[Import_View_Data|Import_View_Data]])
 
===Model Interpreter===
 
* Allow input of matrix instead of just vectors (some methods support applying to matrix)
* Force numeric conversion to be done expecting period as decimal separator (resolves problems interpreting models on systems set to other numeric formats like in France)
* Move math steps into new MEMath object (simplifies code - exposes mathematical operations to caller)

Revision as of 15:49, 15 June 2015

Version 3.2 of Model_Exporter was released in June, 2015. For general product information, see Model_Exporter_User_Guide.

NEW FEATURES / FIXES

  • Add support for non-negative least squares CLS models IF outputting to m-file format (requires function be enabled as sub-functions are added to accomplish the NNLS calculation)
  • Add support for approximate nearest neighbor distance via distancemetric option. This is an approximation of the NN distance, but is NOT exact.
  • Add support for application of most preprocessing methods to MATRICES
    • Allows use of PLS, PCR, PCA, CLS, and PLSDA on x-block of MATRICES (not just vectors) with basically all supported preprocessing methods
  • Add basic support for arithmetic on X-block (only - undo on y-block not supported)
  • Change "prob" to "probs" in SVMDA so it matches PLSDA outputs
  • Fix bug where placeholder variables were not removed from data if SavGol preprocessing was the one and only preprocessing method
  • Fix bug which would lead to indexing error in SavGol preprocessing if variables at the END of the spectrum are excluded


Model Interpreter

  • Allow input of matrix instead of just vectors (some methods support applying to matrix)
  • Force numeric conversion to be done expecting period as decimal separator (resolves problems interpreting models on systems set to other numeric formats like in France)
  • Move math steps into new MEMath object (simplifies code - exposes mathematical operations to caller)
Retrieved from "https://www.wiki.eigenvector.com/index.php?title=Importing_Data&oldid=9248"