Data Editing Scaling and Preprocessing: Difference between revisions

From Eigenvector Research Documentation Wiki
Jump to navigation Jump to search
imported>Jeremy
(Importing text file)
 
imported>Jeremy
(Importing text file)
Line 1: Line 1:
===Data Editing, Scaling, and Preprocessing===
:[[alignmat]] - Alignment of matrices and N-way arrays.
:[[preprocess]] - Selection and application of standard preprocessing structures.
:[[alignpeaks]] - Calibrates wavelength scale using standard peaks.
:[[preprouser]] - User-defined preprocessing methods.
:[[alignspectra]] - Calibrates wavelength scale using standard spectrum.
:[[editds]] - Editor for DataSet Objects.
:[[auto]] - Autoscales matrix to mean zero unit variance.
====Baselining and Offset Correction====
:[[baseline]] - Subtracts a polynomial baseline offset from spectra.
:[[baseline]] - Subtracts a polynomial baseline offset from spectra.
:[[baselinew]] - Baseline using windowed polynomial filter.
:[[baselinew]] - Baseline using windowed polynomial filter.
:[[wlsbaseline]] - Weighted least squares baseline function.
:[[batchdigester]] - Parse wafer or batch data into MPCA or Summary PCA form.
:[[mscorr]] - Multiplicative scatter/signal correction (MSC).
:[[coadd]] - Reduce resolution through combination of adjacent variables or samples.
:[[savgol]] - Savitzky-Golay smoothing and differentiation.
:[[delsamps]] - Deletes samples (rows) or variables (columns) from data matrices.
:[[deresolv]] - Changes high resolution spectra to low resolution.
:[[editds]] - Editor for DataSet Objects.
:[[excludemissing]] - Automatically exclude too-much missing data in a matrix.
:[[glsw]] - Generalized least-squares weighting/preprocessing.
:[[gscale]] - Group/block scaling for a single or multiple blocks.
:[[gscaler]] - Applies group/block scaling to submatrices of a single matrix.
:[[lamsel]] - Determines indices of wavelength axes in specified ranges.
:[[logdecay]] - Mean centers and variance scales a matrix using the log decay of the variable axis.
:[[lsq2top]] - Fits a polynomial to the top/(bottom) of data.
:[[lsq2top]] - Fits a polynomial to the top/(bottom) of data.
:[[mdcheck]] - Missing Data Checker and infiller.
:[[med2top]] - Fits a constant to top/(bottom) of data.
:[[med2top]] - Fits a constant to top/(bottom) of data.
====Derivatives and Smoothing====
:[[medcn]] - Median center scales matrix to median zero.
:[[savgol]] - Savitzky-Golay smoothing and differentiation.
:[[mncn]] - Scale matrix to mean zero.
:[[polyinterp]] - Polynomial interpolation, smoothing, and differentiation.
====Sample-wise scaling corrections (Normalizing)====
:[[mscorr]] - Multiplicative scatter/signal correction (MSC).
:[[mscorr]] - Multiplicative scatter/signal correction (MSC).
:[[normaliz]] - Normalize rows of matrix.
:[[normaliz]] - Normalize rows of matrix.
:[[snv]] - Standard normal variate scaling.
:[[npreprocess]] - Preprocessing of multi-way arrays.
====Variable-wise scaling and offset corrections====
:[[oscapp]] - Applies OSC model to new data.
:[[auto]] - Autoscales matrix to mean zero unit variance.
:[[osccalc]] - Calculates orthogonal signal correction (OSC).
:[[mncn]] - Scale matrix to mean zero.
:[[polyinterp]] - Polynomial interpolation, smoothing, and differentiation.
:[[medcn]] - Median center scales matrix to median zero.
:[[preprocess]] - Selection and application of standard preprocessing structures.
:[[logdecay]] - Mean centers and variance scales a matrix using the log decay of the variable axis.
:[[preprouser]] - User-defined preprocessing methods.
:[[registerspec]] - Shift spectra based on expected peak locations.
:[[rescale]] - Scales data back to original scaling.
:[[savgol]] - Savitzky-Golay smoothing and differentiation.
:[[savgolcv]] - Cross-validation for Savitzky-Golay smoothing and differentiation.
:[[scale]] - Scales data using specified means and std. devs.
:[[scale]] - Scales data using specified means and std. devs.
:[[rescale]] - Scales data back to original scaling.
:[[gscale]] - Group/block scaling for a single or multiple blocks.
:[[gscaler]] - Applies group/block scaling to submatrices of a single matrix.
====Interference Removal and Missing Data====
:[[glsw]] - Generalized least-squares weighting/preprocessing.
:[[mdcheck]] - Missing Data Checker and infiller.
:[[osccalc]] - Calculates orthogonal signal correction (OSC).
====Sample and Variable handling====
:[[coadd]] - Reduce resolution through combination of adjacent variables or samples.
:[[delsamps]] - Deletes samples (rows) or variables (columns) from data matrices.
:[[excludemissing]] - Automatically exclude too-much missing data in a matrix.
:[[lamsel]] - Determines indices of wavelength axes in specified ranges.
:[[shuffle]] - Randomly re-orders matrix and multiple blocks rows.
:[[shuffle]] - Randomly re-orders matrix and multiple blocks rows.
:[[snv]] - Standard normal variate scaling.
:[[specedit]] - GUI for selecting spectral regions on a plot.
:[[specedit]] - GUI for selecting spectral regions on a plot.
:[[super_reduce]] - Eliminates highly correlated variables.
:[[unfoldm]] - Rearranges (unfolds) an augmented matrix to row vectors.
:[[unfoldm]] - Rearranges (unfolds) an augmented matrix to row vectors.
:[[unfoldmw]] - Unfolds multiway arrays along specified order.
:[[unfoldmw]] - Unfolds multiway arrays along specified order.
:[[batchdigester]] - Parse wafer or batch data into MPCA or Summary PCA form.
:[[wlsbaseline]] - Weighted least squares baseline function.
(Sub topic of [[Categorical_Index|Categorical_Index]])

Revision as of 15:40, 2 September 2008

alignmat - Alignment of matrices and N-way arrays.
alignpeaks - Calibrates wavelength scale using standard peaks.
alignspectra - Calibrates wavelength scale using standard spectrum.
auto - Autoscales matrix to mean zero unit variance.
baseline - Subtracts a polynomial baseline offset from spectra.
baselinew - Baseline using windowed polynomial filter.
batchdigester - Parse wafer or batch data into MPCA or Summary PCA form.
coadd - Reduce resolution through combination of adjacent variables or samples.
delsamps - Deletes samples (rows) or variables (columns) from data matrices.
deresolv - Changes high resolution spectra to low resolution.
editds - Editor for DataSet Objects.
excludemissing - Automatically exclude too-much missing data in a matrix.
glsw - Generalized least-squares weighting/preprocessing.
gscale - Group/block scaling for a single or multiple blocks.
gscaler - Applies group/block scaling to submatrices of a single matrix.
lamsel - Determines indices of wavelength axes in specified ranges.
logdecay - Mean centers and variance scales a matrix using the log decay of the variable axis.
lsq2top - Fits a polynomial to the top/(bottom) of data.
mdcheck - Missing Data Checker and infiller.
med2top - Fits a constant to top/(bottom) of data.
medcn - Median center scales matrix to median zero.
mncn - Scale matrix to mean zero.
mscorr - Multiplicative scatter/signal correction (MSC).
normaliz - Normalize rows of matrix.
npreprocess - Preprocessing of multi-way arrays.
oscapp - Applies OSC model to new data.
osccalc - Calculates orthogonal signal correction (OSC).
polyinterp - Polynomial interpolation, smoothing, and differentiation.
preprocess - Selection and application of standard preprocessing structures.
preprouser - User-defined preprocessing methods.
registerspec - Shift spectra based on expected peak locations.
rescale - Scales data back to original scaling.
savgol - Savitzky-Golay smoothing and differentiation.
savgolcv - Cross-validation for Savitzky-Golay smoothing and differentiation.
scale - Scales data using specified means and std. devs.
shuffle - Randomly re-orders matrix and multiple blocks rows.
snv - Standard normal variate scaling.
specedit - GUI for selecting spectral regions on a plot.
super_reduce - Eliminates highly correlated variables.
unfoldm - Rearranges (unfolds) an augmented matrix to row vectors.
unfoldmw - Unfolds multiway arrays along specified order.
wlsbaseline - Weighted least squares baseline function.

(Sub topic of Categorical_Index)