Academy Field Labs Hyperspectral signatures Field Lab 10 · Imaging spectroscopy
Read a spectral cube without turning a curve into an identity Move from wavelength metadata and bad-band QA to reference-linked spectra, fold-safe feature engineering, spatial validation and a qualified prediction map.
A CUBE HAS THREE AXES x y λ
Every pixel contains a sampled spectrum; every band is still an image. Neither view removes mixtures, noise or validation needs.
Lab evidence boundary The included 20-band signatures are sparse synthetic teaching curves—not a real contiguous hyperspectral cube, not species-identification evidence and not measurements from the 2024 Estonia campaign.
Measurement chain
Radiance → correction → reflectance → features → model Imaging spectrometers sample spectral radiance across many narrow bands. Reflectance requires calibration and atmospheric/illumination treatment. Features, endmembers and predictions are later analytical products.
01 RADIANCE CUBE02 SURFACE / ATMOSPHERIC MODEL03 REFLECTANCE CUBE04 VALID BANDS + PIXELS05 FEATURE PIPELINE06 PREDICTION + UNCERTAINTY
AVIRIS example—not a universal specification NASA’s AVIRIS-Classic records calibrated upwelling spectral radiance in 224 contiguous channels from 400 to 2500 nm. Other instruments have different wavelength ranges, bandwidths, response functions and quality flags.
Interactive spectrum · synthetic training data
A spectrum is a measured sequence with gaps and uncertainty Switch the illustrative target and then mask the flagged low-quality bands. The gap is honest: interpolation would be a separate modelling decision.
Illustrative dry meadow reflectance spectrum 0.5 0 450 2400 nm valid teaching band flagged low-quality band
20 bands displayed · 4 require review In an operational cube, use its sensor/product metadata and QA—not these instructional wavelengths—as the authority for exclusion.
Spatial support
One pixel can mix more than one material Change the illustrative areal mixture. A smooth intermediate curve is not a new pure material and does not prove either class occupies the whole pixel.
Dry-meadow fraction 60% 40% illustrative open water
450 nm 2400 nm 01 QUESTION02 CUBE03 LEVEL04 MASK05 SPECTRA06 EXPLORE07 FEATURES08 SPLIT09 MODEL10 MAP QA11 HANDOFF01 · QUESTION Define the target and reference domain ACTION Name the class or continuous response. Specify spatial and spectral support. Define acquisition timing and field/lab reference protocol. State what the model must not claim. CHECK Target labels are independent of the image features. Reference samples represent the intended mapping domain. OUTPUT Target specification, sampling plan and non-claims.
IF THIS FAILS Labels, support or domain of application are ambiguous.
02 · CUBE Audit cube dimensions and metadata ACTION Confirm row, column and band axis order. Read centre wavelength and bandwidth/FWHM for every band. Record radiance/reflectance scale, units, fill value, CRS and transform. Inventory quality layers, bad-band metadata and acquisition geometry. CHECK Band count matches wavelength metadata. Wavelengths increase as expected and scaling reproduces plausible values. OUTPUT Cube contract and band inventory.
IF THIS FAILS Axis order, wavelength mapping, units or scale is unknown.
03 · LEVEL Establish the measurement level ACTION Identify raw DN, radiance, apparent reflectance or surface-reflectance product. Read atmospheric/radiometric processing provenance. Keep radiance and reflectance products separately named. Inspect calibration or validation targets when supplied. CHECK The product level supports the proposed cross-pixel or cross-date comparison. Reflectance is not inferred from the file appearance. OUTPUT Measurement-level decision record.
04 · MASK Build spatial and spectral validity masks ACTION Apply fill, cloud/shadow and geometry masks relevant to the product. Read sensor/product bad-band flags. Review low-SNR, atmospheric-absorption and spectral-edge regions. Keep masked bands in provenance even when excluded from analysis. CHECK Masking follows metadata and observed QA, not a universal wavelength recipe. NaN/NoData are not converted to zero reflectance. OUTPUT Valid-pixel mask, valid-band mask and exclusion log.
05 · SPECTRA Extract spectra at compatible support ACTION Overlay reference geometry on the cube. Use plot/polygon summaries when a point does not represent the field footprint. Record pixel count, statistic and variability. Convolve high-resolution reference spectra to sensor response where comparison requires it. CHECK Field and image timing/support are compatible. Spectral-library samples match material state and measurement conditions closely enough for the claim. OUTPUT Reference-linked spectral table.
06 · EXPLORE Inspect spectral shape and uncertainty ACTION Plot class medians plus dispersion, not only one mean curve. Inspect signal-to-noise and residual striping. Compare spectra on the same units and wavelength support. Mark absorption regions before calculating features. CHECK Apparent separation exceeds within-class variation where claimed. Display smoothing has not silently replaced analysis values. OUTPUT Spectral QA plots and candidate-feature rationale.
IF THIS FAILS A visually attractive curve hides noise, outliers or unequal sample counts.
07 · FEATURES Engineer features inside the training design ACTION Choose raw bands, derivatives, ratios, continuum removal or dimensionality reduction from a physical hypothesis. Fit scalers, PCA or feature selection on training folds only. Preserve wavelength names and transform parameters. Test sensitivity to preprocessing choices. CHECK No validation or test pixels informed preprocessing. Feature count is defensible relative to independent sample count. OUTPUT Fold-safe feature pipeline and feature register.
IF THIS FAILS The full cube is normalized or reduced before splitting, causing leakage.
08 · SPLIT Separate spatially independent evaluation data ACTION Group samples by site, flight line, plot or spatial block. Keep nearby pixels from the same object in one fold. Reserve a final test domain where feasible. Record class balance and spectral coverage by fold. CHECK No mixed-pixel neighborhood appears in both training and validation. Rare classes remain evaluable. OUTPUT Spatial fold registry and held-out test set.
09 · MODEL Train a transparent baseline before complexity ACTION Fit a simple physically interpretable baseline. Compare more flexible models under identical folds. Tune hyperparameters inside training data only. Retain class probabilities or prediction intervals. CHECK Complexity improves held-out performance, not only training fit. Metrics include per-class or response-specific error. OUTPUT Validated model candidates and selection record.
10 · MAP QA Map predictions and their domain of applicability ACTION Apply the exact fitted preprocessing pipeline. Mask invalid pixels and extrapolative spectra. Map uncertainty, confidence or spectral distance. Inspect seams, striping and impossible salt-and-pepper patterns. CHECK Output grid and valid-data mask match the source contract. Low-confidence and outside-domain pixels remain distinguishable from target absence. OUTPUT Prediction, uncertainty and applicability rasters.
11 · HANDOFF Export a spectral evidence package ACTION Save source identifiers, band table and masks. Export training/fold registry, fitted pipeline and model card. Deliver prediction, uncertainty and applicability rasters. Document supported claims, sensitivity and non-claims. CHECK Every feature can be traced to wavelengths and preprocessing. A reviewer can reproduce the split and final map. OUTPUT Analysis-ready cube evidence, model and audit trail.
Prediction before reveal
Which order protects the test evidence? Spatial split → fit preprocessing on training folds → transform validation → evaluate Fit PCA on all pixels → random pixel split → evaluate Choose the prettiest feature map → tune labels → report the same pixels
Choose one processing order. High dimensionality makes leakage especially easy to hide. Analysis-ready handoff
The class map is the end of a chain, not the whole result SOURCE Cube identifiers, wavelengths, bandwidths, units and scale
VALIDITY Pixel mask, band mask, SNR/quality record and exclusions
REFERENCE Labels, support, timing, folds and spectral extraction table
MODEL Fitted preprocessing, features, estimator and selection record
OUTPUT Prediction, uncertainty, applicability and validation evidence
Supported: validated class or response predictions within the stated sensor, sampling and application domain.Not automatic: species identity, chemical concentration, stress cause or transfer to another date/sensor/site.Workstation pack
Download the spectral audit The table is synthetic, intentionally sparse and includes four flagged bands.
Authoritative references
Instrument, validation and spectral-library guidance