A common problem in the analysis of space-time data is to compress a large dataset in order to extract the underlying trends. Empirical orthogonal function (EOF) analysis is a useful tool for examining both the temporal and the spatial variation in atmospherical and physical process and a convenient method of performing this is the Singular Value Decomposition (SVD). Many spatio-temporal models for measurements Z(s; t) at location s at time t, can be written as a sum of a systematic component and a residual component: Z = M+E, where Z, M and E are all T x N matrices. Our approach permits modeling of incomplete data matrices using an "EM-like" iterative algorithm for the SVD. We model the trend, M, by linear combinations of smooth temporal basis functions derived from left (temporal) singular vectors of the SDV of Z with dimension of the model chosen by cross-validation. We further decompose by SVD the spatio-temporal residual matrix E computed as residuals from regressions at each site (column) of the observations on the smoothed temporal basis functions. Finally we fit an autoregressive model to the columns (time series) of residuals from the SVD of E. Our aim is to illustrate a simple model to characterize trends and model the variability in large spatio-temporal data matrices. The methodology is demostrated with a spatiotemporal dataset.

Onorati, R., Sampson, P.D., Guttorp, P. (2009). A spatio-temporal model based on the SVD to analyze large spatio-temporal datasets. In TIES 2009 – the 20th Annual Conference of The International Environmetrics Society, a Section of the ISI and GRASPA Conference 2009 "Handling complexity and uncertainty in environmental studies".

A spatio-temporal model based on the SVD to analyze large spatio-temporal datasets

ONORATI, Rossella;
2009-01-01

Abstract

A common problem in the analysis of space-time data is to compress a large dataset in order to extract the underlying trends. Empirical orthogonal function (EOF) analysis is a useful tool for examining both the temporal and the spatial variation in atmospherical and physical process and a convenient method of performing this is the Singular Value Decomposition (SVD). Many spatio-temporal models for measurements Z(s; t) at location s at time t, can be written as a sum of a systematic component and a residual component: Z = M+E, where Z, M and E are all T x N matrices. Our approach permits modeling of incomplete data matrices using an "EM-like" iterative algorithm for the SVD. We model the trend, M, by linear combinations of smooth temporal basis functions derived from left (temporal) singular vectors of the SDV of Z with dimension of the model chosen by cross-validation. We further decompose by SVD the spatio-temporal residual matrix E computed as residuals from regressions at each site (column) of the observations on the smoothed temporal basis functions. Finally we fit an autoregressive model to the columns (time series) of residuals from the SVD of E. Our aim is to illustrate a simple model to characterize trends and model the variability in large spatio-temporal data matrices. The methodology is demostrated with a spatiotemporal dataset.
Settore SECS-S/01 - Statistica
lug-2009
TIES Annual Conference of The International Environmetrics Society, a Section of the ISI and GRASPA Conference 2009
Bologna
July 5-9, 2009
20
2009
1
http://www2.stat.unibo.it/ties2009/doc/bookTIES2009Bologna.pdf
Onorati, R., Sampson, P.D., Guttorp, P. (2009). A spatio-temporal model based on the SVD to analyze large spatio-temporal datasets. In TIES 2009 – the 20th Annual Conference of The International Environmetrics Society, a Section of the ISI and GRASPA Conference 2009 "Handling complexity and uncertainty in environmental studies".
Proceedings (atti dei congressi)
Onorati, R; Sampson, PD; Guttorp, P
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/52889
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact