- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- UBC Faculty Research and Publications /
- Adaptive Nonlinear MOS Scheme for Precipitation Forecasts...
Open Collections
UBC Faculty Research and Publications
Adaptive Nonlinear MOS Scheme for Precipitation Forecasts Using Neural Networks. Yuval 2011
pdf
Page Metadata
Item Metadata
Title | Adaptive Nonlinear MOS Scheme for Precipitation Forecasts Using Neural Networks. |
Creator |
Yuval Hsieh, William W. |
Publisher | American Meteorological Society |
Date Created | 2011-04-05 |
Date Issued | 2003-04-01 |
Description | A novel neural network (NN)–based scheme performs nonlinear model output statistics (MOS) for generating precipitation forecasts from numerical weather prediction (NWP) model output. Data records from the past few weeks are sufficient for establishing an initial MOS connection, which then adapts itself to the ongoing changes and modifications in the NWP model. The technical feasibility of the algorithm is demonstrated in three numerical experiments using the NCEP reanalysis data in the Alaskan panhandle and the coastal region of British Columbia. Its performance is compared with that of a conventional NN-based nonadaptive scheme. When the new adaptive method is employed, the degradation in the precipitation forecast skills due to changes in the NWP model is small and is much less than the degradation in the performance of the conventional nonadaptive scheme. Copyright 2003 American Meteorological Society (AMS). Permission to use figures, tables, and brief excerpts from this work in scientific and educational works is hereby granted provided that the source is acknowledged. Any use of material in this work that is determined to be “fair use” under Section 107 of the U.S. Copyright Act or that satisfies the conditions specified in Section 108 of the U.S. Copyright Act (17 USC §108, as revised by P.L. 94-553) does not require the AMS’s permission. Republication, systematic reproduction, posting in electronic form, such as on a web site or in a searchable database, or other uses of this material, except as exempted by the above statement, requires written permission or a license from the AMS. Additional details are provided in the AMS Copyright Policy, available on the AMS Web site located at (http://www.ametsoc.org/) or from the AMS at 617-227-2425 or copyright@ametsoc.org. |
Genre |
Article |
Type |
Text |
Language | Eng |
Collection |
Atmospheric Science Program |
Date Available | 2011-04-05 |
DOI | 10.14288/1.0041822 |
Affiliation |
Science, Faculty of Earth and Ocean Sciences, Department of |
Citation | Yuval, Hsieh, William W. 2003. Adaptive Nonlinear MOS Scheme for Precipitation Forecasts Using Neural Networks. Weather and Forecasting 18(2) 303-310. dx.doi.org/10.1175/1520-0434(2003)018<0303:AANMSF>2.0.CO;2 |
Peer Review Status | Reviewed |
Scholarly Level | Faculty |
Copyright Holder | Hsieh, William W. |
URI | http://hdl.handle.net/2429/33327 |
Digital Resource Original Record | https://open.library.ubc.ca/collections/32536/items/1.0041822/source |
Download
- Media
- Hsieh_AMS_2003_WF303.pdf
- Hsieh_AMS_2003_WF303.pdf [ 1.08MB ]
- Metadata
- JSON: 1.0041822.json
- JSON-LD: 1.0041822+ld.json
- RDF/XML (Pretty): 1.0041822.xml
- RDF/JSON: 1.0041822+rdf.json
- Turtle: 1.0041822+rdf-turtle.txt
- N-Triples: 1.0041822+rdf-ntriples.txt
- Citation
- 1.0041822.ris
Full Text
APRIL 2003 303Y U V A L A N D H S I E H q 2003 American Meteorological Society An Adaptive Nonlinear MOS Scheme for Precipitation Forecasts Using Neural Networks YUVAL AND WILLIAM W. HSIEH Department of Earth and Ocean Sciences, University of British Columbia, Vancouver, British Columbia, Canada (Manuscript received 1 August 2002, in final form 3 December 2002) ABSTRACT A novel neural network (NN)–based scheme performs nonlinear model output statistics (MOS) for generating precipitation forecasts from numerical weather prediction (NWP) model output. Data records from the past few weeks are sufficient for establishing an initial MOS connection, which then adapts itself to the ongoing changes and modifications in the NWP model. The technical feasibility of the algorithm is demonstrated in three numerical experiments using the NCEP reanalysis data in the Alaskan panhandle and the coastal region of British Columbia. Its performance is compared with that of a conventional NN-based nonadaptive scheme. When the new adaptive method is employed, the degradation in the precipitation forecast skills due to changes in the NWP model is small and is much less than the degradation in the performance of the conventional nonadaptive scheme. 1. Introduction Model output statistics (MOS) is a process by which a statistical relationship between the output of a nu- merical weather prediction (NWP) model and obser- vations is established in order to improve forecasts. This process is most often applied to forecast problems where the variable to be forecasted is not produced by the NWP model, or for downscaling where the spatial resolution of the NWP model is too coarse. Rough terrain, lack of observations, and yet inadequate understanding of var- ious physical processes are additional problems that contribute to reduced predictability of the NWP and call for additional processing by MOS. A major obstacle in implementing an MOS prediction system is the ongoing modification of NWP models. Improvements in the dynamic and data assimilation schemes, changes in the observation system, and re- finements of the temporal and spatial resolution of the numerical solutions all contribute to changes in the NWP model characteristics. The weather system itself is also changing on various timescales. No doubt then that the connection between the NWP output and the weather variables such as precipitation must be chang- ing as well, and that calls for MOS prediction schemes that adapt themselves accordingly. In a recent paper, Wilson and Vallée (2002) described the updateable MOS (Ross 1987) system of the Meteorological Service of Canada. This system is based on updating the dataset Corresponding author address: William Hsieh, Dept. of Earth and Ocean Sciences, University of British Columbia, 6339 Stores Rd., Vancouver, BC V6T 1Z4, Canada. E-mail: whsieh@eos.ubc.ca from which the linear MOS empirical relationships are developed. A direct estimation and update of parameters of a linear MOS relationship from sequential data can be carried out by Kalman filtering (Grewal 1993). The authors are not aware of an existing technique to con- tinuously update a nonlinear MOS relationship. An in- teresting alternative for nonlinear MOS forecasts of pre- cipitation was introduced by Xia and Chen (1999). Their model output dynamics scheme is based on the modi- fication of the model vertical velocity given the last rain observations. Factors like topography cannot be incor- porated in this method and thus its capability is limited in mountainous areas like British Columbia (BC). The importance of a short-term localized precipitation forecasts for flood control, transportation safety, land- slide and avalanche prediction, and for the general pub- lic’s interest put it in the focus of many research efforts (Ebert 2001; Mao et al. 2000; Hall et al. 1999; Koizumi 1999; Xia and Chen 1999; Kuligowski and Barros 1998a,b; Krzysztofowicz 1998). Prediction of precipi- tation is notoriously difficult and it is a prime example where NWP models fail very often, calling for estab- lishment of MOS schemes. The relationship between the NWP variables and the true precipitation cannot by any means be assumed to be linear. Thus, several studies (Hall et al. 1999; Koizumi 1999; Kuligowski and Barros 1998a,b) employed neural networks (NNs) to form the statistical connection. In all of these cases the NWP model, and the MOS scheme, were frozen in time. This paper proposes an NN-based MOS process that adapts itself continuously. At each time point, an NN is trained to form the connection between the 6-h ac- cumulated precipitation at a set of measuring stations 304 VOLUME 18W E A T H E R A N D F O R E C A S T I N G and the corresponding NWP forecasts valid for that time. This NN model is a modification of an existing references model trained using all the data, in all the stations during a short period of time sometime before present. The updated model is constructed to best fit the new observed data (using predictors of a possibly mod- ified NWP model), keeping the desirable characteristics provided by the reference. The training process is com- pletely automatic and the decisions about the level of modification are made according to a well-defined math- ematical criterion (Golub et al. 1979). Providing precipitation forecasts in the coastal region of the North American Pacific Northwest is a challeng- ing problem because of the acute topographical varia- tions and the large Pacific data void, which does not enable proper initializations of NWP models. The cur- rent precipitation forecasts for the region are not sat- isfactory and we hope this work will serve as a basis for the future establishment of a MOS precipitation fore- casting system in the observation stations participating in the Emergency Weather Network of BC (currently under construction), using output of the high-resolution NWP models run by the Atmospheric Sciences Pro- gramme at the University of British Columbia. In this paper, data from the National Centers for Environmental Prediction–National Center for Atmospheric Research (NCEP–NCAR) reanalysis set (Kalnay et al. 1996) are used to demonstrate the technical feasibility of estab- lishing the proposed scheme. The expected differences and difficulties in its application in an operational mode are discussed. 2. The adaptive NN a. The modeling process A system of N precipitation observation stations is considered. A set of K NWP variables are believed to be associated with the precipitation at each of these stations and are used as predictors. The accumulated observed precipitation between ti21 and ti in the N ob- servation stations are provided by . The correspond-obsyi ing K NWP predictor variables are given in the K 3 N matrix Xi, and each of its N columns contains the NWP values associated with one observation station at time ti. The NWP predictors can be variables from grid points in the vicinity of that station, and valid at various time points (e.g., ti, ti21, ti22, ti23, . . .). The choice of pre- dictors is problem dependent and requires some explo- ration. Additional quantities like local topographical in- formation can also be included. Note that the prediction lead time of the process was not mentioned. It equals the time elapsed between production of the NWP var- iables at ti 2 D and the prediction time ti. The number of observation stations N is not con- strained to be a constant and its value can change from one time point to another if the number of stations that actually report precipitation vary. This is important for operational systems where more likely than not a few of the stations fail to report at any given time point. The NN relationship connecting the precipitation val- ues and the NWP model output is described by caly 5 F [X , w ],ii i (1) where is a vector of current precipitation valuescalyi calculated by the NN model whose parameters are stored in the vector w i, using the information provided by Xi. A detailed description of F will be given in the next subsection. The values wi are the ones that minimize the cost function: obs cal 2 2f 5 | y 2 y | 1 b | w 2 w | ,i i i ref (2) where wref contains the reference NN model parameters and b is a parameter determining the trade-off between the data fit constraints in the first term of f and the requirement of the model to be close to the reference one, expressed in the second term. The value of b is chosen automatically by simultaneously minimizing f and the general cross-validation (GCV) function (Haber and Oldenburg 2000; Yuval 2000). Minimizing the GCV function ensures that the NN model is optimally tuned for the prediction of data points not used in the model’s development, and for the avoidance of overfitting (Ha- ber and Oldenburg 2000; Golub et al. 1979). A natural candidate for the reference model wref is the previous day’s model, wi21. However, we found it more beneficial to use as a reference a model based on the data accu- mulated over a slightly longer period of time. Using the latter option, it is advisable, although not imperative, to periodically update the reference model as more data are accumulated. The spatial distribution of the precipitation at the next time point, ti11, is predicted by prey 5 F [X , w ].i11i11 i (3) When the observations become available, they canobsyi11 be compared to in order to evaluate the accuracypreyi11 by which the NN model predicted the observations. These new observations, and the corresponding NWP values Xi11, are then used to produce the updated NN parameters for the prediction in the next time point. The process of updating the model elements and pre- dicting future precipitation values is repeated continu- ously. Small, or no, changes to the model parameters are needed if no significant changes have occurred in the system since the last update of the reference model. In that case, a reasonable fit between yobs and ycal can be achieved by a model close to the reference, and the GCV controlled training is likely to choose a large value for the b in Eq. (2). However, at times of seasonal changes or following modifications in the NWP, the re- lationship between the NWP output X and the observed precipitation yobs does not remain the same. In this case, the reference model parameters cannot provide an ad- equate fit between yobs and ycal . The chosen value of b APRIL 2003 305Y U V A L A N D H S I E H will be appropriately small, enabling a large deviation of the model from the reference to adapt it to the new relationship. b. The neural network model The relationship between the NWP output variables and the spatial precipitation values is modeled by F [X, w] 5 F [X, W , B , w , b ]1 1 2 2 5 w [F(W X 1 B )] 1 b , (4)1 12 2 where F is the hyperbolic tangent function, W1 is an L 3 K matrix, B1 is an L 3 N matrix with identical col- umns, w2 is a 1 3 L row vector, and b2 is a 1 3 N row vector with identical elements. In the NN literature, F is usually called a two-layer feedforward NN. The ma- nipulations of X by W1 and B1 are referred to as the NN’s first, or hidden, layer, and F is the hidden layer’s transfer function. The value of L is called the number of hidden neurons. The larger it is, the more complex is the NN model. It is convenient to store all the ele- ments of W1, B1, w2, and b2 in one vector of NN model parameters, w. It has been shown by Cybenko (1989), Hornik et al. (1989), and Funahashi (1989) that a two-layer feedfor- ward NN can approximate arbitrarily well any contin- uous nonlinear function given a set of inputs X and a sufficient number of hidden neurons L. The NN is thus assured to be able to sufficiently simulate the desired relationship at any given time, no matter how complex and nonlinear this relationship might be. The problem is to find the model parameters that enable the model to capture the actual relationship between the NWP out- put and the observed values while avoiding fitting to noise (from both measurements and calculation arti- facts). The assumption of our methodology is that, at a given time point, the physical processes governing the rela- tionship between the predictor variables and precipita- tion is the same in all the stations. The same NN model [w i of Eq. (1)] is simulating this relationship, and the predicted spatial differences in the precipitation are due to the differences in the corresponding NWP predictors at the various locations. This assumption certainly does not hold in the very general case. Many different pro- cesses like large synoptic troughs, small-scale turbu- lence, and orographic lifting can lead to precipitation, and the relationship between NWP predictors and the precipitation is not necessarily the same in all these cases. For example, it was not surprising to find out that the NN model that works well for predicting large-scale synoptic precipitation along the BC coast is not suitable for predictions of precipitation in the interior BC Peace River region where most of the precipitation comes from local summer thunderstorms. Thus the MOS system should include only stations where the precipitation is predominantly generated by similar physical processes. Different systems can be constructed for different re- gions. In this paper only stations along the BC coast and the Alaska panhandle were included. 3. Data The data in this study are from the NCEP–NCAR reanalysis project (Kalnay et al. 1996), which uses a state-of-the-art global assimilation model to create a comprehensive dataset that is as complete as possible. The output variables are calculated on two different grids, a Gaussian T62 grid with 192 3 94 points (about 1.98 3 1.98), and a 2.58 3 2.58 latitude–longitude grid. The 6-hourly data (four times a day) from 1 January 2000 to 31 December 2001 were used in this paper. This study considers the data of the coastal Pacific Northwest, from northern Washington State (47.58N) to the BC–Yukon Territories border (60.08N), including the Alaska panhandle (Fig. 1). The precipitation in this area is given in 31 Gaussian grid points. Sixteen atmospheric variables, believed to be related to the precipitation rate, were chosen as predictors. A deliberate choice was made to use only predictor variables given on the latitude– longitude grid. Their values had to be interpolated to the precipitation grid locations imitating the real-life situation where the NWP grid points usually do not coincide with the locations of the precipitation mea- surement stations. The interpolation was crude—each precipitation grid point was associated with the predic- tors values in the closest latitude–longitude grid point. This simulates the expected inaccurate interpolation of NWP output values over the rough terrain of the Coastal Mountains region. The predictor variables are 1000-, 850-, and 500-mb air temperature (K); 1000-, 850-, and 500-mb geopo- tential height (m); 1000-, 850-, 700-, and 500-mb ver- tical velocity (m s21); 1000-, 850-, and 500-mb relative humidity (%); and 1000-, 850-, and 500-mb specific humidity (kg kg21). Values of these predictors were available four times a day at 0000, 0600, 1200, and 1800 UTC. The 6-hourly accumulated precipitation rate [mm (6 h)21] in between these hours (i.e., 0000–0600, 0600–1200 UTC, etc.) at the 31 stations is the predic- tand. It must be noted that the NCEP precipitation is purely model based so the NN models only simulate the dynamic model that generates it. Neither are the tem- poral errors in the NWP predictors simulated in this study. This should not affect the conclusions about the effectiveness of the adaptive process as its performance is compared to a nonadaptive one benefiting from the same advantage. For simplicity, only predictor variables valid at the prediction time of the MOS process were used. For an operating MOS system, NWP variables valid for previous time points should also be considered and can help improve consistent temporal errors in the NWP predictors. 306 VOLUME 18W E A T H E R A N D F O R E C A S T I N G FIG. 1. Map of the study area. Locations of the NCEP–NCAR precipitation values are marked with asterisks. 4. Results The suggested methodology is based on updating an NN-based MOS connection established using short data records of many stations simultaneously. Its results are demonstrated, and compared in this section to those achieved by a conventional (e.g., Kuligowski and Barros 1998b) NN-based MOS connection that is developed individually for each station using long data records, but with no updates to the model. The comparison meth- od is referred to henceforth as the benchmark. For the benchmark, data of 1 yr (1460 time points) were used to develop an individual model at each station connecting the 16 predictor variables, simulating NWP output, to the precipitation predictand. The models were developed using the MATLAB Levenberg–Marquardt routine (Demuth and Beale 2000). The performance of these models was tested in the following year during which the predictors were modified in various ways to simulate the modifications that occur in the NWP output. A reference model is needed in order to apply the adaptive MOS approach. This reference model was de- veloped using only the data of the last month of the first year. The same modified predictors were used to update the adaptive model and predict the precipitation during the second year. Testing the predictions in this case was carried out by using the model, updated by the new data of a 6-h period, to predict the precipitation of the cor- responding 6-h period in the next day. The frequent updating ensures prompt adaptation to possible changes in the NWP but is not necessary if the changes are known to occur on a less regular basis. Three numerical experiments were carried out. In the first one, no modifications were applied to the data in the testing year to compare the performance of the MOS schemes in the case where a ‘‘frozen’’ NWP model is used. In practice, NWP models are never frozen and two other experiments compared the performance of the two schemes in scenarios where the testing period predictors were modified. In one experiment the modifications were carried out according to V 5 V 1 n sgn(V) | V | , where V is a predictor value; sgn(V) 5 21, 0, 1 for V , 0, 5 0, . 0, respectively; and | · | denotes taking an absolute value. This results in a modification that is linearly proportional to the magnitudes of the predictor values with the parameter n controlling the amount of modification. The testing year was divided into 10 equal periods with n 5 0.01, 0.05, 0.10, 0.05, 0.01, 20.01, 20.05, 20.1, 20.05, and 20.01. Thus the level of the linear modification changed every 146 time points (about 5 weeks). The second type of modification was carried out according to V 5 sgn(V) | V | n with n 5 7/6, 6/5, 5/4, 6/5, 7/6, 6/7, 5/6, 4/5, 5/6, and 6/7 in the 10 segments of the testing year. The modified pre- dictor values in this case are proportional to powers of the values, resulting in a nonlinear modification. The predictor series were all normalized prior to the mod- ification so that only the relative magnitudes, not the units of the variables, dictate the amount of modifica- tion. Additional experimentation with combined linear and nonlinear predictor modifications, different division of the testing period, and different ranges for the value of n lead to conclusions similar to those extracted from the results of the three experiments presented below. Figure 2 shows scatterplots of precipitation predic- tions against the observations at all the stations during the period of the testing year using the unmodified data. The predictions in Fig. 2a were produced by models updated every time point according to the method pro- posed in this paper. Figure 2b shows the corresponding plot for the benchmark where models were trained sep- arately for each station using the full data record of the training year. The reduced scatter in Fig. 2b compared to that in Fig. 2a, and the better corresponding corre- lation and root-mean-square error (rmse) scores, given APRIL 2003 307Y U V A L A N D H S I E H FIG. 2. Scatterplots of observed and predicted precipitation in the case of the nonmodified NWP predictors. The solid line is the perfect one-to-one fit. The dashed line is the least squares fit to the data. The least squares parameters are given in Table 1. The predictions are by (a) the adaptive MOS scheme and (b) the benchmark conventional nonadaptive MOS scheme. TABLE 1. The slope and intercept values of the least squares fit lines in Figs. 2, 3, and 5 (tests 1, 2, and 3, respectively). Test 1 Slope Intercept Test 2 Slope Intercept Test 3 Slope Intercept Adaptive Nonadaptive 0.74 0.73 0.57 0.31 0.72 0.69 0.82 1.76 0.78 0.83 0.60 0.51 in Table 2, show a clear advantage for the benchmark method. This is not surprising bearing in mind that, with no modifications, the data in both training and testing periods in this case are produced by the same frozen NCEP data assimilation model. The results in Fig. 2 are what we expect to see in the ideal case of an MOS scheme developed for an NWP model that never changes. The benchmark, using train- ing on much longer data records, and a tailored model for each station, results in superior predictions and should have been chosen for practical use in the case of an MOS system using a frozen NWP model. Unfor- tunately, NWP models invariably change so a more re- alistic comparison is that of the performance of the two methods using testing predictors data that were some- what modified. Figure 3 shows the scatterplots resulting from the second experiment where the predictors in the testing period were linearly modified. Both plots show more scatter than the plots in Fig. 2 but while Fig. 3a, showing results of the adaptive method, is quite similar to the corresponding plot in Fig. 2a, the scatterplot from the benchmark (Fig. 3b) shows much greater scatter than does Fig. 2b. The correlation and rmse skills achieved by the benchmark in this case (Table 2) are significantly worse than those for the nonmodified data and are in- ferior to those achieved by the adaptive method. Figure 4 compares the probability of detection (POD), the false-alarm rate (FAR), and the threat score (TS) (Wilks 1995) of the results achieved by the adaptive method and the benchmark. These three measures are more suitable than the correlation and rmse skills for ranking predictions of events of interest, which are less likely to occur than not. Precipitation forecasts, especially heavy precipitation events, are thus better ranked using these measures. The POD is the ratio of predictions of events (i.e., precipitation above a certain threshold) that were predicted and materialized, to the number of ob- servations of these events. The FAR is the ratio of pre- dicted events that did not materialize to the total number of predictions of such events. The TS, the most common among the accuracy measures in precipitation prediction studies, is the ratio of materialized forecasts to the total number of occasions in which an event was forecasted and/or observed. The range of the three measures is [0, 1] with the POD and TS having positive orientation, that is, a score of unity is best, and the FAR having negative orientation. Readers are advised to consult Wilks (1995) for a more complete discussion of these measures and the contingency table from which they are derived. The POD values of the adaptive method in Fig. 4 are in general slightly higher than those of the benchmark. With linearly modified predictors, a little degradation is noticed in most of the scores relative to those achieved using nonmodified predictors. The better POD values of the the adaptive method, especially at higher precip- itation thresholds, signify a better capability in fore- casting large precipitation events than the benchmark. This capability is unfortunately, but not surprisingly, accompanied by a higher rate of false alarms when using 308 VOLUME 18W E A T H E R A N D F O R E C A S T I N G FIG. 3. Same as Fig. 2 but for the case of linearly modified NWP predictors. TABLE 2. The correlation (corr) and rmse skills of the results ob- tained by the adaptive and nonadaptive schemes using the nonmo- dified testing data (test 1), the testing data with linearly modified predictors (test 2), and the testing data with nonlinearly modified predictors (test 3). Test 1 Corr Rmse Test 2 Corr Rmse Test 3 Corr Rmse Adaptive Nonadaptive 0.74 0.83 0.73 0.56 0.59 0.25 1.05 2.76 0.69 0.52 0.86 1.38 FIG. 4. Plots of the POD, FAR, and TS scores. The 3 symbols denote results obtained by the adaptive MOS scheme; circles denote the benchmark. Solid lines are the results for the case of the non- modified NWP predictors, and dashed lines are results for the linearly modified NWP predictors. the nonmodified data. However, the false alarm rate of the benchmark degrades much more, and far exceeds that of the the adaptive method when using the linearly modified data. The relatively small degradation in the FAR scores obtained in this case by the adaptive method suggests its possible advantage in reducing false alarms when the NWP outputs are occasionally biased up or down. A similar advantage is demonstrated by inspect- ing the TS results, which take into account both ability to predict events and to avoid falsely calling for their occurrence. The TS results of the benchmark are slightly higher than those of the adaptive method for the non- modified data, but the degradation resulting from the use of modified predictors pushes the benchmark TS curve well below that of the adaptive method. Figures 5 and 6 compare the results achieved in the third experiment where the predictors, simulating NWP output, were nonlinearly modified. Figure 5a is a scat- terplot obtained using the adaptive method. Only a little additional scatter is detected in this plot compared to that in Fig. 2a, where nonmodified data were used, and the correlation and rmse skills are only slightly degrad- ed. The scatter of the predictions by the benchmark in Fig. 5b is clearly worse in this case compared to the scatter in Fig. 2b, and the corresponding correlation and rmse scores are obviously not as good. The POD, FAR, and TS results shown in Fig. 6 convey similar infor- mation to that provided by Fig. 4 in the case of the linearly modified predictors. That is, more accurate pre- dictions were achieved by the benchmark when frozen NWP output was used, but the deleterious effects of alterations in the predictors affected the adaptive MOS method significantly less. 5. Discussion and conclusions This paper proposes a method to adapt NN-based MOS prediction of precipitation as new NWP output and observations arrive. Its main advantages are the APRIL 2003 309Y U V A L A N D H S I E H FIG. 5. Same as Fig. 2 but for the case of nonlinearly modified NWP predictors. FIG. 6. Same as Fig. 4 but dashed lines are for the case of the nonlinearly modified NWP predictors. relatively short length of data record required to estab- lish the MOS connection, and the ability to adapt this connection to changes in the NWP model and/or ob- servations. The method assumes that the physical pro- cesses that lead to the precipitation at the different ob- servation locations are similar and that the differences in the MOS connection are only due to differences in the predictors. The performance of the proposed method was demonstrated in three numerical experiments and was compared to that of a benchmark nonadaptive NN- based MOS scheme. A nonadaptive scheme benefits from the information provided by longer data records (in case they are available) to establish the MOS con- nection, and can be tailored separately for each location. The advantage of longer data records was evident in the superior prediction achieved by the benchmark while using data produced by a frozen dynamic model. Mod- ifying the MOS predictors, to simulate changes in the NWP model, resulted in severe degradation of the MOS prediction by the benchmark. The performance of the adaptive scheme was not as severely affected by the modification in the NWP output, suggesting it might be of use for improving operational NWP predictions when frequent modifications in the NWP operation prevent the establishment of a conventional MOS scheme. The study described in this paper used NCEP re- analysis records of atmospheric variables as the NWP predictors, and the purely model-based NCEP precipi- tation record as the predictand. Being purely model based, the NCEP precipitation does not necessarily agree with any observed precipitation values. It is rather tuned to agree with related variables like vertical ve- locity, specific humidity, and latent heat flux, which are smoothed over the NCEP analysis grid. Thus the spatial and temporal distribution of the precipitation values are not expected to closely resemble the real ones. Our com- parison of the NCEP precipitation records at selected locations where rain gauge observations were available revealed substantial differences on a value by value ba- sis. However, with the exception of lack of extreme values [above 25 mm (6 h)21] in the range, irregularity of the series, and the shape of the probability density function, the NCEP precipitation records in the study region are quite similar to the observed ones. The typical difficulties in predicting observed precipitation also ap- pear while predicting the ones produced by the NCEP model. We thus believe that the use of NCEP precipitation to demonstrate the technical feasibility of establishing 310 VOLUME 18W E A T H E R A N D F O R E C A S T I N G an adaptive NN-based MOS scheme for predicting pre- cipitation is justified. Testing on data used for opera- tional forecasts is needed in order to evaluate this meth- od’s worth for practical predictions. A main concern is the prediction capability of the NWP output on which the overall performance of the MOS scheme depends. Using NCEP records as simulators of NWP output elim- inated that concern in this study but it remains to be tested how well the recently developed high-resolution models (1.0-km grid and below) will be capable of cap- turing the small-scale, but important, phenomena that are responsible for much of the variability in precipi- tation over rugged terrain like that of the Pacific North- west. To apply the nonlinear adaptive MOS scheme in an operational mode will also require extensive additional exploration to tailor the algorithm to the specific region under consideration. The most important issues to con- sider are the following. (a) The division of the locations in the forecast area into groups with similar precipitation patterns. The more homogeneous the groups the better, but from our experience, a minimal number of about 30 stations is needed for each group. (b) An exploration for the best predictors, especially additional ones that convey information not included in the NWP output, like typical local wind patterns, local topography (below the NWP resolution), etc. We believe that by properly addressing these issues, and using reasonably accurate NWP outputs, the algorithm presented in this paper is a viable tool for improving precipitation forecasts. Acknowledgments. The need for an adaptive nonlinear MOS scheme was first brought to our attention through discussions with Professor Roland Stull. We thank three anonymous reviewers for their helpful comments. This work was supported by research and strategic grants to William Hsieh from the Natural Sciences and Engi- neering Research Council of Canada. REFERENCES Cybenko, G., 1989: Approximation by superpositions of a sigmoidal function. Math. Control, Signal, Syst., 2, 303–314. Demuth, H., and M. Beale, 2000: Neural Network Toolbox. Version 4, The Math Works, 846 pp. Ebert, E. E., 2001: Ability of a poor man’s ensemble to predict the probability and distribution of precipitation. Mon. Wea. Rev., 129, 2461–2480. Funahashi, K., 1989: On the approximate realization of continuous mappings by neural networks. Neural Networks, 2, 183–192. Golub, G. H., M. Heath, and G. Wahba, 1979: Generalized cross- validation as a method for choosing a good ridge parameter. Technometrics, 21, 215–223. Grewal, M. S., 1993: Kalman Filtering: Theory and Practice. Prentice Hall Information and System Science Series, Prentice Hall, 381 pp. Haber, E., and D. W. Oldenburg, 2000: A GCV based method for nonlinear ill-posed problems. Comput. Geosci., 4, 41–63. Hall, T., H. E. Brooks, and C. A. Doswell III, 1999: Precipitation forecasting using a neural network. Wea. Forecasting, 14, 338– 345. Hornik, K., M. Stinchcombe, and H. White, 1989: Multilayer feed- forward networks are universal approximators. Neural Networks, 2, 359–366. Kalnay, E., and Coauthors, 1996: The NCEP/NCAR 40-Year Re- analysis Project. Bull. Amer. Meteor. Soc., 77, 437–471. Koizumi, K., 1999: An objective method to modify numerical model forecasts with newly given weather data using an artificial neural network. Wea. Forecasting, 14, 109–118. Krzysztofowicz, R., 1998: Probabilistic hydrometeorological fore- casts: Toward a new era in operational forecasting. Bull. Amer. Meteor. Soc., 79, 243–251. Kuligowski, R. J., and A. P. Barros, 1998a: Experiments in short- term precipitation forecasting using artificial neural networks. Mon. Wea. Rev., 126, 470–482. ——, and ——, 1998b: Localized precipitation forecasts from a nu- merical weather prediction model using artificial neural net- works. Wea. Forecasting, 13, 1194–1204. Mao, Q., S. F. Mueller, and H. H. Juang, 2000: Quantitative precip- itation forecasting for the Tennessee and Cumberland River wa- tershed using the NCEP regional spectral model. Wea. Fore- casting, 15, 29–45. Ross, G. H., 1987: An updateable model output statistics scheme. Programme on Short- and Medium Range Weather Prediction, PSMP Rep. Series, No. 25, World Meteorological Organization, 25–28. Wilks, D. S., 1995: Statistical Methods in the Atmospheric Sciences. Academic Press, 467 pp. Wilson, L. J., and M. Vallée, 2002: The Canadian Updateable Model Output Statistics (UMOS) system: Design and development test. Wea. Forecasting, 17, 206–222. Xia, J., and A. Chen, 1999: An objective approach for making rainfall forecasts based on numerical model output and the latest ob- servation. Wea. Forecasting, 14, 49–52. Yuval, 2000: Neural network training for prediction of climatological time series, regularized by minimization of the generalized cross- validation function. Mon. Wea. Rev., 128, 1456–1473.
Cite
Citation Scheme:
Usage Statistics
Country | Views | Downloads |
---|---|---|
Canada | 3 | 3 |
Japan | 3 | 0 |
Republic of Korea | 2 | 0 |
China | 1 | 9 |
United States | 1 | 0 |
City | Views | Downloads |
---|---|---|
Vancouver | 3 | 0 |
Tokyo | 3 | 0 |
Yongsan-dong | 2 | 0 |
Beijing | 1 | 0 |
Ashburn | 1 | 0 |
{[{ mDataHeader[type] }]} | {[{ month[type] }]} | {[{ tData[type] }]} |
Share
Share to: