Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Foody, Giles M. (2015)
Publisher: Copernicus Publications
Journal: ISPRS Annals of the Photogrammetry
Languages: English
Types: Article
Subjects: TA1-2040, T, TA1501-1820, Applied optics. Photonics, Engineering (General). Civil engineering (General), Technology
It is now widely accepted that an accuracy assessment should be part of a thematic mapping programme. Authoritative good or best practices for accuracy assessment have been defined but are often impractical to implement. Key reasons for this situation are linked to the ground reference data used in the accuracy assessment. Typically, it is a challenge to acquire a large sample of high quality reference cases in accordance to desired sampling designs specified as conforming to good practice and the data collected are normally to some degree imperfect limiting their value to an accuracy assessment which implicitly assumes the use of a gold standard reference. Citizen sensors have great potential to aid aspects of accuracy assessment. In particular, they may be able to act as a source of ground reference data that may, for example, reduce sample size problems but concerns with data quality remain. The relative strengths and limitations of citizen contributed data for accuracy assessment are reviewed in the context of the authoritative good practices defined for studies of land cover by remote sensing. The article will highlight some of the ways that citizen contributed data have been used in accuracy assessment as well as some of the problems that require further attention, and indicate some of the potential ways forward in the future.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • Antoniou, V., Morley, J. and Haklay, M., 2010. Web 2.0 geotagged photos: assessing the spatial dimension of the phenomenon. Geomatica, 64 (1), 99-110.
    • Arsanjani, J. J., Mooney, P., Zipf, A., and Schauss, A., 2015a.
    • J., Zipf, A., Mooney, P., and Helbich, M. (editors), OpenStreetMap in GIS, Springer, Berlin, pp. 37-58.
    • Arsanjani, J. J., Zipf, A., Mooney, P., and Helbich, M., 2015b.
    • J., Zipf, A., Mooney, P., and Helbich, M. (editors), OpenStreetMap in GIS, Springer, Berlin, pp. 1-15.
    • Barnett, V., 1991, Sample Survey Principles and Methods, Arnold, London.
    • Bastin, L., Buchanan, G., Beresford, A., Pekel, J. F. and Dubois, G., 2013. Open-source mapping and services for Webbased land-cover validation. Ecological Informatics 14, pp. 9- 16.
    • Carlotto, M. J., 2009. Effect of errors in ground truth on classification accuracy. International Journal of Remote Sensing 30 (18), pp. 4831-4849.
    • Cihlar, J., 2000. Land cover mapping of large areas from satellites: status and research priorities, International Journal of Remote Sensing, 21, pp. 1093-1114.
    • Cochran, W. G., 1977. Sampling Techniques, third edition, John Wiley, New York.
    • Comber, A., See, L., Fritz, S., Van der Velde, M., Perger, C., and Foody, G., 2013. Using control data to determine the reliability of volunteered geographic information about land cover. International Journal of Applied Earth Observation and Geoinformation, 23, pp. 37-48.
    • Congalton, R. G. and Green, K., 2009. Assessing the Accuracy of Remotely Sensed Data: Principles and Practices. Second edition, CRC press.
    • CSDGSND (Committee on Strategic Directions for the Geographical Sciences in the Next Decade), 2010.
    • Estima, J. and Painho, M., 2013. Flickr geotagged and publicly available photos: preliminary study of its adequacy for helping quality control of Corine land cover In ICCSA 2013 Springer Berlin Heidelberg, pp. 205-220.
    • Estima, J. and Painho, M., 2015. Investigating the potential of OpenStreetMap for land use/land cover production: A case study for continental Portugal. In Arsanjami, J. J., Zipf, A., Mooney, P., and Helbich, M. (editors), OpenStreetMap in GIS, Springer, Berlin, pp. 273-293.
    • Fleiss, J. L., Levin, B. and Paik, M. C., 2003. Statistical Methods for Rates and Proportions, 3rd edition, Wiley, New Jersey.
    • Fonte, C. C., Bastin, L., See, L., Foody, G. and Lupia, F., 2015a. Usability of VGI for validation of land cover maps.
    • International Journal of Geographical Information Science, (DOI:10.1080/13658816.2015.1018266, in press).
    • Fonte, C. C., Bastin, L., See, L., Foody, G. and Estima, J., 2015b. Good practice guidelines for assessing VGI data quality.
    • Proceedings of AGILE 2015, 9-12 June 2015, Lisbon, Portugal (in press) Foody, G. M., 1996. Approaches for the production and evaluation of fuzzy land cover classifications from remotelysensed data. International Journal of Remote Sensing, 17(7), pp. 1317-1340.
    • Foody, G. M,. 2002. Status of land cover classification accuracy assessment. Remote Sensing of Environment, 80 (1), pp. 185- 201.
    • Foody, G. M., 2004. Supervised image classification by MLP and RBF neural networks with and without an exhaustively defined set of classes. International Journal of Remote Sensing, 25 (15),pp. 3091-3104.
    • Foody, G. M., 2009. Sample size determination for image classification accuracy assessment and comparison.
    • International Journal of Remote Sensing, 30 (20), pp. 5273- 5291.
    • Foody, G. M., 2010. Assessing the accuracy of land cover change with imperfect ground reference data. Remote Sensing of Environment, 114 (10), pp. 2271-2285.
    • Foody, G. M. 2012. Latent class modelling for site and non-site specific classification accuracy assessment without ground data IEEE Transactions on Geoscience and Remote Sensing, 50 (7), pp. 2827-2838.
    • Foody, G. M., 2013. Ground reference data error and the misestimation of the area of land cover change as a function of its abundance. Remote Sensing Letters, 4 (8), pp. 783-792.
    • Foody, G. M., 2015. Valuing map validation: the need for rigorous land cover map accuracy assessment in economic valuations of ecosystem services. Ecological Economics, 111, pp. 23-28.
    • Foody, G. M. and Boyd, D. S., 2013. Using volunteered data in land cover map validation: mapping West African forests. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 6 (3), pp. 1305-1312.
    • Foody, G. M.,and Curran, P. J., 1994. Environmental Remote Sensing from Regional to Global Scales. John Wiley and Sons Ltd, Chichester.
    • Foody, G. M., See, L., Fritz, S., Van der Velde, M, Perger, C., Schill, C., and Boyd, D. S., 2013. Assessing the accuracy of volunteered geographic information arising from multiple contributors to an internet based collaborative project.
    • Transactions in GIS 17 (6), pp. 847-860.
    • Fritz, S. and See, L., 2008. Identifying and quantifying uncertainty and spatial disagreement in the comparison of Global Land Cover for different applications. Global Change Biology, 14 (5), pp. 1057-1075.
    • Fritz, S., McCallum, I., Schill, C., Perger, C., See, L., Schepaschenko, D., van der Velde, M., Kraxner, F., and Obersteiner, M., 2012. Geo-Wiki: An online platform for improving global land cover. Environmental Modelling and Software, 31, pp. 110-123.
    • Giri, C., Zhu, Z., and Reed, B., 2005. A comparative analysis of the Global Land Cover 2000 and MODIS land cover data sets.
    • Remote Sensing of Environment, 94 (1), pp. 123-132.
    • Goodchild, M. F., 2007. Citizens as sensors: The world of volunteered geography. GeoJournal, 69 (4), pp. 211-221.
    • Goodchild, M. F., and Li, L., 2012. Assuring the quality of volunteered geographic information. Spatial Statistics, 1, pp.
    • Iwao, K., Nishida, K., Kinoshita T. and Yamagata, Y. 2006.
    • Validating land cover maps with Degree Confluence Project information. Geophysical Research Letters 33, p. L23404.
    • Jung, M., Henkel, K., Herold, M., and Churkina, G., 2006.
    • Exploiting synergies of global land cover products for carbon cycle modeling. Remote Sensing of Environment, 101 (4), pp.
    • Magidson, J. and Vermunt, J. K. 2004. Latent class models. In Kaplan, D (editor) The SAGE Handbook of Quantitative Methodology for the Social Sciences, Sage, Thousand Oaks, pp.
    • Mather, P. and Koch, M., 2011. Computer Processing of Remotely-SensedIimages: An Introduction, 4th edition, John Wiley and Sons Ltd, Chichester.
    • McCallum, I., Obersteiner, M., Nilsson, S. and Shvidenko, A., 2006. A spatial comparison of four satellite derived 1km global land cover datasets. International Journal of Applied Earth Observation and Geoinformation, 8, pp. 246-255.
    • McRoberts, R. E., 2011. Satellite image-based maps: Scientific inference or pretty pictures? Remote Sensing of Environment, 115 (2), 715-724.
    • Olofsson, P., Stehman, S. V., Woodcock, C. E., Sulla-Menashe, D., Sibley, A. M., Newell, J. D., Friedl, M. A. and Herold, M., 2012. A global land-cover validation data set, part I: fundamental design principles International Journal of Remote Sensing, 33 (18), pp. 5768-5788.
    • E., 2013. Making better use of accuracy data in land change studies: Estimating accuracy and area and quantifying uncertainty using stratified estimation. Remote Sensing of Environment, 129, pp. 122-131.
    • Olofsson, P., Foody, G. M., Herold, M., Stehman, S.V., Woodcock, C. E. and Wulder, M. A. 2014. Good practices for assessing accuracy and estimating area of land change. Remote Sensing of Environment, 148, pp. 42-57.
    • Rocchini, D., Foody, G. M., Nagendra, H., Ricotta, C., Anand, M., He, K. S. Amicic, V., Kleinschmit, B., Forster, M., Schmidtlein, S., Feilhauer, H., Ghisla, A., Metz, M. and Neteler, M., 2013. Uncertainty in ecosystem mapping by remote sensing. Computers and Geosciences, 50, pp. 128-135.
    • Roman, D. 2009. Crowdsourcing and the question of expertise.
    • Communications of the ACM 52: pp. 12.
    • Som, R. K., 1996, Practical Sampling Techniques, second edition, Marcel Dekker, NewYork.
    • Stehman, S. V., 1999. Basic probability sampling designs for thematic map accuracy assessment. International Journal of Remote Sensing, 20 (12), pp. 2423-2441.
    • Stehman, S. V., 2009. Sampling designs for accuracy assessment of land cover. International Journal of Remote Sensing, 30 (20), pp. 5243-5272.
    • Stehman, S. V., 2012. Impact of sample size allocation when using stratified random sampling to estimate accuracy and area of land-cover change. Remote Sensing Letters, 3 (2), pp. 111- 120.
    • Stehman, S. V. and Czaplewski, R. L., 1998. Design and analysis for thematic map accuracy assessment: fundamental principles. Remote Sensing of Environment, 64 (3), pp. 331- 344.
    • Stehman, S. V. and Foody, G. M., 2009. Accuracy assessment, In Warner, T. A., Nellis, M. D. and Foody, G. M. (editors) The SAGE Handbook of Remote Sensing, Sage, London, pp. 297- 309.
    • Strahler, A. H., Boschetti, L., Foody, G. M., Friedl, M. A., Hansen, M. C., Herold, M., Mayaux, P., Morisette, J. T., Stehman, S. V. and Woodcock, C. E., 2006. Global Land Cover Validation: Recommendations for Evaluation and Accuracy Assessment of Global Land Cover Maps. European Commission, EUR 22156 EN, 2006.
    • Vandecasteele, A. and Devillers, R., 2015. Improving volunteered geographic information quality using a tag recommender system: The case of OpenStreetMap, In Arsanjami, J. J., Zipf, A., Mooney, P., and Helbich, M.
    • (editors), OpenStreetMap in GIS, Springer, Berlin, pp. 59-80.
    • Vermunt, J. K. and Magidson, J., 2003. Latent class analysis. In M. Lewis-Beck, A. E. Bryman and T. F. Liao (editors), The Sage Encyclopaedia of Social Science Research Methods, volume 2, Sage, Publications, Thousand Oaks, pp. 549-553.
    • Wickham, J.D., Stehman, S.V., Gass, L., Dewitz, J., Fry, J.A., Wade, T.G., 2013. Accuracy assessment of NLCD 2006 land cover and impervious surface. Remote Sensing of Environment, 130, pp. 294-304.
    • Wulder, M. A., White, J. C., Goward, S. N., Masek, J. G., Irons, J. R., Herold, M., Cohen, W. B., Loveland, T. R., and Woodcock, C. E., 2008. Landsat continuity: Issues and opportunities for land cover monitoring, Remote Sensing of Environment, 112 (3), pp. 955-969.
    • Yang, I. and Becker, M. P. 1997. Latent variable modelling of diagnostic accuracy. Biometrics, 53, pp. 948-958.
  • No related research data.
  • No similar publications.