Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Elizabeth R. Ellwood; Henry L. Bart, Jr.; Michael H. Doosey; Dean K. Jue; Justin G. Mann; Gil Nelson; Nelson Rios; Austin R. Mast (2016)
Publisher: Ubiquity Press
Journal: Citizen Science: Theory and Practice
Languages: English
Types: Article
Subjects: Q, Benchmarking, Benchmarking; biodiversity specimens; georeferencing; natural history collections; quality assessment; volunteered geographic information, Biodiversity; citizen science; ichthyology; botany; geography; taxonomy; ecology, quality assessment, Science, georeferencing, natural history collections, volunteered geographic information, biodiversity specimens
The majority of the world’s billions of biodiversity specimens are tucked away in museum cabinets with only minimal, if any, digital records of the information they contain. Global efforts to digitize specimens are underway, yet the scale of the task is daunting. Fortunately, many activities associated with digitization do not require extensive training and could benefit from the involvement of citizen science participants. However, the quality of the data generated in this way is not well understood. With two experiments presented here, we examine the efficacy of citizen science participants in georeferencing specimen collection localities. In the absence of an online citizen science georeferencing platform and community, students served as a proxy for the larger citizen science population. At Tulane University and Florida State University, undergraduate students and experts used the GEOLocate platform to georeference fish and plant specimen localities, respectively. Our results provide a first-approximation of what can be expected from citizen science participants with minimal georeferencing training as a benchmark for future innovations. After outliers were removed, the range between student and expert georeferenced points was <1.0 to ca. 40.0 km for both the fish and the plant experiments, with an overall mean of 8.3 km and 4.4 km, respectively. Engaging students in the process improved results beyond GEOLocate’s algorithm alone. Calculation of a median point from replicate points improved results further, as did recognition of good georeferencers (e.g., creation of median points contributed by the best 50% of contributors). We provide recommendations for improving accuracy further. We call for the creation of an online citizen science georeferencing platform.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • Barve, V., 2014. Discovering and developing primary biodiversity data from social networking sites: A novel approach. Ecological Informatics, 24: 194-199. DOI: http://dx.doi.org/10.1016/j.ecoinf.2014.08.008
    • Beach, J., Blum, S., Donoghue, M., Ford, L., Guralnick, R., Mares, M., Thiers, B., Westneat, M., Wheeler, Q., Wiegmann, B. and the Network Integrated Biocollection Alliance, 2010. A strategic plan for establishing a network integrated biocollections alliance. Available at http://digbiocol.wordpress.com/brochure.
    • Beaman, R. and Conn, B., 2003. Automated geoparsing and georeferencing of Malesian collection locality data. Telopea, 10: 43-52. DOI: http://dx.doi.org/10.7751/ telopea20035604
    • Boakes, E.H., McGowan, P.J.K., Fuller, R.A., Chang-qing, D., Clark, N.E., O'Connor, K. and Mace, G.M., 2010. Distorted views of biodiversity: Spatial and temporal bias in species occurrence data. PLoS Biol, 8: e1000385. DOI: http://dx.doi.org/10.1371/journal. pbio.1000385
    • Camponovo, M.E. and Freundschuh, S.M., 2014. Assessing uncertainty in VGI for emergency response. Cartography and Geographic Information Science, 41: 440-455. DOI: http://dx.doi.org/10.1080/15230406.2014. 950332
    • Chapman, A.D., Wieczorek, J. and BioGeomancer Consortium, 2006. Guide to best practices for georeferencing. Global Biodiversity Information Facility.
    • Coleman, D.J., Georgiadou, Y. and Labonte, J., 2009. Volunteered geographic information: The nature and motivation of producers. International Journal of Spatial Data Infrastructures Research, 4: 332-358.
    • Cook, J.A., Edwards, S.V., Lacey, E.A., Guralnick, R.P., Soltis, P.S., Soltis, D.E., Welch, C.K., Bell, K.C., Galbreath, K.E., Himes, C. and Allen, J.M., 2014. Natural history collections as emerging resources for innovative education. BioScience, 64(8): 725-734. DOI: http://dx.doi.org/10.1093/biosci/ biu096
    • Doherty, P., Guo, Q., Liu, Y., Wieczorek, J. and Doke, J., 2011. Georeferencing incidents from locality descriptions and its applications: A case study from Yosemite National Park Search and Rescue. Transactions in GIS, 15: 775-793. DOI: http://dx.doi.org/10.1111/j.1467- 9671.2011.01290.x
    • Ellwood, E.R., Dunckel, B.A., Flemons, P., Guralnick, R., Nelson, G., Newman, G., Newman, S., Paul, D., Riccardi, G., Rios, N., Seltmann, K.C. and Mast, A.R., 2015. Accelerating the digitization of biodiversity research specimens through online public participation. BioScience, 65: 383- 386. DOI: http://dx.doi.org/10.1093/biosci/biv005
    • Elwood, S., Goodchild, M.F. and Sui, D.Z., 2011. Researching volunteered Geographic Information: Spatial data, geographic research, and new social practice. Annals of the Association of American Geographers, 102: 571-590. DOI: http://dx.doi.org/10.1080/00045608.2011.595657
    • Environmental Systems Research Institute, 2014. ArcGIS Platform 10.2.
    • Eveleigh, A., Jennett, C., Blandford, A., Brohan, P. and Cox, A.L., 2014. Designing for dabblers and deterring drop-outs in citizen science. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. Association for Computing Machinery, pp. 2985-2994. DOI: http://dx.doi.org/ 10.1145/2556288.2557262
    • Fernández, M., Hamilton, H.H. and Kueppers, L.M., 2015. Back to the future: Using historical climate variation to project near-term shifts in habitat suitable for coast redwood. Global Change Biology. DOI: http://dx.doi. org/10.1111/gcb.13027
    • Fleet, C., Kowal, K.C. and Pridal, P., 2012. Georeferencer: Crowdsourced georeferencing for map library collections. D-Lib Magazine, 18: 5. DOI: http://dx.doi. org/10.1045/november2012-fleet
    • Goodchild, M.F., 2007. Citizens as sensors: the world of volunteered geography. GeoJournal, 69: 211-221. DOI: http://dx.doi.org/10.1007/s10708-007-9111-y
    • Gotelli, N.J., Chao, A., Colwell, R.K., Hwang, W.H. and Graves, G.R., 2012. Specimen-based modeling, stopping rules, and the extinction of the Ivory-Billed Woodpecker. Conservation Biology, 26: 47-56. DOI: http:// dx.doi.org/10.1111/j.1523-1739.2011.01715.x
    • Graham, C.H., Elith, J., Hijmans, R.J., Guisan, A., Townsend Peterson, A. and Loiselle, B.A., 2008. The influence of spatial errors in species occurrence data used in distribution models. Journal of Applied Ecology, 45: 239-247. DOI: http://dx.doi.org/10.1111/j.1365- 2664.2007.01408.x
    • Gregory, I.N. and Ell, P.S., 2007. Historical GIS: Technologies, methodologies, and scholarship. Cambridge University Press. DOI: http://dx.doi.org/10.1017/ CBO9780511493645
    • Guo, Q., Liu, Y. and Wieczorek, J., 2008. Georeferencing locality descriptions and computing associated uncertainty using a probabilistic approach. International Journal of Geographical Information Science, 22: 1067-1090. DOI: http://dx.doi.org/10.1080/13658810701851420
    • Haklay, M. and Weber, P., 2008. OpenStreetMap: Usergenerated street maps. Pervasive Computing, IEEE, 7: 12-18. DOI: http://dx.doi.org/10.1109/MPRV.2008.80
    • Hanken, J., 2013. Biodiversity Online: Toward a network integrated biocollections alliance. BioScience, 63: 789- 790. DOI: http://dx.doi.org/10.1525/bio.2013.63.10.4
    • Holdsworth, D.W., 2003. Historical geography: New ways of imaging and seeing the past. Progress in Human Geography, 27: 486-493. DOI: http://dx.doi. org/10.1191/0309132503ph440pr
    • Hope, A.G., Waltari, E., Payer, D.C., Cook, J.A, and Talbot, S.L., 2013. Future distribution of tundra refugia in northern Alaska. Nature Climate Change, 3: 931-938. DOI: http://dx.doi.org/10.1038/nclimate1926
    • Hunter, J., Alabri, A. and Ingen, C., 2013. Assessing the quality and trustworthiness of citizen science data. Concurrency and Computation: Practice and Experience, 25: 454-466. DOI: http://dx.doi.org/10.1002/cpe.2923
    • Keeler, B.L., Wood, S.A., Polasky, S., Kling, C., Filstrup, C.T. and Downing, J.A., 2015. Recreational demand for clean water: Evidence from geotagged photographs by visitors to lakes. Frontiers in Ecology and the Environment, 13: 76-81. DOI: http://dx.doi.org/10.1890/140124
    • Kumar, N. and Seitz, S., 2014. Photo recall: Using the Internet to label your photos. In 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). pp. 785-792. DOI: http://dx.doi. org/10.1109/CVPRW.2014.120
    • Lampos, V. and Cristianini, N., 2010. Tracking the flu pandemic by monitoring the social web. In 2nd International Workshop on Cognitive Information Processing (CIP). pp. 411-416. DOI: http://dx.doi.org/10.1109/ cip.2010.5604088
    • Lauriault, T.P. and Mooney, P., 2014. Crowdsourcing: A geographic approach to public engagement. Paper presented at Internet Politics and Policy Conference. Oxford Internet Institute.
    • Liu, Y. and Liu, M., 2015. An online learning approach to improving the quality of crowd-sourcing. Available at http://web. eecs.umich.edu/~mingyan/pub/Sigmetrics15.pdf.
    • Meier, P., 2012. How crisis mapping saved lives in Haiti. National Geographic Voices. Available at http:// newswatch.nationalgeographic.com/2012/07/02/crisismapping-haiti/.
    • Miller, J.S., Porter-Morgan, H.A., Stevens, H., Boom, B., Krupnick, G.A., Acevedo-Rodríguez, P., Fleming, J. and Gensler, M., 2012. Addressing target two of the Global Strategy for Plant Conservation by rapidly identifying plants at risk. Biodiversity and Conservation, 21: 1877-1887. DOI: http://dx.doi.org/10.1007/s10531- 012-0285-3
    • Offen, K., 2012. Historical geography II: Digital imaginations. In Progress in Human Geography. DOI: http://dx.doi. org/10.1177/0309132512462807
    • QGIS Development Team, 2014. QGIS Geographic Information System. Open Source Geospatial Foundation Project. Available at http://qgis.osgeo.org.
    • R Core Development Team, 2014. R: A language and environment for statistical computing. In R Foundation for Statistical Computing. Vienna, Austria.
    • Rivers, M.C., Taylor, L., Brummitt, N.A., Meagher, T.R., Roberts, D.L. and Lughadha, E.N., 2011. How many herbarium specimens are needed to detect threatened species? Biological Conservation, 144: 2541-2547. DOI: http://dx.doi. org/10.1016/j.biocon.2011.07.014
    • Rowe, R.J., 2005. Elevational gradient analyses and the use of historical museum specimens: A cautionary tale. Journal of Biogeography, 32: 1883-1897. DOI: http:// dx.doi.org/10.1111/j.1365-2699.2005.01346.x
    • Spyratos, S. and Lutz, M., 2014. Characteristics of citizencontributed Geographic Information. In Huerta, S. and Granell (Eds.), Proceedings of the AGILE 2014 International Conference on Geographic Information Science. Castellón.
    • Sui, D. and Goodchild, M., 2011. The convergence of GIS and social media: challenges for GIScience. International Journal of Geographical Information Science, 25: 1737-1748. DOI: http://dx.doi.org/10.1080/1365881 6.2011.604636
    • Sui, D., Goodchild, M. and Elwood, S., 2013. Volunteered Geographic Information, the Exaflood, and the growing digital divide. In Sui, D., Elwood, S. and Goodchild, M. (Eds.), Crowdsourcing Geographic Knowledge. Springer Netherlands, pp. 1-12. DOI: http://dx.doi.org/10.1007/978-94- 007-4587-2; http://dx.doi.org/10.1007/978-94-007- 4587-2_1
    • Taylor, M.L., Yesson, C., Agnew, D.J., Mitchell, R.E. and Rogers, A.D., 2013. Using fisheries by-catch data to predict octocoral habitat suitability around South Georgia. Journal of Biogeography, 40: 1688-1701. DOI: http:// dx.doi.org/10.1111/jbi.12122
    • Tingley, M.W. and Beissinger, S.R., 2009. Detecting range shifts from historical species occurrences: New perspectives on old data. Trends in Ecology and Evolution, 24: 625-633. DOI: http://dx.doi.org/10.1016/j. tree.2009.05.009
    • Zhang, M-G., Zhou, Z-K., Chen, W-Y., Slik, J.F., Cannon, C.H. and Raes, N., 2012. Using species distribution modeling to improve conservation and land use planning of Yunnan, China. Biological Conservation, 153: 257-264. DOI: http://dx.doi.org/10.1016/j.biocon.2012.04.023
  • No related research data.
  • No similar publications.

Share - Bookmark

Funded by projects

  • NSF | Cooperative Support Agreeme...
  • NSF | Digitization HUB: A Collect...
  • NSF | Collaborative Research: CSB...

Cite this article