---

---

Books | Book Chapters | Journals | Professional Articles | Conferences | Workshops | Reports

---

Books

Peters, C., Braschler, M. and Clough, P. (2012) Multilingual Information Retrieval: From Research to Practice, Springer: Heidelberg, Germany, ISBN 978-3-642-23007-3, 217 pages. Available from Springer

Müller, H., Clough, P., Deselaers, T. and Caputo, B. (Eds)(2010) ImageCLEF - Experimental Evaluation of Visual Information Retrieval, Springer: Heidelberg, Germany, ISBN 978-3-642-15180, 495 pages. Available from Springer.

Book Chapters

Clough, P. User-related issues in multilingual access to multimedia collections, In Dobreva, Dwyer and Feliciati (eds) User Studies for Digital Library Development, Facet Publishing (Forthcoming 2011).

Clough, P., Müller, H., and Sanderson, M. (2010) Seven Years of Image Retrieval Evaluation, In Müller, H., Clough, P., Deselaers, T. and Caputo, B. (eds) ImageCLEF - Experimental Evaluation of Visual Information Retrieval, Springer: Heidelberg, Germany, pp. 3-18.

Grubinger, M., Nowak, S., and Clough, P. (2010) Data Sets Created in ImageCLEF, In Müller, H., Clough, P., Deselaers, T. and Caputo, B. (eds) ImageCLEF - Experimental Evaluation of Visual Information Retrieval, Springer: Heidelberg, Germany, pp. 19-44.

Clough, P. Measuring Text Re-Use in the News Industry, In Lionel Bently, Jennifer Davis, and Jane C. Ginsburg (eds) Copyright and Piracy: An Interdisciplinary Critique, Cambridge University Press (Publication date: October 2010).

Clough, P. and Gaizauskas, R. (2009), Corpora and Text Re-use, In Anke Lüdeling, Merja Kytö and Tony McEnery (eds) Handbook of Corpus Linguistics. (Series: Handbooks of Linguistics and Communication Science), 1249–1271, Mouton de Gruyter.

---

Journals

Petrelli, D. and Clough, P. (2012) Analysing User’s Queries for Cross-Language Image Retrieval from Digital Library Collections, The Electronic Library, Volume 30(2).

Wakeling, S., Clough, P., Sen, B. and Connaway, L. "Reader's who borrowed this also borrowed ...": Recommender Systems in UK Libraries, Library Hi-Tech, (Forthcoming 2012).

Whittaker, S., Kalnikaite, V., Petrelli, D., Sellen, A., Villar, N., Bergman, O., Clough, P., and Brockmeier, J. (in press). Socio-technical Lifelogging: Deriving design principles for a future proof digital past, Human Computer Interaction, (Forthcoming 2012).

Bothin, A. and Clough, P. Participants’ personal note-taking in meetings and its value for automatic meeting summarisation, Information Technology and Management, Published online: 25 December 2011 (DOI: 10.1007/s10799-011-0112-7), pp. 1-19.

Sedghi, S., Sanderson, M. and Clough, P. (2011) Medical image resources used by health care professionals, Aslib Proceedings, Volume 63(6), pp. 570-585.

Clough, P., Hall, M., Warner, A., and Tang, J. (2011) Linking Archival Data to Location: A Case Study at the UK National Archives, Aslib Proceedings, Volume 63(2/3), pp. 127-147.

Cox, A. M., Clough, P., and Siersdorfer, S. (2011) Developing Metrics to Characterize Flickr Groups, Journal of the American Society for Information Science and Technology, Volume 62(3), pp. 493-506.

Hanbury, A., Müller, H., and Clough, P. (2010) Introduction to Special Issue on Image and Video Retrieval Evaluation (Editorial), Computer Vision and Image Understanding: Special Issue on Image and Video Retrieval, Volume 114 (2010), pp. 409-410.

Clough, P. and Stevenson, M. (2010) Developing A Corpus of Plagiarised Short Answers, Language Resources and Evaluation: Special Issue on Plagiarism and Authorship Analysis, Volume 45(1), pp. 5-24.

Clough, P. and Eleta, I. (2010) Investigating Language Skills and Field of Knowledge on Multilingual Information Access in Digital Libraries, International Journal of Digital Library Systems (IJDLS), Volume 1(1), pp. 89-103.

Whittaker, S., Bergman, O. and Clough, P. (2010) Easy on that Trigger Dad: A Study of Long Term Family Photo Retrieval, Personal and Ubiquitous Computing , Volume 14(1), pp. 31-43.

Clough, P., Ireson, N. and Marlow, J. (2009) Extending Domain-Specific Resources to Enable Semantic Access to Cultural Heritage Data, Journal of Digital Information: Special Issue on Information Access to Cultural Heritage, Volume 10(6). Available online: https://journals.tdl.org/jodi/issue/view/89

Sedghi, S., Sanderson, M. and Clough, P. (2008) A Study on the Relevance Criteria for Medical Images, Pattern Recognition Letters (Special Issue on Medical Image Annotation), Volume 29(15), Nov. 2008, pp. 2046-2057.

Rorissa, A., Clough, P. and Deselaers, T. (2008), Exploring the relationship between feature and perceptual visual spaces, Journal of the American Society for Information Science and Technology (JASIST), Volume 59(5), pp. 770-784.

Jones, C., Purves, R.S., Clough, P., and Joho, H. (2008) Modelling Vague Regions with Knowledge from the Web, International Journal Geographic Information Systems (IJGIS)- Special Edition on Digital Gazetteer Research, Volume 22(10), pp. 1045-1065.

Cox, A., Clough, P. and Marlow, J. (2008), Flickr: a first look at user behaviour in the context of photography as serious leisure, Information Research, 13(1) paper 336. [Available, 6 January, 2008 at http://InformationR.net/ir/13-1/paper336.html].

Deselaers, T., Müller, H., Clough, P., Ney, H. and Lehmann, T. (2007), The CLEF 2005 Automatic Medical Image Annotation Task, International Journal of Computer Vision (IJCV), Volume 74(1), pp. 51-58.

Purves, R.S., Clough, P., Jones, C.B., Arampatzis, A., Bucher, B., Finch, D., Fu, G., Joho, H., Khirini, A.S., Vaid, S., and Yang, B. (2007), The Design and Implementation of SPIRIT: a Spatially-Aware Search Engine for Information Retrieval on the Internet, International Journal Geographic Information Systems (IJGIS), Volume 21(7), January 2007, pp. 717-745.

Clough, P. and Sanderson, M. (2006), User Experiments with the Eurovision Cross-Language Image Retrieval System, In Journal of the American Society for Information Science and Technology (JASIST) Special Topic Section on Multilingual Information Systems, Volume 57(5), pp. 697 - 708.

A. Arampatzis, M. van Kreveld., I. Reinbacher, C.B. Jones, S. Vaid, P.D. Clough, H. Joho, and M. Sanderson (2005), Web-based delineation of imprecise regions, In the Journal of Computers, Environment and Urban Systems (CEUS), Volume 30(4), pp. 436-459.

---

Professional Articles

Clough, P., Ferro, N., Forner, P., Gonzalo, J., Huurnink, B., Kekäläinen, J., Lalmas, M., Petras, V. and de Rijke, M. (2011) CLEF 2011 Conference on Multilingual and Multimodal Information Access Evaluation, ACM SIGIR Forum, Volume 45(2), pp. 32-37.

Purves, R., Clough, P. and Jones, C. (2010) Highlights from GIR'10, ACM SIGSPATIAL Special, Volume 2 (1), March 2010, pp. 17-23.

Clough, P. and Berendt, B. (2009) Report on the TrebleCLEF Query Log Analysis Workshop 2009, ACM SIGIR Forum, Volume 43(2), pp. 71-77.

Clough, P. (2007), Large-scale evaluation of cross-language image retrieval systems, ASIST Bulletin, Feb-Mar 2007.

Grubinger, M., Clough, P., and Leung, C. (2006), IAPR TC-12 Benchmark for visual information search, International Association for Pattern Recognition (IAPR) Newsletter, Volume 28(2), pp. 10-12.

Müller, H. and Clough, P. (2006), The ImageCLEF Benchmark on Multimodal, Multilingual Visual Images, International Association for Pattern Recognition (IAPR) Newsletter, Volume 28(2), pp. 13-17.

Karlgren, Jussi and Clough, Paul and Gonzalo, Julio (2006), Multilingual Interactive Experiments with Flickr, ERCIM News, 66, July 2006.

Clough, P., Sanderson, M., and Reid, N. (2006), The Eurovision St Andrews Collection of Photographs, ACM SIGIR Forum, Volume 40(1) (June 2006), pp. 21-30.

Clough, P. (2003), Old and new challenges in automatic plagiarism detection, National UK Plagiarism Advisory Service (Online).

---

Conferences

Nawab, R.M.A., Stevenson, M. and Clough, P. Retrieving Candidate Plagiarised Documents using Query Expansion, In Proceedings of European Conference on Information Retrieval (ECIR 2012). Due to Appear 2012.

Wan-Chik, R., Clough, P., and Ford, N. (2011) Searching for Islamic and Qur’anic Information on the Web: A Mixed-Methods Approach, In Proceedings of the 7th Asian Information Retrieval Societies Conference (AIRS 2011), 181-192.

Kanoulas, E., Carterette, B., Clough, P., and Sanderson, M. (2011) Evaluating Multi-Query Sessions, In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information (SIGIR '11). ACM, New York, NY, USA, 1053-1062.

Clough, P., Foley, C., Gurrin, C., Jones, G.J.F., Kraaij, W., Lee, H., and Murdoch, V. (2011) Advances in Information Retrieval - 33rd European Conference on IR Research, ECIR 2011, Dublin, Ireland, April 18-21, 2011. Proceedings Springer LNCS 6611.

Bothin, A. and Clough, P. (2010) Quantitative Analysis of Individual Differences in Note-Taking and Talking Behaviour in Meetings, In Proceedings of IADIS Multi Conference on Computer Science and Information Systems 2010, Freiberg, Germany, 26-31 July. Available on CD-ROM.

Sanderson, M., Paramita, M., Clough, P. and Kanoulas, E. (2010) Do user preferences and evaluation measures line up?, In Proceedings of the 33rd Annual ACM SIGIR Conference, Geneva, Switzerland, pp. 555-562.

Clough, P., Sanderson, M., Abouammoh, M., Navarro, S. and Paramita, M. (2009) Multiple approaches to Analysing Query Diversity, In Proceedings of the 32nd Annual ACM SIGIR Conference, Boston, Massachusetts, pp. 734-735.

Clough, P. and Stevenson, M. (2009) Creating A Corpus of Plagiarised Academic Texts, In Proceedings of Corpus Linguistics Conference 2009, Liverpool (To Appear).

Sanderson, M., Tang, J., Arni, T. and Clough, P. (2009) What else is there? Search Diversity Examined, In Proceedings of the European Conference on Information Retrieval (ECIR'09), Toulouse, France, pp. 562-569.

Clough, P. and Sen, B. (2008) Evaluating Tagclouds for Health-Related Information Research, In Proceedings of the 13th International Symposium on Health Information Management Research (ISHIMR), Auckland, New Zealand, October 20-22 2008. (Nominated for Best Paper).

Pasley, R., Clough, P., Purves, R. and Twaroch, F. (2008) Mapping Geographic Coverage of the Web, In Proceedings of 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM GIS 2008), pp. 154-162.

Al-Maskari, A., Sanderson, M. and Clough, P. (2008), The Good and the Bad System: Does the Test Collection Predict Users’ Effectiveness?, In Proceedings of the 31st Annual International ACM SIGIR Conference (SIGIR2008), 20-24 July 2008, Singapore, pp. 59-66.

Al-Maskari, A., Sanderson, M. and Clough, P. (2008), Relevance Judgments between TREC and Non-TREC Assessors, In Proceedings of the 31st Annual International ACM SIGIR Conference (SIGIR2008), 20-24 July 2008, Singapore, pp. 683-684.

Carmichael, J., Larson, M., Marlow, J., Newman, E., Clough, P., Oomen, O., and Sav, S. (2008), Multimodal Indexing of Digital Audio-visual Documents: A Case Study for Cultural Heritage Data, In Proceedings of the Sixth International Workshop on Content-Based Multimedia Indexing (CBMI2008), London, UK, 18-20th June, pp. 93-100.

Marlow, J., Clough, P., Ireson, N., Cigarrán Recuero, J., Artiles, J. and Debole, F. (2008), The MultiMatch Project: Multilingual/Multimedia Access to Cultural Heritage on the Web, In Museums on the Web Conference (MW2008): Proceedings, J. Trant and D. Bearman (eds). Toronto: Archives & Museum Informatics. 2008.

Clough, P. and Read, S. (2008), Key Design Issues with Visualising Images using Google Earth, In Proceedings of the 30th European Conference on IR Research (ECIR'08), Glasgow, UK, April 2008, LNCS4956, pp. 570-574.

Marlow, J., Clough, P., Cigarrán Recuero, J. and Artiles, J. (2008), Exploring the Effects of Language Skills on Multilingual Web Search, In Proceedings of the 30th European Conference on IR Research (ECIR'08), Glasgow, UK, April 2008, LNCS4956, pp. 126-137.

Al-Maskari, A., Sanderson, M. and Clough, P. (2007), Arabic Users' Satisfaction with the Online Information as Obtained from Google , In Proceedings of Sixth International Conference on Conceptions of Library and Information Science (CoLIS), Borås, Sweden, August 13-16.

Marlow, J., Clough, P., and Dance, K. (2007), Multilingual needs of cultural heritage website visitors: A case study of Tate Online, In International Cultural Heritage Informatics Meeting (ICHIM07): Proceedings, J. Trant and D. Bearman (eds). Toronto: Archives & Museum Informatics. 2007. Published September 30, 2007 at http://www.archimuse.com/ichim07/papers/marlow/marlow.html.

Al-Maskari, A., Sanderson, M., and Clough, P.D. (2007), The Relationship between IR Effectiveness Measures and Users’ Satisfaction, In Proceedings of the ACM SIGIR2007 Conference, Amsterdam, Netherlands, pp. 773-774.

Purves, R. and Clough, P. (2006), Judging spatial relevance and document location for Geographic Information Retrieval, extended abstract, In Proceedings of 4th International Conference on Geographic Information Science (GIScience 2006), Münster, Germany, September 2006, pp. 159-164.

Clough, P.D., Joho, H. and Purves, R. (2006) Judging the Spatial Relevance of Documents for GIR, In Proceedings of the 28th European Conference on IR Research (ECIR'06), London, UK, April 2006, Springer-Verlag LNCS Volume 3936, pp. 548-552.

Müller, H., Clough, P., Hersh, W., Deselaers, T., Lehmann, T., and Geissbuhler, A. (2006), Using heterogeneous annotation and visual information for the benchmarking of image retrieval systems, SPIE conference Photonics West, Electronic Imaging, special session on benchmarking image retrieval systems, San Diego, February 2006.

Müller, H., Clough, P., Hersh, W., Deselaers, T., Lehmann, T. and Geissbuhler, A. (2005), Axes for the evaluation of medical image retrieval systems - the Image CLEF experience, In Proceedings of ACM Multimedia 2005 (Brave New Topics track), 6-12 November, Singapore, pp. 1014-1022.

Bucher, B., Clough, P., Joho, H., Purves, R., and Syed, A. K. (2005), Geographic IR Systems: Requirements and Evaluation. In Proceedings of the 22nd International Cartographic Conference, A Coruña, Spain, CD-ROM.

Purves, R., Clough, P. and Joho, H. (2005), Identifying imprecise regions for geographic information retrieval using the web, In Proceedings of GIS RESEARCH UK 13th Annual Conference, Glasgow, UK, pp. 313-318.

Clough, P., Sanderson, M. and Müller, H. (2004), A proposal for the CLEF Cross Language Image Retrieval Task 2004, In Proceedings of the 2004 CIVR conference, Dublin, Ireland, 2004, Springer-Verlag LNCS 3115, pp. 243-251.

Sanderson, M. and Clough, P. (2004), Measuring Pseudo Relevance Feedback and CLIR, In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'04), pp. 484-485.

Stevenson, M. and Clough, P. (2004), EuroWordNet as a Resource for Cross-Language Information Retrieval, In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC-04), May 2004.

Clough, P. and Stevenson, M. (2004), Cross-Language Information Retrieval using EuroWordnet and Word Sense Disambiguation, In Advances in Information Retrieval, McDonald and Tait (Eds), Proceedings of the 26th European Conference on IR Research (ECIR'04), Sunderland, UK, April 2004, Springer-Verlag LNCS 2997, pp.327-337.

Sanderson, M., Clough, P.D., Paterson C. and Tung Lo, W. (2004), Measuring a Cross Language Image Retrieval System, In Advances in Information Retrieval, McDonald and Tait (Eds), Proceedings of the 26th European Conference on IR Research (ECIR'04), Sunderland, UK, April 2004, Springer-Verlag LNCS 2997, pp.353-363.

Clough, P. and Sanderson, M.(2004), The Effects of Relevance Feedback in Cross Language Image Retrieval, In Advances in Information Retrieval, McDonald and Tait (Eds), Proceedings of the 26th European Conference on IR Research (ECIR'04), Sunderland, UK, April 2004, Springer-Verlag LNCS 2997, pp.238-252.

Clough, P. and Stevenson, M. (2004), Evaluating the Contribution of EuroWordNet and Word Sense Disambiguation to Cross-language Retrieval, In Proceedings of the Second International Global WordNet Conference (GWC-2004), Brno, Czech Republic. pp. 97-107, January 2004.

Levin, S., Clough, P.D., and Sanderson, M. (2003), Assessing the effectiveness of pen-based input queries. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Gaizauskas, R., Burnard, L., Clough, P. and Piao, S.L. (2003), Using the XARA XML-Aware Corpus Query Tool to investigate the METER Corpus. In Proceedings of Corpus Linguistics 2003, Lancaster, UK.

Clough, P., Gaizauskas, R. and Piao, S. L. (2002), Building and annotating a corpus for the study of journalistic text reuse. In Proceedings of the 3rd International Conference on Language Resources and Evaluation (LREC-02), pp.1678-1691 (Vol V), 29-31st May 2002, Los Palmas de Gran Canaria, Spain.

Clough, P.D., Gaizauskas, Piao, S.L. and Wilks, Y. (2002), Measuring Text Reuse, In Proceedings of Association for Computational Linguistics (ACL2002), Philadelphia, PA, USA, pp.152-159.

Gaizauskas, R., Foster, J., Wilks, Y., Arundel, J., Clough, P. and Piao, S.L. (2001), The METER corpus: a corpus for analysing journalistic text reuse, In Proceedings of Corpus Linguistics 2001, Lancaster, UK, pp.214-223.

---

Workshops

Petras, V., Forner, P., Clough, P. (2011) CLEF 2011 Labs and Workshop, Notebook Papers, 19-22 September 2011, Amsterdam, The Netherlands, ISBN 978-88-904810-1-7.

Clough, P., Gonzalo, J. and Karlgren, J. (2010) Creating Re-useable Log Files for Interactive CLIR, In SIGIR 2010 Workshop on the Simulation of Interaction (SimInt), Geneva 23 July 2010.

Kanoulas, E., Clough, P., Carterette, B. and Sanderson, M. (2010) Session Track at TREC2010, In SIGIR 2010 Workshop on the Simulation of Interaction (SimInt), Geneva 23 July 2010.

Clough, P. and Pasley, R. (2010) Images and Perceptions of Neighbourhood Extents, In Proceedings of 6th Workshop on Geographic Information Retrieval (GIR'10), Zurich 18-19 February 2010.

Warner, A. and Clough, P. (2009) A Proposal for Space Exploration at The National Archives, In Proceedings of Workshop: The Cultural Heritage of Historic European Cities and Public Participatory GIS, York (UK), September 2009.

Lestari Paramita, M., Sanderson, M. and Clough, P. (2009) Diversity in Photo Retrieval: Overview of the ImageCLEFPhoto Task 2009, In Borri, F., Nardi, A., and Peters, C., editors, Working Notes for the CLEF 2009 Workshop.

Gonzalo, J., Peinado, V., Clough, P. and Karlgren, J. (2009) Overview of iCLEF 2009: Exploring Search Behaviour in a Multilingual Folksonomy Environment, In Borri, F., Nardi, A., and Peters, C., editors, Working Notes for the CLEF 2009 Workshop.

Lestari Paramita, M., Sanderson, M. and Clough, P. (2009) Developing a Test Collection to Support Diversity Analysis, In Proceedings of Redundancy, Diversity, and Interdependence Document Relevance workshop held at ACM SIGIR, pp. 39-45.

Easingwood, A. and Clough, P. (2009) An Evaluation of Publicly Accessible Geographic Information Websites, In Proceedings of the ECIR 2009 Workshop Geographic Information on the Internet, Toulouse, France, April 6, 2009, pp. 61-66.

T. Arni, P. Clough, M. Sanderson, M. Grubinger (2009), Overview of the ImageCLEFphoto 2008 Photographic Retrieval Task, In Proceedings of 9th Workshop of the Cross-Language Evaluation Forum (CLEF'08), September 17-19 2008, LNCS 5706, pp. 500-511.

Gonzalo, J., Clough, P. and Karlgren, J. (2009), Overview of iCLEF2008: Search Log Analysis for Multilingual Image Retrieval, In Proceedings of 9th Workshop of the Cross-Language Evaluation Forum (CLEF'08), September 17-19 2008, LNCS 5706, pp. 227-235.

Tang, J., Arni, T., Sanderson, M. and Clough, P. (2009), Building a Diversity Featured Search System by Fusing Existing Tools, In Proceedings of 9th Workshop of the Cross-Language Evaluation Forum (CLEF'08), September 17-19 2008, LNCS 5706, pp. 560-567.

Clough, P., Marlow, J. and Ireson, N. (2008), Enabling Semantic Access to Cultural Heritage: A Case Study of Tate Online, Larson, M., K. Fernie, J. Oomen and J. Cigarran (eds.) Proceedings of the ECDL 2008 Workshop on Information Access to Cultural Heritage, Aarhus, Denmark, September 18, 2008. ISBN 978-90-813489-1-1 [Online]

Arni, T., Tang, J., Sanderson, M. and Clough, P. (2008), Creating a test collection to evaluate diversity in image retrieval, In Proceedings of the Workshop on Beyond Binary Relevance: Preferences, Diversity, and Set-Level Judgments, held at SIGIR2008.

Clough, P., Gonzalo, J., Karlgren, J., Barker, E., Artiles, J. and Peinado, V. (2008), Large-Scale Interactive Evaluation of Multilingual Information Access Systems - the iCLEF Flickr Challenge , In Proceedings of Workshop on novel methodologies for evaluation in information retrieval, 30th European Conference on Information Retrieval, Glasgow, 30th March-3rd April, pp. 33-38.

Grubinger, M., Clough, P., Hanbury, A., Mueller, H. (2008), Overview of the ImageCLEFphoto 2007 Photographic Retrieval Task, In Proceedings of 8th Workshop of the Cross-Language Evaluation Forum (CLEF'07), Budapest, September 2007, LNCS 5152, pp.433-444.

Siersdorfer, S., Sizov, S. and Clough, P. (2007) Know the Right People? Recommender Systems for Web 2.0, Proceedings of Workshop on Knowledge and Experience Management, FGWM'07, pp. 330-337.

Clough, P., Pasley, R., Siersdorfer, S., San Pedro J. and Sanderson, M. (2007), Visualising the South Yorkshire Floods of '07, Proceedings of Workshop on Geographic Information Retrieval GIR'07.

Pasley, R., Clough, P. and Sanderson, M. (2007), Geo-Tagging for Imprecise Regions of Different Sizes, Proceedings of Workshop on Geographic Information Retrieval GIR'07.

Minelli, S. H., Marlow, J., Clough, P., Cigarran Recuero, J.M., Gonzalo, J., Oomen, J. and Loschiavo, D. (2007), Gathering requirements for multilingual search of audiovisual material in cultural heritage, In Proceedings of Workshop on User Centricity - state of the art (16th IST Mobile and Wireless Communications Summit), Budapest, Hungary, 1-5 July, 2007.

Clough, P., Grubinger, M., Deselaers, T., Hanbury, A. and Müller, H. (2007), Overview of the ImageCLEF 2006 Photographic Retrieval and Object Annotation Tasks, Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers, Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (Eds.), LNCS Vol. 4730, 2007, ISBN 978-3-540-74998-1, Softcover, pp. 579-594.

Mueller, H., Deselaers, T., Grubinger, M., Clough, P., Hanbury, A. and Hersh, W. (2007) Problems with Running a Successful Multimedia Retrieval Benchmark, In Proceedings of the third MUSCLE / ImageCLEF workshop on image and video retrieval evaluation, Budapest, Hungary, 19-21 September 2007, [online].

Grubinger, M. and Clough, P. (2007) On the Creation of Query Topics for ImageCLEFphoto, In Proceedings of the third MUSCLE / ImageCLEF workshop on image and video retrieval evaluation, Budapest, Hungary, 19-21 September 2007, [online].

Clough, P., Al-Maskari, A. and Darwish, K. (2007), Providing Multilingual Access to Flickr for Arabic Users, Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers, Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (Eds.), LNCS Vol. 4730, 2007, ISBN 978-3-540-74998-1, Softcover, pp. 205-216.

Gonzalo, J., Karlgren, J. and Clough, P. (2007), iCLEF2006 Overview: Searching the Flickr WWW Photo-Sharing Repository, Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, September 20-22, 2006, Revised Selected Papers, Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (Eds.), LNCS Vol. 4730, 2007, ISBN 978-3-540-74998-1, Softcover, pp.

Al-Maskari, A., Clough, P., and Sanderson, M. (2006), Users' Effectiveness and Satisfaction for Image Retrieval, Workshop Information Retrieval 2006, University of Hildesheim, Germany, 9.-11. October 2006. pp. 83-87.

Clough, P., Marlow, J. and Sanderson, M. (2006), Designing Multilingual Information Access to Tate Online, Workshop held at the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Workshop: New Directions in Multilingual Access, Seattle, August 2006.

Clough, P., and Müller, H. (2006) Building and Evaluating Systems for Cross-Language Image Retrieval, DELOS Network of Excellence on Digital Libraries Demo Day, Bibliothèque Nationale de France, Francois-Mitterand site Paris, France, 1st Feb.

Grubinger, M., Clough, P., Müller, H. and Deselaers, T. (2006), The IAPR TC-12 Benchmark: A New Evaluation Resource for Visual Information Systems, In Proceedings of International Workshop OntoImage’2006 Language Resources for Content-Based Image Retrieval, held in conjuction with LREC'06, Genoa, Italy, pp. 13-23.

Clough, P., and Petrelli, D. (2006) Using Concept Hierarchies in Text-Based Image Retrieval: A User Evaluation, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 297-306.

Gey, F., Larson, R., Sanderson, M., Joho, H., Clough, P., and Petras, V. (2006) GeoCLEF: The CLEF 2005 Cross-Language Geographic Information Retrieval Track Overview, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 908-919.

Grubinger, M., Leung, C., and Clough, P. (2006) Linguistic Estimation of Topic Difficulty in Cross-Language Image Retrieval, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 558-566.

Gonzalo, J., Clough, P., and Vallin, A. (2006) Overview of the CLEF 2005 Interactive Track, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 251-262.

Clough, P., Müller, H., Deselaers, T., Grubinger, M., Lehmann, T., Jensen, J., and Hersh, W. (2006) The CLEF 2005 Cross–Language Image Retrieval Track, In Accessing Multilingual Information Repositories, Eds (Paul Clough, Julio Gonzalo, Thomas Mandl, Thomas Deselaers, Henning Müller, Horacio Rodríguez, Sven Hartrumpf, Felisa Verdejo, Alicia Ageno, Víctor Peinado), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 4022/2006, Softcover, pp. 535-557.

Sanderson, M., Tian, J. and Clough, P. (2006), Testing an automatic organisation of retrieved images into a hierarchy, In Proceedings of International Workshop OntoImage’2006 Language Resources for Content-Based Image Retrieval, held in conjuction with LREC'06, Genoa, Italy, pp. 44-49.

Müller, H., Clough, P., Hersh, W. and Geissbuhler, A. (2006) Variation of Relevance Assessments for Medical Image Retrieval, In Proceedings of 4th International Workshop on Adaptive Multimedia Retrieval, University of Geneva, Switzerland (in print - to appear in LNCS Volume 3877).

Clough, P., Gonzalo, J. and Karlgren, J. (2006) Multilingual interactive experiments with Flickr, In Proceedings of Workshop on New Texts - Wikis and blogs and other dynamic text sources, held in conjunction with the 11th Conference of the European Chapter of the Association for Computational Linguistics (EACL2006), Trento, Italy.

Clough, P., Sanderson, M., and Shou, X.M. (2005) Searching and Organizing Images Across Languages, In Proceedings of EVA (Electronic Imaging, the Visual Arts & Beyond), Moscow.

Clough, P. (2005), Extracting Metadata for Spatially-Aware Information Retrieval on the Internet, In Proceedings of Workshop on Geographic Information Retrieval (GIR'05), held in conjunction with CIKM2005, Bremen, Germany, pp. 25-30.

Clough, P., Joho, H. and Sanderson, M. (2005), Automatically Organising Images using Concept Hierarchies, Workshop held at the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Workshop: Multimedia Information Retrieval, August 15-19, 2005, in Salvador, Brazil.

Müller, H., Clough, P., Geissbuhler, A. and Hersh, W. (2005) ImageCLEF 2004-2005: results, experiences and new ideas for image retrieval evaluation. In Proceedings of the Fourth International Workshop on Content-Based Multimedia Indexing (CBMI2005), Riga, Latvia, CD-ROM.

Grubinger, M., Leung, C. and Clough, P. (2005) The IAPR Benchmark for Assessing Image Retrieval Performance in Cross Language Evaluation Tasks, In Proceedings of the first MUSCLE / ImageCLEF workshop on image and video retrieval evaluation,Vienna, Austria, 20th September 2005, pp. 33-50.

Clough, P., Müller, H. and Sanderson, M. (2005), The CLEF 2004 Cross Language Image Retrieval Track, In Multilingual Information Access for Text, Speech and Images: Results of the Fifth CLEF Evaluation Campaign, Eds (Peters, C., Clough, P., Gonzalo, J., Jones, G., Kluck, M. and Magnini, B.), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 3491/2005, pp. 597-613.

Clough, P. (2005), Caption vs. Query Translation for Cross-Language Image Retrieval, In Multilingual Information Access for Text, Speech and Images: Results of the Fifth CLEF Evaluation Campaign, Eds (Peters, C., Clough, P., Gonzalo, J., Jones, G., Kluck, M. and Magnini, B.), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 3491/2005, pp. 614-625.

Clough, P. and Sanderson, M. (2004), A proposal for comparative evaluation of automatic annotation for geo-referenced documents, Workshop held at the 27th Annual International ACM SIGIR Conference on Geographic Information Retrieval, University of Sheffield, UK, July 29th 2004.

Clough, P. and Sanderson, M. (2004), Assessing Translation Quality for Cross Language Image Retrieval, In Comparative Evaluation of Multilingual Information Access Systems, Eds (Peters, C., Gonzalo, Braschler, M. and Kluck, M.), Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany, Volume 3237/2004, pp. 594-610.

Arampatzis et al. (2004), Web-based delineation of imprecise regions, Workshop held at the 27th Annual International ACM SIGIR Conference on Geographic Information Retrieval, University of Sheffield, UK, July 29th 2004.

Müller, H., Geissbuhler, G., Marchand-Maillet, S., and Clough, P. (2004) Benchmarking Image Retrieval Applications, In Proceedings of The Tenth International Conference on Distributed Multimedia Systems (DMS'2004), Workshop on Visual Information Systems (VIS 2004), San Francisco, CA, USA, 2004, pp. 334-337.

Karlgren, J., Eriksson, G., Franzén, K., Clough, P., Hansen, P., Mizzarro, S., and Sanderson, M. (2004), Reading between the lines: attitudinal expressions in text, In proceedings of the AAAI Spring Symposium Workshop on Exploring Attitude and Affect in Text: Theories and Applications, 2004

Sanderson, M. and Clough, P. (2002), Eurovision - an image-based CLIR system, Workshop held at the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Workshop 1: Cross-Language Information Retrieval: A Research Roadmap, University of Tampere, Finland, August 15th 2002, pp. 56-59.

Clough, P. (2001), Measuring text reuse in a journalistic domain, In Proceedings of the 4th Annual CLUK Colloquium, University of Sheffield, Sheffield, UK, pp.53-63.

---

Reports

Clough, P. Measuring text reuse (2003), PhD thesis, University of Sheffield.

Piao, S.L., Clough, P. and Gaizauskas, R. (2001), The TEI annotation of the Meter Corpus, Department of Computer Science, University of Sheffield, UK (not refereed).

Clough, P. (2000), Plagiarism in natural and programming languages: an overview of current tools and technologies, Research Memoranda: CS-00-05, Department of Computer Science, University of Sheffield, UK.

Clough, P. Measuring text reuse and document derivation (2001), PhD transfer report, University of Sheffield.

Joho, H., Clough, P., and Sanderson, M. (2003) A Working Searching System, Deliverable number: D10 2101, Spatially-Aware Information Retrieval on the Internet (SPIRIT) project.

Clough, P., Joho, H., and Sanderson, M. (2004) Extraction of semantic annotations from textual web pages, Deliverable number: D15 6201, Spatially-Aware Information Retrieval on the Internet (SPIRIT) project.

Purves, R., Clough, P., Joho, H., Jones, C., van Kreveld, M. (2005) Modelling Vague Places with Knowledge from the Web, Deliverable number: D24 3301, Spatially-Aware Information Retrieval on the Internet (SPIRIT) project.

Bucher, B., Clough, P., Finch, D., Joho, H., Purves, R., Khirni Syed, A. (2005) Evaluation of SPIRIT prototype following integration and testing, Deliverable number: D31 7301, Spatially-Aware Information Retrieval on the Internet (SPIRIT) project.

Heinzle, F., Clough, P., Elias, B., and Sester, M. (2005) Metadata Annotation Methods, Deliverable number: D29 6301, Spatially-Aware Information Retrieval on the Internet (SPIRIT) project.

Peters, C., Oomen, O., Ibbotson, C., Ireson, N., Kamps, J., Jones, G., Clough, P. (2006) State of the art monitoring, Deliverable number: D1.1.1, Multilingual/Multimedia Access To Cultural Heritage (MultiMatch) project.

Clough, P., Marlow, J., Carmichael, J., Cigarran Recuero, J.M., Artiles, J., Gonzalo, J., and Petrelli, D. (2007) Designing the User Interface for the First Prototype, Deliverable number: D6.1.2, Multilingual/Multimedia Access To Cultural Heritage (MultiMatch) project.

Clough, P., Marlow, J., Carmichael, J., Cigarran Recuero, J.M., Artiles, Gareth Jones, Stéphane Marchand-Maillet, Neil Ireson (2008) Interface for Second Prototype, Deliverable number: D6.2.2, Multilingual/Multimedia Access To Cultural Heritage (MultiMatch) project.