Invited Talks

  • 2022
    1. Ferro, N. (2022). L'accesso all'informazione: i sistemi, le tecnologie, le sfide. Linguaggio e informazione: sfide tecnologiche e impatto sociale, Adunanza ordinaria pubblica dell'Accademia Galileana di Science, Lettere ed Arti in Padova, Padua, Italy, 12 October 2022
    2. Ferro, N. (2022). Modelling and Analyzing IR System Performance: From Foundations to Measurement Issues. DOSSIER Summer School 2022, Olympiada, Greece, 26 September 2022
    3. Ferro, N. (2022). Information Retrieval Evaluation. 13th European Summer School in Information Retrieval (ESSIR 2022), Lisbon, Portugal, 18 July 2022
    4. Ferro, N. (2022). What’s happening in CLEF 2022. The 16th NTCIR Conference - Evaluation of Information Access Technologies, National Institute of Informatics (NII), Tokyo, Japan, 14-17 June 2022
    5. Ferro, N. (2022). What's the matter with IR evaluation measures? Scales? Significance Tests? Meaningfulness?. University of Glasgow, Glasgow, UK, 7 February 2022
  • 2021
    1. Ferro, N. (2021). IR evaluation measures: is it a matter of scales? Or meaningfulness? Or both?. Naver Labs Europe, Meylan, France, 29 April 2021
    2. Ferro, N. (2021). Rien ne va plus. Panel on "From IRCDL to IRCDL: Discussion on the future of DLs", 17th Italian Research Conference on Digital Libraries (IRCDL 2021), Padua, Italy, 18-19 February 2021
  • 2020
    1. Ferro, N. (2020). What’s happening in CLEF and what's the Covid-19 @ MLIA Initiative. The 15th NTCIR Conference - Evaluation of Information Access Technologies, National Institute of Informatics (NII), Tokyo, Japan, 8-11 December 2020
    2. Ferro, N. (2020). Reacting to Information Needs in a Global Pandemics: How to Build Multilingual Information Access Systems for Covid-19. Workshop on Crisis Response – Language tools to the rescue, European Language Resource Coordination (ELRC), 9 December 2020, Online.
    3. Ferro, N. (2020). Introduction to Information Retrieval Evaluation. ACM SIGIR/SIGKDD Africa Summer School on Machine Learning for Data Mining and Search (AFIRM 2020), Cape Town, Africa, 27-31 January 2020
  • 2019
    1. Ferro, N. (2019). Diving into Explanatory Models for IR Systems Performance. Royal Melbourne Institute of Technology (RMIT) University, Melbourne, Australia, 31 October 2019
    2. Ferro, N. (2019). Evaluation Measures Scales: From Theory to Experimentation. The 14th NTCIR Conference - Evaluation of Information Access Technologies, National Institute of Informatics (NII), Tokyo, Japan, 11-13 June 2019
    3. Ferro, N. (2019). From Algorithmic Explainability to System Performance Explainability and Prediction. Panel on "Societal Challenges for Search: Privacy, Bias, Accountability, Transparency and some other scary things", 41st European Conference on Information Retrieval (ECIR 2019), 14-18 April 2019, Cologne, Germany
    4. Ferro, N. (2019). Reproducibility in Information Retrieval. Panel on "Digital Libraries: on supporting Open Science", 15th Italian Research Conference on Digital Libraries (IRCDL 2019), 31st January - 1st February 2019, Pisa, Italy
    5. Ferro, N. (2019). Information Retrieval Evaluation. ACM SIGIR/SIGKDD Africa Summer School on Machine Learning for Data Mining and Search (AFIRM 2019), 14-18 January 2019, Cape Town, Africa
  • 2018
    1. Ferro, N. (2018). Rich Explanatory Models of IR System Performance. Forum for Information Retrieval Evaluation (FIRE 2018), 7-9 December 2018, Gandhinagar, India
    2. Ferro, N. (2018). From Systems to Components: Breaking-down Performance and Discovering Interactions. 11th International Quantitative Linguistics Conference (QUALICO 2018), Wroclaw, Poland, 5-8 July 2018
    3. Ferro, N. (2018). The Long Road Ahead from Explanation to Prediction of IR System Performance. 9th Italian Information Retrieval Workshop (IIR 2018), Rome, Italy, 28-30 May 2018
    4. Ferro, N. (2018). ACM Artifact Badging - SIGIR Survey. 3rd Strategic Workshop in Information Retrieval in Lorne (SWIRL III), Lorne, Australia, 13-16 February 2018
    5. Ferro, N. and Voorhees, E. M. (2018). Reproducibility. 3rd Strategic Workshop in Information Retrieval in Lorne (SWIRL III), Lorne, Australia, 13-16 February 2018
  • 2017
    1. Ferro, N. (2017). IR Experimental Evaluation and Evaluation Measure Scales. University of Milano Bicocca, 11th December 2017, Milan, Italy.
    2. Ferro, N. (2017). CLEF 2018: Evaluation Labs, Conference, and Initiative. The 13th NTCIR Conference - Evaluation of Information Access Technologies, National Institute of Informatics (NII), Tokyo, Japan, 5-8 December 2017
    3. Ferro, N. (2017). Advanced Performance Modelling (and Prediction?) Techniques in IR. Towards Cross-Domain Performance Modeling and Prediction: IR/RecSys/NLP - Dagstuhl Perspectives Workshop 17442, Schloss Dagstuhl, Germany, 29 October-3 November 2017
  • 2016
    1. Ferro, N. (2016). Towards an Anatomy of Search Engine Performances. Forum for Information Retrieval Evaluation (FIRE 2016), 9th December 2016, Kolkata, India
    2. Ferro, N. (2016). Towards Component-based Evaluation of Information Retrieval Systems. University of Milano Bicocca, 9th May 2016, Milan, Italy.
    3. Ferro, N. (2016). Multilingual Information Access: What and How Well?. Workshop on Modeling, Learning and Mining for Cross/Multilinguality (MultiLingMine 2016), co-located with the 38th European Conference on Information Retrieval (ECIR 2016), 20th March 2016, Padua, Italy.
    4. Ferro, N. (2016). Managing and Curating IR Experimental Evaluation Data. Dagstuhl Seminar 16041 on Reproducibility of Data-Oriented Experiments in e-Science, 25-29 January 2016, Schloss Dagstuhl, Germany.
    5. Ferro, N. (2016). IMS Research Activities. Information over Space and Time: Seminario di studi sulle ricerca dei dati territoriali, edilizi ed economici nel tempo e nello spazio, 19th January 2016, Department of Civil, Environmental and Architectural Engineering, Padua, Italy.
  • 2015
    1. Ferro, N. (2015). Process to apply to H2020. Elsevier, 18th September 2015, Amsterdam, The Netherlands.
    2. Agosti, M. and Ferro, N. (2015). Digital Annotations: Why, What, and How. Panel on Speech audio archives: preservation, restoration, annotation, aimed at supporting the linguistic analysis, Accademia Nazionali dei Lincei, Centro Linceo Interdisciplinare "Beniamo Serge", 14th September 2015, Rome, Italy.
    3. Ferro, N. (2015). How (not) to evaluate keyword search systems. Keystone Spring 2015 WG Meeting, 11th May 2015, Košice, Slovakia.
  • 2014
    1. Ferro, N. (2014). CLEF 15 Years of IR Evaluation in Europe. 6th International Workshop on Evaluating Information Access (EVIA 2014), co-located with the NII Testbeds and Community for Information Access Research (NTCIR-11) Conference, 9th December 2014, Tokyo, Japan
    2. Ferro, N. (2014). CLEF 15 Years of IR Evaluation in Europe. Forum for Information Retrieval Evaluation (FIRE 2014), 7th December 2014, Bangalore, India
    3. Ferro, N. (2014). Assessing Performances across Evaluation Cycles: The Example of CLEF 15th Birthday. Forum for Information Retrieval Evaluation (FIRE 2014), 5th December 2014, Bangalore, India
    4. Ferro, N. (2014). CLEF 15 Years of IR Evaluation in Europe. Twenty-Third Text REtrieval Conference (TREC 2014), National Institute of Standards and Technology (NIST), 21st November 2014, Gaithersburg, Maryland, USA.
    5. Agosti, M. and Ferro, N. (2014). Database e information retrieval. Il documento elettronico. Oltre le norme per condividere buone pratiche. Workshop annuale a cura di ANAI – Sezione Piemonte e Valle d’Aosta, 28th October 2014, Politecnico di Torino, Italia.
    6. Ferro, N. (2014). What do we mean by "Efficient Assessment"?. ACM SIGIR Workshop on Gathering Efficient Assessments of Relevance (GEAR 2014), co-located with the 37th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2014), 11th July 2014, Gold Coast, Australia.
  • 2013
    1. Ferro, N. (2013). (Formal) Models for Systems, Infrastructures, Communities, and Cultures. Panel on The Digital Library to Support the Computer Humanist, 2nd AIUCD Annual Conference 2013 on Collaborative Research Practices and Shared Infrastructures for Humanities Computing (AIUCD 2013), 12 December 2013, Padua, Italy
    2. Ferro, N. (2013). CLEF 2013 and Onwards. Forum for Information Retrieval Evaluation (FIRE 2013), 6 December 2013, New Delhi, India
    3. Ferro, N. (2013). Document Misplacement for IR Evaluation. Forum for Information Retrieval Evaluation (FIRE 2013), 5 December 2013, New Delhi, India
    4. Invitation at Evaluation Methodologies in Information Retrieval - Dagstuhl Seminar 13441, Dagstuhl, Germany, 27 October-1 November 2013
    5. Ferro, N. (2013). Experimental Evaluation and the Web of Data. Keynote talk at Open Research Areas in Information Retrieval (OAIR 2013), 10th International Conference in the RIAO series, 24 May 2013, Instituto Superior de Engenharia de Lisboa (ISEL), Lisbon, Portugal
    6. Ferro, N. (2013). Multilingual and Multimedia Information Access Evaluation. Official Master's Degree in Artificial Intelligence, Pattern Recognition and Digital Imaging (MIARFID), 21 February 2013, Universitat Politècnica de València, Spain
    7. Ferro, N. (2013). Lessons Learned in Designing and Developing Digital Archives. International Workshop on Digital Archives for a Social History of Fashion and Costume, 15 February 2013, Università di Bologna Rimini Campus, Italy
    8. Ferro, N. (2013). Evaluation Infrastructures. PROMISE Winter School 2013 on Bridging between Information Retrieval and Databases, 7 February 2013, Bressanone, Italy
    9. Ferro, N. (2013). Supporting IR Experimentation through Evaluation Infrastructures. Integrating Data for Analysis, Anonymization, and Sharing (iDASH) External Webinar, National Institute of Health (NIH) Roadmap for Medical Research, 18 January 2013, Division of Biomedical Informatics, University of California, San Diego, USA
  • 2012
    1. Ferro, N. (2012). The CLEF Initiative From 2010 to 2013 and Onwards. Forum for Information Retrieval Evaluation (FIRE 2012), 19 December 2012, Kolkata, India
    2. Ferro, N. (2012). Evaluation Infrastructures for IR Experimentation. Forum for Information Retrieval Evaluation (FIRE 2012), 18 December 2012, Kolkata, India
    3. Ferro, N. (2012). The CLEF Initiative: From 2010 to 2012 and Onwards. MediaEval Benchmarking Initiative for Multimedia Evaluation, MediaEval 2012 Workshop, 5 October 2012, Pisa, Italy
    4. Ferro, N. (2012). Gearing up Evaluation to Drive and Support MLIA Systems Development. Special Session: EC Projects, a broad overview organized by "Unit E1 Language Technologies" at the Eighth International Conference on Language Resources and Evaluation (LREC 2012), 24 May 2012, Istanbul, Turkey
    5. Ferro, N. and Silvello, G. (2012). Evaluation Infrastructures: Experimentation, Visualization and... Simulation. University of Tampere, Finland, 23 March 2012
    6. Invitation at The Second Strategic Workshop on Information Retrieval in Lorne (SWIRL 2012), Lorne, Australia, 15-17 February 2012
  • 2011
    1. Ferro, N. (2011). Presentation of the PROMISE Network of Excellence. ICT-2011 Call 8 Information and Networking Day on Intelligent Information Management. Jean Monnet Conference Centre, Luxembourg, 26 September 2011
    2. Ferro, N. (2011). Experimental Evaluation and Hypertexts. First Workshop on Personalised Multilingual Hypertext Retrieval (PMHR 2011), co-located with the 22nd ACM Conference Hypertext and Hypermedia. Eindhoven, The Netherlands, 6 June 2011
    3. Ferro, N. (2011). Perspectives for Large-scale Evaluation Campaigns and the Cross-Language Evaluation Forum. University of Lugano, Switzerland, 10 February 2011
  • 2010
    1. Ferro, N. (2010). Evaluation Campaigns: What Should We Do with Our Data?, Forum for Information Retrieval Evaluation (FIRE 2010). DAIICT, Gandhinagar, Gujarat, India, 19-21 February 2010
    2. Ferro, N. (2010). CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum. The 8th NTCIR Workshop (2009/2010) - Evaluation of Information Access Technologies: Information Retrieval, Question Answering, and Cross-Lingual Information Access, National Institute of Informatics (NII), Tokyo, Japan, 15-18 June 2010
    3. Ferro, N. (2010). Cross-Language Evaluation Forum. Networking Session "Benchmarking multimedia retrieval applications" at ICT 2010: Digitally Driven. Brussels, Belgium, 27-29 September 2010
    4. Ferro, N. (2010). Quality and Interoperability. DL.org Autumn School on Digital Libraries and Digital Repositories: Modelling, Best Practices & Interoperability, Athens, Greece, 3-8 October 2010
    5. Ferro, N. (2010). CLEF and PROMISE. AI*IA Workshop on Human Language Technologies for Italian, Brescia, Italy, 1 December 2010
  • 2009
    1. Ferro, N. (2009). MLIA Architectures: Standalone Applications and Services to Complex Systems. TrebleCLEF Summer School on Multilingual Information Access. Santa Croce in Fossabanda, Pisa, Italy, 15-19 June 2009
    2. Ferro, N. (2009). Multilinguality and Digital Libraries. Fondazione Bruno Kessler (FBK), Trento, Italy, 18 June 2009
    3. Ferro, N. (2009). Grid@CLEF 2009. New Challenges in Information Retrieval and Text Mining in an Open Source Initiative. CNIPA, Rome, Italy, February 5-6, 2009
  • 2008
    1. Ferro, N. and Peters, C. (2008). From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum. The 7th NTCIR Workshop (2007/2008) - Evaluation of Information Access Technologies: Information Retrieval, Question Answering, and Cross-Lingual Information Access, National Institute of Informatics (NII), Tokyo, Japan, 16-19 December 2008
  • 2007
    1. Ferro, N. (2007). From CLEF Towards Treble-CLEF. The Sixteenth Text REtrieval Conference (TREC 2007), National Institute of Standards and Technology (NIST), Gaithersburg, Maryland, USA, 6-9 November 2007
    2. Agosti, M., Di Nunzio, G.M., Ferro, N., and Peters, C. (2007). CLEF: Ongoing Activities and Plans for the Future. The 6th NTCIR Workshop (2006/2007) - Evaluation of Information Access Technologies: Information Retrieval, Question Answering, and Cross-Lingual Information Access, National Institute of Informatics (NII), Tokyo, Japan, 15-18 May 2007