Informer
Newsletter of the BCS Information Retrieval Specialist Group
  • Informer Home
  • Issues
    • Spring 2017
    • Summer 2017
    • Autumn 2017
    • Winter 2018
    • Spring 2018
    • Summer 2018
    • Autumn 2018
    • Winter 2019
    • Spring 2019
    • Summer 2019
    • Autumn 2019
    • Winter 2020
    • Spring 2020
    • Summer 2020
    • Autumn 2020
  • Articles by Topic
  • Authors
  • About Informer
Browse: Home / 2013 / October / Musing on the theory of it all — ICTIR 2013

Musing on the theory of it all — ICTIR 2013

By Ingo Frommholz on October 31, 2013

The 4th International Conference on the Theory of Information Retrieval (ICTIR 2013) took place from September 29, 2013 to October 2, 2013, in the beautiful Danish capital of Copenhagen hosted by the University of Copenhagen, Department of Computer Science. As the name suggests this conference is primarily concerned with theoretical aspects of IR, however there is also room for industry-relevant and user-oriented topics that are viewed from a different, more theoretical, angle. ICTIR 2013 offered interesting tutorials, lots of keynotes, inspiring talks, a lively panel, a yummy banquet and lots of exciting people to meet.

Prologue: The tutorials

Peter Ingwersen was quite confident that the conference would be a success. He was right.

Peter Ingwersen was quite confident that the conference would be a success. He was right.

The conference started Sunday with 4 tutorials in 2 parallel sessions. The morning session had two interesting tutorials. In their tutorial “Quantum Mechanics and Information Retrieval: From Theory to Application” Benjamin Piwowarski and Massimo Melucci introduced the formalism behind Quantum Mechanics and its possible application to Information Retrieval. This interesting research direction had kind of a renaissance that was started by Keith van Rijsbergen in his seminal book “The Geometry of Information Retrieval”. If you don’t shy away from a bit of math and like to explore a non-classical formal framework for IR, you may have a look at what’s going on in quantum-based retrieval. What you gain is a powerful and expressive framework that goes beyond traditional probability theory and geometry as they are used in standard IR models. The assumption is that we need such a framework to model phenomena in IR that can not or not easily be modelled using a standard framework. The future is quantum, isn’t it?

At the heart of every IR evaluation there is statistical significance testing. Its theory and practice was the topic of the “Statistical Significance Testing in Information Retrieval: Theory and Practice” tutorial held by Ben Carterette. The goal of this tutorial was to help researchers and practitioners to gain a better understanding of how significance tests work and how they should be interpreted. Clearly, almost all IR researchers can benefit here.

The afternoon continued with two other exciting tutorials. The axiomatic approach to IR models was the topic of the “Axiomatic Analysis and Optimization of Information Retrieval Models” tutorial, held by Hui Fang. The tutorial showed how relevance can be modelled by a set of formal constraints on retrieval functions, for instance “Give a higher score to a document with more occurrences of a query term”. Retrieval models that satisfy more of such constraints are supposed to perform better.

In the other afternoon tutorial “IR Models: Foundations and Relationships”, Thomas Roelleke had a closer look at existing IR models and how they relate. Knowing about the foundations and relationships of IR models is crucial for building IR systems in many respect. The first thing Thomas had to do was to unify the terminology of existing models, which then revealed that indeed many models are related to each other and share some probabilistic roots. Besides that we learnt what you can find out about IR models simply by applying LaTeX macros when writing your documents.

The main conference

Thomas 'The Integrator' Roelleke demonstrating that golf and IR go well together

Thomas 'The Integrator' Roelleke demonstrating that golf and IR go well together

The main conference started on Monday with the first keynote address given by Dominic Widdows. Dominic observed that most vector space models in IR are still based on real numbers. “What kinds of numbers should we be using?”, asks Widdows. Other disciplines like physics have successfully been using a more expressive number field, complex numbers. Widdows encourages researchers to consider a different number field than real numbers. Further in his keynote Dominic Widdows presented a semantic WordSpace model that is able to answer questions like “What’s the dollar of Mexico?”

Following the keynote the first session about relevance feedback models started. In the afternoon there were sessions on evaluation and on context and diversification. After the sessions the posters and drinks reception took place, providing opportunites for some interesting discussion among the delegates.

In the Tuesday keynote Ricardo Baeza-Yates, VP of Yahoo! Research for Europe and Latin America, reflected if there is space for theory in modern commercial search engines. Unsurprisingly according to Baeza-Yates the answer is yes, as he pointed out using examples (tier prediction and query intent prediction) where theory can make an important contribution. “The best theory is inspired by practice and the best practice is inspired by theory” is a quote by Donald Knuth that basically sums up Ricardo’s main message.

Information Retrieval in the 1920s - Keith van Rijsbergen presenting Goldberg's Statistical Machine

Information Retrieval in the 1920s - Keith van Rijsbergen presenting Goldberg's Statistical Machine

Next on the agenda for Tuesday were sessions on recommender systems and temporal and thread search. Afterwards there was the panel discussion on challenges and long-range opportunities in IR research, chaired by Peter Ingwersen. Panelists were Ricardo Baeza-Yates (the ‘doer’ according to Peter Ingwersen), Stephen Robertson (introduced as the ‘thinker’), Thomas Roelleke (the ‘integrator’), Peiling Wang (the ‘methodologist’) and ChengXiang Zhai (the ‘broad-minded’). After a lively panel discussion, with lots interesting viewpoints from both the panelists and the audience, the conference dinner took place at Restaurant SULT located in the heart of Copenhagen.

 

The final day began with Keith van Rijsbergen‘s keynote on the roots of the theoretical basis for information retrieval, which became an interesting tour into the history of information retrieval. We learnt that the concept of search engines is as old as the 1920’s (Goldberg’s Statistical Machine) and also that we do machine learning in IR since the 60s (Rocchio). Keith asserts that we need theories to ask the right questions.

Two sessions on ranking followed after the keynote, before ICTIR 2013 concluded with a discussion on the future of ICTIR. The story of theory in information retrieval will of course continue, in fact as it turns out it is becoming more and more important.

What else do we take home?

The concept of one-man sessions. Both ChengXiang Zhai and Stefano Mizarro had their ‘own’ session (and they did it brilliantly). The unofficial ‘busy speaker award’ goes to ChengXiang Zhai.

Brewing theory that made it into application

Brewing theory that made it into application

Theory, though taking an awful long time to establish, is important for information retrieval in many respects. Even more, although the tutorials may suggests this, IR theory is not only about mathematical models. In fact, cognitive models and frameworks can be regarded theory, too, as it was emphasised in the closing discussion on the future of ICTIR as well as in Ricardo Baeza-Yates’ keynote. Researchers who usually publish in conferences like IIiX should check out future ICTIRs as well.

 

ICTIR had a normalized Salton award winner ratio of 0.06.

Copenhagen is a fantastic city. I enjoyed its relaxed atmosphere.

The organisers, Christina Lioma, Birger Larsen and Peter Ingwersen, did a great job! Birger even changed his affiliation during the conference. Congratulations on your new post at Aalborg University, Birger!

Some of the resources Keith van Rijsbergen mentioned in his keynote:

  • Miller’s paper “A probabilistic search strategy for Medlars”
  • “Towards information retrieval” by R. A. Fairthorne
  • The 5th edition of Kuhn’s “The Structure of Scientific Revolutions”

Further resources:

  • Another ICTIR report from Findwise, one of the ICTIR sponsors
  • #ICTIR2013 on Twitter
  • Pictures, pictures, pictures
About Ingo Frommholz
Ingo Frommholz

Ingo is a senior lecturer in computer science at the University of Bedfordshire in Luton, UK. His research focuses on different aspects of information retrieval, in particular formal models for user-oriented search and digital libraries, with emphasis on polyrepresentation, annotation-based retrieval, interactive quantum-based IR and probabilistic and logic-based models. Ingo is actively sharing his passion for information retrieval and digital libraries on Twitter where he is known as @iFromm.

« Previous Next »

Search

Recent comments

  • How To Connect The Dots Of Enterprise Data To Reach Your Business Potential - Business Quick Magazine on The state of enterprise search in Scandinavia in 2019
  • Standout Virtual Events – How to create an experience that your audience will love | Intranet Focus | Intranet strategy & management on Microsoft Research New Future of Work Conference 3-5 August 2020 – Part 1 The conference technology platform
  • Standout Virtual Events – How to create an experience that your audience will love | Intranet Focus | Intranet strategy & management on ECIR 2020 – Delivering a virtual conference
  • My Homepage on Designing Faceted Search: Getting the basics right (pt 2)
  • How good is your enterprise search support team? Assuming you have one! | Intranet Focus | Intranet strategy & management on The state of enterprise search in Scandinavia in 2019

Categories

  • Winter 2021
  • Autumn 2020
  • Summer 2020
  • Spring 2020
  • Winter 2020
  • Autumn 2019
  • Summer 2019
  • Spring 2019
  • Winter 2019
  • Autumn 2018
  • Summer 2018
  • Spring 2018
  • Winter 2018
  • Autumn 2017
  • Summer 2017
  • Spring 2017
  • Winter 2017
  • Autumn 2016
  • Summer 2016
  • Spring 2016
  • Winter 2016
  • Autumn 2015
  • Promotion
  • Summer 2015
  • Spring 2015
  • Winter 2015
  • Autumn 2014
  • Summer 2014
  • Spring 2014
  • Winter 2014
  • Autumn 2013
  • Summer 2013
  • Org Overview
  • Spring 2013
  • Winter 2013
  • Conference Review
  • Feature Article
  • Editorial
  • Events
  • Book Review
  • Autumn 2012
  • Summer 2012
  • Spring 2012
  • Winter 2012
  • Uncategorized

Tags

awards BCS Boolean City University clustering conference conferences design ECIR editorial enterprise seach enterprise search events Faceted search facets HCIR information architecture information discovery Information Retrieval information seeking interaction design IR IR practice IRSG log analysis MSR multimedia retrieval navigation recruitment search Search Solutions search strategies sensemaking site search ss12 survey taxonomy text analytics tutorial user experience user study wayfinding web search weka workshop

Authors

  • Agnes Molnar (1)
  • Alberto Purpura (1)
  • Aldo Lipani (1)
  • Alejandra Gonzalez-Beltran (1)
  • Allan Hanbury (1)
  • Amit Kumar Jaiswal (1)
  • Andy Macfarlane (43)
  • Benjamin Kille (1)
  • Benno Stein (1)
  • Birger Larsen (1)
  • Carsten Eickhoff (1)
  • Cathal Gurrin (8)
  • Charlie Hull (2)
  • Chris Madge (1)
  • Thomas Mandl (1)
  • Claudia Hauff (1)
  • Colin Wilkie (1)
  • David Elsweiler (1)
  • David Haynes (1)
  • David Maxwell (1)
  • Deirdre Lungley (1)
  • Dennis Aumiller (1)
  • Franco Maria Nardini (1)
  • Frank Hopfgartner (13)
  • Gabriel Tanase (1)
  • Gabriella Kazai (5)
  • Giorgio Maria Di Nunzio (1)
  • Haiming Liu (1)
  • Helen Clegg (1)
  • Helen Lippell (1)
  • Iadh Ounis (1)
  • Ingo Frommholz (7)
  • Joao Magalheis (4)
  • Jochen L. Leidner (2)
  • John Tait (7)
  • Jolanta Pietraszko (1)
  • Jon Chamberlain (4)
  • Jose Alberto Equivel (1)
  • Julie Glanville (1)
  • Kamran Abbasi (1)
  • Katherine Allen (3)
  • Kurt Kragh Sørensen (1)
  • Linda Achilles (1)
  • Luca Soldaini (1)
  • Marc Sloan (2)
  • Marco Palomino (2)
  • Marianne Sweeny (1)
  • Marina Santini (1)
  • Markus Schedl (1)
  • Martin White (54)
  • Mateusz Dubiel (1)
  • Michael Oakes (1)
  • Mike Salampasis (1)
  • Mohammad Aliannejadi (1)
  • Morgan Harvey (1)
  • Nandita Tripathi (1)
  • Natasha Chowdory (1)
  • Norbert Fuhr (1)
  • Olivia Foulds (1)
  • Parth Mehta (2)
  • Paul Cleverley (1)
  • Paul Matthews (2)
  • Philipp Mayr (1)
  • Roland Roller (1)
  • Roman Kern (1)
  • Ronan Cummins (2)
  • Sam Marshall (1)
  • Samuel Dodson (1)
  • Silviu Paun (1)
  • Song Chen (1)
  • Stefan Rueger (1)
  • Stephane Goldstein (1)
  • Stephanie Segura Rodas (1)
  • Steven Zimmerman (4)
  • Thanh Vu (1)
  • Tony Russell-Rose (27)
  • Trung Huynh (1)
  • Tu Bui (1)
  • Tyler Tate (8)
  • Udo Kruschwitz (32)
  • Val Gillet (1)

Copyright © 2021 Informer.

Powered by WordPress and Hybrid.