Mining query logs to optimize index partitioning in parallel Web search engines (Contributo in atti di convegno)

Type

• Prodotto della ricerca (Classe)
• Contributo in atti di convegno (Classe)

Label

• Mining query logs to optimize index partitioning in parallel Web search engines (Contributo in atti di convegno) (literal)

Anno

• 2007-01-01T00:00:00+01:00 (literal)

Alternative label

• Perego R.; Lucchese C.; Orlando S.; Silvestri F. (2007)
  Mining query logs to optimize index partitioning in parallel Web search engines
  in INFOSCALE 2007, Suzhou, China
  (literal)

Http://www.cnr.it/ontology/cnr/pubblicazioni.owl#autori

• Perego R.; Lucchese C.; Orlando S.; Silvestri F. (literal)

Http://www.cnr.it/ontology/cnr/pubblicazioni.owl#note

• In: INFOSCALE 2007 (Suzhou, China, June 6-8 2007). Proceedings, pp. CD - ROM. ICST, 2007. (literal)

Http://www.cnr.it/ontology/cnr/pubblicazioni.owl#descrizioneSinteticaDelProdotto

• ABSTRACT: Large-scale Parallel Web Search Engines (WSEs) needs to adopt a strategy for partitioning the inverted index among a set of parallel server nodes. In this paper we are interested in devising an effective term-partitioning strategy, according to which the global vocabulary of terms and the associated inverted lists are split into disjoint subsets, and assigned to distinct servers. Due to the workload imbalance caused by the skewed distribution of terms in user queries, finding an effective partitioning strategy is considered a very complex task. In this paper we first formally introduce Term Partitioning as a new optimization problem. Then we show how the knowledge mined from past WSE query logs can be profitably used to discover good solutions of this problem. Finally, we report many results to show that we are able to effectively reduce both the average number of servers activated per each query, along with the workload imbalance. Experiments are conducted on large query logs of real WSEs. (literal)

Http://www.cnr.it/ontology/cnr/pubblicazioni.owl#affiliazioni

• ISTI-CNR (literal)

Titolo

• Mining query logs to optimize index partitioning in parallel Web search engines (literal)

Prodotto di

• Istituto di scienza e tecnologie dell'informazione \"Alessandro Faedo\" (ISTI) (Istituto)
• Sistemi e algoritmi per Big Data (ICT.P09.006.001) (Modulo)

Autore CNR

• SALVATORE ORLANDO (Persona)
• RAFFAELE PEREGO (Unità di personale interno)

Insieme di parole chiave

• Parole chiave di "Mining query logs to optimize index partitioning in parallel Web search engines" (Insieme di parole chiave)

Incoming links:

Autore CNR di

• RAFFAELE PEREGO (Unità di personale interno)
• SALVATORE ORLANDO (Persona)

Prodotto

• Istituto di scienza e tecnologie dell'informazione \"Alessandro Faedo\" (ISTI) (Istituto)
• Sistemi e algoritmi per Big Data (ICT.P09.006.001) (Modulo)

Insieme di parole chiave di

• Parole chiave di "Mining query logs to optimize index partitioning in parallel Web search engines" (Insieme di parole chiave)