Overview of Patent Retrieval Task at NTCIR-3

We describe the overview of patent retrieval task at NTCIR-3. The main task was the technical survey task, where participants tried to retrieve relevant patents to news articles. In this paper, we introduce the task design, the patent collections, the characteristics of the submitted systems, and the results overview. We also arranged the free-styled task, where participants could try anything they want as far as the patent collections were used. We describe the brief summaries of the proposals submitted to the free-styled task.

• Publication year

  2003

• Venue

  NTCIR Conference on Evaluation of Information Access Technologies

• Publication date

  2003-07-12

• Fields of study

  Computer Science

• Identifiers
  DOI 10.3115/1119303.1119306
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Workshop on patent retrieval SIGIR 2000 workshop report

  2000cited by this paper

• The cluster approach to acquiring patent datasets and assessing the quality of “prior art search”

  2025cites this paper
• P-BERT: Toward Long Sequence Modeling by Enabling Language Representation With Prefix Sequence Compression, Soft Position Embedding, and Data Augmentation for Patent Relevance Assessment

  2025cites this paper
• Innovating Patent Retrieval: A Comprehensive Review of Techniques, Trends, and Challenges in Prior Art Searches

  2024cites this paper
• Patent Sentiment Analysis to Highlight Patent Paragraphs

  2021cites this paper
• Challenges in Patent Information Retrieval

  2020influential citation
• Graded Relevance

  2020cites this paper
• Semantic and Topological Graphs for Patent Retrieval

  2019cites this paper
• On Approach for the Development of Patents Analysis Formal Metrics

  2019cites this paper
• Graded Relevance Assessments and Graded Relevance Measures of NTCIR: A Survey of the First Twenty Years

  2019cites this paper
• Patent Search Based on Model Specification of ICT Products

  2019cites this paper
• The Development of Carbon Capture and Storage in China: Progress, Challenge and Collaboration

  2018cites this paper
• Patent-Related Tasks at NTCIR

  2017cites this paper
• “Smart Queue” Approach for New Technical Solutions Discovery in Patent Applications

  2017cites this paper
• Patent retrieval: a literature review

  2017influential citation
• Keyword Based Search and its Limitations in the Patent Document to Secure the Idea from its Infringement

  2016cites this paper
• An Integrated Framework for Patent Analysis and Mining

  2016cites this paper
• Functional Innovation Strategies Based on IPC Knowledge Community Detection and Reorganization

  2016cites this paper
• E-patent examiner: Two-steps approach for patents prior-art retrieval

  2015cites this paper
• A Safe and Versatile Storage Server for Off-Site Backup

  2015cites this paper
• Patent Application Text Pre-processing for Patent Examination Procedure

  2015cites this paper
• A Semi-Supervised Machine Learning Method for Chinese Patent Effect Annotation

  2015cites this paper
• Patent Mining: A Survey

  2015cites this paper
• Retrieval of Research-level Mathematical Information Needs: A Test Collection and Technical Terminology Experiment

  2015cites this paper
• Evaluation of the Industrial and Social Impacts of Academic Research Using Patents and News Articles

  2015cites this paper
• Patent Query Formulation by Synthesizing Multiple Sources of Relevance Evidence

  2014cites this paper
• Evaluation of the Industrial and Social Impacts of Science and Technology Using Patents and News Articles

  2014cites this paper
• Query refinement for patent prior art search

  2014cites this paper
• Studying machine translation technologies for large-data CLIR tasks: a patent prior-art search case study

  2014cites this paper
• The effect of citation analysis on query expansion for patent retrieval

  2014cites this paper
• Using multiple query representations in patent prior-art search

  2013cites this paper
• Exploring manual and automatic query formulation in patent IR: Initial query construction and query generation process

  2013cites this paper
• Query Generation Techniques for Patent Prior-Art Search in Multiple Languages

  2013cites this paper
• Extrinsic Evaluation of Patent MT: Review and Commentary

  2013influential citation
• Patent Retrieval

  2013influential citation
• An Efficient Language Model Using Double-Array Structures

  2013cites this paper
• Measuring Closure Properties of Patent Sublanguages

  2013cites this paper
• BBN's Systems for the Chinese-English Sub-task of the NTCIR-10 PatentMT Evaluation

  2013cites this paper
• Automatic refinement of patent queries using concept importance predictors

  2012cites this paper
• Query Enhancement for Patent Prior-Art-Search Based on Keyterm Dependency Relations and Semantic Tags

  2012cites this paper
• A co-training based method for chinese patent semantic annotation

  2012cites this paper
• Learning-Based Pseudo-Relevance Feedback for Patent Retrieval

  2012cites this paper
• A ranking framework and evaluation for diversity-based retrieval

  2012cites this paper
• Automatic Translation of Scholarly Terms into Patent Terms Using Synonym Extraction Techniques

  2012influential citation
• Toward Higher Effectiveness for Recall- Oriented Information Retrieval: A Patent Retrieval Case Study

  2012influential citation
• Building Queries for Prior-Art Search

  2011cites this paper
• BBN's Systems for the Chinese-English Sub-task of the NTCIR-9 PatentMT Evaluation

  2011cites this paper
• A study of document-context models in information retrieval

  2011cites this paper
• Building a Statistical Machine Translation System for Translating Patent Documents

  2011cites this paper
• An efficient method for using machine translation technologies in cross-language patent search

  2011cites this paper
• Test Collection Based Evaluation of Information Retrieval Systems

  2010cites this paper
• Extracting Technology and Effect Entities in Patents and Research Papers

  2010cites this paper
• Pruning Training Samples Using a Supervised Clustering Algorithm

  2010cites this paper
• Quantifying the Challenges in Parsing Patent Claims

  2010cites this paper
• A new metric for patent retrieval evaluation

  2010cites this paper
• Knowledge Modeling in Prior Art Search

  2010cites this paper
• The Analysis of Patent Rate Concerning Technical Scope Standardized by the Number of Noun Phrases

  2010cites this paper
• Examining the Robustness of Evaluation Metrics for Patent Retrieval with Incomplete Relevance Judgements

  2010cites this paper
• Overview of the Patent Mining Task at the NTCIR-8 Workshop

  2010cites this paper
• Prior Art Search using International Patent Classification Codes and All-Claims-Queries

  2009cites this paper
• FindCite: automatically finding prior art patents

  2009cites this paper
• Exploring Structured Documents and Query Formulation Techniques for Patent Retrieval

  2009cites this paper
• A Vector Space analysis of Swedish patent claims, does decompounding help?

  2009cites this paper
• Developing an SDR Test Collection from Japanese Lecture Audio Data

  2009cites this paper
• DCU @ CLEF-IP 2009: Exploring Standard IR Techniques on Patent Retrieval

  2009cites this paper
• Classification of Research Papers into a Patent Classification System Using Two Translation Models

  2009cites this paper
• Automatic translation of scholarly terms into patent terms

  2009cites this paper
• A Patent Retrieval Method using Semantic Annotations

  2009cites this paper
• UTA and SICS at CLEF-IP

  2009cites this paper
• Extracting problem solved concepts from patent documents

  2009cites this paper
• Automatically Generating Queries for Prior Art Search

  2009cites this paper
• Construction of a Test Collection for Spoken Document Retrieval from Lecture Audio Data

  2009cites this paper
• The patent mining task in the seventh NTCIR workshop

  2008cites this paper
• Overview of the NTCIR-7 ACLIA IR4QA Task

  2008cites this paper
• A Methodology for Building a Patent Test Collection for Prior Art Search

  2008cites this paper
• Overview of the Patent Mining Task at the NTCIR-7 Workshop

  2008cites this paper
• Automatic extraction of citation information in Japanese patent applications

  2008cites this paper
• Trend Analyses of Patent Applicants and Relevant Patent Retrieval Technique Using the Trends

  2007cites this paper
• Overview of Classification Subtask at NTCIR-6 Patent Retrieval Task

  2007cites this paper
• Producing Test Collections for Patent Information Processing: Toward the Fusion of Information Retrieval and Natural Language Processing

  2007cites this paper
• Introduction to the special issue on patent processing

  2007cites this paper
• NTCIR-6 Preface

  2007cites this paper
• Leveraging Category-based LSI for Patent Retrieval

  2007cites this paper
• Text mining techniques for patent analysis

  2007cites this paper
• Identification of multi-sentence question type and extraction of descriptive answer in open domain question-answering

  2007cites this paper
• Cluster-based patent retrieval

  2007cites this paper
• Advanced learning algorithms for cross-language patent retrieval and classification

  2007cites this paper
• Patent document categorization based on semantic structural information

  2007cites this paper
• Technology survey and invalidity search: A comparative study of different tasks for Japanese patent document retrieval

  2007cites this paper
• Automatically Linking News Articles to Blog Entries

  2006cites this paper
• Cluster-Based Patent Retrieval Using International Patent Classification System

  2006cites this paper
• Evaluating patent retrieval in the third NTCIR workshop

  2006cites this paper
• Patient Status Classification by using Rule based Sentence Extraction and BM 25-kNN based Classifier

  2006cites this paper
• Proposal of two-stage patent retrieval method considering the claim structure

  2005cites this paper
• Experiments on Patent Retrieval at NTCIR-5 Workshop

  2005cites this paper
• MINING FOR PATENT MAP ANALYSIS

  2005cites this paper
• POSTECH at NTCIR-5 Patent Retrieval: Smoothing Experiments in a Language Modeling Approach to Patent Retrieval

  2005cites this paper
• Knowledge Discovery in Patent Texts : Techniques and Challenges 曾元顯 輔仁大學圖書資訊學系 教授

  2005cites this paper
• 特許請求項読解支援のための「発明の詳細な説明」との自動対応付け

  2005cites this paper
• Overview of the Fifth NTCIR Workshop

  2005cites this paper
• Revisiting Document Length Hypotheses: A Comparative Study of Japanese Newspaper and Patent Retrieval

  2005influential citation