Inferensys

Glossary

Mention Detection

Mention detection is the NLP subtask of identifying all spans of text that refer to an entity, serving as the prerequisite step for building coreference chains.
MLOps engineer reviewing model serving infrastructure on laptop, container orchestration visible, technical workspace.
SPAN IDENTIFICATION

What is Mention Detection?

Mention detection is the foundational NLP subtask of identifying all spans of text within a document that refer to a real-world entity, serving as the prerequisite step for building coreference chains.

Mention detection is the process of locating every contiguous text span—whether a named entity, nominal phrase, or pronoun—that references a distinct discourse entity. It operates as the critical upstream component in coreference resolution pipelines, where undetected mentions create broken chains and missed entity links. Modern systems typically use span enumeration over all possible token subsequences, then apply a learned mention scorer to filter non-referring spans.

Unlike Named Entity Recognition, which classifies spans into predefined semantic categories, mention detection focuses purely on referential status regardless of type. Neural architectures like the e2e-coref model jointly optimize mention detection with mention-ranking objectives, using SpanBERT representations and head-finding heuristics to compute span embeddings. The output feeds directly into antecedent pruning and pairwise scoring for downstream coreference linking.

FOUNDATIONAL NLP SUBTASK

Key Characteristics of Mention Detection

Mention detection is the critical first stage of coreference resolution that identifies all text spans referring to entities. Without accurate mention boundaries, downstream coreference linking cannot function.

01

Span Boundary Identification

The primary mechanism involves identifying the start and end tokens of a mention. Modern systems use learned span representations rather than hand-crafted rules. Key aspects include:

  • Detecting nested mentions (e.g., 'the CEO of Microsoft' contains 'Microsoft')
  • Handling discontinuous mentions in some languages
  • Resolving head-finding heuristics to identify the syntactic head of each span
  • Pruning invalid spans using mention likelihood scores to reduce computational overhead
02

Mention Types and Classification

Detection systems must distinguish between different mention types to enable accurate coreference. The standard OntoNotes taxonomy includes:

  • Named entities: Proper nouns referring to specific people, organizations, locations
  • Nominal mentions: Common noun phrases that refer to entities ('the company', 'a large city')
  • Pronominal mentions: Pronouns that anaphorically refer to antecedents ('she', 'it', 'they')
  • Singleton detection: Identifying entities mentioned exactly once, which still require representation as distinct discourse referents
03

Neural Mention Scoring

Modern systems like the e2e-coref architecture compute a mention score for every possible span up to a maximum length. This score represents the model's confidence that a span constitutes a valid mention. The process involves:

  • Enumerating all spans within a length constraint (typically up to 10-30 tokens)
  • Computing span representations from token embeddings using attention or concatenation of boundary vectors
  • Applying a feedforward network to produce a scalar mention score
  • Using span pruning to retain only the top-k highest-scoring spans for downstream coreference scoring
04

Syntactic Constraints and Filtering

Detection accuracy improves by incorporating linguistic constraints that filter implausible mentions. Common filters include:

  • Part-of-speech tag filtering: Requiring mentions to contain at least one noun or pronoun
  • Syntactic parse constraints: Using dependency parses to identify valid noun phrase boundaries
  • Binding theory constraints: Applying syntactic principles governing pronoun-antecedent relationships
  • Head-finding rules: Identifying the semantic head word to ensure the span represents a coherent entity reference
05

Evaluation Metrics for Detection

Mention detection performance is measured independently from coreference linking using precision, recall, and F1 on identified mention boundaries. Key metrics include:

  • Mention Detection F1: Evaluates exact span boundary matching against gold annotations
  • B-cubed precision and recall: Measures entity-level detection accuracy across coreference chains
  • CoNLL-2012 shared task metrics: The standard benchmark combining MUC, B-cubed, and CEAF scores
  • Boundary errors vs. type errors: Distinguishing between incorrect span offsets and misclassified mention types
06

Zero Anaphora and Implicit Mentions

In pro-drop languages like Japanese, Chinese, and Spanish, entities may be referenced without explicit textual mentions. Detection systems must handle:

  • Zero pronouns: Syntactically omitted arguments that are semantically understood
  • Implicit arguments: Verb arguments inferred from context without surface realization
  • Empty category detection: Using syntactic cues to identify positions where a mention should be inferred
  • Cross-linguistic variation: Adapting detection strategies for languages with different pro-drop parameters
MENTION DETECTION

Frequently Asked Questions

Clear, technical answers to the most common questions about the foundational NLP subtask of identifying all textual spans that refer to an entity.

Mention detection is the NLP subtask of identifying all contiguous spans of text that refer to a distinct entity, serving as the prerequisite step for building coreference chains. It works by scanning a document to locate every noun phrase, named entity, or pronoun that constitutes a 'mention' of something in the discourse. Modern neural systems typically use a span enumeration approach, where a model scores every possible text span up to a maximum length, classifying each as a mention or non-mention based on learned span representations. These representations are often computed by concatenating the hidden states of a transformer model like BERT at the span's start and end tokens, combined with an attention-weighted sum of tokens inside the span. A head-finding heuristic may further refine the representation by identifying the syntactic head word. The output is a set of all mentions in the document, which are then passed to a coreference scoring module to determine which mentions refer to the same entity.

TASK BOUNDARIES

Mention Detection vs. Related NLP Tasks

How mention detection differs from adjacent tasks in the entity recognition pipeline

FeatureMention DetectionNamed Entity RecognitionCoreference Resolution

Primary objective

Identify all spans referring to entities

Identify and classify entity spans into categories

Link all mentions referring to the same entity

Output type

Unlabeled mention spans

Labeled entity spans (PER, ORG, LOC)

Coreference chains/clusters

Handles pronouns

Handles nominal mentions

Requires entity classification

Requires mention detection first

Singleton detection

Typical evaluation metric

Recall over gold mentions

F1 per entity type

MUC, B³, CEAF, LEA

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.