Multi-Paragraph Segmentation of Expository Texts

Marti A. Hearst

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-94-790
January 1994

http://www2.eecs.berkeley.edu/Pubs/TechRpts/1994/CSD-94-790.pdf

We present a method for partitioning expository texts into coherent multi-paragraph units which reflect the subtopic structure of the texts. Using Chafe's Flow Model of discourse, we observe that subtopics are often expressed by the interaction of multiple simultaneous themes. We describe two fully-implemented algorithms that use only term repetition information to determine the extents of the subtopics. We show that the segments correspond well to human judgements of the major subtopic boundaries of thirteen lengthy texts, and suggest the use of such segments in information retrieval applications.


BibTeX citation:

@techreport{Hearst:CSD-94-790,
    Author = {Hearst, Marti A.},
    Title = {Multi-Paragraph Segmentation of Expository Texts},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {1994},
    Month = {Jan},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/1994/5389.html},
    Number = {UCB/CSD-94-790},
    Abstract = {We present a method for partitioning expository texts into coherent multi-paragraph units which reflect the subtopic structure of the texts. Using Chafe's Flow Model of discourse, we observe that subtopics are often expressed by the interaction of multiple simultaneous themes. We describe two fully-implemented algorithms that use only term repetition information to determine the extents of the subtopics. We show that the segments correspond well to human judgements of the major subtopic boundaries of thirteen lengthy texts, and suggest the use of such segments in information retrieval applications.}
}

EndNote citation:

%0 Report
%A Hearst, Marti A.
%T Multi-Paragraph Segmentation of Expository Texts
%I EECS Department, University of California, Berkeley
%D 1994
%@ UCB/CSD-94-790
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/1994/5389.html
%F Hearst:CSD-94-790