IBM Debater® Thematic Clustering of Sentences

Format

CSV

License

CC-BY-SA-3.0

Domain

Natural Language Processing

Number of Records

692 articles

Data Split

NA

Size

10.6 MB

Author

Ein-Dor, Liat and Mass, Yosi and Halfon, Alon and Venezian, Elad and Shnayderman, Ilya and Aharonov, Ranit and Slonim, Noam

Data Origin

IBM Research - Project Debater

Dataset Version

1.0.2

Dataset Coverage

The dataset contains 692 articles from Wikipedia, where the number of sections(clusters) in each article ranges from 5 to 12, and the number of sentences per article ranges from 17 to 1614.

Business Use Case

Document Understanding
Thematic clustering of sentences is important for various use cases. For example, in multi-document summarization, one often extracts sentences from multiple documents that should be organized into meaningful sections and paragraphs. Similarly, within the emerging field of computational argumentation, arguments may be found in a widespread set of articles, which further require thematic organization to generate a compelling argumentative narrative