How to Use Paper Machines

To begin, right-click (control-click for Mac) on the collection you wish to analyze and select “Extract Texts for Paper Machines.” Once the extraction process is complete, this right-click menu will offer several different processes that may be run on a collection, each with an accompanying visualization. Once these processes have been run, selecting “Export Output of Paper Machines…” will allow you to choose which visualizations to export.

Word Cloud

Displays words scaled according to the frequency of their occurrence. An oft-maligned, but still arguably useful way to get a quick impression of the most common words in your collection. Either a basic word cloud, a word cloud with tf*idf filtering to remove unimportant words, or multiple word clouds (divided up by subcollection or time interval, specified in days) can be generated. The multiple word clouds can be filtered using tf*idf, Dunning’s log-likelihood, or Mann-Whitney U tests, each of which will provide different results depending on the data. By default, a basic word cloud will appear in the Tags pane of Zotero once text has been extracted.

Phrase Net

Finds phrases that follow a certain pattern, such as “x and y,” and displays the most common pairings. This method is derived from a Many Eyes visualization).

Mapping

Flight Paths

Generates a map linking texts from their places of publication to the places they mention, filtered by time.

Heatmap

Generates a map showing regions of relative intensity for mentions in the text. Same as the flight path visualization without the link data; may be more usable on large datasets).

Export Geodata to CSV

Creates a CSV file with place name, latitude/longitude, the Zotero item ID number, and some context around the mention.

DBpedia Annotation

Annotates files using the DBpedia Spotlight service, providing a look at what named entities (people, places, organizations, etc.) are mentioned in the texts. Entities are scaled according to the frequency of their occurrence.

Topic Modeling

Shows the proportional prevalence of different “topics” (collections of words likely to co-occur) in the corpus, by time or by subcollection. This uses the MALLET package to perform latent Dirichlet allocation, and by default displays the 5 most “coherent” topics, based on a metric devised by Mimno et al. A variety of topic model hyperparameters can be specified before the model is created.

After the model is generated, clicking “Save” in display will open a new window with the graph displayed free of interactive controls; this window may be saved as an “.SVG” file or captured via screenshot. It will also, in the original window, preserve the current selection of topics, search terms, and time scale as a permalink; please bookmark this if you wish to return to a specific view with interactive controls intact.

JSTOR Data For Research

The topic model can be supplemented with datasets from JSTOR Data For Research. You must first register for an account, after which you may search for additional articles based on keywords, years of publiation, specific journals, and so on. Once the search is to your liking, go to the Dataset Requests menu at the upper right and click “Submit New Request.” Check the “Citations” and “Word Counts” boxes, select CSV output format, and enter a short job title that describes your query. Once you click “Submit Job”, you will be taken to a history of your submitted requests. You will be e-mailed once the dataset is complete. Click “Download (#### docs)” in the Full Dataset column, and a zip file timestamped with the request time will be downloaded. This file (or several files with related queries) may then be incorporated into a model by selecting “By Time (With JSTOR DFR)” in the Topic Modeling submenu of Paper Machines. Multiple dataset zips will be merged and duplicates discarded before analysis begins; be warned, this may take a considerable amount of time before it begins to show progress (~15-30 minutes).

Preferences

Currently, the language stoplist in use, types of data to extract, and default parameters for topic modeling may be adjusted in the preference pane. Any custom stopwords may be added to the “Stop Words” pane, one per line, to help eliminate irrelevant terms from your data.