Tuesday, July 15, 2014

Book of Mormon historicity favors progressive ideals

I am a stronger believer than I was, even as a young, indoctrinated teenager, that the Book of Mormon was written by real life, historical people who actually saw and did what they said they did. However, anyone who reads some of my past blog posts, sees some of my more private online conversations, or talks with me about Mormonism for long, will realize that I hold many views that don't line up with typical teenage indoctrination among Latter-day Saints. I spend a fair amount of intellectual time and energy around more liberal or progressive (or cultural) Mormons, although I tend to tune out those focused on being critical of the LDS church. Most of these people recognize problems with understanding what Joseph Smith actually meant by 'translating', and examine pronouncements given with prophetic authority very critically. A common (but not universal) sentiment among them is that the Book of Mormon is valuable simply because we, as the readers, find moral value in it. It has shaped our lives and history whether or not it is truly a historical record. I think they are largely correct. A number go so far as to say they don't believe it is a historical record, and that trying to demonstrate Book of Mormon historicity is a waste of time and a losing battle. I think progressive Mormons are hurting their efforts to shape the future of the church by rejecting Book of Mormon historicity. Instead, they should embrace it and push the idea that the Book of Mormon is truly an ancient historical document. Here are some reasons.

Skip these reasons--I'm venting

First, and perhaps least important, it's not a losing battle. Reasons against believing historicity are completely based on subjective arguments or the absence of evidence, every one of which is undermined by closer readings of the Book of Mormon text or by positive evidences from culture history (archaeology plus other stuff; for easily accessible examples see here). I think critics of historicity will find their resistance to it mildly embarrassing in 50 years. That's me being an uninspired prophet, so we won't dwell on it.

Second, Joseph Smith taught so much stuff that can be used to promote progressive ideals, and it is much easier to justify Joseph Smith as a prophet--and thus someone worth listening to--if he wasn't just imagining that he was translating a historical work. I think this is an important point, but it is highly debatable and won't be discussed here.

Historicity Empowers

Third, scholars who accept Book of Mormon historicity bring in information from many scholarly disciplines. This places limits on the Book of Mormon, turning the game of choosing the best interpretations from a superficial, mystical exercise shaped solely by our 21st (or 20th, or 19th) century views, into an endeavor potentially shaped by the best advances in the scholarship of cultural history, literary theory, etc. This changes the entire discourse around what the Book of Mormon teaches. I want to outline a few ways this favors progressive ideals.

Historicity Empowers Scholarship

Believing the Book of Mormon was written by historical figures--people we can potentially learn about through the study of cultural history--effectively weakens the absolute interpretive control of the religious hierarchy. I believe this control is more culturally assumed than doctrinal, anyway, and that many prophets don't feel it is their job to give absolute interpretations of scripture. Many prophets think we should all be doing it ourselves, and have said as much, although others would restrict personal interpretation more. But accepting the text as belonging in a particular historical and cultural context gives anyone who develops expertise in that history an added authority in scriptural interpretation regardless of their ecclesiastical position. Scholarly experts have more sway in how we understand scripture, and the door is opened for science to influence Mormonism a little more.

Allowing science to encroach upon a religious text will have serious consequences and will meet with a lot of resistance, but it will likely have a similar effect to Biblical scholarship. There will be fundamentalist Mormons who resist the liberalized understanding, seeing it as eroding moral values, but there are few mainstream Christian churches which don't recognize many of the difficulties with literal interpretation of the Bible. I'm unaware of any that still believe the Sun revolves around the Earth, although some still seek to justify a global flood. The same will happen with Mormonism. It will take a generation for each significant shift, but changes will happen, and they will happen in the direction of supporting measurable truths.

Historicity Witnesses for Christ

In contrast to the effect of Biblical scholarship causing many students to doubt the divinity and resurrection of Christ, embracing the Book of Mormon as historical has the opposite effect. Whatever biases its authors may have had, the Book of Mormon is a witness of the risen Christ. Biases don't eliminate the lived experiences of thousands, and the transmission of those experiences is much less convoluted than for the Bible. People who saw Christ wrote about it. Mormon had their writings. Joseph Smith translated those writings. Three steps with no gap of a generation or two between the events and their recording. In addition, it's difficult to argue away the Sermon on the Mount as a collection of wisdom sayings. It comes from Christ in its full force with its injunctions to love your enemies and do good to them that hurt you.

Historicity Empowers Moral Responsibility

If the Book of Mormon is historical, ancient prophets are as human as modern ones, with all of their biases and limitations of knowledge and experience. This gives greater justification for the serious care progressive Mormons give to listening to modern prophets and then carefully examining what they teach. It gives greater strength to the claim that we should claim responsibility for our own moral choices, and not simply rely on anyone else. Instead of having to convince Latter-day Saints that the Book of Mormon shouldn't be read historically, you only need to convince them to read it more literally. To read the subtext illuminated by faithful, church sponsored, Book of Mormon scholars. Nephi got the history right--from his own perspective. When we insist he got it right from all perspectives, we become vulnerable to outside (and inside, for that matter) critics who would show that the Book of Mormon is a hoax perpetrated by Joseph Smith. Mormon compiled the Book of Mormon from the perspective of a lifelong soldier fighting an overwhelmingly losing battle. Thank goodness he and Moroni had visions of the future, or this could be an irredeemably morbid text. When we limit the Book of Mormon to this more human (not completely human) dimension, as the scholars of the Maxwell Institute (and Sunstone and Dialogue) regularly do, then our claims are more defensible--and lots of faithful members like defensible claims (some examples). Show these members how making more modest, careful, historical claims about the Book of Mormon strengthens it against attack and props it up in its most important role--testifying of Christ--and they will begin to think and talk in more modest, careful ways. They will begin to give up a degree of scriptural inerrancy and prophetic hero worship because they will see how liberalizing these beliefs strengthens their testimony of Christ.

Those are some of my reasons. For progressive or cultural Mormons who want to stay in the LDS church, I think you are shooting yourselves in the foot to fight against Book of Mormon historicity. You should be embracing it to give you greater hope for the future of the LDS church, greater power to shape that future, and greater hope in the resurrection.

Thursday, July 10, 2014

(Nephi != Alma) && != Joseph Smith

We've looked at all of the later studies, found some good things and some bad things about them, but we've consistently seen evidence supportive of multiple authorship for the Book of Mormon. Supposedly since the later studies were later, they should have built upon and improved upon the earlier studies, giving us new information. Unfortunately, neither Holmes nor Jockers et al. did enough controls to adequately interpret their data, since both assumed a priori that authorship was 19th century. Schaalje and Fields targeted their studies to a broader academic audience and resisted making any claims about Book of Mormon authorship beyond its not being from the proposed 19th century authors. So if we want to conclude anything about the authors who did write the Book of Mormon, we have to go back to the papers published primarily for an LDS audience. Here is the later of those:

On Verifying Wordprint Studies: Book of Mormon Authorship
John L. Hilton
http://publications.maxwellinstitute.byu.edu/fullscreen/?pub=1099&index=12

I'm still working on acquiring the paper that justifies the details of the methods employed here, but having read other books and papers on stylometry I'm quite confident that the methods are solid. So here's the summary:
  1. Use blocks of 5000 words. This is a substantial sample size, but not too large. Many papers refer to sizes of 2,000-6,000 words being sufficient or ideal for authorship identification. Holmes used 10,000 words for vocabulary richness.
  2. Use pairs of non-contextual words because such word pairs are known to be sensitive measures of authorship and very difficult to imitate, even for skilled authors.
  3. Choose texts of the same genre. Genre shifts have the biggest influence on contextual words, but also influence non-contextual word patterns in some cases. Just to be safe Hilton focused on didactic religious writings.
  4. Do lots of controls. Make 325 pairwise comparisons of 26 texts by 9 authors. Determine how many of the stylometric features agree and how many disagree between each pair of texts.
  5. Compare works translated into English all by the same translator, and also compare them with original works written by the translator.
  6. Once you know what your method can and can't tell you, apply it to texts in the Book of Mormon and by 19th century proposed authors.
The results follow. First is this figure showing the 325 control comparisons:


What this shows is a simple count of how many of the 40-47 stylometric features capable of comparison between each pair of texts don't match. If a stylometric feature doesn't match it is called a "rejection" and counted. The black bars are comparisons between works by the same author. The grey bars compare works by different authors. First note the overlap between the grey bars and the black bars. You are seeing that texts by the same author can be a little different in their stylometric features, averaging statistically significant differences in 2-3 features. Also, texts by different authors can be stylometrically similar, with as few as one or two rejections in unusual cases. This means we can only be completely confident that two texts are by the same author if there are zero rejections. But if there are more than seven rejections it is nearly certain that the two texts are written by different authors. This means that Hilton's methods aren't all that great at telling us if texts are by the same author (although they probably aren't worse than other methods if there is a closed-set of candidates). Fortunately, we can test several Book of Mormon authorship hypotheses by figuring out who didn't write it. Once you have identified 7 statistically significant differences between stylometric features, there isn't a single case of the two texts having been written by the same author. In fact, if there are 7 or more differences, the chance that the texts were written by the same author is much less than 1%.

Only two authors in the Book of Mormon wrote 10,000 or more words in the same genre--Nephi and Alma. The Book of Mormon attributes to each approximately 15,000 words of didactic religious writing, allowing for three, pairwise comparisons of blocks of text for each author.

None of the comparisons agreed in all of the stylometric features (black bars), so it's remotely possible that a single author didn't write all the words attributed to Nephi, and that Alma didn't write all of his words, either, but none of the pairs differ in more than five features, and the distribution parallels the distribution of rejections consistent with single authorship for each set of texts. More interesting are the nine, between author comparisons.
Notice in this graph that four of the nine comparisons show 7 to 10 rejections. This is as good as certainty that the writings of Nephi and Alma were at least two separate authors. Remember, that while Holmes criticized this work, his data also show Nephi and Alma as distinct. Jockers et al. identified a stronger signal for Rigdon in 1st Nephi and a signal for Spalding in Alma, again confirming multiple authorship styles, even if the data don't really support the Rigdon-Spalding hypothesis. That's three independent groups identifying Nephi and Alma as different authors, with Schaalje and Fields refraining from comment.

Unfortunately, as regards the ability of a translator to maintain different styles for the translated authors, we are for the moment left to believe the reports that stylometric features can survive translation. This is supported by a study in stylometric obfuscation (related studies can be found at https://psal.cs.drexel.edu/index.php/Main_Page). Some have argued that certain stylometric features measured by Hilton and others would not have existed in the original reformed Egyptian or Hebrew. It is worth noting that the automated translation in the linked study went from English to German to Japanese and back to English. Despite these changes through grammatically distinct languages, many stylometric features survived the process in tact.

This final table summarizes the 19th Century author and Nephi/Alma data.

While there may be a little question as to whether Nephi is like Nephi, it is very clear that Nephi is not Alma, Smith, Cowdery, and especially not Spaulding. It's remotely possible that Alma is not like Alma, but it is statistically indisputable that Alma is not Nephi, Smith, Cowdery, or Spalding. It is unfortunate in some respects that Rigdon was not included here, but the work of Schaalje and Fields remedied that oversight, as we saw previously.

Summing it up

Nephi is not Alma is not Joseph Smith is not Oliver Cowdery is not Solomon Spaulding. The data of every study we have examined thus far either supports these conclusions or does not contradict them. This is true with various statistical methods and three different types of stylometric features: non-contextual words (Jockers et al.), vocabulary richness (Holmes), non-contextual word pairs (Hilton), and all three combined (Schaalje and Fields).

Hilton did continue to look for an author who could change his style to fool stylometry, and we will look at how William Faulkner succeeded and Mark Twain and Robert Heinlein both failed in another post.

Wednesday, June 18, 2014

Literary Detection: Part 2

Oversimplifying the Complex

Regarding the authorship of the Homeric poems, A. Q. Morton wrote:
“. . . his role is not that of the composer but, at least in part, that of the compiler. The role of the compiler, as of the modern editor, can range from literally using scissors and paste to make a narrative from fragments of other sources without adding one word of original composition, to the other extreme of taking material and completely digesting it so that even when the source is known and exists separately the version included in the compilation cannot be distinguished from an original composition of the redactor. . . . “Between these extremes of altering nothing or transforming everything, there lies a complete spectrum. . . . So before anyone can ask the question, Did Homer create the Iliad and/or the Odyssey? must come a preliminary question--Who do you define Homer to be?” p. 159
Questions of style changes due to author/editor/scribe interactions is immensely relevant to Book of Mormon stylometry. Instead of asking who we define Homer to be, we are faced with defining, Who wrote the Book of Mormon? Just Joseph Smith doesn't match the stylometric evidence. Scribes can't explain differences within the Book of Mormon, but can they explain differences between the Book of Mormon, Joseph's personal writings, and other LDS scripture? If we accept the Book of Mormon's own narrative, how did scribes and abridgements affect the style? The questions for Homer are very relevant, although the answers are quite different.

In discussing authorship of the Illiad and the Odyssey, Morton illustrates how the mode of composition can constrain stylometric features so that two authors appear to be the same in some features simply because they are using the same mode of composition (e.g. iambic pentameter, listing ships and armies, etc.). This observation strengthens the assertion that Book of Mormon language appears 19th century because Joseph was dictating with pseudo-biblical language. It also suggests an explanation for why the war chapters would have so many superficial similarities with a book on the war of 1812 written imitating the same biblical style. Certain features are going to match. Discovering that they do is not a grand revelation, but a confirmation of what would have been predicted from earlier stylometric studies.

But getting back to Morton's conclusion regarding the Homeric poems: Statistically there is not evidence of multiple authorship for the majority of the books in the Homeric poems. There are two exceptions. The first (Iliad Book 2) is a list of ships and armies involved in the war, and is believed to predate Homer. The second (Iliad Book 11), it is not possible to decide through statistics if it was a later addition or an undigested source.
“It may seem a very negative attitude to take, to say that the problem of authorship and integrity in Homer is unique and so a scientific answer to either question is unlikely to emerge, but this is the case. The poems are composed in a manner quite different from any others which have survived, and without comparable material the differences which are detectable cannot be separated into those due to the mode of composition and those due to a difference in authorship or of origin. The best service which an investigation of this kind may do is to show that many scholars have been too simple-minded in their approach to Homer. The poems contain many more problems than some people have supposed.
“It may well be that one of the oldest arguments, one with some scientific basis, is the best. No one knows what the population of ‘Greece’ in Homer’s day was, but that the country should nourish two geniuses of such stature at much the same time is a coincidence beyond acceptance. Against this can be set the view that the poems have no author, but are the result of generations of accretion and adaptation. Of this hypothesis it can be said that it is a scholar’s dream. It can be endlessly argued but never resolved.” p. 164
From stylometry alone, with minimal reference to content, value, or date of creation, we have a similar choice with the Book of Mormon. Was it translated from the writings of multiple ancient authors with their varied styles preserved, or was it constructed in a matter of months by a genius young man who absorbed and synthesized in some unexplained way ideas from a vast variety of sources and then dictated without revision in several self-consistent authorship styles? If the second hypothesis weren't competing with people's disbelief in Mormonism, there would be no debate between the two.

Jane Austen and the Other Lady 

“. . . the foundations of stylometry are habits shown not to change under the circumstances of the particular problem being investigated.” p. 189

In the 1970s, an unknown writer and great fan of Jane Austen completed a book which Austen had left unfinished. Stylometry was able to clearly distinguish between the portions written by Austen and those written by the "Other Lady". After reading how relatively easily stylometric measurements were fooled through imitation of a different author in the adversarial authorship studies I reviewed, I wondered how stylometry could so confidently distinguish Jane Austen's writing from a skilled writer carefully crafting an imitation. In the adversarial studies, most of the authors were minimally trained (college education, but not typically in writing), and they only had a short time to write the passages. How could they fool stylometry while the "Other Lady" failed? I can identify a few differences:
  • The Austen study made absolute comparisons rather than forcing a choice of the closest match. In other words it was an open-set analysis which asked, "Is this passage like Jane Austen or not?" rather than a closed-set analysis which asked, "Which of these five authors is this passage most like?"
  • The numbers of words used in the test samples were probably a few thousand words written by the "Other Lady" rather than the 1,000 words written by the imitators in the other study. This meant that fewer meaningful stylometric features could be extracted from the adversarial authorship tests than from the Austen texts. 
  • Noncontextual word pairings were analyzed in the Austen study. The automated programs tested in the adversarial authorship study did not use word pairings. 
  • The adversarial authorship study selected an author with an unusually distinct prose style from which the untrained imitators extracted obvious traits. The obvious traits included long words and descriptive language (I'm interpreting a little). Word and sentence lengths and vocabulary richness were among the features measured, and all would be affected by such an attempt at imitation. The Austen study did not use such intuitively reproducible features for analysis.
In other words, the adversarial authorship study was in some ways designed to give the imitators the greatest chance of success. They didn’t have to match the target author’s style, they just had to get closer to that style than to their own. They only had to write 1000 words, so stylometric features that might have given them away in 5000 words would not have been an issue. The study employed Method 1: word lengths, letter usage, and punctuation; Method 2: number of different words, lexical density, Gunning-Fog readability index, character count without whitespace, average syllables per word, sentence count, average sentence length, and an alternative readability measure; Method 3: a measure of vocabulary richness. None of these methods employed the noncontextual, function words or word pairings because such pairings typically require larger text sizes to be statistically significant, and they are not as easily automated. The “Other Lady” did match some characteristic punctuation habits and other features, but missed enough noncontextual word pair frequencies to be clearly identified as different.

Imitating Sherlock Holmes

Another example where imitation was distinguishable from the original was in the attempt of two writers and Sherlock Holmes fans to write a new Sherlock Holmes story. Many knowledgeable readers agreed that the two imitators had successfully copied the style of Holmes, yet Morton reports the following results of stylometric examination of the imitation:
“. . . when perpetrating a counterfeit which a number of people well qualified in literary criticism regard as being very like Holmes, neither imitator can reproduce the habits of Holmes which are of value to the stylometrist nor can he apparently suppress his own habits.” p. 193 
It was known from the beginning that the text was an imitation, and even that the first part was written by one author and the second by another. However, noncontextual word pairings easily differentiated the imitators from the original, and were also able to differentiate between the two different imitators. The study was further able to assign the portions of the text to the appropriate imitators through comparison with stories published by one of the imitators. As might be expected, Morton touts the value of careful statistical work and criticizes those who are overconfident in their non-statistical literary analysis--even if they are highly skilled at it:
“It is not what we do not know that causes us to remain ignorant, it is what we assume that we know when we do not know. In the resolution of cases of disputed authorship a feeling for literature is not without value but it comes a long way after a few well chosen experiments.” p. 194

The Book of Mormon Fraud Debate

The Book of Mormon, it seems, falls firmly with the Austen and Holmes studies rather than with the adversarial authorship studies in a number of regards. It is an open-set question, and the LDS researchers have treated it as such. Text sizes are large enough to extract features that appear very hard to imitate, including noncontextual word pairings, and LDS researchers have examined these features and thoroughly reported their results. Additional factors further support our confidence in stylometric findings regarding the Book of Mormon. In many ways it is not unique linguistically. We have examples of hundreds of texts written in the early 19th century using pseudo-biblical language, so we have great potential to control for how using pseudo-biblical language affects shifts in stylometric features. Joanna Southcott failed to produce such a wide range of styles, but the potential is there for a critic to show that stylistic imitation could explain the variety of styles evident in the Book of Mormon. I personally think, based solely on objective stylometric measurements and nothing else, that it's generous to give the chances of authorial fraud at one in a million, but show me statistics that disagree and I will reconsider.

Thursday, June 12, 2014

Literary Detection: a Book of Mormon-centric Review

“If the odds for or against some event are prodigious, particularly if they support some conclusions uncongenial to us, then they will only appear to be ludicrous. So there are really two problems and not one. The first is what odds are required to settle the dispute? And the other is what odds will convince the scholar that it has been settled? Rather surprisingly it appears that the first odds may be larger than the second.” A. Q. Morton. Literary Detection: How to prove authorship and fraud in literature and documents. A. Q. Morton. Charles Scribner’s Sons, New York, 1978, p. 154.
In trying to understand stylometry, I followed the footnotes back to an early book on the subject. A. Q. Morton wrote a mid-sized book that is an introduction to and a review of stylometry up to the 1970s. He takes time to not only explain stylometry, but to help the reader sort through the statistical methods employed. It's a little less than a thorough explanation of the statistics, and a lot more than a discussion aimed at experts only. While I found many things in the first 2/3 of the book useful, it is the last 1/3 where he explores specific applications of stylometry which really grabbed my attention.

Near the beginning of the section on applications, Morton wrote the sentences I quoted above. He was bemoaning the same fact that so many encounter when the become 'scientifically enlightened' on a subject. Statistics can show something to be true with 95, or 99, or 99.9999999% certainty, and people will still refuse to believe it if "some conclusions are uncongenial to us". 95% certainty, with all the proper controls performed and all variables accounted for, is enough to convince most experts that the dispute is settled, but 99.9999999% certainty may be insufficient to end the dispute if strong sentiment is attached to related conclusions. This discrepancy comes up most strongly in Morton's discussion of authorship of the Pauline Epistles.

Pauline Epistles 

In many ways the Pauline Epistles are good candidates for stylometry. They are composed of ~50,000 words, and they can be compared with epistles on similar topics by other Greek authors of the same time period. As Morton puts it:
“There are numbers of letters from the same period, from earlier and later periods too. The mode of composition and of reproduction is unremarkable. Any claim that the letters might have been based on other sources is stoutly contested.” 
Stylometry studies using these resources conclude that only four (or five) of the epistles share the same stylometric signature. To explain the varieties of style some biblical scholars have followed this tack:
“a special case was made that Paul had used an amanuensis to write down what he wished to say and that this was the cause of the differences. This argument has two fatal defects. The first is the question--If an amanuensis gives us something quite unlike Paul, what right has anyone to call it Paul’s? The second objection is that though amanuenses were commonly employed, only in this case has it to be argued that the use made any difference to the text.” p. 166
The last observation is not quite true, today. As we saw from his 2013 study, Jockers has made the claim that scribal influence on Joseph Smith's writings have made it impossible to identify a uniform style for Joseph, but that the writings are still meaningfully from the Prophet. Of course, if Jockers were correct Biblical scholars would be in a bit of a bind. We would have historical evidence of religious documents all coming from the same author but having multiple distinct styles. Those would continued to claim multiple authorship for Pauline epistles would have lost their objective, statistical evidence for it and would be stuck with their more methodologically driven evidence. Fortunately for them, Jockers's conclusions are contradicted by the results of Holmes, Schaalje, and the other two groups that have measured Joseph Smith's style, and he does have a consistent enough style in his dictated writings to separate it from many authors. But back to Morton and Paul:
“The Pauline letters are Greek prose and every feature of them can be paralleled in Greek prose writing. There is no reason why they should not be treated as a particular example of a general problem, the authorship of Greek prose. Yet this is just what many scholars cannot bring themselves to accept. Their resentment is clear, but it is seldom clear which object it is directed against; it may be that mere human agency and intelligence presumes to measure the word of God, or that the results of such enquiries do not support their own published views. . . . Whatever the source of the animus, the consequences are the same; hypotheses are ridiculed rather than tested, the normal imperfections of publication, printer’s errors and omissions, are blamed on the author, challenges are thrown down but refused when the gauntlet is picked up. In 1965 the Bishop of London wrote a letter to The Times saying he would believe this kind of science only when it was shown that Henry James had stable habits in his range of writings. Evidence of this having been available for more than two years, the Bishop has not been heard from.” p. 166
I'm proud to view the efforts of LDS scholars in this regard. The stylometric gauntlet has been thrown down several times and they have taken it up each time by publishing more and more rigorously controlled analyses of our own historical texts. As to the interesting conclusions of Morton regarding the Pauline epistles, he concludes that stylometry supports the view that four epistles (Romans, I and II Corinthians, and Galatians) are by a single author. Philemon is too short to say anything about. Other epistles appear to be stylistically different necessitating other explanations of their origins than purely Pauline. Referring not only to the stylometric evidence, but to a larger sum of evidence:
“The weight of evidence accumulated about the authorship of the Pauline epistles is impressive. So far, attempts to counter it have involved special pleading, but each piece of such pleading further complicates the simplicity which alone would commend the traditional position. If you assume all fourteen letters are by Paul and any difference must have an explanation which shows that special circumstances applied to modify the pure Paul, then you are really in the same position as the Ptolemaic astronomers who argued that all the planets followed the sun round the earth. Every discrepancy needed another complication to be added to the theory, until it collapsed under its own weight and it was at last conceded that the sun was the centre of the system and not the earth. . . . The most salutary experience for the advocates of such refinements is to look at the historical records and see what has been attributed to Paul and why. They might well begin with the museum in Tarsus which showed the boots in which Paul walked the Mediterranean world or the Italian village which had on display both skulls of the Apostle, one as a man and the other as a boy. Many traditions last a long time for reasons other than verity.” p 183
So biblical authorship is a complicated mess. Clear origins are lost to history, and available evidence makes clear that they are more complicated than the traditional story. While I enjoy Morton's poke at the superstition and stupidity that can accompany religious belief, I don't find these observations so simple to apply to Book of Mormon origins, and such belittling tends to polarize emotions more than is useful. For example, one set of arguments points out apparent 19th century influences on the Book of Mormon, emphasizes the supernatural elements of Joseph Smith's story, and eventually implies that we historical believers are superstitious fools who haven't faced the hard evidence (even if they refrain from saying as much). I, on the other hand, see apparent ancient elements in the Book of Mormon and take Joseph Smith's story seriously as it applies directly to the text. I thus eliminate the seemingly supernatural from the equation, since no one can test if Joseph Smith saw an angel, and no one can go back and see what Joseph Smith was seeing with his head in a hat as he dictated. What we can examine is his claims that the Book of Mormon is a translation, that it was written by multiple authors, and that it plausibly captures views of ancient life rather than Joseph Smith's (or his supposed 19th century sources) imaginations stemming from 19th century life and understandings.

Another Book of Mormon Challenge

Stylometry has answered the second of these questions. Every study has shown multiple authorship, including the critical ones that weren't trying to. They didn't calculate the probabilities of different numbers of authors because they were committed from the outset to limiting authorship to Joseph Smith or to a few of his contemporaries, but they supported multiple authorship nonetheless. An insufficiently controlled, informal stylometry study has shown that large numbers of unusual, 19th century, pseudo-biblical phrases are in the Book of Mormon. This observation is superficially easily explained by claiming Joseph Smith plagiarized large portions from early 19th century sources. It is also easily explained by viewing the Book of Mormon as a translation into 19th century, pseudo-biblical language. I suppose it's my turn to throw down the gauntlet for stylometrists who are critical of Joseph's story--statistically show the plagiarism, please. You don't have any historical evidence to show that Joseph copied any book (not even the Bible, and that's clearly in the Book of Mormon). No passage in the Book of Mormon is a direct copy of any of the proposed sources, but rather an intricate, coherent pastiche of at least a dozen unrelated and incoherent sources. Since Joseph didn't copy either the exact words (other than short, disjointed phrases) or exact stories (other than short groupings of significantly modified but sequentially similar events), and he used a single scribe for most of it, and all the scribes wrote his dictation word for word, and we have most of the original manuscript, please explain statistically why there are multiple, distinct authorship styles? Whose styles was Joseph copying? Why was he changing it up? We have statistical and objective evidence that he did. Objectively incorporate it into your story. At least show us other documents where these things have been done, in whole or in part. If it weren't tied up in religious feeling, like the Pauline epistles, I suspect that the question of multiple authorship for the Book of Mormon would be long since resolved. Joseph didn't write it, and no single person did. It is a translation of something into 19th century, pseudo-biblical English. That is what stylometry shows, and it is only the religious (or anti-religious) fervor that keeps most people from accepting it. We are unable or unwilling on all sides of the debate to separate these objective observations from manifold ideological conclusions.

Next time . . .
 
When I continue the review, we will examine Morton's evidence for the difficulty of stylometric fraud in authorship and see how it differs from the later, adversarial authorship studies previously discussed.

Wednesday, June 11, 2014

Choose Your Own Adventure: Reality Flow Chart (take 2)

7V1bk9q6sv41qTxlymCuj5nJyl6pk6yVSrLqnDztMiBANcZi22Yu+fW7W1LLlmQSGBtjTqAoLgbLVnfr64tarVfh3ebpX2m0XX8SCxa/6geLp1fhu1f9fq83DOENjzyrI+PhWB1YpXyhDgX6wI4vWKbPU4dyIeKcb+2Dc5EkbJ5bx5Yi1o3pA9toxbwDX+dRTEdvhsXx/+WLfK2OT/qj4vifjK/WdKHeaKp+mUXz+1Uqdom+4qt++F4+1M9Z/kwXWbBltIvzN/IQ/IY/byK6lO72U6AvoOnyrL8P9QnbKLE68kOIjXUgZRn/YXd2yfVd62vMRLpgqXUo5sl9ma7hH8DFVAg4ET9tnu5YjJy0mfR+z6+GyClLrEvvPWGi5eIhinf65j36wT0yv2F9rQeW5ozEzPQA5JCJDcvTZySt/nU4JG5rIQwHYzryWOL9VN/CusT3/kAdizSxVqb5onfwQXdwX2d1w2fp7GQ8aLOzk4nX168on/1ALF/h6Aqfolfh7T8Jh05lusslOmR5Ku7NkISe3mbraIs/bp5WiDE3y1g8ztdRmt8s2JxnXMAAuW2AdP1B6JBuMJxUkK4X6DFUJp05WId2xJMS7d7zhOc+laBLcOHbKOYrhIc59BoH+C32lgPMvdU/bPhigec0QZ/eWJ9C1BlrVpfFqoI0gyYo48PFX7vNDPrsyNVnkWV8xmOec1Am3RGucOQK17Bt4dKD+2cgxBagJfXXjK020N8/ikO37Inn/wc/9fTn7/A5gE6ob59ZyuGupKIBJXYLJ6fP+Hf9F/wqz6Av9gn7aJyJXTrX90fgkkfpium/kWjgvf+UEwdTOWVxlAM8WbdRRXp9jc+Cwz0bVr/phc5A6evbpjZUl/RpZS3ptuQ0FLoNKTp4DUlRMD0/TDq0KJak40Oy7A74DAa66zR6xtocawN8tE1Yos07FNsNkCfb1AOZKEfUakJ7TYya1yQaTYyV+yvRHzVBJW3AliFawHfQ9P+BAwVEf2JRwpNVLbop6ke5QLk7CfXGLVPPN5v+Se4T8RjNgD5N202NSd1gMDqz1GkYKJubc84S0BjwJ7AADOX+FFsWs6yeUdC03Pn0a1nuTMMNmAVSsf/CLDhEy5NGt7S8xuAOa/lAA2BtLe821JyW7wUkoe0YgS/mtkbDK7frcfuAIEuZ24mAGERpPBuuIo+J3y/gsB67Fod1r68crsfhI526U3G4yi/TmvnK4Xoc9h0zaVb/Syw6YgP2vLjZcIKC1aIN4ztofzzlPJnnGL/pkr3n02o06bdLK99NaxoxThL6MQOhjDGG8x0CmZ6+JcIGilkdDTJOQyb4dQqQ8b3PnwqFSPO1WIkkik/pB1RF+4wYXMN9tTje892+Dk01hGS5niHa1+v5PtLfs4ylD6cIxWTA0/zfiKMnmcEKx9NWtUvvgJnOTmoXYnoZawh/rlBTD2p8L7Su8droqOmN3Bjc0AyjdgaNb75+ZRi//BQleJ9365RnOYdEkAJ8Ikg/6Qd/52s5Bfp5zWORiS188+ObBNQfoxmLYX4UpkZxVvPdTOQ55pJ4SJ6LLVL/CH6I5fINZsz8O2VLBqzAYdUIayYua+BQBW+IDc2z5lKtZUrlsGwnErQOARppcc3eXvhSQHMacttpEs98Y1nimRmbb/+CY+bbX1G+SztkJIxDz11vF+7MLZfGVAgny2eXnHWfUr3+wTkbzZDqYs2pKteN/tkZ+OlRTkxd9DHJNadHn35FJlTHEGY4NOG/MyGMHxVvgEYNRkw9i7MXViVpnpBCflT5QoClYrbQ8LszwAIcdhncM0PgaHDxGoPW3MaaRJiKaPqGQfPYdJFomUI+BfgNNbMst6mYY1JGQ8Bj6EJknxyssIcOZr9sXF2sv1A5rjrnL/SHDWnsNz2npVOq7F85DPJYZx2G0BtVbatzP8frqEF1XLayHHVmSBUj7CWDqsoKJg12dcLrjKnwyLQ1RyaOzWA/sUwQ+l5lopZM+N7yF7bYgX0h1xIiJ7awqCPCk+ZRhocN6C7YliULmZYcYM5AAIv3cD4MQqV4trXGRIJ3oCKwe8D6LJNmI91/Y3K2OGkW+m6pWopjTZkB5WouymnMB/NtxbDf7lxZ2I3cLWPlWYhE/LwiUi1E8l2pT7AiuGvzxuO+t0K25Xnj0PeburfEZjj1Iudtk8n3JC5njc1wajLdzrNWpBce6Ui0sNahN9C3YKNv17KjR1M/pGu4eXy03Mlso2SEEyAwGTfnVrLEUZvNXUsw6Y2pCoVWA+RmHc1ipyHI6Dodi/35xLfzfAe2d460A1RcoS0ufwmK9eEKOmoZ7UuR5LK4AYgGYil+fx9teIy9/pPFDwzPwx94HN+JGJGUJEwhsXMQG6BDAOWBfMBxgOYFLGozv8m/10fkEcUizrCi3wCfUyjC87ZKvLSzXyrW/Ps8Pd+K/3HPVXd7yklQzLjxFf+QbH7CRd3VstqAG0t3fRah9H0ymOiYRSRdtmh+ABrFQBe13LQzkjfxasAMyXxqpdJEb3Dk7GIXS01UG2YkHx1yi2klHZX7cWr4HOwVO+2Y5Qen0Ni+W2xheKGz+0EJ/i9BXUMZsJOp68nQtpvbRcaqmc3Rf3ZYMUxNWWFclQ5UpsmbQx/5PQOid8OrH/dd16Ztt5RKm+ydH/ywgWlyUEIYS+1SfpxHubaLFwzadehPpGiqUnVpuF0VTR1FM+xeuYNqdhOyX9ldi92+S3knNpuKNcDnmJ8DcHRXSbenvqkOa3luFDpzNaqmNEdzjqWGlIN0celiRDRbZ+mb7w6Ijd0Z8ReCGCVtUDtOM01C2OkTcw/TUlXxajJUu7Ta3uHMSzkM08utsdj3fu9SBmRAPQUrYIzZ/5VvdkgePO4EO2t6As3Gm6Y08Ml/Gpn4UzvxJqop3v36H5Oz13ujNOf2Sj2cRgPRKLLN6M7NmzqoQjPQx8JTz2nIbadJePJ9aswx6IABPZl4pXPaM9VGvivZoWw2gGC37HsxCdAKrox8B+N7xdqQ38+/GNv+xZiyNFsR2o6kGFaCNY2oK1i/HKzJWS3bkmshMNoefIfbhbf3uFWJtiId1j+uYSb46zaSfHoEcAIOpyJXfw7fvZk2MZ/7huCFyDrWQlliK5iMPlspnbve1ht+/o9LoL11fM5CnuFUN9EOeXyAcMlTqeXOIzkBGa/t0MZ3xb8whQFd2lnCL/o0LdaatuN/TXyPFlMj0kg7YMZ5feRwN8XXwu3tDDVHY3dOq31q+t4sRLG3YOfUp9UJi35CLdp217BPKkq/C6j93qksMH/fl17QP5hOzQgUgbFVXype8mydyHr4Zjx+5yxGsC8iULu5XJ3dWZmD/N5WZY6UcznS9MDxL7WdwdOXmoVlhu2Wr6nYz6oDZUWNYre8EULdznojtEyrrjfittOgN1KxS9dlTGcR8y2JINi8SkQNibjUCU5ivi0RXY9YXIJEHDnB+XOdcL704Gol0rU9Dy5RQHxn8iPfQLihnBH5hUFGJCzt75BH5G8hBtapH8s5obXl+40fEtgtOWOwNjSB+rGYn9vYSvzT78DWvrnqT41+ip5A9n5YstdM1KK5LdhCs5nx2byiiig0RCwiyFQA4MbFRt2VuwrytSx3/WO3YOvqlDxpP9tm6lpm6+WpxP6xu7bVt5lq8LtrOWKXyO9LLftbtdObsUuuElFDIi41slK1M5yxF64SUUMiKmZuaZYI6NCFfC2zZqSYIfLNqlPlvvQrNs67E1izVgnKb5+YNKBkyfNwp2LPk3mEuNEFye2N7aU6UyqH1gppfD/+7QxzeDRo/NZS61aHaJczfoDgHezMIxnTXQ93OB7fTAbTcDoeToNwRCsbimEf3kygduYwDHqgVSY+PU/o+VYHDmK0Tsr1XrDqxr5Sm2es8DIKbkYDwNFJiPSjMsXFPL9NWD/v83Rz/tDKnnTlYj/8aAslTzsSxBpBab1BIaFUIKIc0DqXjFZsX9aJSewKV8sAVGcMa4Ld2oa109AJDWuqmtsQvxtKoTYD+srvhvmN1Wa6N76NarT4TUJw5XcNfrceTD1RtL1SAXQtsnKJAuJHX6EAz75lt+dwT80agXM4QRUbkO1dk3yWMhsjO67RLnH8qBys4gaHplz9KnpsYF1cE5RydtnuBWGLEaCKLci079dFWk2oIEJBq/aKrxm0cxZYFLUni8SYqqIu5/HpgGRnTkwAEa+g24OAKFc5oaNzEZsKyrWdk1CxZ1UHppyrreLObVN2iUZPN73eqr1JzKi+8vvl/K7YP+vbmsvi21uV3AZbJOHrkiFWBnBJ3GhCqA3nDXQqsxjLtsqNIOG6wWyHPdrGsDYUm4uQpbttyja4ptTfRQn/s8TZDSy8F8VYFjRY8KXcRr4cVl+msFc9sG+3gZ0t8ucb+PwRlibJ7e8VgAebqBwznuH1ZOAYbyF/BuxGicAFiMEug/N/blXEbIlfD5lImfrTIHd3RTVsD/crxH7/HKqzs7AJT7VhdtC+DJU7gQaQgWt2AAX5gJcEReQRuRAkDBeOcVgR7LAdBAiHrmoGTRfFI8XCQn54cbB8trRu1F5egCiZ/CdeGVkMaZm6fHC+jvCXGVtJEUamC9mqfR8gT3hB+IT/gjc8d7OTraYsg416UDaV3GVAPrsBkFm9Q40cILpHPmGwI494rrr38i1gN2Ys5gzno+muwY5QtXSDOHrEBrCVBKrqQjNrvslQGkF6HetFCX+wjmRTr6MY2JC9JjLpISwvgu2ZkzMwnqOUCxxO3+D6ryUC4EydYoviFozPRNEV9pQpnx7NFF25qioPPcaG9B3NxS7G68Zyuj1AYoG6wAFu1/E3EzswGmHSsehFcetLnmb5KYZsk1Ofesz/bOqzFhSMxra7BvWfW4SCiqDIaxwYuyR6VJKtsFYKynbNY5GJ7Vpq4TWfl1d9G9VQtY+eUggcxhbux2erAPXPudCShKL2QUtL8hrFMI/uaSjjKxgb7mh7FOk93qqU2lisUE5kmzpLXt2Y7ImFFXIQgrKTS7B/d0F065BTOlcrcuhHn94zhMkCR0s4B9KpanvcaONGvqCysICc6n+AqILZYQRIJNIaIdQLnsWOzCJz8n0i8OpaL9n/VAfnuxQJK5sSMzBYHuBPv7sIDSjF1VQXbq8qEmxovM/2lS+K+feAQQQFFRJSEgGQuvRZsl6CEc6qKwxTO61IxoPRWtZ7CE1SVX7TzSlRYU9QMUPC0daY0wr0SucmLEKbd/9/H6LVTl01g7UrMf7bnOz/e5ekbC5WCf8B9eX3Gd8PYCPINS8GHaU1lAJIg4EnUVySWAApiILmZChiqXc8xB5/0hqCCRkVBU5mO9mYY5lU0f93HzVDZ8/yMdW3bWXU+DHI8qhRRuOeUYMhcD7nCgQ1UhuTdKZAVhYdKirFrFFdg7+L2xoGS6Ciwm3j0M1lrFgPr2LjCWM9FztR2MNX2iK2S6HKHRVeAvi6OrSK3xYcBshV7fv2J9QybVH6KpIiS5u8Kb0uT1HwTTxXgC4dqxLPtYMxY2guSixE/C1A8VH5ITNEnOptxspXLHlKcFl7I87yfcC/xaOUeynyh20d/f8d0mgPG9rThoJ7rQiVH+RW8ydaDGjzAK2eTZSwf6f8ccsTzkS8w2CHDClAXID0e2FIpuBiAJhgoMs+WZsdUkoL8JHBEVC8Ep3kbzKWBvznS+CpNinLIbII3GUESkhxVxo1FbsVwt3cLFkNJJKCYWAqS9uOjgyYFCdCKAPjOFJ8VZ+5nD+Rxk5x/xZg4rcUXLIrZmL0zsbMIc2rlMVbt9q8eB8Q06+TQE7N1/Ilnb1gp1SytI3xX7E5rDZpTKIwDIaU4WCCCDYaqvhj+j9vVDjZDAAwhHU5AqlX0DbR5dpkkAL1A5dDQ4cR3H3xVUATFusvZBhMVd1a7vBmi6bV8HVCEzrWpsPzSgkVxg9PIKQGZdDRsC7sIdlGIr3mknoCcplWi6iosn6cUV0K2koMUux2QrWKjjxbRg8iZYsKQqCnwecqzGpTwHJ38D7tbpYMuqJjgD4IBlZXS+Fdq3f0jzXD2JEMSRbkUQhHMC3vdLOTVuMGOmI3FcudzPai3KHodTAaXkhAiCauyhNwtDTOnoBzSuO+bBj7sclvyntI1XiUylMHBVMV39faVgbmtTXohIVgal+pYClySvmt1MSDHFNGutCUIyG1m3gL7osWI3ldFCUGboZ2kos70CFy6Q5ZAU/aclRfh2YcIC7O546VWzrv7y/mjG2Ur3VEFSSqNBFw+/GfPxrRzv7in/oC5WzGMaCptFaUwpEFilg8E4/WJDgegB/WIuU/gEDgjb48X9TKFi2SR90THKCx+Fc1V/7LmXcq5WbvVy6H9Rnm2U3S1Qu3I/dO3DOT/jZN5TQa/W2Lf5C5QdXtDqmYO5l3Gs8KWVMtHjhND19TgWqo+DtmGn0CpYj/+C8=

Tuesday, June 10, 2014

I Don't Care About Determinism (Agency as a Law of Nature, take 2)

I don't care about deterministic universes. If I live in one then everything I do is predetermined. If Compatibilists are correct, then I can still meaningfully experience and act on choice, but more than one outcome of my choices was never a possibility. I also couldn't do anything else than what I am doing in my search to understand agency or free will. It's nice that Compatibilists would conclude that I ultimately want to do what I'm doing, but I don't find a deterministic universe meaningful. I know there are people who believe the universe is deterministic and still find meaning, but I (possibly misguidedly) want my life to have meaning that is both an internal experience and shapes the future of the universe in undetermined ways. If my choosing to become a God is not something I can help doing, then I will get there whether I explore the nature of reality or not (or I won't be able to help exploring the nature of reality because it is what I want and the deterministic system I call me enables that path). I care about universes where my becoming a God (or failing to) is not a foregone conclusion. The universe may be deterministic, but if a possible understanding of nature leads me to conclude the universe is deterministic, I discard it--not because it can't be true, but because what I do with it isn't going to change the future at all. I don't care about the kind of free will that might exist in a deterministic universe.

Some people have argued that the alternative to a deterministic universe is one where events are governed by purely random happenings. Narrowing this scope to the events in my brain that I call my choices, if these are reducible to ultimately random occurrences, then I'm not freely choosing. Some random number generator somewhere is doing the choosing for me--at least some of the time. If the system that is me is able to shape outcomes so that random events don't ever determine my choices, then all I've done is made a completely determined system from a random beginning. This may be possible, since it looks a lot like what we learn from physics and psychology--random quantum events scale up to perfectly predictable Newtonian mechanics, or very nearly. Again, I don't want my future to be ultimately controlled by random impulses. I reject this type of universe because I believe I make some choices that are not fundamentally random.

Until recently, I was unwilling to fully reject the mixed random/determined universe for two reasons: 1. it looks most like what physics tells us we have, and 2. I couldn't find any hope for a type of free will I could care about in a purely deterministic universe. The problem was that the type of agency I wanted was being forced into this tiny little box where, instead of a random quantum event determining my thought and making me choose something, a magical, free will thought happened that superficially looked exactly like a random/determined event going on in my brain. But since no one could prove the magical event wasn't happening, I could continue to tentatively believe in it. Unfortunately, I didn't much like this rapidly shrinking kind of Free Will--the Free Will of the Gaps. 

Thanks to John Conway and Simon Kochen's Free Will Theorem, I have seen an alternative. I will summarize the Free Will Theorem: If you or I can choose, in some sense that is neither predetermined nor random, one out of 33 or 40 buttons, then subatomic particles also make limited choices that are not predetermined. This is true if it is impossible to know the outcome of some distant event before that event happens. Basically, it's true if time travel is impossible. The other two criteria for the Free Will Theorem to be true are both experimentally demonstrated results of quantum mechanics. There is one research group which argues that in a stochastic and determined universe the "no time travel" requirement of the Free Will Theorem doesn't behave as Conway and Kochen assert. After rereading the articles several times, I think the critics are wrong, but ultimately it doesn't matter to me. The only possible universes in which they are right are deterministic, and I don't care about those. So there are currently no rigorous objections to the Free Will Theorem that hold within any universe I care to wonder about.

I think (as does John Conway) that it is important to note that the Free Will Theorem does not disprove determinism. If determinism holds, then no experimenter can choose among the buttons in a way that isn't predetermined, so we have no proof of free will among subatomic particles. However, I have already concluded that deterministic universes are uninteresting, so in any universe I care about the Free Will Theorem holds. This means that not only do you and I have the ability to make some choices without predetermined outcomes, but all of matter, and possibly all of energy, have this ability, although the choices available to a photon are not as complex as those available to a human. Instead of agency being something that happens at specific moments that we call decisions, agency is embedded in the very fabric of existence. We exist as we currently do because all the matter in us is choosing to be in these states that are compatible with our being.

It's not too much of a stretch to think this relationship extends to all that is, both within and outside of our universe. The choices available likely change as the qualities of matter, energy, space, and time change, but if we aren't in a deterministic universe, and we aren't in a random universe, then the most likely conclusion is we are in a universe where agency is a Law of Nature.


Thanks to Benjamin Kelsey for helpful discussions on this topic. Hopefully I have removed a number of misconceptions and misrepresentations in my now abbreviated references to various philosophical positions. I also want to thank him specifically for putting into words the idea of agency being a continuous state rather than occasional events.

Monday, May 12, 2014

Written by Persons Unknown

  • Open-set nearest shrunken centroid methods show that the Book of Mormon was not written by any of the proposed 19th century authors--at least not without some unexplained (and likely unprecedented) amount of disguising or modification of style.
  • Schaalje and Fields extended the numbers of stylometric features by including not only 74 of the noncontextual words used by Jockers et al. (removing contextual words retained by Jockers et al.), but also two of the vocabulary richness features used by Holmes, and a number of noncontextual word pairings used by Hilton and coworkers. As we learned from the adversarial authorship studies, increasing the number of features studied improves our chances of identifying the correct author.
  • Just like the Holmes and Jockers et al. studies, the data of Schaalje and Fields clearly support multiple authorship for the Book of Mormon. 
In the last post we saw how, if a text is written by an unknown author, the stylometric features usually don't line up with the candidate authors in a study. Schaalje and Fields looked at the Book of Mormon texts several different ways. They simply cut the Book of Mormon text into 2000 word chunks. They divided it like by chapter, just like Jockers et al. They compared it with the writings of Rigdon, Cowdery, Spalding, Pratt, and Smith. They pretended they 2 of these 5 authors were unknown and tested those 2 authors and the Book of Mormon texts against the 3 remaining authors. Every single time the Book of Mormon came up as different from the test authors. Here is a summary figure for the comparison with 2000 word chunks of text:

Apparently Jockers et al. had the data to figure out they were mostly measuring false positives right in front of them. Besides using the NSC method, they also used a method called Delta. One of the originators of this method determined empirically that Delta values between 0 and -1.9 were most likely false positives. Schaalje and Fields reproduced the Delta calculations of Jockers et al. and produced this graph:
You will notice that only 16 of the 239 chapters are higher than 1.9 (the graph made everything positive), and 10 of those are quotes from Isaiah and Malachi. That's over 93% likely false positives. Oops. The fact that Delta agreed significantly with their closed-set NSC results did tell them something--just not what they claimed it did.

The most interesting of the Schaalje and Fields figures for us Book of Mormon aficionados is this one:

You can see that Isaiah/Malachi significantly overlaps a small portion of the Book of Mormon chapters. Late Sidney Rigdon overlaps a few. You can also see that almost all of the Book of Mormon chapters are different in style from any of the candidate authors--and that's only looking at the first two principle components. Adding additional principle components would only emphasize differences further. In addition, this plot gives another representation of how much each individual author's style varies. When you draw boundaries around each author's samples you get areas that are roughly comparable in size. Some are bigger, some are smaller. None of them are close to the size of variation we see in the Book of Mormon samples. If the Book of Mormon were written only by authors whose styles had zero overlap, these data would indicate at least 4 or 5 different authors, even allowing for style to change with age of the author. If we allow for overlap like what is seen for the five 19th century authors, the Book of Mormon could easily have been written by 20 authors. Schaalje and Fields don't make that claim in either of these peer reviewed papers, it's not what the method was looking for, but we don't have to be geniuses to see it ourselves.

Recap

  • We've looked at studies from three different research groups. 
  • Two groups were critical of LDS claims of Book of Mormon authorship. One group was pro-LDS authorship claims. 
  • The results of all three groups support multiple authorship for the Book of Mormon.
  • None of the groups support viewing Joseph Smith as a primary author of the Book of Mormon (although vocabulary richness gives limited overlap between the Book of Mormon and the Doctrine and Covenants).
  • Vocabulary richness tentatively distinguishes styles for Nephi, Lehi, Abraham, and Alma/Mormon, and maybe others based on the first 3 principle components.
That's a pretty clear picture forming, whatever the rhetoric put forward in the background and conclusions sections of the various papers. It looks like two possibilities remain for rational critics of Joseph Smith's authorship hypothesis, namely, multiple non-19th century authors. The first comes from adversarial authorship studies. It is possible for some authors to change and disguise their styles according to a wide variety of measures. If critics could show historical evidence of Joseph Smith having attempted to do this that dates to close to 1830, that would be telling. It would be best if they could show that he was trying to imitate specific authors. Maybe comparing styles in the Book of Mormon with styles of specific books in the King James Bible would be good test, or with some of the books found by the Johnson's to have linguistic similarities with the Book of Mormon. Authors did best at disguising their style if they were imitating someone else, so if different voices in the Book of Mormon matched different, non-candidate voices from the 19th century, that would be telling. If they could show another author who has successfully created a book with such a wide variety of statistical authorship styles as is found in the Book of Mormon, that would be telling, too, even if it weren't proof. If they could even write a book of similar length with as wide a variety of styles, that would be something. If they could find a single authored book with this variety of styles then at least the Book of Mormon wouldn't be unique. Based on the data so far, single authorship and 19th century candidate authorship are really extraordinary claims in need of evidence.

The second alternative, although somewhat tenuous, was put forth by Jockers et al. Maybe the text is collaborative from the 19th century. Unfortunately for critics (please remember not to include Jockers among them--he really doesn't care), they need to provide solid control data for what collaboration does to style. Then they need to show that collaboration can shift style so that it is unrecognizable as belonging to either of the collaborators, and that it can spread the styles out to look like at least four or five completely distinct authors. Collaboration is still a possible explanation, as is disguised and varied styles created by Joseph Smith. It seems, however, that examples of single or dual author texts with stylometric features like the Book of Mormon are as rare as angels and gold plates--maybe more.