Open Access

Feeling like a State. The Sentiments Tide of Swiss Diplomacy through the Eye of the Algorithm


Cite

Introduction

Sentiments and emotions are transdisciplinary concepts. Depending on research focus, their expression in words and actions is triggered by a somatic event, emerges from the depths of the individual psyche or crystallises in a given sociolinguistic environment. Prior to all analysis in this paper, we reject the idea of any single origin of emotions; our basic posture is to consider them at the interface of a plurality of origins and scales of reality, ranging from the individual to the global context, from the immediate event to the long timescale of biological evolution. By analysing a set of historical documents produced by the Swiss administration in the first half of the 20th century, we ask whether emotions can be observed throughout the years at the regional scale of continents and countries.

In this sense, we concur with the concept of ›group-level emotion« examined by Mercer, see Jonathan Mercer: »Feeling like a State: social emotion and identity«, in: International Theory 6/3 (2014), pp. 515–535, online at: https://doi.org/10.1017/S1752971914000244(1. 8. 2018), though our analysis has a different object and takes another theoretical path.

We ask whether variation in their expression and intensity correlates with historical events

Gao, Goetz, Mazumder and Connelly have shown that a topic modelling approach can identify 30 most significant international events during the 1973 and 1977 by analysing to 1.9 million declassified cables and the metadata associated with 0.4 million diplomatic documents of US State Department records (US National Archives). Our approach, based on a significantly smaller corpus, examines the usability of sentiment analysis for similar historical event detection, see Yuanjun Gao et al.: Mining Events with Declassified Diplomatic Documents, Cornell 2017, online at: https://arxiv.org/abs/1712.07319 (1. 8. 2018).

and the evolution of diplomatic and administrative practices. The novelty of this line of questioning lies in spanning several fields of research and implies both methodological and theoretical reflexivity to contain its historical object.

Our work requires adopting a ›remote reading‹ posture. We shall use ›sentiment analysis‹, a well-known set of computer-assisted methods for identifying subjective affects in data; in our case, texts written in a natural language. We shall combine the individual texts of our corpus based on place and time of composition and measure the ›sentiments‹ expressed in these aggregates. Because the very idea of a super-individual emotion can only be constructed in this assembling, quantitative manner, we dedicate an important part of this paper to explicate the extent of the concept of sentiment in this methodological context and to reflect upon its contribution to our general understanding of sentiments of social groups and institutions.

The nature of our documents also induces another methodological challenge. Traditionally, textual sentiment analysis (TSA) is used to observe the evolution of a book's mood throughout individual chapters, detect the fingerprint of an author, detect passages for close reading, sort mail or follow the trends on the Web 2.0 with regard to a specific topic. Curricular examples of TSA often rely on public domain fiction. Its commercial applications focus on customer feedback over e-mails, blogs and social media. In all of these examples, strongly expressive language is frequent, including accounts of state officials. Sentiment is most straightforward when reading of »crooked Hillary Clinton [...] the worst looser of all times«

Twitter, @realDonaldTrump, 14:31 – 18. 11. 2017, online at: https://twitter.com/realDonaldTrump/status/931877599034388480 (1. 8. 2018).

or »Fiona and her team at the Tudor Club - delicious lunch! Important social club«.

Twitter, @BorisJohnson, 16:44 – 3.11. 2017, online at: https://twitter.com/BorisJohnson/status/926475222609547266 (20. 9. 2018.)

Twitter, of course, provides real time access to massive textual data and has received understandable focus in digital politology.

See e. g. Andranik Tumasjan u. a.: Predicting elections with twitter. What 140 characters reveal about political sentiment, in: Proceedings of the Fourth International AAAI Conference on Weblogs and Social Media (2010), pp. 178–185.

But how does TSA deal with diplomatic language from the first half of the 20th century?

What Are Political Reports

Doubtlessly, the difficulty in assessing subjective affects in diplomatic documents will rise with their degree of formality. In this case study, we concentrate on the corpus of the political reports of Swiss ambassadors.

Language specificities

Since the second half of the 19th century, Swiss embassies in an increasing number of world cities have to send regular reports (usually on a monthly basis) on the political and military situation in their host countries to the Federal Department of Foreign Affairs (FDFA) in Bern. These reports served to inform the government about the international situation and thus were the basis for making foreign and security policy decisions. These so-called ›political and military reports‹

SFA, fond E2300* Eidgenössisches politisches Departement: Politische und militärische Berichte der Auslandvertretungen (1848–1965) 1848–1965. For later periods see the fonds E2300-01* and E2010-02A*: Eidgenössisches politisches Departement: Politische und militärische Berichte der Auslandvertretungen (1 966–1978) 1966–1978 and (1 979–) 1979–1990.

are valuable sources for historic analysis under different approaches. In particular, they contain information about the official Swiss perception of foreign nations and their political developments. As internal diplomatic documents, they are written by diplomats in diplomatic wording, but they do not reflect the polished diplomatic style of official utterances. The style is the result of the combination of a diplomatic culture that developed in the inter-war period and professionalised after the World War II, and many years of individual training in the course of a diplomatic career. As such, these documents are both institutional and subjective and can be questioned for sentiments or value judgements. One recent example is the confidential report by the Swiss ambassador in Washington during the diplomatic crisis of the mid-1990s, caused by the critique against the Swiss policy during World War II. The report was leaked and published, and the Swiss ambassador had to resign.

Carlos S. F. Jagmetti: Alte Schatten, neue Schatten. Zeitzeuge in den USA, 1995–1997, Zürich 2002.

He had not met the expected diplomatic restraint.

Diplomats and the evolving culture of diplomacy

The authors of our corpus, the diplomats, are experts.

Herren and Zala wrote about the figure of the expert in Swiss foreign policy. They concentrated on the international conferences: Madleine Herren / Sacha Zala: »›Die Experten verpflichten ihre Regierungen in keiner Weise‹. Experten im Milizsystem der schweizerischen Aussenpolitik der Zwischenkriegszeit«, in: Traverse 2001/1, pp. 96–109.

They have their own professional habitus and language (cf. infra). We could speak of a culture of diplomacy that ritualises feelings and guides the risk associated with them in orderly ways. The term ›diplomacy‹ has a twofold meaning: On the one hand, it signifies the substance of diplomatic affairs and on the other, the style and manner in which such businesses are conducted. Traditionally, at the centre of diplomatic activity used to be the representation. While explaining the formation of diplomatic forms and styles in Europe, Pietro Gerbore speaks of a diplomatic ceremonial of envoys: In Venice and Rome, for example, the diplomats accompanied the dignitaries because they represented the prince or the government of their country.

Pietro Gerbore: Formen und Stile der Diplomatie, Reinbek 1964, p. 65.

Rank, priority and precedence play(ed) an important role in the diplomatic game.

Gerbore: Formen und Stile der Diplomatie, p 87.

Today, state visits still display old elements of such ceremonies: the red carpet, the music band, the (military) honour guard, the festive reception, etc.

For Switzerland, see Guido Koller et al.: Helvetia hält Hof – Staatsbesuche in der Schweiz, Bern 2002.

In the second half of the 20th century, the design of diplomacy was less solemn. Negotiations, correspondence (notes, reporting), protection of interests, press and propaganda were typical tasks of an embassy.

Gerbore: Formen und Stile der Diplomatie, pp. 134–200.

These activities had been regulated internationally in the Vienna Convention of 1961. The regulation was necessary because, with the growth of the number of states and the expansion of state functions, the number of embassies and diplomats had grown rapidly.

Gerbore: Formen und Stile der Diplomatie, p. 43.

Switzerland initially had more consulates than diplomatic missions. On the eve of World War II, the confederation maintained a network of 121 consular offices, some of them professional and some honorary.

Claude Altermatt: »Konsularwesen«, in: Historisches Lexikon der Schweiz, online at: http://www.hls-dhs-dss.ch/textes/d/D13809.php(1.8.2018)

The reasons for the extension of the diplomatic service were above all the increasing Swiss exports and emigration.

Claude Altermatt: Les débuts de la diplomatie professionnelle en Suisse (1848–1914), Fribourg 1990, p. 107.

Compared to the professionalisation of the Foreign Service in Germany and France, Switzerland had a considerable backlog. For a long time, it used private contractors for bilateral negotiations, such as entrepreneurs who represented Swiss interests in the country where they had their business. In Asia, the Federal Council (the Swiss government) appointed the first permanent head of mission for Asia only in 1906, at the Government of Japan.

Altermatt: Les débuts, p. 159.

The decolonisation after World War II brought a considerable growth. Later, the title Ambassador supplanted that of the envoy (French: ›ministre‹). The head of mission in Paris was the first to receive the title of Ambassador in 1957.

Claude Altermatt: Zwei Jahrhunderte Schweizer Aussenvertretungen 1798–1998 – Deux siècles de représentations extérieures de la Suisse 1798–1998, Bern 1998. For a history of the Swiss diplomacy, also see: Albert Redard: Die diplomatischen Vertretungen, Dissertation, Universität Bern 1948; Franz A. Blankart/Jaçues Freymond / Nadine Galvani: La Suisse et la diplomatie multilatérale, Genf 1978; Paul Widmer: Diplomatie. ein Handbuch, Zürich 22018.

Today, the FDFA recruits diplomats in a multistage admission competition, the so-called Concours, and trains them for around two years at home and abroad. For its Concours diplomatique 2018, the FDFA was seeking »young and innovative talents who use their potential of diplomacy to actively shape Swiss foreign policy«.

Diplomatischer Concours und Ausbildung, online at: https://www.eda.admin.ch/eda/de/home/das-eda/arbeiten-eda/berufserfahrene/diplomatische_laufbahn/der-diplomatischeberuf.html (1. 8. 2018).

Their activities »in the context of international relations, including in the fields of politics, economics, international law, environment and culture« contain notably

https://www.eda.admin.ch/eda/fr/dfae/dfae/travailler-dfae/berufserfahrene/diplomatische_laufbahn.html (20. 9. 2018).

attending a country, attending conferences and organisations, answering legal questions in the context of international relations, representing the interests of Switzerland (economy, technology, politics, culture), supporting Swiss companies and establishing and maintaining networks.

Keller discussed the »democratization of the diplomatic corps« in the context of the Concours.

Florian Keller: Botschafterporträts – Schweizer Botschafter in den Zentren der »Macht« zwischen 1945 und 1975, Zürich 2017, p. 50.

Portraying Swiss diplomats in Paris, Washington, London, Moscow, New York and Cologne, he came to the conclusion that »the person shaped the activity«,

Keller: Botschafterporträts, p. 348.

meaning that it is not the development in the diplomatic service that shapes the activities of an ambassador but the experiences he has made in his previous career. He argued that the most important instrument to influence the activity of a diplomatic post is reduced to the selection of its chargé d'affaires.

Keller: Botschafterporträts, p. 352. For further portraits of Swiss diplomats, see Paul Widmer: NZZ Libro, Zürich 2014.

TSA could verify such statements against a broad empirical foundation, for instance by following the evolution of the language of a given ambassador or by examining correlations between professional promotions or transfer of diplomats in function with statistically measurable linguistic features of his or her reports.

Scope and limitations

Our algorithmic analysis of the Swiss political reports is of course subject to a series of material contingencies. The original documents of the E2300* fond are printed on paper of diverse qualities and formats, which required scanning and optical character recognition. Furthermore, the political and diplomatic reports are written in many languages, among which 46% are written in French,

According to a rough automatic detection during the scanning part of the process. Some texts detected as French at this point turned out to consist of less than 70% of French words at a later stage.

an official language as well in Switzerland as in the international diplomatic circles since the 18th century. Coming after in terms of frequency are German (35%), English (9%) and Italian (2%), and then a series of other languages. Because of the methodological difficulties associated with conducting TSA across multiple languages, we have chosen to focus on the most frequently one, French, at this stage, and constructed our analytical system around it. From our original set of 80,322 documents, we have only kept 23,700 based on the following criteria:

identified as written in French by their metadata

These metadata were not always reliable. Some of the reports identified as French turned out being written in several languages or containing meaningless sequences of characters.

>400 characters long (a short paragraph)

>20 single words long after tokenisation

In the tokenization process, we have also removed numbers, punctuation, symbols and French stopwords.

>70% of words clearly identifiable as French

The identification of French words was based on the Lexique des Formes Fléchies du Français (LeFFF). Cf. Benoît Sagot: »The Lefff, a freely available and large-coverage morphological and syntactic lexicon for French«, Presented at the 7th International Conference on Language Resources and Evaluation, LREC (2010), online at: https://hal.inria.fr/inria-00521242/document (1. 8. 2018). The 70% threshold allowed us to eliminate texts mixing languages, while leaving some lenience for texts with misspelled but identifiable French words that LeFFF identified as non-French.

The corpus totals 15,584,725 words, of which 35% are associable with an emotion by the FEEL dictionary (cf. infra). Individual reports contain between 24 and 102,000 words. Only 130 documents exceed 10 pages length (Figure 1).

Figure 1

Count of reports in function of their number of words.

Excluding stopwords, numbers and punctuation.

The average (660 words, black line) lies far beyond the median (380 words, maximum peak of count), due to a few documents exceeding 10 pages (10,000 words).

Figures 2 and 3 show that these reports come from all of world's and Europe's regions, respectively. This is an important precondition for testing our hypothesis according to which differences in sentiments across nations and continents can be identified. Reports from important cities, such as Moscow

There was no Swiss envoy in the USSR between 1923 and 1956, see Peter Collmer: »Russie« (27.1. 2016), online at: http://www.hls-dhs-dss.ch/textes/f/F3376.php (1.9. 2018).

and Madrid,

These documents are in another fonds, not yet digitised.

are obviously missing. Nevertheless, the amount of documents, collected from cities well scattered around the world map, allows us to observe regional differences. We note that the system of Swiss embassies mostly concentrates in Europe and on the East Coast of North America. In the nearest neighbouring countries, ambassadors are present in many different cities, especially in less centralised Germany. This offers a nice illustration of the »first law of geography«, according to which »everything is related to everything else, but near things are more related than distant things«.

Waldo. R. Tobler: »A Computer Movie Simulating Urban Growth in the Detroit Region«, in: Economic Geography 46 (1970), p. 234–240, hier p. 236, online at: https://doi.org/10.2307/143141 (1.8. 2018).

»Near«, though, may not refer to topographical space only:

André Ourednik: L'habitant et la cohabitation dans les modèles de l'espace habité, Dissertation, Universität Lausanne 2010, p. 105.

The presence of Swiss envoys in North America should rather be understood in terms of political proximity. On the opposite, many countries of Asia and Africa still lack Swiss representation by the end of the 1960s, above all countries that only gain independence from colonial powers later on. Geopolitical interest, here, is an obvious factor of explanation. Japan, for instance, who enjoys the status of a colonial power in the Pacific from the second half of the 19th century, also enjoys the presence of a Swiss diplomatic envoy since 1906.

Figure 2

Number of reports sent per city. Total French: 23,426. 1920 (thin) and August 1945 (thick) borders. (Map projection: Dymaxion).

Figure 3

Detail of Figure 2: Europe. (Map projection: Peirce Quincuncial).

We further hypothesise that sentiments show a chronological evolution, which can be correlated with general or specific political, economic or cultural trends. In such a way, TSA can contribute to a history of the administration, to a description and analysis of diplomatic and administrative practices. For this, we need our data to be sufficiently fine-grained on the historical time scale.

The date of most political reports in our possession is expressed in time spans covering several years. In effect, the dating is not based on the documents themselves but on the associated metadata in the archival database of the Swiss Federal Archives (SFA). Figure 4 illustrates the historical distribution of these dates (cf. Figure 2).

Figure 4

Distribution of documents from selected cities, per city and time span of origin. Line colour is transparent: Light grey lines indicate one or two documents and dark lines multiple documents overlapping in the same time span. The line width is proportional to the number of tokens per document, divided by the line's length.

As Figure 4 shows, the most densely covered period across all cities, on which we therefore focus, lies between 1920 and 1960. Reports from cities such as Antwerp are few and dated to a single, wide time span (1857–1936) excluding analysis of a historical evolution. Documents from Mexico are more numerous and stem from five different time spans, but the dating precision is still insufficient. On the contrary, cities such as Paris, Washington, Tokyo, London and Stockholm provide a continuous sequence of precisely dated texts. We have selected such cities due to this availability of fine-grained chronological data. We have set the precision threshold to 3 years, meaning that we excluded reports dated from a larger time span from further analysis. This brings us down to 12,364 analysed reports. The next question is whether the language of these texts allows detection of statistically meaningful sentiments.

A State of Practice in Sentiment Analysis
Sentiments, feelings, affects and emotions

The European Parliament recently tested TSA of foreign documents to detect translation bias. In case of quantifiable change in mood and sentiment across translations in documents, Whelchel and Fellbaum speak of »misconstrued communications«, which the administration seeks to overcome.

John Whelchel / Christiane Fellbaum: »Sentiment Analysis of Foreign Documents to Detect Translation Bias. Misconstrued Communications in the European Parliament«, Independent Work Report Spring 2014, online at: http://www.johnwhelchel.com/static/mysite/index/IWBiases.pdf (1. 8. 2018).

Algorithms become its tool of international sentiment expression alignment. Whatever the purpose and chosen method of TSA, making its epistemic posture explicit is essential for its use and the interpretation of its results.

If an algorithm is to attribute sentiments to data of any type, it needs a predefined discrete and finite set of sentiment categories. Whether such a set can be constructed at all is of course in dispute,

The complexity of this psychological disputatio ramifies in neuroscience, biology, linguistics, anthropology and philosophy. Darwin proposed the existence of transcultural basic emotions in an ethically motivated publication, see Charles Darwin: The expression of the emotions in man and animals, London 1872, online at: http://archive.org/details/expressionofemot1872darw (1. 8. 2018). For further discussion, see Keith Oatley / Philip N. Johnson-Laird: »Towards a cognitive theory of emotions«, in: Cognition & Emotion 1 (1987), pp. 29–50; Andrew Ortony / Terence J. Turner: »What's basic about basic emotions?«, in: Psychological Review 97/3 (1990), pp. 315–331; Paul Ekman, »An Argument for Basic Emotions«, in: Cognition and Emotion 6 (1992), pp. 169–200; Kristen A. Lindquist et al.: »Language and the perception of emotion«, in: Emotion 6/1 (2006), pp. 125–138, online at: https://doi.org/10.1037/1528-3542.6.1.125(1 8. 2018); Maria Gendron et al.: »Emotion words shape emotion percepts«, in: Emotion, 12/2 (2012), pp. 314–325, online at: https://doi.org/10.1037/a0026007 (1. 8. 2018); Paul Ekman / Dacher Keltner: »Darwin's Claim of Universals in Facial Expression Not Challenged«, 27. 3. 2014, online at: https://www.paulekman.com/uncategorized/darwins-claim-universals-facial-expression-challenged (1. 8. 2018).

as much as the ›real difference‹ between sentiments, feelings, affects, emotions and opinions.

The term feeling, for instance, has »multiple psychological and physiological definitions ranging from the subjectively accessible component of emotions to somatosensory experiences, ideas, and beliefs«, see Lauri Nummenmaa et al.: »Maps of subjective feelings«, in: Proceedings of the National Academy of Sciences, online at: https://doi.org/10.5281/zenodo.1291730 (28. 8. 2018). Etymologically speaking, the entire vocabulary of emotions evolves around the idea of movement and effect, as suggested by the Latin ex-movere (to move out), ad-facere (to be acted upon) and the old English felan (to touch). Sentiment re-enters into modern English from 17th c. French, where it denotes a faculty to receive physical impressions. Depending on the choice of the term, focus is given to the environment moving a subject or to the subject moving the environment by the expression of his or her emotion. »It is generally agreed that emotions are something people experience and something they do. We have emotions and we manifest emotions. Much of the difficulty in defining them has come from the traditional view that these are two essentially different activities«. See Monique Scheer: »Are Emotions a Kind of Practice (and Is That What Makes Them Have a History)? A Bourdieuian Approach to Understanding Emotion«, in: History and Theory 51/2 (2012), pp. 193–220, online at: https://doi.org/10.1111/j.1468-2303.2012.00621.x (1. 8. 2018). In effect, some authors seek to normalise differences between these terms for the practical purposes of their own research, which diverge from ours.

Plamper, like other authors, overcomes the latter by encompassing all of these terms in a meta-concept.

Jan Plamper: Geschichte und Gefühl. Grundlagen der Emotionsgeschichte, München 2012.

For ourselves, except for ›opinion‹, we shall treat these terms as synonyms, since their distinction provides no added value in our context. We also concur with Plamper or Scheer

Scheer: »Are Emotions a Kind of Practice«.

about the need for a better dialogue between neuroscience and the social sciences, i.e. for overcoming rigid postures that oppose, at best, scientist universalism to ideological culturalism and, at worse, phrenology to creationism. Thus, while considering any finite set of ›basic emotions‹ as an epistemic construct, we also recognise its pragmatic value and necessity.

We retain that natural language provides names for sentiments, which can serve as a classification basis. We also pose that language participates in the mental state of its speaker, by encouraging her to conceive her emotions in a specific way. In turn, her use of a given vocabulary to express her emotions contributes to the reification of this vocabulary and of the associated mental states of other individuals, and thus affects her social environment. Emotions »arise at junctures of social plans«.

Oatley /Johnson-Laird: »Towards a cognitive theory of emotions«.

This also means that we can expect emotions expressed by individuals in an administrative apparatus to reflect political or historical events, as much as the other way around: Such events are indeed the ultimate expression of the emotions of political bodies. Their analysis can contribute to a history of the administration that is not only the history of the rationality of an institutional order, as Max Weber stressed,

Max Weber: Wirtschaft und Gesellschaft, Tübingen 51976, online at: https://www.textlog.de/weber_wirtschaft.html (1. 8. 2018).

but also the history of ritualising feelings and guiding the risk associated with them, especially in diplomacy.

Polarities and basic emotions

TSA inherits its basic emotions from research in psychology and neuroscience, for example:

Further examples: [rage/terror, anxiety, joy] Jeffrey A. Gray / Neil McNaughton: The neuropsychology of anxiety. An enquiry into the function of the septo-hippocampal system, Oxford 1982; ders.: »The whole and its parts. Behaviour, the brain, cognition and emotion«, in: Bulletin of the British Psychological Society 38 (1985), pp. 99–112; [anger, interest, contempt, disgust, distress, fear, joy, shame, surprise] Silvan S. Tomkins: »Affect theory«, in: Klaus R. Scherer / Paul Ekman (eds.): Approaches to emotion, Hillsdale 1984, pp. 163–195; [expectancy, fear, rage, panic] Jaak Panksepp: Affective neuroscience. The foundations of human and animal emotions, Oxford 1998 (2004); [anger, disgust, anxiety, happiness, sadness] Oatley / Johnson-Laird: »Towards a cognitive theory of emotions«; [anger, contempt, disgust, distress, fear, guilt, interest, joy, shame, surprise] Caroll E. Izard: Human emotions, New York 1977. Note that sentiment analysis is not necessarily based on text. Its development is rather tributary to studies of facial expressions, see Paul Ekman / Wallace V. Friesen: »The repertoire of nonverbal behaviour. Categories, origins, usage, and coding«, in: Semiotica 1 (1969), pp. 49–98; idem: »Universals and Cultural Differences in Facial Expression of Emotion«, in: James K. Cole (ed.): Nebraska Symposium on Motivation, 1971, Lincoln 1972, pp. 207–283; Izard: Human emotions; Paul Ekman / Wallace V. Friesen / Phoebe Ellsworth: »What emotion categories or dimensions can observers judge from facial behavior?«, in: Paul Ekman (ed.): Emotion in the human face, New York 1982, pp. 39–55; Rachel E. Jack / Oliver G. B. Garrod / Philippe G. Schyns: »Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time«, in: Current Biology 24/2 (2014), pp. 187–192, online at: https://doi.org/10.1016/j.cub.2013.11.064 (1.8. 2018), brain activity, see Gray / McNaughton: The neuropsychology of anxiety; idem: »The whole and its parts; Tomkins: »Affect theory«; Jaak Panksepp: »Toward a general psychobiological theory of emotions«, in: The Behavioral and Brain Sciences 5 (1982), pp. 407–467; Panksepp: Affective neuroscience; or neuroendocrinology, see Panksepp: »Toward a general psychobiological theory of emotions«; Panksepp: Affective neuroscience; Judith A Toronchuk / George F.R. Ellis: »Affective Neuronal Selection. The Nature of the Primordial Emotion Systems«, in: Frontiers in Psychology 3 (2012): p. 589, online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2012.00589/full (1. 8. 2018).

Ekman, Friesen, Ellsworth:

Ekman: »Universals and Cultural Differences«; Ekman / Friesen / Ellsworth: »What emotion categories«.

anger, disgust, fear, joy, sadness, surprise

Plutchik:

Robert Plutchik: The emotions. Facts, theories, and a new model, New York 1962, online at: http://archive.org/details/emotionsfactsthe00plut (1. 8. 2018); idem: »A general psychoevolutionary theory of emotion«, in: Ders. / Henry Kellerman (eds.): Emotion. Theory, research, and experience 1, Theories of emotion, New York 1980, pp. 3–33.

trust, anger, anticipation, disgust, joy fear, sadness, surprise

Jack, Garrod, Schyns:

Jack / Garrod / Schyns: »Dynamic facial expressions«. The authors explicitly argue for the reduction of Ekman emotions by combining fear / surprise and anger / disgust.

happiness, sadness, fear | surprise, anger | disgust

Most authors working with basic emotions consider these as categories subsuming a wider range. Cheerfulness, zest, contentment, pride, optimism, enthrallment and relief, for example, are all considered as variants of joy by Shaver et al.

Phillip Shaver et al: »Emotion knowledge. Further exploration of a prototype approach«, in: Journal of Personality and Social Psychology 52/6 (1987), pp. 1061 – 1086.

Some propose a graduation of basic emotions and derived sentiments, such as remorse as a combination of disgust and sadness (Figure 5). Most include at least four emotions among the ›basic‹ ones: anger/rage, happiness/joy/elation, sadness and fear/anxiety.

Figure 5

Plutchik's wheel of emotions‹. The intensity of emotions weakens with distance from the centre. Similar emotions are placed next to each other and contrasting emotions opposite to each other. Complex emotions appear as combinations of the basic emotions, between the petals of main axes.

Some authors treat basic emotions as distinct from sentiment polarities: positive vs. negative,

Bo Pang / Lillian Lee: »Opinion Mining and Sentiment Analysis«, in: Information Retrieval 2/1–2 (2008), pp. 1–135.

also referred to as semantic orientation or valence.

Vauth Hatzivassiloglou / Kathleen McKeown: »Predicting the semantic orientation of adjectives«, in: Proceedings of the Eighth Conference on European Chapter of the Association for Computational Linguistics 35 (1997), pp. 174–181.

We propose to consider such polarities as highest metasets of basic emotions. For TSA, it is noteworthy that discrete polarities (-1,1) closely relate to the linguistic concept of synonyms and antonyms. Some authors include a neutral valence (-1,0,1) or attribute polarities on a continuous scale of real numbers between -1 and 1,

Erik Cambria et al.: »SenticNet 4. A Semantic Resource for Sentiment Analysis Based on Conceptual Primitives«, in: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics (2016), pp. 2666–2677, online at: http://sentic.net/senticnet-4.pdf (1. 8.2018).

translating, for instance, the difference in degree between serenity, joy and ecstasy.

Textual sentiment analysis in popular approaches

TSA uses mainly two classes of methods to detect sentiments in texts, based on either a lexicon or machine learning.

Lexicon-based approaches

A lexicon-based approach considers a text as a list of words. It does not analyse its sequential linguistic structure but only frequencies of isolated words (unigrams), predefined phrases or word sequences of uniform length n (n-grams). By constructing the so-called document-term matrix, one seeks to identify individual texts in which some words occur more than in others in the same corpus. Words are lemmatised beforehand to avoid redundant counts of flections (plurals, verb tenses, cases). TSA then treats lemmas as markers of specific sentiments, according to a predefined lexicon.

The most cited lexicon of this kind is the NRC-EmoLex,

Saif M. Mohammad / Peter D Turney: »Crowdsourcing a Word-Emotion Association Lexicon«, in: Computational Intelligence 29/3 (2013), pp. 436–465, online at: http://arxiv.org/abs/1308.6297 (1. 8. 2018).

marking 9383 unigrams and 787 bigrams with the positive/negative polarity and with eight Pluchik's emotions. Its authors argue that Pluchik's set, unlike Ekman's, is not composed of mostly negative emotions and is a superset of Ekman's, itself a superset of Jack's.

The use of a lexicon consisting mainly of unigrams to detect sentiments might be surprising. Among its numerous limitations is the semantic shift

Andreas Blank/Peter Koch: Historical Semantics and Cognition, Berlin, Boston 22013, online at: https://doi.org/10.1515/9783110804195 (1.8.2018)

of word meanings that necessarily occurs over a time span of over 40 years. In their machine learning-based examination of the of such shifts, Hamilton, Leskovec and Jurafsky showed, for instance, how the English term ›awful‹ travels from its 1850s semantic neighbourhood of ›solemn‹ and ›majestic‹ to its 1900s neighbourhood of ›appalling‹ and ›terrible‹.

William L. Hamilton, Jure Leskovec, Dan Jurafsky: »Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change«, in: ArXiv:1605.09096 [Cs] (2016), online at: http://arxiv.org/abs/1605.09096 (1.8. 2018).

Other problems of unigram lexicon-based TSA include negation handling: on 13 February 1922, for instance, the Swiss ambassador in Stockholm wrote that the Scandinavians »suffer from the economic crisis as much as us, and we cannot pretend that we are particularly happy (les Scandinaves souffrent de la crise économique comme nous et on ne peut pas prétendre que nous soyons particulièrement heureux)«;

CH-BAR#E2300#1000-716#1013#2#6.

the word ›heureux‹ does appear but means its opposite. Another common example is irrealitis: According to the Swiss ambassador in Washington on 17 November 1958, Mr Walter Robertson, Assistant Secretary of Far Eastern Affairs »would much rejoice in getting rid of New Guinea by ceasing it to the Indonesians, if he governed it (s'il régnait sur la Nouvelle Guinée, il serait trop heureux de s'en débarrasser en la cédant aux Indonésiens)«.

CH-BAR#E2300#1000-716#1202#1#206.

Mr Robertson might have rejoiced in doing so, but he does not govern Indonesia. Further common problems of unigram-based sentiment analysis are listed by Denis, Cruz-Lara and Bellalem.

Alexandre Denis / Samuel Cruz-Lara / Nadia Bellalem: »General Purpose Textual Sentiment Analysis and Emotion Detection Tools«, in: ArXiv:1309.2853 [Cs] (2013), online at: http://arxiv.org/abs/1309.2853 (1. 8. 2018).

Diplomatic language, rich in such wordings, poses a challenge for TSA. Proceeding by word collocation sampling, we found our most emotional lemmas, like ›heureux‹, to be mostly used in an unmodified way in our over 5 million emotionally marked lemmas of our corpus. But we did not find, yet, a systematic method for identifying the proportion of such problematic cases such as negation and irrealitis. Word sense disambiguation techniques by machine learning should offer a solution.

Machine learning

Machine learning approaches consist of ›training‹ a sentiment-detection algorithm. The method's advantage lies in its independence from a general-use, context-unspecific lexicon. It relies instead on the dataset itself, from which a ›training set‹ of texts is extracted and annotated by human analysts. The construction of a training set is accordingly resource demanding. Authors often reach out to pre-tagged databases of texts, such as user reviews that are both textual and ordinal. The Internet Movie Database, for instance, provides user comments associated with an ordinal rating, ranging from one to ten.

Andrew L. Maas et al.: »Learning Word Vectors for Sentiment Analysis«, in: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics. Human Language Technologies, Portland, Oregon 2011, pp. 142–150, online at: http://www.aclweb.org/anthology/P11-1015 (1. 8. 2018).

The training itself is based on n-gram frequencies in the training set and can thus be compared to the use of a hidden lexicon. Nevertheless, this hidden lexicon is always, per definition, adapted to the set of texts on which the sentiment detection was trained.

The most used supervised machine learning methods

For a recent review, see Jaspreet Singh / Gurvinder Singh / Rajinder Singh: »Optimization of sentiment analysis using machine learning classifiers«, in: Human-Centric Computing and Information Sciences 7/1 (2017): p. 32, online at: https://doi.org/10.1186/s13673-017-0116-3 (1. 8. 2018).

in sentiment analysis are Naive Bayes Classification;

Vivek Narayanan / Ishan Arora / Arjun Bhatia: »Fast and Accurate Sentiment Classification Using an Enhanced Naive Bayes Model«, in: Lecture Notes in Computer Science 8206 (2013), pp. 194201, online at: https://link.springer.com/content/pdf/10.1007%2F978-3-642-41278-3_24.pdf (1. 8. 2018).

K-Nearest Neighbours; Support Vector Machines, known for performance in word sense disambiguation; Maximum Entropy Classifiers; Random Forest and Multi-Layer Perceptron. In a recent work, Zhang, Zou and Gan used Convolutional Neural Networks combined with Cross-modality Consistent Regression to integrate predefined lexica in the machine learning process. All of these methods are algorithmically elaborate and mostly need an extensive human-annotated training set. This explains why current research in this field remains essentially methodological. Zhang, Zou and Gan, for instance, only apply their method to standard datasets designed for testing sentiment prediction performance

One is Twitter dataset from Semeval-2016 task 4 and the other is Sentiment Treebank dataset constructed by Stanford University including two subtasks: binary classification and fine-grained classification of the sentence sentiment polarity.

and conclude that »lexicon embeddings, attention mechanism and CCR are effective in general sentiment analysis«.

Zu-Fan Zhang / Yan Zou / Chenquan Gan: »Textual sentiment analysis via three different attention convolutional neural networks and cross-modality consistent regression«, in: Neurocomputing 275 (2018), pp. 1407–1415.

A gap between machine learning and historical research still needs to be bridged. In further work, we endeavour to use this type of methods to construct corpus-oriented sentiment lexica, notably by the use of machine learning-supported word sense induction.

Such an approach has been conducted, see A. Joshi / A. Balamurali / P. Bhattacharyya (2010). A fall-back strategy for sentiment analysis in hindi: a case study. Proceedings of the 8th ICON, for the construction of a Hindi sentiment lexicon.

In this study, we focus on a lexicon-based approach with a predefined lexicon. However, we have felt a need to adjust it.

Adjusting to the Context
A French sentiment lexicon

We developed our analysis algorithms using the R programming language. With regard to algorithmic efficiency, we have used the Quanteda package for R,

Kenneth Benoit et al. contributors:: »quanteda: An R package for the Quantitative Analysis of Textual Data«. GitHub. Retrieved from https://github.com/quanteda/quanteda (Original work published 2012). This citation pertains to a software: a collective open source development initiated by first author; also the one of Tyler Rinker below.

which includes fast methods for the use of custom dictionaries. The aforementioned NRC-EmoLex is directly available in some R packages,

Namely tidytext, see Julia Silge / David Robinson: Text Mining with R. O'Reilly, Beijing 2017, online at: http://tidytextmining.com/index.html (1. 8. 2018); idem.: Tidytext. Text Mining and Analysis Using Tidy Data Principles in R, in: The Journal of Open Source Software 1/3 (2016), p. 37, and sentimentr, see Tyler Rinker: »sentimentr: Dictionary based sentiment analysis that considers valence shifters«. GitHub. Retrieved from https://github.com/trinker/sentimentr (Original work published 2015); Tyler Rinker: »A data package containing lexicons and dictionaries for text analysis« GitHub«. Retrieved from https://github.com/trinker/lexicon (Original work published 2016). In tidytext, the NRC-EmoLex can be found in the tidytext::sentiments data table, along with AFINN, see Finn Årup Nielsen: »A new ANEW: Evaluation of a word list for sentiment analysis in microblogs«, in: Proceedings of the ESWC2011 Workshop on »Making Sense of Microposts«. Big things come in small packages, 2011, online at: http://arxiv.org/abs/1103.2903 (1. 8. 2018); Bing, see Minqing Hu / Bing Liu: »Mining and Summarizing Customer Reviews«, in: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York 2004, pp. 168–177, online at: https://doi.org/10.1145/1014052.1014073 (1. 8. 2018) and the polarity lexica. In lexicon, it is stored in lexicon::nrc_emotions (8 emotions) and in lexicon::hash_sentiment_nrc (polarities), see Tim Loughran / Bill McDonald: When is a Liability not a Liability? Textual Analysis, Dictionaries, and 10-Ks (SSRN Scholarly Paper No. ID 1331573), Rochester, NY 2010.

but it only classifies English lemmas. Our corpus being in French, we base our analysis on the FEEL lexicon

Amine Abdaoui et al.: »FEEL. A French Expanded Emotion Lexicon«, in: Language Resource and Evaluation 51/3 (2017), pp. 833–855, online at: https://doi.org/10.1007/s10579-016-9364-5 (1. 8. 2018).

that includes 14,000 French lemmas and bigrams tagged by polarities and a set of six Ekman emotions: anger, disgust, fear, joy, sadness and surprise. The FEEL lexicon results from a human-validated automatic translation and expansion to synonyms of the NRC-EmoLex.

Why the authors prefer Ekman's emotion set instead of Plutchik's is not clear from their paper.

FEEL is, to our knowledge, the most complete general-purpose French sentiment lexicon available at the present date.

In order to use it, we have lemmatised our original corpus at the tokens' level using the LEFFF lexicon

Sagot: »The Lefff«.

of ~550,000 French words. We have removed French stopwords.

Stopwords include for example logical conjunctions (et, ou, cepedant...), personal pronouns or locatives. We have also removed the weak verbs faire, être and avoir.

In ulterior work, TreeTagger,

Helmut Schmid: »Probabilistic part-of-speech tagging using decision trees«, in: Proceedings of International Conference on New Methods in Language Processing 12/4 (1994), pp. 44-49; idem: »Improvements in part-of-speech tagging with an application to German«, in: Proceedings of the ACL SIGDAT-Workshop, Dublin 1995.

SpaCy

Matthew Honnibal et al.: »SpaCy. Industrial-strength Natural Language Processing (NLP) with Python and Cython«, Explosion AI, 2018, online at: https://github.com/explosion/spaCy (1. 8. 2018) (Original work published 2014).

or UDPipe

Milan Straka / Jan Hajic / JanaStraková: »UDPipe: Trainable Pipeline for Processing CoNLL-U Files Performing Tokenization, Morphological Analysis, POS Tagging and Parsing« in: Proceedings of the Tenth International Conference on Language Resources and Evaluation, Portorož 2016.

shall be used for higher quality lemmatisation.

Authors, political entities, and sentiment dictionary compilers: the three subjects of sentiment expression

Context adjustment is a difficult task of TSA, especially in lexicon-based approaches. Some authors propose specific lexica for domains like finance.

Loughran / McDonald: When is a Liability.

Others develop automatised methods for lexicon-adjustment.

Salud María Jiménez-Zafra et al.: »Domain Adaptation of Polarity Lexicon combining Term Frequency and Bootstrapping«, in: Proceedings of NAACL-HLT, pp. 137–146.

For our purpose, we have manually adjusted the FEEL lexicon, following a preliminary analysis in which we used its original version. We were surprised, in effect, by the most frequent terms in our corpus marked with positive vs. negative polarity in FEEL (Figure 6).

Figure 6

The 30 most frequent polarised lemmas in the corpus, according to the original FEEL lexicon. Turquoise terms marked as positive, and red terms marked as negative. Crossed out terms reflect judgement arbitral of the lexicon authors rather than actual sentiments and were removed prior to further analysis. The full list of removed terms is in the Annex.

Unsurprisingly, words associated with the exercise of political power occur most frequently in our corpus. Surprisingly, FEEL associates such words with sentiment polarity (Figure 6). To make sense of the lexicon and to define a more solid base for its adjustment, we have decided to distinguish between three types of emotions or, more precisely, between what we shall name the three subject levels of emotional expression. The first two levels reflect what sentiment analysis also defines as subjectivity classification.

Janyce Wiebe / Rebecca Bruce / Thomas O'Hara: »Development and use of a gold standard data set for subjectivity classifications«, in: Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL-99), 1999, pp. 246–253; Stefano Baccianella / Andrea Esuli / Fabrizio Sebastiani: »SentiWordNet 3.0. An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining«, in: Proceedings of LREC, 2010.

The third one, we introduce.

Expressions reflecting the feelings of the author(s) of a report. These include ›triste‹ or ›heureusement‹, formulations such as ›de plus en plus‹ (denoting a fear of excess) or negative turns (›non‹, ›ne pas‹).

Expressions reflecting emotionally shaped states of political entities, such as ›guerre‹, ›crise‹ or ›paix‹. At the level of the author, these lemmas are objective facts, but they definitely indicate a non-neutral disposition on a higher social level. In the context of international diplomacy, military action usually denotes negative mutual disposition. We shall come back to the notion of super-individual emotions in the ›Global Results and Interpretation‹ section.

Expressions reflecting judgement arbitral or deliberate values of the lexicon's authors. Such include the association of ›communism‹ with fear, anger and a negative polarity; ›gauche‹ and ›conservateur‹ were marked as negative; ›socialisme‹ was marked as positive but was also associated with fear and disgust by FEEL; ›socialiste‹ was marked as positive but was associated with sadness and anger. ›Droite‹, ›nation‹, ›troupe‹, ›militaire‹, ›armer‹, ›soldat‹ and ›catholique‹ were marked as positive; ›gouvernement‹ was marked as positive but associated with fear. For incomprehensible reasons, some country names such as ›Allemage‹ were marked positive while most others were not.›Ministre‹ was marked as positive; ›fascisme‹ was absent from the dictionary.

The value judgements of FEEL's authors raise questions and concerns. Some appear as a mere result of an automatic translation. The English term ›date‹, for instance, is correctly translated to ›date‹ in French, but the many dates mentioned in our corpus hardly carry any romantic connation; its association with joy is a mere misunderstanding. Similarly, an English ›person‹ is correctly translated to ›personne‹, but the lemma then also means ›nobody‹. ›Occupation‹ has twofold meaning both in English and French and is distinguished in German by the terms Beschäftigung and Okupation. Polysemy is a great challenge to sentiments analysis. So is context. The most ›disgusted‹ report

CH-BAR#E2300#1000-716#314#5#5

of our preliminary analysis turned out to be an account for the total revenues from tobacco sales in Cuba in 1924, due to the fact that the FEEL dictionary associates ›cigarettes‹ and ›cigares‹ with disgust. Most striking, however, are the aforementioned value judgements. Some word markings of FEEL, respectively of NRC-Emolex, reflect a pro-religious and homophobic posture. To the discharge of its compilers, we retain that the lexicon results from crowdsourcing, i.e. from the current Zeitgeist of the English-speaking world. History might, some day, treat sentiment lexica themselves as historical documents.

Our aim being to analyse the evolution of sentiments of levels 1 and 2, we have individually examined the 100 most frequent lemmas for each polarity and for each one of the six Ekman emotions and removed all terms of level 3 that reflect judgement values of the lexicon's authors (see Annex for a complete list).

Politeness and sentiment

Finally, as expected, we have observed that 20th century ambassadors make extensive use of elaborate greetings and expressions such as ›j'ai l'honneur de‹, ›veuillez agréer l'hommage de mon respects‹ ›votre excellence‹ and, most frequently, ›assurance de ma considération‹ (18,488 occurrences).

Such turns contain words charged with sentiments of level 1 (respect, honneur, considération) but actually reflect mere adherence to social conventions. It can be argued that all reflect a particular disposition of level 2: diplomatic politeness, whose degrees of emphasis may vary. Interestingly, the choice of terms evolves over time (Figure 7). A full analysis could be dedicated to this topic, since even the slightest variations in polite wordings may carry otherwise unexpressed sentiments of joy or anger. At the present stage, however, we have combined such expressions into compound n-grams without emotional value.

Figure 7

Evolution of final salutations.

Sentiment scores and their global distribution

In textual statistics, simply measuring the proportion of lemmas associated with a specific sentiment is not enough. The FEEL lexicon associates more of its terms with positive feelings than, for instance, with the negative ones. This unequal distribution would induce a strong statistical bias, since counting occurrence of lemmas associated with each sentiment would reflect the relative frequencies of sentiments in the lexicon itself, not their relative frequencies in a given text. The sentiment scores (e. g. Sp = Scorepositive or Sn = Scorenegative) are therefore adjusted as follows:

Sp=TpTLpSn=TnTLn \begin{align} & {{S}_{p}}=\frac{{{T}_{p}}}{{{T}_{\forall }}{{L}_{p}}} \\ & {{S}_{n}}=\frac{{{T}_{n}}}{{{T}_{\forall }}{{L}_{n}}} \\ \end{align}

where:

Tp = count of all positive tokens in a given text

Tn = count of all negative tokens in a given text

T = count of all tokens in the text

Lp = count of all lexicon entries marked as positive

Ln = count of all lexicon entries marked as negative

We have applied the same adjustment to all six Ekman emotions. A compound indicator taking into account both positive and negative polarities is defined as

compound = Sp –Sn

In the upcoming graphics, Sp shall be referred as positive and Sn as negative.

For the sentiment scores thus defined, we observe a normal distribution across texts, with varying mean values and standard deviations (Figure 8). This is encouraging for a statistical interpretation of our results. The expression of positive sentiments dominates, followed by joy and surprise. The least proportion of texts expresses negative sentiments and sentiments of disgust.

Figure 8

Number of texts expressing each given sentiment. Histogram. n=27,000.

Here, we also include texts from wide time spans.

Global Results and Interpretation
Sentiment groups

We present our detailed results in the section ›individual cases‹. Globally, we observe that sentiments can be organised into three groups. The first two, negative sentiments (negative, anger, fear and sadness) (Figure 12) and positive sentiments (positive, compound and joy) (Figure 20), display strong intragroup correlation. This means that an analysis in terms of positive and negative polarities is adapted for our purpose, and we shall concentrate on it in further work. In other words, in our context, the Ekman emotions mainly explicate the meaning of these polarities, without yielding more differentiated insight. Joy should be considered a heightened and probably more subjective positive emotion. Anger, fear and sadness combine into a general negative feeling. The third group, encompassing sentiments of disgust and surprise (Figure 19), shall be treated very briefly.

The historic background

Before all interpretation, we need to set our results against a general historic background. The major known events between 1920 and 1960, most of which verify by text mining of our corpus, include the world economic crisis in the late 1920s (Figure 9), early Fascism, later Nazism in the 1930s (Figure 10), the Second World War and post-war economic reconstruction (Figure 11) and the beginning of the Cold War in the 1950s. For the US, the evolution of the mood was different: Fascism and Nazism did not directly affect Washington until the 1940s when the US supported the Allies and entered the war, and post-war economic development took a different course than that of war-torn Europe, whose reconstruction was funded significantly by the US under the Marshall Plan. On the other hand, the highly industrialised Japan, politically part of the Axis powers, was presumably subject to similar basic moods as Europe.

Christian W. Spang / Rolf-Harald Wippich. (ed.): Japanese-German Relations, 1895–1945. War, Diplomacy and Public Opinion, London 2006.

Japan suffered similar devastation during the war as Europe did, worsened by the atomic bombings of Hiroshima and Nagasaki, in addition to the shame about the defeat and occupation of the country by the Americans.

Figure 9

Evolution of mean document frequency of crisis-related lemmas.

Figure 10

Evolution of mean document frequency of Fascism- and Nazism-related lemmas. These encompass nazisme, nazi, naziste, antinazisme, fasciste, fascisme, fascisation and anti-fasciste.

Figure 11

Evolution of mean document frequency of terms related to war and reconstruction, including reconstruire and régénérer.

Figure 12

Indicators of negative sentiments: negative, fear, sadness, anger. The thick grey line reflects average of all cities shown in Figure 2 and Figure 3. Annotations: maximum Tokyo (A) and maximum Stockholm (B).

The theoretical background: places as synthetic subjects of sentiments

In psychology, the usual subjects of emotions are human individuals, observed in a precise moment. In our case, we are dealing with aggregate emotions of entire sets of political reports, written by multiple authors at different dates. The ontological gap between parts and the whole that we cross in this manner requires caution. While we do provide excerpts of individual political reports to support our detailed analysis, the reader must keep in mind that no single text can fully illustrate the aggregate phenomenon of a statistical regularity. Expecting the contrary would resemble predicting a human's behaviour from the observation of his or her individual cells.

We argue that aggregate subjects of emotions do exist. In fact, as we have discussed in earlier work, the acting subject of any action, including sentiment expression, is always a synthetic individual.

See Ourednik: L'habitant, pp. 156–195. This notion of syntheticity can be traced back, for instance, to Spinoza's conatus (Ethica 3, 6), in particular in its interpretation in terms of ›will‹ by Nietzsche, and further translation into the Freudian Ich at the interface of the Es and the exterior world. It also relates to Leibniz's notion of monad and its sociological interpretation by Gabriel Tarde, first indirectly, see Bruno Latour: Reassembling the Social, Oxford 2005, and then directly adopted by Bruno Latour in his actor-network theory, see Bruno Latour et al.: »›The whole is always smaller than its parts‹, a digital test of Gabriel Tardes' monads«, in: The British Journal of Sociology 63/4 (2012), pp. 590–615, online at: https://doi.org/10.1111/j.1468-4446.2012.01428.x (1. 8. 2018). The synthetic individual can also be conceived of as the self of an autopoietic system constructed by the system's observer, see Ourednik: L'habitant, p. 163; cf. Humberto Maturana / Francisco Varela: De Maquinas y Seres Vivos, Editorial Universitaria 1972. The synthetic subject of emotion should be conceived of as a logical place from which a sentiment about the world can be assessed and interpreted.

In our case, we aggregate reports based on the place and time of writing. Sentiments expressed by these sets of political reports are the sentiments of these sets, not sentiments of isolated documents and, a fortiori, not sentiments of an isolated author. Even at a single report level, the sentiment of a document is the result of a particular synthesis of:

a human author

selected as ambassador for particular abilities by an institution

representing Switzerland

having its own interests

representing interests of third parties (1939– 1945)

consciously writing to that institution

of which he possesses an own inner representation

assisted by a personnel producing text drafts and modules

a given context of writing

in a given place

in which the author has been living for 1–3 years

In effect, the Swiss foreign office has noted that the emotional world of ambassadors evolve and diverge with time spent in remote cultural settings. It sought to counter this by limiting the time spent by an envoy in a single country: to five, four and finally three years.

at a given time

marked by a set of current geopolitical concerns

a specific subject matter

identified as important by the author

that has triggered the writing of the report

The advantage of aggregating sentiments of multiple documents is that we progressively leave the level of subject matters and authors to find the aggregate sentiments of institutions, epochs and places, which are only revealed in the aggregate. This is all the more significant if we recall that the reports were sent regularly to the FDFA in Berne serve to inform the government about the international situation and thus are the basis for making foreign and security policy decisions, acting not as an individual but as a nation-state. The reports permit feeling like a state.

In allusion to James C. Scott's famous Book (James C. Scott: Seeing Like a State. How certain Schemes to Improve the Human Condition Have Failed, New Haven 1998).

Throughout the history of the administration, synthetic sentiments translate into synthetic actions. This process gives a nice illustration of the old notion of Wirkungszusammenhang,

Wilhelm Dilthey: Der Aufbau der geschichtlichen Welt in den Geisteswissenschaften, Frankfurt am Main 1910 [1970], at p. 85– 196.

more recently reappeared under the terms of agencement (assemblage) in the Deleuze and Guattari's writings on Kafka.

Gilles Deleuze / Félix Guattari: Kafka, pour une littérature mineure, Paris 1975.

Thus, the earlier mentioned stance, according to which »the person shapes the activity«

Keller: Botschafterporträts, p. 348.

might hold, but only insofar as we keep in mind that the activity and its context also shape the person. All individuals, be the aggregate or personified, are the result of synthesis.

In our case, a fourth, easily forgotten actant intervenes:

the sentiment lexicon itself

produced by a specific scientific method

applied to a specific set of data

produced by human actors

embedded in a specific epoch and cultural context

partially verified by a set of human actors

embedded in a specific epoch and cultural context

translated by a machine

With regard this fourth actant, we must stress to which point word–sentiment associations strongly vary with the selection of a lexicon's contributors. Our manual adjustment of the FEEL lexicon seeks to limit observation to sentiments proper to subjects of levels 1 (author and subject matter) and 2 (context and institution).

The relation between the three subject levels of sentiment expression and the synthetic subject

As suggested, there is a direct correspondence between our fourth actant and sentiment expressions of level 3 (judgement arbitral of the lexicon's authors). What we have defined as level 1 (›joie‹, ›tristesse‹, etc.) and 2 (›guerre‹, ›crise‹, etc.) of sentiment expression could allow us to distinguish the part played by single human authors in the synthesis of sentiment scores of documents or document aggregates. Methodologically, however, making this latter distinction would imply a total revision of the more than 10,000 terms of the FEEL dictionary, which we could not accomplish at this stage; thus, our sentiment scores do not account for it. We shall keep track of these levels, however, in our interpretation of individual cases.

Individual cases

For an interpretation of the quantitative analysis of the political reports, we have selected six countries, respectively capitals: Great Britain (London), France (Paris), Italy (Rome), Sweden (Stockholm), Japan (Tokyo) and the US (Washington). This allows us to analyse cities on three continents, while concentrating on locations from where records are available with sufficient dating precision for the whole time of observation (cf. Figure 4). We start with negative sentiments.

»Negative« sentiments

A first general observation shows that the range of negative feelings before and after World War II is significantly smaller than that during the war. Their frequency reaches its maxima between 1940 and 1944. Mathematically, this can be due to either a frequency decline in positively connoted lemmas or a frequency rise in the negatively connoted ones. Historically, we assume that it relates to anxiety and the negative horizons of expectation during wartimes.

Figure 13 gives better insight into rise of negative sentiments in the 1940–1944 period, by showing the obvious contribution of the negative lemma ›guerre‹ and associated terms ›troupe‹, ›armer‹ and ›militaire‹. It is striking that, according to our three subject levels of emotional expression defined earlier, the most influent sentiments cannot be attributed to the level of authors' reports (1) but to the level of political entities (2). This does not mean that the ambassadors never express personal-level sentiments, as illustrate documents found for Tokyo. TSA allowed us to detect the most negatively marked text from that Embassy (or Legation, as an Embassy was called then). It was headed by Camille Gorgé, a lawyer and the Envoyé extraordinaire et ministre plénipotentiaire of Switzerland in Japan.

Patrick Ziltener (ed.): Handbuch Schweiz – Japan. Diplomatie und Politik, Wirtschaft und Geschichte, Wissenschaft und Kultur. Texte, Dokumente und Bilder aus 400 Jahren gegenseitiger Beobachtung, Austausch und Kooperation, Zürich 2010.

In his telegram No 476 on 29 December 29 1944, he let the Foreign Ministry in Berne (the Federal Political Department, as it was called that time) know that Japan ends badly (»finit mal«): People [are] deprived of everything without illusions (»peuple privé de tout sans illusions«); they are suffering from hunger and cold (»souffre de la faim et du froid«). The ambassador describes the economic situation [as] still lamentable (»situation économique toujours lamentable«) and the increased discomfort due to train traffic disruptions caused by aerial bombardments and recent earthquake (»malaise accru par perturbations du trafic ferroviaire

Figure 13

50 polar lemmas with the largest D between 1940 and 1944 frequencies and all time frequency average. Polarity is given by colour. Negative values on the x-axis denote terms that appear less in that period than in all time average, and positive values represent terms that appear more.

causées par bombardements aériens et récent tremblement de terre«). But not only the American bombardments from the air test the population (»raids aériens éprouvent la population«) but also the hope for a victory of the Axis powers dwindles: The defeat seems inevitable (»défaite semblant inevitable«).

E2300#1000/716#1085*, 175 / [12], Tokio, Politische Berichte und Briefe, Militärberichte, Band 12, 1943–1945.

Nine months later, on September 1945, after the defeat of Japan, Gorgé sent a telegram to Berne, which was also very emotional; it reflects Japan's sadness. The Swiss ambassador reports on his meeting with the new foreign minister: He has not much illusion about the difficulties for Japan to win back international esteem (»II ne se fait pas beaucoup d'illusions sur les difficultés pour le Japon de reconquérir l'estime internationale«). The position of the government is extremely precarious because it depends entirely on Americans (»La position du gouvernement est d'ailleurs extrêmement précaire car elle dépend entièrement des américains«). Gorgé is amazed at the ease with which the Japanese suffer their extremely humiliating fate (»On est toujours plus étonné de la facilité avec laquelle les japonais subissent leur sort extrêmement humiliant«).

E2300#1000/716#1085*, 175 / [12], Tokio, Politische Berichte und Briefe, Militärberichte, Band 12, 1943–1945.

Relating back to the question of the subject of emotion (author or political entity),

Chapter »Global results and interpretation«.

we are clearly situated on the level of the individual. Several factors explain the elevated indices of negative emotions in end-of-war Tokyo. First of all the extreme conditions, of course, though similar ones have not lead envoys in other war-torn cities of that time to a comparable passion. More decisive seems Gorgé's ability and willingness to express sentiments, induced by a specific culture of the French-speaking diplomats of 1920s and 1930s versed in art and literature.

Gorgé has also published essays and poetry prior and after his diplomatic career. See also Pierre-Yves Donzé et al. (eds.): »›Journal d'un témoin‹. Camille Gorgé, diplomate suisse dans le Japon en guerre (1940–1945)«, in: Dodis. Diplomatische Dokumente der Schweiz, 2018, online at: http://dodis.ch/dds/11280 (1. 8. 2018).

That TSA allowed us to detect Gorgé's texts, without prior knowledge about his career, could have an interesting explanation. As stated in our introduction, TSA is notably developed in literature science. Its detection of sentiments relies on the extensive use of adjectives, adverbs and emotionally coloured substantives; such are less frequent in a more cautious writing, which might, nevertheless, express emotion by circumlocution and understatement that fall under the radar of current TSA methods. A hypothesis attested by the global decline of the proportion of sentiment-marked lemma (Figure 14) is that the professionalisation of Swiss diplomacy has reinforced such cautious language, modifying the ›emotional habitus‹

Scheer: »Are Emotions a Kind of Practice«.

of its members. Further inquiry in this direction shall consider the proportion of adjectives, adverbs and lemmas with a high subjectivity classification (cf. supra), as well as the global convergence of these values across different embassies.

Figure 14

Evolution of sentiment intensity defined as (positive + negative)/total of tokens excepting stopwords. Loess smoothing applied. Global average in thick dark grey.

These observations raise many questions: To what degree do an ambassador's personal feelings influence relations between political entities in general and between Japan and Switzerland specifically? Gorgé probably identified too strongly with his host country, which might explain why he had to leave Japan and was sent to Turkey in 1946.

Eidgenössischer Staatskalender, 1946, Politisches Departement, Türkei (Ankara), 39, online at: https://www.amtsdruckschriften.bar.admin.ch/viewOrigDoc/40001842.pdf?id=40001842 (1.8. 2018).

But let us proceed to a second example, in which the aggregate level of the political entity becomes more apparent. Surprisingly, the document with the most violent rash in terms of negativity, fear, grief and anger is a report on Sweden from the 1928 to 1932 period. Actually, it reveals the strength of the socialist movements in Sweden in the late 1920s and 1930s in comparison to other Western countries,

E2300#1000/716#1015*, 166 / [6], Stockholm, Politische Berichte und Briefe, Militärberichte, Band 6, 1928–1931.

something that seemed to disturb Swiss diplomacy deeply.

Switzerland and Sweden had a long tradition of good relations. Since 1847, the Swiss consulate in Christiania (Oslo) was also responsible for Sweden. The first Swiss consulate in Sweden was established at Stockholm in 1887. For a longer time, the head of the Swiss diplomatic mission in Berlin was also responsible for Sweden. The diplomatic relations were upgraded in 1919 with a Swiss envoy to Stockholm. In 1957, the legation was transformed into an embassy. The two countries made similar experiences during the World War II: Both were neutral, both economically and financially dependent on relations with both the Allies and Nazi Germany. The Allies even addressed common questions in a Sweden– Swiss Committee. As Sweden and Switzerland faced new challenges during the Cold War, the two countries moved even closer. Foreign Ministries agreed on a regular mutual exchange of views in the 1950s.

Irène Lindgren / Renate Walder (eds.): Schweden, die Schweiz und der Zweite Weltkrieg, Bern 2001.

The cultural relations between Switzerland and Sweden were close as well. Schiller's William Tell was translated into Swedish in 1823. Both countries exchanged films during the war. In Switzerland, Swedish lifestyle (home furnishing, books, travel) became very popular after World War II. In Sweden, Switzerland was sometimes seen as a model for the future constitution of Europe,

Karin Naumann: Utopien von Freiheit. die Schweiz im Spiegel schwedischer Literatur, Berlin 1994.

whereas in Switzerland, many thought Sweden to be a modern model society.

Given this narrative of the tight and good relations between both countries, it astonishes that the document from our corpus with the second-most violent rash in terms of negativity, fear, grief and anger, after the Tokyo reports, is the aforementioned report

CH-BAR#E2300#1000-716#1015#2#9, E2300#1000/71 6#1015*, 166 / [6], Stockholm, Politische Berichte und Briefe, Militärberichte, Bd. 6, 1928–1931.

on Sweden from the 1928 to 1932 period. Frequency D analysis for this period (Figure 16) shows a relative rise of negatively connoted lemmas such as crisis (›crise‹), unemployment (›chomâge‹), radical (›radicale‹) and extreme.

Figure 15

Demonstration march against strike-breakers in Ådalen, Lunde, on May 14th 1931, 3PM, gathering 3,000 people. A few minutes later, five people were killed by bullets fired by troops. Photo: IT News Agency / Scanpix.

Figure 16

Stockholm. Frequency D of polarised lemmas between the 1928 and 1932 period and all time Stockholm average. Colour indicates polarity. Negative values on the x-axis denote terms that appear less in that period than in all time Stockholm average; positive values denote terms that appear more.

Obviously, the negativity of the reports relates to an economic crisis. But what does the Swiss embassy in Stockholm deem as radical and extreme in this context? This question can be answered by representing the semantic network of word co-occurrence in the documents from that place and period (Figures 17 and 18). The figures show not only negative and positive expressions but also their neighbouring lemmas, notably ›socialiste‹, ›ouvrier‹, ›communiste‹ and ›gauche‹. Co-occurrent terms are connected by network edges and closer to each other. Based on them, we can hypothesise that the strengthening of the labour movement in Sweden worried Swiss diplomacy. The Socialist Workers' Party (›parti‹, ›socialiste‹, ›ouvrier‹) taking over government power in Sweden (›pouvoir‹, ›gouvernement‹) seems a development that Switzerland did not follow politically and socially. This would also explain why, after World War II, Switzerland's idealised image faded and criticism became loud. Swedish authors like Arvid Brenner scourged in particular a reckless capitalism in Switzerland.

Eric Flury-Dasen: »Schweden«, in: Historisches Lexikon der Schweiz, online at: http://www.hls-dhs-dss.ch/textes/d/D3371.php (1. 8. 2018).

Figure 17

Co-occurrence network of most frequent lemmas in reports from Stockholm, 1928-1932. We have kept only politically relevant lemmas in this visualisation (excluding e. g. ›année‹ or ›voir‹). We applied Fruchterman–Reingold network layout, meaning that strongly linked lemmas are close to each other on the graphic. Edge weights show lemma co-occurrence frequency; circle sizes are proportional to lemma frequency. Polarised lemmas, marked in red and turquoise, reflect the sentiments expressed when reporting on these topics.

Figure 18

Selected nodes from the semantic network of Figure 17, showing only the part of the network related to social movements. Socialism and the working class movement are particularly important topics in this period.

Figure 19

Indicators of disgust and surprise. The thick grey line reflects average of all cities shown in Figure 2 and Figure 3.

Figure 20

Indicators marking positive sentiments: positive, compound and joy. The thick grey line reflects average of all cities shown in Figure 2 and Figure 3.

Disgust and surprise

Disgust and surprise (Figure 19) mostly correlate with negative sentiments and provide no extra information. We see no specific added value of these sentiment categories – as implicitly defined by their associated word set in the FEEL lexicon – for the analysis of our dataset. Based on our observation, we do not recommend their use for analysis similar to ours.

»Positive« sentiments

One curve of evolution of the positive sentiments (Figure 20) immediately stands out: Values for Washington are falling sharply during World War II, remain at a very low level for a while and then rise again after the war (A). Lemmas such as ›croire‹ and ›foi‹ occur less often then (Figure 21), suggesting a loss of mutual confidence. Upon the background of historical knowledge,

Linus von Castelmur: Schweizerisch-Alliierte Finanzbeziehungen im Übergang vom Zweiten Weltkrieg zum kalten Krieg. Die deutschen Guthaben in der Schweiz zwischen Zwangsliquidierung und Freigabe (1945–1952), Zürich 1992; Marco Durrer: Die schweizerisch-amerikanischen Finanzbeziehungen im Zweiten Weltkrieg. Von der Blockierung der schweizerischen Guthaben in den USA über die »Safehaven«-Politik zum Washingtoner Abkommen (1941–1946), Bern 1984.

the interpretation seems quite simple: The Americans criticised Switzerland because of its close economic and financial ties to Nazi Germany. They blocked Swiss assets in the US and blacklisted Swiss companies. The tensions did not settle until 1946, when the Washington Agreement offered a basis for good post-war relations. The joy of this success of Swiss diplomacy seems visible in Figure 20. Yet, we did not find more specific terms related to these events in our corpus with text-mining techniques (Figures 911). We venture the suggestion that these events had a deeper, more ›subconscious‹ effect on the tone of the reports of the Swiss embassy in Washington: The more frequent use of negative turns involving words like ›contre‹ or ›malgré‹ might be a sign of this.

Figure 21

Washington. Frequency D of polarised lemmas in the 1940–1944 period and all time Washington average. Colour indicates sentiment polarity. Negative values on the x-axis denote terms that appear less in that period than in all time Stockholm average; positive values denote terms that appear more.

As much interesting are the joy scores for Stockholm that decline rapidly during the 1930s (Figure 20B), stay at a low level during the forties and decline again after the war (Figure 20C), almost in a mirrored image of the assessment for Figure 12. This points historians interested in relations between Switzerland and Sweden to possibly relevant sources for describing these relationships while socialist forces increasingly determined politics in Sweden. In addition, it raises a question similar to the case of Tokyo: To what degree do the Swiss ambassador's feelings influence relations

between Sweden and Switzerland? What role did the socialist turn play in the reports for a country with which Switzerland felt strongly connected? Did the professionalisation of diplomacy improve these relations?

Positive sentiment scores for London are consistently elevated. The same applies to Paris and Rome. In effect, literature also attests for good relations between Switzerland and its direct geographical neighbours, France and Italy.

See, for instance, the information of the FDFA to the bilateral relations to these countries. For France in particular, online at: https://www.eda.admin.ch/eda/en/home/representations-and-travel-advice/france/switzerland-france.html (1. 8. 2018).

Our results suggest that these relations were hardly affected by the French Vichy regime and the Italian fascist government. To verify this, historians could turn to the individual sources identified by the algorithms of the sentiment analysis – something that we cannot do here.

In all cases, caution in such interpretations is important. It is, for instance, worth taking a closer look at the big joy in London (Figure 22). The terms that contribute to this result are notably good (›bien‹), create (›créer‹), success, interest and beneficial (›favorable‹). They could signal both good bilateral relations and a potentially favourable economic situation. To determine what was really meant, the individual reports should be consulted to answer more specific questions: When did the roaring 20s come to an end in the UK? How did this affect the bilateral relations with Switzerland, which in general remained rather consistently good?

Figure 22

Frequency of lemmas associated with joy in London, 1932-1936.

Discussion

In our approach, we have applied a most basic method of sentiment analysis, relying on a precompiled and manually edited sentiment lexicon. Yet, we observe variations in sentiment expression over the course of time, which correlate with historical events. Local specificities can be observed as well.

Sentiment analysis contributed most to our knowledge about sentiments in the administration by identifying the Tokyo reports with strikingly strong sentimental expression over a large set of documents. This identification opens perspective for further focused research on the personal role of the Swiss ambassador in Tokyo for shaping bilateral relations.

In the case of 1930s documents from Stockholm, the method proved itself useful in identifying moments of important social change and giving insight into the interpretation of these events by the Swiss administration.

We can expect emotions expressed by individuals in an administrative apparatus to reflect political or historical events, as much as the other way around. In this respect, it is possible to more closely examine Keller's statement, whereas »the person shaped the activity«.

Keller: Botschafterporträts, p. 348.

The analysis of such emotions can contribute to a history of the administration that is not only the history of the rationality of an institutional order, as Max Weber stressed. For a history with diplomatic and administrative practices in its focus, it should be possible then to detect special events, respectively the feelings they evoke against the backdrop of the prevailing mood for each country.

Of course, despite our efforts to eliminate contemporary judgement values, the sentiments observed by our method appear at the interface of 20th century subjects and a 21st century lexicon. Lexicon-based TSA always projects a sentimental ontology of its contemporary context of compilation on past documents. This has not only the obvious risk of an anachronistic interpretation but also the interest of revealing the comparative particularities of the past document's language. In effect, at least since the 19th century hermeneutics, we know that all forms of text interpretation carry a bias induced by the difference between the world from which they are interpreted and the world in which they were composed. In an algorithmic approach, this historical bias is stronger, because fixated in a lexicon, but is also much more explicit. While it is difficult to know what values a historian associates with given expressions during her interpretation, her lexicon reveals exactly what values have been attributed by her interpretation algorithm. This suggests work focused on the construction of place-and time-specific sentiment lexica as a heuristic method in history. The association of lemmas with sentiments in such lexica, considered in its historical dynamic, could give us a framework for specifying semantic shifts and, through these, the evolution of the world of sentiments. We have identified how corpus-based lexicon construction and machine learning methods for word sense induction could offer a methodological solution to do so.

In further work, beyond the benefit of the discovery of significant phases in bilateral diplomatic relations, TSA could also help to detect the fingerprint of authors in aggregated (political) reports that are the base for decisions of the administration and the government. We endeavour to achieve this by a more systematic distinction between the first- and the second-level subject of emotion expression in the sentiment lexicon.

Generally, we believe that TSA offers a powerful instrument for an evidence-based, empirically funded historiography. Bridging distant and close reading in historical science, it contributes to the closure of the old historiographical gap between history focused on individual action and history focused on structural phenomena, by considering historical subjects of emotions on multiple scales and bringing the individual into perspective without losing sight of the aggregate.

Last but not the least, the description and interpretation of administrative practices on a new empirical basis can help to make the administrative history of Switzerland more visible and increase understanding of how the administration works.

Annex : Top 100 Words per Sentiment

The following tables give frequencies of the top 100 words for each emotion, ordered by frequency in the corpus. In strikethrough, words that we removed from the original feel dictionary prior to analysis are listed.

Positive, joy, surprise and disgust
PositiveJoySurpriseDisgust
FeatureFrequencyFeatureFrequencyFeatureFrequencyFeatureFrequency
1gouvernement82,146Bien39,114nouveau44,621pouvoir120,136
2pays71,717premier30,291prendre31,759politique70,722
3politique70,722économique23,352aucun25,146non19,430
4état51,399partie20,882problème19,672seul18,545
5ministre49,981obtenir12,580travail1 7 , 5 2 9étranger18,438
6général46,573vie10,601actuel16,036sujet18,063
7grand42,568reprendre9757possible14,526socialiste14,741
8président42 563créer9130trop12,556chose12,721
9devoir42,539rappeler9038présent12,162intérieur11,474
10bien39,114intéresser7873occasion11,784manière8305
11monsieur37,140libre7578prévoir10,211mentir6798
12donner31,156date6653bon9315opposer6520
13jour31,087spécial6466particulier8405gauche6438
14premier30,291succès6375exposer8179éviter5790
15sou29,896favorable5349crise7677matière5662
16situation29,196jouer5119liberté7647ennemi5471
17mettre28,808offrir4705art7386mort5458
18trouver28,551réussir4574malgré7185congrès4882
19part27,794terminer4559différent6943incident4834
20allemand27,019gagner4235événement6724économie4803
21droit26,471organe4149perdre6657tâche4559
22rapport26,430enfant3908indépendance6528vice4266
23peuple24,785contribuer3858circonstance5892tour4253
24affaire24,605considérable3820voyage5886mauvais4189
25national24,467faciliter3647second5806accuser4134
26savoir24,337maintien3464arrêter5726tribunal4129
27économique23,352existence3430charge5689étendre4113
28année23,226satisfaction3428apprendre5171adversaire3940
29temps22,814posséder3357incident4834modifier3720
30mesure22,341heureux3309pacifique4795compromettre3630
31nation22,102accueillir3154espoir4702abandonner3591
32lieu21,594naître3100appel4656vif3559
33public21,293aboutir2760quitter4639copie3403
34moment21,143satisfaire2655vote4627posséder3357
35partie20,882profit2546voter4468air3285
36membre20,871avancer2438tirer4348noir3250
37effet19,515atmosphère2240jeune4334ignorer3090
38foi19,385bénéfice2211tour4253anti3067
39tenir19,125libérer2116parer4081parvenir3031
40rendre19,021énergie1951terrain3969dépasser2938
41sembler18,886bonnes1924immédiatement3950évident2829
42article18,850arriver_à1909avance3940tarif2824
43intérêt18,316santé1894expérience3924exclure2728
44croire18,236pro1865siège3891échec2676
45paix18,115majesté1607surprendre3862menacer2654
46ambassadeur17,546remercier1606agression3719blesser2584
47travail17,529facilement1575saisir3660faute2574
48international17,480bénéficier1502grave3612modification2518
49conférence17,280songer1462vif3559prisonnier2516
50permettre17,009accomplir1455inviter3510moindre2469
51accord16,706saluer1449conservateur3493socialisme2378
52traiter16,625théâtre1350immédiat3459suffisant2368
53agir16,531prospérité1328tenter3375séparer2339
54raison16,433vaincre1313souhaiter3358violent2334
55relation16,387féliciter1247inspirer3251souffrir2331
56république16,367opportun1233rencontrer3153faible2328
57moyen16,149concert1197attribuer3108finalement2216
58million15,794fille1179chance3067sacrifice2206
59conseil15,726rétablissement1158secret3055écarter2174
60commission15,714vacance1144attaquer2923éprouver2160
61compte15,634joie1136dangereux2788hostile2154
62monde15,620énergique1120argent2773nul2115
63fort15,416interpréter1079pousser2747dépit2108
64déclarer14,988précieux1052rencontre2720foule2081
65opinion14,964considérablement1046extraordinaire2706FAUX2054
66produire14,951remarquable1027allusion2704offensif2006
67union14,936bien_être960exception2681rejeter2005
68suivre14,893triomphe928rapide2639dur1985
69socialiste14,741animer913attirer2509hostilité1929
70parler14,658bis906trouble2385con1856
71loi14,597disponible871violent2334sanction1856
72entendre14,595heureusement863unique2324charbon1850
73possible14,526congé845aborder2278pli1843
74également14,064rassurer842monnaie2218reproche1802
75personne14,056songe821finalement2216prétexte1785
76service13,908paye798démission2144accusation1778
77comprendre13,779doter795historique2107possession1727
78nombre13,616le_meilleur790frapper2094sensible1694
79recevoir13,612célébrer773organisme2088prolonger1588
80puissance13,573inaugurer748foule2081dictature1568
81déclaration13,560triompher725encourager2054reprocher1549
82ordre13,474sourire702obstacle2045tort1501
83penser13,470content679tourner1987sang1489
84connaître13,268salon676jeunesse1923suppression1421
85assurer13,026bonheur673cacher1872sol1417
86organisation12,929courtoisie646prier1866retard1410
87journal12,811aisé626bombe1817riche1398
88action12,795avantageux620secours1803détenir1377
89lettre12,752amnistie594franc1783rumeur1366
90représentant12,671vigueur591rupture1776taire1339
91suite12,586éclat579chute1742dénoncer1330
92obtenir12,580visiteur579peur1733maladie1310
93surtout12,579victorieux569constant1684négatif1275
94chine12,362repos567urgence1620criminel1242
95présent12,162combler561compléter1597dommage1240
96aller12,073accéder556éclater1594mécontentement1235
97position11,918fleur554sincère1558malheureux1223
98occasion11,784repartir554enthousiasme1556repousser1223
99assembler11,749bienvenu551vague1547haine1220
100discours11,702jardin537surgir1478avocat1210
Negative, fear, Sadness and anger
NegativeFearSadnessAnger
FeatureFrequencyFeatureFrequencyFeatureFrequencyFeatureFrequency
1pouvoir120,136gouvernement82,146dernier38,322politique70,722
2contre41,728dernier38,322vouloir34,420contre41,728
3dernier38,322vouloir34,420guerre32,865guerre32,865
4vouloir34,420guerre32,865aucun25,146militaire24,566
5guerre32,865prendre31,759problème19,672communiste23,137
6moins25,810militaire24,566seul18,545armer21,962
7aucun25,146communiste23,137étranger18,438problème19,672
8militaire24,566armer21,962sujet18,063seul18,545
9communiste23,137problème19,672faillir15,922sujet18,063
10armer21,962seul18,545socialiste14,741demander15,681
11problème19,672étranger18,438rien14,031socialiste14,741
12non19,430déclarer14,988peu13,683chose12,721
13seul18,545condition14,803fin12,100régime12,562
14étranger18,438socialiste14,741laisser11,581troupe11,277
15sujet18,063chose12,721porter11,379défense9741
16faillir15,922régime12,562petit11,008ligne9486
17demander15,681trop12,556charger10,391lutte9002
18rien14,031fin12,100concerner10,001opposition8943
19peu13,683troupe11,277lutte9002manière8305
20ancien13,107charger10,391occuper8154occuper8154
21suivant12,950concerner10,001difficulté7941poursuivre7909
22chose12,721défense9741poursuivre7909vis7830
23régime12,562lutte9002crise7677crise7677
24trop12,556particulier8405art7386conflit7545
25attendre12,530exposer8179difficile7327coup7373
26fin12,100poursuivre7909contraire7143contraire7143
27laisser11,581crise7677mentir6798soumettre7108
28troupe11,277coup7373perdre6657armes7036
29petit11,008craindre7364opposer6520mentir6798
30charger10,391contraire7143nécessiter5826provoquer6630
31concerner10,001montrer7066estime5582opposer6520
32lutte9002armes7036ennemi5471campagne6432
33opposition8943différent6943mort5458imposer6226
34manière8305perdre6657tendance5200charge5689
35exposer8179opposer6520mal5064matière5662
36occuper8154gauche6438obligation5014ennemi5471
37besoin8089campagne6432division4967menace5190
38extérieur8051imposer6226danger4928propagande5001
39difficulté7941voyage5886incident4834division4967
40poursuivre7909éviter5790sérieux4825sérieux4825
41crise7677confiance5729soldat4789soldat4789
42conflit7545arrêter5726prétendre4704prétendre4704
43total7478charge5689quitter4639appel4656
44coup7373empêcher5623vote4627quitter4639
45craindre7364ennemi5471tâche4559vote4627
46difficile7327police5394manquer4521extrême4598
47note7265opération5337voter4468voter4468
48malgré7185menace5190estimer4415défendre4389
49contraire7143dépense5087peine4382exiger4377
50soumettre7108obligation5014doute4376tirer4348
51armes7036propagande5001tirer4348impôt4275
52mentir6798danger4928impôt4275vice4266
53servir6794obliger4886somme4261tour4253
54perdre6657incident4834revenu4254exécution4244
55provoquer6630sérieux4825exécution4244mauvais4189
56refuser6612soldat4789mauvais4189histoire4162
57opposer6520prétendre4704histoire4162accuser4134
58gauche6438appel4656accuser4134tribunal4129
59imposer6226quitter4639étendre4113colonie4127
60bien_que6135extrême4598impossible4109étendre4113
61éviter5790tâche4559pression4022pression4022
62arrêter5726maréchal4545terrain3969conseiller4013
63charge5689manquer4521radical3968revanche4000
64matière5662marchandise4425siège3891terrain3969
65empêcher5623doute4376dette3851adversaire3940
66ennemi5471tirer4348subir3730siège3891
67mort5458exécution4244modifier3720renforcer3779
68période5347mauvais4189occupation3677agression3719
69opération5337masse4156revenir3639saisir3660
70menace5190accuser4134compromettre3630abandonner3591
71dépense5087tribunal4129grave3612moral3467
72mal5064colonie4127abandonner3591communisme3412
73obligation5014étendre4113communisme3412copie3403
74propagande5001pression4022noir3250posséder3357
75division4967conseiller4013oublier3222participation3321
76danger4928assurance3970retirer3220noir3250
77juger4907terrain3969causer3108insister3208
78obliger4886avance3940ignorer3090grève3109
79incident4834adversaire3940condamner3085anti3067
80soldat4789risque3938limiter3053limiter3053
81alors_que4755siège3891perte3033pierre3049
82prétendre4704surprendre3862tomber3025perte3033
83appel4656agression3719neutre3019armement2996
84quitter4639occupation3677dépasser2938attaquer2923
85extrême4598saisir3660diminuer2886atomique2889
86tâche4559grave3612se_rendre2855évident2829
87manquer4521abandonner3591tarif2824tarif2824
88tonne4483vif3559dangereux2788rang2792
89peine4382sort3534terme2786dangereux2788
90exiger4377communisme3412exclure2728argent2773
91doute4376posséder3357laisse2677exclure2728
92impôt4275changer3295échec2676allusion2704
93vice4266noir3250blesser2584laisse2677
94somme4261oublier3222faute2574résistance2661
95exécution4244condamner3085nuit2540menacer2654
96mauvais4189secret3055interdire2531jeter2628
97histoire4162perte3033modification2518blesser2584
98masse4156tomber3025combat2517interdire2531
99accuser4134neutre3019prisonnier2516combat2517
100colonie4127armement2996recette2508prisonnier2516
eISSN:
2519-1187
Language:
English