{"id":3820,"date":"2023-08-15T13:03:22","date_gmt":"2023-08-15T10:03:22","guid":{"rendered":"https:\/\/digilab.rara.ee\/blogi\/autosoit-labi-suurandmete\/"},"modified":"2025-01-03T18:14:00","modified_gmt":"2025-01-03T15:14:00","slug":"autosoit-labi-suurandmete","status":"publish","type":"blogi","link":"https:\/\/digilab.rara.ee\/en\/blog\/autosoit-labi-suurandmete\/","title":{"rendered":"Driving Through Big Data"},"content":{"rendered":"
\n
\"\"
Movie by Tallinnfilmi \"Keskea r\u00f5\u00f5mud\" (1986). Source: Rahvusarhiiv<\/a><\/figcaption><\/figure><\/div>\n\n\n

Would you like to see how big data tells history? Come and explore with the Digilab's tool what has been said about cars in Estonian newspapers throughout history! First read the blog post and then try the tool here<\/a>.<\/strong><\/p>\n\n\n\n

To conduct the analysis, we use a word cluster counter developed in Digilab, which allows us to analyze the frequency of words and word combinations over time. For this purpose, word clusters appearing in digitized Estonian newspapers have been reviewed. These one-, two-, or multi-word phrases can provide insights into topics that were prevalent in print at different times. For example, it is not surprising that the phrase \"Eesti Vabariik\" (Republic of Estonia) peaks around 1991, or that \"ol\u00fcmpiam\u00e4ngud\" (Olympic Games) increases in frequency roughly every four years (see Figure 1 below).<\/p>\n\n\n

\n
\"\"
Joonis 1<\/strong><\/figcaption><\/figure><\/div>\n\n\n

The word cluster counter currently draws on 54 newspapers, covering the period from 1857 to 2023. This includes major well-known Estonian publications such as Postimees<\/em>, Eesti P\u00e4evaleht<\/em>, and Sakala<\/em>, older papers like Perno Postimees<\/em> and Eesti Postimees<\/em>, as well as local papers like V\u00f5rumaa Teataja<\/em> and Muhulane<\/em>. The counter does not display the absolute frequency of words and phrases but instead indicates how many times a given word appears per 1,000 words each year. This approach is used for two reasons: first, the total volume of journalism has grown immensely over nearly two centuries; second, not all newspapers are digitized or simultaneously available, meaning the amount of text varies by year. It is important to note that the trends shown by the tool should not be interpreted literally, as the digitization process is not flawless. Additionally, one must keep in mind that word frequency in journalism primarily reflects what the media focused on at any given time.<\/p>\n\n\n\n

With this in mind, let us first examine how the frequency of the word auto<\/em> (car)changes over time and compare it with some other common modes of transportation. Figure 2 compares the search terms auto<\/em> (car), hobune<\/em> (horse), jalgratas<\/em> (bicycle), and rong<\/em> (train). As shown, until the mid-20th century, hobune<\/em> appears most frequently, although rong<\/em> is also quite common. This pattern generally reflects the infrastructure of the time: the most prevalent means of transportation and power source was the horse, essential for every household. Trains, which arrived in Estonia in the 1870s and whose benefits were heralded by J. V. Jannsen in the first issue of his newspaper1<\/a><\/sup>, became symbols of industrial society and modernity. The bicycle, which began to spread rapidly in the late 19th century, was initially also seen as an avant-garde and modern mode of transport2<\/a><\/sup>.<\/p>\n\n\n

\n
\"\"
Figure 2<\/strong><\/figcaption><\/figure><\/div>\n\n\n

As the graph shows, the word auto<\/em> first appears in the data around 1910. Interestingly, this was not due to the replacement of an earlier term\u2014automobiil<\/em> (automobile) appears at the same time but fades away shortly thereafter3<\/a><\/sup>. From that point, it takes only twenty years for auto<\/em> to become the most mentioned mode of transport in journalism, surpassing even hobune<\/em> (horse). This aligns well with the recollections of people who lived during that time, noting that cars became a common sight on the streets by the mid-1930s4<\/a><\/sup>.<\/p>\n\n\n\n

In Soviet-era newspapers, we can simultaneously observe a rise in the frequency of the word auto<\/em> and a decline in mentions of other modes of transport. Notably, auto<\/em> peaks in the early 1970s, reflecting the explosive growth in private vehicle ownership during this period. It was in the 1970s that cars became primarily privately owned and associated with family or personal use, in contrast to vehicles belonging to collective farms or workplaces. As cars became a regular part of everyday life and the trend of automobilization continued during the re-independent Republic of Estonia, mentions of auto<\/em> in the press also increased.<\/p>\n\n\n\n

The spread of cars is also reflected in the emergence of various car-related terms. For instance, traffic accidents, which are inherently newsworthy events, frequently appear in the dataset. In the 1920s and 1930s, the term most commonly used was auto\u00f5nnetus<\/em> (car accident). However, by the mid-20th century, the preferred term shifted to liiklus\u00f5nnetus<\/em> (traffic accident), as shown in Figure 3.<\/p>\n\n\n

\n
\"\"
Figure 3<\/strong>.<\/figcaption><\/figure><\/div>\n\n\n
<\/div>\n\n\n
\n
\"\"
The traffic accident involving the liquor merchant Bernhard Palm's car on the Kose road, which resulted in a fatality (1924). Source: Rahvusarhiiv<\/a><\/figcaption><\/figure><\/div>\n\n\n

It can be assumed that over time it became self-evident that any traffic accident involved at least one motor vehicle, most likely a car, and therefore it became unnecessary to specifically mention this in the terminology. In general, the word liiklus<\/em> (traffic) began to appear in use in the mid-20th century and has become increasingly common since then.<\/p>\n\n\n\n

<\/div>\n\n\n\n

Since the tool allows us to examine the frequency of word clusters, we can also explore the occurrence of different word pairs (and triplets) over time. Figure 4 shows the frequency of three phrases: m\u00fc\u00fca s\u00f5iduauto<\/em> (selling a car), autode kokkuost<\/em> (car buying), and s\u00f5iduautode kokkuost<\/em> (buying cars).<\/p>\n\n\n

\n
\"\"
Joonis 4<\/strong><\/figcaption><\/figure><\/div>\n\n\n
<\/div>\n\n\n
\n
\"\"
Sales advertisements in the official publications of the Estonian Communist Party's Viljandi District Committee and the Viljandi District Soviet Workers' Council (RSN). Tee <\/a>Kommunismile<\/a>, nr. 30<\/a>, 13th of March 1958,<\/figcaption><\/figure><\/div>\n\n\n

The relatively high frequency of the phrase m\u00fc\u00fca s\u00f5iduauto<\/em> (selling a car) between the 1950s and 1980s can be attributed to newspaper advertisements where people sold their used vehicles. Buying a car was notoriously difficult during the Soviet era, as one first had to obtain a purchase permit, which could take years to secure. At the same time, a lively used car market existed, and prices for second-hand cars were often higher than for new ones, as the former were driven by demand, while the latter had artificially fixed prices set by the state. Sometimes, people managed to acquire more than one car by scheming with purchase permits (even though only one car was allowed per family), and in such cases, they could sell the old car at a profit5<\/a><\/sup>.<\/p>\n\n\n\n

<\/div>\n\n\n\n

Miks aga puudusid n\u00f5ukogudeaegsetes lehtedes igasugused ostu- ja kokkuostukuulutused? P\u00f5hjus on lihtne \u2013 defitsiitse kauba ostukuulutus ei omanud mingit m\u00f5tet ning selle \u00fclespanija oleks lihtsalt v\u00e4lja naerdud (\u201eJa mis siis, et sa autot tahad osta? Kes ei tahaks!\u201c). Nii m\u00f5nedki teavad lugusid r\u00e4\u00e4kida sellest, kuidas n\u00f5ukogude ajal v\u00f5is autom\u00fc\u00fcgikuulutuse peale kohale ilmuda kolmekordne arv soovijaid, sularaha kotis. <\/p>\n\n\n\n

<\/div>\n\n\n
\n
\"\"
Vehicle purchase advertisements in Tartu Linnaleht nr. 41<\/a>, 6th of November 2020<\/figcaption><\/figure><\/div>\n\n\n

The reason why there were no purchase or buy-back advertisements in Soviet-era newspapers is simple \u2013 an advertisement for purchasing scarce goods made no sense, and the person posting it would simply be mocked (\"So what if you want to buy a car? Who wouldn't want one!\"). Many people recall stories of how, during the Soviet era, a car sales ad could attract three times as many buyers, all with cash in hand.<\/p>\n\n\n\n

<\/div>\n\n\n\n

As we can see, this is not the first time that cars have attracted so much public attention. The analysis of historical big data allows us to explore how the development of transportation has been reflected in the media over the past 170 years, and how it has been influenced by the economic context and political situation.<\/p>\n\n\n\n

Did you have any thoughts while reading about which words and phrases' frequencies could be further explored? Feel free to give it a try and experiment with the Digilab's word cluster counter here<\/a>! Feel free to contact us on digilab@rara.ee<\/a>.<\/p>\n\n\n\n

<\/div>\n\n\n\n
\n\n\n\n

1<\/a>.<\/span> Perno Postimees ehk N\u00e4ddalileht, nr. 1<\/a>, 5th of June 1857, pp. 3-4.<\/p>\n\n\n\n

2<\/a>.<\/span> Muide, Tambet (2023). Eesti XIX ja XX sajandi jalgrattakultuur. Sirp 9th of June 2023. https:\/\/www.sirp.ee\/s1-artiklid\/arhitektuur\/eesti-xix-ja-xx-sajandi-jalgrattakultuur\/<\/a><\/p>\n\n\n\n

3<\/a>.<\/span> In fact, the words auto<\/em> and automobiil<\/em> were already used in newspaper columns earlier, but they appeared so rarely that the word cluster counter does not show them.<\/p>\n\n\n\n

4<\/a>.<\/span> Rattus, Kristel (2013). N\u00f5ukogude ajal algas autode ajastu: autokasutuskogemusest N\u00f5ukogude Eestis Eesti Rahva Muuseumi k\u00fcsitluslehtede vastuste p\u00f5hjal. Runnel, Pille; Kaalep, Tuuli; Ruusmann, Reet; Sikka, Toivo (Toim.). Eesti Rahva Muuseumi aastaraamat 56. (14\u221243). Tartu: Eesti Rahva Muuseum, lk 21.<\/p>\n\n\n\n

5<\/a>.<\/span> Rattus (2013), lk 28.<\/p>\n\n\n\n

6<\/a>.<\/span> ERR. Eestis seisab kasutuseta pea iga kolmas s\u00f5iduk. 10th of August 2023. https:\/\/www.err.ee\/1609058309\/eestis-seisab-kasutuseta-pea-iga-kolmas-soiduk<\/a><\/p>\n\n\n\n

7<\/a>.<\/span> ERR. Vanametalli kokkuostu j\u00f5uavad viimasedki n\u00f5ukogudeaegsed autoromud. 8th of April 2022. https:\/\/www.err.ee\/1608558889\/vanametalli-kokkuostu-jouavad-viimasedki-noukogudeaegsed-autoromud<\/a>  <\/p>\n\n\n\n

This post has been translated using ChatGPT.<\/em><\/p>\n","protected":false},"featured_media":2758,"template":"","blogipostituse_kategooria":[],"class_list":["post-3820","blogi","type-blogi","status-publish","has-post-thumbnail","hentry"],"acf":[],"uagb_featured_image_src":{"full":["https:\/\/digilab.rara.ee\/wp-content\/uploads\/2023\/08\/autod_thumbnail.png",320,160,false],"thumbnail":["https:\/\/digilab.rara.ee\/wp-content\/uploads\/2023\/08\/autod_thumbnail-150x150.png",150,150,true],"medium":["https:\/\/digilab.rara.ee\/wp-content\/uploads\/2023\/08\/autod_thumbnail-300x150.png",300,150,true],"medium_large":["https:\/\/digilab.rara.ee\/wp-content\/uploads\/2023\/08\/autod_thumbnail.png",320,160,false],"large":["https:\/\/digilab.rara.ee\/wp-content\/uploads\/2023\/08\/autod_thumbnail.png",320,160,false],"1536x1536":["https:\/\/digilab.rara.ee\/wp-content\/uploads\/2023\/08\/autod_thumbnail.png",320,160,false],"2048x2048":["https:\/\/digilab.rara.ee\/wp-content\/uploads\/2023\/08\/autod_thumbnail.png",320,160,false]},"uagb_author_info":{"display_name":"Laura Nemvalts","author_link":"https:\/\/digilab.rara.ee\/en\/author\/"},"uagb_comment_info":0,"uagb_excerpt":"Would you like to see how big data tells history? Come and explore with the Digilab's tool what has been said about cars in Estonian newspapers throughout history! First read the blog post and then try the tool here. To conduct the analysis, we use a word cluster counter developed in Digilab, which allows us…","_links":{"self":[{"href":"https:\/\/digilab.rara.ee\/en\/wp-json\/wp\/v2\/blogi\/3820","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/digilab.rara.ee\/en\/wp-json\/wp\/v2\/blogi"}],"about":[{"href":"https:\/\/digilab.rara.ee\/en\/wp-json\/wp\/v2\/types\/blogi"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/digilab.rara.ee\/en\/wp-json\/wp\/v2\/media\/2758"}],"wp:attachment":[{"href":"https:\/\/digilab.rara.ee\/en\/wp-json\/wp\/v2\/media?parent=3820"}],"wp:term":[{"taxonomy":"blogipostituse_kategooria","embeddable":true,"href":"https:\/\/digilab.rara.ee\/en\/wp-json\/wp\/v2\/blogipostituse_kategooria?post=3820"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}