Space Sound Effects Short Film Festival: using the film festival model to inspire creative art–science and reach new audiences
The ultra-low frequency analogues of sound waves in Earth's magnetosphere play a crucial role in space weather; however, the public is largely unaware of this risk to our everyday lives and technology. As a way of potentially reaching new audiences, SSFX (Space Sound Effects) made 8 years of satellite wave recordings audible to the human ear with the aim of using it to create art. Partnering with film industry professionals, the standard processes of international film festivals were adopted by the project in order to challenge independent filmmakers to incorporate these sounds into short films in creative ways. Seven films covering a wide array of topics and genres (despite coming from the same sounds) were selected for screening at a special film festival out of 22 submissions. The works have subsequently been shown at numerous established film festivals and screenings internationally. These events have attracted diverse non-science audiences resulting in several unanticipated impacts on them, thereby demonstrating how working with the art world can open up dialogues with both artists and audiences who would not ordinarily engage with science.
Public-engagement projects which see artists and scientists collaborate together in some way have become increasingly popular, with growing evidence that such projects, through a variety of methods, contribute to the development of society (Malina et al., 2018). Malina (2010) classifies such collaborations into the following categories:
scientists collaborating with artists on common projects resulting in both scientific discoveries and the production of artworks
scientists applying scientific research to understand creative activity in the arts
scientists working with artists to develop technological inventions
people working as both a scientist and an artist in a dual career
scientists engaging with the arts to enhance the cultural appropriation of science
scientists engaging with the arts to improve the ways science is communicated to the public.
To better understand scientists' motivations for such endeavours at an art–science session at the 2019 Interact symposium (Archer et al., 2019), 12 university science researchers and public-engagement professionals were surveyed for their attitudes towards art–science collaborations. This found that their interest in art–science collaborations were based on their enjoyment of both subjects, the utilisation of their creativity and its application as a communication tool (particularly for different audiences). When asked in an open question who they thought the audience was for such collaborations, 67±17 % thought they are for everyone, 25±16 % said non-science arts audiences and one person responded that it depended on the aims of the project (see Appendix A for details of statistical techniques used throughout and Appendix B for all the responses). Respondents thought art–science is important because it provides different ways of communicating science that can reach new audiences, can help embed science as part of culture and can help both disciplines learn from one another through their respective creativity. Therefore Type VI of Malina (2010) was the most highly cited typology of an art–science collaboration, though Type IV and Type V were also mentioned.
There have been numerous published examples of science-inspired artworks (Type V), where science acts as a resource for creative art (Kim, 2011). Voss-Andreae (2011) presents sculptures inspired by quantum physics that he argues can indicate aspects of reality that science cannot. The Tumamoc Hill Arts Initiative was a collection of site-based art and writing inspired by the Sonoran Desert and the underlying science of the region (Mirocha et al., 2015). Similarly, Orfescu (2012) describes artistic interpretations of scientific images, in this instance nanostructures, where artists convert them into pieces of art. Hoare (2013) posits that even classic works of literature, such as Moby Dick, have strong scientific influences, since art and science were not strictly demarcated at the time. It is therefore clear, even from these few examples, that activities attempting to integrate science into culture are incredibly varied and have been undertaken for a long time.
Engaging with new audiences seems to be a prominent motivation for scientists in undertaking art–science collaborations, and many evaluations of art–science events have tried to assess whether they have indeed attracted non-science audiences. Science et Cité, a festival across 20 cities in Switzerland, while striving to be “a festival of the sciences and arts” attracted significantly more people who were interested by science (40±1 %) than art (24±1 %; respondents could select from any number of 14 options), with the festival's more art-themed events typically only attracting 1.4±0.3 times more people with an interest in arts than science (von Roten and Moeschler, 2007). Another example – Covariance, a month-long art–science exhibit in London – found that 95±1 % of their audience were frequent or occasional attendees of art exhibits and that 83±3 % attended science events; hence there was substantial overlap in these two areas ( %; Lynch, 2013). Finally, the Art and Space exhibition in Dunedin, New Zealand, attracted audiences of which 57±10 % had a professional background in the arts compared to 26±9 % in science, who primarily attended due to a general interest in art (71±9 %) rather than science (38±9 %), though 50±10 % were attracted by how science and art can combine (Brook, 2017). These case studies therefore highlight that art–science events vary significantly in their audiences' interests and do not necessarily always attract new audiences as desired.
Given the multitude of different formats that constitute the art world, there are many ways of combining it with science. The twentieth century saw film emerge as one of the main art forms readily appreciated by the public (Nowell-Smith, 2017), and in recent years the film festival has burgeoned into an important area of cinema, both culturally and industrially, with an incredibly diverse range of festivals running internationally (Archibald and Miller, 2011). Research into film festival attendees (Báez and Devesa, 2014) has revealed three key motivating factors – “discovery”, “entertainment” and “cinema” – with specialised film festivals (such as those covering specific genres, topics or issues) also providing a general feeling of belonging to a specific group and/or “cinephile community” (de Valck and Loist, 2009; Film Festival Research Network, 2019). Film festivals surrounding science have been growing in number (e.g. European Academy of Science Film, 2019; Imagine Science Films, 2019), with these typically featuring documentary films presenting scientific findings in an entertaining but still educational way. However, beyond simply improving the ways that science is communicated to the public (Type VI of Malina, 2010), there is the potential to as well have science appreciated more as part of culture via film (Type V). BIO-FICTION invites short films addressing current and future debate topics in areas of biology, with a near-even mix of fiction and documentary style submissions (Schmidt et al., 2015). CineGlobe is a film festival at CERN (European Organization for Nuclear Research) which centres around broad and culturally relevant themes inspired by science and technology (CineGlobe, 2019). CineSpace is a film festival by NASA and the Houston Cinema Arts Society which solicits films inspired by and using actual NASA imagery.
This paper concerns a film festival project called SSFX (Space Sound Effects), devised and run by the author, which aimed to integrate space science research into culture. The scientific basis for the project was the ultra-low frequency (ULF) analogues of sound present within near-Earth space (e.g. Keiling et al., 2016, and references therein) which had been converted into audible sound (Archer et al., 2018). The motivations for choosing the use of these sounds for the creation of art, and in particular through film, are discussed in Sect. 2. The SSFX project had two phases, both with different target audiences and aims. Phase one targeted filmmakers, aiming to engage the independent filmmaking community with the sounds present in the near-Earth space environment and enable the creation of creative short films inspired by and incorporating these sounds. This was tackled by running an international short film competition (adopting standard film festival practices through partnering with film industry professionals) which challenged filmmakers to use the sounds as key creative elements. Section 3 concerns this phase of the project and the subsequent collaborative relationships that formed between scientists and filmmakers through the project. It was through these relationships that phase two of SSFX was possible, which aimed to exhibit these films to wide and diverse audiences, exposing them to this area of space science research and hence positively impacting these non-traditional audiences. This phase therefore had two target groups, film exhibitors and programmers, and independent filmgoers. Section 4 discusses how film exhibitors and programmers were engaged to integrate the films into their events and venues, whereas Sect. 5 concerns evaluating the backgrounds of the audiences that attended these events and what impacts resulted from them.
Space is far from completely empty; it is pervaded with very tenuous plasmas such as the solar wind that streams off of the Sun. Earth's intrinsic magnetic field acts as an obstacle to this wind and results in a magnetosphere, protecting us from much of this harmful ionising radiation. However, the interaction between the solar wind and the magnetosphere is highly complex and dynamic, resulting in phenomena which affect the space- and ground-based technology we increasingly rely upon in modern life such as electrical grids, GPS (Global Positioning System) and weather forecasts. These effects are known as space weather and have been recognised as a potential risk to our everyday lives (Cannon et al., 2013); however, a large fraction of the general population is not aware of this (3KQ and Collingwood Environmental Planning, 2015).
One way in which solar wind energy and momentum are transferred into and around magnetospheres is through plasma waves. The spatial and temporal scales where the weak plasma can largely be treated as a single conducting fluid dictated by magnetohydrodynamics necessitates plasma waves to fall within the ultra-low frequency (ULF) regime, with frequencies from fractions of millihertz to 1 Hz. Of course this does not lie within the human auditory range; however, simply by dramatically speeding up the playback of satellite observations it is possible to make our ULF wave measurements audible. Archer et al. (2018) converted perturbations in magnetic field data (which move similarly to the plasma itself due to the frozen-in condition within magnetohydrodynamics) taken at geostationary orbit into an audio dataset which is now publicly available from the National Oceanic and Atmospheric Administration (NOAA, 2018). This has already been used as a tool in exploratory citizen science with schools, as detailed by the authors, but could lend itself to artistic uses also.
How this audible version of scientific data, or “sounds of space”, could potentially be used in the creation of art was primarily informed by the sounds themselves. They surprisingly did not typically take on the musical quality somewhat expected by the researchers who study discrete frequencies and resonances within Earth's magnetosphere, but instead they conveyed a sense of dynamism and variety as well as having a somewhat cacophonous nature. While the audible dataset described in Archer et al. (2018) was comprehensive enough in order to undertake science, for the purpose of creating art there was redundancy. Therefore to reduce the amount of data, only the time-differenced stereo summary files were used, averaging these over all spacecraft to result in only one audio file per year. Through an article in The Conversation (Archer, 2016), republished by Newsweek, Daily Mail and Space.com amongst others, online comments using SoundCloud on what people thought random periods of the data “sounded like” were solicited. While the accuracy and precision of SoundCloud comments' time-tagging meant it could not be used as a means of event identification for scientific research, it did result in the wide range of 85 unique responses (from 151 comments) that are shown in Fig. 1. These reflections on the sounds planted the idea of their usage as sound effects in films, ultimately resulting in the SSFX (Space Sound Effects) Short Film Festival project. In the following sections we detail the various phases and audiences engaged through the project from filmmakers and exhibitors to filmgoers, presenting findings on their motivations for getting involved and what impact the project had on them.
3.1 Establishing a film competition
It was clear that even with the idea of having the sounds used in creative ways within films, much expertise and advice from within the film industry was required. We were interested in engaging with the filmmaker community and seeing what they came up with themselves, rather than commissioning something specific from a given filmmaker; therefore we went down the public-call model. We solicited expert external contacts from Queen Mary's film department as well as existing film contacts. These individuals consulted us on how film festivals operate and are run, pointing us in the direction of several organisations and networks that would be helpful. It was deemed that adopting standard film festival practices and establishing film industry partnerships were vital in order to make the project as authentic and attractive as possible for independent filmmakers, a concern given as this was a new initiative being spearheaded by scientists. However, the film industry professionals we approached to voluntarily sit on the judging panel found the concept exciting, as referenced by film industry judges 1 and 2, respectively:
I found the project to be innovative, having never worked with a shorts programme dedicated to engaging filmmakers with pre-recorded sounds, space sounds, or an academic programme.
Many people forget that sound is one of the most important aspects of good filmmaking.
They were joined on the panel by a couple of scientists with experience in art–science collaborations.
There were necessarily some differences with the SSFX (Space Sound Effects) Short Film Festival from most film festivals. Typically these opportunities allow filmmakers to submit existing works with only a few limiting criteria such as genre. However, we were challenging filmmakers to incorporate very specific elements, the provided sounds of space, into their work, and in many cases they were making a film especially for the festival. Given these unusual constraints, it was decided that we would try to make the rest of the competition's criteria as broad and inclusive as possible. Therefore we would not charge a submission fee; there would be no restrictions on genre or topic; we would allow filmmakers to modify the sounds as they saw fit and permit films created specifically for the competition or existing films edited to integrate the space sounds. The only other criteria we set were by age and location, with categories initially for both UK and international filmmakers separately in the age ranges: under 18, 18–24 and 25+. The significant work involved on the side of the filmmaker necessitated there being a large submission window, which we set as 6 months long, which would hopefully provide enough time to produce high-quality short films. We felt it was important for there to also be monetary prizes associated with the competition to ensure that filmmakers' efforts were valued.
A website was established which hosted the space sounds for download, more information about the competition–festival and would post YouTube videos throughout the submission window providing more background on the science (SSFX, 2019). However, it was deemed that using an existing online film festival submission platform would be better than coming up with our own method. Desk research highlighted two portals – Withoutabox and Film Freeway (2019). We opted for the former, given that it was the first online film festival submission service and was owned by IMDB (Internet Movie Database). In hindsight, however, we realised that Film Freeway would have been more flexible. Withoutabox subsequently closed down in late 2019. While we had set our final submission deadline, staff at Withoutabox recommended within their system that we have various different stages of deadlines (“early bird”, “standard”, etc.), since this would flag the opportunity to filmmakers looking at Withoutabox's calendar for upcoming deadlines. Finally, in order to reduce ineligible entries, we asked that filmmakers provide some information on how they used the space sounds. At first this was simply written in the terms and conditions to be included in their cover letter. However, it soon became clear that many filmmakers were not reading the terms and simply submitting their ineligible films anyway. We were able to get Withoutabox to add a custom required question which explicitly asked the filmmakers to provide this information, which dramatically cut down (but did not entirely eliminate) spam entries. At this stage the competition was open, and we simply needed filmmakers to engage with the opportunity.
3.2 Engaging with filmmakers
To share the opportunity widely within the independent film community, existing networks were utilised: a protracted marketing campaign throughout the submission window to Shooting People's member base of over 45 000 was run through newsletters, an editorial feature and social media (Shooting People, 2019); flyers about the competition were mailed to every film school in the country; we attended London-based filmmaker Meetup groups discussing the opportunity with around 70 filmmakers (Meetup, 2019); and we contacted key people recommended by film industry judges for more grassroots marketing. As part of a formative evaluation to ensure these were being effective at reaching our target audience, we monitored the number of people who registered interest in the project on our website (essentially subscribing to a mailing list), recording also their age, location and motivations for signing up. In total 102 people signed up, after having discarded spam entries (see later). The majority of people were 25 or over at 62±6 %, with few younger than 18 at only 10±3 % (in hindsight perhaps to be expected), which informed our merging of the two younger age categories in the competition early in the submission window. In terms of location there was an almost even split in absolute terms between those from London, elsewhere in the UK and internationally, which is clearly unrepresentative of the global population and likely down to the main networks used to promote the opportunity.
To assess people's motivations, we asked them to select from as many of the following options as applied: an existing interest in science generally (S), an existing interest in filmmaking (F), an interest specifically in the project (P) or some other reason which they could then specify. We assume that all entries which did not select any of these options (including others) were spam. A total of 16 people reported other reasons for registering interest (with three not selecting any of the main options): nine had a background in either sound design or musical composition; three were considering visualising the sounds; and others mentioned the creative challenge, interests in space or art–science and the possibility of integrating the resulting films into existing science or art–science events. Figure 2 shows the breakdown over the three main options. The proportions in each set (i.e. S, F and P) and region (of the Venn diagram) have been compared to those expected purely at random, with S, F and S∩F being significantly greater than expected. We also compared the sizes of all sets and unions of sets with one another, finding that most of these differences are statistically significant – of the six possible comparisons, only S vs. F and F vs. S∪P were not significant. From this we deduce that people who registered interest typically had existing interests in both science and filmmaking. Given that only small (typically only a few percent) fractions of the public work or have qualifications in film (e.g. BFI, 2019), we conclude that SSFX successfully engaged the filmmaking community. Given the considerable effort involved in creating a film, an interest in science also is thus understandable; though anecdotally from conversations with filmmakers, it was found that their primary scientific interests (if any) were typically not in physics or space science.
Leading up to the competition's deadline, very few films had been submitted; therefore to assess this, we sent out a survey to the mailing list 6 weeks before the deadline. While only seven responses were received, six indicated they intended to submit films, though only two of these were confident that their film would be ready by the deadline. Based on these results we decided to extend the deadline by an additional 2 weeks to allow more time for filmmakers, while still having sufficient time for judging and event organisation. Even closer to the submission, a few filmmakers reached out stating that their films would not be complete, so we made the decision to allow work-in-progress submissions, so long as the filmmakers indicated what additional work needed to be done and that it could be achieved in time for the event.
3.3 Evaluating film submissions
By the deadline 22 eligible films had been submitted (180 ineligible films not featuring any space sounds were also submitted, most of which came before the bespoke question was implemented), which according to their credits involved a total of 90 people. These films themselves demonstrate an impact on filmmakers, given that they have engaged with an opportunity to co-create an artwork based around scientific data – a substantial undertaking. Most entries (nine) were in the 25+ UK category, with 4–5 entries in the other three categories. This also meant that most entries came from the UK (59±12 %), though we note that international filmmakers from Brazil, Canada, Italy, Portugal and the USA also submitted films. None of the differences in submission numbers were statistically significant by category, age or internationality.
Each film was scored by the judges on both their usage of the space sounds (e.g. a few submissions had just a token usage of the sounds within their films) and overall impression of the film with equal weighting within Withoutabox's online system. Judges could also leave any written feedback on both judging criteria to help final decisions. A subset of all the submissions based on total runtime were assigned to each judge, though 11 films were seen by all judges (the shortest ones), and at least three judges saw each submission. One of the film industry judges (film industry judge 1) noted
The process of running the competition was extremely professional, and I would recommend the model to others in the future, with a secure screening system, showing full creative credits for each film that allowed feedback to be added and votes cast within one dedicated site. Thanks for such great organisation and clear steer on how you wanted the judging to go.
In the end there was a fair amount of disagreement between the judges – the alpha coefficient of Krippendorff (1970, 2018) for these ordinal measurements was only 0.43 (where a value of 1 would indicate perfect agreement and 0 would result from randomly drawn scores; see Appendix A). Each judge's scores were therefore standardised, using means and standard deviations across only those films which were seen by all, to ensure no one judge had more sway in the outcome. Given the overall time within the venue, we were able to select the top eight films (based on the average standardised scores) for exhibition; however, one of these was unfinished upon submission and could not ultimately be completed in time. This film dropping out necessitated merging the two international categories.
One of the film industry judges (film industry judge 2) noted about the submissions
I was really impressed by the quality and diversity of films submitted through the competition as well as the international uptake. The range of filmmaking styles was really interesting; there were dramas, comedies, animation, science fiction and avant-garde productions with some films exploring the scientific concepts directly and others using them in more abstract ways. … I really loved the fact that the project was open in how filmmakers could interpret the sounds in their productions, and I think this was key to gaining the variety that appeared across the submissions.
We note that even while some of the films incorporated elements of the underlying scientific concepts, they were not the primary focus of the films and were done in creative fictional ways and not in a documentary style. Thus all the films fell under the “science as culture” type of art–science, i.e. Type V of Malina (2010), rather than a form of direct science communication (Type VI). Even one of the judges noted “it has genuinely got me thinking about how I could explore some of the research in my future creative outputs” (film industry judge 2). The conclusion from these is that by giving a huge amount of creative freedom over to the filmmakers in allowing them to interpret and include this scientific data as they saw fit, it enabled the creativity and variety of films submitted, thus highly aligning with the aim of integrating science into culture. The following sections summarise the selected works, including the filmmakers' reflections captured during filmed panel discussions at events.
Synopsis: a meticulous young man tends to his fake garden to the sounds of deep space.
Genre: science fiction
Duration: 1 min
The film depicts a man performing gardening tasks, though this garden features no real plants, instead being filled with the titular Astroturf along with plastic flowers, trees, butterflies, etc. It is revealed at the end that this garden is on the Moon and that the Earth is on fire. The director of Astroturf noted
We wanted to make a film that used the space sound effects in an interesting way, while telling a compelling short science-fiction story. The rustling, swirling space sounds reminded us of the noises that people make all the time when performing simple tasks – sounds that in film are often replaced or reproduced as Foley. So we decided to build the entire soundtrack from the space sound effects and created a simple narrative that involved a combination of actions that we felt would be convincing when dubbed. We came up with the idea of putting it in space because of the space sounds. … Because [in the film] we've screwed up the Earth, for him this tiny patch of land is extraordinarily precious, and so that was where his character emerged from.
The producer of Astroturf added
He's trying to recreate what he's known in the past, what a real garden is, in this fake world that he's living it. Because we're both “greenies” and we see that as a potential future for us, that was what really inspired that incongruous nature of nature versus fakeness.
Further comments can be found at https://www.youtube.com/watch?v=RpC-sFzUnEE (last access: 30 January 2020).
3.3.2 Dark Matter(s)
Synopsis: this experimental and meditative imagining captures the activities of a fish tank in a way that takes the inhabitants out of their enclosed world, to a place unknown, to feel both their death and their life.
Genre: video art
Duration: 5 min
The director of Dark Matter(s) describes the film as
about a couple fish in a fish tank, but we tried to film it in a way that it doesn't look like they're in a fish tank… that got rid of the boxed-in enclosure. When I realised what's bigger than being a locked in a box was everything, it made such sense to me to look into sounds from space. I think the sound from space gives it that extra push for [the fish] to like break out of this cage or for that dichotomy of inside versus outside to be transcendent. As soon as I figured out that I was going to use sound effects from space, I think the project came full circle.
The sound designer of Dark Matter(s) commented on how he modified the sounds for the film, which were matched with classical music throughout:
I used a lot of reverbs to soften them [the sounds]; I did a little bit of slow panning; I shifted the pitch on the sound effects a couple times to separate them; I shifted them down to make them a little deeper. There's this one part where there's a bunch of bubbles, and so I changed them so they could sound like bubbles. Basically the whole process was making them soft enough to fit in the context of the film.
Further comments can be found at https://www.youtube.com/watch?v=quLaFmS9kDE (last access: 30 January 2020).
3.3.3 Murmurs of a Macrocosm
Synopsis: in this journey through a microscopic world we are led via the descriptive recordings of those who travelled it.
Genre: science fiction
Duration: 5 min
This film shows recoloured drone footage from Snowdonia paired with NASA Apollo recordings and the space sounds to depict exploration in a microscopic realm, which is revealed at the end to be inside the grooves of a vinyl record of the Moon landings. The filmmaker (director of Murmurs of a Macrocosm) stated
It was a visual that I always loved to, those SEM [scanning electron microscope] microscopic images that are colourised black and white images. But I always wanted a little bit more; I wanted to move around them. I think when hearing those sounds it kind of reminded me a bit of a record player. It also reminded me a lot of the sound from space in Contact, the Carl Sagan film/book; that's how it came together from those little things.
When discussing the use of NASA recordings, the director of Murmurs of a Macrocosm noted
finding this sort of innate humour and human conversation that they would often have to each other, and they just felt so in awe the whole time; … they're constantly excited which I really I love that aspect of exploration.
Further comments can be found at https://www.youtube.com/watch?v=e3kUGlvI_Hk (last access: 30 January 2020).
3.3.4 Names and Numbers
Synopsis: this is a sound and voice collage shaped by the sounds of space and Morse code, addressing the external, physical and material experiences of sound and movement contrasted with interior reflections, explored through language, inner voices and symbols.
Duration: 14 min
The filmmaker (director of Names and Numbers) explained how this experimental piece came together:
I tried to enact that experiment of writing down your thoughts to the sound of a buzzer which samples your mind at any particular time.… It was basically an accumulation of ideas and just sitting down and following the logic of each individual material thing: a soundtrack, recording a piece of text, a collection of different images. There was no simple way of putting them all together, and I guess the stream of consciousness of that writing process was one of the guiding principles.
Further comments can be found at https://www.youtube.com/watch?v=Uuvcm1YfdZ4 (last access: 30 January 2020).
Synopsis: a secretive woman opens herself up to her unruly housemate, after they are stuck together in her room.
Duration: 13 min
This drama film is about a woman who often isolates herself by listening to the sounds of space and who doesn't get along with her very different housemate. They eventually are able to connect over these sounds. The director of Noise noted on the title
“noise” is a specific scientific term for something which has no informational value, … and so when the characters are talking to each other they're trying to work out what's noise and whether they can actually understand anything from what they're saying to each other.… Once you heard the sounds they kind of wrote the story; they had to carry the narrative, creating a character in and of themselves.
Further comments can be found at https://www.youtube.com/watch?v=Fgvo_lP7ZmA (last access: 30 January 2020).
Synopsis: there is no answer when time is the question. Featuring 35 mm slides found in a medical archive, this science-fiction story concerns unknown phenomena that made all organic processes so fast as to make life impossible.
Genre: science fiction
Duration: 7 min
This film couples still images of medical imagery with subtitled text and a soundtrack composed of modified space sounds. The filmmaker (director of Saturation) noted of the creative process
When I first started to edit the film a couple of years ago, before I even knew what it was supposed to be, I thought [the mysterious phenomenon in the film's narrative] was something related to space. … When I saw your call [for films using the sounds of space], I realised that's what I needed – something really from space that I can use on my film. To make the sounds more tense I saturated them, making them more drone-like; … I was also interested by the process itself of making the sounds hearable by stretching and compressing the time, and it is very related to the narrative that I was thinking.
Further comments can be found at https://www.youtube.com/watch?v=rYxFHExQ4aQ (last access: 30 January 2020).
3.3.7 The Rebound Effect
Synopsis: this film brings together contemporary movement and digital media to capture dance in a way which pushes beyond the tangible dimensions of live performance.
Genre: dance and music video
Duration: 2 min
This film depicts a modern dancer moving to the sounds from space mixed with electronic music. Unfortunately filmmaker comments about this work were not captured.
3.4 Running a film festival
A boutique arts and cinema venue was hired for the SSFX Short Film Festival (Rich Mix in Shoreditch, London). To capitalise on their regular members, we opted to have them host ticket sales and primarily undertake marketing for the event. While the event was not being run to make a profit, we decided to charge a small ticket price to reduce cancellations and convey a sense of perceived value for the event. In reality all ticket proceeds actually went into the cost of a free post-event reception. The cinema required the films in a Digital Cinema Package (DCP) format. First we received the high-quality video files from the selected filmmakers and then converted these using the free, open-source DCP-o-matic (2019) software. For exhibition to the public, the films required British Board of Film Classification (BBFC) certification also, for which reason these were submitted as DCPs online. The majority of classifications were Universal rating bar two – one was deemed Parental Guidance for “mild surgical detail”, and another gained a 15 rating due to “strong language and drug misuse”.
The event was started with an unadvertised short presentation on the underlying science to the audience. These were then followed by groups of film screenings, awards presentations and panel discussions between scientists and filmmakers (international filmmakers joined via videoconferencing) about their work and approach to the project. Photos of all of these can be seen in Fig. 3. The post-event reception then enabled further discussion between scientists, filmmakers and filmgoers. Evaluation of this event (and subsequent ones) can be found in Sects. 4 and 5.
3.5 Supporting the films and filmmakers
Following the SSFX Short Film Festival, we wanted to support the filmmakers in sharing their work more widely. In return we asked them to add specific prologue or epilogue text about the underlying science as well as items in the credits pertaining to project staff, data providers and funders. In hindsight, it may have been easier to ask for this at the selection stage, so these would have been incorporated into the high-quality versions provided for the festival.
There were a number of different ways in which we supported the filmmakers. Firstly at the level of individual films, we financed the submission fees for the top four highest scoring films (Astroturf, Dark Matter(s), Murmurs of a Macrocosm and Noise) to existing UK film festivals, as this was flagged by the filmmakers as a limiting factor in their ability to share the work more widely. We left it up to the filmmakers to determine which festivals might be the best fit for them given the budget offered to each. Secondly, we acted as champions representing the entire set of shorts and approached numerous film exhibitors to enquire about some of them being considered for screening within their existing events. Finally, we wanted to offer the entire set of shorts as a ready-made package that could be screened elsewhere. However, it was deemed that simply showing the shorts back-to-back and not also having some background to their context and production would neither be such an informative nor entertaining experience for audiences. Therefore, it was decided to produce a framing film which would incorporate the shorts into an anthology.
A tender was put out to various production houses and through networks soliciting pitches for this framing film. The aim was that this framing film could in a narrative way bridge together the short films while also communicating a few simple messages about the underlying science behind the space sounds and how they affect us. We received three proposals, which were very different in approach. We went ahead with one which envisioned a point-of-view shot film during a space weather event, where technology failing causes the films to appear on various screens around the house. We worked closely with the production company on the development of the script and through the production process. The poster for the anthology film, composed of imagery from the individual short films, is shown in Fig. 4. This anthology was released for free on YouTube in October 2018 (https://www.youtube.com/watch?v=P5_OljSnA1k, last access: 30 January 2020).
Overall, the filmmakers were very grateful for all the support offered. One of the filmmakers, the producer of Astroturf, noted
The SSFX project was incredibly rewarding and allowed us as a creative team to learn about an exciting area we had no knowledge of previously. We also met other interesting filmmakers and found the audiences incredibly engaged and interested into the background of the project and where the research is. We have had a lot of positive feedback and have been able to direct our audiences to the SSFX website for more information. Martin Archer has been incredibly supportive and a champion for these films, for which we are incredibly grateful and have found invaluable.
Another, the director of Dark Matter(s), said
Collaborating on the project was a wonderful experience, and we were so grateful for all the opportunities offered to our film from taking part, reaching an international audience with our film and getting to enter into dialogues with audiences, scientists and other filmmakers. If it wasn't for SSFX, I'm not sure that our production team would have thought to engage so thoughtfully with sounds from space – we didn't know they existed. Not only did Martin provide exceptionally unique and compelling sounds for any sound designer to work with, but he was so thoughtful in terms of explaining the science and techniques used to capture these sounds. As someone who was a little intimidated by science in school, I really felt an understanding around the basic mechanisms and significance around obtaining these compelling sounds. As a filmmaker, I appreciated this so that I could answer questions at Q and As [question and answer sessions] with confidence and ease. One of the other aspects about this project that I appreciate was Martin's ability to have people from all over the world join in on the conversation. Multiple times throughout this process, I was able to talk to audience members and fellow filmmakers on a different continent while staying in the US. This is not something that I've experienced a lot in the independent-film-festival world. If you can't physically attend, then you simply can't be a part of the conversation. That was not the case with SSFX, and it made the experience all the more educational, inclusive and fun for everyone involved.
These comments highlight the impact that the open, collaborative and supportive approach that SSFX took had on the filmmakers.
Several complementary approaches were taken to get the SSFX films more widely seen as part of film festival and events programmes. As noted earlier, we paid the submissions fees for film festivals (limited to the UK only due to funding usage restrictions) identified by the filmmakers. In addition to this, we advertised the free shorts and/or anthology through film exhibitor networks recommended by our judges (including the various British Film Institute – BFI – Film Audience Network hubs and the Independent Cinema Office) and approached several key film exhibitors, enquiring about either arranging one-off screenings of the anthology or showing the shorts before their features. This generally fed into their aims of developing audiences for and increasing access to a diversity of film content for local independent filmgoing communities. We also liaised with a few science-focused events such as science festivals, either through open calls or following contact with us, about integrating the films into their programme in some way.
Table 1 details all the events which featured SSFX film screenings, where these have been grouped by initiative, since in several cases multiple screenings of the same or different films occurred. There was a large overrepresentation of UK-based events (68±10 %) compared to all film festivals globally (8 %, ), as listed in Film Freeway (2019). This was in part due to funding usage restrictions limiting which festivals could be applied for; however, we also note that many film festivals aim to highlight the works of filmmakers from their own country.
Events have been classified as either art, art–science or science, with the distribution of event types shown in Fig. 5. Art events denote those with no clear association with science whatsoever; science events indicate those with no explicit link to art; and art–science is used to describe events with a stated connection between the two subjects. There were substantially more art events than science ones (p=0.012, αBonf=0.017), which constituted the only significant difference between SSFX event types. Excluding science events, art–science (41±11 %) was overrepresented compared to all film festivals globally that contain some mention of space or science (11 %, ). Both of these results reflect some of the struggles faced in the second phase of the SSFX project – science event programmers were largely uninterested in art–science, since their audiences are already highly engaged with science and not necessarily with art, whereas many film event programmers we approached struggled to understand the concept of the project, thinking the films were aimed at science audiences rather than being open to judge them as films in their own right that happen to contain a scientific connection (i.e. their preconception was Type VI of Malina, 2010, rather than Type V).
Figure 5 demonstrates that screenings predominantly occurred as part of pre-existing events rather than as bespoke ones (), indicating SSFX was largely successful at infiltrating science into the film world, and there was a fairly even split in events arranged by filmmakers and scientists. We note that filmmakers were more successful at infiltrating art events (71±14 % of all their events) than the scientist ones (29±15 %), though this difference was not strictly statistically significant when accounting for multiple comparisons (p=0.021, αBonf=0.017). Primarily it was an individual short film or subset of the collection of shorts which was exhibited at events rather than the full anthology film (), which we struggled to convince film programmers to incorporate into events despite advice from film industry collaborators that this might be an attractive proposition. Of the individual shorts Astroturf was the most successful, though the only statistically significant differences (αBonf=0.0024) in the number of distinct events and initiatives by film were between Astroturf and both Names and Numbers () and Saturation (). We note that neither of these latter two films' festival submission fees were funded by the project, and in the case of Saturation a number of exhibitors expressed that they could not screen it at their family-friendly events due to the potentially upsetting medical imagery (edited clips from Noise removing the strong language and drug usage were however able to be used). In terms of the total number of screenings, Astroturf had significantly more than all the other shorts, though this was purely due to being selected for the touring SCINEMA International Science Film Festival (and associated community screenings) across Australia.
Film festival acceptance rates are typically ∼5 % (Stephen Follows, 2013b), with the largest festivals being ≲1 % (Sponring and Puskás, 2018). While we do not have concrete numbers on exactly how many festivals the filmmakers submitted to, given the budget and average submission cost for short films (Stephen Follows, 2013a), we estimate around 30 total submissions. This means that the 17 festival successes constitutes an impressive acceptance rate across the shorts of 57±11 %, significantly higher than expected. This perhaps reflects the quality of the art–science films that resulted from the project. We also note that given that the filmmakers were submitting their shorts to festivals independently and that all found success, this lends confidence beyond just an individual case study that this model of infiltrating science into cultural events can indeed work.
We generally relied on the event organisers to attract audiences, since they have built-in audience bases from their previous activities. Given that we were largely infiltrating existing events, this limited the evaluations that could be implemented, especially as at many events (especially the international ones) no filmmakers or scientists from the project were physically present. Therefore, evaluation data were typically collected only at bespoke SSFX events, and several methods were employed: a ball and bin question upon arrival assessing prior knowledge, graffiti walls at post-film receptions assessing their motivations and takeaways, and an online survey 3 weeks later for those who left contact details. Filming by a third party at the SSFX Short Film Festival (event ab) captured additional qualitative data. Given that these events where evaluation was possible tended to show all the shorts (either individually or via the anthology), we are unable to comment on whether certain SSFX films were more impactful on attendees than others.
As part of a recent public dialogue, 3KQ and Collingwood Environmental Planning (2015) found in a survey of 1010 people representative of the UK adult population (by gender, age, social grade, education, dependants, geographic region and human settlement type) that 48±2 % have never heard of space weather before. We therefore asked audiences upon arrival at events whether they had heard of space weather before, via a ball and bin method where attendees were instructed to put a ball in either the “yes” or “no” bin. The results from the individual events where we asked this question are displayed as the light-blue bars in Fig. 6, indicating levels greater than in the public dialogue (orange). Combining the data from all these SSFX events gives an overall result (dark blue) of 76±5 %, which constitutes 2.95±0.20 times more likely (the odds ratio) to have never heard of space weather than the general population (). Therefore an atypical audience was attracted to these events in terms of prior knowledge. Note that these results came exclusively from art–science events, and arguably one might expect an even greater overall proportion of people to be unaware of the field at the art events that SSFX infiltrated.
Another way we assessed whether the project attracted new audiences was by asking what motivated them to attend. At two art–science events (ab and ac) this was collected via open-ended graffiti walls, where nine responses were recorded, which can be found in Appendix B. Through thematic analysis (Braun and Clarke, 2006) it was possible to group all of these as being due to an interest in science (e.g. “love science”), film (e.g. “I like weird films.”) or specifically the project (e.g. “interesting concept”), where the quotes displayed serve as representative illustrative examples from different respondents. Follow-up online surveys after several events (f, h, aa, ab and ac) specifically asked in a closed question whether attendees had been attracted due to regular attendance at science events or film events or if it was specifically this event that had interested them. They could select as many options as were applicable. Given this yielded only 12 responses, we opt to combine the data from both methods, omitting event aa, since out of those events surveyed it was the only science event as well as the only pre-existing one. The overall results are shown in Fig. 7. Repeating the same analysis as with filmmakers' motivations revealed that significantly more people attended due to being filmgoers or specifically being interested in the project (F∪P) at 78±12 % compared to attending science events often (S) at 33±13 % (p=0.0023, αBonf=0.0083). This therefore provides further evidence that SSFX was able to attract substantial non-science audiences, placing it as comparable to some of the most successful art–science events across different art forms at reaching new audiences (cf. Brook, 2017). Again we note that since this analysis pertained only to art–science events, it is highly likely at the art events SSFX infiltrated that even fewer people would have exhibited science interests given the complete lack of a science connection at these events and the existing research into the motivations behind film festival attendance (Báez and Devesa, 2014).
We assessed the learning outcomes of attendees through the follow-up surveys, asking in open questions if they recalled the event's theme and why this topic is studied or important. The full list of responses is given in Appendix B. As shown in Fig. 8, the majority (83±14 %, p=0.039) correctly recalled that the event concerned the sounds of space or provided more specific answers. Interestingly most (67±17 %) thought this area was important due to the inherent value of science or intellectual curiosity (e.g. “It helps us to understand the universe, physics, and gives us a clearer idea of the world around us.”) rather than citing space weather (25±16 %), though this majority was not statistically significant and neither were the differences between responses. As far as we are aware there is little published research into the recollection of the themes and key messages of public-engagement events by attendees in follow-up surveys. However, in comparison with studies into the recollection of television campaigns (e.g. Berry et al., 2009; Potter et al., 2019) and the so-called Memory Chain Model (Murre and Dros, 2015) suggests that the fraction quoting space weather would be deemed successful, while the recollection of the event's overall theme would be considered extremely high. Also, given the atypical non-science audience, the fact that many attendees took away from the event the value of fundamental scientific research was an unanticipated but very welcome impact.
In terms of the impact on attendees, at two art–science events (ab and ac) we asked via graffiti wall what (if anything) they had gained or taken away from the event. Most of the 16 responses, displayed in full in Appendix B with representative examples from different respondents shown here, could be broadly categorised using grounded theory (Silverman, 2010; Robson, 2011) as concerning the science (e.g. “amazing space sounds I want to learn more about”), perception of sound (e.g. “people hear differently”) or art or film (e.g. “grown an interest in filmmaking”), with the proportions of each shown in Fig. 8 demonstrating a near-even split between the three. Other miscellaneous takeaways included aspects of science communication, humanity and specific (non-science) themes raised in the films. Furthermore, at the SSFX Short Film Festival (event ab) a selection of people were interviewed during the reception by a third party, with some of the responses available at https://www.youtube.com/watch?v=sPa7avaksFI (last access: 30 January 2020). The most common point that emerged (again analysed using grounded theory) was that attendees really enjoyed the broad range of interpretations of the same space sounds which were expressed in the different films. Others commented on how the concept of the festival was an interesting approach to bringing scientific ideas to a wider audience, that they had learned about and gained an interest in the science behind the sounds, and that it attracted a diverse group of people with a lot of interaction particularly in the reception. On this latter point, it was anecdotally noted at most of the events that the diversity of audiences by gender and ethnicity appeared much greater than compared to typical physics engagement events, though this was not captured quantitatively. Respondents in the follow-up survey also noted other takeaways from attending which we again have coded using grounded theory and provide illustrative example responses from different participants here: enjoying or being inspired by the event (e.g. “Really enjoyed the enthusiasm of the speaker and the topic of the films mixed with science”), the creativity or diversity of films (e.g. “how each filmmaker found the humanity in sounds from space”), meeting and hearing from both scientists and filmmakers (e.g. “It was interesting to meet some of the people involved in both the science and filmmaking.”), and the importance or relevance of the scientific research (e.g. “Genuine and relevant science research and knowledge is vital and underused in the film industry”). Of the responses which did not fit into any of these themes, one person said that they had developed an interest in art events by attending (“I will definitely look at the [arts venue] Rich Mix website more for future events.”), while another found the anthology film to be “very strange”, which may or may not be a good thing. One respondent wrote in detail on their thoughts of the virtues of this type of art–science collaboration:
Taking raw data out of context and using it as a key creative element in the creation of art is a way of providing a fresh look at a scientific inquiry. Art can be a mirror whose reflection can reset context and provide the listener with a different perspective than might otherwise be encountered. The result of this competition has been a number of submissions that stimulate a wider audience to think about how science is more than just the collection of raw data and that understanding can come from looking at results from a new vantage.
We note that despite the somewhat-limited evaluation data, it does not appear that the impacts from events which exhibited the short films (with their prologue or epilogue text concerning the science) are significantly different from those of the anthology film (which contained substantial additional messaging through the bridging film). The overall results highlight that there were many unforeseen impacts on attendees outside of simply raising awareness of the research area to atypical audiences.
The SSFX (Space Sound Effects) Short Film Festival was an art–science collaboration project aimed at infiltrating space science into culture through the medium of film. In particular it invited the usage of sonified satellite data of plasma waves in Earth's magnetosphere, a key component within space weather, as key creative elements.
The first audience the project aimed to engage with independent filmmakers through challenging them to use these space sounds to create short films. Through partnership with film industry experts and organisations, an international film festival was run, adopting many of the standard practises within the sector to lend authenticity and legitimacy to the project. A formative evaluation of people who registered interest with the project during the submission revealed that we successfully hooked the filmmaking community, though most who engaged also had a general interest in science. Seven very different films were selected for screening. Feedback from these filmmakers highlighted that they relished the creative freedom afforded to them in interpreting the sounds and their usage within their works; hence very open criteria are not only enticing to filmmakers but also enable a broad range of artworks to be produced. Another important aspect of the project was the support of the filmmakers and the championing of their films after the initial festival, which had the mutual benefit of raising the profile of the filmmakers whilst also sharing the underlying science more widely.
The second audience was film programmers and exhibitors in trying to infiltrate the produced short films into existing events. While an anthology film packaging all the shorts together through a science-based narrative was produced, we struggled to get this shown and found much greater success with the individual short films. Filmmakers were best placed to submit their own works to film festivals following the standard method, with monetary support from the scientists, as they have a better idea of which festivals would be most appropriate. However, scientists were still able to play a role in representing the full suite of shorts for consideration at other sorts of film events. Both of these approaches led to SSFX infiltrating more art events than science ones, as desired, though a substantial number of art–science events also occurred.
The project ultimately also aimed to raise awareness of the science to atypical audiences through the use of the films. While audience evaluation proved challenging due to SSFX films typically sitting within larger events organised by others, some evaluation was able to be done at mostly bespoke art–science events. This highlighted that attendees were much less aware of the topic of space weather than the general public and were much more likely to have attended due to an existing interest in film or specifically the concept of SSFX rather than having an existing science interest. This placed the project as comparable to some of the most successful art–science events across different art forms at reaching new audiences. Many different, and often unanticipated, impacts were had on attendees beyond simply learning about the science, which demonstrates the versatility of film as a form of art at provoking varied responses in audiences.
We therefore advocate that adopting a film festival model can result in creative art–science that fits within the many film-based cultural events around the world. This enables the power of cinema to be leveraged on audiences that do not normally engage with science, thus providing potential means of breaking beyond the scientific “echo chamber” in portraying the importance and relevance of scientific research.
Several statistical methods are used throughout this paper which are detailed here.
All uncertainties quoted or displayed, e.g. through error bars, represent standard (i.e. 68 %) intervals. Proportions and probabilities are determined through the Clopper and Pearson (1934) method, a conservative estimate based on the exact expression for the binomial distribution and therefore represent the expected variance due to counting statistics only and not any other potential sources.
Several statistical hypothesis tests are used with effect sizes and two-tailed p values being quoted. Throughout the desired significance level α is set as 0.05; though in the case of multiple comparisons we use the Bonferroni correction where the significance level per comparison is for N total possible comparisons. Two-tailed binomial tests are used to compare proportions of both independent and correlated (i.e. within the same) samples.
Finally, the agreement between judge scores is quantified using the alpha coefficient of Krippendorff (1970, 2018), which is computed as unity minus the ratio of the observed disagreement to that expected by chance, i.e.
where ock values are the observed frequencies in a coincidence matrix, nc values are the column totals in this matrix, n is sum of the entire matrix and δck is a metric function for which we use the one applicable to ordinal data. The interpretation of this coefficient is that a value of 1 indicates perfect agreement between judges, 0 would result from randomly drawn scores, and a negative value is possible when disagreements are systematic and exceed what can be expected by chance.
Here we tabulate the various qualitative data captured from audiences at events, where each row contains responses from a single unique participant. The qualitative data were coded and analysed by the author using thematic analysis (Braun and Clarke, 2006); however, no a priori codes were generated, instead allowing these to naturally emerge from the data via a grounded-theory approach (Silverman, 2010; Robson, 2011). The final themes determined by this method and their association to the raw qualitative data are also listed in the following tables.
Firstly, the responses from researchers and public-engagement professionals to open questions through an interactive online survey during an art–science session at the 2019 Interact symposium (Archer et al., 2019) are shown in Table B1.
Table B2 displays the responses from audiences captured on a graffiti wall concerning what attracted them to SSFX art–science events.
A similar graffiti wall also asked audiences what they felt that they had gained from attending these events (see Table B3).
Finally, the results from an online survey three weeks following various SSFX events are shown in Table B4.
Data supporting the findings of this study are contained within the article or derived from listed public-domain resources.
MOA conceived the project and its evaluation, performed the analysis, and wrote the paper.
The author declares that there is no conflict of interest.
This article is part of the special issue “Five years of Earth sciences and art at the EGU (2015–2019)”. It is not associated with a conference.
We thank the SSFX Short Film Festival judges Laura Adams, David Berman, Ed Prosser and Jake Roper; the selected filmmakers Adam Azmy, Victor Galvão, Nidhi Gupta, Aaron Howell, Ali Jennings, Simon Rattigan, Jesseca Ynez Simmons and James Uren; and all the film industry experts and exhibitors that helped us share this work with audiences.
This public-engagement project and research have been supported by the Science and Technology Facilities Council (grant no. ST/R001456/1), Queen Mary University of London (Public Engagement Large Grant 2016) and the European Geosciences Union (Public Engagement Grant 2017).
This paper was edited by Antonio Menghini and reviewed by Antonio Menghini and one anonymous referee.
3KQ and Collingwood Environmental Planning: Space weather public dialogue, Tech. rep., Sciencewise, Science and Technology Facilities Council, RAL Space, Natural Environment Research Council, National Grid, Lloyd's of London, available at: https://www.ralspace.stfc.ac.uk/Pages/SWPDFinalReportWEB.pdf (last access: 30 January 2020), 2015. a, b, c
Archer, M. O.: What does empty space sound like? We need your help to find out, The Conversation, available at: https://theconversation.com/what-does-empty-space-sound-like-we-need-your-help-to-find-out-69252 (last access: 30 January 2020), 2016. a
Archer, M. O., Hartinger, M. D., Redmon, R., Angelopoulos, V., Walsh, B. M., and Eltham Hill School Year 12 Physics students: First results from sonification and exploratory citizen science of magnetospheric ULF waves: Long-lasting decreasing-frequency poloidal field line resonances following geomagnetic storms, Space Weather, 16, 1753–1769, https://doi.org/10.1029/2018SW001988, 2018. a, b, c
Archer, M. O., Tedaldi, S., and Boast, K. E.: Embedding science in the art world, Session at Interact 2019 Symposium, University of Central Lancashire, Preston, UK, 2019. a, b
Archibald, D. and Miller, M.: The Film Festivals dossier: Introduction, Screen, 52, 249–252, https://doi.org/10.1093/screen/hjr013, 2011. a
Báez, A. and Devesa, M.: Segmenting and profiling attendees of a film festival, Int. J. Event Festiv. Manag., 5, 96–115, https://doi.org/10.1108/IJEFM-08-2013-0021, 2014. a, b
Berry, T. R., Spence, J. C., Plotnikoff, R. C., Bauman, A., McCargar, L., Witcher, C., Clark, M., and Stolp, S.: A mixed methods evaluation of televised health promotion advertisements targeted at older adults, Eval. Program Plann., 32, 278–288, https://doi.org/10.1016/j.evalprogplan.2009.05.001, 2009. a
BFI: Film education and industry employment, Tech. rep., British Film Institute, available at: https://www.bfi.org.uk/sites/bfi.org.uk/files/downloads/bfi-film-education-and-industry-employment-2019-11-05.pdf (last access: 30 January 2020), 2019. a
Braun, V. and Clarke, V.: Using thematic analysis in psychology, Qual. Res. Psychol., 3, 77–101, https://doi.org/10.1191/1478088706qp063oa, 2006. a, b
Brook, L.: Exposing an Art Audience to Science: Art and Space Exhibition Case Study, Junctures, 18, available at: https://junctures.org/index.php/junctures/article/view/274/524 (last access: 30 January 2020), 2017. a, b
Cannon, P., Angling, M., Barclay, L., amd C. Dyer, C. C., Edwards, R., Greene, G., Hapgood, M., Horne, R., Jackson, D., Mitchell, C., Owen, J., Richards, A., Rogers, C., Ryden, K., Saunders, S., Sweeting, M., Tanner, R., Thomson, A., and Underwood, C.: Extreme space weather, Tech. rep., Royal Academy of Engineering, available at: http://www.raeng.org.uk/spaceweather (last access: 30 January 2020), 2013. a
CineGlobe: CineGlobe Film Festival at CERN, available at: http://cineglobe.ch/ (last access: 30 January 2020), 2019. a
Clopper, C. and Pearson, E. S.: The use of confidence or fiducial limits illustrated in the case of the binomial, Biometrika, 26, 404–413, https://doi.org/10.1093/biomet/26.4.404, 1934. a
DCP-o-matic: available at: https://dcpomatic.com/ (last access: 30 January 2020), 2019. a
de Valck, M. and Loist, S.: Film Festival Yearbook 1: The Festival Circuit, St Andrews Film Studies (with College Gate Press), St. Andrews, 2009. a
European Academy of Science Film: available at: https://www.eurasf.com/ (last access: 30 January 2020), 2019. a
Film Festival Research Network: Film Festival Research, available at: http://www.filmfestivalresearch.org/ (last access: 30 January 2020), 2019. a
Film Freeway: available at: http://www.filmfreeway.com (last access: 30 January 2020), 2019. a, b
Heberle, H., Meirelles, G. V., da Silva, F. R., Telles, G. P., and Minghim, R.: InteractiVenn: a web-based tool for the analysis of sets through Venn diagrams, BMC Bioinformatics, 16, 169, https://doi.org/10.1186/s12859-015-0611-3, 2015. a
Hoare, P.: Cetology: How science inspired Moby-Dick, Nature, 493, 160–161, https://doi.org/10.1038/493160a, 2013. a
Imagine Science Films: available at: http://imaginesciencefilms.org/ (last access:30 January 2020), 2019. a
Keiling, A., Lee, D.-H., and Nakariakov, V. (Eds.): Low-Frequency Waves in Space Plasmas, Geophysical Monograph Series, American Geophysical Union, Washington DC, USA, https://doi.org/10.1002/9781119055006, 2016. a
Kim, S.: Art, Science and the Public: Focusing on Science as a Resource for Creative Art, in: EKC 2010, edited by: Han, M. W. and Lee, J., Vol. 138 of Springer Proceedings in Physics, Springer, Berlin, Heidelberg, https://doi.org/10.1007/978-3-642-17913-6_6, 2011. a
Krippendorff, K.: Estimating the reliability, systematic error, and random error of interval data, Educ. Psychol. Meas., 61–70, https://doi.org/10.1177/001316447003000105, 1970. a, b
Krippendorff, K.: Content Analysis An Introduction to its Methodology, 4th Edn., Sage Publications, Inc., Newbury Park, California, USA, 2018. a, b
Lynch, E.: Superposition: Evaluation of 2013 pilot project for the Institute of Physics, Tech. rep., Institute of Physics, available at: https://www.iop.org/activity/outreach/activity/file_62357.pdf (last access: 30 January 2020), 2013. a
Malina, R.: What are the different types of art science collaboration, available at: http://malina.diatrope.com/2010/08/29/what-are-the-different-types-of-art-science-collaboration/ (last access: 30 January 2020), 2010. a, b, c, d, e
Malina, R. F., Topete, A. G., Silveira, J., and Sead Steering Group: What Is the Evidence That Art-Science-Technology Collaboration Is a Good Thing?, Leonardo, 51, 2, https://doi.org/10.1162/LEON_e_01555, 2018. a
Meetup: available at: https://www.meetup.com/ (last access: 30 January 2020), 2019. a
Mirocha, P., Magrane, E., Terkanian, B., Soria, M., Coleman, D. L., Milstead, M., and Koopman, K.: The Tumamoc Hill Arts Initiative: A Portfolio of Site-Based Art and Writing Inspired by a History of Sonoran Desert Science, J. Southwest, 57, 265–303, 2015. a
Murre, J. M. J. and Dros, J.: Replication and Analysis of Ebbinghaus' Forgetting Curve, PLOS One, 10, e0120644, https://doi.org/10.1371/journal.pone.0120644, 2015. a
NOAA: Sounds of a Solar Storm, available at: https://www.ncei.noaa.gov/news/sounds-solar-storm (last access: 30 January 2020), 2018. a
Nowell-Smith, G.: The history of cinema: a very short introduction, Oxford University Press, Oxford, UK, https://doi.org/10.1093/actrade/9780198701774.001.0001, 2017. a
Orfescu, C.: Biologically-Inspired Computing for the Arts: Scientific Data through Graphics, chap. NanoArt: Nanotechnology and Art, IGI Global, Hershey, Pennsylvania, USA, https://doi.org/10.4018/978-1-4666-0942-6.ch008, 2012. a
Potter, A., Jardine, A., Morrissey, A., and Lindsay, M. D. A.: Evaluation of a Health Communication Campaign to Improve Mosquito Awareness and Prevention Practices in Western Australia, Frontiers in Public Health, 7, 54, https://doi.org/10.3389/fpubh.2019.00054, 2019. a
Robson, C.: Real World Research, John Wiley and Sons Ltd., Hoboken, New Jersey, USA, 2011. a, b
Schmidt, M., Meyer, A., and Cserer, A.: The Bio:Fiction film festival: Sensing how a debate about synthetic biology might evolve, Public Underst. Sci., 24, 619–635, https://doi.org/10.1177/0963662513503772, 2015. a
Shooting People: available at: https://shootingpeople.org/ (last access: 30 January 2020), 2019. a
Silverman, D.: Doing Qualitative Research: A Practical Handbook, Sage Publications Ltd Thousand Oaks, California, USA, 2010. a, b
Sponring, A. and Puskás, L.: How much budget do I need for a festival run?, Festival Whizz, available at: https://www.festivalwhizz.com/how-much-budget-do-i-need-for-a-festival-run/ (last access: 30 January 2020), 2018. a
SSFX: Space Sound Effects, available at: http://ssfx.qmul.ac.uk (last access: 30 January 2020), 2019. a
Stephen Follows: The economics of film festivals, available at: https://stephenfollows.com/the-economics-of-film-festivals/ (last access: 30 January 2020), 2013a. a
Stephen Follows: What film festival directors really think, available at: https://stephenfollows.com/what-film-festival-directors-really-think/ (last access: 30 January 2020), 2013b. a
von Roten, F. C. and Moeschler, O.: Is art a “good” mediator in a science festival?, J. Sci. Commun., 6, 9 pp., https://doi.org/10.22323/2.06030202, 2007. a
Voss-Andreae, J.: Quantum Sculpture: Art Inspired by the Deeper Nature of Reality, Leonardo, 44, 14–20, https://doi.org/10.1162/LEON_a_00088, 2011. a