Physics in schools is distinctly different from, and struggles to
capture the excitement of, university research-level work. Initiatives
where students engage in independent research linked to cutting-edge
physics within their school over several months might help mitigate
this, potentially facilitating the uptake of science in higher education.
However, how such initiatives are best supported remains unclear and
understudied. This paper evaluates a provision framework, Physics Research in School Environments (PRiSE), using survey data from participating
14–18-year-old students and their teachers to understand their experience of the programme. The results show that PRiSE appears to provide much
more positive experiences than typical university outreach initiatives
due to the nature of the opportunities afforded over several months,
which schools would not be able to provide without external input.
The intensive support offered is deemed necessary, with all elements
appearing equally important. Based on additional feedback from independent
researchers and engagement professionals, we also suggest the framework
could be adopted at other institutions and applied to their own areas
of scientific research, something which has already started to occur.
Introduction
Research, policy, and practice all agree that participation in science,
technology, engineering and mathematics (STEM) needs to be increased and widened e.g., with these issues being particularly
acute for the subject of physics e.g..
Physics as a field has become within society strongly aligned with
intelligence/cleverness, masculinity and whiteness, all of which can
dissuade school students (even those highly enthusiastic about the subject) from pursuing it further and thereby showing inequitable
effects on those from under-represented backgrounds .
Some of these issues arise from practices in school-level physics
education. Debarring and gatekeeping of physics based on attainment
(disproportionately so compared to other subjects) simply feeds the
alignment of physics with cleverness and can make even high-attaining
students' confidence in the subject precarious. Teachers and the school
environment often (even unconsciously) reinforce stereotypes about
physics and physicists that are patterned by biases. Curriculum practices
in physics often teach oversimplifications at younger ages which are
later completely reconceptualised without being presented as refinements
to a model, making students perceive the simpler versions as “lies”.
Furthermore the general deferment of “interesting” physics in
the curriculum produces a disconnect between “school physics”
and “real physics”, i.e. the cutting-edge research undertaken
by professional physicists, making continued participation in physics
education something of a “test of endurance”. These concerns are
further reflected in results from national surveys. While 20 %
of 16–18-year-old physics school students in the UK aspire towards a physics degree and 80 % aspire towards STEM more broadly ,
only 9.7 % and 59.3 % actually go on to study either physics
or STEM respectively . These constitute odds ratios
for aspirations vs. destinations of 2.3 and 2.7, both of which are
considerable. All of these issues raised cultivate and contribute
to reproducing inequitable, and low overall, patterns of participation
within physics .
suggest that for STEM subjects in general an
intervention approach that sustains and supports science identity
is most appropriate for students in late secondary/high-school education in the context of their educational journey. However, in the case
of physics specifically, comment that existing interventions
based on simply enthusing, inspiring and informing students about
physics will not significantly change uptake or diversity in post-compulsory
physics. While they advocate for widespread changes in science education
policy and practice, both at school and university levels, they note
that if interventions are also used they need to fundamentally address
the problematic processes and practices present within both physics
teaching and physics as a field generally.
The stark differences between school, university, and professional
science practices have long been noted – while research is one
of the main activities of professional scientists, it is quite removed
from how science is taught in schools, with some arguing that science education is not “authentic” in this respect e.g..
Indeed, report that school students are largely
unaware of what research actually is, finding a disconnection between
“research as information gathering”
and the “research question”, and in general
have little opportunity to set their own research questions within
their school environment. Independent research projects, which provide
extended opportunities for students to lead and tackle open-ended
scientific investigations (not simply literature reviews or essays,
e.g. ), may be one way of exposing students
to “real science”. These align with established international
pedagogical initiatives such as “inquiry-based science”
e.g., “problem-based learning”
e.g., and “authentic science” e.g.. A survey of such projects across 12
countries (Australia, Ireland, Israel, Netherlands, New Zealand, Qatar,
Singapore, Spain, Taiwan, Turkey, UK, and USA), however, found them
to be rare globally and only sometimes supported by mentors from university/industry
. This review found considerable variability
in the nature of independent research projects, such as their focus, delivery/provision models, external support, and funding/costs. It
was noted that such programmes place demands on time and money beyond
standard provisions for all stakeholders, on the skills required by
teachers and other adults involved, and on the supporting infrastructure.
For successful projects recommend that students
should be given the freedom to devise a research question, have ownership
over their own data analysis and decision-making, and be given access
to experts in their project work. Broadly there are two distinct formats
of independent research projects.
Those associated with dedicated out-of-school events of only a few
weeks' duration such as internships/apprenticeships (e.g. Nuffield Research Placements in the UK, ; Raising Interest in Science and Engineering in the USA, ), summer
schools/camps (e.g. the International Astronomical Youth Camp run across Europe and parts of Africa, ), or science
competitions/fairs (particularly prevalent in the USA, e.g. ).
Those undertaken within school itself over the course of several months
to a year, either in class or supplemented with time in after-school
clubs (e.g. an after-school mechatronics project in Taiwan, , class-based biology project in Singapore, , or various CarboSchools climate change projects between research institutes
and schools across seven European countries, ).
We do not discuss the former here as they are necessarily limited
in reach, catering only to heavily bought-in individuals (i.e. typically
one to three students; ) from any given school. Most independent research projects based within schools are not linked to current cutting-edge
and novel scientific research topics or questions. However, relatively
recently so-called “research in schools” projects have emerged, which
do provide students with experiences of genuine contemporary STEM
research within their own school environment over several months.
While several citizen science projects have also run within schools
and aim to help participants learn about current science and to experience
the scientific research process, these are typically secondary aims
since they primarily concern a single (or small number) of well-defined
science questions which will be assisted through developed citizen
science protocols . This contrasts
with independent research projects and thus also “research in schools”, where positively affecting the participants is the primary concern
and the projects are necessarily open-ended. Nonetheless, the different
approaches can have some overlap, and indeed some projects denoted as citizen science, such as the “curriculum-based” projects based
in the USA described by , might perhaps be better
framed as “research in schools”. “Research in schools” programmes appear at present to be most prevalent in the UK, and we are aware
of three featuring projects in the physical sciences (outside of that
at Queen Mary University of London, QMUL, which forms the subject
of this paper).
HiSPARC (High School Project on Astrophysics Research with Cosmics)
is a scintillator–photomultiplier cosmic ray detector project originating in the Netherlands at Radboud University in 2004, which has subsequently
been adopted by other Dutch (Amsterdam, Eindhoven, Groningen, Leiden,
Nikhef, Twente, Utrecht) as well as UK (Bath, Bristol, Birmingham,
Sussex) and Danish (Aarhus) universities .
Many of these universities operate a tiered membership scheme for
schools: “Gold” enables schools to buy their own detector (GBP 5,500
in the UK); “Silver” is a detector rental scheme (GBP 300
p.a. plus an installation fee) with the contract specifying if they
do not participate the detector will be collected with an additional
fee; and “Bronze” membership (GBP 200 p.a.) gives schools
access to HiSPARC data but not their own detector. Schools signing
up for “Silver” or “Bronze” membership are contractually obliged to
generate funding to upgrade to “Gold”. While the “Gold” membership
fee covers the costs of the detector and installation, the other memberships
are to ensure that schools make a commitment to working with the university
Jaap Velthuis and Maria Pavlidou, personal communication, 2016;.
It is not possible to compare how these schools go about project work
and how much support they are given by participating universities,
which may vary by institution, as at the time of writing HiSPARC has
not published any reviews of their processes or evaluation.
IRIS (Institute for Research in Schools) is a UK charity formally
launched in March 2016 , building on the previous CERN@School
project conceived in 2007 . While IRIS' projects cover all the sciences, current physics projects include
the aforementioned CERN@School, Higgs Hunters , LUCID
, and Webb Cosmic Mining (in preparation
for the James Webb Space Telescope). They have rapidly expanded across
the UK since formation, having worked in some capacity with over 230
schools as of 2020. Publications have provided technical details of
their projects and case studies of some students' successes within
them, including a few examples of resulting peer-reviewed scientific
work; however, the exact provision/delivery model implemented and precisely how project work is supported are not fully explored in the available
literature. IRIS aims to develop “teacher scientists”, teachers that
identify as both science teachers and research-active scientists ,
which suggests a teacher-driven model. While some researchers/academics
have designed or consulted on some IRIS projects, they appear in general
to have little involvement in supporting students or teachers (Oliver Moore, personal communication, 2020), with IRIS itself being the main point
of contact for schools. With a recent change of staff at IRIS in late
2019 has come a reformulation of how they classify their projects.
“Seed” projects are for new schools, are the most straightforward,
and receive the most support from IRIS, though it is not clear what form that takes. “Sprout” projects are more advanced, seeing students carrying out more complex activity to assist scientists with their research questions, though how this collaboration operates is not specified. “Grow” projects are where students have proposed their
own research questions, either independently or using IRIS resources,
with IRIS merely providing advice in producing posters, talks, or
papers as well as opportunities to present.
ORBYTS (Original Research By Young Twinkle Scientists), based at University
College London, was piloted from January 2016 and is nominally based
around the Twinkle mission but has expanded into other research areas since . A select group of students
(with an imposed limit of four to six) from each school undertakes fortnightly meetings with early career researchers (either PhD students or post-docs)
throughout their project aiming to achieve, where possible, publishable
scientific results . Teachers,
while present, are not typically actively involved in these sessions, and students tend to do little independent work outside of the sessions
(William Dunn, personal communication, 2018). The content of the projects
changes each year to align with the researchers' current focus, with them typically working with only one school per year each. PhD researchers
are paid for their (preparation, travel, and session) time with funds
from independent schools, who pay not only for their school, but also for enabling an additional school from a lower socio-economic background
to take part.
It is clear that there is currently a lack of published details and
evaluation on provision within the emerging area of “research in schools”.
This paper therefore explores these aspects applied specifically to
the “research in schools” programme of QMUL's School of Physics and Astronomy. This was piloted between 2014 and 2016, as detailed in , and is now known as Physics Research in School Environments .
Section introduces PRiSE's framework,
which is then evaluated in Sect. in terms of
participating students' and teachers' experience. We also briefly
discuss how the PRiSE approach has been received by the university
sector in Sect. .
PRiSE framework
Physics Research in School Environments (PRiSE) is a collection of physics-based “research in schools” projects (see Table )
brought together under a coherent provision framework. The programme
aims to equip 14–18-year-old school students (particularly those from disadvantaged backgrounds) with the ability, confidence, and
skills to increase/sustain their aspirations towards physics or more
broadly STEM, ultimately enabling them to realise these at higher
education and thus contributing to increased uptake and diversity
of physics and to some extent STEM cf.. Through working with teachers, PRiSE also aims to develop their professional
practice and build long-term university–school relationships that
raise the profile of science and mitigate biases/stereotypes associated
with physics within these schools, generally making them environments
which nurture and enhance all students' science capital cf..
Our rationale for these particular outcomes is left to the Supplement. This section summarises the PRiSE framework, discussing
the ethos of the programme and the roles played by the schools and university as well as outlining the various activity stages, interventions, and
resources which it consists of. In-depth practical details aimed at
practitioners looking to replicate the framework are given in the
Supplement.
A summary of the existing PRiSE projects at QMUL.
ProjectAbbreviationYearsFieldDescriptionScintillator Cosmic Ray Experiments into Atmospheric MuonsSCREAM2014–2020Cosmic raysScintillator–photomultiplier tube detector usageMagnetospheric Undulations Sonified Incorporating Citizen ScientistsMUSICS2015–2020Magnetospheric physicsListening to ultra-low frequency waves and analysing in audio softwarePlanet Hunting with PythonPHwP2016–2020Exoplanetary transitsLearning computer programming, applying this to NASA Kepler and TESS dataATLAS Open DataATLAS2017–2020Particle physicsInteracting through an online tool with LHC statistical data on particle collisionsApproach
PRiSE takes the “research in schools” approach to schools engagement,
whereby students are given the opportunity to lead and tackle open-ended
scientific investigations in areas of current research. Therefore,
the PRiSE projects were developed to transform current scientific
research methods, making them accessible and pertinent to school students
so that they could experience, explore, and undertake scientific research
themselves.
Ethical considerations
Since the programme intends to influence school students and teachers, a number of ethical considerations have been taken into account, following
the guidance for educational research, with regard
to safeguarding and to ensure that no harm results. Firstly, to ensure
equality of access to the programme, we do not charge schools to be involved cf. and try to provide
them with all the physical resources they need for their project,
thereby removing potential barriers to entry for less resourced schools.
Our targeting takes into account several school-level metrics (type
of school, students on free school meals, indices of multiple deprivation,
gender balance, etc.) to ensure diversity. We aim for the programme to be equitable with all schools being offered the same interventions/opportunities,
taking into account and being flexible to their specific needs where
necessary. We work with as many schools as we have capacity to do
so each year and do not withhold interventions from any students for the purpose of having control groups. The projects are optional and
presented as an opportunity that students can take advantage of which
will be supported by their teacher and the university; therefore, students are not pressured into being involved. Students and schools can drop
out at any point within the programme with no penalty, which does
occur in a minority of schools.
Role of teachers
The involvement of teachers at all stages is of paramount importance
in terms of delivery and safeguarding. They have helped shape the
design of the programme, inform how we update it each year, and serve
as our liaison to schools and the students involved. It is the teachers
that decide who projects are offered to within their school, with
us simply advising that the projects should be suitable for all A-Level
(16–18-year-old) students as well as high-ability GCSE (14–16-year-old) students (further contextual information on the UK education system is given in Appendix ). These recommendations
were made based on the basic background knowledge required to meaningfully
engage with the research. Invariably teachers choose to involve older
age groups, with 79±1 % of PRiSE students being aged 16–18
(and so far only one student below our recommended ages has been involved,
being 13–14). Unfortunately, we do not have any specific information
on exactly how teachers go about selecting students. However, the
average number of students per school each year is around 12, which
compared to the national average class size in A-Level physics of
16 indicates teachers involve a significant majority
(or in many cases the entirety) of their cohorts in PRiSE. We allow
teachers to determine how best to integrate the projects within their
school though provide advice on this. We also aim, through our resources and communications, to equip teachers to manage the day-to-day aspects
of the projects without overly burdening them – their role is chiefly
one of encouraging their students to persist, providing what advice
they can, and then communicating with the university.
Teachers' involvement at all stages also presents opportunities to
them for continuing professional development, helping them nurture
and cultivate STEM aspirations among students throughout their school
(i.e. not just PRiSE students). This is implemented informally and
integrated within the programme in the form of both bespoke resources
and ongoing dialogues between teachers and researchers. These are
aimed at enhancing teachers' knowledge about the underlying science and how they link to curriculum-based topics where appropriate, their
skills and confidence surrounding current research topics and methods,
and their pedagogy in mentoring independent project work.
Role of the university
It was recognised that teachers in general likely will not have the
skills or experience in research to manage projects without expert
assistance . Therefore, PRiSE was
designed to be supported by active researchers equipped with the necessary
expertise to draw upon in offering bespoke, tailored guidance to the
students and teachers. Well-defined roles within the university have
been established for each of the PRiSE projects to provide this support.
Outreach Officer. Manages the entire programme, including university–school relationships, communications, intervention/event
co-ordination, programme finances, and evaluation.
Project Lead. Visible figurehead for the project to schools,
typically an academic member of staff.
Researcher. Providing advice and guidance to students and
teachers throughout the programme. Can be delegated to or shared with
early career researchers.
Since the primary focus of PRiSE is (unlike typical citizen science)
on the participants rather than the research, researchers should not
consider students contributing to novel research to be their rationale for being involved. Our position is that it is rather unreasonable
to expect investigations that are motivated by school students themselves
(an established element of good practice in independent research projects,
e.g.) to be able to make meaningful contributions
to the physics research as a matter of course. We note that in some
exceptional cases PRiSE students' work has arrived at promising preliminary
results, though these have required significant follow-up work by
professional researchers to transform the results into publishable
research e.g. and thus should not be considered
the archetype. Instead, researchers are enticed by the possibility
of societal impact underpinned by their research. This is something
which is increasingly called upon from funders e.g.
and is notoriously difficult for areas of “blue skies” research such
as physics. Furthermore, significant contribution to a coordinated
departmental outreach programme can be used as criteria for academic
promotions cf.. Physics researchers though are
largely unmotivated in delivering curriculum content as part of their
engagement work, valuing instead aspects relating to their research
and role as a researcher . PRiSE thus also aligns
with this direction. Ultimately, researcher buy-in is vital to the
delivery of protracted research-based engagement programmes such as
PRiSE.
It is clear from Table that the topics and activities
of current PRiSE projects vary considerably. This suggests that a
wide range of fields and project ideas might be able to adopt the
PRiSE framework. How projects have been developed has also varied
(further explored in the Supplement), though we have adopted a pragmatic approach in taking advantage of opportunities (grant funding,
internships, etc.) and adapting existing materials where possible, since creating a project from scratch is a significant undertaking
far beyond what most academics (unfortunately) have the capacity to do cf..
Structure
PRiSE runs from the start of the UK academic year to just before the
spring/Easter break, which teachers had informed us during the pilot
stage is manageable and largely fits around exams/other activities
for most (but not necessarily all) schools .
The structure has evolved naturally from the pilot to that shown in
Fig. .
Graphic summarising the PRiSE framework including a timeline of the
different project activity stages (rectangles), interventions and
stakeholders' roles within them (rounded rectangles), and resources
provided (document shapes). Arrows indicate over what dates interventions
(identified by colour) typically occur.
Activity stages
Students work in research groups of typically five people and they
are advised to try and work on the project on average for 1–2 h
a week. The bulk of this is done outside of regular physics lessons,
though some schools integrate the projects within their timetabled
“science clubs” or required extra-curricular blocks, whereas other
teachers arrange a regular slot for students to work on the projects
or leave it up to the students to arrange (though this latter approach
often proves unsuccessful). PRiSE projects are split up into three
activity stages (see Fig. ).
Prescribed work. Given that independent research in STEM
is probably unfamiliar to the students, rather than expecting them
to be able to come up with their own avenues of investigation in an
unfamiliar research topic straight away, we instead give them an initial
prescribed stage of research.
Independent project. Groups are encouraged to set their own
research questions and undertake different projects in the topic area
when ready. This enables every group to explore something different
so that students gain a sense of independence and ownership of their
work.
Writing up. Near the end of the project students produce
either a scientific poster or talk to be presented at an annual conference.
Interventions
Several different interventions form the structure and support behind
the activity stages.
Assignment. The opportunity is advertised to schools via
existing teacher networks and teachers apply to participate in the
following academic year. Schools are assigned a project before the
summer break.
Kick-off. Typically on-campus event featuring an introductory
science talk, outline of how the project will work, and a hands-on
workshop.
Visit. Researchers visit schools to mentor students (and
their teachers) on their project work in a student-driven intervention.
Webinars. Drop-in online sessions similar to school visits
but allowing students and teachers to gain further support.
Ad hoc. Further asynchronous support via email as required.
Comments. Students are offered the opportunity to receive
comments on their draft slides or posters.
Conference. Students present the results of their projects
as oral or poster presentations at a special conference at the university,
attended by researchers as well as the students' teachers, peers,
and family.
Stakeholders' roles within these interventions are given in Fig. ,
with photos depicting some of them displayed in Fig. .
All stages of the programme and the processes involved are communicated
to teachers via email to pass on to their students.
Photos of various stages of the PRiSE framework: students participating
in an on-campus kick-off workshop (a), students interacting during the poster session at a conference (b), a group of
students display their prizes won at a conference along with their
teacher (c), and a group presents a talk at a conference (d).
Resources
To enable the students to take part in PRiSE, the students and teachers
are also provided with numerous resources. While some projects require
specific equipment, data and software, here we discuss more common
types of resources across the different projects as shown in Fig. .
Project poster/flyer. Given to teachers to help advertise
projects in their school.
Project guide. Each project has a student guide covering
an introduction to the research field, background physics/theory,
an explanation of the equipment/data, discussion of analysis techniques,
details of the initial prescribed activity, suggested research questions/methods for independent research, and links to other sources of
information. Teachers are provided with the same guide but with extra guidance.
Project webpage. These showcase anonymised examples of good-quality talks/posters that previous students have produced and provide any links or videos relevant to the project.
“How to” guide. General articles applicable to most research
projects, such as producing scientific talks and posters.
Scalability
PRiSE's framework attempts to find a balance between the (necessarily
competing) reach and significance of the interactions. For example,
an academic staff member acting as both project lead and researcher
within PRiSE can support four schools' participation (∼50 students), taking around 8 h over the course of 6 months (cf. Fig. ).
Using PhD students or post-docs in the researcher role(s) makes even
more efficient use of time. In contrast, under the ORBYTS model each
early career researcher can support only one school (four to six students) with 10 h of their time. As noted in the introduction, mentorship
from active researchers throughout does not appear prevalent in other
“research in schools” programmes at present.
Programmes of repeat interventions with schools will necessarily have a smaller reach than various one-off events. However, PRiSE's efficiency
in researcher time is reflected in its reach as shown in Table ,
demonstrating the model now serves around 30 schools per year having
reached a total of 67 schools and over 1300 students with the direct
involvement of 88 teachers as of 2020. We note that a minority of
schools do not complete the full programme and others do not return
for subsequent years; however, we do not provide a full analysis of the types of schools involved and their retention within the programme
in this paper. Comparing the number of schools to other physical science
“research in schools” projects/programmes, University of Oxford researchers have interacted directly with only 14 students from five schools through their Higgs Hunters IRIS project which commenced in 2016 (Oliver Moore,
personal communication, 2020, though we note information regarding other IRIS projects is not available), reports collaborating
with 17 schools since 2016, and discloses 140 schools since 2004 across their network of 13 Dutch, Danish, and UK universities
, i.e. around 11 per institution. Therefore, the reach through the PRiSE framework by a single university department is considerable
compared to the rest of the sector.
Number of schools, students, and teachers involved in PRiSE by academic year as the programme has grown.
Academic year 2014/20152015/20162016/20172017/20182018/20192019/2020Number per yearSchools1618292733Students20115163310311407Teachers1725293138Unique cumulative totalSchools1620395067Students201352986089191326Teachers1728446388Methods
To determine the perceived value of PRiSE's approach with its key
stakeholders, namely participating students and teachers as well as
those across the wider university sector, we have maintained regular
collection of evaluative data cf.and references therein
via various surveys which we detail here. These data underpin our understanding of PRiSE and have been collected securely to protect
all participants, in compliance with GDPR and in line with the
guidelines for educational research.
Instruments and participants
We gathered feedback from participating students and teachers via
paper questionnaires handed out at our student conferences each year.
The only exception to this was in 2020, where online forms were used
due to the COVID-19 pandemic causing that year's conference to be
postponed. The questionnaire method was chosen so as to gather data
from as wide a range of students and teachers as possible, respecting
the limited time/resources of all involved (both on the school and
university sides). For ethics considerations all feedback was anonymous,
with students and teachers only indicating their school (pseudonyms
are used here to protect anonymity) and which project they were involved
with. Students were not asked to provide details of any protected
characteristics (such as gender or race) or sensitive information
(such as socio-economic background). Both students and teachers were
informed via an ethics statement on the form that the information
was being collected for the purpose of evaluating and improving the
programme and that they could leave any question they felt uncomfortable
answering blank (this functionality was also implemented on the online
form for consistency).
The open and closed questions concerning participants' experience
of the programme, which varied slightly year to year, are given in Appendix . While we attempted to collect responses
from all participants in attendance, invariably only a fraction did
so, yielding results from 153 students and 45 teachers across 37 schools. A breakdown of the number of respondents and their schools per year
is given in Table , where the numbers of participants and schools in attendance at our conferences are also
indicated. We do not have reliable information on how many students,
teachers, and schools would have successfully completed the programme
in 2020 due to the COVID-19 disruption. Students and teachers did
not always answer all of the questions asked, and hence we indicate the number of responses for each question considered throughout. There
is no indication that the respondents differed in any substantive
way from the wider cohorts participating in the programme. While ideally
one would also gather feedback from schools which dropped out during
the year, a similar formal feedback process has not been viable bar
in a few cases where only the teachers responded.
Response rates to questionnaires at PRiSE student conferences.
Feedback from the university sector came from a session at the 2019
Interact symposium that presented the challenges to STEM outreach
practice highlighted by recent educational research and the need for deeper programmes of engagement with young people and then summarised
the PRiSE approach as one possible example .
Throughout this workshop an anonymous interactive online survey was
used for interactivity and to collect data presented in this paper.
The survey included both closed and open questions as listed in Appendix .
Attendees were fairly evenly split between UK university researchers
and engagement professionals (gauged in-person by attendees raising
their hands when asked), with 19 people participating in the survey
and only 7 not doing so. Participants were allocated a unique number
by the online survey itself, which did not distinguish between researchers
and engagement professionals.
Analysis
Both qualitative and quantitative approaches were utilised in data
analysis, as the open- and closed-ended questions present in the questionnaires produced different types of data.
For all quantitative data, standard (i.e. 68 %) confidence intervals
are presented throughout. For proportions/probabilities these are
determined through the method, a conservative estimate
based on the exact expression for the binomial distribution, and therefore
represent the expected variance due to counting statistics only. Several
statistical hypothesis tests are used with effect sizes and two-tailed
p values being quoted, with the required significance level being α=0.05. In general we opt to use nonparametric tests as these
are more conservative and suffer from fewer assumptions (e.g. normality,
interval scaling) than their parametric equivalents such as t tests . The Wilcoxon signed-rank test is used to compare single samples to a hypothetical value, testing whether
differences in the data are symmetric about zero in rank. When comparing
unpaired samples a Wilcoxon rank-sum test is used, which tests whether
one sample is stochastically greater than the other (often interpreted
as a difference in medians). Finally, for proportions we use a binomial
test, an exact test based on the binomial distribution of whether
a sample proportion is different from a hypothesised value . For ease of reference, further details about the quantitative analyses
are incorporated into the relevant sections of the findings.
Qualitative data were analysed using thematic analysis .
Instead of using a priori codes, the themes were allowed to emerge
naturally from the data using a grounded theory approach
as follows.
Familiarisation. Responses are read and initial thoughts noted.
Induction. Initial codes are generated based on review of the data.
Thematic review. Codes are used to generate themes and identify associated data.
Application. Codes are reviewed through application to the full data
set.
Analysis. Thematic overview of the data is confirmed, with examples
chosen from the data to highlight the themes.
Feedback from participants
In this section we use the feedback from participating students and
teachers to evaluate the provision offered within the PRiSE framework,
specifically assessing their experience and the level of support offered.
Experience
Firstly from 2016 onwards we asked both students (n=150) and teachers
(n=42) “Have you been happy with the research project overall?”, giving options on a five-point Likert scale, which we coded to the values 1–5. This scale and the results are displayed in Fig. ,
revealing that 91±3 % of students and 95±5 % of teachers
rated their experience as positive (scores of 4–5), with only three students giving a negative reaction (scores of 2). Teachers tended
to rank this question somewhat higher (their mean score was 4.50±0.09,
where uncertainties refer to the standard error in the mean) than
students (mean of 4.17±0.05), with p=0.002 in a Wilcoxon rank-sum
test. The PHwP project scored slightly higher (average of 4.59±0.11,
p=8×10-4) than the overall results with students, whereas
ATLAS scored slightly lower with both students (3.92±0.09, p=0.012)
and teachers (3.80±0.20, p=0.017) than their respective means.
No obvious trends were present by school.
While suggestive of extremely positive experiences with PRiSE, one
also needs to compare these distributions against the typical responses
of students and teachers for schools' STEM engagement programmes. We use the results of as such a benchmark, which surveyed
729 high-school students and 35 teachers about 12 different STEM
outreach activities in the USA and Netherlands. This comparison reveals
that PRiSE seems to be perceived considerably more positively than
usual by both students (benchmark average 3.66±0.01, p=1×10-15
in a one-sample Wilcoxon signed-rank test) and teachers (benchmark
average 3.84±0.08, p=1×10-7).
Distribution of students' (blue) and teachers' (green) overall happiness
with their PRiSE projects. Error bars denote standard (1σ)
intervals.
Secondly, students (n=135) were asked for adjectives describing
their experience of the projects overall. They were free to use any
words they wanted and were not given a pre-selected list. Teachers
(n=38) were similarly asked to indicate observations of their students'
experience also. Since 2016 this has resulted in 88 unique adjectives,
with both students and teachers typically writing two to three words each. We present the results as the word cloud in Fig. ,
where students and teachers have been given equal prominence by normalising
their counts by their respective totals. We have indicated by colour
from which group(s) the words originated, generally showing a lot
of agreement between students' thoughts and teachers' observations.
The most cited adjectives were (in descending order) interesting,
challenging, exciting, inspiring, and fun, similarly to those from the pilot , with the top two adjectives being
significantly greater than the subsequent ones. While in the pilot
stage only positive adjectives were expressed, since then a few negative
experiences have been conveyed, such as time-consuming, frustrating, and stressful. These constitute a small minority of experiences though
(6±1 %), and in most cases the same students also listed positive adjectives, apart from only four individuals.
Word cloud of students' experiences. Colours indicate words identified
by students (blue), teachers (green), or both (cyan). Students and
teachers have been given equal total weight.
Following on from these quantitative analyses, we qualitatively explore
the potential reasons behind the results. The most common themes that
emerged from students' (n=110) responses to open questions about
their experience were that they feel they learnt a lot (62 responses).
We have learnt so many new things relating to the magnetosphere
and waves and we have developed new skills. (Student 3, Xavier's
Institute for Higher Learning, MUSICS 2016)
I learned so much! I would recommend it to all the younger
kids at my school! (Student 111, St Trinians, SCREAM 2019)
I definitely learnt many new and interesting things and
it helped me to develop my understanding of particle physics while
aiding my A-Level knowledge. (Student 140, Jedi Academy, ATLAS
2020)
They found the projects' content and methods interesting (47 responses).
It brought my interests in
programming, physics, maths and space together. (Student 100,
Octavian Country Day School, PHwP 2019)
It has been very interesting to work with actual data and
plan our own research project. (Student 116, St Trinians, SCREAM
2019)
It was very interesting to learn more in regards to astrophysics
and the MUSICS project was a very safe space to do so. We got lots
of support and it was fun. (Student 119, Pokémon Technical
Institute, MUSICS 2020)
Coming into the Planet Hunting With Python project, my
interests were mainly focused on the physics side of understanding
brightness-curves and finding equations to solve for planetary parameters.
However, in this project, my eyes were opened to the many uses of
coding to analyse data, and it was a wonderful experience to learn
about such an interesting area through a combination of theory and
practical coding. (Student 120, Octavian Country Day School,
PHwP 2020)
They enjoyed the style of working in and with research which differs from their regular school experience (33 responses).
It
was quite interesting to broaden our views and experience high level
education. (Student 90, Hill Valley High School, ATLAS 2019)
I enjoyed the opportunity to do science instead of just
learning it. (Student 101, Octavian Country Day School, PHwP
2019)
It was very nice to work with friends and work together
to produce something. (Student 106, Boston Bay College, PHwP
2019)
It was very fun to do our own research and I appreciated
that help was always available even though it is very independent. It also shows how challenging research can actually be but also how
rewarding it is once you start making progress. (Student 143,
Sunnydale High School, MUSICS 2020)
Neutral or negative
experiences tended to be due to students finding the projects' content
or open-ended way of working difficult or confusing (seven responses).
I did not understand most of the project or what I was supposed to do.
(Student 147, Jedi Academy, ATLAS 2020)
The vast majority
of students seemed to ultimately enjoy this challenge though.
The project gave us a lot of freedom and challenged us to think in different
ways. (Student 122, Jedi Academy, ATLAS 2020)
[It] made me more willing to take a go at challenges
and what I deem hard. (Student 130, Bending State College, PHwP
2020)
Teachers agreed that the learning curve involved with the projects was advantageous for students.
When the students got the hang of it they really enjoyed it. (Teacher 16,
Tree Hill High School, MUSICS 2018)
The students found it hard to identify what to do a project
on and would have liked guidance on that, but I felt this was a good
experience. They have developed grappling with open ended and difficult
material. (Teacher 23, Smeltings, ATLAS 2019)
Teachers'
feedback on their experience (n=34) tended to praise how the projects
allow their students to access and explore beyond the curriculum (29 responses).
A great framework to explore physics beyond the syllabus but still accessible.
(Teacher 26, Octavian Country Day School, PHwP 2019)
Excellent project that is open-ended allowing students
to take it where they want. (Teacher 27, Hogwarts, SCREAM 2019)
This year I had an extremely motivated, enthusiastic and
well-organised group of 7 students who fully immersed themselves into
the project and quickly took it in a direction outside my own understanding
of this area of science. This is exactly the experience I wanted them
to have, and they were able to discover some genuinely novel processes
that had not been observed before – the hallmark of great scientific
research! (Teacher 44, Sunnydale High School, MUSICS 2020)
Therefore,
both quantitative and qualitative data suggest students and teachers
had much more positive and rewarding experiences participating in
PRiSE projects than is typical for schools engagement programmes from
universities in general.
Support and resources
We originally asked students whether they felt they had received adequate
support, finding overall positive results on a five-point Likert scale . However, students' qualitative responses
explaining their answers often revealed a conflation of the support
provided by Queen Mary with that offered by their teacher. Therefore,
from 2019 onwards we explicitly separated these two aspects. Students
(n=68) were asked “Do you feel that support from your teacher
was provided/available during the project?”, which yielded the following results: Strongly Agree (30), Agree (34), Neither Agree or Disagree
(3), and Disagree (1). The average response is 4.37±0.08, which
is considerably greater than the benchmark on teacher support reported
by of 3.60±0.03 (p=4×10-10). Students'
comments explaining their ratings (n=56) revealed that teachers
provided them with advice, encouragement, and enthusiasm (49 responses).
My teacher has been very supportive and has helped us when
we didn't understand something as well as encouraging us to taking
a more innovative approach. (Student 124, Quirm College for Young
Ladies, MUSICS 2020)
If we had a question, teachers were probably not useful.
But if we did not know what to do or we were stuck, here teachers
were really useful and that was what we needed. (Student 145,
Sunnydale High School, MUSICS 2020)
They arranged regular sessions for students to meet and visits or calls from the university when required (seven responses).
Our teacher arranged a Skype call with a professor from QMUL when we needed
to ask questions about how certain parts of the data were calculated.
(Student 126, Harbor School, ATLAS 2020)
[Our] teacher would often ask us about it and hold
meetings to catch up with us on our progress. (Student 143, Sunnydale
High School, MUSICS 2020)
[Our] teacher answered some of our questions and organised
a weekly meet-up where students could ask each other questions and
work together. (Student 148, Jedi Academy, ATLAS 2020)
Neutral
or negative responses tended to be explained by their teacher lacking
specific knowledge about the research in response to students' queries
(two responses).
Although they were always ready to help, sometimes they didn't know the answers to our questions. (Student 122, Jedi Academy, ATLAS 2020)
[They] didn't understand the content of the project.
(Student 139, Jedi Academy, ATLAS 2020)
This is something we do not expect of teachers cf.,
hence why support from the university is also offered.
Teachers' (n=18) responses on a yes/no scale (chosen due to expected
small number statistics) on whether they felt able to support their students were also highly positive, with only two negative responses, a significant majority (p=0.001 in a two-tailed binomial test). Bear in mind, however, that these responses were in light of the support
provided from the university, something which a few teachers referenced
in explaining their answers.
My own experience
with research was handy but I felt that without this the students
would still have been supported (Teacher 2, Hogwarts, SCREAM
2016)
only through Martin's support (Teacher 4, Sweet Valley
High School, MUSICS 2016)
the teacher version of the handout was useful, but otherwise
I could only give generic advice (Teacher 16, Tree Hill High
School, MUSICS 2018)
Several teachers raised pressure on
their time, with one teacher using this to justify their negative
response.
sheer time pressure – big limiting factor (Teacher 13, St Trinians, SCREAM 2017)
Another said this somewhat limited their ability to support students.
not
as much as I would have liked (lack of available time) (Teacher 3,
Xavier's Institute for Higher Learning, MUSICS 2016)
However, most said it was manageable.
The autonomous group work, with very little input from me, was great to see (Teacher 1,
Hogwarts, SCREAM 2015)
Students were quite self-sufficient so if I made suggestions
they were able to do the leg work (Teacher 15, Spence Academy
for Young Ladies, MUSICS 2018)
Teachers' ability and confidence
in supporting the projects were other themes that emerged. Even with the teacher-specific resources provided, some felt they did not have
the specific knowledge or skills to support the projects.
[Unable to support due to a] lack of knowledge of Python (Teacher 19,
Boston Bay College, PHwP 2018)
Other teachers reflected
that, similarly to their students, they too had experienced a learning
curve through their involvement.
[I found it] difficult at first (Teacher 8, Coal Hill School, MUSICS 2017)
They ultimately
became more determined and confident with time and in subsequent years.
First time we've done this – I will
do better next time (Teacher 17, Sunnydale High School, MUSICS
2018)
Second year that I ran it I feel more confident (Teacher 21,
Hogwarts, SCREAM 2018)
The final theme raised was that
for successful participation teachers believed the students needed
the external motivation to come from the university rather than having project delivery being solely teacher-driven.
Dr Archer was a great external lead to have. If I had been pushing them
myself they would have taken it less seriously (Teacher 17, Sunnydale
High School, MUSICS 2018)
Therefore, the comments from
both students and teachers indicate that teachers alone would likely
not have been able to successfully support these research projects
in their schools without both the resources and external motivation/mentoring
provided as part of the PRiSE framework.
We now consider the specific elements of support shown in Fig. .
From 2019 onwards we investigated participants' thoughts on each of
these various aspects offered. Students (n=68) and teachers (n=23)
were asked to rate the usefulness of these as either “unimportant”,
“helpful”, “essential”, or “unsure”. This was chosen over a five-point Likert scale due to an expected low number of responses, particularly
from teachers. Any unsure or blank responses are neglected, yielding 326 (out of a potential 408) student and 156 (out of 161) teacher
responses. We divide these responses into negatives (“unimportant”)
and positives (“helpful” or “essential”), though we acknowledge some
may consider the “helpful” response to be neutral, and thus our analysis takes both interpretations into account. The results are displayed
in Fig. for the individual elements as well
as overall results obtained from totalling all responses. Both students
and teachers overall rated the elements positively – coding the
responses to values of 1 (negative) to 3 (essential), the overall means were 2.62±0.04 for teachers and 2.23±0.03 for students.
The majority of teachers tended to give “essential” ratings to most
aspects, and while these majorities are not statistically significant in a two-tailed binomial test, the average value for each element
was greater than 2 to high confidence (p<0.002 in one-sample Wilcoxon
signed-rank tests). Students, on the other hand, mostly rated each
element as “helpful” as well as stating slightly more negative responses
than teachers, though again all elements' mean scores (apart from
the kick-off workshop at 2.15±0.08) were significantly greater
than 2 (p<0.023). While there are some variations in scoring amongst
the different support elements, such as students and teachers respectively
rating researcher visits and communications (the latter of which includes
webinars and ad hoc emails) as the most essential, these differences
to each group's overall results are slight and not statistically significant.
One interpretation of this might be that most respondents answered
unreflectively, ticking the same boxes for each item. However, no
students and only three teachers gave the same answer in every category. This therefore suggests that all of the elements of support provided
as part of PRiSE are almost equally important and necessary. This
has been further elaborated on in teacher feedback.
It
is very well set up and open ended and the support received is magnificent.
(Teacher 33, Boston Bay College, PHwP 2020)
Martin's guide to help the students was a very good balance
of useful guidance and allowing them to find their own way through.
(Teacher 38, Royal Dominion College, MUSICS 2020)
Truly excellent support from the Queen Mary team! They
have visited us multiple times and have been so generous with their
time. Students have learnt a great deal from them! (Teacher 44,
Smallville High School, PHwP 2020)
Usefulness of support provided to teachers (T, n=23) and students
(S, n=68). Results are divided (black lines and associated error
bars) into negative (red) and positive responses, with the latter
subdivided (grey lines and error bars) into “essential” (blue) and
“helpful” (yellow) elements. Error bars denote standard (1σ)
intervals.
Feedback from the university sector
Based on the highly positive results from participants, we think there
is potential for the PRiSE framework to spread beyond QMUL and be
applied to other institutions' own areas of physics (and perhaps even
STEM more generally) research. We therefore wanted to assess how it
is perceived by those from the university sector with interests and/or
expertise in schools engagement. Feedback from our partner organisations
seemed promising, for example with the South East Physics Network
including PRiSE in their public engagement strategy ,
several of their member institutions expressing interest in adopting
it, and the University of Surrey having already developed a pilot
project. However, for a slightly more balanced perspective we collected
evaluative data via an anonymous interactive online survey (see Appendix )
from independent researchers and public engagement professionals during
a session at Interact 2019 , a day-long
UK symposium concerning public engagement in the physical sciences.
This workshop contained an overview of recent educational research
and then introduced the PRiSE framework to attendees.
The respondents, while heavily bought into schools engagement, tended
to only undertake one-off activities (as detailed in Appendix ).
After presenting the PRiSE framework to them, when asked on a five-point Likert scale whether they (n=19) would now consider deeper approaches
to outreach/engagement with schools, the results were Strongly Agree (5), Agree (9), Neither Agree or Disagree (5), and no responses
in the two negative options. Coding these to a 1–5 scale yields
a mean of 4.0±0.2, i.e. greater than neutral (p=1×10-4
in a one-sample Wilcoxon signed-rank test).
In an open-ended question, participants were also asked to identify
the main thing they had taken away from the session. This yielded
17 responses. Through coding these answers three main themes emerged,
with all responses covering only one theme each. The first theme is
about what types of schools engagement are possible (eight responses), with almost all thinking that deeper programmes like PRiSE are achievable:
Outreach
does not have to just be workshop/talk based. It can be an interactive
research based activity that supports research activities within HE
(Participant 24)
students are probably far more capable than schools and
researchers might expect (Participant 16)
Only one person claimed that such approaches are not practical.
Would
need a huge amount of time to set up something good - even with input
from other people! (Participant 3)
The second theme
(five responses) concerns practical aspects towards delivering deeper programmes based on PRiSE's approach:
lots
of practical and multifaceted suggestions people in a variety of contexts
can take and adapt for themselves (Participant 13)
try and use existing resources available rather than reinventing
the wheel (Participant 15)
The final theme (five responses) concerned potential impacts from deeper programmes of schools engagement, which is beyond the scope of this paper. These results suggest researchers
and engagement professionals also see the value in PRiSE's approach
and may be receptive to adopting the framework, though evidence of
action following these immediate attitudes is really needed. We also
acknowledge that this was a rather small survey from a group already
highly bought-in to schools engagement, and thus results would likely be less positive from a wider and more representative sample of all
researchers. These are avenues which could be explored further in
the future to gain a better perspective on whether the PRiSE framework
could realistically be rolled out further.
Conclusions
“Research in schools” programmes, where school students and their
teachers get to experience and interact with cutting-edge science
through independent projects over several months, may have some role
to play in addressing current issues around participation and equity
in science (physics in particular) at university. However, how best
to go about delivering such projects for schools remains unclear.
This paper evaluates the provision framework of the Physics Research in School Environments (PRiSE) programme. These 6-month-long projects
mentored by expert researchers include a suite of activity stages,
interventions and resources to enable a wide range of students, teachers, and schools to be involved.
Feedback from participating students and teachers upon completion
has been significantly more positive than benchmark results on schools
engagement programmes with STEM in general. This is because students
and teachers have found the research projects of great interest and
have relished the challenge of working differently to their regular
school experience. This suggests that “research in schools” projects
are of greater value to schools than more common forms of outreach
activities. Since these experiences can uniquely be provided by active
researchers compared to other possible STEM engagement providers,
we strongly urge universities consider “research in schools” approaches
to engagement. Participants find the numerous elements of supporting
interventions and resources provided in PRiSE's framework, uncommon
in general with other schemes, as equally valued and necessary for
their participation. We therefore recommend that providers of independent
research projects offer schools detailed project guides, mentorship
from experts (in-person, live-online, and asynchronously), online
resources (such as “how to” articles, examples of previous students'
work, and videos), and finally the opportunity to present their work
to peers, teachers, and family. We note that even with all the support provided there is some attrition within the programme, which is to
be expected for any protracted engagement programme. While this has
not been explored here, it is assessed in a companion paper .
Currently though we have few data on the experience of students and teachers that have dropped out of the programme, which is something
that could be explored in the future. We have also gathered data on
the impact of the PRiSE initiative, which is assessed elsewhere .
The PRiSE model attempts to make efficient use of researchers' time,
enabling more schools to be supported per institution than other current
formats. We have presented data from independent researchers and public
engagement professionals showing they seem receptive to the PRiSE
framework. Indeed, it is already slowly beginning to spread to other
institutions. This potential expansion might allow an assessment of
how generally applicable the framework is outside of its current London
location and what other affordances might be required in these contexts.
While PRiSE has so far only concerned areas of physics research, “research in schools” in general already spans all the sciences e.g.. We therefore see no reason why PRiSE's approach could not also be
broadened to other STEM areas, particularly areas of research based
on data and/or analysis. We therefore encourage researchers, and the public engagement professionals who facilitate their activity, to
consider adopting this way of working and hope this paper can inform
this practice. In such cases, it is recommended that PRiSE projects
be embedded as core schools engagement activities within research groups. We would be happy to support groups in developing, delivering, and
evaluating pilot PRiSE projects around their own research, thereby
making use of the learning that has arisen from the programme over the last 6 years.
Information about UK/English schools
To those unfamiliar with the UK/English education system, we provide some further notes here. The curriculum is broken down into
Key Stages of duration 2–4 years, with those for secondary schools displayed in Table . The final two Key Stages culminate in GCSE and A-Level examinations respectively, with the
latter being optional as education post-16 is not compulsory. Our
recommendations to teachers about which year groups should be involved
with PRiSE are also highlighted in the table.
Summary of the stages of secondary education in the English system.
Here we list the questions posed in questionnaires that are considered
within this paper, giving details of what phrasing was used, how participants
could respond, and which years the question was posed. Follow-on questions
are indicated by indentation and a down-right arrow. (Students responded to the following.
The questions asked of students.
QuestionResponse typeYear(s)Have you been happy with the research project overall?Five-point Likert2016–2020 Please tell us why / why notOpen text2016–2020What adjectives would you use to describe your experience of the project overall?Open keywords2016–2020Did you feel that support from your teacher was provided/available during the project?Five-point Likert2019–2020 Please tell us why / why notOpen text2019–2020Did you find the following elements of support from Queen Mary useful in supporting you?Closed options2019–2020How could we improve future projects?Open text2016–2020Any other comments?Open text2016–2020
The questions asked of teachers.
QuestionResponse typeYear(s)Have you been happy with the research project overall?Five-point Likert2016–2020 Please tell us why / why notOpen text2016–2020What adjectives would you use to describe your students' experience of the project overall?Open keywords2016–2020Did you feel able to provide support to your students during the project?Yes/no2016–2018 Please tell us why / why notOpen text2016–2018Did you find the following elements of support from Queen Mary useful in supporting you and your students?Closed options2019–2020 Are there any ways we could further help you support your students with project work?Open text2019–2020Would you be interested in running this project or a similar one with us again?Yes/no2016–2018Please tell us why / why notOpen text2016–2018How could we improve future projects?Open text2016–2020Any other comments?Open text2016–2020University sector questionnaire
The following questions were posed to university researchers and engagement
professionals via an online interactive survey during a session at the 2019 Interact symposium .
The questions asked of university researchers and engagement professionals.
QuestionResponse typeWhat do you want your outreach / engagement with schools to achieve (i.e. what impact)?Open textWhat sorts of outreach activities with schools do you do? (Select all that apply)Closed optionsI am now considering deeper approaches to outreach / engagement with schools (Select only one)Five-point LikertWhat is the main thing you have taken away from this session?Open text
For context on these participants, Fig.
shows the distribution of the types of activity they undertake, where they could select from the following.
Stall/stand. Drop-in activities for schools at STEM or careers fairs
Talk. A typically one-/two-lesson slot featuring a predominantly one-way interaction
Workshop. A typically one-/two-lesson slot with mostly two-way interaction and often hands-on activities for students
Masterclass/taster. Half-day or day-long activities which may be comprised of talks and/or workshops
Summer school. Several-day to week-long activities often involving some project work as well as talks and/or workshops
Extended programme. Multiple interventions with the same group of students over a protracted period of time
Unsurprisingly, one-off
activities such as talks and workshops scored the highest, whereas more the protracted engagements, summer schools and extended programmes
were significantly (p<0.0019) less common. The attendees were also
asked what they hoped to achieve (i.e. the aims or intended impacts)
through their school engagements via an open question. Performing
a thematic analysis of the qualitative results, it was possible to
categorise the majority of answers into the following.
Change school students' aspirations (nine people), with the word “inspire” often used
Enhance students' awareness or understanding of STEM
(six people), often in the context of primary research
Tackle societal biases in STEM (four people), most often gender
Note that some responses covered more than one of these aims. Other
stated motivations outside of these themes included “access
to a student population for [research] studies”,
to “build relationships”, and to
deliver “meaningful content”. The
three themes are in general agreement with those determined by
in a larger survey of UK physicists.
Bar chart of types of school outreach activities undertaken by university researchers and engagement professionals (n=17). Error bars denote
the standard (1σ) interval.
Data availability
Data supporting the findings of this study that
are not already contained within the article or derived from listed public domain resources are available on request from the corresponding
author. These data are not publicly available due to ethical restrictions based on the nature of this work.
The supplement related to this article is available online at: https://doi.org/10.5194/gc-4-147-2021-supplement.
Author contributions
MOA conceived the programme and its evaluation,
performed the analysis, and wrote the paper. JDW and CT contributed
towards the analysis, validation, and writing. OK contributed to the
writing.
Competing interests
The authors declare that they have no conflict
of interest.
Acknowledgements
We thank Dominic Galliano for helpful discussions. MOA and CT are
grateful for funding from the Ogden Trust. MOA holds a UKRI (STFC/EPSRC) Stephen Hawking Fellowship.
Financial support
This research has been supported by the Science and Technology Facilities Council (grant no. ST/N005457/1), Queen Mary University of London (grant no. Centre for Public Engagement Large Award), the Ogden Trust (grant no. OQMU01), and UK Research and Innovation (grant no. EP/T01735X/1).
Review statement
This paper was edited by John K. Hillier and reviewed by John K. Hillier and four anonymous referees.
ReferencesArcher, L., Moote, J., and MacLeod, E.: Learning that Physics is “Not for
Me”: Pedagogic Work and the Cultivation of Habitus among Advanced Level
Physics Students, J. Learn. Sci., 29, 347–384,
10.1080/10508406.2019.1707679, 2020.Archer, M. O.: So you're looking to run a research in schools project?
Practical tips from the evaluation of a pilot programme, Tech. Rep.,
SEPnet, London, UK, available at: 10.13140/RG.2.2.25674.06088, 2017.
Archer, M. O.: How to undertake a programme of research-based engagement with
schools and evaluate it, Session at Interact 2019 Symposium, University of
Central Lancashire, Preston, UK, 4 September 2019, 2019.Archer, M. O.: Schools of all backgrounds can do physics research – on the accessibility and equity of the Physics Research
in School Environments (PRiSE) approach to independent research projects, Geosci. Commun., 4, 189–208, 10.5194/gc-4-189-2021, 2021.Archer, M. O. and DeWitt, J.: “Thanks for helping me find my enthusiasm for physics”: the lasting impacts “research in schools” projects can have on students,
teachers, and schools, Geosci. Commun., 4, 169–188,
10.5194/gc-4-169-2021, 2021.Archer, M. O., Hartinger, M. D., Redmon, R., Angelopoulos, V., Walsh, B. M.,
and Eltham Hill School Year 12 Physics students: First results from
sonification and exploratory citizen science of magnetospheric ULF waves:
Long-lasting decreasing-frequency poloidal field line resonances following
geomagnetic storms, Space Weather, 16, 1753–1769,
10.1029/2018SW001988, 2018.Barr, A. J., Hass, A., and Kalderon, C. W.: Citizen scientist community
engagement with the HiggsHunters project at the Large Hadron
Collider, Research for All, 2, 359–373, 10.18546/RFA.02.2.13, 2018.Bennett, J., Dunlop, L., Knox, K. J., Reiss, M. J., and Torrance Jenkins, R.: A Rapid Evidence Review of Practical Independent Research Projects in
Science, Tech. Rep., Wellcome Trust, London, UK, available at:
https://wellcome.ac.uk/sites/default/files/review-of-practical-independent-research-projects-in-science-wellcome-apr16.pdf (last access: 30 April 2020), 2016.Bennett, J., Dunlop, L., Know, K. J., Reiss, M. J., and Torrance Jenkins, R.: Practical independent research projects in science: a synthesis and
evaluation of the evidence of impact on high school students, Int. J. Sci.
Educ., 40, 1755–1773, 10.1080/09500693.2018.1511936, 2018.BERA: Ethical Guidelines for Educational Research, Tech. Rep., Fourth Edition, British Educational Research Association, London, UK, available at:
https://www.bera.ac.uk/researchers-resources/publications/ethical-guidelines-for-educational-research-2018 (last access: 30 April 2020), 2018.Bonney, R., Cooper, C. B., Dickinson, J., Kelling, S., Phillips, T., Rosenberg, K. V., and Shirk, J.: Citizen science: a developing tool for expanding science knowledge and scientific literacy, BioScience, 59, 977–984, 10.1525/bio.2009.59.11.9, 2009.Bonney, R., Phillips, T. B., Ballard, H., and Enck, J. W.: Can citizen science enhance public understanding of
science?, Public Underst. Sci., 25, 2–16, 10.1177/0963662515607406, 2016.Braun, V. and Clarke, V.: Using thematic analysis in
psychology, Qual. Res. Psychol., 3, 77–101, 10.1191/1478088706qp063oa, 2006.Braund, M. and Reiss, M.: Towards a More Authentic Science Curriculum: The
contribution of out-of-school learning, Int. J. Sci. Educ., 65, 1373–1388,
10.1080/09500690500498419, 2006.Campaign for Science and Engineering: Improving diversity in STEM, Tech. Rep., CaSE, London, UK, available at: http://www.sciencecampaign.org.uk/resource/ImprovingDiversityinSTEM2014.html (last access: 30 April 2020), 2014.Chin, C. and Chia, L.-G.: Implementing Project Work in Biology through
Problem-based Learning, J. Biol. Educ., 38, 69–75,
10.1080/00219266.2004.9655904, 2010.Chubb, K. L., Joseph, M., Franklin, J., Choudhury, N., Furtenbacher, T.,
Császárc, A. G., Gaspard, G., Oguoko, P., Kelly, A., Yurchenko,
S. N., Tennyson, J., and Sousa-Silva, C.: MARVEL analysis of the measured
high-resolution rovibrational spectra of
C2H2, J. Quant. Spectrosc. Ra., 204, 42–55, 10.1016/j.jqsrt.2017.08.018, 2018.Cilauro, F. and Paull, G.: Nuffield research placements: interim report, Tech. Rep., Nuffield Foundation, London, UK, available at:
https://www.frontier-economics.com/media/3244/nrp-evaluation-interim-report-june-2019.pdf (last access: 30 December 2020), 2019.Clopper, C. and Pearson, E. S.: The use of confidence or fiducial limits
illustrated in the case of the binomial, Biometrika, 26, 404–413,
10.1093/biomet/26.4.404, 1934.Colle, J., Lascaris, E., and Tánczos, I.: The HiSPARC project: science,
technology and education, in: AIP Conference Proceedings, Seattle, USA, 21–23 September 2006, 44–50,
10.1063/1.2818548, 2007.Conner, J. O.: Student Engagement in an Independent Research Project: The
Influence of Cohort Culture, J. Adv. Acad., 21, 8–38,
10.1177/1932202X0902100102, 2009.Corlu, M. S.: Which preparatory curriculum for the International Baccalaureate
Diploma Programme is best? The challenge for international schools with
regard to mathematics and science, Int. Rev. Educ., 60, 793–801,
10.1007/s11159-014-9446-9, 2014.Dalgleish, H. S. and Veitch-Michaelis, J. L.: Assessing the influence of one
astronomy camp over 50 years, Nature Astronomy, 3, 1043–1047,
10.1038/s41550-019-0965-y, 2019.Davenport, C., Dele-Ajayi, O., Emembolu, I., Morton, R., Padwick, A., Portas, A., Sanderson, J., Shimwell, J., Stonehouse, J., Strachan, R., Wake, L., Wells, G., and Woodward, J.: A Theory of Change for Improving Children's
Perceptions, Aspirations and Uptake of STEM Careers, Res. Sci. Educ.,
10.1007/s11165-019-09909-6, 2020.Dijkstra, E. and Goedhart, M.: Evaluation of authentic science projects on
climate change in secondary schools: a focus on gender
differences, Res. Sci. Technol. Educ., 29, 131–146,
10.1080/02635143.2011.581631, 2011.
Dunlop, L., Knox, K. J., Bennett, J., Reiss, M. J., and Torrance Jenkins, R.:
Students becoming researchers, School Science Review, 100, 85–91, 2019.Furnell, W., Shenoy, A., Fox, E., and Hatfield, P.: First results from the
LUCID-Timepix spacecraft payload onboard the TechDemoSat-1 satellite in
low Earth orbit, Adv. Space Res., 63, 1523–1540,
10.1016/j.asr.2018.10.045, 2019.Gallagher, S. A., Sher, B. T., Stepien, W. J., and Workman, D.: Implementing
Problem-Based Learning in Science Classrooms, School Science and Mathematics, 95, 136–146, 10.1111/j.1949-8594.1995.tb15748.x, 1995.
Gibbons, J. D. and Chakraborti, S.: Nonparametric statistical inference,
Chapman & Hall/CRC Press, Taylor & Francis Group, Boca Raton, Florida, USA, 2011.Harrison, T. G. and Shallcross, D. E.: Towards sustainable public engagement
(outreach), New Directions in the Teaching of Physical Sciences, 6,
41–46, 10.29311/ndtps.v0i6.381, 2010.Hatfield, P., Furnell, W., Shenoy, A., Fox, E., Parker, B., Thomas, L., and
Rushton, E. A. C.: IRIS opens pupils' eyes to real space
research, Astron. Geophys., 60, 122–124, 10.1093/astrogeo/atz046,
2019.Hillier, J. K., Saville, G. R., Smith, M. J., Scott, A. J., Raven, E. K., Gascoigne, J., Slater, L. J., Quinn, N., Tsanakas, A., Souch, C., Leckebusch, G. C., Macdonald, N., Milner, A. M., Loxton, J., Wilebore, R., Collins, A., MacKechnie, C., Tweddle, J., Moller, S., Dove, M., Langford, H., and Craig, J.: Demystifying academics to enhance university–business collaborations in environmental science, Geosci. Commun., 2, 1–23, 10.5194/gc-2-1-2019, 2019.HiSPARC: High School Project on Astrophysics Research with Cosmics, available at: http://www.hisparc.nl/en/, last access: 31 July 2018.Hodson, D.: Is this really what scientists do? Seeking a more authentic science in and beyond the school laboratory, in: Practical Work in School Science – Which Way Now?, edited by: Wellington, J., Routledge, London, UK, 16, 10.4324/9780203062487, 1998.Holdship, J., Viti, S., Codella, C., Rawlings, J., Jimenez-Serra, I., Ayalew, Y., Curtis, J., Habib, A., Lawrence, J., Warsame, S., and Horn, S.:
Observations of CH3OH and CH3CHO in a
Sample of Protostellar Outflow Sources, Astrophys. J., 880, 138,
10.3847/1538-4357/ab1f8f, 2019.
Hollander, M. and Wolfe, D. A.: Nonparametric statistical methods, John Wiley
& Sons Inc., Hoboken, New Jersey, USA, 1999.Hong, J.-C., Chen, M.-Y., and Hwang, M.-Y.: Vitalizing creative learning in
science and technology through an extracurricular club: A perspective based
on activity theory, Think. Skills Creat., 8, 45–55,
10.1016/j.tsc.2012.06.001, 2013.
Howell, D. C.: Statistical methods for psychology, Wadsworth, Belmont,
California, USA, 2007.IOP: Raising Aspirations in Physics: A review of research into barriers to
STEM participation for students from disadvantaged backgrounds, Tech. Rep.,
Institute of Physics, London, UK, available at:
http://iop.cld.iop.org/publications/iop/2014/file_64466.pdf (last access: 31 May 2020), 2014.IRIS: The Institute for Research in Schools, available at:
http://www.researchinschools.org/, last access: 31 March 2020.Jardine-Wright, L.: Making outreach work, Phys. World, 25, 42,
10.1088/2058-7058/25/04/41, 2012.McKemmish, L. K., Masseron, T., Sheppard, S., Sandeman, E., Schofield, Z.,
Furtenbacher, T., Császár, A., Tennyson, J., and Sousa-Silva, C.:
MARVEL Analysis of the Measured High-resolution Rovibronic Spectra of
48Ti16O, Astrophys. J. Suppl. S.,
228, 15, 10.3847/1538-4365/228/2/15, 2017.McWhinnie, S.: Degree-Course Destinations of Accepted Applicants with Physics
and Mathematics A-level or Scottish Higher 2006–2011, Tech. Rep.,
Institute of Physics, London, UK, available at:
http://www.iop.org/publications/iop/2012/page_55899.html (last access: 30 August 2018), 2012.Minner, D. D., Levy, A. J., and Century, J.: Inquiry-based science instruction – what is it and does it matter? Results from a research synthesis years 1984 to 2002, J. Res. Sci. Teach., 47, 474–496, 10.1002/tea.20347, 2010.Murphy, P. and Whitelegg, E.: Girls in the Physics Classroom: A Review of the
Research on the Participation of Girls in Physics, Tech. Rep., Institute of
Physics, London, UK, available at:
https://www.iop.org/education/teacher/support/girls_physics/review/page_41597.html (last access: 31 May 2020), 2006.National Coordinating Centre for Public Engagement: What is public
engagement?, available at:
https://www.publicengagement.ac.uk/about-engagement/what-public-engagement, last access: 30 April 2020.National HE STEM SW: HiSPARC project on National HE STEM
Programme South West Region website, available at:
http://www.hestem-sw.org.uk/project?id=55 (last access: 31 May 2019), 2012.ORBYTS: Original Research By Young Twinkle Students, available at:
http://www.twinkle-spacemission.co.uk/orbyts/, last access: 31 March 2019.Parker, B., Rushton, E. A. C., Thomas, L., and Hatfield, P.: Transforming
Education with the Timepix detector – ten years of
CERN@school, Radiat. Meas., 127, 106090, 10.1016/j.radmeas.2019.03.008, 2019.Paull, G. and Xu, X.: Nuffield research placements study: composition report,
Tech. Rep., Nuffield Foundation, London, UK, available at:
https://mk0nuffieldfounpg9ee.kinstacdn.com/wp-content/uploads/2019/12/Frontier-NRP-Composition-Report-April-2017.pdf (last access: 23 February 2021), 2017.PRiSE: Physics Research in School Environments, available at:
http://www.qmul.ac.uk/spa/researchinschools, last access: 30 April 2020.RAE, IOP, and Gatsby Foundation: School sixth forms with no entries for
A-level physics, Tech. Rep., Institute of Physics, London, UK, available at:
https://www.iop.org/about/publications/school-sixth-forms-no-entries-level-physics (last access: 30 August 2020), 2015.
Robson, C.: Real World Research, John Wiley & Sons Ltd., Hoboken, New Jersey, USA, 2011.Rogers, P.: Ways of framing the difference between research and evaluation,
Better Evaluation, available at:
https://www.betterevaluation.org/en/blog/framing_the_difference_between_research_and_evaluation (last access: 31 May 2020), 2014.Rushton, E. A. C. and Reiss, M. J.: From science teacher to “teacher
scientist”: exploring the experiences of research-active science teachers in
the UK, Int. J. Sci. Educ., 41, 1541–1561, 10.1080/09500693.2019.1615656, 2019.SEPnet: South East Physics network Outreach and Public Engagement Strategy,
available at: http://www.sepnet.ac.uk (last access: 30 May 2020), 2017.Shah, H. R. and Martinez, L. R.: Current approaches in implementing citizen
science in the classroom, J. Microbiol. Biol. Educ., 17, 17–22, 10.1128/jmbe.v17i1.1032, 2016.
Silverman, D.: Doing Qualitative Research: A Practical Handbook, Sage
Publications Ltd., Thousand Oaks, California, USA, 2010.Sousa-Silva, C., Mckemmish, L. K., Chubb, K. L., Gorman, M. N., Baker, J. S.,
Barton, E. J., Rivlin, T., and Tennyson, J.: Original Research By Young
Twinkle Students (ORBYTS): when can students start performing original
research?, Phys. Educ., 53, 015020, 10.1088/1361-6552/aa8f2a, 2018.Stanford Office of STEM Outreach: Raising Interest in Science and
Engineering summer internship program, available at:
https://oso.stanford.edu/programs/39-rise-summer-internship-program,
last access: 23 December 2020.Thorley, C.: Physicists and Outreach: Implications of schools physics outreach
programmes from the perspective of the participating physicists, PhD thesis,
Institute of Education, University College London, UK, available at:
https://discovery.ucl.ac.uk/id/eprint/1503745 (last access: 30 April 2020), 2016.van Dam, K., van Eijk, B., Fokkema, D., van Holten, J., de Laat, A.,
Schultheiss, N., Steijger, J., and Verkooijen, J.: The HiSPARC experiment,
Nucl. Instrum. Meth. A, 959, 163577,
10.1016/j.nima.2020.163577, 2020.Vennix, J., den Brok, P., and Taocnis, R.: Perceptions of STEM-based
outreach learning activities in secondary education, Learning Environ. Res.,
20, 21–46, 10.1007/s10984-016-9217-6, 2017.Wellcome Trust: Wellcome Science Education Tracker, 2016, [data collection], UK Data Service, available at: 10.5255/UKDA-SN-8119-1, 2017.Whyntie, T., Cook, J., Coupe, A., Fickling, R. L., Parker, B., and Shearer, N.: CERN@school: bringing CERN into the classroom, Nucl. Part. Phys. P., 273–275, 1265–1270,
10.1016/j.nuclphysbps.2015.09.202, 2016.
Yasar, S. and Baker, D.: Impact of involvement in a science fair on seventh
grade students, in: Annual Meeting of the National Association for Research
in Science Teaching, Philadelphia, USA, 23–26 March 2003, ED478905, 2003.Yeoman, K., Nardi, E., Bowater, L., and Nguyen, H.: “Just Google it?”:
pupil's perceptions and experience of research in the secondary classroom,
Brit. J. Educ. Stud., 65, 281–305, 10.1080/00071005.2017.1310179, 2017.