Assessing participant learning in an interdisciplinary and freeform environment can be difficult [
3,
64]. The breadth of topics we touched on would make for an unwieldy post-exam, and we considered formal assessment less relevant for our out-of-school context. Instead, we focused on assessing how the students engaged with our topics and activities. One possible metric of engagement is simple participation: did each participant complete each activity, without excessive prodding by instructors? We found this metric not particularly satisfying; due to the structure and voluntary nature of the workshop, all of our attendees participated in all of the main activities: each participant made their own test airbag, helped gather data in the characterization activity, contributed ideas and feedback to the brainstorming session, and ultimately produced a project solo or in a 2- or 3-person team. Even the relatively dry "data-gathering" activity had good participation, with one participant even discovering a methodological flaw in the characterization procedure, and another noticing and fixing faulty data. Other than one participant who had a family emergency, every participant returned for the second day of the workshop.
5.1 Salience of Learning Goals
Building on the curricular relevance demonstrated in section
4.3, we wanted to understand the morphing matter research skills’ salience to our actual participants. To do so, we analyzed participant narratives of their project and experience
in their own words through two sources of self-narrative data: their oral project presentations and our one-on-one post-workshop interviews. (The post-workshop survey was largely multiple-choice/Likert-scale questions, not the participants’ own words.)
As described in section
4.2.7, the participants gave presentations thrice: once as an initial practice attempt in small groups, a “first round” for the whole workshop group, and “second round” in front of a small audience of invited guests. The presentations were generally more succinct for the final audience, averaging about two minutes in the first round, with an additional two minutes of questions per project, a minute and a half for the second round. Because some participants worked in groups for the final project, not every participant spoke in all presentations. In the three-person team, P6 and P7 co-presented for the first full-group round, and P10 presented for the guests round. Additionally, P5 presented her joint project with P11, who had left just before presentations. Two participants (P11 and P12) left before presenting or being interviewed, and are therefore not included in this analysis.
Our semi-structured post-workshop interviews were limited by their brevity, lasting an average of five minutes. This length was constrained by the relatively small number of our team trained to give interviews and the available time at the end of the two-day workshop. The post-survey given just before the interviews asked for feedback on individual activities and thus likely reminded the participants about what they had done, but the oral interview questions did not reference specific activities or learning goals. Instead, we asked these high-level questions:
•
What skills and techniques do you feel you learned?
•
Was there anything missing that you wanted to learn, but we didn’t cover?
•
Do you feel confident that you will be able to apply the skills you learned in this workshop in the future?
•
What do you see yourself creating using the skills you learned in this workshop?
•
Do you feel satisfied with the project you created?
•
Do you think you will try something like this in the future? Either to make projects at home or in school / as a job?
We don’t assume that participant self-reports of skills learned are necessarily accurate; however, their responses could point toward what was new, exciting, or relevant to the participants.
To structure our analysis, we selected a subset of evaluation criteria from our list of relevant learning standards (Table
2). We prioritized criteria that were particularly relevant to morphing matter research, that cut across disciplines, and that were not explicitly enforced by us (e.g. not "Document the process of developing ideas from early stages to fully elaborated ideas" because we specifically told them to do so).
For each selected goal, we looked for instances of each participant either mentioning a related activity directly, or describing their experience in a way that shows evidence of learning in that area. For example, for the goal “learning to use tools, materials, and artistic conventions,” P1, P3, P8, P9 all specifically recollected “learning to use the heat sealer” in their interviews (direct mention), and P7 discussed her team’s incremental understanding of how to work with heat-sealed plastic, noting that “the material was hard to fold once it was already stapled down. So I might cut it into different pieces and then press those all together” (evidence of learning).
We present an overview of this data in Table
4.
Unsurprisingly because it was the focal activity of the workshop and the topic of the presentation,
“Designing/refining a solution based on student-generated evidence, scientific knowledge, and prioritized criteria/tradeoffs” is well-represented: most participants mentioned how they designed and refined their pneumatic wearable with an eye toward tradeoffs and what they understood about diamond-inflatable actuator design. Especially within the presentations, participants mentioned factors influencing their results including time constraints, successful or failed prototypes, and how actuator motions would ideally cause their desired results. Participants particularly described their workarounds for assembling their project quickly (e.g. P2 used safety pins instead of sewing, and P9 made a deliberately partial prototype) and their processes for location and fixing holes in their air bags, indicating that they were particularly involved in troubleshooting and problem-solving processes.
Every participant – even P5, who was quite taciturn – touched on “making works that convey personal meaning and interpreting meaning in the works of others” at least once, whether in their presentation or their interview. We hypothesize that this is partially influenced by how we structured the initial brainstorming of the projects, which emphasized user and context. However, some of the “purposes” were deliberately exaggerated to the point of comedy for personal joy (e.g. an octopus-shaped sun hat, because P9 wanted to make something big), and even projects that weren’t explained as having a particular “purpose” were connected to something relevant to that participant (e.g. P4’s morphing skirt, because she is inspired by beetle exoskeletons).
Very few participants mentioned or invoked
“using algorithmic representations to describe or support explanations” within the presentations or interviews. The strongest recollection was P2, whose commentary was still fairly lukewarm, noting that “it was a little bit difficult for me, but I was still able to do it.” This is in contrast to the reality that every participant did, in fact, participate in both the Telephone Game and main characterizing activities, with many spirited discussions especially during the Telephone Game, and participants engaged enough to call out errors in a proposed methodology (P9) and question/double-check specific data points (P6 and P7). Participants also clearly used their understandings of Ou et al’s identified parameters in refining their projects; for example, by adding more diamonds to produce more cumulative bending. We hypothesize that these activities may have been the least novel, or most school-like, and therefore least salient or interesting to most participants. Additionally, in the presentations, participants tended not need need algorithmic representations because they could simply use visual or gestural descriptions (e.g. “it bends like this”). Lastly, while we were focusing on the physical/geometric representation in this analysis, we observe that participants did tacitly incorporate the inherent time dimension of morphing matter into their presentations; for example, all three posters of our case study participants (Figure
4) include “before and after” sequential imagery.
5.2 Case Studies: Ways of Engaging with Research Processes
We were curious how students’ own cross-disciplinary interests and aspirations influenced their perceptions of, and interactions with, morphing matter research processes because STEAM education, particularly in e-textiles, is often positioned as a basis for positively shaping student aspirations and improving transfer across knowledge domains, particularly for minoritized students such as girls in electrical engineering [
11] However, we noticed that many of our participants
already self-defined as multidisciplinary learners with a wide variety of interests and aspirations. Many of them had done similar blended projects before, though not necessarily framed as research.
To better understand how participant backgrounds and aspirations influenced their experiences with the various research processes, and to understand how learning or inspiration could be supported, we document three case studies [
86]: one group of three friends who chose to collaborate on their final project, as well as two individuals. We chose these three cases because, together, they provide good representative coverage of the overall participant group: different ways of working, different priorities, and different backgrounds.
Our analysis in this section is based on participant survey data (pre- and post-workshop), the post-workshop interviews, our audio/video and photographic recordings of the workshop and the artifacts produced, and our instructing team’s observations of the participants both during the session and in reviewing the recordings. To help spur and structure the instructor observations, we considered the four types of indicators of learning in "tinkering" environments proposed by Petrich et al. –
engagement,
intentionality,
innovation, and
solidarity [
64] – as a prompt. To summarize Petrich et al., indications of
engagement include “expressions of joy, wonder, frustration, and curiosity,” and “work inspired by prior examples”;
intentionality is evident in variation, personalization, and self-direction toward projects and efforts;
innovation includes “repurposing ideas/tools,” deliberately “redirecting efforts,” and “complexification of processes and products”;
solidarity can be shown in borrowing and sharing “ideas, tools, approaches” and “helping others to achieve their goals.” For each, we asked each member of the instructing team for examples of each of our focal participants showing that indicator. These examples included some recollected anecdotes, as well as corroborating evidence from our recorded data. We used Google Sheets [
28] to sort and analyze the survey data and Dovetail [
35] to transcript, tag, and cross-reference the recording and interview data. All authors of this paper contributed to tagging the data, which was done iteratively, with each data source processed by at least two and typically three members of the team. Initially, we tagged based on learning goals, participant reactions (such as “wants to learn more” or “isn’t sure why this would be useful”), and each author’s discretionary highlighting of incidents worth discussion. As we periodically discussed emergent patterns, we re-visited the data to synthesize the tags into thematic codes to develop our “ways of engaging research processes” thematic framing for understanding the participant experiences.
5.2.1 Team Puff Muscle (P6, P7, and P10).
Three participants had an existing friendship – P10 and P6 mentioned that P7 recruited them to join the workshop. P7 mentioned in her interview that she had looked up the definition of "actuator" to explain what kind of workshop it would be to a friend (though it’s unclear whether the friend in question was one of the participants or not). These three–P6, P7, and P10–worked together on their final project, the “Puff Muscle 9000” artificial bicep allowing its wearer “to be buff without having to go through the struggles of going to the gym.”
All three team members showed
engagement throughout the workshop, as active participants in all of the activities including asking technical questions during the fashion inspiration presentation at the end of the first day (at a time when everyone was getting tired). Team Puff Muscle’s
intentionality showed in both the humor and technical aspects of their project. They had a clear narrative for the Puff Muscle 9000, which they “sold” with self-directed infomercial-like language and joking claims from their initial design sketches through the final presentations. They were also intent on solving technical fabrication problems. They worked together on numerous techniques to debug a persistent leak in their pneumatic actuator, including using much of their snack break time to do so. They ultimately ran out of time before fully solving the problem, and all three team members were still musing about possible solutions to their leak during both the presentations and their individual post-experience interviews. In the post-survey, P6 and P10 mentioned the air leak as the most frustrating part of their project. However, it wasn’t a fully negative experience: when asked to rate their comfort with debugging and problem-solving on a scale from 1 to 5 (with 5 being the best) all three members of Team Puff Muscle responded with a 5 during the post-survey, whereas P6 and P10 had responded with a 4 for the same question in the pre-survey.
They showed innovation in choosing to build a different kind of pneumatic actuator than the one we taught: instead of a creased bending actuator, they produced a pillow-like airbag which drew on P10’s understanding of sewn object shaping to incorporate heat-sealed darts for a rounded shape.
Team Puff Muscle’s primary solidarity was within the team – in P10’s summary, “[P6] came up with the main idea of it all and then me and [P7] kind of figured out how we were gonna connect all the corners and I was the one who had the most proficiency in sewing skills. So I mainly focused on the arm band, then connecting it to the arm band while the other two focused on constructing it and filling up any holes” – but they were broadly outgoing in engaging other workshop participants as well. They were also especially active in providing feedback and discussion during the design critique activity on the second day, and in helping other participants with leak-debugging.
P10 was particularly enthusiastic about interdisciplinary work. She had a demonstrated and discussed interest in technical sewing and historical fashion. When asked whether she could see herself in a lab like ours, she mentioned that her career aspirations were likely science-based (“biology and like a more medical field or like chemistry”), but that “the more I go to internships and workshops like this, I’m like, wait a second, I want do too many things in life. There’s too many cool things. [...] I had no idea that there were labs that did this and I’m so happy that they exist.”
P7 listed her potential college majors as “business and fashion,” though she also said that her reason for taking the workshop was “I’m going to start sewing soon and getting used to fashion.” (In her post-survey, she rated the helpfulness of this workshop for her career as a “3,” which may indicate that she didn’t find it particularly fashion-based.)
Team Puff Muscle’s collaboratively interdisciplinary approach showed finesse in how they balanced/bridged interests, and it therefore exemplified
research as a way of building things together: bringing together ideas and techniques that might not otherwise be combined.
5.2.2 Metamorphosis Skirt (P4).
P4’s project goal was a bio-inspired "Metamorphosis" skirt (“like Kafka’s bug”), which could unfold like a beetle’s wings (“a cool spooky bug abdomen”). She included a swatch of fabric in her final poster to help communicate the overall vision, but she focused on prototyping the actuator component instead of the whole skirt.
Because of this scoping decision, she was able to finish relatively early. She used the extra time showing solidarity in assisting P2 with her project, and refining her poster more than other participants had time to do. In her poster, she innovated in including printed imagery of her beetle inspiration and in using photo cut-outs in her composition (which inspired P9).
P4’s tight project scope and specific visual concept show intentionality, and she engaged with the previous day’s activities by using different sealing patterns from Ou et al as the basis of her experiments to refine the specific full-but-curved shape she had in mind. In addition to refining her specific sealing pattern for her desired shape, she pushed the technical construction aspects of her project by using two of the “optional” construction techniques we supported: 1) attaching multiple airbag modules together with branching tubing connectors, and 2) using the microcontroller air pump for inflation (needed because of the relatively higher volume of air required for multiple modules).
P4’s background includes a love of science and math, but a broad range of other interests as well, with above median "interested in" and "familiar with" items in the pre-survey (Table
3). She participates in a university-hosted robotics club and listed “both mechanical and electrical engineering” as possible college majors for herself. The instructors perceived P4 as quite savvy about research methods and robotics, perhaps because of her background. While she never directly mentioned it, her bio-inspired concept was well-aligned with much existing morphing matter research (e.g. [
26,
81]) and may indicate outside familiarity with our lab and related work. However, her results with the project were not just prior knowledge. For the self-rating “I feel comfortable using pneumatics to design projects” (1-5, with 5 being the most comfortable), P4’s pre-workshop assessment was 3 and post-workshop was 5; that is, she learned much more about constructing pneumatic circuits than she knew before. Instead of benefiting from specific operational knowledge, it is likely that she had an understanding of research mindsets and priorities.
In approaching a specific concept-driven aesthetic with tactical iteration building off of prior work; P4 undertook
research as a set of methodological tactics and conceptual goals: a way of making connections to other scholarship and being thoughtful, at the process level, about desired outcomes.
5.2.3 Octopus Hat (P9).
P9 attended alongside her sister, P8. Both are home-schooled. P9 joined the workshop with a clear desire to learn and explore. She is particularly excited about science – her favorite subjects in school are "Math, Biology, Chemistry and Physics" – but her interests are broad; for example, she listed "reading, riding my bike, and sometimes sewing" as hobbies and "the immune system, outer space, and various random interesting facts" as favorite topics. In conversation, she brought up her burgeoning interest in fashion design as well.
P9 was highly
engaged, correctly identified a procedural error during the "characterization" activity, and contributed many relevant facts and theories to the various discussion activities, including connecting our exploration of inflatables to Baymax the inflated robot from the Disney movie Big Hero 6. She showed
solidarity in helping the other participants at her table. For the project, P9 was eager to integrate as much of her knowledge as she could, and she was keen to build something different from everybody else. She had a specific
intentional vision in her first sketch of the brainstorming activity (in the morning of the second day), which she pursued more or less unchanged. For example, she chose materials in very similar colors to her initial sketch (included in her final poster, Figure
4), which was drawn without knowing what fabric we would supply.
She ran into several difficulties with the project, mainly based on her ambitious scope given the time limitations. She proposed an octopus hat with eight curling tentacles, which she scaled down to two tentacles as a prototype. However, after producing these, she discovered that, because she was attempting to innovate by making them much larger than the actuators we had made up to that point, they required a larger volume of air to inflate than the simple hand-operated syringe inflation method we were using. She pivoted to using the optional microcontroller air pump setup but the tentacles were large enough to be very difficult to check for leaks. Time constraints ultimately prevented her from completing a working prototype, but she articulated the challenges well and had ideas for future solutions.
Like many of our participants, P9 had wide-ranging interests (e.g. “the immune system, outer space, and various random interesting facts”). When asked if she might make pneumatic airbag actuators in the future, she replied that she “may do it because I feel like it is a very interesting idea and a process,” – though she may have said this out of politeness – “but I may not do it because there are many other things that I also find interesting.”
When asked how the pneumatic curling actuators could be used, she suggested "maybe in biomedical engineering for, for prosthetics, or moving joints," which aligns with her stated possible career path of “bioengineering (immunoengineering).” However, she was overall skeptical that the workshop content would be relevant to her studies or future career, with a "3" in response to this question on the post-survey. (Her sister, P8, flat-out denied it would be useful, stating that "I’m planning on doing nursing, so I don’t think it would.")
However, the lack of future applicability didn’t appear to be a negative for her; P9 appeared to enjoy simply building something new (albeit frustrated by the limited time), and she even asked if she might be able to come back in the future. She was confident in her understanding of the engineering challenges that would need to be solved to make the project work.
In our observations, P9 seemed highly motivated by the thrill of the chase for knowledge, and she enjoyed learning something cool and impressive. In other words, P9 was most aligned with research as a way of obtaining and proving knowledge.