Julie and Vicki have published a research report on using audio feedback for peer review on student writing.  They used iPods distributed as part of the Duke Digital Initiative, to test if audio feedback is an effective way for students to offer high-quality comments to each other on their writing.   Their report “Can you hear us now?: A comparison of peer review quality when students give audio versus written feedback” (pdf) is published in the annual 2008 edition of The WAC Journal, a national peer-reviewed journal on writing across the curriculum.

Julie and Vicki noticed that when they gave students feedback on their writing, audio feedback was more time-efficient and seemed to be of higher quality than written comments.  They designed a study to find out if students would experience the same efficiency and effectiveness using audio feedback for peer review.  Students in their classes gave and received peer reviews using both audio and written comments.  Students were surveyed about their preferences and perceptions at the end of the semester.  In addition, Julie and Vicki assessed the quality of the peer reviews using defined criteria and two raters for each review.

They found that audio peer reviews contained more specific and higher order comments than written peer reviews.  They conclude that audio feedback significantly improves the quality of peer reviews.  The paper finishes with concrete suggestions based on their results and experiences with students for effectively using audio feedback in the classroom.

This paper is a great example of the Scholarship of Teaching and Learning; Vicki and Julie have carefully researched “what works” in teaching using audio peer reviews, and offered suggestions for others based on their results.

Connel teaches ECON 51D, Economic Principles, a very large class held in Griffith Theater in the Bryan Center.  Connel uses a tablet PC so that he can sketch and create notes while he is lecturing.  By creating lecture notes dynamically, he is able to quickly respond to student concerns and be interactive. After his lecture, students can download the notes as PDF documents from the Blackboard course site. The image below shows a portion of these notes.  In addition, both the notes and his lecture are saved using DukeCapture, which produces both streaming and downloadable files with audio and video for his students to review.  Students can select the media that best suits their needs.

Connel wondered whether posting these recordings & annotated slides would impact attendance in the class; attendance has not decreased and he is no longer concerned about this issue.  Students have responded very favorably; some have said that they watch after lecture even if they attend because they’re so busy taking notes they miss side comments which end up being important. Others have said that they find being in lectures distracting and are better able to focus on the content outside of the large lecture setting.  DukeCapture reports that lectures have 100 hits each.

Connel enjoys using a tablet PC in his teaching.  He prefers the slate-type, without a keyboard, because it is light and easy to set up. He likes using Windows Journal, because he can use a range of ink colors (and create his own for best projection), and the graph paper background assists him in drawing legible graphs during class. He uses Windows Journal on the tablet PC to produce grading rubrics for his TAs, and to quickly create sample solutions for TAs to grade student work.

see a short video from Connel’s class

Connel began by borrowing a tablet PC from the Duke Digital Initiative, and now his infectious enthusiasm has encouraged other instructors in Economics to teach with tablet PCs.

Watch a demonstration of Windows Journal on YouTube

Project Description

“How do they connect? The past and the present?”

CIT provided Trudi Abel with funding and student support to create digital versions of historic maps of Durham using Google Earth. Using high quality digital copies of maps from the late 1800’s, Abel worked with CIT staff to figure out the best methods for converting, importing and placing images as overlays into Google Earth. The “georectification” of these maps presented several obstacles, requiring the team to consult with local Durham mapping and historical experts to complete the placement and positioning of these maps.

Several of the resulting digital maps have recently been added to Abel’s ongoing project – the Digital Durham website. Google Earth files can be downloaded and opened on users’ computers for exploration. Visitors to the site can also access several high resolution screen captures of the map overlays without the need to open or use Google Earth. The resulting maps can also be used in Abel’s work with Duke and local high school students – providing a basis for student research projects. Audio pieces created on iPods, geotagged photography and even short video clips can be linked directly to their historical and/or present-day locations.

“I think these maps will help users visualize an industrializing city and gain a better understanding of the process of urbanization in this New South community.”

Click here to view the Digital Durham page for Sanborn 1884

Click here to view the Digital Durham page for Sanborn 1888

Presentations

The following video is an excerpt from the presentation “Everybody’s Doing It: Web-based Visualizations and Mashups in the Social Sciences” which CIT consultant Shawn Miller gave at Duke’s Visualization Forum in September 2008. The full video is available from the Visualization Forum website.

Trudi Abel also presented about the project and the larger Digital Durham project at a Visualization Forum in March 2009. The video from her talk is available here.

Abel and Miller discussed future possibilities for the Digital Durham project at Duke’s Tech and New Media Tuesdays forum. The presentation is accessible on iTunesU.

Articles about the project

The Digital Durham Project: Creating Community through History, Technology, and Service Learning by Trudi Abel

Duke News article: New Map Collaboration Helps Tell Story of Durham’s History

MyNC.com article: Duke, Durham Merge Google Earth technology with historic city maps

Duke Research Blog: Seeing Through Time: Historic Maps, Google Earth, and the Transformation of Durham

Independent article: What Google Earth doesn’t show you: A small movement of alternative mapmakers seek to revolutionize our understanding of the Triangle and the world

Project Started: May 4, 2007
Funding: $1650

Project description

In Advanced Geospatial Analysis (ENVIRON 359), students used Geographic Information Systems (GIS) to understand environmental processes and how to protect and manage environmental resources. Students were required to work with large, complex databases and satellite images.

In support of these goals, students used iPods as portable storage to complete labs and projects with datasets too large for the classroom server. They also subscribed to podcasts from commercial GIS companies (e.g. Environmental Systems Research Institute) and from GIS practitioners to add these perspectives on cutting edge GIS technologies not yet documented in their textbooks.

Project start date: August 1,  2006

“There’s this whole chunk of cultural history that’s been forgotten,” Foster said about the Golden Age of Radio covered in his course. “So much of what we have [today] of TV and film is so indebted to radio.”

One example Foster gave was from “Three Skeleton Key,” a 1949 episode of the CBS show “Escape.” In it, three men in a lighthouse on the coast of French Guyana see a menacing ship approaching as Richard Wagner’s “The Flying Dutchman” plays in the background (listen to the clip). In class, Foster pointed out the dramatic elements — pauses, voice inflections, sound effects and the musical score — as well as the cultural significance of introducing Wagner’s nineteenth-century classical music to a popular radio audience.

“The way that many Americans come to… high cultural commodities like Wagner and Bach is through popular media like radio,” he said, and now TV and movies. For example, he said, “We know [Wagner’s] ‘Ride of the Valkyries’ because of [the film] ‘Apocalypse Now.’”

After listening to the classic radio dramas, students did their own productions of the shows, which are then made available on The mp3ater Project Web site.

As students get a sense of the old time radio dramas, Foster asked them to pick a script of one show and produce their own version of it. The students broke into groups and use iPods to record their parts. They then used audio editing software to mix in sound effects.

Sophomore Tiffany Chen chose to do a solo production of a radio version of the short story “The Most Dangerous Game” by Richard Connell — a story she remembers from high school as “unusual.” In it, a hunter named Rainsford falls off a boat and ends up on an isolated island where he becomes the game for another hunter.

“He starts as a man in control. But he slowly loses control as the story proceeds,” Chen explains. To capture that mounting tension, Chen employed techniques from class — mood music, voice inflection and sound effects she made as well as ones she found online. Recording herself with an iPod or a microphone attached to her computer, she used the audio editing software to alter her voice for the male parts.

At the end of the semester, the students’ productions were posted on a Web site Foster created called The mp3ater Project.

iPods are a good fit for the course because students use them in both the listening and producing aspects of the course, Foster said. “Pedagogically it killed a lot of birds with one stone.”

Listen to a clip of “The Flying Dutchman”



Listen to the beginning of Chen’s version of “The Most Dangerous Game”

In order to capture and carry forward class discussions begun by guest lecturers, Lucic records those classes with an iPod; then he posts the recordings on a class Web site for students to download and review on their computers or iPods.

Sophomore Ryan Sparrow got the assignment of leading a class discussion to further explore issues raised in two guest lectures, by Duke art history professor Anya Belkina, on her use of computer software to create video animations as works of art.

Sparrow explained one way he prepared for his presentation. “I downloaded the lectures from the [class Web site] and I put them on my iPod,” he said. “One of them I listened to while I was at work at the Provost’s office. I was upstairs in the attic doing some filing and I got to just listen to the lecture and take some notes.” (The recording from Belkina’s first lecture was particularly helpful for Sparrow, who had missed that class after staying up late to complete an engineering project.)

Listening to the recordings, Sparrow homed in on issues he thought would spark further discussion, such as Belkina’s thoughts about the potentially ephemeral nature of digital art and the transition from using a paintbrush to a computer .

Professor Anya Belkina gave two guest lectures on using computer software to create artistic animations to a class in Duke’s Information Science and Information Studies certificate program. Listen to a portion of her first talk recorded with an iPod for students to review.

In his class presentation, Sparrow gave examples of technology intersecting with art — such as 3-D printers that “print” sculptures and animation software used to design movies like “Finding Nemo” — then posed his discussion questions. (Some students use their iPods to transport large multimedia files for their presentations, but Sparrow did not.)

Remarks from his peers ranged from how Japanese animé has created stars out of voiceover artists to the notion that computer programs themselves can be works of art.

Lucic said he plans to use audio segments of guest lectures to promote his course, which is part of Duke’s Information Science and Information Studies certificate program.

iPods were also a topic of class discussion later in the semester.

“They’re going to hear Bach-style [music] the way they hear their own music,” Kelley says about integrating the iPods into his course. “You sing along to the radio, why don’t you sing along to Bach?”

Absorbing Bach’s musical style, particularly his chorales and “Saint Matthew Passion,” is the foundation for the course, in which students learn to recognize, sing and emulate his compositions.

Junior Geoff Lorenz says Bach’s music is “so well textured” with many layers of melodic lines.

“If you take [Bach music] around and listen to it constantly then eventually you’re going to hear all the different layers,” he says.

Kelley says when he plays musical phrases in class that depart from Bach’s style, his students are often quick to notice the incongruity. “I’ve never seen a class so sensitive to error detection,” he says, although it is hard to determine how much of the class’s proficiency to attribute to introducing the iPods.

The next step the class is taking with digital music technology is to a kind of eighteenth-century karaoke.

The students are asked to input the notes for all four parts of a Bach chorale into a musical notation software program. Then, each student is supposed to remove the part — bass, tenor, alto or soprano — that he sings. With this missing-voice version of the song loaded on their iPods, the students have an assignment: play the song and practice singing your part, karaoke style.

“I want you on the bus singing with your iPod,” Kelley told the class. “I want you over Thanksgiving with turkey in your mouth, singing with your iPod.”

At one class, with a CBS News TV crew filming for a story about iPods, freshman Stephen Clark won a class competition to best sing one part in a Bach chorale. Clark sang his part, tenor, as the other three parts played off his iPod, which was attached to the classroom stereo system. Clark says he practices his part, listening to his iPod, mostly on the bus — “humming, not singing loudly, but humming.”

Not everyone has taken to the digital music technology as readily as Clark.

For an hour the students — Katie Tiedemann, Dana Edelstein and Sarah Weber — observed committee members, a city councilman and staff from the Durham Department of Housing and Community Development stumble through the meeting. The students recorded the conversation on a couple iPod devices equipped with microphone attachments.

“That was the most inefficient meeting I’ve ever been to,” Weber said after the students stepped out of the meeting.

To turn the unfocused hour into a newspaper story, each student researched the stipulations of the development grant, reviewed the notes they took during the meeting and listened to the recordings they made.

In their articles, all three homed in on comments by the same committee member. Weber recounts the scene in her paper: “‘We don’t necessarily have a prescribed goal or mission at this point,’ said committee member Aaron Cain between bites of a grilled cheese sandwich. ‘I’ve been coming since June, and it seems to me that every meeting we have a long discussion about why we’re supposed to be here, and nobody’s really sure.’”

Students in Ken Rogerson’s “Newspaper Journalism” course use their iPods to listen to examples of radio journalism and to record interviews for their own stories. Three students covered a wandering local committee meeting. Listen to a portion of the meeting.

For this “Newspaper Journalism” course, the iPods are “glorified tape recorders,” says instructor Ken Rogerson, Ph.D. But, he says, the iPods are a step up from tape recorders because the iPods allow students to more easily retrieve quotes and store their interviews. The iPods also support another assignment he gives: listening to radio segments, such as a National Public Radio show on interviewing techniques. Rogerson gets permission to distribute the segments through his class Web site. The students can then download the segments and listen to them on their iPods.

Rogerson says about two thirds of the students use their iPods as recorders for the short newspaper stories he assigns each week. Compared with previous classes that didn’t use iPods, he says, “the number of sources and variety of sources [in students’ stories] have increased, and that’s been really nice.”

Listen to a portion of the meeting.



Listen to the Cain’s remark

The riveting half-hour interview with DeAngelis, captured on the women’s iPods, was part of a class project to examine how major events are remembered by various social groups and how cultural texts such as newspaper articles might influence or reflect such group memories. (Baumgartner grew up in Boulder, Co., a town near Columbine, and, based on advice from a family friend, arranged for the interview.)

The project for Professor Michele Strano’s Writing 20 course “Social Minds: Memory as Collective Practice” asked students, in groups of three or four, to conduct a dozen-or-so interviews about an event and then compare the responses to news articles about it. In addition to the Columbine shooting, students examined memories of the Apollo 11 mission, Clinton-Lewinsky scandal, Y2K, first Gulf War, O.J. Simpson trial, Apollo 13 mission and Chernobyl nuclear plant disaster.

After writing essays about the interviews and the articles, the groups gave class presentations on how the news reports and the accounts given in the interviews may be related. The students were required to play clips from their interviews to support their points. The clips were incorporated into the students’ PowerPoint presentations as digital audio files that were played through a classroom sound system. Baumgartner and April Edwards, along with teammates Dean Chiang and Matt Edwards, concluded in their presentation that both the people they interviewed and the news stories they read interpreted the Columbine shootings through the lens of themes, or what they termed “myths.” The four students cited three prevalent myths: “end of innocence,” “perpetrators as victims,” and “personal responsibility.”

“If we could pinpoint one thing — if I could tell you the reason that [the student killers] Harris and Klebold committed this crime was because of A, B and C, then people can say, ‘Well, we’ll make sure that other students do not do A, B and C.’” DeAngelis said in a clip the students played. “But we can’t. We don’t know what the cause was. They took that to their grave with them.” Listen to DeAngelis’ remark about blame. Including audio excerpts in the presentations reinforces a key principle of writing, Strano says. “One thing we emphasize about academic writing is that researchers are expected to move beyond speculation and support their claims with some form of evidence,” she says. “You make a claim, and then you give data to support that claim. Incorporating the sound files made that expectation clear.”

Freshman Rita Baumgartner conducts a phone interview with Columbine High School Principal Frank DeAngelis, while April Edwards, also a freshman, takes notes. The two recorded the interview with their iPods.

“They started thinking of the voice files and the news articles on the same level,” she says. “Through their analyses of the interviews — which they recognized as raw, subjective data from the beginning — they began to realize that the news coverage was also data about how an event is framed.”

Strano has taught other writing courses with interview assignments, but she says, with the iPods, she was better able to guide students through the process of interpreting interviews because the students could easily send her the audio files of the interviews. “I kept all 84 interviews [done by the students] on my iPod,” she says. “It gave me access to the raw data in a way that allowed me to better evaluate how they interpreted it.”

Students said that recording the interviews with iPods and including clips in the presentation made the project more engaging.

“It helps us make our points better,” Matt Edwards says. “But it was a hassle getting all the [audio excerpts] to length.”

“[The assignment] seems more practical because it’s a real world application,” says April Edwards, who called the interview with DeAngelis “eye opening.”

Listen to the beginning of the interview.



Listen to reflections from Columbine High School Principal Frank DeAngelis

In this lab for “Computational Methods in Engineering,” students picked ten seconds of a favorite song, stored on their iPods, to manipulate. They adjusted the rate at which the computer takes in samples of sound, break out individual frequencies, boost and lower frequency ranges and scramble pitch and beat.

Lab instructor Professor Michael Gustafson explained why he decided to incorporate the devices into the lab. “Rather than spend any money buying signal generators, we could just use the free signal generators [i.e., the iPods] that Duke provides,” he said. Plus, he said, the music helps connect engineering principles to a familiar experience.

Sophomore Joanna Noble had done a similar lab exercise — but without the iPods — in another engineering class. “It makes a lot more sense in the context of the music,” she said.

In the lab, freshmen Corey Butler and Stesha Doku selected the song “Innocent” by rock band Our Lady Peace (listen to the clip of “Innocent” on the band’s Web site). After recording ten seconds of the song into a computer, they ran algorithms that raise or lower the strength of certain frequency ranges in the song, and then listened to how the change in frequency distribution affected the sound.

Next, Butler and Doku applied another algorithm to the original song, which switches around certain frequency ranges, effectively encrypting the song by altering it beyond recognition (listen to “Innocent” after it has been encrypted). Finally, they returned it to its original state by applying the encrypting algorithm three more times.

Butler, Doku and other students agreed the lab is more engaging using music from their own collections, than it would be using a tone generator.

You know your own music, freshman John Pura explained, so any changes to it are “readily detectable.”
In addition to learning engineering principles, students gained insight into their songs. Pura discovered in “100 Years” the lead singer of Five for Fighting “has a really, really high range.” And freshman Emmett Nicholas discovered the Red Hot Chili Peppers’ “Universally Speaking” “doesn’t have a really strong bassline.

And Gustafson gave the class a tip for do-it-yourself karaoke — just pick a song and filter out the frequencies in the range of the human voice.