Dartmouth Seminar

I’ve mentioned a key element in my sabbatical retooling, the Dartmouth Seminar for Composition Research. The first two weeks of August, I traveled to Hanover, NH to the campus of Dartmouth College, where I participated in an intensive two-week research seminar that followed some directed reading and online discussions. I was one of about 18 writing studies researchers interested in learning more about empirical research methods. Participants were diverse in multiple ways. We came from many kinds of institutions: state comprehensives, private colleges, research universities, and community colleges. Many career stages and types were represented: graduate students, non-tenured instructors, academic support staff, and tenured full professors, with some carrying administrative duties in composition programs, writing centers, or writing in the disciplines. Research projects were diverse, too: other writing transfer research projects; CCCC-sponsored research into institutional support for veterans; online authorship; evaluating the workload of online teaching; and a variety of projects closely tied to institutional assessments.

Not surprisingly, the seminar was demanding intellectually: after a few days, some of us took to referring to it as “research boot camp.” That’s what it was. We first met the night of July 31, and finished our work August 12–just about two weeks. We had one day off: the middle Sunday. Every few days, new visiting scholars joined us to speak to their expertise: Charles Bazerman gave an overview to situating research in the larger field, and Cheryl Geisler offered a two-day workshop in coding data and discourse analysis. Dartmouth professors John Pfister gave a crash course in statistics, and Jonathan Chipman in visualizing data. John Brereton offered excellent advice about grants. Chris Anson and Les Perelman spoke to assessment and situating research in larger institutional frameworks. The last two scholars to join us, Neal Lerner and Chris Haas, spoke to research design and ethical research. We concluded with two days of presentations in which participants summarized our research design and described what we learned during the seminar, with Haas and Lerner offering commentary. Throughout, all of the visiting scholars were available for office hours and individual consultation–for me, some of the most valuable time I spent at Dartmouth.

The seminar felt like a week, or maybe two weeks, of graduate school every day. Seminar organizer Christiane Donahue planned the calendar very well, keeping us busy but providing time for individual work. Some days, especially early on, consisted of eight hours of intensive seminars. Some were divided between morning seminars followed by individual work, consultations, and group work. None of the activities suffered for want of attendance and participation. Even optional night and weekend classes were very well attended. All of the participants lived in Fahey Hall, a dormitory on campus; classes were held in a common space on the ground floor of the building. It wasn’t hard to find attendees hanging out and working in the common space on the first floor, and it was downright easy to seek help with seminar work: for example, after Geisler concluded her lectures on Friday, I suggested all interested attend a “coding party” on Sunday afternoon. About eight people showed up and worked for two hours, coding each others’ data and reviewing segmenting and coding schemes as well. This good-natured work ethic stuck for the entire seminar. Don’t get me wrong, it wasn’t all work and no play: I definitely enjoyed local beer culture with Scott Whiddon, Molly Oberlin, Justin Lewis, Tara Lockhart, and other attendees. We got to hear Charles Bazerman sing opera during a much-needed first Wednesday social. But it was great to collaborate with a group of people serious about learning and getting things done.

Much of what I learned during the seminar was focused specifically on the transfer research Neil and I are doing. As always, I took notes carefully–55,000 words in seminars, group work, and on my own. I’ve shared my wordcloud. I boiled those notes downs to eight pages of takeaways after the seminar, but can focus on three things here:

First, our research design was too complex. Neil and I wanted to use multiple methods of data collection in order to achieve the complexity we believe is necessary for understanding our research questions about writing in the major–learning about the activity systems in which our participants work. But planning for multiple kinds of data collection is cumbersome. Better to achieve complexity by focusing on case studies driven by interviews–and learning to become a very good interviewer. Here are the changes I proposed in my presentation:

original revised
  • Preliminary surveys of students in writing in the disciplines courses
  • Interviews of students and faculty at WIU and local community colleges which supply WIU with large numbers of students
  • Case studies of students at WIU and local community colleges
  • Pilot year in 2011–12; larger longitudinal study with similar methods 2012–2015.
  • Case studies of 8-10 students at WIU’s Macomb campus, 2011–12
  • Longitudinal study (methods and length to be determined) to follow.
  • Complex–many techniques to learn
  • Very labor intensive
  • Difficult to change on the fly
  • More focused research technique (interviews)
  • More manageable workload
  • Scales down if necessary, or up if desirable

Secondly, I failed to separate assessment and research. Part of the reason for the over-complex research design Neil and I imagined arose from prioritizing institution-focused goals (including all of WIU’s diverse constituencies–transfer students, first-generation college students, etc.) over research goals (gathering a manageable amount of relevant data). Ironically, over-prioritizing WIU needs could mean not meeting them as the study collapsed under its own weight.

Third, I left the seminar with a list of methodological questions to approach as I continue to learn the art and craft of empirical research:

  1. What principles can guide our comparisons of information from different sources?
  2. How can we measure the quality of our interviews—given the difficulty of research into transfer?
  3. How can we be genuinely beneficent to our participants, on the short and long term?
  4. What mechanisms can help us apply lessons learned from this study to future work?
  5. What support structures and resources will help us move the project forward?

All of the seminar leaders were very helpful, but I want to mention two in particular. I don’t know if I’ve ever seen any academic work as hard as Christiane Donahue did for the entire the two-week seminar. It seemed like she was up before everyone every day. Before all else, she created a fantastic intellectual experience for us, providing quite a bit of it personally by speaking to transfer, research design, and other specialities while offering us individual help. In addition, she arranged trips to the local grocery, helped us get access to scholarly resources on campus, and woke up in the middle of the night to help seminar attendees who’d locked themselves out of their rooms. With Kathy Herrington, I was very glad to sneak around Hanover a bit and put together a basket for Tiane which recognized how helpful she was for all seminar attendees. Secondly, Chris Haas: her talk on research ethics came at the end of the seminar when many of us were borderline exhausted. But it was invigorating, and thought provoking too. I went straight from her first talk to a chair and wrote Neil immediately to say, “Hey, we’ve got to think about this.” The two three page handouts she provided were very dense, giving me two or three specific things to think about. After I returned to Macomb, I wrote Haas with some follow-up questions, and she traded email with me, providing some very helpful suggestions and things to read–and strong encouragement as well. Much appreciated.

Quite a nice exclamation point to my year of retooling. A wise choice for all of the audiences I noted above: people like me looking for a mid-career change, early career scholars with projects develop, or graduate students looking to establish a firm grounding in research methods. I’m looking forward to following this year’s Dartmouth Seminar, and getting together with my cohort at CCCC in St Louis.

Posted in Research, Travel, Writing | Tagged , , , , , , , | Comments Off

Reading job applications

I’m sure we’ve all heard old saws about the speedy screening of job applications. I’ve always used 30 seconds as my rule of thumb. Our career services people say one minute, and it’s not hard to find job sites which time initial screening at 10 seconds. In line with my desire to shift my research and teaching toward data, I recently learned about a relevant CareerBuilder telephone survey conducted in June 2011. Two findings:

When asked how long they spend reviewing job applications, 55% of hiring managers (n=2654, ±2% MoE) said less than two minutes:

<1 min 1-2 mins 2-5 mins 5+ mins
28% 27% 24% 21%

Respondents who self-identified as HR managers (n=218, ±6.5% MoE) were even more speedy. Almost half less spend less than minute, and a quarter between one and two, meaning 72% of HR managers take less than two minutes for initial screening:

<1 min 1-2 mins 2-5 mins 5+ mins
45% 27% 17% 11%

So job applications (résumés + other documents) are likely to get more than 30 seconds of attention–but not much more. (Thanks to Ryan Hunt at CareerBuilder for sharing these data.)

Since I’m teaching technical communication this semester and next, reading job applications is on my mind in other ways. Like quite a few textbooks, our program’s book starts out by using job application materials to model core concepts (Anderson, Tech Comm 7/e, centered around usability and persuasiveness). The syllabus framework my colleagues and I share begins with this assignment. So I read quite a few job applications this semester, though I certainly spent more than two minutes on each one. (Sometimes a lot more.) As in previous semesters, I had a pretty high drop rate the first four weeks, and some palpable dissatisfaction among students who didn’t drop the course. Quite a few students submitted draft job materials which would fail the two-minute test. There were three classes of problems:

  1. Some students simply underestimated the amount of work needed to do work which meets my standards for quality, or tried to get by with generic materials not really tailored to a job description. (Of course, this can happen in any class, on any assignment.)
  2. For many students, education is what happens the classroom, and work experience is limited to service work. This leaves them very little to insert into customary résumé categories other than “Education,” and very little to say about experience and abilities in cover letters.
  3. They struggled to understand the job ads. Becoming fluent in disciplinary genres requires extensive knowledge of content, and too many students are simply unable to productively read job descriptions in their fields. Both lack of experience and lack of content knowledge play a part.

I’ve talked about the connections of genre and disciplinary knowledge in class. To see struggling students learning this lesson on the fly isn’t pretty: for example, having no way to write cover letters besides copying examples from the textbook nearly word for word, changing a few nouns here and there to keywords drawn from their field. For seniors, this is a bitter pill to swallow. And it should be for us: in these too-blank pages, we can see that students have realized that substituting academic faux-languages like “research paper” or “English essay” won’t replace the languages of magazine design, or sustainable energy, or broadcasting, to name a few of the majors I’m working with. On the one hand, this is good news: students know they need to learn more. But on the other hand, it points out our classroom practice is still problematic. When will we make the same realizations our students have? It’s downright unpleasant to see seniors struggle to connect what they have learned in their four (or five) years at the university with the languages and forms of their fields. It’s painful for them, and it should be painful for us.

With this in mind, I am eager to continue moving away from these mutt genres and finding ways to help students connect the work we can do with real genres to their classroom experiences. That’s no sure fix, but it’s a step forward. For sophomores and juniors, at least, there are possibilities. Reading collections of job advertisements can be used to map futures: the language of job advertisements we read together, now nearly foreign to students, suggests their do-lists for the next few years. I’ve asked students to speak with their advisors and professors to identify activities, internships, and other things outside the classroom which will help them learn the way their disciplines work. I’ve explained the connections between learning content, genres, and the languages of professions. This has been confusing and challenging for students, and often works better one-on-one than in class. Regardless, I want to continue thinking about ways to seeing fewer blank pages from students about to leave the university, and I hope my work with transfer and writing in the major will help.

Posted in Teaching, Writing | Tagged , , , , , , | 3 Comments

Oh, Charlotte

“Charlotte” got the worst of it in the Illinois ethics training this year. Sometimes she looked like a BAD ASS, staring down her “noncompliant” status:

I’m still wishing for scenarios which include one of our two former governors currently residing in Federal prison.

Posted in Irony | Tagged , , , , , | 2 Comments

New cast, boot to follow

Bradley's new castYesterday, two weeks after achilles tendon repair, I visited my surgeon to have my staples removed, then get a new cast and a checkup. Dr. White’s nurse cut off the old cast and removed my staples first. The incision was about five inches long, on the inside of my ankle, with the skin bunched up by the staples. (Very funky looking. I wish I’d had a camera.) I was surprised there were so many staples–about 30–and relieved that removing then was only slightly painful. The new cast Dr. White put on (at right) is much smaller and lighter than the old one, which makes everything much easier. Showering and dressing today was a cinch compared to wielding that 8-10 pounder. It’s also harder, so I feel more confident about getting around on campus. I crutched to the Union today to get a sandwich and coffee, and I’m going back this afternoon for a meeting. Nice. It is a bit tighter, at least for now, so I’m making an effort to keep my foot up more than I was in the past week.

Dr. White was pleased with the healing of my incision and the lack of swelling in my foot and ankle. He was glad to hear I’d been off the pain medication since Friday 10/28, and said my healing process looks on track. I went over my recollection of the surgery and post-op with him, and it turns out I wasn’t as loopy as I thought; what I remembered was accurate. I asked if I could switch to a VACOcast achilles boot the next time my cast needed to be replaced, so I could resume swimming. Dr. White agreed, and said he’d be happy for me to start the rehab, carefully, at that time. In fact, he suggested making the switch four weeks from now, or six weeks after the surgery. So December 1, I’ll be able to get back in the pool and do some one-legged biking on a recumbent at the Y. That will be great. And maybe a few weeks after that, I can take the next step towards that 5K.

Posted in Achilles | Tagged , , , , , | Comments Off

Three errors

I offer three error messages today, all from WIU’s current effort to increase network security. Like a good writing workshopper, compliments first. When I had problems connecting to the secure network yesterday (I suspect it’s overloaded, as it’s time to make the conversion to secure wireless), I tried the old, unencrypted one. I was rerouted to this page:

Secure wireless redirect

Secure wireless redirect

Good; that tells me what to do. Not as good: when I followed the directions, downloading a Java applet, checking the publisher, etc., then entering my username and password, a second error was raised (link through for text):

Timeout or wrong password?

Timeout or wrong password?

I’ve been using the secure wireless (and recommending it to students) for about a year. Perhaps that’s why, even though I got this “failure” message, I connected just fine. In any case, the error message is problematic–is the problem a wrong password or a network timeout? Software shouldn’t ask users to distinguish these very different problems–especially when, by policy, we’re locked out after five failed logins. Better to say what’s wrong and allow us to correct the typo or report the network issue.

Finally, here’s some wording which could be a little better:

Authentication server error

Authentication server error

“The credentials you provided cannot be determined to be authentic.” Hrm. This is from the new authentication server–again, a welcome change from the days of expired and/or self-signed certificates. We should drop the Official Style here: “Wrong username or password. Please try again” seems a reasonable substitution.

Thanks to the WIU technology people for the security push.

Posted in Nerdliness, Writing | Tagged , , , , , , , , | Comments Off

Odds and ends crutchtime

A catchall as I start my second week after Achilles surgery.

Crutches checklist I went to campus three days this week, my teaching days Monday, Wednesday and Friday. Limited mobility means I have to get systematic about things which I imagine most of us do ad hoc: a checklist for getting out the door, since I can’t run home to get things I forget, and I’m more forgetful than usual on pain medication; keys in the left pocket, phone in the right; planning my movement around the building and campus, since our elevator is slow; cutting back on coffee, since 15 minute round trip walks to the union just aren’t gonna happen. Etc. I already have daily checklists for class, and use our groupware calendar extensively. So that’s not a very big adjustment. I’m lucky that my classroom is about 50 feet from my office.

I’ve had a lot of help. Multiple colleagues have offered to drive me to and from campus. Our department office manager Barb Arvin did a fantastic job getting me a few accommodations for teaching without walking. In less than 24 hours, she got a rolling desk chair for my classroom–much easier to scoot around for group work and the like than to use crutches– and got Physical Plant to fix my sticky door lock and slow down the timing on the door closer to the bathroom I use most often. She and my department chair gave me rides to and from a meeting. My students have also been very gracious. Every day before and after class, students have volunteered to help me carry books, open doors, and the like. Small things, but add up to a tremendous difference, and I appreciate them very much.

AJ and the girls At home, things are going well, too. Friends brought food the first weekend after my surgery. John and Karen brought greens from the garden. Since I was planning to go to a conference, we had already scheduled sitters so Erin could go to book club. They came over to help with bedtime, since what I could do was limited, to say the least. AJ brought a great math activity from her block teaching to share with the girls, and Elisa worked her baby whisperer magic on Amelia the next night. My parents arrived Monday, taking over most of the chauffeur and taxi duties from Erin, and helping with housework, harvesting tomatoes in kale in advance of our first freeze, etc. I’ve been able to help in limited ways, like reading books to the girls, prepping food, and directing Madelyn during pick-up-around-the-house time.

Zippy pants and foot-hat I’ve made some little adaptations to get around, like wearing my fingerless bike gloves most of the time, since my hands get a workout from the crutches, and wearing a backpack most of the time as well, so I can carry things around school and the house. One of my travel mugs fits right onto the handle of my crutches, which is nice. We’ve put a stool into the bathroom so I can put weight on my left knee while I shave and sponge myself off (no showers for now). And at times I give up on standing and just sit down to do stuff–like the other day when I couldn’t find one of my NA beers in the fridge (no real beer because of pain meds). My mom put zippers into two pairs of pants for me so I can get them over my cast, and modified a hat to fit my foot. All in all, while crutches are certainly an inconvenience, I’ve figured out ways to keep up some of my normal activities, with help from others. I’m glad my parents visited–they were helpful, and Madelyn and Amelia were thrilled to see them.

Erin deserves the most credit here. She’s been simply great, never blinking despite adding an array of duties to her mama schedule. I never forget how wonderful my wife is. But now it’s especially apparent. I’ve recruited friends to help her get some time for herself. After I hang up these crutches, I’m going to invest some serious energy into that project.

Today is our sixth pajama party for the girls’ birthdays. Breakfast at dinnertime, Erin’s choice. We count 70 people on our RSVP list. Gonna be a full house, to say the least. Erin and my mom put together the “haunted closet” which the kids love. I’ll be cutting up some pineapple soon and helping make some other things. And so far today I’ve been off the pain meds (yay!) so maybe I can have a glass of beer with my pancakes.

Though I missed MWCA, Neil and I have kept up our research schedule. We’re halfway through the second round of student interviews now, and we’re contacting faculty members to make arrangements to interview them. This weekend, we’re answering a call for proposals for the Kairos special issue on multimodality and writing across borders. Friday afternoon, we spent an hour and a half catching up, planning our work for the rest of the year. We decided to start using a weblog to write regularly about our progress. I’ll have more to say about that shortly.

What else? Not much. Getting to and from the university, helping with parenting, and keeping up with research is enough. Wednesday and Friday, I was booked pretty much solid 9-5: and exhausted at the end of the day. Certainly, I’ve had no problems sleeping since my surgery! As my leg heals, perhaps I’ll be able to do more–but I’m not going to overdo things. Better safe than stupid. This coming week, I meet with my surgeon Thursday; he’ll remove the staples and put on a new cast, and we’ll talk about my rehabilitation. I’m going to ask if I can switch to a VACOcast achilles boot a few weeks after that. It would be great to be able to walk before February.

Posted in Achilles, Family, Research | Tagged , , , , , , | Comments Off

Three and six

Today in 2005, we welcomed Madelyn into the world. Three years later, Amelia was born. Two girls born on the same day! Today, my big girls are three and six. We celebrated with my parents: dinner, cake, ice cream, a few presents, and a video chat with my brother and his wife (Aunt Erica and Uncle Curtis).

Birthday girls

This is just a start. Our annual ridiculously huge pajama party is late afternoon this Saturday. Y’all come.

It’s a fantastic life we have, my girls and I.

Posted in Family | Tagged , , , , , , , , | 1 Comment

Amazon error

Amazon error message

Posted in Whatever | Tagged , , , | Comments Off

Infographics, tables, and spring teaching

Information visualization is hot stuff these days, as sharing on Facebook shows. Ivan Cash built an “Infographic of infographics” based on Good.is visualizations. FastCompany offers five tools for making your own. Some Occupy Wall Street supporters are printing them on dollar bills. As I start building a spring 2012 course in visualization, I’m looking for texts, examples, starting points, courses others have taught. I’d love to hear your ideas.

Right away, I’m wondering about notology: how much time we’ll devote to what not to do. There are lovely visualizations out there, but a lot of noise competing with the signal. Too many “infographics” would be better rendered as simple text with an occasional chart or graphic, rather than a gigantic graphic. Here’s an example, “Securing yourself from a world of hackers,” 1000 pixels wide and 3172 pixels tall. Another, “Profile of Mac vs PC,” is 947 × 3693. Both graphics approach interesting subject matter: password security is particularly welcome, and the Mac vs PC comparisons are funny. But execution is poor. Form seems the starting point, not content. (“Infographics are hot hot hot. Go get me one.”) Worse, I see plenty of of questionable how-tos high in Google search results. Again, I welcome suggestions for high quality sites.

Detail of password infographic

I’m considering opening week work which features a few graphics, discusses their high and low points, and makes clear that visualization is not just prettying up (poor quality) content. Tying these activities to course objectives would set a clear path for the semester. For example, content in this password security graphic is weak:

  • The headline “Securing yourself from a world of hackers” is alarmist and misleading. Any security professional will say “securing yourself” is impossible. Reducing risk? That’s possible. Unfortunately, bad content carries through to “How to create the perfect password”–no. There can be no perfect password; no security mechanism is perfect. The copy promises something which can’t be delivered. From a security firm, this is disappointing.
  • The method for password generation and memorization is questionable. Try the mnemonic recommended here: it’s cumbersome at best. They generate ?LACpAs56IKMs” with five steps. Who can remember this? How is it more secure than other common methods of creating pseudo-complex passwords? If, as they recommend, it’s okay to write down passwords, why not just use randomly generated character strings? And it’s incomplete: they recommend testing passwords, but don’t say how.
  • The authors call on a few sources (Schneier) but cite irregularly, truncating citations to base URLs or not including them at all. The graphic mentions NASA guidelines but there’s no mention of NASA in the sources. Not a good example for academic writing!
  • Writing style is wordy and inconsistent. Some bullets use second person; some use third person. (“It is okay to write passwords down so they can be remembered” not “You can write down your passwords” or “Writing down your passwords is okay.”). Copy needs revision to bring characters and actions forward.

Etc. This maps to an objective about enhancing high-quality content through careful representation of data. Similar critiques could be targeted at others: effective design, knowing common visualization approaches, and familiarity with common visualization tools. (I guess it’s time to build out those objectives, eh?)

What “good” graphics should I include? Tufte’s well-known favorite, Minard’s rendering of Napoleon’s march? Staying meta, David McCandless’s What Makes Good Information Design? would be a good pick. I like both, but I think I also need some tables. Sometimes, tables are just better. A course in visualization which taught students how to make accessible, effective, well-designed tables would provide a very useful and transferable skill.

Posted in Nerdliness, Teaching, Visualization, Writing | Tagged , , , , , , , | 2 Comments

Transfer research design

I mentioned the transfer research project Neil Baird and I have started when I discussed my sabbatical retooling, but I haven’t written much about it here; just a brief outline long ago when I discussed my application to the Dartmouth Seminar. Since then, things have changed quite a bit. So here’s a more in-depth look at the evolution of our research design over the past year.

In October 2010, not long after I committed to retooling, I approached Neil to see if he wanted to collaborate to study transfer, since I knew from our research group he had experience with qualitative research. Like me, he was interested in the transfer research of Elizabeth Wardle and other scholars, and agreed that our writing program needed to better understand transfer student needs and other changes reverberating from WIU’s adoption of the “2+2″ model. I outlined the work I imagined doing to Neil, shared the Dartmouth Seminar application, and suggested we apply for a University Research Council (URC) grant as well. This is WIU’s featured internal grant, up to $5,000 “intended to promote research or its scholarly equivalent in appropriate fields by providing ‘seed’ money for the initiation of new projects.” We began meeting regularly in November, sharing readings in writing transfer, methodology, and working on the grant application as a way to begin designing a study. As Neil and I talked, we realized our long term research interests shared a key commonality:

  • I was refocusing on ease, the array of specific practices which favor simplicity and transparency over complexity and difficulty, and discovering strong correspondences between qualities discouraged by ease yet conducive to transfer.
  • Neil had long studied the negotiation of writerly identity which occurs when writers learn the particular worldviews, genres, and tools associated with the communities in which they seek membership. Imagined as conflict, this negotiation could hinder transfer.

That is, we realized both ease and negotiation might operate as barriers to transfer, and we could shape our study around this concept and the institutional needs we agreed were most pressing. Thinking big, and with some previous studies we liked in mind, we begin imagining a multi-year project which sought to collect data from multiple sources, answering the oft-discussed difficulties of studying transfer: surveys, interviews with faculty and students, and case studies which included analysis of student writing. Piloting the research would begin in 2011-12, most of the work would take place in 2012-15. We named the project “Transfer @ Transfer,” since our target is writing transfer in the upper division, and it’s a given at Western that includes many transfer students. By December 15, we had our application to the Dartmouth Seminar ready to go, and we were thrilled to see our acceptance in early January. At the time, these were our research questions:

  1. What successes and failures do students have as they move from writing in general education courses to writing in their majors?
  2. What strategies do students use to transfer writing skills and knowledge from writing in general education to writing in the major? Baird: how do students negotiate rhetorical and ideological conflicts between two or more activity systems? Dilger: does ease (making easy as a strategy for mitigating complexity and difficulty) play a role?
  3. What differences in transfer of writing skills and knowledge, if any, exist between students who satisfy writing requirements at two-year and for-profit colleges, and those who do so at WIU?

In January, Neil and I began writing the URC grant. We began to articulate our research design more explicitly: we sought to collect data which would allow us to understand the activity systems involved in transfer. For this reason, we imagined a three-stage research design: surveys designed to generate preliminary data and help us recruit students and faculty for more in-depth interviews and case studies. We planned to interview faculty and students at WIU and area community colleges which send large numbers of transfer students to WIU, followed by case studies of students at WIU and perhaps community colleges as well. Given the many different student and faculty demographics in which we were interested, we thought a fairly large number of participants would be required to be able to effectively answer questions raised by our institutional exigences. Faculty interviews would allow us to understand how transfer was (or was not) discussed in the classroom, and would help us understand better understand students’ experiences. We assumed, based on the literature, that talking with faculty would be needed to help us understand what students could or could not transfer–to get access to students’ thought processes, and to help us learn more about things students might not even be conscious of. With methods on our minds, Neil and I proposed a roundtable on transfer research methodology for the Midwest Writing Centers Association conference, October in Madison.

In March, the online component of the Dartmouth seminar began–email, telephone consultations, and group video chats with Dartmouth facilitators and other participants. These conversations helped Neil and I begin to see the limits, or rather the over-extensions, of our research design: the amount of work we imagined was just too large. (After one email exchange with Charles Bazerman, I checked a spreadsheet I had built to project our workload, and discovered an error which underestimated some required time by a factor of 5. Doh!) So we began to scale back the size of our study while keeping our diverse data collection methods. That is, we still felt that our research required a rich set of data to work with in order for us to understand the activity systems in which our writers moved, and to gain access to the discursive processes involved in transfer. We believed workload could be addressed by reducing the number of participants in each leg of the study, and finding ways to be more efficient (including more than one student from the instructors in the study). By the time we submitted the URC grant in April, we had made changes which reflected this thinking, and we submitted a research design to our IRB as well.

Three items of good news came in May when we found out our proposal for MWCA was accepted, we were awarded the URC grant, and our IRB protocol was approved. At this time, we were still planning to use surveys for the first stage of the study, with the hopes of targeting summer courses, but it soon became clear that wouldn’t work, since there were so few writing in the disciplines courses being taught. We also had trouble scheduling interviews: there just weren’t that many people around WIU or our local community colleges. My travel schedule didn’t make things any easier. We did get to interview four WIU faculty, and those interviews gave us a lot to think about. But we didn’t get as much work done as we planned.

When I traveled to Hanover for the Dartmouth seminar, I had the opportunity to sit down with Chris Anson and Neal Lerner, describe our intentions in detail, and get feedback about our plans. Independently, both Anson and Lerner suggested further changes would be wise. They agreed that Neil and I needed to find ways to get at information which would not necessarily be articulated by students. But they suggested that we didn’t need to work both sides of the problem–community college and writing in the major–to fully understand it. And, again independently, they suggested a different approach: rather than multiple kinds of data collection, turning to stimulated recall or techniques like those used by Flower and Hayes. Over the next few days of the seminar, I realized we might drop everything but the case studies, reconceptualizing those around interviews, and reintroducing other types of data collection if needed. Rather than spending a lot of effort to develop and execute surveys, interviews, and other instruments, then building an analytical framework to bring their data together, we should focus on interviews with a small number of students, and broaden data gathering only if it became necessary. I wrote up my ideas and shared them with Neil, and we quickly came to consensus about a new design.

That brings us to the current time. Neil and I recruited participants by visiting writing in the disciplines classes in August and September, building a pool which satisfied us in terms of demographic and curricular diversity. We made contact with ten students and interviewed them all once, with very interesting preliminary results. We’ve continued refining our design and our goals, and submitted a proposal for the CCCC Research Initiative. Over the next year, we’ll interview our participants four or five more times, collect their writing, discuss it in depth, talk to their instructors, and learn how writing transfer happens for them. As we move forward, I hope to keep up with our study here. Reconstructing what we did from email, meeting notes, and other archives is possible, but it would be far better to have a more formal record.

Posted in Composition, Research, Teaching, Writing | Tagged , , , , , , , , | Comments Off