Reason and Persuasion On Coursera – or – Look, Ma, I’m a MOOC

by John Holbo on February 9, 2014

Yep, I did it. Love me if you like. Hate me if you have to. Officially, the course starts tomorrow, but we were ready so we flipped the switch.

[UPDATE: Probably I should mention this, in case people don’t know about Coursera. It’s free and you can just sign up now and take the course, if you care to.]

Here’s what I have learned so far. It took me a really really long time to prepare. (And I’m still not done.) One of the main worries about MOOC’s, of course, is that they will accelerate the adjunctification of the profession. That’s a serious concern, which I share. But doing all this work has left me with increased respect for the quiet efficiency of our old-fashioned, medieval, live lecturing ways.

I can give a decent 90 minute Plato lecture with just a few PPT slides and a half hour to collect my thoughts. This Coursera thing was way more labor-intensive. I’m embarrassed even to admit how many dozens of hours it took to prepare for each 90 minute recording session. This does not, of course, refute concerns that this new form will accelerate adjunctification. We can talk about it.

Allegedly I have 34,000 students on Coursera. (People are funny!) I am simultaneously using this material ‘internally’ at my own school to teach a class of just 100 students. I am doing a ‘flipped classroom’ thing. The idea being: contact time is not lecture time but discussion time. We’ll see how it goes.

It was fun making illustrations to go with all my lectures. I used lots of old images from my book [amazon] and made new ones. Good excuse for a spot of cartooning. (More than a spot. Who am I kidding?)

The first two weeks are on Euthyphro, so I’ll just share one illustration. I guess I could call it “Goya McKronos Kronos”. Possibly it is an allegory of MOOC’s eating traditional academic teaching. (Click for larger.)

0054cronos

Sometimes I take it a bit too far – is what I am confessing. (But I have this dream of an animation style halfway between cartoon modern and black figure vase.)

I do believe that doing this sort of thing makes sense. (Not the cartooning. The MOOC’ing.) I hope it works out and isn’t a disaster.

{ 36 comments }

1

js. 02.09.14 at 6:32 am

So what happens with these 34,000 students? Is there progress tracked in some fashion? They get some version of ‘credit’ somehow? And this is all done by Coursera? I’m presuming you don’t have a battalion of TAs at your disposal. Just genuinely curious. But the ceding control over evaluation, which is what I’m imagining must happen, does seem a bit strange to me. (And I’ve taught classes with TAs.)

2

John Holbo 02.09.14 at 6:54 am

There’s an informal Statement of Accomplishment we give out if you take the quizzes and write a short paper that will be peer-assessed. No grading by me or any TA.

The Statement of Accomplishment is not any sort of official anything. It isn’t credit with Coursera or with my school or anything. It’s just a gold star.

Even so, I’m nervous about it. Purely peer-assessed paper marking? Seriously, that can work?

Well, we’ll give it a try. It’s an experiment. I would like to be able to combine peer-assessment with regular old grading in my regular teaching. People can do so much more writing if they can be peer-assessed. And the practice of assessing other people’s writing is excellent practice, obviously. If I find that it doesn’t blow up, in this external environment, I’ll use it in my regular teaching.

This thing is going to be proof-of-concept, in a lot of ways. (Or disproof-of-concept, as the case may be.)

3

John Holbo 02.09.14 at 6:59 am

As to the 34,000. I would call that number a Walter Mitty number. It is the number of people who saw the course offering, thought ‘I could be a great philosopher!’ and clicked a button. If I get 10% of them showing up regularly, I’ll be surprised. We’ll see.

If more than 1% do the assignments, I will be shocked down to my shoes. That means that, in the end, if I want to try to monitor how peer-assessment it going, it will merely be a lot of work, not literally impossible. If 300 people submit short papers for peer assessment, I’ll be amazed. Maybe no one will.

But maybe a lot of people will watch the videos. That seems more likely.

4

godoggo 02.09.14 at 7:04 am

We’re not payin’, because this guy, this guy’s a fuckin’ MOOC.

5

John Holbo 02.09.14 at 7:07 am

I know. It’s the worst word since ‘blog’.

6

L.D. Burnett 02.09.14 at 7:07 am

Do you retain the intellectual property rights to all this material you’ve developed, or is Coursera free to use/repackage your course materials for future/other courses? If it’s the latter, and if that’s the SOP for MOOCs, then it seems that eventually adjunctification might segue fairly smoothly into automation.

Also, is this something that your university/department has signed on to do, or is this a freelance project for you?

If it’s a freelance project, what persuaded/possessed you to do it?

7

John Holbo 02.09.14 at 7:30 am

“If it’s a freelance project, what persuaded/possessed you to do it?”

It’s sponsored by my school, NUS. So I’m doing it at the behest of my home institution, and I’m getting credit in that sense. But NUS isn’t giving academic credit to all the non-NUS students who choose to take it for free.

Your concern that, having paid me to make it, NUS could fire me and keep using the videos, is basically correct. They could do that. NUS isn’t interested in engaging in a race to the bottom, like that, however. NUS wants academic prestige and turning itself into a YouTube channel would not be the way to do that. But obviously this sort of thing has a basic pedagogic functionality. The idea is to incorporate these resources into a better course than I’ve ever taught before. Students have a nice, well-organized page where they go to watch lectures. And when they meet with me, they really meet with me. Contact hours are no longer lecture hours. (That’s the flipped classroom dream. I’m not exactly living it at the moment, however. More the Coursera launch preparation nightmare!)

8

Plume 02.09.14 at 7:35 am

Massive Open Online Course. That’s a new one for me.

Watched your intro and it sounds really good. I actually have a pretty strong background in philosophy, though it’s mostly self-taught, and I’m a few years past when I read it voraciously. Actually, more like twenty years past it. Is this the kind of course that would work for someone with a coupla degrees and a long history of reading the humanities, but some distance from this particular subject?

As in, a lot of time to forget what was read?

9

L.D. Burnett 02.09.14 at 8:52 am

Well, I wasn’t really thinking of your own institution keeping your videos and ditching you! I was wondering what Coursera would be able to do with your lectures outside of whatever particular set-up they have with your institution. In other words, could Coursera take the materials you’ve prepared and repackage them for other institutions, other state college or university systems?

I’m guessing a big MOOC development company — Coursera, Udacity, etc. — that had acquired/accumulated the work of many profs at many institutions could figure out a way to cobble together a made-to-order MOOC-based general ed curriculum for a state system, a curriculum that could be managed by TAs or graders or discussion board monitors. In fact, the governor of Texas has been pushing for a $10,000 4-year degree program, which would no doubt require a great deal of online instruction in one form or another. If enough profs at enough different institutions make that initial and quite considerable investment of time/expertise to develop courses, then Coursera (or some other company) will eventually have enough raw material to shape into a some kind of basic curriculum, and something like that $10K mostly-online B.A. becomes a real possibility — though what kind of possibilities or opportunities such an education would open up for students is another matter.

I guess I see this as a kind of two-tier system of cultural capital in the prestige economy of higher ed. There are the MOOC-producing-institutions and the (potential) MOOC-consuming-institutions. Stanford, for example, is probably not going to be accepting MOOCs for undergrad credit any time soon, but there might be many institutions who would be pleased to offer credit for a MOOC featuring lectures by a Stanford prof — or a NUS prof, or an MIT prof, or whatever. That seems like an undesirable outcome, especially for students at institutions at the bottom of the prestige ladder –large underfunded state systems or community college districts looking for cheaper, more “efficient” means of teaching more students with less money.

As you see, I’m leery of MOOCs. But I’m considering enrolling in yours, if it isn’t too late. It’s either that or work on my dissertation.

10

John Holbo 02.09.14 at 9:31 am

” But I’m considering enrolling in yours, if it isn’t too late. It’s either that or work on my dissertation.”

Oh, it’s not too late. You can sign up any time before it’s finished.

“In other words, could Coursera take the materials you’ve prepared and repackage them for other institutions, other state college or university systems?”

Not without NUS’/my permission. Coursera doesn’t have the copyrights.

11

Phil 02.09.14 at 9:51 am

“Flipped classroom”: students study at home (lecture material plus follow-up material and wider reading), then come together for discussion.

How we taught at a Russell Group institution where I worked once: students come to lectures, then go home and study (lecture notes plus follow-up material and wider reading), then come together the following week for discussion.

Compared to that, this model strikes me as not so much flipped as truncated.

As for adjunctification, I think we’ve got plenty of that already – and it’s certainly true that developing and delivering this stuff doesn’t of itself call for more adjuncts. But what I think it does throw into the mix is, firstly, greater pressure on those precarious positions themselves (the sector as a whole just isn’t going to need as many adjuncts as it does now); secondly, obstacles in the way of progression out of adjuncthood (“we really need someone who’s got experience of teaching and publishing and funding applications and MOOC delivery…”).

12

John Holbo 02.09.14 at 10:33 am

“students come to lectures, then go home and study (lecture notes plus follow-up material and wider reading), then come together the following week for discussion.”

Isn’t this just the traditional model? Come together for lectures. Read at home. Have some discussion sections?

I’m not sure why you say my approach is ‘truncated’. Are you saying the flipped classroom model itself is truncated? Or just that I’m not doing it right? (To tell you the truth, I’m NOT doing it right. Not yet. But I don’t see how you could know that from the post!)

13

John Holbo 02.09.14 at 10:34 am

“greater pressure on those precarious positions themselves”

I admit that’s a real concern. I’m concerned about it.

14

Phil 02.09.14 at 11:15 am

Are you saying the flipped classroom model itself is truncated?

Yes – home study/class discussion instead of lecture/home study/class discussion.

15

otto 02.09.14 at 11:52 am

“I am simultaneously using this material ‘internally’ at my own school to teach a class of just 100 students. I am doing a ‘flipped classroom’ thing. The idea being: contact time is not lecture time but discussion time. We’ll see how it goes.”

I would be interested to know how you make/will make a 100 person discussion work — are you still in the same lecture room for 100 students as before? or what? I am interested in this flipped classroom aspect myself but a bit unsure of what it means in practice, and whether students will have incentives to turn up for the discussion of they can keep up minimally via lectures at home.

16

QS 02.09.14 at 12:25 pm

I’m also at NUS and the center for teaching there is very keen on us trying the “flipped classroom.” I get its logic for the sciences/maths, where the classroom time is a workshop and the prof goes around helping students work through problems. I couldn’t figure out its logic for the humanities/social sciences, since we have discussion sections that already do this. And we have upper-level seminars which combine lecture/discussion. So, what’s the utility there for us and our students?

17

Donald A. Coffin 02.09.14 at 6:42 pm

“Even so, I’m nervous about it. Purely peer-assessed paper marking? Seriously, that can work?”

In the two MOOCs I have actually taken, the peer assessment was fairly well done in the first and not well done in the second. In neither case were we given anything approaching a rubric for reviewing other students’ work. And in the second case, there was a fair amount of (peer) pressure just to give everyone high marks.

By the way, I had signed up for your course, but dropped out about a month ago, as I have wound up teaching two courses this semester (in my “retirement”). I hope it goes well.

18

Donald A. Coffin 02.09.14 at 6:45 pm

L. D. Burnett asks: “Do you retain the intellectual property rights to all this material you’ve developed, or is Coursera free to use/repackage your course materials for future/other courses?”

From Coursera’s point of view, the instructor (or the instructor’s sponsoring institution) owns the intellectual property. Their course development agreement specifically excludes their ability to re-use the material on their own. Which is as it should be.

19

Klingsor 02.09.14 at 8:48 pm

Can you watch videos of the lectures w/o signing up for the course?

20

L.D. Burnett 02.09.14 at 9:17 pm

Well, I think I should probably NOT enroll in an online philosophy class in the middle of this chapter draft — but some day I’d be interested to see for myself how a MOOC operates in practice.

On the backchannel functionality, my surmise is that Coursera must have some way to monetize — or at least mine — the incredible amount of student-generated data that must come along with a course like this. In much the same way that turnitin.com has accumulated a library of student writing, I guess Coursera must be doing the same thing — along with peer review comments, instructor comments, etc. That’s a lot of raw data / writing / “content” that will surely be put to some profitable use.

21

Donald A. Coffin 02.09.14 at 9:26 pm

I don’t know the details of Coursera’s business plan. But it does enter into partnerships with institutions, and those institutions pay a fee for Coursera’s hosting. In addition, Coursera has begun charging for some versions of some courses; those courses provide a higher level of interaction with the instructor and/or TAs than do the free courses (or free components of courses). And you get a shinier certificate.

Where this is all likely to wind up is anyone’s guess. My guess is that the “free” tier will remain much as it is, with low completion rates. The current “pay a little” tier (but $100 from 20,000 students in a course is, after all $2 million) will continue to look like it does. And I expect a “for-credit” tier, in which the online platforms (Coursera, Udacity, edX, etc.) will share tuition revenue with the institutions offering courses for credit. But we’ll see.

22

John Holbo 02.09.14 at 11:13 pm

“Can you watch videos of the lectures w/o signing up for the course?”

No, you’ve got to sign up. But it’s pretty simple. And free.

23

Anders Widebrant 02.10.14 at 5:54 pm

I spent the past few days plowing through the first week (videos first, then the reading, but I think the other way around is maybe better?) and this is very impressive and incredibly interesting already.

And I didn’t think of it when I signed up, but just putting a, well, personality to the name of someone you only know through writing is kind of a big deal. Part of what makes me love Bloggingheads (and the heads who blog there) so much.

24

chris y 02.10.14 at 7:41 pm

I hope you’re going to run this again, because it looks fantastic but I can’t do it right now because I’m up to my neck in another MOOC.

25

Main Street Muse 02.11.14 at 1:24 am

So people sign up by the thousands to take a course where they are graded by other people who’ve signed up for the course (implying they are not expert in the subject?)

That’s what I don’t understand. How do they know they’re on the right track? I can’t imagine my students providing the only feedback for my students. I would be very interested in hearing your thoughts on this experience at the end of the course.

26

js. 02.11.14 at 2:14 am

I second the entirety of Main Street Muse’s second para @25. But, Holbo, thanks for the response upthread. But this:

That means that, in the end, if I want to try to monitor how peer-assessment it going, it will merely be a lot of work, not literally impossible. If 300 people submit short papers for peer assessment, I’ll be amazed.

Umm, wow! Reviewing students’ comments, or “assessments”, on 300 papers seems insane!? (And that’s just one assignment. If you reviewed one assignment in full, and say 5-10% what’s turned in for the other assignments, then assuming 300ish students are turning things in, you’re getting pretty close to ‘literally impossible’, no?

27

js. 02.11.14 at 2:16 am

Not that peer assessment can’t be great, of course. It can, in my experience, work brilliantly in a class of 30. In a class of 300, I continue to have somewhat serious doubts.

28

Batocchio 02.11.14 at 3:06 am

I thought the first set of videos was pretty good. As others have noted, peer review is the weakest part of Coursera classes (rubrics do help, but only so much). I’m glad there’s a quiz element as well. Anyway, good luck with it all!

29

Alan White 02.11.14 at 3:13 am

The novelty of the game of “telephone” results from slight misunderstandings chronically enhanced from multiple serial iterations. MOOCs it seems to me synchronize the same phenomenon proportional to audience population. What a live face-to-face smaller audience also faces in this same way is ameliorated by (potentially) instantaneous feedback on matters of interpretation by the standing call for clarification (by raised hands) that then smears across the ensemble for the real possibility of more precision and insight. I fail to see how MOOCs can possibly solve the synchronic telephone problem that it faces by virtue of the medium it embraces in the first place.

30

John Holbo 02.11.14 at 6:20 am

“Umm, wow! Reviewing students’ comments, or “assessments”, on 300 papers seems insane!?”

Well, I’m not planning to do it. More this: if there is a problem, I can at least take a look and see what kind of thing is going wrong. It’s not totally unsurveyable.

31

Ronan(rf) 02.11.14 at 2:33 pm

Oh noice, consider me signed up ! Though I wont be doing the coursework. For people wondering, watching the videos only is fine, with the only downside really being that you forget 98% of it within the month. Ive done it on a HEAP of them so far and learned nothing (except that game theory really has no applicability to real life) but some of the basics do stick if you make minimum effort. Theres also, of course, a scale on this stuff between doing nothing and doing all the work, so people could easily work out a happy medium and do as much as they please and learn what they like..

John Holbo, Ive always wondered what you spoke like (well not always, of course) but more do you speak in exclamation marks ! ? Now I’ll know for good ! Ive always pictured dsquared speaking like Al Pacino in dog day afternoon with a Welsh accent (‘Im dying here dyn’ ..’why are you always saying youre dyin, dyn? youre not dyin’.. that sort of thing)

32

Enlin Pan 02.11.14 at 5:01 pm

Holbo, I signed up for the course merely out of curiosity, not intending to spend much time on it. Now I find it’s interfering seriously with my getting anything else done, d..n you.

Some hard statistics for another course I took:
14,004 students enrolled in the course, 472 students were active during the semester and 291 students earned a certificate (got at least a 35%).

33

L.D. Burnett 02.11.14 at 8:40 pm

The February issue of the AHA’s Perspectives includes a forum, “Historians respond to MOOCs,” with comments from Elaine Carey, Philip Zelikow, Jeremy Adelman, Ann Little, and Jonathan Rees. Here’s a link to the TOC, which contains hyperlinks to each paper in the panel:

Perspectives 52, no. 2, February 2014

The perspectives represented range from MOOC-friendly to MOOC-agnostic to MOOC-skeptical. Some interesting insights from people who have taught MOOCs about what worked/didn’t work.

34

Donald A. Coffin 02.12.14 at 12:09 am

FWIW, here a link to my response to being a student in a MOOC:

http://jotlt.indiana.edu/issue/view/555

35

John Holbo 02.12.14 at 2:05 am

“14,004 students enrolled in the course, 472 students were active during the semester and 291 students earned a certificate (got at least a 35%).”

At the moment I have 37,000 enrolled and 7500 who have accessed in the last week. That is, they actually showed up since we started. Re: your figures. I’m surprised so many students are interested in the certificate option. I figured most people would just want to browse a few videos, not really ‘take a course’.

Thanks for the other links. I am been so buried in prep I haven’t even been reading lots of recent stuff about other people’s experience with MOOCs. Now I’m getting curious about all that again.

36

Andrae 02.13.14 at 10:25 pm

The numbers for one MOOC I took (and completed):

67,800 peak registration
~64,000 still registered at the end of the course
~9,100 logging into the site per week during the last half of the course
4450 passed the assignments and received (pdf) certificate

My experience with MOOC’s is positive. I have enrolled in about 40 (in coursera, you can’t always assess if you wish to do a course until you are enrolled); actually gone on to attempt about 8, and completed 3.

The 5 courses I have attempted and subsequently dropped involved tight, rigid assessment schedules that assumed a full/part-time dedicated student. They subsequently ran afoul of work and other commitments that interfere when you are doing the course in your spare-time. The 3 courses I did had either weekly or fortnightly assessment, but allowed at least 3 weeks for submission—often more.

Comments on this entry are closed.