Share and discuss this blog



Friday, March 8, 2013

I was wrong about the Testing Bed, but they are almost here

In 2001 I wrote a book called “Scrooge Meets Dick and Jane” that predicted a school that consisted entirely of testing beds:

from page 87 

“When did they invent the test bed? inquired the girl. “That surely changed things I dare say.”

“It just made clearer what was already a done deal,” said old Joe. “The goal was to get students to be comfortable and perform as well as possible on tests. Once they were wired into the internet in their own test bed, they could get questions and answers repeated over and over until they knew the answer pair. This made it easy to require 100% on every test and students could just lie there until they had memorized it all.”


So it turned out I was wrong about the bed. Here is a picture of a room at the Carpe Diem school, (sponsored, of course, by Bill Gates.)


Thursday, March 7, 2013

measure or die: why the schools will only get worse




If you want to know why education is bad and getting worse all you have to do is read the questions sent by potential investors who were thinking about working with our learn by doing experiential model of education.

Now, I have to say that these particular investors are well known bad guys in the education space and why they were interested in investing in us is anybody’s guess. But the questions were so telling, I thought people should see them. 

1. What evidence do they have of the effectiveness of their particular programs, if any?  What evidence do they have from Socratic Arts of effectiveness of a similar model with a similar student base and similar subject matter areas? How do they plan to gather evidence of effectiveness?

Why do I think this is a terrible question? Imagine that someone asked how we could measure your effectiveness as a parent. You might take a offense at this question or you might say “my kids love me and lead happy and fun lives.” Or you might say how they were doing in school.  What you would probably not say is “ I am a very effective parent and I know this because my kids got 800s on their SATs.”

But if these people were put in charge of parenting, or if they invested money in parenting classes or mentoring, they wouldn’t accept subjective answers.

Effectiveness always means test scores. We don’t have them yet for parenting measures but we sure have them for school and that is because measuring effectiveness is now seen as a legitimate question to ask.

I always thought I was an effective teacher when my students got excited about ideas or came up with ideas of their own. But no. Now, we have to measure it, and, in order to do that, we have to measure kids. Maybe these people think they are helping or maybe all investors think like this. I don’t know. I just know it is questions like these that kill educational innovation.








2.       What learning analytics are they gathering on their offering and/or what do they plan to collect and why? What metrics matter to them?

Do our graduates get jobs? That would be the question that mattered to me. But, no.  They would hate that answer. Do our students enjoy themselves? No. They would hate that answer as well. Do our students send their friends? Maybe that one. But, alas, they mean test scores. Of course the only real question is do our students find they passion? Do they know wth they want and know how to pursue it? But, no one asks those questions. How sad for kids.


3.       How standardized are the assessments of the artifacts of their story based approach vs. having an expert pronounce it “just like we do it in the real world”?

Can these people think about anything but measurement? Nope.


4.       Have they considered a competency-based learning model? 

Aha. The real question. Could your guys just forget about helping people learn to do things and just concentrate on the important stuff which as we all know is fact memorization, formula application, and lots of math which is after all so easy to test.

Want to know why our schools are a disaster? Ask investors what they want to measure next. (And, for fun, ask a parent how he or she measure success in child raising.

Sunday, February 24, 2013

MOOCs: The New York TImes gets it wrong again; Europe is not lagging behind the U.S.


I feel compelled to again write about MOOCs, but this time because of a recent New York Times article entitled:

“Europeans Take a More Cautious Approach Toward Online Courses”

which can be found here:


The Times has been lately thrilled with MOOCs as a subject but has shown no interest in addressing the real issues in education in their discussions of them. Take for example this quote from Adrian Smith of the University of London printed in the Times article:

“However, you ignore them at your peril,” he said. “The challenges they pose to the traditional classroom model of knowledge transmission are obvious. The question is no longer whether we should consider MOOCs, but how quickly to get involved.”
According to Mr Smith, and one would assume, to the Times, MOOCs challenge the traditional classroom model in some important way. But how do they do that? The very idea of education as “knowledge transmission” is the problem in the first place. Yes, MOOCs transmit more knowledge to more people but knowledge transmission as education is exactly what is wrong with the standard university education model and most education of any sort.

The idea that people can learn by being told, has been ridiculed by movie makers and by philosophers (like John Dewey and Immanuel Kant, not to mention Plato.) Still we persist. Do you know how many life rafts there are on a 757 and where they are located? Why not? That knowledge has been transmitted to you tens or even hundreds of times every time you board a 757. No one listens. Still we talk.

The TImes does quote John Zvereff from Barcelona’s Open University saying:

“I think we should be responding to challenges to the learning model,” Mr. Zvereff said. “At U.O.C., our philosophy is based on accompaniment — each student is assigned a tutor who stays with him or her all the way through till graduation. None of the MOOCs I’ve seen offer anything like that.”
What a weird idea. Teachers are important. Yet, teachers are exactly what MOOCs don’t have. The valid part of the classroom model is not the lecturing and not the tests, it is is the idea that there is a teacher present who you might engage in some intellectually stimulating way. The idea of school, at least in principle, is the interchange of ideas that cause you to challenge cherished assumptions and grow intellectually. This requires a good teacher. That is the teacher’s job, not knowledge transmission. MOOCs pretend to do this of course by having students talk to teach other, which is probably as useful as all the comments sections after a New York Times article. If the Times let one interact with the author of its articles and it we the author’s job to respond to every comment, then maybe the Times would show that it knew something about teaching. Perhaps the Times likes MOOCs so much because they are so much like newspapers -- great at the one way transmission of knowledge.

Another quote from the article, this time from Drummond Bone master of Ball College who: 

told the conference that his university “was very strongly associated with face-to-face, and very expensive, one-to-one learning,” and was unlikely to change.
Good for him.

But, here is the most honest quote from the article:

Veronica Campbell, the dean of graduate studies at Trinity College Dublin, said her school had no open online courses, nor plans to offer them, but “there is a fear of being left behind, so we are considering what to do.”
This is the truth of the matter. Universities everywhere, not just in Europe, are afraid. The Times and others are promoting MOOCs, so universities are afraid of the MOOC tidal wave (for which the Times is, in part, responsible.) 

But this is what universities are actually afraid of:

  1. High quality education, the face to face challenging interaction type, is very expensive to produce. Even the best universities offer mostly lectures. The reason: small seminars taught by famous researchers are too expensive to do too many of. They must be balanced by lecture halls that have a 1000 students even though most everyone knows this is not real education.

  1. On line learning will clearly beat classroom learning eventually. By on line learning I do not mean MOOCs. Why will on line win? Because one can produce authentic experiences, where students learn by doing, with mentors available to help student produce things, at less cost than it takes to run a giant campus.   Build the best Search Engine Optimization course, or Data Analytics course, for example, and no university ever has to put up the money to build another. They just have to provide mentors for that course.

By the way, Europe is not lagging behind at all. A new open university offering on line learn by doing has just been launched in Andorra:


They offer an experiential MBA that I built for them. No U.S. university would dare offer anything like it. Why not? Because universities in the U.S. are run by their faculty and faculties wants no challenges to the existing model. A faculty member may be happy to be the lecturer in a MOOC just for fun, but if that became their actual job they would be running for the hills. Faculty control of U.S. universities means they will never change since faculty have a pretty cushy life that they want to protect. 

But, this is less true in other countries where the bets university education is not private. The Times needs to stop thinking that the U.S. is at the centre of the university world. It may have that position in research but not necessarily in teaching. And, other countries may well be willing to change a broken teaching model that relies on knowledge transmission because their citizens are demanding it. 

Sunday, February 10, 2013

Benito Juarez, Don Quixote, and Mexico City street kids; Really?


I have just returned from a long trip which included Mexico City and Riyadh among other places. Riyadh was certainly fascinating in many ways, but my mind keep returning to Mexico. This is because the people who invited me to Mexico (Telefonica Epsana) made a serious mistake -- they invited me to visit a school. 

Now this wasn’t just any school. It was school for street kids, those who sweep up, sell Chick-lets, run errands, or do anything else they can to earn money. Telefonica had convinced the parents of these kids to let them go to school until noon, enabling them to work the rest of the day. Clearly Telefonica is trying to help, but the result isn’t so clear. They don’t have the freedom to design the half day they provide for these kids. The Mexican government, like all governments, still dictates the curriculum. So, the first lesson I heard was about what a wonderful man Benito Juarez was. 








The picture above is of the teacher asking questions of the class about Benito Juarez. Notice that the children are all sitting in front of computers, but they are not using them, they are hearing lecture/quiz kind of thing. They were using them at an earlier point to play with a jigsaw puzzle that had a map of Mexico on it that as far as I could tell was just abut finding pieces that fit and not really about Mexico at all.
Later the students went to into the yard to sing a song about Benito Juarez and to march around while singing it.









The next day I gave a speech about “the role of the teacher in the 21st century” which was the theme of the two day meeting. That speech can be found here. 




It is in English of course but there is a louder Spanish translation above it. Telefonica has been holding discussions about my speech in most of the Latin American countries and in Spain for the last few weeks. Some of the basis of those discussions can be found here (in Spanish.)


For years I have been pointing our the absurdity of the curriculum taught in schools. It is outdated and irrelevant to most children. But in Mexico, I saw a serious need for which I have much empathy and still the school authorities don’t get it.

Really Benito Juarez? (I have the same point of view about George Washington by the way.) So, when these kids go back on the street (and quit school at 14 as I was told they all do) they will know about their national hero. They won’t know how to get a good job however. 

We could be teaching them how to run a business, how to program a computer, how to raise a family, how to find ways to make money -- really anything that might help them get out of poverty. But no, they sing about Juarez.

Now I wish this were just a problem in Mexico but it is problem anywhere and everywhere.

As it happens I speak in Spanish-speaking countries more often than I do in English-speaking ones, so I have learned what I can say that will drive Spanish-speaking intellectuals mad into to get them to think harder about what they are doing to kids.  

I always say for example, that they should stop teaching history. This remark is generally hated in Spain, but apparently I upset a few people in Mexico as well. But how accurate is the history we teach? Mexican history as I understand it is about Spanish occupation and the mistreatment of the local population, some of which is still going on as can be seen from the color of the faces of the children in these pictures. The descendants of the Spanish are not selling Chick-lets.

If you look at the Spanish text in the last link you will see questions that the debates held after my talk have been   centered around. One of these is about my remark that teaching Don Quixote is not necessarily the cleverest idea I ever heard. Don Quixote is required reading in Spain, and as far as I know ,in every other Spanish speaking country. It is defended as learning about their culture. How what happened in Spain in 1605 (or really a novel set in 1605) is of value to Mexicans who really have no need to know about Spanish culture I don't know. Many say that Don Quixote was the best novel ever written. Maybe it was . I don't know. I have managed to live a good life without ever having read it, which is probably true of most Americans (and American Intellectuals) as well.

The only relevant question for me is how these street kids can be helped to live better lives. I don't get how making them read Don Quixote and sing about Juarez will help.

Further I don't get why the Mexican government and the Spanish speaking intellectuals who argue with me about this, are not getting that idea that what they are doing is simply wrong.

It is all well and good to have a view of education that says we need to teach our culture and history and where we came from but this idea flies in the face of reality.

Spain isn’t where most Mexican street kids came from. (A little known fact here is that Spain is actually where my ancestors came from and this makes me not one bit more interested in reading Don Quixote.)

Culture and history is very nice for intellectuals. Let them have it if they want it. And maybe, through Telefonica’s efforts one of these kids will stay in school and become an intellectual. But is that really anyone’s goal? We have plenty of intellectuals. What about the rest of the people? What about the kids who will, at best, live ordinary lives?

Why can’t we start teaching them skills that will help them with their lives and why and why can’t we start doing this now? Teach them to be healthy, productive, have some fun, think clearly, be good to others. Teach them life skills.

The answer that there is no government that I know that actually has that goal. (Maybe Saudi Arabia -- they hinted at it while I was there, but I don’t know if they meant it.)

Governments design schools to make citizens behave themselves, who won’t don’t threaten the status quo. But the status quo isn’t so good in Mexico (or in my country either frankly.) It is time we stopped trying to turn everyone into an academic scholar and help students become functioning adults who can earn a living, raise their children, and all get along with each other. Don Quixote wont help a bit in that kind of education and neither will Benito Juarez.

Wednesday, January 30, 2013

Princeton Professor teaches Coursera course; you must be kidding me!


I don’t recall ever agreeing with anything Thomas Friedman has ever written in the New York Times, but this Sunday’s article was especially ridiculous.

He was again extolling the glories of the coming education revolution led by MOOCs.

This is part of what he wrote:

“Mitch Duneier, a Princeton sociology professor, wrote: “A few months ago,  40,000 students from 113 countries arrived here via the Internet to take a free course in introductory sociology. ... My opening discussion of C. Wright Mills’s classic 1959 book, ‘The Sociological Imagination,’ was a close reading of the text, in which I reviewed a key chapter line by line. I asked students to follow along in their own copies, as I do in the lecture hall. When I give this lecture on the Princeton campus, I usually receive a few penetrating questions. In this case, however, within a few hours of posting the online version, the course forums came alive with hundreds of comments and questions. Several days later there were thousands. ... Within three weeks I had received more feedback on my sociological ideas than I had in a career of teaching, which significantly influenced each of my subsequent lectures and seminars.””
Friedman mentions this because he thinks it is a wonderful thing, I suppose. Let’s consider what this professor actually said:
My opening discussion of C. Wright Mills’s classic 1959 book, ‘The Sociological Imagination,’ was a close reading of the text, in which I reviewed a key chapter line by line.
Well, isn’t that just education at its finest? Princeton should be proud. Not only are they still lecturing, a relic of the Middle Ages when students didn’t have books and monks read them to them, but the professor is reading it line by line. The analysis of a text is a scholarly activity done by intellectuals, and when done with students, it is part of an effort to create more intellectuals. Does Professor think that the world needs 40,000 more sociology intellectuals? When this stuff happens at Princeton, it is still isn’t really good educational practice, but Princeton does try to produce intellectuals for the most part.

When done with 40,000 students from 113 countries, this is is simply fraud. There is no need for them to read a text in this way. Far from being a revolutionary new practice that will eliminate universities as Friedman says, this kind of activity is perpetuating the very thing that is wrong with universities --- their distance from the real world.

within a few hours of posting the online version, the course forums came alive with hundreds of comments and questions. Several days later there were thousands. ...

It is nice that there were thousands of comments. How many did you respond to Professor Duneier?

I assume the answer is “none.” As a professor, not responding to a student, is, in my mind, the worst thing one can do. Education is about the dialogue between professor and student. This is why classrooms, especially large classrooms, are a terrible idea. They limit discussion. When I taught at Yale and Northwestern I never assigned readings. just topics for discussion. And then we discussed. If you had 30 or 40 students you could get into some good arguments, especially if I had assigned a provocative question to think about. (“What does it mean to learn” was one I often used.)

Your job professor is not to notice how many nice discussions students have with each other. But it is his last line that got me:

Within three weeks I had received more feedback on my sociological ideas than I had in a career of teaching, which significantly influenced each of my subsequent lectures and seminars.

So, the Coursera experience was good for you eh? Nice to hear.

But the issue is that universities have always been good for the faculty. Places like Princeton are run by the faculty for the faculty. No one teaches much. No one cares about anything but PhD students and research.  Undergraduates sit in lecture halls in order to pass the time between football games and parties. No one cares because they all windup with impressive Princeton degrees.

Friedman is right that online will change universities, but not the kind of online that Coursera is providing.

Just yesterday, there were thousands of visits to a lecture of mine that is on line because it was assigned as part of a Coursera course. I find that very funny since my lecture was about why lectures don’t work (oh the irony!) and why learning requires doing and why universities should stop teaching scholarly subjects and start teaching students skills they can use in real life.
Yes change is coming. Too bad Mr Friedman doesn’t have clue why. Here it s. We can build mentored learn by doing courses online that challenge current teaching practice. They won’t be offered by Princeton because Princeton likes what it has now. But change is coming, just not the change Coursera or Friedman had in mind.



Saturday, January 19, 2013

Teacher's Despair: We cannot afford to be focussed on training intellectuals






As part of a presentation to teachers in Mexico City that I am to make at the end of the month, Telefonica of Spain has set up a forum for teachers to ask me questions here:



It is in Spanish and my Spanish is minimal at best, so they have been sending me translations of the questions and comments that have been posted. What I am struck by, as always, is the difficult situation in which teachers find themselves these days. It really doesn’t matter what country a teacher is in, they are faced with two truths:

1.    They are not quite sure what they are doing in school is really the right thing to do
2.    They know they have very little power to change things


Here is one question I got for example. (Excuse the awkward translation, I received them all in that form.)

·       We learn something new every day, depending on our attitude towards learning, and even if we are not going to put it into practice, we need to take it in as part of our general knowledge. For example, why is philosophy important for someone who is going to study engineering? There is some material that is simply useful in life. Is this assessment correct?

I can’t help but feel this teacher’s pain when reading this. I am saying, as usual, that we only learn by doing and this teacher is trying to figure out how what he or she is doing is still ok. “If we don’t put it into practice, isn’t is still ok to teach?” Now of course, for me the answer is “no” since I believe that we only learn by doing, but consider the teacher. The teacher stands up in front of class trying to teach general knowledge that will never be used. The teacher’s hope is that philosophy would be of use somehow to someone and that the “general knowledge” that is the staple of the school system will someone turn out to be useful even though this teachers isn't really so sure it will.

Consider this next question:

·       Learning depends more on the person doing the teaching, on the strategy and methodology applied, than on the student. This is because a good methodology can make the student take interest in what he/she is doing and be enthusiastic. Is that right?

Here we have another teacher saying that a good teacher can make students excited about anything so isn’t that a worthwhile thing to be doing? Well of course it is. Turning students on to things they didn’t know about and getting them to care about it is very enjoyable for a student and could possibly have a large affect on the rest of the student’s life. What’s the problem then?

The problem is well expressed by this next question:

·      It is possible to learn almost anything. All we need is motivation. We must try to somehow involve, motivate and encourage students to participate in their lessons... Is it possible to learn through practice, even when what is learned is of no use to the student?

This teacher is willing to accept the fact that what is taught in school may be completely useless to the student’s future life. I for one, find that idea very difficult to accept. I realize that teachers teach what they are ordered to teach, but what must it be like to teach material that you know is completely useless to the student?

I ask this question as If I didn’t know what it is like, but of course I know it all too well. Exactly the reason that I became an education radical is that I was teaching a course in Semantics at Stanford and realized within a few days that no student in the class cared about, or would ever make use of, what I was teaching. They were simply required to take Semantics. I knew right then I needed to re-think.

I will now consider the last (of the one’s I have chosen to write about) three questions together:

·       Would it be wiser to focus more on the theoretical basis than on practice? Students show more interest in classes in which the outcome is an object constructed upon a scientific foundation.

·       It is extremely important to find the reason behind what we teach and, often, this raison d'etre is the source of knowledge or of its use in other sciences or fields of knowledge.

·       Is it possible to remember what they have heard in a reading if it is truly significant to them? If what is read motivates the reader, does this mean there is a greater chance of learning it? Or do we only learn by doing?

I get an overwhelming sadness from these questions taken as a whole. These teachers are focussed on teaching science, and basic knowledge, and great books. This is what they do and it is what they have always done. They ask if there isn’t some use to it all and of course there is. This is how we create intellectuals. Intellectuals worry about science, and general knowledge, and philosophy, and great literature, Intellectuals can discuss these things and enjoy doing so. They may use them or they may not but it is part of the well-rounded education of an intellectual.

My question is about the percentage of intellectuals out there in world. I find it hard to believe that our school systems in every country are geared towards the creation of intellectuals. I am sure 90% of all students have no interest in becoming intellectuals. They would like to learn to earn a living, and how to take care of their families, and how to be good citizens, and how to have good relationships with people. They would like to know how to function in the world. While we can kid ourselves that making them read Don Quixote, or read about the glories of the Spanish Armada, will somehow contribute to their greater development, this just has to be wrong and irrelevant to their lives.

Our education system was designed to create intellectuals. In the U.S., it was designed by the President of Harvard (in 1892). He wasn’t interested in the average person. He was interested in the elite who would attend Harvard.

All this must stop. We need to focus on getting the general population to be able to think clearly. This does not mean teaching algebra and chemistry and pretending that such things teach clear thinking. It means having students practice making decisions and understanding the consequences of those decisions. It means having them come to a conclusion about something they care about by learning how to examine evidence. It means having them learn to create a plan that will help them get what they want and then executing that plan. The average person does not need to read Descartes no matter how much we rationalize to ourselves that Descartes said some things that might be of use to the average person.

I know teachers can’t change the system by themselves. But they need to band together and try to make some changes or another generation will be lost.

Sunday, December 23, 2012

How does online learn by doing actually work? See the video we made 10 years ago at CMU


This is a movie we shot 10 years ago to describe what a learn by doing projects only mentored, team based curriculum looked like. There are interviews with the mentors, the students, and the faculty (Lynn Carter video referred to in my post yesterday starts at about 3.22).

We learned how to do it and worked well until CMU administrators decided they didn't want to have thousands of online students and didn't want have brand new empty buildings.

XTOL has re-thought and re-built these online learn by doing curriculum taking advantage of ten years of change in computer science. (See my post here from yesterday.)

We are now ready to offer real learn by doing education to everyone, taught be the people who invented it the first place (unless you count Plato or Dewey, which, of course I do.. but they didn't have) computers.