Share and discuss this blog



Sunday, May 17, 2020

All colleges are going online; too bad they will produce garbage



Thursday, May 7, 2020

Please don’t try to put your course online….


I and (a large team) have been building online courses since I started the Institute for the Learning Sciences (ILS) at Northwestern University in 1989. I started ILS because after watching my kids suffer through school and wondering why things were done that way in school, I thought (since my field was learning) maybe I could change things. But school weren’t interested in changing. Corporations were interested, so we built (and still are building) online courses for them. Occasionally we got to build course for colleges but even when we had built a great course, internal faculty politics usually killed it.

But now, due to Covid, schools are closing and we are all wondering what to do. Putting your courses on line is the obvious answer. But wait. Let me explain what to do and what not to do, following these ten admonitions:



  1. Do not attempt to copy an existing course

Why not? You teach a great course so why not attempt to copy it?

Once I was talking with another professor about why I thought lectures were not a good idea. He told me he gave great lectures. I said: suppose you go to class and there is only one student there, would you give the lecture? He hesitated and then said “no, but he would miss a great lecture.” 

Then why wouldn’t he give one student the lecture? Because in real life we don’t talk at someone we talk with them. The listener typically has a question or a different point of view, and they want to respond with what they are thinking. Conversation is how we learn. No one can learn from someone talking at them for an hour. The reason lectures exist at all is both economic and historical.  Before printing books was easy, teachers would read books to their students. (Lecture means “to read”in Latin.) Colleges can make money by stuffing 500 kids in a room with only one teacher. When the Romans decided what needed to be in the curriculum (another Latin word) they chose subjects from what they called the Liberal Arts in an effort to create intellectuals. They were not trying to prepare kids to go to work or live in the real world. They wanted to train rich kids to be Orators in the Forum. It is astonishing that we still do this (given that we don’t need Orators these days.) But the University of Bologna copied this model and all universities have followed. The high school curriculum in the U.S. was created by the President of Harvard in 1892. Harvard was still copying the Roman concept of education and Harvard wanted everyone in high school to be ready for Harvard. From Rome until today school is meant for the rich and for people who will not have to work. Why can’t we change that? Because we have always done. it that way.

So, before you attempt to put your course online you must ask if your course is useful, and the answer can’t be “it will teach you how to think” which what all academics say when they can’t answer questions about the usefulness of what they teach.   Knowing stuff and being able to repeat it is not education no matter what the Romans thought. When your child asks you a question you don’t respond with an hour lecture. Long before children first attend school they are little learning machines. They try to do stuff that interests them and when they are stuck they ask someone for help. This is how all humans learn (and animals too but without the ability to ask questions.)

So, before you try to put your course online, you must ask what the students will be able to do after they have taken your course and you must ask if they truly want to be able to do that. If a course doesn’t teach you something that you want to learn how to do, then it is just transferring inert knowledge that will soon be forgotten.


2. No tests  

Every year in my first class of a course in September I would ask the class if they could pass the final exams from the courses they took last year? They all agreed they could if they could study first. That didn’t sound crazy to them, but it did to me. Isn’t a test meant to be an assessment of what you have learned in a course? Studying is temporary memorization of stuff you haven’t already retained. We make every kid in the world memorize the quadratic formula so they can pass the test that will inevitably have a question about it. Does anyone who isn’t a mathematician need to know it? 

The problem with tests is that their entire point is to enable the teacher to assign a grade. Why do we need grades? For colleges to determine if they should admit you is the usual answer. I used to give every kid an A as long as they showed up and wrote answers to questions I gave them that were intended to start them thinking so we could discuss ideas in class. (I only did this when I got to a point where I was too important to be punished for having done this.)

Kids are so used to grades that they obsess about them. But why? Because they want to get admitted to the next school. I understand that teachers must give grades but while we have a chance to redesign courses we must get rid of them. My driver’s license doesn’t have a grade on it. You have one or you don’t. Someone watched and saw what I could do. In real life there are no grades just assessments of a capabilities based on observed performance.

So, an ideal course has to end in a proof of performance (not of the ability to temporarily memorize.)

For as long a there has been “distance learning” and “computer based training” there has been text on screen followed by a test. This was never a reasonable way to handle education. Putting it online doesn’t improve this terrible methodology.


3. Start with a goal that a student wants to be able to achieve 

When you design an online course you must begin with the end in mind.  What do you want the student to be able to do at the end? Do they want to learn to do that? Will being able to do that help them in some way? Courses often ignore a student’s real goals and replace them with artificial academic goals.

When I was at Yale I happened to sit in on a class in developmental psychology. It was all women. When I inquired about this the professor told me that these women all expected to be mothers some day and wanted to learn about how to raise a child. Except that is not what they they were teaching in that course. Child raising is not an academic subject, so instead they taught theories about child development. They didn’t care why the students were there.

Many years later my team built a course in how to raise a child  (with the help of the developmental psychology faculty at Columbia University.) The student dealt with videos of problem children and taught how to deal with them. Students loved it. But no school would use it. Too practical; no theory.

In order to fix online education we need to fix education. Faculty always seem to want to teach theory and rarely want to teach practice.  This has to change. Teachers are rarely practitioners. This has to change as well.

4. Encourage the expression of ideas

Small children always have questions, and ideas and stuff they want to say. Then they go to school and are told to sit down and shut up or they are diagnosed with ADHD because they don’t follow orders. School has always been about paying attention.  In the movie “Horsefeathers” Groucho Marx plays the role of a college president. When he is told about a problem arising from too few dormitories he responds by saying that students can sleep in the classrooms like they always do.

We all know all know that students are not paying attention, but we don’t care because they have to pass the test and will study. Classrooms tend to inhibit the expression of ideas. But, good online education does the opposite. We believe in having “cohorts” of students in our online courses. There may be 50 students in a course but there are just 5 that you hang out with. Talk to them and when you are confused you can talk to the teacher (who is more of a mentor than a teacher) and ask for help. A good mentor does not tell you “the answer” but encourages you to find it for yourself. Say your ideas, defend them, find a way to convince others that you are right. This is how a good online course must go. In general, there are no right answers.


5.  Teachers are behind the scenes

When we hear the word teacher we immediately think about someone standing in front of a classroom talking at us. But your best teachers were more than likely your parents who never did that. Natural teaching occurs when one has an idea follows their intuitions and nothing goes as planned. You look for  someone to ask for help. Providing this help is a teacher’s real job. Most teachers actually know this but the system puts them in a room with 50 kids so they can’t teach in response to a student’s need. They have a curriculum to follow and content to cover. The notion that the teacher is a deliverer of content is simply wrong. Textbooks can do that (badly).

A good online course employs mentors not teachers. A mentor is someone who is only there when you need them.

6. Build in failure

If you don’t fail you don’t learn. All good online courses set up the student for failure. Course need to have situations in which a student’s job is to figure out a real problem. “We’ve been hacked. Figure out what happened.” “Our business is running out of money, figure to why.” The engine isn’t running. Why?” “The patient is dying, help him.” 

Set up a problem the students will find interesting and make the student try to figure out a solution, not to a math problem, but to a real life problem. Provide help as warranted.

That is all there is to online education.

Why don’t we do that in classroom? Because each student would have their own ideas, different solutions, and need different kinds of help. School demands that every child be on the same page at the same time, an idea so stupid it is hard to believe we do that.

7. Make it emotional

Humans are emotional and people oriented. Why do many students (girls more than boys) because it is barren of feelings and emotional substance. History is more interesting when it is about real people rather battles and ideology. 

We built a course that taught doctors how to tell patients that they have cancer. We employed videos that were heart wrenching (just good actors actually) and they were hard to forget because they made students feel something. 

We built a history course that relied on real people telling stories about decisions that were made in similar situations and how they worked out. Some of these stories were hard to forget. After the first Gulf War we asked an advisor to the first George Bush why they decided not to kill Saddam Hussein. He said “do know what would happen if we killed Saddam?” He then laid it in detail the events that followed 10 years later when we did kill Saddam. I remember his final words “it would be a bloodbath.”

I have that video on my laptop and often show it when I am talking to the US government about building online courses. It always has a tremendous impact.


8. Use just in time stories 

We collect stories (usually about 1.5 minutes long) from experts, the kind of stories people tell when they are in a conversation. We learn a great deal from stories people tell when we can relate to them. So, the first thing we do when we build an online course is collect stories from experts. We engage them in conversation (with the camera showing only the interviewee) and in the end we have hundreds of stories that we can use just in time as appropriate in the course. We learn a great deal when we do these interviews. We learn about the domain and we learn about the people in the domain. The course should provide that same entree into a domain. Talk with enough doctors and you begin to understand how they think, what they know, and what they don’t know.

You want an online courses to be full of experts ready to jump in as needed.

9. Students must have other people to talk to


Most online course are lonely experiences. One person staring at a screen. If the online course really is a copy of a classroom there may well be other people around  but not ones you can easily talk with. People like to talk to other people. In our online courses students talk to each other all the time. They can figure things out together. The mentor can meet one on one but also schedules regular sessions with a small group. Online courses must include regular interactions that are both enjoyable and interesting or they are hard to endure.


10. Make it fun

Learning something new is enjoyable. We revel in acquiring new skills. We like to show off what new things we can do. It is fun. I do not mean that learning is a game where one laughs a lot. People enjoy learning new skills that they wanted to learn. No one ever learned how to drive a car who wasn’t excited to show off  their new ability and go for a drive.

The Coronavirus Pandemic has offered a solution to education that have plagued our world for many years.

“Failure is instructive. The person who really thinks learns quite as much from his failures as from his successes.” 
John Dewey

“Tell me and I forget, teach me and I may remember, involve me and I learn.” 
Benjamin Franklin

A general State education is a mere contrivance for moulding people to be exactly like one another; and as the mould in which it casts them is that which pleases the dominant power in the government, whether this be a monarch, an aristocracy, or a majority of the existing generation; in proportion as it is efficient …
J.S. Mill


Good online learning changes all that. We can fix it now. Start Designing. 








Monday, April 27, 2020

Thinking about putting your course online?

When I first started teaching in college (at Stanford) I just stood up and started talking. The students were there because the course was required, not because they wanted to know what I had to say. They just cared about doing whatever they had to do to get a good grade. By the time I got to Yale I had acquired more sense about teaching. The first day I would ask students why they were there. This question was met with blank stares. When I pushed them I got answers about how the course fit into their schedule and that they heard I was an easy grader. By the time I got to Northwestern I had acquired more sense and more power. I did what I wanted to do: started arguments, made students defend their ideas, told them what I thought didn't matter, what mattered was what they thought. As I began to think about online learning during that time, I became convinced that the teacher didn't really matter in these courses except as a course designer. I laid out the groundwork and forced the kids to think hard. I started designing online courses. The student has to achieve an agreed upon goal. You make sure they can achieve that goal by providing good resources. Online courses must have deliverables that students want to create, not teachers they have to listen to.

College was not designed to teach students to do things. The idea was (and is) that students should be taught to know things. But you can't know things because someone told you those things. You can believe things because someone told you them and but knowing requires doing, experiencing, and learning from mistakes. Learning is an emotional experience guided by a desire to do. Online learning must let you do things you want to do. It is not about listening to a teacher.

Tuesday, April 7, 2020

Please don't ruin online learning because teachers don't know how to do it

I called two of my grandchildren to ask about how their online schooling was going. They said they were very happy about it. They are bored to death (as is everyone else these days) and they were missing school. They wanted to talk to their friends. They needed something to do. When I asked about what they were doing in online school they both said the same thing. They were listening to the teacher talk, doing some assignments they had been given, and talking with their friends. “Did they like it?” I asked. Well, “it is better than doing nothing, but it is boring. Had they learning anything? “Not really, but they got to see their friends.” “Why did they bother with doing the assigments?” I asked. “Because we don’t want to get bad grades.”

I wonder why they care about grades so much; I didn’t. Their mother didn’t. But we live in a time where everyone wants to go to Harvard and is working towards that goal from first grade on. We have transformed “education” as the goal of school into an obsession with grades.

I have been concerned about this most of my adult life. I studied how learning worked in an attempt to fix school. In 1989, I moved to Northwestern University to create the Institute of the Learning Sciences. My goal was to build an alternative to school that could be done on a computer. Why use a computer? Because by getting rid of the classroom we allowed each kid to follow their own interests and go at their own pace. 

Today we hear a lot about online learning but what is really meant is an attempt to replicate the classroom online. This is a terrible idea because the classroom was never really about learning in the first place, unless by learning” we mean memorization followed by a test. 

Real learning (the kind we do everyday) occurs in the context of truly held goals and the attempt to achieve them. Kids learn that way in school in the context of everyday life not studying in academic subjects.

When we go back to thinking about online education, please don’t try to replicate the classroom. Try to replicate real life.

Some programs we built in those days which would entertain and educate kids today if they were available to them.

Road trip: travel around the country to see stuff that interests you

Creanimate: design you own animal

Sickle Cell Counselor: advise couples about whether they should get married by doing genetic tests

Broadcast News: review the days event and put together tonight’s evening news.

Dustin: enter a foreign country and try to learn the language by interacting with the people you find there  

Advise the president: war has broken out in Eastern Europe. You need to advise the president about what we should do

Is it a Rembrandt: a museum has a painting that they think is a Rembrandt. Help them figure out if it is a forgery

Outbreak:  A pandemic has broken out; fix it

We build many more. They were all meant to entertain and to allow kids to learn by doing. They weren’t “taught.”


We couldn’t get schools to use them because “they didn’t fit into the curriculum.” The curriculum we written in 1892. What online learning could do is change the curriculum and allow kids to have fun learning. Sometimes I feel like I am the only one who cares about that.

Sunday, March 29, 2020

The virus is a big opportunity for education actually

Could we stop pretending that kids will be harmed by having to learn from home during the virus and school shutdowns? This is actually a big opportunity
if we relax our rigidity about education. All a teacher has to do is suggest that a kid produce something  (anything) and help them when needed and then provide some assessment of the quality of what they produce . We need to stop demanding that kids learn what some government, or university committee, or ETS, or OECD, has decided that they must learn and let them learn what they want to learn. Teachers need to stop “teaching”  and start helping kids achieve what they actually want to achieve. Teachers can encourage kids who want to learn the same thing to work together in teams. Imagine if school was fun and allowed you to learn what you’d always wanted to learn. How many would decide to learn the quadratic formula, or how to balance a chemical equation, or memorize a physics formula?  Who would decide that they needed to read Silas Marner? Letting kids decide what to read and what to learn how to do happens all the time outside of school mentored by parents (and friends). Teachers need to stop being the ultimate authority and instead learn to mentor just in time (online)  and stop pushing test preparation. Instead of online learning becoming a disaster due the school snot really understanding education, the virus could become the savior of education. Let’s make this school shut down into a good thing.

Saturday, March 21, 2020

So you want to put your course on line



In these days of “sheltering in place,” there is a mad rush to move education at all levels online. Unfortunately, nearly all of these efforts are reminiscent of the early days of movies in which moviemakers filmed plays; it was not until they began to recognize the unique characteristics of the medium that movies began to achieve their full potential. The same is true for online courses; until we get beyond trying to replicate the classroom online, the potential of online education will not be realized. So given that, how do you rethink a course in light of what is possible in an online experience?

  1. think about the goals of your course

This is a hard question. Teachers rarely ask themselves about the goals of a course. They have the idea that they need to teach what they want you to know, and they will tell you about it. But learning and knowing are different things. We learn every day — through experience — but many of the things we “know,” are decontextualized facts that school said were important to memorize. I know that Lincoln was the 16th president. Why do I need to know this? Only because school said so. The same is true about the quadratic formula, the formula for salt, and the War of 1812. To turn your classroom course into an engaging, effective online course, you must ask about the utility of what you teach. You can’t really teach students things they don’t want to learn, and you can’t teach them by telling them because learning by telling doesn’t really work.


2  ask what people should be able to do after they have taken your course

When you teach someone to play the piano, hearing them play something well is the ultimate goal. When you teach a kid to play soccer, one goal is scoring a goal. What about mathematics, for example, solving simultaneous equations? No one needs to solve them. No kid will learn to do this in an online course unless you force them to the threats of with tests and grades. Insisting on kids learning something might work in a classroom because they are a captive audience and have no choice, but it won’t work online when they’re working from home; they’ll get bored and turn on the TV.

3. figure out who the experts are

School has only one expert  — the teacher. But in the real-world, there are many. Letting students ask questions and having true experts answer is possible in good online education. You don’t know how to do that? It’s hard to do on your own. In our experience with corporate training, a company has experts who can be interviewed on video, telling stories from firsthand experience. The same thing can work for school, but you may have trouble finding and interviewing experts on your own. However, groups of people who want to teach the same things may be able to work together to find experts, interview them, and record their answers. These video answers can then be incorporated into a course where they can pop up in places where the corresponding questions are likely to arise.
4. ask what this course is really for

Is it to fulfill some sort of requirement imposed on students, or is it to learn something they are really interested in? Asking this question is not something teachers typically do. What do you think most students would say if you asked them if they want to learn geometry, or history, or creative writing? A good course should make it clear to students that they are going to learn something they really want to be able to do, and it should deliver on that promise by helping them to do it. The key words here are “want” and “help.” Forcing students to do something to fulfill a requirement which doesn’t interest them is unlikely to work online. Instead, a good course will make it clear to students that they will learn something they want to do and that they will receive the help they need to succeed. Such a course will “teach students to swim by throwing them into the water,” while making it clear that a mentor will always be there to stop them from “drowning.” For example, in our cybersecurity program we present students with compelling, realistic problems and ask them to solve them; they are provided with extensive learning resources keyed specifically to the things students are asked to do and knowledgeable mentors who are always available to provide help, advice, and feedback help them to succeed. These things — compelling, realistic problems, immediately relevant learning resources, and knowledgeable mentors — are key attributes of an effective, engaging, online course. 

In summary, to build an effective online course, you must rethink what you have been doing in the classroom, paying more attention to what the student’s real goals are and giving them the support they will need to succeed.


Thursday, January 23, 2020

What is love? A challenge for AI (and for all of us)



Do you love me?

It is a common enough question and we all know what it means. Or do we?

According to the media, AI is coming any day now, and machines will soon rule us. But will those machines understand when someone asks this question of them? To see why this is difficult, ask yourself what it means to love someone. If you asked ten people this question you would get ten different answers.

I asked Google: “what is love?”  Here are some of its answers:

a feeling of strong or constant affection for a person.

attraction that includes sexual desire: the strong affection felt by people who have a romantic relationship.

a person you love in a romantic way.

Google shows many other questions you can ask and that it will answer. For example:

What are the signs of true love in a relationship?

Give and take in love. ...
Pure happiness. ...
Pain and anger. ...
You make sacrifices for their happiness or wellbeing even if they may not realize it.

The right effort. ...
You can't hurt them. ...
You keep your promises. ...
When you truly love your partner, you see them as part of your life and your future.

Below are a few ways you can identify true love.

You forgive your person: Although your person's actions upset you, you always find it in your heart to forgive them. ...
You understand your person. ...
You accept your person. ...
You tell your person when they are wrong. ...
You want to see your person happy.

My career was in Natural Language Processing which is only one part of AI. I spent my life trying to figure out ways that computers could understand sentences and interact with people in English. Asking people what words meant didn't help us. People can come up with answers easily enough but they are just words. 

What is love? It is a feeling. It is hard to define but people don’t need to define it. We know what we are feeling most of the time. If we don’t feel anything we will not understand the simplest or words, like hunger, anger, or ambition. Unless we are trying to get a computer to be smart we don’t have to define words. But, real AI  (which these days is referred to as “AGI” so the people who do AI can pretend they are doing AI) depends on explanations of what words mean (which are based on experiences has had.)

We are very far from being able to do that. Perhaps it is time to stop making everyone afraid of AI or having endless  meetings about the ethics of AI.

There is no AI and there won’t be any any time soon. Counting words or choosing between moves in GO or spitting out sentences that a person wrote, does not count. 

Here is Google again. 

Below are a few ways you can identify true love.

You forgive your person: Although your person's actions upset you, you always find it in your heart to forgive them. ...
You understand your person. ...
You accept your person. ...
You tell your person when they are wrong. …
You want to see your person happy.



Let me know when a computer can do any of that.