Share and discuss this blog



Sunday, February 28, 2016

Trump U; I was there; students should get to complain if they were mistreated, but they should get to do that at every school

The attacks on Trump University are starting to bother me. I was the chief learning officer of Trump University from its inception until 2007. At that point, Mr. Trump decided to stop building the online learn by doing courses that I was hired to do and do real estate seminars instead. He didn’t need me for that.

Here is my problem. I don’t know if those seminars were shady or not. I wasn’t there and I wasn’t consulted. However, some of the attacks and discussions and lawsuits are about whether this was a state sanctioned university. We all make the assumption that the government should determine if you can call yourself a university, and if you can grant degrees.

A colleague (a faculty member at a top university) wrote to me today and commented:

it will set a bad precedent that students can sue private universities for tuition claiming bad education!”


Will it?  Universities sanctioned by the state and lauded by official rankings grant degrees to students who simply amass sufficient credits which they do by attending lectures and passing multiple choice tests. Are these students getting a reasonable education?  MY colleague s right to worry about lawsuits from unhappy students, but possibly we should all be unhappy about the current state of university education.

At the launch of Trump U, I was quoted as saying:

 "The problem with school is that school is a little academic, a little theoretical, not necessarily practical," Schank said. "It doesn't necessarily serve the general public, who may just want to know how to do something."

Some members of the press printed only the first phrase of that and made fun of me saying that “school is a little academic.”  The defenders of the system never concern themselves with the idea that everyone must go to college simply assumes that colleges know what they are doing and that what they are doing is meant to benefit students in a way they might care about, like preparing them for employment. Bart Giamatti (at the time he was my boss and the President of Yale) once said to me “we don’t do training Roger.” Maybe it is time to re-think that idea.

I don’t know if Trump U was fraudulent in some way but I can tell you that people keep calling me to discuss this. The press asks me about the “unofficial” courses and I respond asking what is so good about the official courses. (Yale Computer Science students recently protested that their education wasn’t practical enough and that Google wouldn’t hire them. They were right to complain. It wouldn’t have happened on my watch.)

The important issue to me (apart from Trump himself which of course is the real issue) is why it is not possible to simply launch a different kind of school, (maybe one that does not teach algebra or one that concentrates on job skills) without the government telling you what you  are doing is ok.

The government is hardly the expert on education, and neither I think are faculty members whose interests are typically research.  Students should be able to complain if the Yale education they got disppointed them in some way.  As a professor at Yale for 15 years I can tell you that Yale often disappointed its students. Many of them found their way into my office eventually to complain about what they were being taught.  For example, why are psychology students learning to run experiments when they have no intention of being researchers and simply want to know what is wrong with them or their family?

Trump U was trying to do something different (at least at the beginning while I was there.) If it did something wrong after I was told to stop building online learn by doing courses, then people have a right to criticize it. But the state should stay out of the business of sanctioning courses and schools.   All the state does is
reinforce old ideas and make change impossible.










Tuesday, February 23, 2016

Massive delivery of "just in time" videos; a way to change education and build useful AI

  
Today there was this quote from Mark Zuckerberg in Fast Company:

"Most of the content 10 years ago was text, and then photos, and now it’s quickly becoming videos," Zuckerberg said, justifying Facebook's aggressive push into the area. "I just think that we’re going to be in a world a few years from now where the vast majority of the content that people consume online will be video.”



I suspect he is right about this, but he has not mentioned what may well be the most important use of those videos. Before I explain what I mean here I would like to mention that a man whom I respect a great deal, Donald Clark, made a speech recently about the history of education, called 2500 years of learning theory.


In his presentation he talks about 101 people. I agree with him about nearly everything he says about each of them (especially since he says nice things about me.) But he says this about MOOCs:

“We have waited 20 or 30 years for people to deliver massive online education and all we want to do is kill it.”

Now let me put Zuckerberg and Clark together and make some points about video and education. In order for me to do that, I need to reiterate a point I have made before in this space. When you are trying to do something, and you need help or advice, what is your first course of action? Google it or read a book about it are possible answers to this question of course. But honestly, the first thing anyone does is ask someone who might know, assuming they are available to them.

Why is that? Because we learn, and have always learned, through conversation. When we ask our resident expert and they answer, what do we do next? We ask another question. We discuss. We engage. This is how we learn. This is how humans have always learned.  

Clark is wrong about MOOCs because the very concept of massive education is oxymoronic. Education is only massive because we have created a world of schools that include classrooms and not enough teachers to do one on one education. MOOCs are an extension of a vary bad educational idea called lecturing. We have come to accept lecturing because it is everywhere and we all had to endure it. But no one gives lectures to their children who have assembled together in a room. We deal with children as individuals when we “teach” them as children. What is wrong with MOOCs is the “massive” part. Education cannot be both massive and actual education. Learning starts with a goal followed by questions when you have trouble reaching your goal. We each have our own questions and our own goals.

Back to Zuckerberg. If people have answers to questions, or good stories to tell, or helpful hints, or specific advice, we should be delivering them through video.  Rather than consult my friend and ask him a question I would prefer to ask that question of many experts (maybe massive numbers of them) and hear and see their responses. The “massive" part is on the opposite end. It is the teachers who must be massive, not the students. Zuckerberg is right about videos being the medium of delivery, but short and to the point ones, not hour long ones.

To make this work right for learning, these videos need to be delivered just in time. That means, that they appear when we have a question but it also means that they appear when we are confused and don’t even know what question to ask. People give advice when you don’t ask for it as well. They know what you are thinking (or talking) about and offer their point of view. But we are limited to answers from people we know.

I envision a new computer world, a world that works on Artificial Intelligence principles that are sound and not the AI flavor of the month, that delivers just in time video to anyone who is trying to do anything because the computer is smart enough to know what you need to hear when, just like a good teacher would do or a good parent would do.

Can we build this? Yes, we can. Or to put this another way, Zuckerberg could afford to build it. Then, instead of MOOCs and friends posting videos randomly, we could have actively listening AI systems that are helpful anytime you need help. To accomplish this we need to record the best stories, advice, and answers, from the best and brightest in the world. We need to index those videos in order to link them to activities people are engaging in. Can this be done? Yes. But it would be a massive undertaking.


It would however change education and learning forever.

Saturday, February 20, 2016

Now it is Facebook's turn to be stupid about AI

 It is another week, and yet another big company has profoundly misunderstood AI. Today Facebook. IBM has been around a long time and was always actively hostile to AI so it is understandable that they would know nothing about AI. Facebook, founded by a guy who went to Harvard where AI was never taken seriously as a subject is another case of “let’s just make up stuff about AI and assume we are making sense.” Today’s announcement:



Facebook releases 1.6GB of children’s stories for training its AI

I guess what they are saying is that children learn about the world by reading children’s stories so their program will learn that way as well.

To see that this is simply stupid, let’s consider three well known children’s stories: Goldilocks, Rumplestilskin, and Little Red Riding Hood.

I just chose these at random. I remember them, and to be honest, never really understood what they were about. But surely Facebook’s AI will understand them better than I ever did. Many people have written about these stories and tried to explain them. Here are three answers I found on the web about the moral of Goldilocks:


What is the moral of "Goldilocks and the Three Bears"?


  1. The moral of “Goldilocks and the Three Bears” is that individual actions can hurt others, especially when one person uses or destroys another person’s property. In addition, the popular fable stresses the importance of self control and respecting others. 
  2. In the original story, the moral was that you should respect the privacy and property of others. 
  3. Goldilocks is a cute, misguided child that makes mistake after mistake. However, you never quite know if she learned a lesson from them in the end. Instead the reader (hopefully) learns the lesson for her. 




How about Rumplestilskin? I found a site that listed ten lessons. Here are three:

Lesson 1 – Always have a fall guy; if you get away with a lie, you have around 24 hours to get to Mexico.

Lesson 2 – Prenuptial agreements; find a good lawyer, one who won’t overlook any previous deals made with Rumpelstiltskin.

Lesson 3 – Don’t judge a book by its cover; Just because a man enslaves and threatens you, doesn’t mean he isn’t good ‘marriage material’.



What about Little Red Riding Hood? Here are there I found:


1. In the story of “Little Red Riding Hood,” the view behind  the fairytale is as a warning to young girls to be careful of their virginity.

2. In Little Red Riding Hood, your children can learn the importance of being careful whom to trust, as well as to think critically. Although the young girl featured in this tale was initially fooled by the wolf, she was eventually able to deduce that her “grandmother” was not at all who she appeared to be at first.

3. I guess it's probably 'don't talk to strangers', and also 'be careful about who you trust'. It could also be 'don't walk through creepy woods by yourself' though


What could Facebook be thinking here? We read stories to our children for many reasons. These are read because they have been around a long time, which is not a great reason. The reason to read frightening stories to children has never ben clear to me. The only value I saw in doing this sort of thing as a parent was to begin a discussion with the child about the story which might lead somewhere interesting. Now my particular children had been living in the real world at the time so they had some way to relate to the story because of their own fears, or because of experiences they might have had.

Facebook’s AI will be able to relate to these stories by matching words it has seen before. Oh good. It will not learn anything from the stories because it cannot learn anything from any story. Learning from stories means mapping your experiences (your own stories) to the new story and finding some commonalities and some differences. It also entails discussing those commonalties and differences with someone who is willing to have that conversation with you. In order to do that you have to be able to construct sentences on your own and be able to interpret your own experiences through conversations with your friends and family.

Facebook’s “AI” will not be doing this because it can’t. It has had no experiences. Apparently its experience is loading lots of text and counting patterns. Too bad there isn’t a children’s story about that.

Facebook hasn’t a clue about AI, but it will continue to spend money and accomplish nothing until AI is declared to have failed again,

Saturday, February 13, 2016

Everyone should learn to code Mr Obama says; really? say it ain't so


Mr Obama thinks everyone should learn to code. As a computer scientist, I have to say that coding is a good thing to learn. But everyone? What is it with people who decide what everyone should do? Why is school so awful? Because people make statements like that and then enforce them. How would Mr Obama know what everyone should learn to do?

So, for fun, I typed “everyone should learn” into Google. Here are the things (besides coding which is there 100 times at least), that everyone should learn, according to the people who post to the internet.


Why Everyone Should Learn a Little Bit of Photography

Reasons why everyone should learn at least one foreign …

Ten wonderful Catalan expressions everybody should learn …

Why Everyone Should Learn How to Sail - Queensland …

Why Everyone Should Learn CPR - First Aid

5 Reasons Why you Should Learn a New Language

20 Simple Truths Everybody Should Learn about God, Life …

5 lessons from Google that everyone should learn …

5 Reasons Why Everyone Should Learn to Sew

A Skill Everyone Should Learn: Sketching | Big Think

4 Reasons Everyone Should Learn Basic Accounting

Why Everyone Should Learn How to Shoot a Gun - ESP …

Why Everyone Should Learn Martial Arts - - Karate USA

Everyone Should Learn Design Thinking | PBL CONSULTING

Why Everyone Should Learn How to Edit Video

Why Everyone Can (and Should!)… Learn to Draw …

Master Bathroom Designs Everybody Should Learn And Apply

Everyone should learn to swim | nataliekyoung

Everybody should learn how to treat asthma - AllDayChemist

Everyone Should Learn Statistics | Ten Miles Square | The …

Everyone should learn to drive in a simulator | The Verge

5 Reasons Everybody Should Learn to Dance by Lisa …

Why everyone should learn how to sell - Sales Distilled

Everybody should learn how to Ballroom Dance by Scott …

Aitor Molina: Everyone should learn English

Everyone should learn Backgammon | BoardGameGeek | BoardG



I propose the that we eliminate the silly everyone should learn history, algebra, chemistry, etc curriculum that we now have by the what the masses think.

So I have picked my new high school curriculum based on this list.

I think we should make every one learn to…

sail
ballroom dance
play backgammon
design bathrooms
do basic accounting


This should be the first year of high school. Makes as much sense as “everyone should learn to code.”

Sunday, January 17, 2016

IBM is at it again; more lies about Watson and AI

IBM is at it again. They are still pushing Watson and still being fraudulent about it. Let’s look at the commercial that aired this weekend: 

Watson: Ashley Bryant,  a teacher of small children.  

AB: That’s right. 

Watson: I have read it is the hardest job in the world.  

AB: Thats why I am here. 

Watson: I can offer advice form the accumulated  knowledge of other educators. 

AB: That’s wonderful.

Watson: I can tailor a curriculum for each student by cross referencing aptitude, development, and geography. 

AB: Sorry to interrupt but I just have one question: how do I keep them quiet? 

Watson: There is no known solution.


Every single line of this is nonsense, so let’s take it line by line:


Watson: Ashley Bryant, a teacher of small children.  

How would Watson know it was talking to this woman? Does Watson know her? What would it mean to know her? Did Watson happen to recognize her when she walked up to a computer? How would that have happened exactly? AI can do some of this, but recognizing a person you have never met is complicated, and at this point beyond the abilities of AI except in a very superficial way.

AB: That’s right. 

Watson: I have read it is the hardest job in the world.  


Oh, Watson has has it? Where exactly did it read that? How did it choose to say that as opposed to anything else it might have read about being a teacher? How did it know that this might be a reasonable thing to say? Does it have a conversational model of small talk with strangers? Why didn’t it say “teaching is something teachers do”? It probably read that too. Or “I read about someone who hated their teacher”? What mental model does Watson have that helps it select what to say from everything it has “read” that contains the word “teacher?” 

When people meet teachers in a new setting is this something that they likely to say to them? Wouldn’t that be a kind of condescending remark? Does Watson understand condescension? Does Watson understand intentions and goals in a conversation? NO. IBM is just pretending. IBM is making it all up. They are not working on how the mind works, how conversation works, or on AI really. They just like saying that that is what they are doing so they sell Watson.


AB: Thats why I am here. 

Watson: I can offer advice form the accumulated  knowledge of other educators. 

Really? It should be able to offer advice from me then. I have knowledge about teaching that includes that when someone comes to talk with you, they typically have a reason for doing so, and that a good teacher asks what someone is thinking about or what their problems might be. Even in this fictional conversation, Watson makes clear that it has no idea how teaching or learning work at all. The right answer to “that’s why I am here” would be to ask about her problem, not to make grandiose claims about things it can’t do, namely match what it has stored as text to what her real problem is. Asking the right question at the right time is one of the hallmarks of intelligence and good teaching and is way beyond anything Watson can do.

AB: That’s wonderful.

Watson: I can tailor a curriculum for each student by cross referencing aptitude, development and geography. 

Oh it can can it? Curricula are actually very difficult to build and doing so requires a sense of what a student might want to learn and best ways to get them challenged and excited. Knowing the geographical placement of the student is sometimes relevant but hardly a major issue. Measurements of aptitude are tricky. Is Watson going to make a curriculum based on a student’s SAT scores? Watson probably can provide more math problems to a student who got some wrong answers. That is probably something Watson can do, but it is not AI and does not take intelligence to do. A good curriculum designer tries to figure out what is hard to comprehend and tries to make learning more fun, more engaging, more challenging and more relevant to the individual goals of the students. Is that what Watson can do? Of course not. It can make absurd claims however (or the people who wrote the commercial can.) 

I heard about a company that uses Watson to help in education. It takes Wikipedia pages (or any text) and turns them into tests. A marvelous innovation. So, Watson can take a bunch of words and make up test questions about the. Thats what it can do in education. And, by the way, that doesn't require understanding what the questions are even about, which is good because Watson understands nothing.


AB: Sorry to interrupt but I just have one question: how do I keep them quiet? 

Watson: There is no known solution.

Why can’t Watson look up the word “quiet” and take words of wisdom from the accumulated knowledge of educators on the value of quiet?

Because this is a commercial, and like most commercials it is selling based on minimal truth. IBM should know better and it should stop doing this. They are trying to convince the world that computers are smarter than they are, that AI has succeeded far better than it has, and that they, IBM know a lot about AI. All they seem to know about AI is how to retrieve text and lie about it.

Time to stop this crap IBM.

Tuesday, December 22, 2015

Corporate training needs to re-think its model; no to courses and assessment, yes to experiences

In 1989, I witnessed corporate training for the first time. We had just started the Institute for The Learning Sciences, which was sponsored by Andersen Consulting (now Accenture). I visited their campus in St. Charles, Illinois, and saw many classrooms full of people who were mostly half asleep or in a daze from being talked at about corporate culture, and Andersen’s core values, and client needs, and so on.

But, they had spent a lot of money on me so they were willing to listen. Early on, they said we could re-do any course they offered there except one, which was the entry-level boot camp. So, that being the one that they thought was already perfect, that was the one I selected.

I saw immediately why they loved it. It simulated the experience of being on a week-long assignment with little or no sleep having to get technical work done with a new team in a role you did not know. That was what life was like at Andersen so they had effectively thrown their new hires into a sink or swim environment. I loved it. But, they were also trying to teach COBOL in that environment. The new hires had no actual job to accomplish other than to learn COBOL. I asked them why they thought learning COBOL under stressful conditions was likely to produce competent programmers.

I have had plenty of opportunity to look at corporate training since then, and my team and I have built quite a bit of it. So, now I want to say something easy to understand about corporate training: STOP IT.

Some things to stop doing:


  1. delivering content

Once a company decides to pursue a global training program and reaches shared agreement on how to define and develop the initiative, the instructional design team can take the next step: deciding what content to offer and how to design instruction to deliver it.




Content cannot be delivered. If it could, you could hire FedEx to do it. Content is usually spoken about as if it were a physical object. It isn’t. But, content is not a physical object.  In a book, the content is the same no matter whom it is delivered to. Socrates warned about this when the written word became commonplace saying that the words can’t defend themselves. But when we talk with one another we say different things to different people and respond to what they ask about and try again. Still content I suppose, but now it can’t be delivered in that FedEx (or MOOC) sort of way.

What needs to be “delivered” are dialogues with individuals. As it is now, training is like trying to argue with the package the Fed Ex man delivered.

2. expecting people to remember what you tell them

Montaigne, the great French philosopher said of his teachers: “They never ceased to scream in one’s ears as if they were pouring something into a barrel and one’s task was only to repeat what one was told.”

But we keep talking at people. If your training includes talking, then it isn’t working. If it includes Power Point it isn’t working. If it includes a classroom, it isn’t working. It has always fascinated me that corporate training looks so much like school (with classrooms!) Did you learn a lot in school? Did you like sitting in a classroom? For those who think they did, I suggest taking any college exam that you took once before and seeing if you could pass it now. School is based on the concept of retention of information. But, oddly, we don’t retain any information if we don’t regularly use that information. And if we do regularly use it, we do not have to attempt to retain it. We can’t help but retain it.

3. creating courses

Now I need to be careful here because my customers think we create courses for them. But we don’t really. We create experiences. There is a difference.

What is the difference? I was once consulting with United Airlines and I got to fly one of their big simulators. I don’t know how to fly a plane and I didn’t learn from 20 minutes in the simulator. In fact, I crashed on my first landing attempt. Could I have taken a course and learned what to do and what not to do? I guess I could have. But a better choice would have been to keep on trying and have a mentor sitting next to me to advise on what I was doing right and what I was doing wrong. When I advised the Army about their tank simulators (which are great) I was advising them to how to arrange things so that important mistakes are more easily made. You don’t learn that much from getting things right. You need to practice experiences in which you are likely to fail. These are not courses. They are a very different approach to education than courses. Try things out. Fail. Have someone around with whom you can discuss and get advice.

We often consult with companies about their courses. Here is what we usually find:

Many learners will go through an entire course when they will only do a few of the things taught in the their actual jobs.  One course for everyone is a waste of time and focus. Training people often have an obsession with complete coverage when such coverage is likely to be unimportant. Training should focus, first, on things people actually need to be able to do and, second, within those things on which they make mistakes.

There is often eLearning material. It regularly tries to cover far too much material in advance of when the learner actually needs to know it.  Training departments create videos, MOOCs, documents,  and think this will help people learn.  The critical skills the company wants to teach are lost in the details.  More time and money wasted.  
       
There are always assessment questions. Why? Because the training department wants to know if the students have “learned the material.” What the training department should really want to know is what the student can do that they couldn’t do before the training. They misunderstand assessment: measure abilities not facts. There is often a misalignment between the business and the training department. The business wants to know if people can do things, while the training department may want things that are easy to measure. 


   




It is the very concept of a course (and an assessment of facts delivered) that is the problem here. 

So, if we shouldn’t deliver content, or expect people to retain information or create courses, what should corporate training be?

Think about this:

When you went to summer camp, or boy scout camp, or anything similar, did you learn stuff? Did you think you were attending a course, or that content was being delivered? Or were you just doing stuff that was fun and learning new skills as you went along?

When you hang out with friends and decide to do a project together, or have an adventure together, do you learn stuff? You certainly learn about how to get along with each other, maybe how to work with each other, and maybe you learn to do things from one another. Is this a course? Is content being delivered?

Now let’s reconsider Accenture’s Boot Camp. Why did they have it? Because they needed people to understand how to work together under certain kinds of stressful conditions. This is what the Army does when it teaches new recruits how to be soldiers in simulated combat situations (when they aren’t marching and listening to speeches.)

When EPA coordinators realized they didn't know how to run a public meeting we built a simulated meeting for them to run. We didn’t build a course. When ISO realized it didn’t know how to train new people to be capable of dealing with ISO standards in a new country, we built a fictional country for them to operate in and multiple situations to deal with. When we were working on child development we had people run a simulated day care center so they deal with a variety of situations, problematic kids, and annoying parents. When we heard that cancer doctors didn't know how to conduct difficult conversations with their patients we created situations where they needed to advise colleagues who had just done it badly.

None of these are courses. None of these delivered content.

Corporate Training Departments need to adapt to the real world. Here is something I read the other day. At first glance, it looks entirely reasonable.

1 Guiding participants through data gathering with their team, structured assessments, learning, application, and reflection.

2 Ensuring accountability by forming a partnership between participants and their direct managers.  

3 Integrating deliberate practice into the journey, making on-the-job application a structured and tracked element of the program.
 
4 Providing technology that makes it easy for both participants and managers to play along with the journey, track progress, and share realizations and insights.
 
5 Providing results so that business leaders can see how skills grow as participants move through the program.

What is this? This is part of an announcement by a company in the corporate training space saying what their wonderful new product will do. I noticed it because it was written by a former PhD student of mine. He is a smart guy and I am sure he didn’t get dumber since he worked for me. But the world of corporate training has gotten dumber. As I pointed out in an earlier Outrage if we don’t say assessment, gamification, or social media, in every sentence, no one is happy.

On the surface, what he wrote doesn’t seem that bad. He is trying to sell stuff that people probably want to buy, so I can see that the average reader would think he is offering good stuff. Let me explain why I don’t think that is the case.

The underlying theme is assessment driving learning. “Ensuring accountability,”  “providing results to see how skills grow,” “tracking progress,” and “structured assessments,” are what he is excited about. Now I doubt he really is excited about that. In fact, he co-authored a book with me on how to get rid of assessments in education. Here is a quote from that book:

School cannot be changed in any important way until fixed curricula are eliminated.  But fixed curricula will not be eliminated until we change the way we assess progress. Bear in mind that adults take courses in subjects for which they pay money — courses in photography, weight loss, yoga, home repair — there is no test at the end. There isn’t a need for a test because students are their own masters. They set their own standards and rather than having themselves be judged, they judge the teacher. 


Corporate Training has to stop doing what school does, namely looking to provide numbers so that some other part of the business can say that someone learned something. Give your employees opportunities to really learn to do things and then you can report on actual accomplishments. Remember the real reason schools give tests and grades. It is because the parents are obsessed with their kids getting into college and colleges do not want to look at each student as an individual because they have too many applicants. So they demand tests about the quadratic equation or physics formulas that simply don’t matter to the average student. Corporations need to be smarter  than this. They can treat students as individuals and not as numbers. They don’t have to deal with choosing from tens of thousands of applicants. They just need to help the people they already have perform better. They have adopted the school model and they are suffering as a result.

Corporations can do this by providing employees with things they would really like to learn to do. Treat your people like grown ups. You can measure grown ups the way we have always measured each other. We promote employees we think do a good job. We are friends with people we think are fun to hang out with. We select as mentors people who always seem to give us good advice. Look at your people and help them do their jobs better. Mentor them. Stop assessing them.

We need to get rid of the corporate training mindset that has taken some of my best students and corrupted them.  The system wants to make training boring and wants to constantly measure progress. How sad.  This doesn't work in school and it doesn’t work for business.  

So, enough with our current corporate training model. Create situations that are like ones employees will need to deal with and have them try them out in a simulations (live or on a computer) before they try them out for real. Create experiences not courses.