Sal Khan: Let’s teach for mastery, not test scores @ TED Talks Live

TED Talks Live were held at The Town Hall Theater in NYC, in November of 2015. I had the pleasure of attending all six nights to hear speakers present impactful Ideas Worth Spreading. This post is an analysis of a talk by Sal Khan about how mastery and mindset can improve learning.

It’s a classic problem/solution story. One that describes a process that is being used on a global scale – in this case the process of learning – but often delivers less than ideal results. In such situations the stakes are high and new ways of thinking are required in order to address rapid changes in society.

Watch Sal’s TED Talk. He demonstrates that the status quo is not serving most students as it should, and offers an alternative that is based on his experience running the Khan Academy. In his view, it’s imperative that we change the way we learn. And if we do, the benefits to society are significant.

Transcript

(my notes in red)

I’m here today to talk about the two ideas that, at least based on my observations at Khan Academy, are kind of the core, or the key leverage points for learning. And it’s the idea of mastery and the idea of mindset.

When a speaker is well known, as is the case with Sal Khan who founded Khan Academy, a phrase such as ‘my observations at Khan Academy’ speaks volumes. He doesn’t need to explain his role or the history of the academy, but if you don’t have such notoriety, adding another sentence of explanation will keep the audience from being confused about who you are and the work you’re doing. In fact, at no point in his talk does Sal speak about his credentials. Few of us would be so fortunate.

I saw this in the early days working with my cousins. A lot of them were having trouble with math at first, because they had all of these gaps accumulated in their learning. And because of that, at some point they got to an algebra class and they might have been a little bit shaky on some of the pre-algebra, and because of that, they thought they didn’t have the math gene. Or they’d get to a calculus class, and they’d be a little bit shaky on the algebra. I saw it in the early days when I was uploading some of those videos on YouTube, and I realized that people who were not my cousins were watching.

Having introduced ‘the idea of mastery and the idea of mindset’, Sal provides an example that is also personal – ‘my cousins’ and by mentioning that it happened ‘in the early days’, he takes us back in time to the beginning of his journey. When you’re taking an audience on a journey of discovery, of developing a new view of the world, people want to know where it all started. What’s your origin story?

And at first, those comments were just simple thank yous. I thought that was a pretty big deal. I don’t know how much time you all spend on YouTube. Most of the comments are not “Thank you.” They’re a little edgier than that.

But then the comments got a little more intense, student after student saying that they had grown up not liking math. It was getting difficult as they got into more advanced math topics. By the time they got to algebra, they had so many gaps in their knowledge they couldn’t engage with it. They thought they didn’t have the math gene. But when they were a bit older, they took a little agency and decided to engage. They found resources like Khan Academy and they were able to fill in those gaps and master those concepts, and that reinforced their mindset that it wasn’t fixed; that they actually were capable of learning mathematics.

He then shifts the narrative from his cousins to the general public who have been watching his math videos on YouTube. In doing so Sal offers evidence that people who struggled with math could master the concepts that had been troublesome. In your idea-driven story, can you offer examples of how your idea is having an impact? That signifies that your idea has been, to some extent, validated.

And in a lot of ways, this is how you would master a lot of things in life. It’s the way you would learn a martial art. In a martial art, you would practice the white belt skills as long as necessary, and only when you’ve mastered it you would move on to become a yellow belt. It’s the way you learn a musical instrument: you practice the basic piece over and over again, and only when you’ve mastered it, you go on to the more advanced one.

Sal uses the examples of martial arts and music to support the idea of mastery that he began with. In this way we understand that the principle at hand is not confined to his one subject, but instead is common in many aspects of life. Most social problems have parallels elsewhere in society.

But what we point out — this is not the way a traditional academic model is structured, the type of academic model that most of us grew up in. In a traditional academic model, we group students together, usually by age, and around middle school, by age and perceived ability, and we shepherd them all together at the same pace. And what typically happens, let’s say we’re in a middle school pre-algebra class, and the current unit is on exponents, the teacher will give a lecture on exponents, then we’ll go home, do some homework. The next morning, we’ll review the homework, then another lecture, homework, lecture, homework. That will continue for about two or three weeks, and then we get a test. On that test, maybe I get a 75 percent, maybe you get a 90 percent, maybe you get a 95 percent. And even though the test identified gaps in our knowledge, I didn’t know 25 percent of the material. Even the A student, what was the five percent they didn’t know?

Even though we’ve identified the gaps, the whole class will then move on to the next subject, probably a more advanced subject that’s going to build on those gaps. It might be logarithms or negative exponents. And that process continues, and you immediately start to realize how strange this is. I didn’t know 25 percent of the more foundational thing, and now I’m being pushed to the more advanced thing. And this will continue for months, years, all the way until at some point, I might be in an algebra class or trigonometry class and I hit a wall. And it’s not because algebra is fundamentally difficult or because the student isn’t bright. It’s because I’m seeing an equation and they’re dealing with exponents and that 30 percent that I didn’t know is showing up. And then I start to disengage.

In this story block, Sal describes how a traditional education system works and identifies a fundamental flaw in the learning process – the fact that students are expected to learn new concepts using a foundation that contains knowledge gaps. This description not only resonates with the highly educated audience at the event, but will also be familiar with students around the world. In doing so, he builds a connection to the local, as well as the remote, audience.

To appreciate how absurd that is, imagine if we did other things in our life that way. Say, home-building. So we bring in the contractor and say, “We were told we have two weeks to build a foundation. Do what you can.” So they do what they can. Maybe it rains. Maybe some of the supplies don’t show up. And two weeks later, the inspector comes, looks around, says, “OK, the concrete is still wet right over there, that part’s not quite up to code … I’ll give it an 80 percent.” You say, “Great! That’s a C. Let’s build the first floor.”

Same thing. We have two weeks, do what you can, inspector shows up, it’s a 75 percent. Great, that’s a D-plus. Second floor, third floor, and all of a sudden, while you’re building the third floor, the whole structure collapses. And if your reaction is the reaction you typically have in education, or that a lot of folks have, you might say, maybe we had a bad contractor, or maybe we needed better inspection or more frequent inspection. But what was really broken was the process. We were artificially constraining how long we had to something, pretty much ensuring a variable outcome, and we took the trouble of inspecting and identifying those gaps, but then we built right on top of it.

As he did previously, Sal uses an analogy – this time building a house – to illustrate the result of creating a flawed foundation. Analogies can be an impactful part of your narrative, as they provide your audience with another way of seeing the problem that you’re addressing. When Sal says ‘Let’s build the first floor.’ what goes through your mind is, ‘This is not going to end well.’ Which is the point he’s making about the education system. You would never consider building a house with a flawed foundation.

So the idea of mastery learning is to do the exact opposite. Instead of artificially constraining, fixing when and how long you work on something, pretty much ensuring that variable outcome, the A, B, C, D, F — do it the other way around. What’s variable is when and how long a student actually has to work on something, and what’s fixed is that they actually master the material.

Every story that is concerned with a problem, must naturally shift to the solution, which in this story is ‘… to do the exact opposite.’ The change is from focusing on the time constraint to focusing on ‘mastery learning’. Where this pivot occurs is different in every story. In this talk, it’s about the half way point, which is pretty common. What’s important is that the pivot is clear the audience.

And it’s important to realize that not only will this make the student learn their exponents better, but it’ll reinforce the right mindset muscles. It makes them realize that if you got 20 percent wrong on something, it doesn’t mean that you have a C branded in your DNA somehow. It means that you should just keep working on it. You should have grit; you should have perseverance; you should take agency over your learning.

As he continues with the benefits of his approach to learning, Sal touches upon the second idea that he mentioned at the beginning of his talk – mindset. Rather than feeling that a low score is the final word, he encourages students to take control of their situation, to have grit, perseverance and agency. Solutions to problems that require individual action should include the inspiration to take those actions.

Now, a lot of skeptics might say, well, hey, this is all great, philosophically, this whole idea of mastery-based learning and its connection to mindset, students taking agency over their learning. It makes a lot of sense, but it seems impractical. To actually do it, every student would be on their own track. It would have to be personalized, you’d have to have private tutors and worksheets for every student. And these aren’t new ideas — there were experiments in Winnetka, Illinois, 100 years ago, where they did mastery-based learning and saw great results, but they said it wouldn’t scale because it was logistically difficult. The teacher had to give different worksheets to every student, give on-demand assessments.

If there are audience members who doubt the veracity of your idea, including an opposite viewpoint story block allows the speaker to address concerns that might be present. In this case he includes the example of a previous experiment, the challenges they encountered, then follows on with his view that such issues are no longer a problem today. The general approach is ‘you may see the situation this way, but I have a different view that I want to share with you’.

But now today, it’s no longer impractical. We have the tools to do it. Students see an explanation at their own time and pace? There’s on-demand video for that. They need practice? They need feedback? There’s adaptive exercises readily available for students.

In a longer talk there would be time to provide examples of how ‘on-demand video’ and ‘adaptive exercises’ would work for students. I was left with a concept, but not much in the way of understanding. Hearing one story about an individual would have made the idea much more impactful.

And when that happens, all sorts of neat things happen. One, the students can actually master the concepts, but they’re also building their growth mindset, they’re building grit, perseverance, they’re taking agency over their learning. And all sorts of beautiful things can start to happen in the actual classroom. Instead of it being focused on the lecture, students can interact with each other. They can get deeper mastery over the material. They can go into simulations, Socratic dialogue.

Sal reiterates some of the key point previously mentioned in his talk – mastering the concepts, building a growth mindset, building grit and perseverance and taking agency. This is a way to remind the audience of those factors which are important to your solution. Once again, however, I wanted to hear a story. An example of how a more dynamic classroom would operate. Take me inside the room. Let me feel the experience.

To appreciate what we’re talking about and the tragedy of lost potential here, I’d like to give a little bit of a thought experiment. If we were to go 400 years into the past to Western Europe, which even then, was one of the more literate parts of the planet, you would see that about 15 percent of the population knew how to read. And I suspect that if you asked someone who did know how to read, say a member of the clergy, “What percentage of the population do you think is even capable of reading?” They might say, “Well, with a great education system, maybe 20 or 30 percent.”

But if you fast forward to today, we know that that prediction would have been wildly pessimistic, that pretty close to 100 percent of the population is capable of reading. But if I were to ask you a similar question: “What percentage of the population do you think is capable of truly mastering calculus, or understanding organic chemistry, or being able to contribute to cancer research?” A lot of you might say, “Well, with a great education system, maybe 20, 30 percent.”

But what if that estimate is just based on your own experience in a non-mastery framework, your own experience with yourself or observing your peers, where you’re being pushed at this set pace through classes, accumulating all these gaps? Even when you got the A, that 95 percent, what was that five percent you missed? And it keeps accumulating — you get to an advanced class, all of a sudden you hit a wall and say, “I’m not meant to be a cancer researcher; I’m not meant to be a physicist; I’m not meant to be a mathematician.”

And I suspect that that actually is the case, but if you were allowed to be operating in a mastery framework, if you were allowed to really take agency over your learning, and when you get something wrong, embrace it — view that failure as a moment of learning — that number, the percent that could really master calculus or understand organic chemistry, is actually a lot closer to 100 percent.

The use of a ‘what if’ type of hypothetical question allows the audience to envision what could be better if the process was improved. In a problem/solution, idea-driven storyline, that’s a way of asking, ‘What if my solution were implemented? What would the result be?’ There are no guarantees that a proposed solution will work, but if you explain it clearly and give examples, the audience can imagine what the future might look like.

And this isn’t even just a “nice to have.” I think it’s a social imperative. We’re exiting what you could call the industrial age and we’re going into this, whatever, information revolution. And it’s clear that some things are happening. In the industrial age, society was a pyramid. And at the base of the pyramid, you needed human labor. In the middle of the pyramid, you had an information processing, a bureaucracy class, and at the top of the pyramid, you had your owners of capital and your entrepreneurs and your creative class. But we know what’s happening already, as we go into this information revolution. The bottom of that pyramid, automation, is going to take over. Even that middle tier, information processing, that’s what computers are good at.

Sal brings up an important point, that society is changing rapidly due to a revolution in information processing, which in his mind, means that it’s imperative to adopt a new way of learning. This is common for social issues that are not static. Which is to say, your solution is not just about solving a current problem, but is also needed going forward to prevent even greater harm. Think about how the future will look without your ideas being implemented. Is there a similar imperative within your story that the audience needs to understand?

So as a society, we have a question: All this new productivity is happening because of this technology, but who participates in it? Is it just going to be that very top of the pyramid, in which case, what does everyone else do? How do they operate? Or do we do something that’s more aspirational? Do we actually attempt to invert the pyramid, where you have a large creative class, where almost everyone can participate as an entrepreneur, an artist, as a researcher?

And I don’t think that this is utopian. I really think that this is all based on the idea that if we let people tap into their potential by mastering concepts, by being able to exercise agency over their learning, that they can get there. And when you think of it as just a citizen of the world, it’s pretty exciting. I mean, think about the type of equity we can we have, and the rate at which civilization could even progress. And so, I’m pretty optimistic about it. I think it’s going to be a pretty exciting time to be alive.

Thank you.

The visual of ‘inverting the pyramid’ is powerful, it’s a classic, ‘turn the problem on its head’ sort of narrative, but I’m not sure it works here. It may make sense to you, but it had me scratching my head. I was thinking that Sal’s approach to learning, whereby students learn at their own pace, master each level before moving on, and take control of their future, feels more like ‘leveling the playing field’.

But that’s a relatively small complaint, as the crux of his talk is about how our education system is fundamentally flawed, but doesn’t need to be. That we can change how the system operates, and in doing so, give students the opportunity to thrive instead of struggle.

[Note: all comments inserted into this transcript are my opinions, not those of the speaker, the TED organization, nor anyone else on the planet. In my view, each story is unique, as is every interpretation of that story. The sole purpose of these analytical posts is to inspire a storyteller to become a storylistener, and in doing so, make their stories more impactful.]

Learn more about the coaching process or
contact me to discuss your storytelling goals!

Subscribe to our newsletter for the latest updates!

Copyright Storytelling with Impact – All rights reserved

Nadia Lopez: Why open a school? To close a prison @ TED Talks Live

TED Talks Live were held at The Town Hall Theater in NYC, in November of 2015. I had the pleasure of attending all six nights to hear speakers present impactful Ideas Worth Spreading. This post is an analysis of a talk by Nadia Lopez on the power of the education system to change lives.

As some of you may know, I worked on two events held inside a state prison. TEDxDonovanCorrectional was an eye-opening experience, as the men that I coached often told me stories about growing up without a proper education. It wasn’t an uncommon story for a teenager to drop out of school and join a gang. Nadia’s story is a reminder that changes to the education system are possible, but it takes a new vision and a dedicated team to make that happen.

Watch Nadia’s TED Talk. It’s an ideal example of personal storytelling that is effective within a short timeframe. Then review your own manuscript. Have you tightened your prose to be direct and impactful? Does every sentence matter?

Transcript

(my notes in red)

When I opened Mott Hall Bridges Academy in 2010, my goal was simple: open a school to close a prison. Now to some, this was an audacious goal, because our school is located in the Brownsville section of Brooklyn — one of the most underserved and violent neighborhoods in all of New York City. Like many urban schools with high poverty rates, we face numerous challenges, like finding teachers who can empathize with the complexities of a disadvantaged community, lack of funding for technology, low parental involvement and neighborhood gangs that recruit children as early as fourth grade.

Notice how much the first line, in just 20 words, says about the story. Her action – opening the academy. When action happened – 2010. Her goal – opening a school to close a prison. We don’t know what that means, exactly, so she’s caught our interest and we want to know the answer. In the next 2 sentences she goes deeper into the background of the story – the neighborhood, poverty rates, finding teachers, lack of funding, parents and gangs. All of this is revealed in less than a minute. She makes every word count.

She shows a slide comparing the rate of shootings between the Brownsville section of Brooklyn to all of Manhattan. The visual is easy to understand – the comparison startling.

So here I was, the founding principal of a middle school that was a district public school, and I only had 45 kids to start. Thirty percent of them had special needs. Eighty-six percent of them were below grade level in English and in math. And 100 percent were living below the poverty level.

Nadia uses 3 key statistics to illustrate the difficulties that she faced – 30% special needs, 86% below grade level, 100% below poverty level. With few words we come to understand the extent of the challenge that’s ahead of her.

If our children are not in our classrooms, how will they learn? And if they’re not learning, where would they end up? It was evident when I would ask my 13-year-old, “Young man, where do you see yourself in five years?” And his response: “I don’t know if I’m gonna live that long.”

In a longer talk Nadia could have given us more background on her son, but I doubt that it would have done anything to increase the impact of considering a 13-year-old who doubts whether he will celebrate his 18th birthday.

Or to have a young woman say to me that she had a lifelong goal of working in a fast-food restaurant. To me, this was unacceptable. It was also evident that they had no idea that there was a landscape of opportunity that existed beyond their neighborhood.

We call our students “scholars,” because they’re lifelong learners. And the skills that they learn today will prepare them for college and career readiness. I chose the royal colors of purple and black, because I want them to be reminded that they are descendants of greatness, and that through education, they are future engineers, scientists, entrepreneurs and even leaders who can and will take over this world. To date, we have had three graduating classes, at a 98 (applause) At a 98-percent graduation rate. This is nearly 200 children, who are now going to some of the most competitive high schools in New York City.

The narrative shifts from background to the students in her school, with a brief description of her philosophy, and ending with a statistic – 98% graduation rate – that is in stark contrast to the opening set of statistics. Contrast is a powerful way to use statistics.

It was a cold day in January when my scholar, Vidal Chastanet, met Brandon Stanton, the founder of the popular blog “Humans of New York.” Brandon shared the story of a young man from Brownsville who had witnessed violence firsthand, by witnessing a man being thrown off of a roof. Yet he can still be influenced by a principal who had opened up a school that believes in all children. Vidal embodies the story of so many of our underprivileged children who are struggling to survive, which is why we must make education a priority.

The narrative shifts again, this time to a specific student and a blogger – a story block about other people. Showing a picture of Vidal also serves to humanize the segment. We are now able to experience more than her words. Vidal is a vivid part of the story too.

Brandon’s post created a global sensation that touched the lives of millions. This resulted in 1.4 million dollars being raised for our scholars to attend field trips to colleges and universities, Summer STEAM programs, as well as college scholarships. You need to understand that when 200 young people from Brownsville visited Harvard, they now understood that a college of their choice was a real possibility. And the impossibilities that had been imposed upon them by a disadvantaged community were replaced by hope and purpose.

Nadia then shares the result of that blog post, using a statistic – 1.4 million dollars – and what that number equates to – field trips, STEAM programs, college scholarships. We easily follow the chain of events – student, blogger, post, donations, programs – it’s clear in our mind.

The revolution in education is happening in our schools, with adults who provide love, structure, support and knowledge. These are the things that inspire children. But it is not an easy task. And there are high demands within an education system that is not perfect.

But I have a dynamic group of educators who collaborate as a team to determine what is the best curriculum. They take time beyond their school day, and come in on weekends and even use their own money to often provide resources when we do not have it. And as the principal, I have to inspect what I expect.

So I show up in classes and I conduct observations to give feedback, because I want my teachers to be just as successful as the name Mott Hall Bridges Academy. And I give them access to me every single day, which is why they all have my personal cell number, including my scholars and those who graduated — which is probably why I get phone calls and text messages at three o’clock in the morning.

We come back to the topic of education, the revolution that’s happening, the educators dedication, her personal commitment to everyone involved in the process. And she turns the spotlight on the people who are part of the team to give them credit for their contribution.

But we are all connected to succeed, and good leaders do this. Tomorrow’s future is sitting in our classrooms. And they are our responsibility. That means everyone in here, and those who are watching the screen. We must believe in their brilliance, and remind them by teaching them that there indeed is power in education.

In her closing, Nadia brings the audience into the narrative and emphasizes the responsibility that we all share, to support the power in education. There’s no specific call to action – to volunteer at your local school, or donate money, or write to a politician – it’s a simple reminder that we hold the future of these young students in our hands.

Thank you.

Note her composure on stage, and her measured pace of speaking that makes the narrative and underlying message easy to understand. Yet you can still hear the passion in her voice. Without moving across the stage Nadia turns to address each section of the audience, making direct eye contact. She also uses her hands in a way that emphasizes key words.

At under 7 minutes this story says a lot, and serves as an example of how much can be said in a short amount of time. But in my opinion, I would appreciate a longer talk, maybe in the 12 minute range, as I know she has so much more to say. But that’s just me. How about you? Where there questions on your mind at the end, or issues that you wanted to hear more about? This is one of the biggest challenges we all have when crafting a personal story. Maximizing the impact in the time allowed. So make sure every word counts.

[Note: all comments inserted into this transcript are my opinions, not those of the speaker, the TED organization, nor anyone else on the planet. In my view, each story is unique, as is every interpretation of that story. The sole purpose of these analytical posts is to inspire a storyteller to become a storylistener, and in doing so, make their stories more impactful.]

Learn more about the coaching process or
contact me to discuss your storytelling goals!

Subscribe to our newsletter for the latest updates!

Copyright Storytelling with Impact – All rights reserved