1 00:00:01,600 --> 00:00:05,600 But I'd like to show you next is a case study of a 2 00:00:05,600 --> 00:00:09,800 team that works in this collaborative. Cross-functional way. This is 3 00:00:09,800 --> 00:00:10,100 a 4 00:00:12,300 --> 00:00:16,500 Widely available video of the Nordstrom Innovation lab, there an RD team. 5 00:00:18,300 --> 00:00:22,500 And they're focused on finding new products for the Nordstrom, a organization to 6 00:00:22,900 --> 00:00:26,800 invest in. Now, the two things I want you to keep in mind, as you watch 7 00:00:26,800 --> 00:00:30,700 this video are that this team Works in one week iterations. 8 00:00:31,200 --> 00:00:35,800 Their project length is one week, and they're tasked with failing 9 00:00:36,200 --> 00:00:37,300 80% of the time. 10 00:00:40,200 --> 00:00:44,500 Okay, so watch this video and then we'll discuss what we saw in the video 11 00:00:44,500 --> 00:00:45,000 itself. 12 00:00:51,800 --> 00:00:55,500 I'm JB Brown the Nordstrom Innovation lab manager and this is the lap. 13 00:00:56,800 --> 00:01:00,700 We work on one week experiments. Somebody will have an idea and we'll find a way to 14 00:01:00,700 --> 00:01:04,900 figure out how to prove if the idea is going to work and this week, The Innovation 15 00:01:04,900 --> 00:01:08,800 lab is going to be building an iPad app with customer feedback as we go 16 00:01:08,800 --> 00:01:12,400 through the week. We wanted to work in the store to make sure that we were getting customer feedback 17 00:01:12,400 --> 00:01:16,800 as we work. So that we were never working on anything that wasn't valued by the customer, and 18 00:01:16,800 --> 00:01:20,600 only doing things that are delivering value. So, we'll be building a 19 00:01:20,600 --> 00:01:24,900 feature and testing it till we get to the point where we have something that's 20 00:01:24,900 --> 00:01:26,500 good enough that we can. 21 00:01:26,900 --> 00:01:30,700 Leave and leave the iPad at behind and have this new 22 00:01:30,700 --> 00:01:34,700 thing that customers can use, this is the world's first flash build, it's 23 00:01:34,700 --> 00:01:38,600 a flash mob. We're a software team shows up and built an application and it's 24 00:01:38,600 --> 00:01:42,600 priced location. So the Nordstrom Innovation lab and we're at the flagship store in 25 00:01:42,600 --> 00:01:46,800 downtown Seattle right now, the team is just setting up their equipment to get started. We're going to 26 00:01:46,800 --> 00:01:50,900 build an iPad app that helps customers pick the best pair of sunglasses for 27 00:01:50,900 --> 00:01:54,800 them. We really don't know what the features are yet. We're going to use customer feedback 28 00:01:54,800 --> 00:01:56,600 as we go along throughout the day and the rest. 29 00:01:56,700 --> 00:02:00,900 Rest of the week in order to build the best thing. So the next thing we're going to do is use 30 00:02:00,900 --> 00:02:04,800 your story map. So we're going to sit here and together outline, all the 31 00:02:04,800 --> 00:02:08,700 steps that custom would take and actually beforehand how they buy sunglasses like what are 32 00:02:08,700 --> 00:02:12,900 the different things that they might do and how that process might change if we have this 33 00:02:12,900 --> 00:02:16,700 application? No actually dig into what we have to build in order to support that process. 34 00:02:16,700 --> 00:02:20,900 So now that we've done a card mapping, we're going to do a paper prototype and this is 35 00:02:20,900 --> 00:02:24,800 something that we commonly do in The Innovation lab. It's a great way to show. 36 00:02:24,800 --> 00:02:26,600 What we'd like to do in a ref 37 00:02:26,800 --> 00:02:30,900 Prototype that we can easily throw out, change, alter based 38 00:02:30,900 --> 00:02:34,500 on feedback from the customers, I'll continue building individual, paper 39 00:02:34,500 --> 00:02:38,700 slides, and our user experience specialist at what L will bring the 40 00:02:38,700 --> 00:02:42,500 prototype to a customer and say, okay, I have this app and this is a paper 41 00:02:42,500 --> 00:02:46,800 version, I'd like you to kind of use it, like you would normally use an app and you can 42 00:02:46,800 --> 00:02:50,900 press things interact with them and then she'll change out the pages, based on how the 43 00:02:50,900 --> 00:02:54,200 customer uses it. So, it's a similar experience to the iPad, 44 00:02:54,400 --> 00:02:56,600 only an analog version, 45 00:02:56,700 --> 00:03:00,900 And so it's day two and we have our first working prototype of this app and how 46 00:03:00,900 --> 00:03:04,600 it works. Is it take my first pair of sunglasses, it on 47 00:03:05,500 --> 00:03:09,800 the picture, Alright? And then I want to compare it to this other pair of got right 48 00:03:09,800 --> 00:03:12,600 here. Put these on 49 00:03:15,600 --> 00:03:19,400 The picture. I can just fill these up like this and see which one I like better. 50 00:03:20,100 --> 00:03:24,600 Tell him Kim having talking to people and doing paper prototypes. We've been coding, 51 00:03:24,900 --> 00:03:28,800 building an iPad. We take a stab at something. We look at the paper 52 00:03:28,800 --> 00:03:32,700 prototypes, they put together, we might take one at a time. 53 00:03:32,800 --> 00:03:36,800 Usually we come to the board and we grabbed the most important feature 54 00:03:36,800 --> 00:03:40,900 and we start implementing it. The really cool thing with this flash build is that we have 55 00:03:40,900 --> 00:03:44,700 actual real customers just today, we delivered four or five different separate features. 56 00:03:44,900 --> 00:03:48,800 And I deliver it swap. The iPad would tell. She would go and talk to a 57 00:03:48,800 --> 00:03:52,500 customer and 10 minutes later I had feedback from real customers about this thing that I 58 00:03:52,500 --> 00:03:56,500 delivered and it changed how we did the next. And it's been really, really great watching 59 00:03:56,500 --> 00:04:00,800 day-to-day. What they've been doing the team to get all the feedback from the salespeople 60 00:04:00,800 --> 00:04:04,900 that feedback to sales people gathered in the customers. And it's a really interesting process 61 00:04:04,900 --> 00:04:08,600 to kind of come in on Tuesday. We had no idea what this would look like. There's an 62 00:04:08,600 --> 00:04:12,400 idea that somebody had to say people take a lot of pictures themselves, the 63 00:04:12,400 --> 00:04:14,700 sunglasses. It be cool if we could show them Side by. 64 00:04:14,800 --> 00:04:18,700 My side to help them make the process better. And that was the idea that was it. They came in at nothing 65 00:04:18,700 --> 00:04:22,900 built and they've been building this literally on the spot throughout each day. And by 66 00:04:22,900 --> 00:04:26,400 now, we actually have an app for functioning after they can go through. It's very 67 00:04:26,400 --> 00:04:30,700 intuitive to help. Look at themselves and make the sunglass, selection process 68 00:04:30,700 --> 00:04:34,900 easier, which is pretty cool to watch. So, yesterday, the sunglass, buyer for Nordstrom came down to 69 00:04:34,900 --> 00:04:38,800 check out our progress, and she happened to put on polarized glasses and then held 70 00:04:38,800 --> 00:04:42,500 up the iPad and portrait View and was surprised that she couldn't see anything because it's 71 00:04:42,500 --> 00:04:44,700 black. We figured out that hole. 72 00:04:44,800 --> 00:04:48,800 Relation of the iPad running up and down and the polarization of the glasses running 73 00:04:48,800 --> 00:04:52,600 vertical. Cancel each other out, you don't see anything but if you turn the iPad to 74 00:04:52,600 --> 00:04:56,900 landscape, you see perfectly fine because the polarization of the two items lined up and 75 00:04:56,900 --> 00:05:00,800 it's okay. So it was pretty good, find to be in the store and she just 76 00:05:00,800 --> 00:05:04,600 happened. Put on polarized glasses. And so today, first thing we're going to do is switch it to a 77 00:05:04,600 --> 00:05:08,100 landscape design and then lock in the aspect ratio of the iPad. So, 78 00:05:08,400 --> 00:05:12,500 customers and sales, people just naturally pick it up and use it in landscape and not try and go to 79 00:05:12,500 --> 00:05:14,700 Portrait, okay? So I'm going to show you 80 00:05:14,800 --> 00:05:18,800 You what we've been working on the last five days, we've added quite a few features of the week. 81 00:05:18,800 --> 00:05:22,800 You take a picture multiple pictures of the customer and then pull them up 82 00:05:23,300 --> 00:05:27,800 to have the first one, you can see it larger. And then tap the second and do a 83 00:05:27,800 --> 00:05:31,700 side-by-side comparison of each glass next to each other. We also added a 84 00:05:31,700 --> 00:05:35,900 feature where you can rename the picture because we heard from sales people. 85 00:05:35,900 --> 00:05:39,900 If a customer is trying on quite a lot of glasses, it's helpful to be able to know what 86 00:05:39,900 --> 00:05:43,800 order they were taken in and also rename if you want with the brand 87 00:05:43,800 --> 00:05:44,600 or some 88 00:05:44,800 --> 00:05:48,700 Distinguishing feature of the glass. Another feature we added was the ability to 89 00:05:48,700 --> 00:05:52,800 zoom in zoom in and really get a good detailed. Look at the frame 90 00:05:52,800 --> 00:05:56,600 side by side. Also the see one of the pictures 91 00:05:56,600 --> 00:06:00,900 larger, if you want to just better view of one frame, you can put the 92 00:06:00,900 --> 00:06:04,700 camera view as well face it forward. So the sales person could take a picture of 93 00:06:04,700 --> 00:06:08,700 it like this or you can click the camera. So 94 00:06:09,400 --> 00:06:13,900 take the picture yourself facing and then at the end of it all, we have 95 00:06:13,900 --> 00:06:14,600 a button called 96 00:06:14,700 --> 00:06:18,700 Customer which just erases all of the images and allows the 97 00:06:18,700 --> 00:06:22,800 salesperson to start with a new customer. We just try to put the final touches on the app and tell 98 00:06:22,800 --> 00:06:26,700 talk to a lot of users and they said that when we went into the compare view, 99 00:06:26,700 --> 00:06:30,900 it was unclear where the pictures were coming from and which picture was which. So the 100 00:06:30,900 --> 00:06:34,300 animation here is trying to solve that problem, make it more clear, what's going on? 101 00:06:34,600 --> 00:06:38,900 One of the challenges with software is when you're done, right? And I think the answer is really, 102 00:06:38,900 --> 00:06:42,600 it depends on how much time you have at least the most boring things got done. So 103 00:06:42,600 --> 00:06:44,300 this was time box to a week. 104 00:06:44,700 --> 00:06:48,600 We did a week's worth of work and it seems like what we have now is something that makes customers 105 00:06:48,600 --> 00:06:52,800 happy and addresses the main problems and something that we can track, we have metrics on. 106 00:06:52,800 --> 00:06:56,400 So weird call that a day. The 107 00:06:56,400 --> 00:07:00,700 application has developed so far. Everything's finished everything that we've 108 00:07:00,700 --> 00:07:04,800 asked for and even the little roadblocks and glitches that we kind of stumbled across as 109 00:07:04,800 --> 00:07:08,900 we use the app during the week has been solved. I think that it's going to be really easy 110 00:07:08,900 --> 00:07:12,600 to be able to implement into our sale. And I think there were going to find a lot of 111 00:07:12,600 --> 00:07:14,600 success with application. Whether it's be 112 00:07:14,700 --> 00:07:18,800 Be a selling tool for us or if it goes public into a 113 00:07:18,800 --> 00:07:22,900 downloadable format, whatever happened that he was generally quite success. 114 00:07:25,800 --> 00:07:29,800 So what did you see in the video? What was interesting, what was different? What 115 00:07:29,800 --> 00:07:31,400 was unique about the way this team works? 116 00:07:33,100 --> 00:07:37,700 I think the speed in which they were just releasing the 117 00:07:37,700 --> 00:07:41,800 application, I'm kind of constant feedback. I mean, they were pushing iPad 118 00:07:41,800 --> 00:07:45,900 belts back and forth. Like every 10 minutes of seeing that I started on the first day, I thought 119 00:07:45,900 --> 00:07:49,800 that was very impressive. The speed is amazingness and what enabled them 120 00:07:49,800 --> 00:07:53,700 to move that quickly. Yeah, it directs you 121 00:07:53,700 --> 00:07:57,900 feedback from customers so that actually could see what's you customers. 122 00:07:57,900 --> 00:07:59,700 Like, what do they don't like 123 00:08:01,100 --> 00:08:05,700 It was parked in the feedback loop with customers was was very quickly because they have a 124 00:08:05,700 --> 00:08:09,800 direct line to the, to the end user. And then get that feedback very quickly, 125 00:08:10,200 --> 00:08:14,900 how did they get access to the customers? I think, one of the things that 126 00:08:14,900 --> 00:08:18,900 really helped is that the whole team was there. The design team was there constantly rolling 127 00:08:18,900 --> 00:08:22,600 out iterations. The programmers were willing a Tinder iterations. The 128 00:08:22,600 --> 00:08:26,000 client was there, and the you end-user was there. So, you had a full 129 00:08:26,400 --> 00:08:30,100 collaboration between every aspect of the project. 130 00:08:30,500 --> 00:08:34,800 Yes, everyone that needed to be on the team was on the team and was 131 00:08:34,800 --> 00:08:38,900 present and participating in that process. Where were 132 00:08:38,900 --> 00:08:39,800 they physically? 133 00:08:42,400 --> 00:08:46,800 Yeah, in the shop they were in the store right? Baby. They planted 134 00:08:46,800 --> 00:08:50,800 themselves in a place that would allow them to get that rapid customer 135 00:08:50,800 --> 00:08:54,900 feedback at a pace that allows them to push builds every 10 minutes. 136 00:08:55,800 --> 00:08:58,400 Right? What else is interesting about that lets you find interesting about that. 137 00:09:01,900 --> 00:09:05,900 One of the things that was clear is they had a long list of things they could 138 00:09:05,900 --> 00:09:09,600 do. But obviously emphasized, the most important things to allow them to get 139 00:09:09,600 --> 00:09:13,900 features out. It's hard to see a little bit from the story, all the things that 140 00:09:13,900 --> 00:09:17,900 they didn't do. But as you can imagine, there was probably a lot of things they were thinking about 141 00:09:17,900 --> 00:09:21,900 doing, but did a great job prioritizing, which as 142 00:09:21,900 --> 00:09:25,500 we know, can certainly Aid in the speed of releasing product. 143 00:09:25,500 --> 00:09:27,800 How did they pick, how do they prioritize? 144 00:09:29,500 --> 00:09:33,500 I think one of the things that helped us is they had a week and 145 00:09:34,300 --> 00:09:38,400 they figured out what the most important items were for the user and the customer 146 00:09:38,400 --> 00:09:42,800 first and they had a, they had a timeline. Yeah. They 147 00:09:42,800 --> 00:09:46,600 say that the end there. How do you know when you're done? You're done. When you run out of 148 00:09:46,600 --> 00:09:50,500 time and so they, the reality is in 149 00:09:50,500 --> 00:09:54,800 software is that you can fix one of two things you can fix scope, but you 150 00:09:54,800 --> 00:09:55,800 can fix time, 151 00:09:58,100 --> 00:10:02,800 And in this case they fix time and they said we're going to build the best product that we can 152 00:10:03,600 --> 00:10:04,400 in a week. 153 00:10:05,500 --> 00:10:09,900 And they made prioritization decisions based on that customer feedback 154 00:10:10,800 --> 00:10:14,800 and take it back a step for a second. How did they even decide tool to tackle this 155 00:10:14,800 --> 00:10:18,600 particular product or this, this this, this 156 00:10:18,600 --> 00:10:21,400 business problem, how do they even get there? 157 00:10:23,900 --> 00:10:27,900 Why were they even solving this particular situation? 158 00:10:29,900 --> 00:10:33,800 It was a, it was a question from the store 159 00:10:33,800 --> 00:10:37,700 planner but today could help customers in a 160 00:10:37,700 --> 00:10:41,700 certain way of comparing losses. So there was, there was store 161 00:10:41,700 --> 00:10:45,500 staff. That was observing customers and 162 00:10:45,500 --> 00:10:49,900 recognizing that there was a certain behavior that customers were engaging in 163 00:10:49,900 --> 00:10:53,900 when they were shopping for glasses which there was an opportunity to 164 00:10:53,900 --> 00:10:57,800 improve so. By observing customers, contextual observation and 165 00:10:57,800 --> 00:10:58,300 customers. 166 00:10:58,900 --> 00:11:02,900 In the wild and in the natural habitat of doing whatever it is that 167 00:11:02,900 --> 00:11:06,700 they do with our within their case, with the sunglass, purchase process. But whatever 168 00:11:06,700 --> 00:11:08,900 your business is, they discovered 169 00:11:10,200 --> 00:11:14,800 Opportunities for improvement. They saw people come in and they saw them taking cell 170 00:11:14,800 --> 00:11:18,500 phone photos of themselves and if you've ever been to buy glasses or 171 00:11:18,500 --> 00:11:22,800 sunglasses and you actually wear glasses, right? What's the first thing that you 172 00:11:22,800 --> 00:11:26,300 do? When you walk into the sunglass Department, you find a pair that you like, 173 00:11:26,800 --> 00:11:29,400 right, you blind yourself, 174 00:11:30,600 --> 00:11:34,400 And then hope that you can see what you look like from one pair to the next. So they 175 00:11:34,400 --> 00:11:38,500 recognized an opportunity simply by observing customers. 176 00:11:41,100 --> 00:11:45,300 Now Nordstrom in the United States is a brand that is 177 00:11:45,400 --> 00:11:49,300 associated very heavily with amazing customer service. 178 00:11:50,500 --> 00:11:54,500 They have case studies after case, studies about how great their customer 179 00:11:54,500 --> 00:11:58,700 services. Now, all of a sudden this team just setup 180 00:11:59,500 --> 00:12:03,700 In the middle of their flagship store in Seattle and started running these 181 00:12:03,700 --> 00:12:07,900 iterative experiments on customers. How do they stay on brand? How do 182 00:12:07,900 --> 00:12:10,300 they save the Nordstrom brand? Protect it. 183 00:12:17,100 --> 00:12:21,900 In reality, everything that they did in this video was 184 00:12:21,900 --> 00:12:22,600 on brand. 185 00:12:24,200 --> 00:12:28,900 First and foremost, the inclusion of customers in the design process, tell us what will make this 186 00:12:28,900 --> 00:12:32,700 better for you. Help us make your experience better. We want to 187 00:12:32,700 --> 00:12:36,800 serve you better at the philosophical level. If you look at 188 00:12:36,800 --> 00:12:38,600 the tactics that they used, 189 00:12:39,800 --> 00:12:43,900 They they, they made a sign for the team 190 00:12:44,000 --> 00:12:48,900 and the sign wasn't poorly designed and didn't have the yellow triangle with the guy 191 00:12:48,900 --> 00:12:52,900 digging in the dirt saying under construction, right? It was a beautifully designed sign that 192 00:12:52,900 --> 00:12:56,700 said Innovation and progress in a van who doesn't want to be a part of 193 00:12:56,700 --> 00:13:00,600 innovation, right? They brought out. 194 00:13:01,400 --> 00:13:05,800 They didn't bring out, you know, the old white board that sitting in the office with the markers that have been 195 00:13:05,800 --> 00:13:09,500 burned into it for 12 years, right? They brought in a glass board. 196 00:13:09,700 --> 00:13:13,800 And posted notes. They put out a series of Max, everything was 197 00:13:13,800 --> 00:13:17,800 well designed was well, thought out and was on brand as 198 00:13:17,800 --> 00:13:21,500 part of that experience. Now what are the things we talked about a little bit 199 00:13:21,500 --> 00:13:25,800 earlier was the fact that everybody was there. 200 00:13:26,500 --> 00:13:30,200 What roles did we see on the team? What roles did you see on the team? 201 00:13:32,500 --> 00:13:35,400 You had the iterative designer who was drying up 202 00:13:36,500 --> 00:13:40,700 screenshots, essentially them in paper version so people could press buttons 203 00:13:40,700 --> 00:13:43,400 and test and you had programmers. 204 00:13:45,300 --> 00:13:49,700 Yeah. You also had sales associates and 205 00:13:51,400 --> 00:13:55,200 customers. Yeah, researchers as well. 206 00:13:55,300 --> 00:13:59,500 What else was the team working on 207 00:13:59,900 --> 00:14:01,700 besides this project? 208 00:14:02,300 --> 00:14:03,100 During this week. 209 00:14:05,300 --> 00:14:09,700 That was that? Nothing of a trick question. Nothing. 210 00:14:10,200 --> 00:14:14,400 That's exactly right. So, we've got a self-sufficient team that can 211 00:14:14,400 --> 00:14:16,100 design build and test 212 00:14:17,400 --> 00:14:18,200 It's ideas. 213 00:14:19,400 --> 00:14:23,700 They're focused strictly on solving a business problem that has been 214 00:14:23,700 --> 00:14:27,500 contextually. Observed are not being pulled aside to fix some bugs over 215 00:14:27,500 --> 00:14:31,800 here, they're not being pulled on to other projects. The designer isn't shared between 216 00:14:31,800 --> 00:14:32,700 teams 217 00:14:34,200 --> 00:14:38,800 Focus strictly on solving this problem. And what else? What's the last piece of the 218 00:14:38,800 --> 00:14:42,900 puzzle there? So we've got a cross-functional team that's dedicated to this effort for 219 00:14:42,900 --> 00:14:45,100 a week solving a clear business problem. 220 00:14:47,300 --> 00:14:49,500 And what was the, what's the last component? 221 00:14:50,600 --> 00:14:54,600 That makes this team so effective and able to move so quickly and make those 222 00:14:54,600 --> 00:14:56,000 prioritization decisions. 223 00:14:58,000 --> 00:15:02,600 The feedback feedback really helps them to forms the decision but most importantly, they're 224 00:15:02,600 --> 00:15:06,600 empowered. They're empowered to make that decision. They don't have to run 225 00:15:06,800 --> 00:15:10,900 every idea up a bureaucratic chain of decision makers. 226 00:15:12,500 --> 00:15:16,400 Right. Not only, can they make any changes that they want? But they are 227 00:15:16,400 --> 00:15:20,800 allowed to make them in again. Why think about 228 00:15:20,800 --> 00:15:24,700 the Amazon statistic? Think about moving from doubt to 229 00:15:24,700 --> 00:15:28,900 certainty because the risks that they're taking or tiny, 230 00:15:30,300 --> 00:15:34,900 We're going to make a paper prototype and we're going to test it. If we get it wrong, we'll 231 00:15:34,900 --> 00:15:36,900 just tear up that paper prototype and do it again. 232 00:15:38,300 --> 00:15:42,700 We're going to put a build out there, that has one feature in a day and a half. We can see how 233 00:15:42,700 --> 00:15:46,900 that works out. If it doesn't work out, put another feature on 234 00:15:46,900 --> 00:15:48,900 there through that customer feedback. 235 00:15:51,100 --> 00:15:55,700 Loop Final question on. That's why does this team? 236 00:15:57,300 --> 00:16:01,600 Have an 80% failure Target, why do we give? Why do 237 00:16:01,600 --> 00:16:05,900 their Executives? Give this team and eighty percent Target of 238 00:16:05,900 --> 00:16:06,400 failure. 239 00:16:11,800 --> 00:16:14,300 That their mandate is to fail 80% of the time. 240 00:16:19,000 --> 00:16:23,700 Yeah well certainly to take some risks to take risks, that's exactly right. They will 241 00:16:23,700 --> 00:16:27,800 not they will never push the envelope as 242 00:16:27,800 --> 00:16:31,600 hard as if they're challenged with failing 80% of the time and it 243 00:16:31,600 --> 00:16:35,700 forces them to really push their thinking into new 244 00:16:35,700 --> 00:16:39,000 ways and new avenues to improve the brand. 245 00:16:41,200 --> 00:16:45,900 Now, again, the feedback that they were getting was qualitative, right? They're 246 00:16:45,900 --> 00:16:49,900 going back and talking to customers and getting that qualitative but they say it in the 247 00:16:49,900 --> 00:16:53,500 video. Again, they've built analytics into this 248 00:16:53,500 --> 00:16:57,700 platform so that when they leave it after a week and they leave that 249 00:16:57,700 --> 00:17:01,900 iPad in the store, they're going to get the continue to get the qualitative feedback from the sales 250 00:17:01,900 --> 00:17:05,700 staff, about how this is being used, or if it's being used. But they're also going to be able to 251 00:17:05,700 --> 00:17:09,800 see which features are being used and how long they're being 252 00:17:09,800 --> 00:17:10,400 used. Because there will be 253 00:17:10,800 --> 00:17:14,300 Quantitative data in the application as well. And that paints a 254 00:17:14,300 --> 00:17:16,000 360-degree view. 255 00:17:18,200 --> 00:17:22,400 Of the situation for them, which then informs decision making. 256 00:17:23,300 --> 00:17:27,700 And so, what you're seeing in this is the principles for lean teams. These are 257 00:17:27,700 --> 00:17:31,700 nine principles are not the only nine, but these are the principles that this team 258 00:17:31,700 --> 00:17:35,800 embodied. You're seeing design business and Engineering, everybody's on 259 00:17:35,800 --> 00:17:39,500 the same team together. Everything they're doing is 260 00:17:39,500 --> 00:17:43,700 external. It's on posted notes, it's on whiteboards, it's in sketches, 261 00:17:43,700 --> 00:17:47,500 it's in conversations, they're focused on a specific goal 262 00:17:47,500 --> 00:17:51,500 and a specific outcome. We want to improve 263 00:17:51,500 --> 00:17:53,100 the sunglass, buying 264 00:17:53,200 --> 00:17:57,700 Success. How do we measure that? That's a good conversation to have as a team but that's our goal, 265 00:17:58,100 --> 00:18:02,900 everything they're doing is repeatable and it's route, nice. So that they can push builds 266 00:18:02,900 --> 00:18:06,600 as quickly as possible, because they've got this cycle, this feedback loop 267 00:18:06,600 --> 00:18:10,900 cycle, right? The researching with customers, and they're 268 00:18:10,900 --> 00:18:14,700 using that as the best source of information to understand whether their products 269 00:18:14,800 --> 00:18:18,900 makes sense, or don't. And it helps them focus on solving the right 270 00:18:18,900 --> 00:18:19,700 problems. 271 00:18:22,900 --> 00:18:26,800 They're generating many options as a team. You saw all those 272 00:18:26,800 --> 00:18:30,900 options on that board and then they're focusing. They're deciding quickly what to 273 00:18:30,900 --> 00:18:34,800 pursue and they're making stuff and then they're figuring out 274 00:18:34,800 --> 00:18:38,400 whether it was the right stuff to make or not because their ideas are 275 00:18:38,400 --> 00:18:42,600 hypotheses hypotheses that need to get validated and they're working 276 00:18:42,600 --> 00:18:45,100 quickly through this think make check cycle. 277 00:18:47,100 --> 00:18:51,900 And these are just the methods that we just saw in that particular video and that will practice in this Workshop 278 00:18:52,400 --> 00:18:56,300 lightweight low Fidelity. Low-tech artifacts 279 00:18:56,500 --> 00:19:00,800 external conversations face-to-face collaboration with our colleagues 280 00:19:01,000 --> 00:19:05,700 and with our customers, creating lots of ideas, Divergent 281 00:19:05,700 --> 00:19:09,200 ideas, first, and then coming together converging on something 282 00:19:09,900 --> 00:19:12,800 doing that quickly and focusing on 283 00:19:13,500 --> 00:19:16,100 specific outcomes that serve as our 284 00:19:16,200 --> 00:19:17,100 Success criteria. 285 00:19:18,800 --> 00:19:22,900 And this builds nicely into era creases build measure. 286 00:19:22,900 --> 00:19:26,900 Learn Loop the lean ux cycle, fits very nicely into this Loop. So, this is 287 00:19:26,900 --> 00:19:30,600 Eric Reese has Loop and Eric again says that you have an 288 00:19:30,600 --> 00:19:33,300 idea for your startup, for your product, for your service. 289 00:19:34,400 --> 00:19:38,800 You build the smallest thing that you can then represents that idea, that's the 290 00:19:38,800 --> 00:19:41,500 first version of your product. You then measure. 291 00:19:43,000 --> 00:19:47,800 The efficacy, the performance, the success of that product against explicit success criteria, so you're 292 00:19:47,800 --> 00:19:51,800 collecting data and then you're learning from that. And then you're 293 00:19:51,800 --> 00:19:55,800 iterating again and the goal is to get through this loop as 294 00:19:55,800 --> 00:19:59,800 many times as you can as quickly as you can and the lean ux cycle 295 00:19:59,800 --> 00:20:03,400 speaks directly to that state. Your desired outcomes, that's our first 296 00:20:03,400 --> 00:20:07,900 task. What is success? What does success look like? We will know. We're 297 00:20:07,900 --> 00:20:11,400 successful when we see customers behaving in a particular way. 298 00:20:13,500 --> 00:20:17,700 Then we declare our assumptions. We assume that if we build this feature 299 00:20:18,000 --> 00:20:22,800 for this person, it will affect their behavior in a certain way. And we 300 00:20:22,800 --> 00:20:26,600 use those assumptions to write hypotheses. We write the test first. 301 00:20:27,100 --> 00:20:31,600 Essentially, this is, if you're familiar with test-driven development, this is test driven product development. 302 00:20:31,900 --> 00:20:35,800 We're writing the test first we then make an MVP, a 303 00:20:35,800 --> 00:20:37,200 minimally viable product. 304 00:20:38,400 --> 00:20:42,800 The first version of our product, we get out of the building and talk to customers. 305 00:20:43,900 --> 00:20:47,900 We collect that data. We synthesized together as a team to 306 00:20:47,900 --> 00:20:51,800 build that collaborative shared understanding and then we repeat and we go through 307 00:20:51,800 --> 00:20:55,800 this over and over and over as fast as we can. Because 308 00:20:55,800 --> 00:20:59,600 every time we get through this loop, we're moving from doubt to certainty 309 00:20:59,600 --> 00:21:03,500 and we're nudging ourselves in a more accurate direction for our product would be 310 00:21:03,500 --> 00:21:05,800 risking what we're building.