all right hey everyone welcome back 好吧，大家欢迎回来
this is people who gave me okay alright 这是给我好的人
so if as usually you can take a second 所以，如果通常你可以花一秒钟
to 至
your su ID so we know who is here um 你的身份证，所以我们知道谁在这里嗯
so today's lecture will be a 所以今天的讲座将是一个
choose-your-own-adventure 选择你自己冒险
lecture so I think you know by now 讲座所以我想你现在知道了
you've learned a lot about the technical 你已经学到很多关于技术的知识
aspects of building learning algorithms 构建学习算法的方面
and then in the third course in the 然后在第三个课程中
third set of modules you saw some of the 第三组模块你看到了一些
principles for debugging learning 调试学习的原则
algorithms and how that you use these 算法以及如何使用这些算法
tools in order to be efficient in how 工具，以便在如何有效
you build a machine learning application 你建立一个机器学习应用程序
what I want to do today is step through 今天我想要做的就是一步一步
with you a moderately complicated 和你一起中等复杂
machine learning application and 机器学习应用和
throughout all of today's lecture I'm 在今天的所有演讲中，我都是
gonna you know step you through a 你会知道如何引导你走过一条路
scenario and then ask you to kind of 场景，然后问你有点
choose your own adventure because if 选择你自己的冒险，因为如果
you're working on this project what are 你正在研究这个项目是什么
you gonna do right and so you give you 你会做得对，所以你给你
all that practice in the Nix 在尼克斯的所有练习
what are in a bit that we have on 我们所拥有的是什么
thinking through machine learning 通过机器学习思考
strategy and you know I've seen in so 战略，你知道我已经看到了
many projects there they're sometimes 他们有时会在那里开展很多项目
things that a less strategically 战略上较少的事情
sophisticated team will take a year to 成熟的团队需要一年的时间
do but if you're actually very strategic 但是，如果你真的很有战略意义
and very sophisticated in deciding what 在决定什么方面非常复杂
you will do Nix right how they drive a 尼克斯会怎样对待他们
project forward I've seen many times 项目前进我见过很多次
that what a different team will take to 这是一个不同的团队将采取什么
do maybe you could do it in a month or 也许你可以在一个月内完成它
two and you know if you are trying to I 两个你知道你是否想要我
don't know where the research paper or 不知道研究论文在哪里或
build a business or the product the the 建立一个企业或产品
the ability to drive a machine learning 驱动机器学习的能力
project quickly gives you a huge 项目很快给你一个巨大的
advantage and just you know you're 优点，只是你知道你
making much more efficient use your life 更有效地利用你的生活
as well right um so in for today I'd 对我今天也是如此
like to I'm gonna host a scenario post a 喜欢我将主持一个场景
machine learning application and say 机器学习应用并说
alright 好的
I mean you are the CEO of this project 我的意思是你是这个项目的首席执行官
what are you gonna do next so but I'd 接下来你要做什么，但我会
like to have today's meeting be quite 喜欢今天的会议是相当的
interactive as well so can I get people 互动也是如此，我可以得到人
to sit in groups of two in ideally three 理想情况下三人一组坐两人一组
or so maybe plus minus one and tried 或许可以加减1并试过
sit next to someone that you don't work 坐在你不工作的人旁边
with all the time so if it's simply 如果它只是简单的话
sitting makes your best friend I'm glad 坐着让你最好的朋友，我很高兴
your best friend is in the class with 你最好的朋友在课堂上
you but go sit with someone else because 你，但是和别人坐在一起，因为
I think I'm I've done this multiple 我想我已经完成了这个
times in the discussions that he Richard 理查德在讨论中的时间
you talk to someone that you don't know 你和一个你不认识的人说话
super well so actually take a second 超级好，所以实际上需要一秒钟
introduce yourself and just be cool 介绍自己，只是冷静
neighbor i yes 邻居我是
so the example I want to go through 所以我想要通过的例子
today is actually a continuation of the 今天实际上是延续了
example I described briefly in the last 我在最后简要介绍了一些例子
lecture I taught building a speech 讲座我教了一个演讲
recognition system right so remember 识别系统，所以记住
briefly motivated this trigger word 简要地激发了这个触发词
awake word or trigger word detection 唤醒单词或触发单词检测
system last time where you know right 系统上次你知道的权利
iiiiii have both an Amazon echo and a iiiiii既有亚马逊回声又有回声
Google home but you know is this a lot 谷歌的家，但你知道这是很多
of work to configure these things to 配置这些东西的工作
turn on and off your lightbulbs and so 打开和关闭你的灯泡等等
if you can build a chip to sell to say a 如果你可以建立一个芯片出售说
lamp maker to recognize phrases like you 灯具制造商识别像你这样的短语
know let's say we call the lamp robin 知道让我们说我们称之为知更鸟灯
then you can recognize phrases like 然后你就可以识别像这样的短语
Robert turned on right Robert turn off 罗伯特右转罗伯特关掉了
and you have a little switch to give 而你有一点开关给
this thing different names you're called 这个东西叫你不同的名字
robbers or later or elders or something 强盗或以后或长者或其他什么
as you can also linear turn on later 因为你也可以稍后线性打开
turn off and give to give your lamp a 关掉并给你的灯一个
name and just say hey Robert turn on 名字，只是说嘿罗伯特打开
right so rather than detecting different 对，而不是检测不同
names and turn on and turn off I'm just 名字然后打开并关闭我只是
gonna focus on just for the technical 专注于技术
discussion I'm just going to focus on 讨论我只是要关注
the phrase Robert turn on but this is 罗伯特打开了这个词，但这是
kind of the same problem you need to 你需要的那种问题
solve like four times to give it two 解决四次，给它两个
names or to turn on and turn off so I'm 名字或打开和关闭所以我
gonna abbreviate Robert turn on this RTO 将罗伯特缩写为RTO
right if you want to call your name 如果你想叫你的名字就对了
Robert and tell your lamp to turn on I 罗伯特告诉你的灯打开我
think I was inspired by well Isaac 我觉得艾萨克很有灵感
Asimov wrote these own robotic novel C's 阿西莫夫写了这些自己的机器人小说C'
and and all his robots names started 并且他的所有机器人名字都开始了
with our so maybe our s robot turned on 和我们一起，也许我们的机器人打开了
and so let's see so let's say that you 让我们看看，让我们说你
are the new CEO of a small start-up with 是一家小型初创公司的新CEO
you know three persons and your goal is 你认识三个人，你的目标是
the building is to build a circuit or 建筑物是建立一个电路或
actually your goal is to build a 实际上你的目标是建立一个
learning algorithm that can recognize 可以识别的学习算法
this race Robert turned on so that when 这场比赛罗伯特打开了这个时候
someone either buys this lamp and they 有人买这盏灯和他们
say Robert turned on the lamp can turn 说罗伯特打开灯可以转
on right and just focusing on the task 在右边，只关注任务
of building a linen you know to be CEO 建立一个你知道成为首席执行官的亚麻布
to start to be to do a lot of things 要开始做很多事情
where I need to figure out how to do the 我需要弄清楚如何做到这一点
embedded circuitry you figure out 你弄清楚的嵌入式电路
whether that Mika's sales general so 是否Mika的销售一般如此
there's all that stuff but for today 这就是今天所有的东西
let's just focus on the machine learning 让我们只关注机器学习
aspect of it and so my first question to 它的方面，所以我的第一个问题
you 您
it's very open-ended is but and this is 它是非常开放的但是，这是
the life of a CEO right you wake up one 一个CEO的生命就在你醒来之前
day and you just got to decide what to 那一天，你只需要决定做什么
do but so my first question to you is 但是，所以我的第一个问题是
the open-ended question is you're the 开放式的问题是你是
CEO CEO
oh you're gonna show up at work you know 哦，你会出现在你知道的工作中
tomorrow in your startup office and you 明天在你的创业办公室和你
want to build a learning algorithm to 想要建立一个学习算法
detect the phrase Robert turn on for 检测罗伯特开启的短语
this application right so um so my 这个应用程序是这样的，所以我的
question is what you're gonna do right 问题是你要做的事情
so take a take a minute to answer that 所以花点时间回答一下
by yourself first no don't don't discuss 你自己先不要不讨论
your neighbor yeah but then you're gonna 你的邻居是啊但是你会的
show up in your office and and then 出现在你的办公室然后
you're gonna start working on this 你会开始研究这个问题
engineering problem to build a neural 建立神经网络的工程问题
network to do this so and and do this as 网络这样做，并做到这一点
yourself right don't don't don't pretend 自己对不要不要不假装
that you have this hypothetical whatever 你有这个假设的东西
a start-up CEO with ten months ten 一个十个月十的初创CEO
billion dollars to spend or whatever 花费十亿美元或其他什么
just do this is let's say yeah I but I 这样做是让我说是的，但我
don't think this is a terrible startup 不要以为这是一个可怕的创业公司
idea is not the best idea but I think 我认为这个想法不是最好的主意
this could work so you're actually 这可能有用，所以你实际上
welcome to do this but let's say you 欢迎这样做，但让我们说你
decide to do this and you go into your 决定这样做，你进入你的
office tomorrow like what do you do 明天的办公室就像你做的一样
right want you to take um why should 对，想要你接受为什么要这样做
take let's say two minutes to enter an 让我们说两分钟进入
answer then we can you can discuss I 回答那么我们可以讨论我
think yeah yes one thing I really like 想是的，是的，我真的很喜欢
about answer is 关于答案是
the meat is extinguished share a pot 肉被熄灭共享一个锅
right in fact when you start a new 事实上当你开始新的时候
project and I think when you start a new 项目，我想当你开始一个新的
project like that assuming you've not 假设你没有这样的项目
worked my trigger words detection before 之前我的触发词检测
you know reading research papers or 你知道阅读研究论文或
reading code on github or reading blog 在github上阅读代码或阅读博客
posts on this problem is a very good way 关于这个问题的帖子是一个很好的方法
to quickly level up your knowledge and I 快速提升你的知识和我
think that you know it turns out that um 认为你知道结果是嗯
in terms of your exploration strategy 就你的探索策略而言
right um I want to describe to you how I 对，我想告诉你我是怎么回事
read research papers which is so this is 阅读研究论文，这是这样的
a not a good way to review the 一个不好的方式来审查
literature which is if the x-axis is 文献，如果x轴是
time and the vertical axis is research 时间和纵轴是研究
papers what some people will do is find 论文有些人会做的就是找到
the first research paper and meet that 第一篇研究论文并与之相遇
until it's done and then go and find a 直到它完成然后去找一个
second research paper and beat that 第二篇研究论文并击败了那篇
until it's done and then you can find 直到它完成然后你才能找到
the third research paper in this very 这是第三篇研究论文
sequential way of meeting research 顺序的研究方式
papers and I find it the more strategic 论文，我发现它更具战略性
way to go through these resources 通过这些资源的方式
everything ranging from blog posts lots 博客文章很多
of good medium articles that explain 好的中篇文章解释
things write research papers write 事情写研究论文写
github is if you use a parallel github是你使用并行的
exploration process where this is 这是一个探索过程
actually what it feels like when I'm 实际上当我的时候感觉如何
doing research on the way I'm trying to 正在研究我正在尝试的方式
learn about the new field I'm not that 了解新领域我不是那个
experienced right so I've she's done a 经验丰富，所以我已经完成了
lot of work on trigger word detection 关于触发词检测的大量工作
but if I hadn't worked on this before 但如果我以前没有这方面的工作
then I would probably find you know 然后我可能会发现你知道
three papers so again x-axis is time and 三篇论文再次x轴是时间和
Mercury axis is different papers and you 水星轴是不同的纸和你
know read a few papers kind of in 知道读了几篇论文
parallel at a surface level and skim 平行于表面并撇去
them and based on that you might decide 他们，并根据你可能决定
to read that one in greater detail and 更详细地阅读那个
then to add other papers that you start 然后添加你开始的其他论文
skimming and maybe find another one do 略读，也许找另一个人做
you want to read in great detail and 你想要阅读非常详细的内容
then to gradually add new papers it's 然后逐步添加新论文
you're reading this and be some to 你正在阅读这篇文章并成为一些人
completion and some not to completion 完成，有些不完成
you know I was actually chatting with um 你知道我真的和你聊天
one of my friends at Peter Bua former 我在Peter Bua的朋友之一
students 学生们
at Berkeley who mentioned that he was 在伯克利，他提到他是
wanting to learn about a new topic and 想要了解一个新主题和
he he was he told me is compiling a 他告诉我他是在编译一个
reading list of 200 research papers they 阅读200份研究论文清单
want to read that sounds like a lot you 想读这听起来很像你
rarely read 200 papers but I think if 很少读200篇论文，但我想如果
you read 10 papers you have a basic 你读了10篇你有基本论文的论文
understanding if you read 50 you're a 理解你是否读过50岁
pretty decent understanding if you read 如果你读的话，相当不错的理解
like 100 I think you're a very good 像100我觉得你很好
understanding of a few but often this is 了解一些，但往往是这样
time well spent 时间花得很好
I guess oh and some other tips again 我想哦，还有其他一些提示
this is something I'm really thinking if 这是我真正在考虑的事情
you really are CEO of this startup and 你真的是这家创业公司的首席执行官
this is what you want to do what advice 这就是你想要做什么建议
would I give you when you're reading 你在读书时会给你
papers other things to realize one is 论文其他要实现的是
that some papers don't make sense right 有些论文没有意义
and this fine you know you might be some 这很好，你知道你可能会有些
papers I just go nope I don't think that 论文我只是不行，我不这么认为
makes sense so and and it's not that 这是有道理的，而且不是那样的
uncommon for us to find papers from a 我们很难找到一篇论文
decade ago then and we learned that half 十年前那时我们学到了一半
of it was straight and the other half of 这是直的和另一半
it you know was really talking about 你知道它真的在谈论
things that were not that important 那些不那么重要的事情
right so it's okay authors 对，所以这是好作者
you know usually papers are technically 你知道通常论文是技术性的
accurate but often what they thought was 准确，但往往他们认为是
important like maybe an author thought 像作者想的那样重要
that using Vacheron was really important 使用江诗丹顿非常重要
than this problem but it just turns out 比这个问题，但事实证明
not to be the case that that happens a 不会发生这种情况
lot but that happens sometimes and I 很多，但有时会发生，我
think the other tactic that I see 想想我看到的另一种策略
Stanford students sometimes not use 斯坦福大学学生有时不会使用
enough is talking to experts including 足够与专家交谈，包括
contacting the authors so when I read 在我阅读的时候联系作者
the paper I don't I don't bother the 这篇论文我不是不打扰的
authors unless I've actually like tried 作者，除非我真的喜欢尝试
to figure it out myself 弄清楚自己
right but if you actually spend some 对，但如果你真的花了一些
time trying to understand the paper and 时间试图理解论文和
if it really doesn't make sense to you 如果它真的对你没有意义
it's okay to email the authors and see 可以给作者发电子邮件，看看
if they respond and and people are busy 如果他们回应并且人们很忙
maybe there's a 50% chance they respond 也许有50％的机会他们回应
and that's okay because it takes you 那没关系，因为它需要你
five minutes to write an email and 五分钟写一封电子邮件和
there's a 50% chance to get back to you 有50％的机会回复你
that could be time pretty well spent 这可能是时间非常好
but but don't don't don't bother people 但是不要不要打扰别人
on this you try to do your homework I 在这，你试着做我的作业
should get a lot of emails from you know 应该收到很多来自你的电子邮件
high school students that do not feel 没有感觉的高中生
like they've done their own work and 就像他们做了自己的工作一样
right and then so so just don't don't 是的，所以只是不要
don't bother people unless you've 除非你这样做，否则不要打扰别人
actually tried to do cool so after 实际上之后尝试做酷
looking at the literature and having a 看文学，有一个
base maybe downloading a open-source 基地可能下载开源
implementation or getting a sense I've 实施或了解我的意思
been averaging when I try oh and it 当我尝试哦和它时，我一直在平均
turns out the trig reward detection 结果是三元奖励检测
literature is actually one literature 文学实际上是一种文学
where there isn't consensus on this is a 对此没有达成共识的地方是
good algorithm is a bad algorithm right 好的算法是一个糟糕的算法吧
despite all the trigger word a way core 尽管所有的触发词都是核心
detection system is that you know some 检测系统是你知道的一些
of you may use already there there there 你可能已经在那里使用过了
isn't actually consensus in the research 实际上并不是研究中的共识
for me today unlike this is the best 今天对我来说不像这是最好的
ever and to try but so let's say that um 永远地尝试，但是让我们说那个嗯
you read some papers download some open 你读了一些文章下载一些开放
source of invitations and now you want 邀请来源，现在你想要
to start training your first system 开始训练你的第一个系统
right a lot of time we talked about this 很多时候我们谈到了这一点
we talked a little bit about how much 我们谈了一点关于多少
time you will spend to collect data and 你将用于收集数据的时间和
then you know we said you spend a small 然后你知道我们说你花了一小笔钱
amount of time spent like a day or maybe 像一天或者一样花费的时间
two days at most so collect your first 最多两天所以收集你的第一个
data set to start training up a model 数据集开始训练模型
but my next question to you is what data 但我的下一个问题是什么数据
would you collect right um in particular 你会收集特别的权利吗？
what train death test data would you 什么训练死亡测试数据你会
collect so you've decided on an initial 收集，所以你已经决定了一个初始
neural network architecture and you want 神经网络架构，你想要的
to train something to recognize this 培养一些东西来认识到这一点
face robert turned on i think this 面对罗伯特，我想是这个
probably i don't think it's possible to 可能我不认为这是可能的
download the data set i don't think 下载数据集我不认为
anyone has collected the data set with 任何人都收集了数据集
the worst rapper turned on and post it 最糟糕的说唱歌手打开并张贴
down the internet so you have to collect 在互联网上，所以你必须收集
your own data for this particular 你自己的数据
trigger for a so you want to use but 触发你想要使用但是
some you know sco of this sort of trying 有些人你知道这种尝试的sco
to build a new net to detect the phrase 建立一个新网来检测这个短语
robert turned on what data do you 罗伯特打开了你的数据
collect right so once you take once you 一旦你拿走一次就收集权利
again take let's say three minutes to 再说三分钟吧
write an answer to this yeah I think 写这个答案是的，我想
this is an interesting 这是一个有趣的
robber turned on over and over and then 强盗一遍又一遍地打开然后
data augmentation data augmentation is 数据增强数据增加是
one of those techniques that is a way to 其中一种技术是一种方法
reduce variance in your learning 减少学习中的差异
algorithm because you're generating more 算法，因为你生成更多
data and having worked on this problem 数据并解决了这个问题
I happen to know data augmentation works 我碰巧知道数据增强工作
you know it's very useful for this 你知道它对此非常有用
problem but if you didn't already know 问题，但如果你还不知道
that fact this is one of the things I 事实上，这是我的事情之一
would probably not do right away because 可能不会马上做，因为
I would train a quick and dirty system 我会训练一个快速而肮脏的系统
validate that you really have a high 验证你真的很高兴
variance problem before investing of the 投资前的差异问题
effort into data augmentation so they 努力进行数据扩充，以便他们
don't know as well those techniques that 不知道那些技术
so you know like it never hurts they're 所以你知道它永远不会伤害它们
all very very hurt so usually helps but 所有非常非常伤害所以通常有帮助但是
I don't bother to make that investment 我不打算投资
unless you have collected the evidence 除非你收集了证据
that you actually have a high variance 你实际上有很大的差异
problem and that this is actually a good 问题，这实际上是一个好的
use of your time 利用你的时间
yeah I think this is just one that she 是的，我认为这只是她的一个
just actually nice so require gonna 实际上很好，所以要求
start to st. Robert turn a hundred times 从圣路易斯开始罗伯特转了一百次
so doing really nice thing about that 这样做真的很棒
you can get done really quickly when I'm 我可以很快完成你的工作
working with teams I actually think in 我实际上在考虑与团队合作
terms of hours in terms of how long it 它的使用时间长短
take us to do something so this one you 带我们做一些这样的事情
could probably do in like 30 minutes 可能会在30分钟内完成
right so you get your dataset collected 正确，这样您就可以收集数据集
30 minutes ain't get going or if you run 30分钟没有开始或如果你跑
around Stanford they just ask you no 在斯坦福附近他们只是问你不
friends or strangers to speak into your 朋友或陌生人说话
laptop microphone you didn't spend a few 笔记本电脑麦克风，你没有花几个
hours together much bigger data set then 然后，小时数组合在一起
possible to start up so I priority do 可以启动所以我优先做
that I probably actually couldn't 我可能实际上不能
collect data and several hours for app 收集数据和几个小时的应用程序
didn't only spend 30 minutes but this is 不仅花了30分钟，而且这是
actually pretty interesting as well 实际上也非常有趣
because unless you get it done pretty 因为除非你完成它
quickly access right so um yeah so let 快速进入，所以，是的，所以让
me actually uh share some more concrete 我实际上呃分享一些更具体的
advice right and I think actually some 建议权利，我认为实际上是一些
point some time back to prepare a 一段时间回来准备一个
homework problem that you see later in 你后来看到的作业问题
this course Ken and Eunice and I we're 这个课程Ken和Eunice以及我们
actually you know building the system 实际上你知道建立系统
partially to create the homework right 部分地创造了正确的功课
then you see later in this course this 然后你会在本课程后面看到这个
is a good this trigger word thing is a 是一个很好的这个触发词的东西是一个
nice running example that we're using a 我们正在使用的一个很好的运行示例
few points throughout this course um so 这个课程中的几点也是如此
here's one thing you can do and this is 这是你可以做的一件事，这是
actually what what we did right which is 实际上我们做得对的是什么
a collect oh well simplifying a little 收集哦，简化一点
bit collect a hundred examples of 比特收集了一百个例子
ten-second audio clips right and so it 十秒音频剪辑正确等等
turns out once you grab a hold of 一旦你抓住了，就会结束
someone and ask them to speak into your 某人并要求他们说话
microphone you know you can keep them 麦克风，你知道你可以保留它们
for three seconds which is how long it 三秒钟，这是多久
takes to say Robert turn on or you can 需要说罗伯特打开或你可以
keep them for ten seconds which they're 保持他们十秒钟
actually very willing to spend that 实际上非常愿意花那么多
extra seven seconds 额外七秒钟
you right but so if this is ten seconds 你是对的，但如果这是十秒钟的话
of audio data you know so this is ten 您知道的音频数据，所以这是十
seconds of audio and and audio is just 音频和音频的秒数只是
patterns of little changes in air 空气中微小变化的模式
pressure right so if you plot audio the 压力正确所以如果你绘制音频
reason looks like this waveform it's 原因看起来像这个波形
just the way you're hearing my voice 只是你听到我的声音的方式
this yo my voice or the speakers are 这是你的声音或扬声器
creating very rapid changes in the air 在空中创造非常迅速的变化
pressure and your ear measures those 压力和你的耳朵测量那些
very rapid changes in the air pressure 气压变化非常迅速
interprets in sound and so a microphone 用声音解释麦克风
is a sensitive device for recording 是一种敏感的录音设备
these very very high frequency changes 这些极高的频率变化
in the air pressure and this plots that 在空气压力和这个情节
you see an audio is just what is the air 你看到音频就是空气
pressure at different moments in time 不同时刻的压力
right but so given a 10 second clip like 是的，但是给了10秒的剪辑
this if this is the 3 second section 如果这是3秒部分
where they said Robert turned on then 那时他们说罗伯特打开了
what you would like to do is to build a 你想做的是建立一个
nest Lam say they can sit here and the 巢林说他们可以坐在这里了
lamp is turned off turn it off turn it 灯熄灭关闭它转动它
off turn off turn off turn off and at 关闭关闭关闭和关闭
the moment they finished saying Robert 他们说完罗伯特的那一刻
turn on you know you turn it on so this 打开你知道你打开它所以这个
is a open table Y really right and then 是一个开放的表Y真的是对的
and then it's not detecting afraid right 然后它没有发现害怕的权利
so so what you want to do for the trick 那么你想要做什么的伎俩
word system is at you know pretty much 字系统几乎是你所知道的
the moment they finish saying Robert 他们说完罗伯特的那一刻
turn on you want your learning algorithm 打开你想要你的学习算法
to output a 1 that's your target label 输出1是你的目标标签
why I saying yep I just heard this 为什么我说是的，我刚听到这个
trigger word and for all other times you 触发单词，所有其他时间你
want it to output 0 right because cuz 希望它输出0对，因为cuz
and then the 1 is when you decide to 然后1是你决定的时候
turn on the lamp at that moment in time 在那个时刻打开灯
right so to collect the data set here's 这是为了收集这里的数据集
something you can do which is collect 你可以做的事情就是收集
100 audio clips of 10 seconds each and 100个音频剪辑，每个10秒
you know when I'm prioritizing my work 你知道我什么时候优先考虑我的工作
home my teams work I would really you 回家我的团队工作我真的很想你
know look at these numbers and think 知道看看这些数字并思考
okay let's say let's say you actually if 好吧，让我们说你实际上是
you are doing it let's say you are 你这样做让我们说你是
running around Stan's 在斯坦的周围跑来跑去
and you want to collect a hundred audio 你想收集一百个音频
clips maybe 10 people 10 clips per 剪辑可能每人10个10个剪辑
person or maybe a hundred different 一个人或者一百个不同的人
people 人
I would actually estimate you know if 我实际上估计你知道是否
you go to Stanford cafeteria how long 你去斯坦福自助餐厅待了多久
does it take to get one person right and 是否需要让一个人做对
you can pray get one person every minute 你可以祈祷每分钟得到一个人
or two if you go to a busy place them on 如果你去一个繁忙的地方他们或两个
like a Stanford cafeteria so you can 就像斯坦福自助餐厅一样，你可以
pray to get this done in like a 100 to 祈祷这样做就像100到100
200 minutes late or three hours right 晚了200分钟或者右边三个小时
it's not that bad so you get this done 它并没有那么糟糕，所以你完成了这件事
quite quickly and so and lets you 很快，所以，让你
collect 100 audio clips and actually for 收集100个音频剪辑，实际上是
them for the purposes of today let's say 为了今天的目的，我们可以说
you collect hundred or do clips to use 你收集数百或做剪辑使用
for training 25 for your dev set and 为你的开发和训练25训练
zero for the test set right it's 对于测试集合为零
actually not that uncommon if you're 如果你是的话，实际上并不罕见
building a new product they just not 建立一个他们不是的新产品
have a test set because you go is to 有一个测试集因为你去了
build something that you're convinced is 建立你所信服的东西
you know just early prototyping phases 你知道早期的原型设计阶段
of the project sometimes I don't bother 该项目有时我不打扰
with my test set if you if it goes the 我的测试设置，如果你去了
function paper then of course you need a 功能纸当然你需要一个
rigorously corrected test that but if 严格纠正测试，但如果
you're just building a product and you 你只是在构建一个产品而你
don't need a rigorous evaluation 不需要严格的评估
sometimes you can just get started 有时你可以开始
without doing with a test set right 没有正确的测试设置
those pretty little get started um and 那些很少开始嗯和
then 然后
[Applause] [掌声]
all right so taking that audio clip from 好的，所以从中获取音频剪辑
above one thing you can do to turn this 以上一件事你可以做到这一点
into supervised learning problem is to 进入有监督的学习问题是
take so you know the phrase robber 所以你知道强盗这个词
turn-on can be said in less than three 开机可以说不到三个
seconds so let's say you take three 秒，所以让我们说你拿三个
seconds as the duration of audio right 音频的持续时间为秒
so what you can do is a clip out so 所以你能做的就是把它剪掉
let's say here was when Robbie turn on 让我们说这是罗比打开的时候
my set so what you can do is the type of 我的设置所以你能做的就是它的类型
what you can do is then clip out 你可以做的就是剪掉
different audio clips of three seconds 三秒钟的不同音频片段
so here's one audio clip you can take 所以这里有一个你可以拍的音频片段
that audio clip this is X and the target 那个音频片段是X和目标
label is zero because Robert turn-on was 标签是零，因为罗伯特开启了
not set and you can take I know this 没有设置，你可以把我知道
audio clip a different random nature 音频剪辑具有不同的随机性
clipped with three second clip and that 夹着三个第二个夹子
clip also as the toggle a buzz rope and 剪辑也作为切换一个嗡嗡的绳子和
you know for this one right which is a 你知道这个权利是一个
three second clip there come that that 三个第二个片段那就是那个
that ends at the reel on the last part 结束于最后一部分的卷轴
of the on sound you would have a target 你会有一个目标的声音
label of one right so and when you learn 一个权利的标签，所以当你学习
about sequence models there are and ends 关于序列模型的存在和结束
you learn a better method than this 你学到了比这更好的方法
explicit clipping but for now let's say 明确裁剪但现在让我们说
you take these on audio clips and turn 你把它们放在音频剪辑上并转动
it into please so take a ten second clip 它取悦了所以采取十秒钟的剪辑
and by clipping around different windows 并通过剪切不同的窗口
you can take your let's say 100 clips 你可以说你的100个剪辑
and because for each 10 second clip you 因为你每10秒钟剪辑一次
can take different windows you could 可以采取不同的窗口
turn this into let's say 3000 把它变成让我们说3000
training examples right so here I took a 训练的例子，所以在这里我拿了一个
10-second clip and - and show you know 10秒的剪辑和 - 并告诉你你知道
totally three different three-second 三个不同的三秒
windows but if you take thirty three 窗户，但如果你采取三十三
second windows then each 10-second audio 第二个窗口然后每个10秒音频
clip becomes thirty examples and now 剪辑成为三十个例子，现在
you've turned the problem into a binary 你已经把问题变成了二进制文件
classification problem where you need to 你需要的分类问题
train a neural network that inputs a 训练一个输入a的神经网络
three second clip and they build it as 三秒钟剪辑，他们建立它
either 0 1 right those mean this and so 要么是0 1那么这意味着这样
this is an example of the the more 这是一个例子
complex pipelines you might have if 如果你可能有复杂的管道
you're building a learning algorithm to 你正在建立一个学习算法
take a continuous you know audio 连续你知道音频
detection problem to turn into the 检测问题变成了
binary classification problem which 二进制分类问题
you've learned how to build barriers 你已经学会了如何建立障碍
near networks for right and again we 靠近网络我们一次又一次
learn about our own ends you learn about 了解我们了解自己的目标
other ways to process sequence data or 其他处理序列数据的方法或
temporal data okay so um go ahead oh is 时间数据没关系，所以你要继续哦
this manual even yes I I would yeah 本手册即使是，我会是的
actually if you have a hundred examples 实际上，如果你有一百个例子
it's not that hard to just listen to it 只是倾听它并不难
you know on your laptop with some audio 你知道你的笔记本电脑上有一些音频
playing software to figure out when when 玩软件搞清楚什么时候
they finish saying or Robert turn on and 他们说完了或罗伯特打开了
then at that moment to put a 1 in the 然后在那一刻把1加入
target label because this is really when 目标标签，因为这是真的
you want the lamb to turn on right so 你希望羊羔能够正确地打开
any other questions actually few fideos 任何其他问题实际上很少有视频
clarifying questions yeah go ahead 澄清问题是的，继续
oh I wonder if this is gonna cost a 哦，我想知道这是否会花费一个
problem that ones are tools bars 那些是工具栏的问题
oh sure let me get back to that and 哦，当然让我回到那个
things 事
if there are specific reason we only 如果有特殊原因我们只
train them with three seconds 用三秒钟训练他们
I see yeah why do we do three seconds 我明白为什么我们要做三秒钟
there for five seconds there's a yeah 有五秒钟就有了
because there's another hyper prompt you 因为你有另一个超级提示
can test so I can go oh no oh yeah you 可以测试所以我可以去哦不哦是的你
have to stand really slowly to take 必须站得很慢
three seconds is this right reabsorb it 这是对的三秒钟重新吸收它
turn on right so okay this is a design 右转，好吧这是一个设计
choice yeah um alright so so um let's 选择是的，好吧，所以，嗯，让我们
say you do this feed it to supervised 说你这样做是为了监督
learning algorithm train a neural 学习算法训练神经
network um and let's say that when you 网络嗯，让我们说，当你
classify this when you run this 运行此时将其分类
algorithm you end up with 99.5% accuracy 算法最终得到99.5％的准确率
right but you find that the algorithm 对，但你发现了算法
has zero detection right and you know 没有检测权，你知道
and what I mean is that whether audio 而我的意思是，是否音频
you give it it just outputs zero all the 你给它它只是输出零所有
time so the algorithm just says nope I 时间所以算法只是说不，我
never heard the phrase Rob I turn on you 从来没有听过Rob我转向你的短语
know so so so so and so my question to 知道如此那么如此我的问题
you is you know and by the way the 你知道吗，顺便说一句
reason I'm going through these scenarios 我之所以经历这些场景
is um I found that a good way to gain 是啊，我发现这是一个很好的获得方式
good intuitions and and to become good 良好的直觉，并成为好人
at making these decisions is these are 做出这些决定的是这些
the decisions that project leader right 项目负责人的决定权
a tech leader our CEO needs to make 我们的首席执行官需要做的技术领导者
these are actually like pretty much 这些实际上就像是非常相似
exactly the decisions you need to make 确切地说你需要做出的决定
and I find that um one of the ways to 而且我发现这是其中一种方法
gain this type of experience if you you 如果你有这种经验
know find a job with a good AI team and 知道找到一个有良好人工智能团队的工作
work with them for five years 与他们合作五年
right and then you said you lived 对，然后你说你住了
through this and you see what they do 通过这个，你看到他们做了什么
but instead of needing you to go and 而不是需要你去
spend five years to see ten examples of 花五年时间看十个例子
this I'm trying to step you through 我试图引导你完成
maybe one example in 可能是一个例子
in one hour or so so instead of yo 在一个小时左右而不是哟
gaining this experience to work 获得这种工作经验
experience which is great but takes many 经验很棒，但需要很多
many he has how many many months hoping 许多他有多少个希望
to you know let's just put you in the 你知道让我们把你放进去
position of making these decisions you 做出这些决定的立场
can learn from that much faster right 可以从更快的权利中学习
but so and all the examples I'm giving 但是这样以及我给出的所有例子
or actually completely realistic right 或者实际上是完全现实的
there you either exactly or very similar 你要么完全相同，要么非常相似
to things I have seen in actual you know 我知道你实际看到的事情
very real project so question is uh your 非常真实的项目所以问题是你的
learning algorithm gives sisters out 95% 姐妹学习算法95％
ac0 dissections what do you do let me ac0解剖你做了什么让我
mention some of some dances are really 提到一些舞蹈真的
light I think that you know I when I 光我认为你知道我什么时候
think of building learning algorithms 考虑构建学习算法
the process is often specify a deaf set 该过程通常指定一个聋人集
and all test set that measure what you 以及衡量你的所有测试集
care about and then you don't always 关心，然后你并不总是
have to do it but it's good hygiene and 必须这样做，但它是良好的卫生和
it just is it is a shoppings clarity of 它只是一个购物清晰度
your thinking right if you have a very 如果你有一个非常好的想法你的想法
clear specification a problem and I 清楚说明问题和我
think when inside all of this is that if 想想当里面所有这一切都是如果
your death set is really out of whack 你的死亡集合真的没有了
right because it's so unbalanced that 是的，因为它是如此不平衡
accuracy your deficit doesn't translate 准确性你的赤字不会转化
to what you actually care about because 到了你真正关心的是因为
you know presumably this is 99.5 percent 你知道这可能是99.5％
accurate on the deficit as well but this 准确的赤字也是如此
performance is terrible so it's doing 表现很糟糕所以它正在做
great on the death set on your accuracy 伟大的死亡设定你的准确性
nice shake we're giving terrible 很好的摇晃，我们给了可怕的
performance so I think of it as good 表现让我觉得它很好
hygiene you know this is kind of good 卫生你知道这有点好
sound practice to just specify make sure 声音练习，只需指定确保
you at least have a Jeff said an 你至少有一个杰夫说过
evaluation metric that corresponds more 评估指标更符合
closely to what you care about 密切关注你所关心的事情
so making the deaf set more balanced 这样可以使聋哑人更加平衡
equal numbers of positive and negative 正数和负数相等
which would be a good step toward that 这将是一个很好的一步
and then I think what you could also 然后我想你也可以
there are a few people that talked about 有几个人谈到过
give the higher weights to the positive 给予积极的更高权重
examples right so you know one way to do 例子正确，所以你知道一种方法
this is the resample your training and 这是你的训练和重新取样
your Jeff says to make them more 杰夫说要让他们更多
proportionate in terms of maybe closer 比例可能更接近
to balanced racial positive negative 平衡的种族积极消极
examples that'd be okay the other way to 反之亦然的例子
not do Reiss 不做Reiss
we just give the positive examples it 我们只是给出积极的例子吧
great to wait right 很高兴等待
I would probably sample another thing 我可能会尝试另一件事
you could do you know India in the 你能告诉印度吗？
interests of speed even if it's not the 速度的利益，即使它不是
Matt Matthew most good most sound thing 马特马修最好听的东西
to do is to change the target labels to 要做的是将目标标签更改为
be a bunch of ones after that and this 在此之后成为一堆人
is a hack this is not formally rigorous 这是一个黑客，这不是正式严谨
but if you've implemented the rest of 但如果你已经实现了其余部分
this code already this might be a 这段代码已经可以了
reasonable you know a little bit hacky 合理你知道有点hacky
thing to do but this is just this is 要做的事情，但这就是这个
this might work well enough right I 这对我来说可能运作得很好
would I might not I don't know if I 我可能不会不知道我是不是
would want to try to you know write an 我想尝试你知道写一个
academic research paper with this method 学术研究论文用这种方法
maybe and get away with it but this 也许并且侥幸逃脱但是这个
little thing that I think if you try to 如果你尝试的话，我认为这件小事
publish your paper with this academic 与这位学者一起发表论文
review is my raising eyebrows and say 评论是我的眉毛，并说
maybe now maybe it is okay but I think 也许现在也许没关系，但我想
if you're one something quick and dirty 如果你是一个快速和肮脏的东西
that just works I think leaving the ones 只是工作我认为离开那些
changing back to labels to be one so 改回标签就是这样
that say a clip here right oh that and 在这里说一个剪辑哦，那个和
it's just a little bit off their proper 它只是一点点他们的正确
turn on the still label one that'd be 打开那个仍然是标签的标签
pretty reasonable it doesn't be saying 非常合理，它不会说
that for anywhere within maybe a 0.5 对于任何可能0.5的任何地方
second period after Robert turn on 罗伯特开启后的第二个时期
finish it's okay to turn on the light 完成它可以打开灯
any time within that period then you 在那段时间内的任何时间，那么你
kind of want to be turning on the light 有点想打开灯
turning on the lamp you know say within 打开你知道的内灯
half a second right after Robert turn on 罗伯特打开后半秒钟
this has been said anyway and this would 无论如何，这已经说过了
be a not this would be a way to just get 不是这将是一种获得的方式
more labels of ones in there right how 更多的标签在那里如何
does that translate to like when you 这会转化为喜欢你的时候吗？
deploy this you're not gonna see Robert 部署这个你不会看到罗伯特
turn on as much right like one out of 像一个人一样向右转
1,000 might be reflective of what you 1,000可能反映了你的意义
expect to see 期待看到
yeah yeah right so I think that uh 是的，是的，我认为呃
by the button so if you actually yes so 通过按钮，所以如果你真的是这样的话
well I this is of a deaf set and 好吧，我这是一个聋人和
evaluation actually kind of question 评估其实有点问题
right so one of the couple of the 对，所以其中一对
metrics that people often use when 人们经常使用的指标
actually working on this is when someone 实际上在做这件事就是有人
says Robert turned on what does the 罗伯特说道
chance that she wakes up or the lamp 她醒来或灯泡的机会
turns on and then the second is if no 打开然后第二个如果没有
one is saying anything to the lamp you 一个人对你的灯说什么
know how often does it randomly turn on 知道随机打开的频率
by yourself without you having said 没有你说过你自己
anything so those are the two metrics 这些都是两个指标
people actually use and and sometimes 人们实际使用，有时候
you could also try the combined in a 你也可以试试一下
single number evaluation metric or 单号评估指标或
something but I think that you could 但是我想你可以
tend to find the data set to measure 倾向于找到要测量的数据集
both of these things and then and then 这些事情都是偶然的
hopefully find a way to combine them 希望找到一种方法来组合它们
into single real number which I think 我认为是单个实数
yeah and I think one of the ways you 是的，我认为你的方式之一
talked about in the in the videos as 在视频中谈到了
well great so make sense yeah but I 很好，所以有道理但是我
think I think the question is really Oh 我觉得我觉得这个问题真的很好哦
what is it this satisfies a user need 什么是满足用户需求
right and Owen just want one thing about 对，欧文只想要一件事
dumb the straightforward way of 愚蠢的直截了当的方式
rebalancing is that if you don't do this 重新平衡就是如果你不这样做
then your whole dataset just as very few 然后你的整个数据集就像很少
positive examples right and so if you 正面的例子，所以如果你
throw away all the negative examples so 抛弃所有的负面例子
that you cut down the number of negative 你减少了负数
examples until you have exactly equal 例子，直到你完全相同
numbers of positive and negatives you've 你有多少正面和负面的
actually thrown away a lot of negative 实际上扔了很多负面的
examples this make sense and so one one 这个例子很有意义，所以一个人
one problem with the straightforward way 直截了当的一个问题
of rebalancing is that you know in your 重新平衡就是你知道的
audio clip and your test ten-second clip 音频剪辑和你的测试十秒剪辑
they were collected by running around 他们是通过跑来跑去收集的
Stanford um you have one example of 斯坦福，你有一个例子
Robert turn on and so if you want 如果你愿意，罗伯特可以开启
exactly perfectly balanced positive 完全平衡的正面
negative it means that you're allowed to 否定意味着你被允许
only clip on one negative example all of 只剪辑一个负面的例子
this so you can say that's negative and 这样你就可以说这是消极的
that's a positive 这是积极的
and you can't clip out more negative 你不能削减更多的负面
examples from this right so so so if you 这个例子就是如此，如果你这样的话
use a if you insist on the perfectly 如果你坚持完美，就用一个
balanced you're actually stirring away a 平衡你实际上是在搅拌
lot of negative examples that that could 这可能是很多负面的例子
be helpful for the learning all right 对学习很有帮助
so alright so you know a lot of the 好吧，所以你知道很多
workflow of building learning algorithms 构建学习算法的工作流程
is building learning algorithms feels 正在构建学习算法的感受
more like debugging right because what 更像是调试正确，因为什么
happens in a typical machine learning 发生在典型的机器学习中
workflow is you implement something and 工作流程是你实现的东西和
it doesn't work so you figure out what 它不起作用所以你弄清楚是什么
is the problem so you fix that like 是问题，所以你解决这个问题
rebalancing re-weighting we're adding 我们正在重新加权重新平衡
more ones and so that fixes the current 更多的，所以，以修复当前
problem and then after fixing the 问题然后修复后
current problem which which is the one 当前的问题是哪一个
we just solved say you then come across 我们刚解决说你然后碰到了
a new problem and you have to solve that 一个新问题，你必须解决这个问题
and you fix that problem you cook 你解决了你做的问题
somewhere else another new problem so I 在其他地方另一个新问题所以我
find it the workflow of when I'm working 找到我工作时的工作流程
a machine learning project it often 经常是机器学习项目
feels more like software debugging than 感觉更像是软件调试而不是
software development right because 软件开发权因为
you're often trying to figure out what 你经常试图找出什么
doesn't work and then trying to fix that 不起作用，然后试图解决这个问题
and after you fix that problem then 然后你解决了这个问题
another bug surfaces and you squash that 另一个虫子浮出水面，然后你压扁它
and you do that and another and you kind 你这样做，而另一个你善良
of keep doing that until the algorithm 在算法之前一直这样做
work so if I keep talking about you know 工作，所以如果我一直在谈论你知道
your algorithm doesn't work what do you 你的算法不起作用
do Nick right that's kind of theme of 尼克是对的那种主题
today's presentation but that that is 今天的演讲，但就是这样
what the workflow that is what your 什么工作流程是你的
day-to-day work of developing a learning 开展学习的日常工作
algorithm is usually like because I it 算法通常就像我一样
doesn't work you fix it it still doesn't 不起作用你修复它仍然没有
work as you fix that you still doesn't 按你的方式工作，你仍然没有
worry you fix it and you do that enough 担心你修复它并且你做得那么多
times until it works right that is 时间直到它正常工作
actually what often working on the 实际上经常工作的是什么
learning I don't work look looks like oh 学习我不工作看起来像哦
all right 行
so let's say you fix that problem and 所以，让我们说你解决了这个问题
you conclude through doing error 你通过做错误得出结论
analysis then your algorithm is 分析然后你的算法是
overfitting all right so you know you've 过度拟合，所以你知道你
added a lot more ones so the data set is 添加了更多，所以数据集是
a little bit more balanced so let's just 更平衡一点，让我们做到
add a bunch of ones like I did on that 添加一堆像我那样的人
previous board where it was just out of 以前的董事会刚刚离开
all the ones here so the data set isn't 这里所有的所以数据集不是
as unbalanced and 不平衡和
let's see let's say that's sorry two 让我们看看，对不起两个
pages of notes here okay good 这里的笔记页面还不错
so let's say that um you find out that 所以，让我们说你发现了那个
the cheese now and I mean assign 奶酪现在，我的意思是分配
accuracy on training and fifty percent 培训准确率和百分之五十
accuracy on the dev set right so very 对设备的准确性如此正确
large gap between your training and your 你的训练与你的训练之间存在很大差
deaf set performance and so clear a sign 聋人设定表现，所以清楚的迹象
of overfitting and so I think one their 过度拟合，所以我认为他们的
earlier question someone talked about 有人谈过的早期问题
data augmentation and so when you have 你有数据增加等等
this clear sign of overfitting this is a 这个过度拟合的明显迹象是
good time to consider data augmentation 考虑数据增加的好时机
and then and so let's say you go ahead 然后让我们说你继续吧
and do JSOC mentation so for audio this 为了音频这个做了JSOC的思考
is how you could do data augmentation 你是如何做数据增加的
which is um collect a bunch of 这是收集一堆
background audio you know so I guess if 您知道的背景音频，我想如果
you're trying to build a lamp that might 你正试图建造一盏灯
go into people's homes then you could go 进入人们的家，然后你可以去
into your friends homes and you know 进入你的朋友家，你知道
with their permission record right what 他们的许可记录正确
the background sound in their home looks 他们家看起来的背景声
like you know maybe uh people talk in 就像你知道的那样，也许有人会说话
the background maybe the TV on the 背景可能是电视上的
background 背景
well whatever goes on people's homes and 以及人们家里的一切
then it turns out that if you take a say 然后事实证明，如果你发表意见
a one-second clip I've Robin turn on of 我罗宾打开的一秒钟剪辑
RTO and you add that to a background RTO并将其添加到后台
clip then you can synthesize an audio 剪辑然后你可以合成一个音频
clip of what it sounds like and your 听起来像是你的照片
friend's house if someone were to 朋友的家，如果有人去
suddenly pop up and say Robert turn on 突然弹出并说罗伯特打开
against the background sound of your 对你的背景声音
friend's house right and 朋友的房子对
and it turns out that if you want to 事实证明，如果你想
make the system robust so actually for 使系统健壮，所以实际上
example I have a oh no I actually know 例如我有一个哦，不，我真的知道
someone that lives unfortunately closely 不幸生活的人
to a train station and so their house 到火车站等他们的房子
that she has a lot of train station 她有很多火车站
noise from the Caltrain and so what you 来自Caltrain的噪音，所以你呢
can do to make your system more robust 可以做到让您的系统更健壮
is also take you know a clip of say 也带你知道一句话
train noise right like cow train noise 像火车噪音一样训练噪音
and if you take that noise and take a in 如果你接受了那个噪音并接受了
this case let's say one second one 这个例子让我们说一秒钟
second or three second clip of someone 某人的第二或第三个剪辑
saying robber turn on and you synthesize 说强盗打开你合成
that on top of the train in the 在火车上面
background then what you end up with is 然后你最终得到的是背景
a ten second clip of someone saying 有人说的十秒钟剪辑
robber turned on against the noisy you 强盗打开你的吵闹声
know train in the background type of 知道火车的背景类型
pepper noise right and so in order to do 辣椒噪音是正确的，所以为了做
data augmentation or data synthesis you 数据增强或数据合成你
can take some one second clip so people 所以人们可以花一些时间
say robber turn on in the quiet 说劫匪在安静中打开
background and then take some one second 背景，然后花一秒钟
clip but people saying random words 剪辑，但人们说随机的话
right let's say you know caught it all 是的，让我们说你知道抓住了这一切
all right it's a static and synthesized 好吧，这是一个静态和合成
this against the train noise background 这对火车噪音背景
and then you would have in this case you 然后你会在这种情况下拥有你
would have what sounds like rain noise 会有听起来像雨声的声音
train noise train on street noise 在街道噪音上训练噪音火车
Robert turn on Trina Jana's or the 罗伯特打开了Trina Jana或者
called in I was in a row right and then 我称之为正确然后
you could generate the labels now as 你现在可以生成标签
girls there once there and then zeros 那里的女孩曾经然后有零
there because if this is what he sounded 因为如果这是他的声音
like you know and I uses home then you 就像你知道的那样，我使用的是你
want the lamp to turn on after Robert 想要在罗伯特之后打开灯
turn on but now after these random words 在这些随机词之后，现在开启
you can take different random words 你可以采取不同的随机词
great um so let's see right so 太棒了，让我们这样看
what I'd like you to do is evaluate 我希望你做的就是评估
three different possible ways to collect 三种不同的收集方式
noisy data right two to collect this 吵闹的数据两个收集这个
type of background data right and so 背景数据的类型是正确的
what I'd like you to do for the next 我希望你为下一个做什么
question is let's say you and your team 问题是让你和你的团队说
you know have brainstormed brainstormed 你知道头脑风暴头脑风暴
a few different ways to collect this 收集这个的几种不同方法
type of background noise data and let's 背景噪音数据的类型和让我们
say you've decided that you would like 说你已经决定了
to collect ten hours of background noise 收集十个小时的背景噪音
data right okay so I'm gonna present to 数据没错，所以我要去参加
you three options one is um you know run 你有三个选择，你知道吗
around Stanford and replace microphones 在斯坦福附近并更换麦克风
around Stanford or your friends homes do 在斯坦福附近或你的朋友家做
this with consent and don't don't you 这是经过同意而不是你
know California you're not supposed to 知道加利福尼亚你不应该这样做
don't record people about their 不要记录有关他们的人
knowledge and consent right Oh 知识和同意权哦
second is uh downloads clips online it 第二个是呃在网上下载剪辑吧
turns out you can go to youtube there 结果你可以去那里的youtube
are these like ten hour long clips of 这些像是十个小时的片段
you know rain noise or cars driving 你知道雨声或汽车驾驶
around so you actually can if you do 如果你这样做，你实际上可以
that find something that's creative 找到有创意的东西
common sense of appropriately license 适当许可的常识
right um another thing you could do is 对，你能做的另一件事是
use a mechanical turk Amazon Mechanical 使用机械土耳其亚马逊机械
Turk we can have people all around the 土耳其人我们可以拥有各地的人
world be paid you know modest amounts of 你知道适度的世界
money to submit audio clips right so for 钱提交音频剪辑是这样的
the next exercise what I want you to do 我希望你做的下一个练习
because I want you that this exercise 因为我想要你这个练习
of this discipline which is what I want 这个学科是我想要的
you to do is um I went to the estimate 你要做的就是我去估计
let's see what time is it 让我们看看现在几点了
no okay it's 12:30 p.m. right now what I 不行，现在是12:30 pm，我
want you to do is write down three 你要做的就是写下三个
numbers in the next exercise to estimate 数字在下一个练习中估算
if you were to do this you know let's 如果你这样做，你就知道了
say you were to go do this right now 说你现在就去做
right by what time will you have 你什么时候有
finished it we went to do option one 完了它我们去做选项一
what time would you finish you were to 你什么时候完成你的
do option two what time would you finish 选项二你什么时候完成
you were to do option three if you go is 如果你去的话，你会选择三
to collect ten hours of data through one 通过一个收集十个小时的数据
of these mechanisms that make sense so 这些机制是有道理的
it's 12:30 p.m. now so what I'd like you 现在是下午12:30，所以我想要你
to do is just write down three numbers 要做的就是写下三个数字
first number is what time is it what 第一个数字是什么时候是什么
time would be by the time you collected 时间将是你收集的时间
ten hours of data you know from around 你知道的十个小时的数据
Stanford what time would be right and if 斯坦福什么时候是正确的，如果
you could do this in some so if you 你可以在某些方面这样做，如果你
think you'd do it by tonight then right 我想你今晚要做到这一点然后才行
9:00 p.m. if you think I'll do if you 如果你认为我会这样做，那么晚上9点
think it'll take you one week then write 认为这需要你一个星期然后写
the date one week from now right 从现在起一周后的日期
whatever it is but just write down three 不管它是什么，但只写下三个
numbers to these three activities okay 这三项活动的数字还可以
let's do this one relatively quickly can 让我们相对快速地做到这一点
people do this in like a maybe a minute 人们这样做可能只需要一分钟
and a half 和一半
all right cool this is interesting 好吧，这很有趣
yeah what the people actually 是的，人们实际上是什么
surprisingly large variability I 令人惊讶的大变异我
mentioned one thing that surprised me 提到一件令我惊讶的事情
I'll give you my own assessment I think 我想我会给你自己的评估
that you know what I'm leading startup 你知道我在领导创业公司
teams we tend to be very scrappy right 团队我们往往非常斗志
and so I think that if it goes to 所以我想如果它去了
collect $10 of data if you have three 如果您有三个数据，则收集10美元的数据
friends with laptop you can collect 有笔记本电脑的朋友可以收集
three hours of data per hour because you 因为你每小时三小时的数据
have three recordings going in parallel 有三个录音并行
so if I were doing this with say two 所以，如果我这样说两个
other friends you know I bet I bet we 你认识的其他朋友我打赌我打赌我们
could get this done by tonight great 可以通过今晚很好的完成
because if you need nine hours of data 因为如果你需要九个小时的数据
that's each person needs to collect 这是每个人需要收集的
three hours of data and you run around 三个小时的数据，你跑来跑去
stand for the cue 2 microphones running 代表提示2麦克风运行
I bet I bet I could get this done by 我打赌我敢打赌，我可以完成这件事
6:00 p.m. right maybe maybe even earlier 下午6点，也许甚至可能更早
I don't know 我不知道
download clips online there's actually 实际上，在线下载剪辑
no it's such an interesting one maybe a 不，这可能是一个有趣的
bit about the same time it turns out one 结果大约是同一时间
tricky thing about downloading clips 关于下载剪辑的棘手问题
online is that I think a lot of the you 网上是我认为很多你
know there are people that have trouble 知道有人有麻烦
sleeping at night so they listen to 晚上睡觉所以他们听
highway noise or whatever and so there 高速公路噪音或其他等等
are these you know 20 hours of highway 这些你知道20小时的高速公路
Clips highway noise on YouTube that you 在YouTube上剪辑你的高速公路噪音
can find but I I don't know how those 可以找到，但我不知道那些
clips were generated and I suspect a lot 剪辑生成，我怀疑很多
of them loop right meaning is the same 他们循环正确的意思是一样的
one hour play over and over so I 一个小时一遍又一遍地玩，所以我
actually think is harder than then one 实际上认为比那更难
might guess to get 10 hours of 可能会猜到要10个小时
non-repetitive data and there's one of 非重复数据，其中之一
those things you know if I take an hour 如果我花一个小时，你知道的那些事情
of how highway sound and loop it you 高速公路的声音和循环你
can't tell the difference because all 不能分辨因为所有
highway sounds sounds the same I just 高速公路的声音听起来和我一样
can't tell one would have highway sound 不能说一个人会有高速公路的声音
from another one but if you have one 从另一个，但如果你有一个
hour of highway sound looped ten times 高速公路声音小时循环十次
the learning algorithm where she 她在哪里学习算法
performed much less well then if you 如果你表现得不那么好
have ten hours of fresh highway sound so 有十个小时的新鲜公路声音
this I would have a harder time doing I 这对我来说会更难
think I probably I would proud if I were 我想我可能会感到自豪
doing this I because of these problems I 这样做我是因为这些问题而我
work very budget until sometime tomorrow 工作非常预算，直到明天某个时候
right maybe maybe 9:00 p.m. or something 也许可能是晚上9点或者什么的
maybe that's doable 也许那是可行的
I'm not sure um the one surprise to me 我不确定这对我来说是一个惊喜
was some people thought they could do 有些人认为他们可以做到
this by tonight 这是今晚
I again I've used Amazon Mechanical Turk 我再次使用亚马逊机械土耳其人
is actually a huge process to set up and 实际上是一个庞大的设置过程
some accounts are get people on board 一些帐户让人们参与进来
and especially to get them microphone I 特别是让他们拿麦克风我
don't know if you implant something on 不知道你是否植入了什么东西
flash they can speak to their web 他们可以通过他们的网络说话
browser all and then factually 浏览器所有然后事实
supportive is actually so it's actually 支持实际上是这样的
not that easy to get a lot of Turkish to 不是那么容易得到很多土耳其人
do this and the global supply of it's 做到这一点以及它的全球供应
also unlimited so I would if I were 也是无限的，所以如果我是的话我会的
doing this I would probably I know maybe 这样做我可能也许会知道
a week or something right hard to say 一个星期或者很难说的话
but so the specific opinion isn't that 但所以具体意见不是这样
important but I want you to go through 很重要，但我希望你能通过
this exercise because this is how 这个练习因为这是怎么回事
efficient startup teams should you know 你应该知道高效的创业团队吗？
brainstorm a list of things and then you 头脑风暴一系列事物然后你
all figure out how long you think it'll 所有人都知道你会想多久
take to do these things and I think we 采取做这些事情，我想我们
can have a debate about how high quality 可以就如何高质量进行辩论
the dangerous I think you can get very 危险我认为你可以得到
high quality data from this and from 来自此的高质量数据
this I I just didn't trust a lot of 这个II只是不相信很多
those online audio sources but this is 那些在线音频源，但这是
really fast and you can get pretty high 非常快，你可以得到很高
quality data I would probably do this to 质量数据我可能会这样做
collect the background sound to get 收集背景声音
going right but I think that part of the 向右走，但我认为那部分原因
workflow I see of you know fast moving 工作流程我看到你知道快速移动
teams is pretty much exactly what you 团队几乎就是你
did which is why I just have that 这就是为什么我有这个原因
exercise of brainstorming the list of 锻炼头脑风暴的清单
options and then really estimating what 选项，然后真正估计什么
time can we get this done and then use 时间我们可以完成这个，然后使用
that to pick an option right um 那个选择权利嗯
and then I wanna just mention one last 然后我想提到最后一个
thing which is that 那是什么的东西
these differences matter right um you 这些差异对你很重要
know I've actually a Pulaski system for 知道我实际上是一个Pulaski系统
long machinery systems but oh and I 长机械系统，但哦和我
think by the way if you do everything we 顺便想一想，如果你做了我们所做的一切
just described and you see this later 刚刚描述过，你会看到这个
in a problem set you can actually with 在一个问题集中你可以实际使用
this set of ideas pretty much the set of 这套想法几乎就是这套
ideas that we just went through today 我们今天刚刚经历过的想法
you can actually probably build and 你实际上可能会构建和
build a pretty decent trigger where 建立一个相当不错的触发器
detection system or way question or 检测系统或方式问题或
detection system and in fact well I'll 检测系统，事实上我很好
see that you're pretty much this in the 看到你几乎就是这个
later homework exercise but now you know 后来的作业练习，但现在你知道
when you get to that power exercise when 当你进行那种力量运动的时候
you do are an ends up you know how you 你知道你是怎么做到的
could come up with this sort of process 可以想出这种过程
yourself if you didn't already know how 你自己，如果你还不知道如何
to make these types of choices affect my 使这些类型的选择影响我的
results by the way the beginning I think 从一开始我认为的结果
that it's not super sense which like 这不是超级意义上的喜欢
many micro moments or lights is the same 许多微时刻或灯光都是一样的
as the one that's used when I run the 作为我运行时使用的那个
run standpoint that's what I don't keep 运行的立场，这是我不守的
with my best but my data points you have 尽我最大但我的数据点你有
to yeah so my advice ed what does your 是的，所以我的建议是什么，你的
microphone affect your results right 麦克风会影响你的结果
yeah my advice it would be to get 是的，我的建议是得到
something going quickens are here and 有些事情在这里变得越来越快
then develop a dev set right with the 然后开发一个开发设置权利
actual types of data you think you get 您认为可获得的实际数据类型
on your real microphone and then see if 在你真正的麦克风上然后看看
it is a problem and it may be in 这是一个问题，它可能在
different microphones do have different 不同的麦克风确实有所不同
characteristics and if it is a problem 特征，如果是一个问题
then go back and think about how you 然后回去想想你是怎么回事
collect data there's more representative 收集数据更有代表性
upon you yes I want to mention one more 在你是的我想再提一个
quick thing there were kind of hot 快速的东西有点热
surveys I wanted to do something real 调查我想做一些真实的事情
quick 快
which is um I want to tell you why these 这是我想告诉你为什么这些
things really matter which is um if this 事情真的很重要，如果是这样的话
is a performance right unless they 除非他们是表演权
actually missing error 实际上缺少错误
and this is tiny right and if this is 这是微不足道的，如果是这样的话
today and the other see all this data 今天和另一个看到所有这些数据
remember yes that's what we're doing 记住是的，这就是我们正在做的事情
just Lessing and this is six months from 只是莱辛，这是六个月
now and this is 12 months but now you 现在，这是12个月，但现在你
know maybe of a competitor actually 实际上可能知道竞争对手
maybe maybe I don't know maybe a because 也许我可能不知道也许是因为
we talked about this so much in this 我们在这里讨论过这么多
class it may be two of you in this 这可能是你们两个人
posture gonna build this sauce up but I 姿势会打造这个酱，但我
said it may be a competitor um 说它可能是竞争对手嗯
but over time mostly machine learning 但随着时间的推移大多是机器学
teams you know the error actually goes 团队你知道错误实际上是
down over time as you work on problems 当你处理问题时，随着时间的推移而下降
right I mean this is what I see in tons 对，我的意思是这就是我所看到的吨数
of practical projects you know you work 你知道你工作的实际项目
on the project improve the system and 在项目上改进了系统和
the error actually goes down over time 错误实际上随着时间的推移而下降
as you work on this over the next 12 当你在接下来的12个工作中这样做
months a right if you really see over 几个月，如果你真的看到了一个权利
started doing this and it turns out that 开始这样做，结果证明了这一点
it's a start up to have the discipline 这是一个有纪律的开始
to constantly be the most efficient 永远是最有效率的
don't do something that takes you two 不要做两件事
days if you can get a similar result in 如果你能得到类似的结果，那就好了
one day 一天
the difference is not that you're one 差别不在于你是一个人
day slower the difference is that you're 一天比较慢，差异就在于你
2x faster right and then then having 快2倍然后再拥有
that mindset if we take this whole chart 如果我们采用这整个图表，这种心态
and compress it on the horizontal axis 并在水平轴上压缩它
um then you want to be the startup that 那么你想成为那个初创公司
you know makes the same amount of 你知道的相同数量
progress in six months instead of 12 六个月而不是十二个月的进展
months variant because if you're able to 几个月的变种，因为如果你能够
do this then your startup will actually 这样做，然后你的创业实际上
perform much better in the marketplace 在市场上表现得更好
assuming your accuracy is important 假设您的准确性很重要
which it seems to be for wake where it 这似乎是唤醒它的地方
and so don't think of this as saving you 所以不要认为这是拯救你
a day here and there think of this as 这里和那里的一天都想到这一点
making your team twice as fast and 让你的团队快两倍
that's the difference between this level 这是这个级别之间的差异
of performance and downloadable so 性能和可下载的
that's why when I'm you know building 这就是为什么当我知道建筑时
teams executing these projects I tend to 我倾向于执行这些项目的团队
be pretty obsessive about making sure 对于确保这一点非常着迷
we're very efficient in exploring the 我们非常有效地探索
options and don't wait till tomorrow to 选择，不要等到明天
collect data of dubious quality when you 当你收集可疑质量的数据
have a better idea of collecting data by 有更好的收集数据的想法
today because the difference is not that 今天因为差别不是那样
you wasted 12 hours the difference is 你浪费了12个小时的差异
you had twice as slow as a company right 你的速度是公司的两倍
so I think so hopefully through this 所以我希望通过这个有希望
example on your ongoing experiences 关于您持续经历的例子
throughout this course I can help you 在整个课程中，我可以帮助你
continue 继续
to get better at this right um 嗯，这对你好
last thing we want to do was we're about 我们要做的最后一件事就是我们
halfway through the course I'll go ahead 在课程的中途我会继续
um we want to hand out a survey of an 嗯，我们想发一份调查问卷
anonymous survey to get some feedback 匿名调查以获得一些反馈
from you about this class and whenever 关于这个课程，无论何时何地
we get these surveys we end up thanks to 我们得到这些调查，我们最终感谢
the previous generations of students 前几代学生
feedback we've already been gradually 反馈我们已经逐步了
making cause better so I think Ken and I 让事业变得更好所以我想肯和我
actually read all of these questions 实际上阅读了所有这些问题
ourselves and try to find ways to take 我们自己并试图找到方法
your feedback to improve the class so I 你的反馈，以改善课程，所以我
can take you know five minutes to felt 可以带你知道五分钟的感觉
the survey and you can hand it in just 调查，你可以把它交给我
drop it up anonymously up here in front 匿名放在前面
but very grateful for your suggestions 但非常感谢你的建议
okay so um I think if you haven't 好吧，所以，如果你没有，我想
entered your ID yet you can still do so 输入了您的身份证，但您仍然可以这样做
but that's it for today so please start 但今天就是这样，所以请开始吧
the survey and anonymously drop that 调查并匿名删除
back in front then we wrap okay thank 回到前面然后我们包好了谢谢
you 您