计算机视觉 W40 Training ConvNet (1)
Review cnn: sparse interations and parameter sharing computational graphs: automatic differentiation Training pipeline set up network architecture = computational graph train using mini-batch stochastic gradient descent loop sample a batch of images forward propagation through the network and get loss back propagation to calculate the gradient update parameters using the gradient Activation Function Sigmoid σ(x)=11+e−x\sigma(x)=\frac{1}{1+e^{-x}}σ(x)=1+e−x1 nice interpretation as a sat ...
计算几何 W39 Introduction to Computational Geometry
阅读材料 Classroom examples of robustness problems in geometric computations by Lutz Kettner et al. substituting floating point arithmetic for the assumed real arithmetic may cause implementation to fail. focus on floating point - real numbers issue IEEE 754 课堂笔记 Computational Geometry algorithms that deal with geometric data points lines circles hyperplanes applications graphic databases geographical information system robotics one example: a file contains n lines where the i-th line contai ...
丹麦语 DU 3.1 Familie, Klokken, Hverdag of weekend
Familie En familie 直系亲属 en kone 妻子 en mand 丈夫 en mor 母亲 en far 父亲 forældre 父母 børn 孩子 en datter - to døtre 女儿 en søn - to sønner 儿子 兄弟姐妹 en søster - to søstre 姐妹 en bror - to brødre 兄弟 en lillebror - to små brødre 弟弟 en storebror - to storebrødre 哥哥 en lillesøster - to små søster 妹妹 en storesøster - to storesøstre 姐姐 祖辈 en mormor 外祖母 en morfar 外祖父 en farmor 祖母 en farfar 祖父 et barnebarn - to børnebørn 孙辈 en oldemor 曾(外)祖母 en oldefar 曾(外)祖父 en oldebarn 曾(外)孙辈 其他亲戚关系 en moster 姨 = mors søster ...
算法博弈论 W39 Revenue-maximizing auctions
This week Revenue-maximizing DSIC auctions completely different goal than social welfare maximization average-case analysis Review Spectrum auction’s problem: VERY LOW REVENUE Social welfare maximization many applications makes sense even in cases where revenue maximization seems to be more important (e.g. keeping customers compared to competitors) educational value: ideal auctions and ideal mechanisms always exist Single item auction with a single potential buyer revenue? what other truth ...
计算机视觉 W39 Backpropagation
Back propagation with manual derivation Let’s consider a neural network LLL is total number of layers sls_lsl is number of units (except bais) in layer lll. (W,b)=(Wij(l),bi(l))l=1nL(W,b)=(W_{ij}^{(l)},b_i^{(l)})_{l=1}^{n_L}(W,b)=(Wij(l),bi(l))l=1nL is model parameters, where we write Wij(l)W_{ij}^{(l)}Wij(l) to denote the weight associated with the connection between unit jjj in layer lll, unit iii in layer l+1l+1l+1. bi(l)b_i^{(l)}bi(l) is the bias associated with unit iii in layer l+1 ...
德语学习 B2 Kapitel 1 Heimat ist ...
Inhalt Neue Heimat Ein Land, viele Sprachen Missverständliches Zu Hause in Deutschland 1-1 Heimat ist … (1) Was bedeutet Heimat? Heimat ist nicht nur das Land, die Stadt oder die Region, aus dem/der eine Person kommt. Es kann auch ein anderer Ort sein, an dem man sich wohlfühlt, weil man dort schon lange lebt und sein soziales Netz dort aufgebaut hat. soziales Netz aufbauen 建立人际关系 z. B. Es fällt mir hart schwer, China zu verlassen. Ich habe meine Familie hier und mein soziales Netz habe ich ...
计算几何 W38 I/O Model and Permutation Lower Bound
课前预习 Random Access Machine Model standard theoretical model of computation infinite memory uniform access cost simple model crucial for success of computer industry Hierarchical Memory modern machines have complicated memory hierarchy levels get larger and slower further away from CPU data moved between levels using large blocks many issues influence performance cache misses, TLB misses, branch mis-predictions etc. Disk access is 10610^6106 slower than main memory access important to st ...
丹麦语 DU 3.1 I klassen 1 Præsentation 2
I klassen 1 Hvordan går det? 你好吗? Det går godt. Hvad med dig? 我很好。你呢? bliver 留在 svært 困难的 adj Vi ses. = Hej hej. 再见。 En uge 一周 工作日 Hverdage: mandag, tirsdag, onsdag, torsdag, fredag 周末 Weekend: lørdag, søndag Ting i klassen en bog 书 et hæfte 小册子 en mappe 笔记本 et papir 纸 en blyant 铅笔 en kop 茶杯 et ur 手表 en nøgle 钥匙 en taske 挎包 en ordbog 字典 en kuglepen 签字笔 et penalhus 文具盒 en blyantspidser 削笔刀 et bord 桌子 en stol 椅子 et vindue 窗户 et skab 柜子 en tavle 黑板 et landkort 地图 en dør 门 et viskelæder 橡皮擦 ...
算法博弈论 W38 Algorithmic mechanism design
Ιωάννης 的可爱🇬🇷口音 exponential 一克斯破烂秀 guarantee 尬兰提 Mechanism design for single-parameter environments 3 goals of mechanism designs: DSIC Social welfare maximization simplicity solution: Myerson’s lemma possible obstacle: computational complexity of the social welfare maximization problem hence, the second and the third goals may not be compatible The Knapsack The Knapsack problem aka 背包问题 A burglar enters a house to steal, with a knapsack that can hold items of total weight WWW the burglar ...
计算机视觉 W38 Convolutional Neural Networks
Convolution disadvantage of fully connected MLP: difficult to detect local features. In fully connected neural network, we need a separate neuron to detect each of the items (same feature appear in different position). a waste of network parameters. Solution: using convolution to identify local features Advantages: fewer trainable params (sparse interactions) Same params reused multiple times (param sharing) translation invariance (equi-variance) 平移不变性 for continue: (f∗g)(t)=∫−∞∞f(τ)g(t−τ)dτ= ...