Developed by 10 MIT faculty members at IDSS, this seven-week course is specially designed for data scientist, business analyst, engineers and technical managers looking to learn the latest theories and strategies to harness data. Offered by MIT xPRO.
IDSS will host Prof. Bruce Western as part of the Distinguished Speaker Seminar series. Prof. Westerns research has examined the causes, scope, and consequences of the historic growth in U.S. prison populations. He is Co-Director of the Justice Lab at Columbia University.
Abstract: The training of neural networks optimizes complex non-convex objective functions, yet in practice simple algorithms achieve great performances. Recent works suggest that over-parametrization could be a key ingredient in explaining this discrepancy. However, current theories could not fully explain the role of over-parameterization. In particular, they either work in a regime where neurons don't move much, or require large number of neurons. In this paper we develop a local convergence theory for mildly over-parameterized two-layer neural net. We show…
