Nitish Srivastava and Geoffrey Hinton introduce the dropout technique, randomly deactivating network nodes during the training phase. This simple architectural modification prevents complex co-adaptation and reduces overfitting in highly parameterized models.
Part of the 29 Structural Foundations: The Internet Era, Big Data, and Deep Learning Explosion Edition archive. HistoricallyVerified
Top 5 Structural Foundations: Origins
- The Launch of the Google Glass Ambient Computer Experiment — Google unveiled its augmented reality smart glasses, pushing the absolute spatial limits of low-powe...
- The Collapse of the Thinking Machines Corporation (1994) — Danny Hillis’s company, famous for its 64,000-processor supercomputers, declared bankruptcy. The mar...
- The Formulation of the AdaGrad Optimization Standardization — Computational statisticians finalized the AdaGrad adaptive subgradient optimization method, allowing...
- The Launch of the Waymo 100K Autonomous Passenger Ride Milestones — Alphabet’s Waymo scaled its commercial robotaxi services aggressively across San Francisco, Los Ange...
- The ALPAC Report Budget Crisis (1966) — The Automated Language Processing Advisory Committee issued a devastating government report concludi...
Discussion: