Spurious valleys in one-hidden-layer neural network optimization landscapes

Mathematics

• Network Optimization 100%
• Neural Networks 63%
• Data Distribution 43%
• Gradient Descent Method 24%
• Non-convexity 22%
• Model 22%
• Nonconvex Optimization 20%
• Activation Function 20%
• Nonconvex Problems 19%
• Global Minimum 19%
• Optimise 17%
• Nonlinear Function 17%
• Level Set 17%
• Topological Properties 17%
• Connected Components 16%
• High-dimensional 13%
• Trace 13%
• Optimization Problem 12%
• Imply 10%
• Class 10%
• Necessary Conditions 9%
• Sufficient Conditions 8%

Engineering & Materials Science

• Neural networks 41%
• Steepest descent method 21%
• Chemical activation 15%