1. A lot of problems are inherently high-dimensional, so you're often more likely to run into saddle points
2. Some problems don't even have a bounded global maximum, a true optimal
A more concerning bottleneck is diminishing returns: even with recursive improvement, capability gains could end up being only logarithmic (or worse). Even current systems seem capable of these diminishing returns only/mostly.
A more concerning bottleneck is diminishing returns: even with recursive improvement, capability gains could end up being only logarithmic (or worse). Even current systems seem capable of these diminishing returns only/mostly.
reply