Concrete Problems in AI Safety
At a glance
Outlined five practical research problems for preventing accidents in AI systems.
In one paragraph
Outlined five practical AI safety problems: unwanted side effects, gaming rewards, costly human supervision, risky trial-and-error learning, and failures when conditions change. Proposed research directions for preventing these accidents.