Although a president has a lot of leeway to change regulations, it can be hard to do once rules are already implemented.