Actually, you can do all sorts of things here...well, except go home. But you're free to make your own decisions now! The world is your oyster and all that. You don't have to take the gym challenge if you don't want to.

And I guess if you were really that adverse to it...technically you wouldn't even have to catch Pokemon if you didn't want to. Nobody's going to make you.