Quick reply button appears at the bottom of every thread and allows you to post quickly without having to load the full post editor (unless you need one of its functionalities).
It's just a way to load a post editor faster, and also stay on the page of the thread. It doesn't mean that you should hit the submit button any sooner than you usually do.