You can test usability in a running application, a high fidelity prototype, a paper prototype… Wherever you want! The design doesn’t need to be perfect, it just needs to contain the main components and you have to be able to simulate the software behavior.