To compile all available help formats at once select Tools->Compile All or click on "Compile all formats" button on the tool bar.

"Compile" dialog will appear. Check formats you want to compile and select paths to store compiles files to. Or leave it with default values.

Check "Auto open" if you want all compiled files to open right after they are ready.