A basic VFD will not have a lot of torque at slow speeds. To overcome that many VFDs have a tach input so the drive can boost the motor when it is stalling. There are also issues with proper cooling at low speeds. The best thing is to setup the belt system so the motor runs at nameplate speed or above for most operations. Inverter duty motors can be overdriven way over speed. Standard motors can still go a lot, but the insulation might have issues with very high frequencies. It's always better to run the motor over speed than under. Many VFDs can go as high as 400Hz so the motor will run 6.6 times the nameplate speed. While that motor probably can't handle that, it can at least do double or triple speed. Then setup your belts to get the max spindle speed you want and use the VFD to go down from there. If you plan on tapping or drilling super large holes in hard materials, you still may need to swap a belt from time to time.
Long arc, short arc, heliarc and in-the-dark!