There is a bit of variation between devices, but it can be seen that the nominal flow speed through a tubeaxial fan (CFM rating divided by frame area) is the dominant influence in the question. (see figure 2 here)
There may be opportunities for noise reduction by changing guards/filters or exhaust ports present, or if the existing unit is poorly-matched to the system, something with a different curve might offer improvement. But generally speaking, a larger fan is going to be quieter for a given flow rate.