There are two types of sorts that may use fewer than the configured number of sort buffers:
Creating a clustered index on a partition table always requires a parallel sort. If the table size is smaller than the number of configured sort buffers, then the sort reserves the number of pages in the table for the sort.
Small serial sorts reserve just the number of sort buffers required to hold the table in cache.
