What is the softest sweater material? It is an interesting question and one that has been bothering me for quite some time. I have even searched high and low to no avail. The sweater itself does not matter but the boning or the filling material that holds the fibers together and gives the shirt its shape. So why the question of what is the softest sweater material anyway? Why would someone care if a sweater is too hard or too soft?