It is said that we should only take what is necessary from material things of this world. So does this mean we should take only little?

Yes, that is what we should do - the less we will take, the better off we are.

When Prophet Muhammad (ﷺ) died, he left nothing of this world. Whatever was with him before his death was all given away. He only left knowledge behind.

This characteristic is referred to as Zuhd where a person takes from the material things of this world only what is needed. Whatever is in excess, we should give it away, because if we don't give it away, then it would be of no benefit in the life to come. But, if we give it away, it’s value would be a lot. As Allah says in the Qur’an:

“Whatever you have will end, but what Allah has is lasting. And We will surely give those who were patient their reward according to the best of what they used to do.” [1]

And Allah knows best.

Reference:

[1] Surah al-Nahl, 16:96