How can I increase storage space?

When android phone (4.3) warns about

Storage space running out.

Some system function may not work.

Besides install apps, what can I do to mitigate the problem?

I have replaced SD card from 2GB to 32GB. But it doesn’t seem to solve problem. Why?