Low budget?

Being on a low budget does not mean you cannot do anything. You do not have to have the most expensive thing in the store. Candles you can typically buy for a few cents if you go to the right place. At Walmart they are about 2 dollars for a large candle.
If you are just starting out and want a book, whether it be a book of shadows or a reading book, you may need to save some money for this. In the mean time, you can look online for the basic knowledge and you can use a notebook to write down your findings. You can also use a computer program, like Microsoft WordMicrosoft Office Home & Student 2010 Traditional Disc 79G-02144

What is a Book of Shadows? 
---A Book of Shadows is a book that you have all your personal stuff in. It contains anything from spells to Zodiac signs to just basic knowledge. Many people suggest that inside your Book of Shadows you write anything that would be needed if you are buried with it and it is found hundreds of years later, so someone can recreate your religion.
I have also been told to write down any spell in it that works. It will make the spell stronger if your book is blessed too.

Incense can be bought from Walmart for $1 a box. Walmart also carries cones and incense burners.
Many craft items that you will need can be bought for a very cheap price if you find the right place to go. You can also hand make many items or find them outside. It's all up to you.