No need to spend money on picture books. Everything you need is right there in your town at your public library. Concept books, shapes, numbers, board books -- it's all there.
My library has an exchange program so I can get in books from other local libraries, if my own library doesn't have something. That is great to be able to get the more unusual picture books.