Guilt is a good thing. It is your minds way of teaching you a lesson. Let it take its course. If you didnt feel guilty, you would probably keep stealing, and eventually get caught and possibly ruin your life. Be grateful for that guilt. It could save your butt by preventing you from repeating the same mistake.