Should I increase my weights every week?

Yes, when possible. Progress might look different week-to-week, but any increase in strength counts. The goal is slow, consistent improvement.