Is there a penalty for engaging in business in Putnam County without a Business Tax Receipt

Yes, you can be assessed a penalty up to 25% of the business tax due, in addition to any other penalty provided by law or ordinance.

Putnam County Tax Collector