The town, or at least the main street that goes by the factory. As far as I know, no orange people were enslaved.
Seriously though, Milton Hershey was surprisingly progressive for his time. He built affordable homes for his workers and helped them become home owners. The school he built was originally for orphaned boys.

You are going to think I made this up, but the street lights are shaped like Hershey kisses.

Wow! I grew up with these. (Nostalgia intensifies!)