Yes, there are no restrictions on entering the campus, except that the library has to swipe its card.
CUHK has Haizhu Campus and University Town Campus. If you want to see red brick buildings, you should go to Haizhu Campus, and the University Town Campus can play with other universities conveniently.