If you are on library property, which does include outdoor spaces (Courtyard; Patio; Plaza) and the parking lot, then you do need permission to take photos or videos. If you are on a public road or sidewalk, you do not need permission to take photos or videos.
