About 5:15 Thursday morning police arrested Christopher Gilmore and William Cross after they were seen allegedly trying to break-in to the Apollo Liquors on Franklin Street.
Both men were still in the parking lot when police arrived.
Officers say the glass on one of the store's doors was busted out and had a shoe print on it.
One of the suspects shoes was taken into evidence and appeared to match the print on the door.
Both men were arrested and charged with attempted burglary and criminal mischief.