Black Lives Matter is targeting Democrat Senator Sheldon Whitehouse over his membership with an exclusive all-white beach club in Rhode Island. The group is calling on Sen. Whitehouse to either cut all tries to the beach club which his family has been members of for years or resign from office.

Fox News reports:

“This is an issue that’s not going to go away, and Senator Whitehouse needs to address it. He needs to take it on,” the group’s Mark Fisher told ABC6 on Wednesday. “If he thinks we’re just going to forget about it, if he thinks that it’s going to get swept under the rug, it’s not.”

Sen. Whitehouse apologized but it’s not enough for Black Lives Matter, Fisher says that if Sen. Whitehouse doesn’t correct his actions soon the organization has no problem going to his home, office, or Bailey’s beach Club to protest.

“The recent attention to this issue has prompted me to assess all my affiliations and to consider whether any involve inequitable or exclusionary policies. While I am not a member of the beach club, I do own a boat and belong to a sailing club in Newport,” he said June 23. “While this club does not have exclusionary rules for membership, it does lack diversity.”

Fisher of Black Lives Matter Rhode Island said the group is giving Whitehouse until next Friday to put out a statement announcing his family members have left Bailey’s Beach Club. If he doesn’t, Fisher said his group will start protesting.

“We’ll go to his club, we’ll go to his office, we’ll go to his home,” he told ABC6, “wherever we need to go.”