Interior Secretary Ryan Zinke said Monday that almost one-third of career bureaucrats at his department are “not loyal to the flag,” and not in lockstep with him and President Trump.

Zinke, a former Navy SEAL, took over the 70,000-employee department in March, and has since been working to change the department’s regulatory culture to be more business-friendly.

“I got 30 percent of the crew that’s not loyal to the flag,” Zinke said. “We do have good people, but the direction has to be clear and you’ve got to hold people accountable.”

Zinke made the remarks in a speech to an oil industry group and compared his department to a pirate ship that captures “a prized ship at sea and only the captain and the first mate row over” to finish the mission.