Keep in mind that Musk is treating the government like twitter - he invested over $250 million to get this access, and so he's taking over as much as he can, and just like with twitter, he brings in his crew who proceeds to do the same stupid shit with "show me your best code" etc. in order to try and pressure people to leave.
He believes that his $250 million bought him access to all of this data. Wouldn't surprise me if gaining access to CFPB, etc. is just below trying to control the various agencies that could regulate or impact his companies.
I don't know if you remember, but when he took over twitter, he unplugged a rack of servers just to see if things functioned without them - that's his mindset, and I have a gut feeling that we will soon see him try and disconnect something or shut something completely off to see what's affected.
Regardless, the US government is now just a fucking startup for him and his incels to fuck around with.