That’s pretty simple. But you have to do it in UA_SYSTEM_TABLES database. There is no graphical way to remove campaign Custom Attributes.

delete from UA_CAMPATTRIBUTE where ATTRIBUTEID = ?;
delete from UA_ATTRIBUTEDEF where ATTRIBUTEID = ?;

Put your attribute ID on above placeholders and execute the query. You will not be able to see those fields on Campaign UI.