Have each prison in a region have a specialty service. For example, one could specialize in repairing/testing fire extinguishers, one could specialize in SCBAs, etc. Then the services could be provided in-house and at a significant savings for others.
Quit promoting individuals who cause problems, and terminate them.
Not only are you just causing more trouble for the section, agency, or department they are promoted to, you are also increasing their pay. and continuing to pay them for years, then they retire and you further continue to pay them.
Spend some money on investigating them and get them out. Cut ties.
Integrity for all
Rank all Federal employees. Any employee in the bottom 5% for 2 consecutive years can be fired.
Ranking can include exams relevent to their position if appicable, as well as performance thoughout the year.
Additionally, all new hires must go through a 2 year probation, and can be fired at any time during those 2 years.