KB Article #176480

root mount point disk usage increase continously

Problem

-- Root mount point disk space taken is continuously growing;

root@server:/# df -kh
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/GatewayVG00-GW_LV_root
                       27G   22G  3.1G  88% /


Resolution

* in order to detect the problem, use the getinfo tool:

[admin@axp ~]$ su -c getinfo
Password:
Collecting command history...
Storing system files...
Executing debug commands...
Zipping the results...
A zip file of the system information has been saved in:
/opt/gateway/sysinfo/sysinfo_axp_1406111557.zip

* cause:
-- it has been seen from admin history: is that it has deleted a large file with "rm" (/home/admin/bin/APIServerxxx.out) but the process does not know that the files is deleted so holds on to the file descriptor;
-- the OS (Linux and du) think that the space is free but df reports it as in use;
-- the file is in unlinked state (can be seen in output of lsof command);

grep deleted lsof
vshell xxx admin 1w REG 253,0 22639634155 785752 /home/admin/bin/APIServerxxxx.out (deleted)



* solution:
-- restart the APIGateway and the space will be free up.