Ubuntu 突然每晚都会崩溃,日志中会出现 oom-killer

Ubuntu 突然每晚都会崩溃,日志中会出现 oom-killer

在我将服务器上大约一百万个文件添加到 truecrypt 分区中的一个文件夹后,突然开始崩溃。

奇怪的是,它每天晚上 1 点左右都会这样做...检查了我的 cron,发现当时没有任何程序在运行。

以下是昨晚我的 kern.log 文件中的一些信息:

Dec 20 01:01:58 Lubuntu kernel: [142653.102582] lightdm-gtk-gre invoked oom-killer: gfp_mask=0x44d0, order=2, oom_adj=0, oom_score_adj=0
Dec 20 01:01:58 Lubuntu kernel: [142653.102588] lightdm-gtk-gre cpuset=/ mems_allowed=0
Dec 20 01:01:58 Lubuntu kernel: [142653.102591] Pid: 1786, comm: lightdm-gtk-gre Tainted: G           O 3.5.0-17-generic #28-Ubuntu
Dec 20 01:01:58 Lubuntu kernel: [142653.102593] Call Trace:
Dec 20 01:01:58 Lubuntu kernel: [142653.102602]  [<c15c01c4>] dump_header.isra.10+0x86/0x1b4
Dec 20 01:01:58 Lubuntu kernel: [142653.102607]  [<c1104a1a>] oom_kill_process+0x23a/0x270
Dec 20 01:01:58 Lubuntu kernel: [142653.102611]  [<c1104b3e>] ? select_bad_process.constprop.15+0xee/0x170
Dec 20 01:01:58 Lubuntu kernel: [142653.102614]  [<c1104f53>] out_of_memory+0x163/0x1c0
Dec 20 01:01:58 Lubuntu kernel: [142653.102617]  [<c1108abf>] __alloc_pages_nodemask+0x68f/0x750
Dec 20 01:01:58 Lubuntu kernel: [142653.102621]  [<c1108bfc>] __get_free_pages+0x1c/0x40
Dec 20 01:01:58 Lubuntu kernel: [142653.102625]  [<c113dd82>] kmalloc_order_trace+0x22/0x90
Dec 20 01:01:58 Lubuntu kernel: [142653.102628]  [<c114008a>] __kmalloc_track_caller+0x14a/0x160
Dec 20 01:01:58 Lubuntu kernel: [142653.102631]  [<c113df88>] ? kmem_cache_alloc+0xe8/0x120
Dec 20 01:01:58 Lubuntu kernel: [142653.102636]  [<c14caf2f>] ? sock_alloc_send_pskb+0x17f/0x2b0
Dec 20 01:01:58 Lubuntu kernel: [142653.102639]  [<c14cfb65>] __alloc_skb+0x55/0x200
Dec 20 01:01:58 Lubuntu kernel: [142653.102642]  [<c14caf2f>] sock_alloc_send_pskb+0x17f/0x2b0
Dec 20 01:01:58 Lubuntu kernel: [142653.102645]  [<c14cb07d>] sock_alloc_send_skb+0x1d/0x30
Dec 20 01:01:58 Lubuntu kernel: [142653.102649]  [<c1556cb3>] unix_stream_sendmsg+0x2f3/0x3e0
Dec 20 01:01:58 Lubuntu kernel: [142653.102652]  [<c14c74bf>] sock_aio_write+0xff/0x120
Dec 20 01:01:58 Lubuntu kernel: [142653.102655]  [<c14c73c0>] ? sock_register+0x90/0x90
Dec 20 01:01:58 Lubuntu kernel: [142653.102659]  [<c114f42c>] do_sync_readv_writev+0xac/0xe0
Dec 20 01:01:58 Lubuntu kernel: [142653.102664]  [<c125d3f4>] ? security_file_permission+0x24/0xb0
Dec 20 01:01:58 Lubuntu kernel: [142653.102667]  [<c114eba3>] ? rw_verify_area+0x63/0x110
Dec 20 01:01:58 Lubuntu kernel: [142653.102670]  [<c114f6bf>] do_readv_writev+0x9f/0x190
Dec 20 01:01:58 Lubuntu kernel: [142653.102672]  [<c14c73c0>] ? sock_register+0x90/0x90
Dec 20 01:01:58 Lubuntu kernel: [142653.102677]  [<c10735a2>] ? check_preempt_curr+0x72/0x90
Dec 20 01:01:58 Lubuntu kernel: [142653.102680]  [<c10735e8>] ? ttwu_do_wakeup+0x28/0x110
Dec 20 01:01:58 Lubuntu kernel: [142653.102683]  [<c114f7e7>] vfs_writev+0x37/0x60
Dec 20 01:01:58 Lubuntu kernel: [142653.102685]  [<c114f94d>] sys_writev+0x3d/0xa0
Dec 20 01:01:58 Lubuntu kernel: [142653.102689]  [<c15cff5f>] sysenter_do_call+0x12/0x28
Dec 20 01:01:58 Lubuntu kernel: [142653.102692]  [<c15c0000>] ? filter_check_discard.isra.15.part.16+0xb/0x25
Dec 20 01:01:58 Lubuntu kernel: [142653.102694] Mem-Info:
Dec 20 01:01:58 Lubuntu kernel: [142653.102696] DMA per-cpu:
Dec 20 01:01:58 Lubuntu kernel: [142653.102698] CPU    0: hi:    0, btch:   1 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102699] CPU    1: hi:    0, btch:   1 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102701] CPU    2: hi:    0, btch:   1 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102702] CPU    3: hi:    0, btch:   1 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102704] Normal per-cpu:
Dec 20 01:01:58 Lubuntu kernel: [142653.102705] CPU    0: hi:  186, btch:  31 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102707] CPU    1: hi:  186, btch:  31 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102709] CPU    2: hi:  186, btch:  31 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102710] CPU    3: hi:  186, btch:  31 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102711] HighMem per-cpu:
Dec 20 01:01:58 Lubuntu kernel: [142653.102713] CPU    0: hi:  186, btch:  31 usd:  17
Dec 20 01:01:58 Lubuntu kernel: [142653.102715] CPU    1: hi:  186, btch:  31 usd:  19
Dec 20 01:01:58 Lubuntu kernel: [142653.102717] CPU    2: hi:  186, btch:  31 usd:   0
Dec 20 01:01:58 Lubuntu kernel: [142653.102718] CPU    3: hi:  186, btch:  31 usd:  19
Dec 20 01:01:58 Lubuntu kernel: [142653.102722] active_anon:109650 inactive_anon:110327 isolated_anon:0
Dec 20 01:01:58 Lubuntu kernel: [142653.102722]  active_file:317770 inactive_file:89531 isolated_file:0
Dec 20 01:01:58 Lubuntu kernel: [142653.102722]  unevictable:7798 dirty:0 writeback:0 unstable:0
Dec 20 01:01:58 Lubuntu kernel: [142653.102722]  free:177821 slab_reclaimable:182861 slab_unreclaimable:6900
Dec 20 01:01:58 Lubuntu kernel: [142653.102722]  mapped:565603 shmem:5873 pagetables:3184 bounce:56
Dec 20 01:01:58 Lubuntu kernel: [142653.102729] DMA free:4232kB min:784kB low:980kB high:1176kB active_anon:0kB inactive_anon:0kB active_file:432kB inactive_file:412kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15800kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:10548kB slab_unreclaimable:80kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:76kB writeback_tmp:0kB pages_scanned:3741 all_unreclaimable? yes
Dec 20 01:01:58 Lubuntu kernel: [142653.102731] lowmem_reserve[]: 0 869 6072 6072
Dec 20 01:01:58 Lubuntu kernel: [142653.102739] Normal free:44208kB min:44216kB low:55268kB high:66324kB active_anon:0kB inactive_anon:0kB active_file:4152kB inactive_file:3972kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:890008kB mlocked:0kB dirty:0kB writeback:0kB mapped:4880kB shmem:0kB slab_reclaimable:720896kB slab_unreclaimable:27520kB kernel_stack:3416kB pagetables:756kB unstable:0kB bounce:148kB writeback_tmp:0kB pages_scanned:25082 all_unreclaimable? yes
Dec 20 01:01:58 Lubuntu kernel: [142653.102741] lowmem_reserve[]: 0 0 41626 41626
Dec 20 01:01:58 Lubuntu kernel: [142653.102748] HighMem free:662844kB min:512kB low:66692kB high:132872kB active_anon:438600kB inactive_anon:441308kB active_file:1266496kB inactive_file:353740kB unevictable:31192kB isolated(anon):0kB isolated(file):0kB present:5328224kB mlocked:31192kB dirty:0kB writeback:0kB mapped:2257532kB shmem:23492kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:11980kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Dec 20 01:01:58 Lubuntu kernel: [142653.102750] lowmem_reserve[]: 0 0 0 0
Dec 20 01:01:58 Lubuntu kernel: [142653.102754] DMA: 41*4kB 29*8kB 77*16kB 51*32kB 6*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 4284kB
Dec 20 01:01:58 Lubuntu kernel: [142653.102763] Normal: 1764*4kB 1524*8kB 1029*16kB 79*32kB 0*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 1*4096kB = 44256kB
Dec 20 01:01:58 Lubuntu kernel: [142653.102773] HighMem: 4662*4kB 1936*8kB 842*16kB 5637*32kB 3319*64kB 916*128kB 149*256kB 21*512kB 1*1024kB 1*2048kB 13*4096kB = 662872kB
Dec 20 01:01:58 Lubuntu kernel: [142653.102787] 415373 total pagecache pages
Dec 20 01:01:58 Lubuntu kernel: [142653.102789] 722 pages in swap cache
Dec 20 01:01:58 Lubuntu kernel: [142653.102790] Swap cache stats: add 5238, delete 4516, find 3096/3220
Dec 20 01:01:58 Lubuntu kernel: [142653.102792] Free swap  = 1937052kB
Dec 20 01:01:58 Lubuntu kernel: [142653.102793] Total swap = 1953120kB
Dec 20 01:01:58 Lubuntu kernel: [142653.121617] 1703920 pages RAM
Dec 20 01:01:58 Lubuntu kernel: [142653.121622] 1475586 pages HighMem
Dec 20 01:01:58 Lubuntu kernel: [142653.121623] 693511 pages reserved
Dec 20 01:01:58 Lubuntu kernel: [142653.121624] 367083 pages shared
Dec 20 01:01:58 Lubuntu kernel: [142653.121625] 555463 pages non-shared
Dec 20 01:01:58 Lubuntu kernel: [142653.121627] [ pid ]   uid  tgid total_vm      rss cpu oom_adj oom_score_adj name
Dec 20 01:01:58 Lubuntu kernel: [142653.121638] [  403]     0   403      705      148   3       0             0 upstart-udev-br
Dec 20 01:01:58 Lubuntu kernel: [142653.121642] [  436]     0   436      843      412   0     -17         -1000 udevd
Dec 20 01:01:58 Lubuntu kernel: [142653.121645] [  573]     0   573      842      323   2     -17         -1000 udevd
Dec 20 01:01:58 Lubuntu kernel: [142653.121648] [  574]     0   574      844      321   2     -17         -1000 udevd
Dec 20 01:01:58 Lubuntu kernel: [142653.121651] [  774]     0   774      704      149   1       0             0 upstart-socket-
Dec 20 01:01:58 Lubuntu kernel: [142653.121654] [  866]     0   866     1176      240   2       0             0 vsftpd
Dec 20 01:01:58 Lubuntu kernel: [142653.121657] [  975]     0   975     5740      996   2       0             0 smbd
Dec 20 01:01:58 Lubuntu kernel: [142653.121660] [  978]     0   978     1673      602   3     -17         -1000 sshd
Dec 20 01:01:58 Lubuntu kernel: [142653.121663] [  980]   102   980      979      434   2       0             0 dbus-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121666] [  989]     0   989     3325      439   1       0             0 nmbd
Dec 20 01:01:58 Lubuntu kernel: [142653.121669] [ 1001]     0  1001     5864      334   3       0             0 smbd
Dec 20 01:01:58 Lubuntu kernel: [142653.121672] [ 1052]     0  1052     1854      639   1       0             0 modem-manager
Dec 20 01:01:58 Lubuntu kernel: [142653.121675] [ 1057]     0  1057     1195      337   2       0             0 bluetoothd
Dec 20 01:01:58 Lubuntu kernel: [142653.121678] [ 1067]     0  1067     6299     1327   2       0             0 NetworkManager
Dec 20 01:01:58 Lubuntu kernel: [142653.121682] [ 1081]   101  1081     7768      329   0       0             0 rsyslogd
Dec 20 01:01:58 Lubuntu kernel: [142653.121685] [ 1092]   108  1092      895      425   3       0             0 avahi-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121688] [ 1097]   108  1097      862      106   0       0             0 avahi-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121690] [ 1124]     0  1124     4229      847   3       0             0 cupsd
Dec 20 01:01:58 Lubuntu kernel: [142653.121694] [ 1146]     0  1146     6363      995   2       0             0 polkitd
Dec 20 01:01:58 Lubuntu kernel: [142653.121696] [ 1208]     0  1208     1158      211   1       0             0 getty
Dec 20 01:01:58 Lubuntu kernel: [142653.121699] [ 1214]     0  1214     1158      208   1       0             0 getty
Dec 20 01:01:58 Lubuntu kernel: [142653.121702] [ 1220]     0  1220     1158      211   1       0             0 getty
Dec 20 01:01:58 Lubuntu kernel: [142653.121705] [ 1221]     0  1221     1158      210   1       0             0 getty
Dec 20 01:01:58 Lubuntu kernel: [142653.121708] [ 1224]     0  1224     1158      211   1       0             0 getty
Dec 20 01:01:58 Lubuntu kernel: [142653.121711] [ 1241]     0  1241      544      163   1       0             0 acpid
Dec 20 01:01:58 Lubuntu kernel: [142653.121714] [ 1242]     0  1242     8529     7790   3       0             0 lightdm
Dec 20 01:01:58 Lubuntu kernel: [142653.121717] [ 1252]     0  1252      955      160   3       0             0 irqbalance
Dec 20 01:01:58 Lubuntu kernel: [142653.121720] [ 1261]     0  1261      655      228   3       0             0 cron
Dec 20 01:01:58 Lubuntu kernel: [142653.121723] [ 1262]     0  1262      619       31   1       0             0 atd
Dec 20 01:01:58 Lubuntu kernel: [142653.121725] [ 1265]   107  1265     6483     1119   1       0             0 whoopsie
Dec 20 01:01:58 Lubuntu kernel: [142653.121729] [ 1277]   116  1277    80506    40846   1       0             0 mysqld
Dec 20 01:01:58 Lubuntu kernel: [142653.121731] [ 1327]   103  1327     8876     1018   3       0             0 colord
Dec 20 01:01:58 Lubuntu kernel: [142653.121735] [ 1392]     0  1392    25298     3293   1       0             0 Xorg
Dec 20 01:01:58 Lubuntu kernel: [142653.121738] [ 1608]   117  1608     1938      252   0       0             0 exim4
Dec 20 01:01:58 Lubuntu kernel: [142653.121740] [ 1670]     0  1670     5870     1056   1       0             0 lightdm
Dec 20 01:01:58 Lubuntu kernel: [142653.121743] [ 1673]     0  1673     6183      782   0       0             0 accounts-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121746] [ 1693]     0  1693     8603      889   0       0             0 console-kit-dae
Dec 20 01:01:58 Lubuntu kernel: [142653.121749] [ 1780]   105  1780      558      137   3       0             0 lightdm-greeter
Dec 20 01:01:58 Lubuntu kernel: [142653.121752] [ 1785]   105  1785      845      254   2       0             0 dbus-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121755] [ 1786]   105  1786    27032     3122   2       0             0 lightdm-gtk-gre
Dec 20 01:01:58 Lubuntu kernel: [142653.121758] [ 1788]   105  1788    11091      737   1       0             0 at-spi-bus-laun
Dec 20 01:01:58 Lubuntu kernel: [142653.121761] [ 1792]   105  1792      812      357   1       0             0 dbus-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121764] [ 1795]   105  1795     4272      749   3       0             0 at-spi2-registr
Dec 20 01:01:58 Lubuntu kernel: [142653.121767] [ 1804]   105  1804     6687      656   2       0             0 gvfsd
Dec 20 01:01:58 Lubuntu kernel: [142653.121770] [ 1808]   105  1808    10691      748   2       0             0 gvfsd-fuse
Dec 20 01:01:58 Lubuntu kernel: [142653.121773] [ 1816]     0  1816     7163      926   0       0             0 upowerd
Dec 20 01:01:58 Lubuntu kernel: [142653.121775] [ 1976]     0  1976      640      237   1       0             0 hddtemp
Dec 20 01:01:58 Lubuntu kernel: [142653.121779] [ 2188]     0  2188    10280     1878   2       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121782] [ 2226]    33  2226    10340     1319   0       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121784] [ 2227]    33  2227    10340     1335   1       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121787] [ 2228]    33  2228    10296     1301   3       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121790] [ 2229]    33  2229    10296     1301   1       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121793] [ 2230]    33  2230    10340     1323   2       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121796] [ 2275]     0  2275     1158      209   2       0             0 getty
Dec 20 01:01:58 Lubuntu kernel: [142653.121799] [ 2562]   106  2562     1439      505   3       0             0 ntpd
Dec 20 01:01:58 Lubuntu kernel: [142653.121802] [ 2567]     0  2567     3533      781   1       0             0 lightdm
Dec 20 01:01:58 Lubuntu kernel: [142653.121804] [ 2572]    33  2572    10340     1329   0       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121807] [ 2573]    33  2573    10340     1320   0       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121810] [ 2574]    33  2574    10340     1319   0       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121813] [ 2832]   113  2832     1675      730   1       0             0 nxssh
Dec 20 01:01:58 Lubuntu kernel: [142653.121816] [ 2833]     0  2833     4257     1087   0       0             0 sshd
Dec 20 01:01:58 Lubuntu kernel: [142653.121819] [ 2934]  1000  2934     4257      457   1       0             0 sshd
Dec 20 01:01:58 Lubuntu kernel: [142653.121822] [ 2935]  1000  2935     3734     3226   1       0             0 nxnode
Dec 20 01:01:58 Lubuntu kernel: [142653.121825] [ 2959]  1000  2959    36002    26402   2       0             0 nxagent
Dec 20 01:01:58 Lubuntu kernel: [142653.121828] [ 2961]   113  2961     5200     2747   3       0             0 nxserver
Dec 20 01:01:58 Lubuntu kernel: [142653.121831] [ 2964]  1000  2964     3767     2017   1       0             0 nxnode
Dec 20 01:01:58 Lubuntu kernel: [142653.121833] [ 2974]  1000  2974    12069     1414   1       0             0 lxsession
Dec 20 01:01:58 Lubuntu kernel: [142653.121836] [ 2977]  1000  2977     4482     1937   0       0             0 openbox
Dec 20 01:01:58 Lubuntu kernel: [142653.121839] [ 2982]  1000  2982    48577     3282   0       0             0 lxpanel
Dec 20 01:01:58 Lubuntu kernel: [142653.121842] [ 2983]  1000  2983     1875      592   0       0             0 xscreensaver
Dec 20 01:01:58 Lubuntu kernel: [142653.121845] [ 2985]  1000  2985    31394     3145   2       0             0 pcmanfm
Dec 20 01:01:58 Lubuntu kernel: [142653.121848] [ 2986]  1000  2986     7310     1356   2       0             0 polkit-gnome-au
Dec 20 01:01:58 Lubuntu kernel: [142653.121850] [ 2990]  1000  2990      961      139   2       0             0 dbus-launch
Dec 20 01:01:58 Lubuntu kernel: [142653.121854] [ 2991]  1000  2991      938      308   2       0             0 dbus-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121856] [ 2993]  1000  2993    11092      736   2       0             0 at-spi-bus-laun
Dec 20 01:01:58 Lubuntu kernel: [142653.121859] [ 2994]  1000  2994     7349     1041   0       0             0 xfce4-power-man
Dec 20 01:01:58 Lubuntu kernel: [142653.121862] [ 3001]  1000  3001    12608     2707   1       0             0 update-notifier
Dec 20 01:01:58 Lubuntu kernel: [142653.121865] [ 3005]  1000  3005      812      357   1       0             0 dbus-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121868] [ 3011]  1000  3011    50324     3472   2       0             0 nm-applet
Dec 20 01:01:58 Lubuntu kernel: [142653.121870] [ 3016]  1000  3016     4273      763   0       0             0 at-spi2-registr
Dec 20 01:01:58 Lubuntu kernel: [142653.121873] [ 3019]  1000  3019     1627      597   2       0             0 xfconfd
Dec 20 01:01:58 Lubuntu kernel: [142653.121876] [ 3031]  1000  3031     1487      456   3       0             0 menu-cached
Dec 20 01:01:58 Lubuntu kernel: [142653.121880] [ 3042]  1000  3042     2204      579   0       0             0 gconfd-2
Dec 20 01:01:58 Lubuntu kernel: [142653.121882] [ 3046]  1000  3046    22131      893   3       0             0 pulseaudio
Dec 20 01:01:58 Lubuntu kernel: [142653.121886] [ 3048]   115  3048     5334      315   1       0             0 rtkit-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121888] [ 3069]  1000  3069    11507     1082   2       0             0 indicator-appli
Dec 20 01:01:58 Lubuntu kernel: [142653.121891] [ 3274]  1000  3274     8400      613   0       0             0 dconf-service
Dec 20 01:01:58 Lubuntu kernel: [142653.121894] [ 3305]  1000  3305     4970     1243   3       0             0 VBoxXPCOMIPCD
Dec 20 01:01:58 Lubuntu kernel: [142653.121897] [ 3310]  1000  3310    10332     2611   1       0             0 VBoxSVC
Dec 20 01:01:58 Lubuntu kernel: [142653.121900] [ 3356]  1000  3356    34122     4071   3       0             0 truecrypt
Dec 20 01:01:58 Lubuntu kernel: [142653.121903] [ 3357]  1000  3357     8258      520   1       0             0 truecrypt
Dec 20 01:01:58 Lubuntu kernel: [142653.121905] [ 3373]     0  3373     6216      715   3       0             0 truecrypt
Dec 20 01:01:58 Lubuntu kernel: [142653.121908] [ 3377]     0  3377     6216      332   3       0             0 truecrypt
Dec 20 01:01:58 Lubuntu kernel: [142653.121911] [ 3379]     0  3379    40907      465   3       0             0 truecrypt
Dec 20 01:01:58 Lubuntu kernel: [142653.121915] [ 3419]     0  3419     6216      334   3       0             0 truecrypt
Dec 20 01:01:58 Lubuntu kernel: [142653.121918] [ 3421]     0  3421    39029      496   2       0             0 truecrypt
Dec 20 01:01:58 Lubuntu kernel: [142653.121922] [ 3444]  1000  3444   331341   284523   3       0             0 VirtualBox
Dec 20 01:01:58 Lubuntu kernel: [142653.121924] [ 3991]  1000  3991   345903   282194   1       0             0 VirtualBox
Dec 20 01:01:58 Lubuntu kernel: [142653.121927] [ 4395]     0  4395    17967     1184   2       0             0 udisksd
Dec 20 01:01:58 Lubuntu kernel: [142653.121930] [ 4872]    33  4872    10296     1302   2       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121933] [ 5576]     0  5576     5964     1019   2       0             0 smbd
Dec 20 01:01:58 Lubuntu kernel: [142653.121936] [ 5646]     0  5646     4272     1113   0       0             0 sshd
Dec 20 01:01:58 Lubuntu kernel: [142653.121939] [ 5826]   113  5826     4309      491   2       0             0 sshd
Dec 20 01:01:58 Lubuntu kernel: [142653.121942] [ 5827]   113  5827     5169     4672   2       0             0 nxserver
Dec 20 01:01:58 Lubuntu kernel: [142653.121944] [ 6057]   113  6057     1675      567   0       0             0 nxssh
Dec 20 01:01:58 Lubuntu kernel: [142653.121947] [ 6139]    33  6139    10340     1299   0       0             0 apache2
Dec 20 01:01:58 Lubuntu kernel: [142653.121950] [ 6162]  1000  6162     1303      299   0       0             0 su-to-root
Dec 20 01:01:58 Lubuntu kernel: [142653.121953] [ 6168]  1000  6168    24381     2066   0       0             0 gksu
Dec 20 01:01:58 Lubuntu kernel: [142653.121956] [ 6175]     0  6175      961       85   1       0             0 dbus-launch
Dec 20 01:01:58 Lubuntu kernel: [142653.121958] [ 6176]     0  6176      842      169   2       0             0 dbus-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121961] [ 6185]     0  6185    14470     1015   0       0             0 kdeinit4
Dec 20 01:01:58 Lubuntu kernel: [142653.121964] [ 6186]     0  6186    16613     1439   0       0             0 klauncher
Dec 20 01:01:58 Lubuntu kernel: [142653.121967] [ 6189]     0  6189    18512     1834   0       0             0 kded4
Dec 20 01:01:58 Lubuntu kernel: [142653.121970] [ 6197]     0  6197     6351      837   3       0             0 udisks-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121973] [ 6198]     0  6198     1655      108   2       0             0 udisks-daemon
Dec 20 01:01:58 Lubuntu kernel: [142653.121976] [ 6213]     0  6213    22899     1784   2       0             0 kactivitymanage
Dec 20 01:01:58 Lubuntu kernel: [142653.121979] [ 6262]  1000  6262    26641     2961   0       0             0 lxterminal
Dec 20 01:01:58 Lubuntu kernel: [142653.121981] [ 6263]  1000  6263      601      182   1       0             0 gnome-pty-helpe
Dec 20 01:01:58 Lubuntu kernel: [142653.121984] [ 6264]  1000  6264     1558      664   2       0             0 bash
Dec 20 01:01:58 Lubuntu kernel: [142653.121987] [ 7259]     0  7259     5957      972   2       0             0 smbd
Dec 20 01:01:58 Lubuntu kernel: [142653.121990] [24575]     0 24575     5954     1194   3       0             0 smbd
Dec 20 01:01:58 Lubuntu kernel: [142653.121993] [24843]     0 24843     5991     1142   2       0             0 smbd
Dec 20 01:01:58 Lubuntu kernel: [142653.121996] [25240]     0 25240    18206     2749   0       0             0 kuiserver
Dec 20 01:01:58 Lubuntu kernel: [142653.122000] [27635]     0 27635     2684      597   3       0             0 cron
Dec 20 01:01:58 Lubuntu kernel: [142653.122003] [27636]     0 27636      558      137   3       0             0 sh
Dec 20 01:01:58 Lubuntu kernel: [142653.122006] [27637]     0 27637      558      136   0       0             0 backintime
Dec 20 01:01:58 Lubuntu kernel: [142653.122009] [27638]     0 27638   114984   113351   1       0             0 python
Dec 20 01:01:58 Lubuntu kernel: [142653.122014] [ 3194]     0  3194      558      137   0       0             0 sh
Dec 20 01:01:58 Lubuntu kernel: [142653.122017] [ 3195]     0  3195     1244      324   0       0             0 chmod
Dec 20 01:01:58 Lubuntu kernel: [142653.122019] Out of memory: Kill process 3444 (VirtualBox) score 139 or sacrifice child
Dec 20 01:01:58 Lubuntu kernel: [142653.122025] Killed process 3444 (VirtualBox) total-vm:1325364kB, anon-rss:19736kB, file-rss:1118356kB

这种情况一直持续,服务器完全冻结。它运行的是 Lubuntu 12.10 32 位

答案1

OOM 日志显示它在遇到内存不足情况时发现哪些进程正在运行,以及它尝试终止哪些进程。请参阅以以下标题开头的表格:

 [ pid ]   uid  tgid total_vm      rss cpu oom_adj oom_score_adj name

total_vm 是显示进程的总映射内存(RAM + Swap)的列 - 我注意到大进程是 VirtualBox(x2)和 python(pid == 27638)。

我假设您了解 VirtualBox,但有必要找出那个 python 进程是什么。可能是脚本出了问题?监控添加文件的东西?某种查找新文件的媒体扫描器(例如 plex、rygel 或类似服务器?)还是您的备份管理器?

跟踪内存使用情况的最简单方法(但严格来说是在线/交互的)是使用top并按内存排序(按 M - 大写 M,即 shift-M)。第一个内存行还会告诉您操作系统认为您有多少物理 RAM“Mem:”,如果您认为由于 32 位问题而缺少一些 RAM,这将非常有用。

您可以编写某种监控脚本,尽管我暂时还不知道有什么好办法。首先,我有:

top -n 1 -b | sed '1,/^$/d' | sort -r -n -k10

这将转储顶部输出,修剪标题直到空白行(从 1 到“^$”),然后按第 10 列(对我来说是内存百分比)以反向数字顺序对输出进行排序。定期运行该程序并将其转储到文件可能会有所帮助。

相关内容