Trace number 3321892

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 7215.06 913.115

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v40000-c168000-S386300535-065-UNKNOWN.cnf
MD5SUM2ca6073d25d8d5f2648d590c0edc75c0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1217.09
Satisfiable
(Un)Satisfiability was proved
Number of variables40000
Number of clauses168000
Sum of the clauses size504000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3168000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.34/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.67	c INFO: solving HOME/instance-3321892-1304369118.cnf
0.34/0.67	c INFO: computing task features
0.92/1.26	c INFO: computed variable-clause graph statistics
0.92/1.28	c INFO: computed clause balance statistics
3.92/4.26	c INFO: computed variable balance statistics
6.33/6.65	c INFO: computed small-clause counts
6.33/6.66	c INFO: computed Horn-clause counts
8.32/8.67	c INFO: computed variable graph statistics
8.32/8.67	c INFO: collected features for HOME/instance-3321892-1304369118.cnf in 7.98 s
8.42/8.71	c INFO: running hybridGM3@0 for 97 with 39991 remaining (b = 0.35)
8.42/8.75	c INFO: running hybridGM3@0 for 97 with 39991 remaining (b = 0.21)
8.42/8.79	c INFO: running hybridGM3@0 for 97 with 39991 remaining (b = 0.14)
8.52/8.83	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.18)
8.52/8.87	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.13)
8.62/8.91	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.10)
8.62/8.95	c INFO: running TNM@0 for 97 with 39991 remaining (b = 0.04)
8.62/9.00	c INFO: running hybridGM3@0 for 194 with 39991 remaining (b = 0.07)
794.88/107.36	c INFO: running hybridGM3@0 for 97 with 39893 remaining (b = 0.03)
803.68/108.44	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
809.97/109.22	c INFO: running hybridGM3@0 for 194 with 39891 remaining (b = 0.05)
811.41/109.41	c INFO: running hybridGM3@0 for 97 with 39891 remaining (b = 0.02)
1563.34/203.68	c INFO: running hybridGM3@99 for 97 with 39797 remaining (b = 0.02)
1571.42/204.64	c INFO: running hybridGM3@94 for 97 with 39796 remaining (b = 0.02)
1579.35/205.68	c INFO: running hybridGM3@0 for 97 with 39795 remaining (b = 0.02)
1580.14/205.74	c INFO: running hybridGM3@0 for 97 with 39794 remaining (b = 0.02)
1580.14/205.78	c INFO: running hybridGM3@0 for 97 with 39794 remaining (b = 0.02)
1580.81/205.88	c INFO: running hybridGM3@98 for 97 with 39794 remaining (b = 0.03)
1595.15/207.62	c INFO: running hybridGM3@99 for 97 with 39793 remaining (b = 0.03)
2339.76/300.98	c INFO: running hybridGM3@0 for 194 with 39699 remaining (b = 0.04)
2340.52/301.03	c INFO: running hybridGM3@0 for 194 with 39699 remaining (b = 0.03)
2341.16/301.12	c INFO: running hybridGM3@0 for 194 with 39699 remaining (b = 0.03)
2371.62/304.93	c INFO: running TNM@0 for 1940 with 39695 remaining (b = 0.21)
2378.83/305.90	c INFO: running TNM@0 for 97 with 39694 remaining (b = 0.01)
2380.93/306.15	c INFO: running hybridGM3@100 for 97 with 39694 remaining (b = 0.01)
2387.56/306.98	c INFO: running hybridGM3@0 for 194 with 39693 remaining (b = 0.02)
2393.81/307.90	c INFO: running adaptg2wsat2009++@0 for 97 with 39692 remaining (b = 0.01)
3178.83/406.19	c INFO: running TNM@0 for 97 with 39594 remaining (b = 0.01)
3189.17/407.43	c INFO: running hybridGM3@0 for 194 with 39593 remaining (b = 0.02)
3195.53/408.21	c INFO: running adaptg2wsat2009++@100 for 97 with 39592 remaining (b = 0.01)
3910.49/497.90	c INFO: running hybridGM3@94 for 97 with 39502 remaining (b = 0.01)
3911.27/498.02	c INFO: running hybridGM3@95 for 97 with 39502 remaining (b = 0.01)
3911.27/498.09	c INFO: running hybridGM3@100 for 97 with 39502 remaining (b = 0.01)
3954.28/503.49	c INFO: running hybridGM3@0 for 194 with 39497 remaining (b = 0.02)
3959.04/504.05	c INFO: running hybridGM3@98 for 97 with 39496 remaining (b = 0.01)
4018.86/511.52	c INFO: running TNM@0 for 97 with 39489 remaining (b = 0.01)
4670.77/593.30	c INFO: running hybridGM3@291 for 97 with 39407 remaining (b = 0.01)
4670.77/593.38	c INFO: running hybridGM3@0 for 194 with 39407 remaining (b = 0.01)
4716.96/599.20	c INFO: running hybridGM3@291 for 194 with 39401 remaining (b = 0.02)
4759.20/604.50	c INFO: running TNM@0 for 97 with 39396 remaining (b = 0.01)
4766.33/605.36	c INFO: running hybridGM3@98 for 97 with 39395 remaining (b = 0.01)
4818.17/611.83	c INFO: running TNM@0 for 97 with 39388 remaining (b = 0.01)
5477.83/694.61	c INFO: running hybridGM3@387 for 194 with 39306 remaining (b = 0.02)
5524.85/700.51	c INFO: running adaptg2wsat2009++@296 for 291 with 39300 remaining (b = 0.02)
5573.38/706.66	c INFO: running TNM@0 for 97 with 39294 remaining (b = 0.01)
5606.80/710.83	c INFO: running TNM@0 for 97 with 39289 remaining (b = 0.01)
5617.13/712.17	c INFO: running TNM@0 for 97 with 39288 remaining (b = 0.01)
6239.60/790.39	c INFO: running hybridGM3@100 for 97 with 39210 remaining (b = 0.01)
6242.76/790.71	c INFO: running TNM@0 for 97 with 39210 remaining (b = 0.01)
6371.71/807.00	c INFO: running TNM@0 for 97 with 39193 remaining (b = 0.01)
6405.10/811.17	c INFO: running TNM@0 for 97 with 39189 remaining (b = 0.01)
6407.96/811.56	c INFO: running TNM@0 for 97 with 39189 remaining (b = 0.01)
6998.82/885.72	c INFO: running hybridGM3@291 for 194 with 39115 remaining (b = 0.01)
7001.96/886.15	c INFO: running TNM@0 for 97 with 39114 remaining (b = 0.01)
7088.59/897.08	c INFO: running TNM@0 for 97 with 39103 remaining (b = 0.01)
7162.56/906.37	c INFO: running TNM@0 for 97 with 39094 remaining (b = 0.01)
7204.61/911.65	c INFO: running TNM@0 for 97 with 39089 remaining (b = 0.01)
7207.05/911.92	c INFO: running TNM@0 for 97 with 39088 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321892-1304369118/watcher-3321892-1304369118 -o /tmp/evaluation-result-3321892-1304369118/solver-3321892-1304369118 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321892-1304369118.cnf -seed 1112615086 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.16 8.18 7.67 1/277 1018
/proc/meminfo: memFree=15065308/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=15216 CPUtime=0 cores=0-7
/proc/1018/stat : 1018 (python) R 1016 1018 32572 0 -1 4202496 660 0 0 0 0 0 0 0 22 0 1 0 548512260 15581184 555 33554432000 4194304 5683644 140733708475248 18446744073709551615 5288080 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1018/statm: 3804 555 314 364 0 291 0

[startup+0.0637479 s]
/proc/loadavg: 8.16 8.18 7.67 1/277 1018
/proc/meminfo: memFree=15065308/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=29792 CPUtime=0.04 cores=0-7
/proc/1018/stat : 1018 (python) S 1016 1018 32572 0 -1 4202496 1461 0 0 0 3 1 0 0 22 0 1 0 548512260 30507008 1300 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/1018/statm: 7448 1300 443 364 0 818 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29792

[startup+0.100713 s]
/proc/loadavg: 8.16 8.18 7.67 1/277 1018
/proc/meminfo: memFree=15065308/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=87708 CPUtime=0.05 cores=0-7
/proc/1018/stat : 1018 (python) S 1016 1018 32572 0 -1 4202496 2639 0 0 0 4 1 0 0 17 0 1 0 548512260 89812992 2354 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/1018/statm: 21927 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87708

[startup+0.300711 s]
/proc/loadavg: 8.16 8.18 7.67 1/277 1018
/proc/meminfo: memFree=15065308/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=135752 CPUtime=0.18 cores=0-7
/proc/1018/stat : 1018 (python) S 1016 1018 32572 0 -1 4202496 5964 935 1 0 13 5 0 0 17 0 1 0 548512260 139010048 4151 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809161733 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/1018/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700641 s]
/proc/loadavg: 8.16 8.18 7.67 1/277 1018
/proc/meminfo: memFree=15065308/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=283276 CPUtime=0.42 cores=0-7
/proc/1018/stat : 1018 (python) R 1016 1018 32572 0 -1 4202496 10462 935 1 0 30 12 0 0 16 0 1 0 548512260 290074624 8144 33554432000 4194304 5683644 140733708475248 18446744073709551615 4619696 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1018/statm: 70819 8144 1761 364 0 6743 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 283276

[startup+1.50049 s]
/proc/loadavg: 8.16 8.18 7.67 2/278 1023
/proc/meminfo: memFree=15020164/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=317988 CPUtime=1.22 cores=0-7
/proc/1018/stat : 1018 (python) R 1016 1018 32572 0 -1 4202496 23797 935 1 0 108 14 0 0 17 0 1 0 548512260 325619712 16881 33554432000 4194304 5683644 140733708475248 18446744073709551615 4418296 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1018/statm: 79497 16881 1826 364 0 15421 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 317988

[startup+3.10016 s]
/proc/loadavg: 7.58 8.06 7.63 2/278 1023
/proc/meminfo: memFree=15003796/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=317988 CPUtime=2.82 cores=0-7
/proc/1018/stat : 1018 (python) R 1016 1018 32572 0 -1 4202496 23797 935 1 0 268 14 0 0 19 0 1 0 548512260 325619712 16881 33554432000 4194304 5683644 140733708475248 18446744073709551615 5003942 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1018/statm: 79497 16881 1826 364 0 15421 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 317988

[startup+6.30058 s]
/proc/loadavg: 7.58 8.06 7.63 2/278 1023
/proc/meminfo: memFree=15004696/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=317988 CPUtime=6.02 cores=0-7
/proc/1018/stat : 1018 (python) R 1016 1018 32572 0 -1 4202496 23798 935 1 0 588 14 0 0 25 0 1 0 548512260 325619712 16882 33554432000 4194304 5683644 140733708475248 18446744073709551615 4500491 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1018/statm: 79497 16882 1827 364 0 15421 0
Current children cumulated CPU time (s) 6.02
Current children cumulated vsize (KiB) 317988

[startup+12.7014 s]
/proc/loadavg: 7.13 7.95 7.60 9/302 1047
/proc/meminfo: memFree=14714768/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=396920 CPUtime=8.71 cores=0-7
/proc/1018/stat : 1018 (python) S 1016 1018 32572 0 -1 4202496 30582 935 1 0 854 17 0 0 24 0 9 0 548512260 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1018/statm: 99230 16194 1889 364 0 35127 0
[pid=1024] ppid=1018 vsize=314884 CPUtime=0 cores=0-7
/proc/1024/stat : 1024 (python) S 1018 1018 32572 0 -1 4202560 739 0 0 0 0 0 0 0 15 0 1 0 548513131 322441216 14626 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185807 0 0 16781312 514 17394643391618187523 0 0 17 7 0 0 0
/proc/1024/statm: 78721 14626 353 364 0 14639 0
[pid=1026] ppid=1024 vsize=276236 CPUtime=3.97 cores=0-7
/proc/1026/stat : 1026 (hybridGM3) R 1024 1026 1026 0 -1 4202496 8560 0 0 0 396 1 0 0 25 0 1 0 548513131 282865664 8297 33554432000 134512640 135204385 4290948848 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1026/statm: 69059 8297 64 169 0 68889 0
[pid=1027] ppid=1018 vsize=325140 CPUtime=0 cores=0-7
/proc/1027/stat : 1027 (python) S 1018 1018 32572 0 -1 4202560 736 0 0 0 0 0 0 0 15 0 1 0 548513135 332943360 14624 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 15026642791063060743 0 0 17 2 0 0 0
/proc/1027/statm: 81285 14624 347 364 0 17200 0
[pid=1029] ppid=1027 vsize=276236 CPUtime=3.94 cores=0-7
/proc/1029/stat : 1029 (hybridGM3) R 1027 1029 1029 0 -1 4202496 8561 0 0 0 393 1 0 0 25 0 1 0 548513135 282865664 8298 33554432000 134512640 135204385 4287904560 18446744073709551615 134536737 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1029/statm: 69059 8298 64 169 0 68889 0
[pid=1030] ppid=1018 vsize=335396 CPUtime=0 cores=0-7
/proc/1030/stat : 1030 (python) S 1018 1018 32572 0 -1 4202560 748 0 0 0 0 0 0 0 15 0 1 0 548513139 343445504 14628 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 9741013319413629186 0 0 17 7 0 0 0
/proc/1030/statm: 83849 14628 347 364 0 19761 0
[pid=1032] ppid=1030 vsize=276236 CPUtime=3.89 cores=0-7
/proc/1032/stat : 1032 (hybridGM3) R 1030 1032 1032 0 -1 4202496 8565 0 0 0 388 1 0 0 25 0 1 0 548513139 282865664 8300 33554432000 134512640 135204385 4289139216 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1032/statm: 69059 8300 64 169 0 68889 0
[pid=1033] ppid=1018 vsize=345652 CPUtime=0 cores=0-7
/proc/1033/stat : 1033 (python) S 1018 1018 32572 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 548513143 353947648 14632 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 7239897045106917633 0 0 17 2 0 0 0
/proc/1033/statm: 86413 14632 347 364 0 22322 0
[pid=1035] ppid=1033 vsize=276240 CPUtime=3.82 cores=0-7
/proc/1035/stat : 1035 (hybridGM3) R 1033 1035 1035 0 -1 4202496 8562 0 0 0 381 1 0 0 25 0 1 0 548513144 282869760 8299 33554432000 134512640 135204385 4293357616 18446744073709551615 134537143 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1035/statm: 69060 8299 64 169 0 68890 0
[pid=1036] ppid=1018 vsize=355908 CPUtime=0 cores=0-7
/proc/1036/stat : 1036 (python) S 1018 1018 32572 0 -1 4202560 761 0 0 0 0 0 0 0 15 0 1 0 548513147 364449792 14636 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 13402008807907754242 0 0 17 0 0 0 0
/proc/1036/statm: 88977 14636 347 364 0 24883 0
[pid=1038] ppid=1036 vsize=276236 CPUtime=3.81 cores=0-7
/proc/1038/stat : 1038 (hybridGM3) R 1036 1038 1038 0 -1 4202496 8562 0 0 0 380 1 0 0 25 0 1 0 548513148 282865664 8297 33554432000 134512640 135204385 4287067328 18446744073709551615 134547654 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1038/statm: 69059 8297 64 169 0 68889 0
[pid=1039] ppid=1018 vsize=366164 CPUtime=0 cores=0-7
/proc/1039/stat : 1039 (python) S 1018 1018 32572 0 -1 4202560 766 0 0 0 0 0 0 0 15 0 1 0 548513151 374951936 14640 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 4525070894732640513 0 0 17 6 0 0 0
/proc/1039/statm: 91541 14640 347 364 0 27444 0
[pid=1041] ppid=1039 vsize=276236 CPUtime=3.76 cores=0-7
/proc/1041/stat : 1041 (hybridGM3) R 1039 1041 1041 0 -1 4202496 8565 0 0 0 375 1 0 0 25 0 1 0 548513152 282865664 8300 33554432000 134512640 135204385 4286801056 18446744073709551615 134547654 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1041/statm: 69059 8300 64 169 0 68889 0
[pid=1042] ppid=1018 vsize=376420 CPUtime=0 cores=0-7
/proc/1042/stat : 1042 (python) S 1018 1018 32572 0 -1 4202560 764 0 0 0 0 0 0 0 18 0 1 0 548513155 385454080 14644 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 15414457309731979524 0 0 17 0 0 0 0
/proc/1042/statm: 94105 14644 347 364 0 30005 0
[pid=1044] ppid=1042 vsize=467024 CPUtime=3.71 cores=0-7
/proc/1044/stat : 1044 (TNM) R 1042 1044 1044 0 -1 4202496 6823 0 0 0 370 1 0 0 25 0 1 0 548513156 478232576 6558 33554432000 134512640 135008748 4289941776 18446744073709551615 134527795 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1044/statm: 116756 6558 46 122 0 115656 0
[pid=1045] ppid=1018 vsize=386676 CPUtime=0 cores=0-7
/proc/1045/stat : 1045 (python) S 1018 1018 32572 0 -1 4202560 813 0 0 0 0 0 0 0 15 0 1 0 548513160 395956224 14654 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 7668403114730291458 0 0 17 6 0 0 0
/proc/1045/statm: 96669 14654 353 364 0 32566 0
[pid=1047] ppid=1045 vsize=276240 CPUtime=3.66 cores=0-7
/proc/1047/stat : 1047 (hybridGM3) R 1045 1047 1047 0 -1 4202496 8571 0 0 0 365 1 0 0 25 0 1 0 548513160 282869760 8300 33554432000 134512640 135204385 4289203360 18446744073709551615 134537249 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1047/statm: 69060 8300 64 169 0 68890 0
[pid=1018/tid=1025] ppid=1016 vsize=396920 CPUtime=0 cores=0-7
/proc/1018/task/1025/stat : 1025 (python) S 1016 1018 32572 0 -1 4202560 26 935 0 0 0 0 0 0 25 0 9 0 548513131 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1028] ppid=1016 vsize=396920 CPUtime=0 cores=0-7
/proc/1018/task/1028/stat : 1028 (python) S 1016 1018 32572 0 -1 4202560 27 935 0 0 0 0 0 0 25 0 9 0 548513135 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1031] ppid=1016 vsize=396920 CPUtime=0 cores=0-7
/proc/1018/task/1031/stat : 1031 (python) S 1016 1018 32572 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 9 0 548513139 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1034] ppid=1016 vsize=396920 CPUtime=0 cores=0-7
/proc/1018/task/1034/stat : 1034 (python) S 1016 1018 32572 0 -1 4202560 26 935 0 0 0 0 0 0 25 0 9 0 548513143 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1037] ppid=1016 vsize=396920 CPUtime=0 cores=0-7
/proc/1018/task/1037/stat : 1037 (python) S 1016 1018 32572 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 548513148 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 0 0 0 0
[pid=1018/tid=1040] ppid=1016 vsize=396920 CPUtime=0 cores=0-7
/proc/1018/task/1040/stat : 1040 (python) S 1016 1018 32572 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 548513152 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1043] ppid=1016 vsize=396920 CPUtime=0 cores=0-7
/proc/1018/task/1043/stat : 1043 (python) S 1016 1018 32572 0 -1 4202560 30 935 0 0 0 0 0 0 22 0 9 0 548513156 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 0 0 0 0
[pid=1018/tid=1046] ppid=1016 vsize=396920 CPUtime=0 cores=0-7
/proc/1018/task/1046/stat : 1046 (python) S 1016 1018 32572 0 -1 4202560 31 935 0 0 0 0 0 0 24 0 9 0 548513160 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39.27
Current children cumulated vsize (KiB) 5603844

[startup+25.501 s]
/proc/loadavg: 7.27 7.95 7.60 10/302 1048
/proc/meminfo: memFree=14714480/32951124 swapFree=59766108/67111528
[pid=1018] ppid=1016 vsize=396920 CPUtime=8.71 cores=0-7
/proc/1018/stat : 1018 (python) S 1016 1018 32572 0 -1 4202496 30582 935 1 0 854 17 0 0 24 0 9 0 548512260 406446080 16194 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1018/statm: 99230 16194 1889 364 0 35127 0
[pid=1024] ppid=1018 vsize=314884 CPUtime=0.03 cores=0-7
/proc/1024/stat : 1024 (python) S 1018 1018 32572 0 -1 4202560 903 0 0 0 2 1 0 0 15 0 1 0 548513131 322441216 14649 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185807 0 0 16781312 514 12354763560574746883 0 0 17 7 0 0 0
/proc/1024/statm: 78721 14649 376 364 0 14639 0
[pid=1026] ppid=1024 vsize=276236 CPUtime=16.77 cores=0-7
/proc/1026/stat : 1026 (hybridGM3) R 1024 1026 1026 0 -1 4202496 8563 0 0 0 1676 1 0 0 25 0 1 0 548513131 282865664 8300 33554432000 134512640 135204385 4290948848 18446744073709551615 134537483 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1026/statm: 69059 8300 64 169 0 68889 0
[pid=1027] ppid=1018 vsize=325140 CPUtime=0.03 cores=0-7
/proc/1027/stat : 1027 (python) S 1018 1018 32572 0 -1 4202560 903 0 0 0 1 2 0 0 15 0 1 0 548513135 332943360 14647 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 12354763560574746887 0 0 17 2 0 0 0
/proc/1027/statm: 81285 14647 370 364 0 17200 0
[pid=1029] ppid=1027 vsize=276236 CPUtime=16.66 cores=0-7
/proc/1029/stat : 1029 (hybridGM3) R 1027 1029 1029 0 -1 4202496 8561 0 0 0 1665 1 0 0 25 0 1 0 548513135 282865664 8298 33554432000 134512640 135204385 4287904560 18446744073709551615 134546144 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1029/statm: 69059 8298 64 169 0 68889 0
[pid=1030] ppid=1018 vsize=335396 CPUtime=0.04 cores=0-7
/proc/1030/stat : 1030 (python) S 1018 1018 32572 0 -1 4202560 927 0 0 0 2 2 0 0 15 0 1 0 548513139 343445504 14651 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 12354763560574746882 0 0 17 7 0 0 0
/proc/1030/statm: 83849 14651 370 364 0 19761 0
[pid=1032] ppid=1030 vsize=276236 CPUtime=16.69 cores=0-7
/proc/1032/stat : 1032 (hybridGM3) R 1030 1032 1032 0 -1 4202496 8565 0 0 0 1668 1 0 0 25 0 1 0 548513139 282865664 8300 33554432000 134512640 135204385 4289139216 18446744073709551615 134546082 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1032/statm: 69059 8300 64 169 0 68889 0
[pid=1033] ppid=1018 vsize=345652 CPUtime=0.03 cores=0-7
/proc/1033/stat : 1033 (python) S 1018 1018 32572 0 -1 4202560 936 0 0 0 1 2 0 0 15 0 1 0 548513143 353947648 14655 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 12354763560574746881 0 0 17 2 0 0 0
/proc/1033/statm: 86413 14655 370 364 0 22322 0
[pid=1035] ppid=1033 vsize=276240 CPUtime=16.38 cores=0-7
/proc/1035/stat : 1035 (hybridGM3) R 1033 1035 1035 0 -1 4202496 8568 0 0 0 1637 1 0 0 25 0 1 0 548513144 282869760 8305 33554432000 134512640 135204385 4293357616 18446744073709551615 134537020 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1035/statm: 69060 8305 64 169 0 68890 0
[pid=1036] ppid=1018 vsize=355908 CPUtime=0.03 cores=0-7
/proc/1036/stat : 1036 (python) S 1018 1018 32572 0 -1 4202560 947 0 0 0 2 1 0 0 16 0 1 0 548513147 364449792 14659 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 12354763560574746882 0 0 17 0 0 0 0
/proc/1036/statm: 88977 14659 370 364 0 24883 0
[pid=1038] ppid=1036 vsize=276236 CPUtime=16.61 cores=0-7
/proc/1038/stat : 1038 (hybridGM3) R 1036 1038 1038 0 -1 4202496 8567 0 0 0 1660 1 0 0 25 0 1 0 548513148 282865664 8302 33554432000 134512640 135204385 4287067328 18446744073709551615 134537565 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1038/statm: 69059 8302 64 169 0 68889 0

################
# More data... #
################

[pid=1128] ppid=1018 vsize=606052 CPUtime=0.23 cores=0-7
/proc/1128/stat : 1128 (python) S 1018 1018 32572 0 -1 4202560 1191 0 0 0 13 10 0 0 19 0 2 0 548582926 620597248 15091 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1128/statm: 151513 15091 407 364 0 87365 0
[pid=1130] ppid=1128 vsize=467024 CPUtime=97.07 cores=0-7
/proc/1130/stat : 1130 (TNM) T 1128 1130 1130 0 -1 4202496 6841 0 0 0 9707 0 0 0 25 0 1 0 548582927 478232576 6557 33554432000 134512640 135008748 4289994736 18446744073709551615 134527444 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/1130/statm: 116756 6557 46 122 0 115656 0
[pid=1128/tid=1146] ppid=1018 vsize=606052 CPUtime=0 cores=0-7
/proc/1128/task/1146/stat : 1146 (python) S 1018 1018 32572 0 -1 4202560 99 0 0 0 0 0 0 0 19 0 2 0 548592950 620597248 15091 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 514 18446604450182242624 0 0 -1 3 0 0 0
[pid=1132] ppid=1018 vsize=616308 CPUtime=0.24 cores=0-7
/proc/1132/stat : 1132 (python) S 1018 1018 32572 0 -1 4202560 1201 0 0 0 13 11 0 0 19 0 2 0 548583344 631099392 15142 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1132/statm: 154077 15142 407 364 0 89926 0
[pid=1134] ppid=1132 vsize=467024 CPUtime=99.99 cores=0-7
/proc/1134/stat : 1134 (TNM) T 1132 1134 1134 0 -1 4202496 6840 0 0 0 9998 1 0 0 25 0 1 0 548583344 478232576 6558 33554432000 134512640 135008748 4286708496 18446744073709551615 134527327 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/1134/statm: 116756 6558 46 122 0 115656 0
[pid=1132/tid=1150] ppid=1018 vsize=616308 CPUtime=0 cores=0-7
/proc/1132/task/1150/stat : 1150 (python) S 1018 1018 32572 0 -1 4202560 98 0 0 0 0 0 0 0 19 0 2 0 548593367 631099392 15142 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 514 18446604450948059328 0 0 -1 4 0 0 0
[pid=1136] ppid=1018 vsize=626564 CPUtime=0.24 cores=0-7
/proc/1136/stat : 1136 (python) S 1018 1018 32572 0 -1 4202560 1251 0 0 0 12 12 0 0 19 0 2 0 548583477 641601536 15035 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1136/statm: 156641 15035 401 364 0 92487 0
[pid=1138] ppid=1136 vsize=467024 CPUtime=99.26 cores=0-7
/proc/1138/stat : 1138 (TNM) T 1136 1138 1138 0 -1 4202496 6846 0 0 0 9924 2 0 0 25 0 1 0 548583478 478232576 6558 33554432000 134512640 135008748 4286872544 18446744073709551615 134529367 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/1138/statm: 116756 6558 46 122 0 115656 0
[pid=1136/tid=1154] ppid=1018 vsize=626564 CPUtime=0 cores=0-7
/proc/1136/task/1154/stat : 1154 (python) S 1018 1018 32572 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 548593405 641601536 15035 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 514 18446604452206682176 0 0 -1 1 0 0 0
[pid=1142] ppid=1018 vsize=636820 CPUtime=0.27 cores=0-7
/proc/1142/stat : 1142 (python) S 1018 1018 32572 0 -1 4202560 1249 0 0 0 15 12 0 0 19 0 2 0 548591331 652103680 15039 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1142/statm: 159205 15039 401 364 0 95048 0
[pid=1144] ppid=1142 vsize=467024 CPUtime=102.27 cores=0-7
/proc/1144/stat : 1144 (TNM) T 1142 1144 1144 0 -1 4202496 6844 0 0 0 10226 1 0 0 25 0 1 0 548591332 478232576 6558 33554432000 134512640 135008748 4290505712 18446744073709551615 134527320 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/1144/statm: 116756 6558 46 122 0 115656 0
[pid=1142/tid=1163] ppid=1018 vsize=636820 CPUtime=0 cores=0-7
/proc/1142/task/1163/stat : 1163 (python) S 1018 1018 32572 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 548601957 652103680 15039 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 514 18446604453934840768 0 0 -1 7 0 0 0
[pid=1147] ppid=1018 vsize=647076 CPUtime=0.25 cores=0-7
/proc/1147/stat : 1147 (python) S 1018 1018 32572 0 -1 4202560 1300 0 0 0 13 12 0 0 19 0 2 0 548592960 662605824 15148 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1147/statm: 161769 15148 401 364 0 97609 0
[pid=1149] ppid=1147 vsize=467024 CPUtime=99.18 cores=0-7
/proc/1149/stat : 1149 (TNM) T 1147 1149 1149 0 -1 4202496 6842 0 0 0 9917 1 0 0 25 0 1 0 548592961 478232576 6559 33554432000 134512640 135008748 4294456560 18446744073709551615 134527795 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/1149/statm: 116756 6559 46 122 0 115656 0
[pid=1147/tid=1167] ppid=1018 vsize=647076 CPUtime=0 cores=0-7
/proc/1147/task/1167/stat : 1167 (python) S 1018 1018 32572 0 -1 4202560 219 0 0 0 0 0 0 0 19 0 2 0 548602886 662605824 15148 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 514 18446604453865371776 0 0 -1 4 0 0 0
[pid=1151] ppid=1018 vsize=657332 CPUtime=0.25 cores=0-7
/proc/1151/stat : 1151 (python) S 1018 1018 32572 0 -1 4202560 1196 0 0 0 14 11 0 0 19 0 2 0 548593377 673107968 15228 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1151/statm: 164333 15228 401 364 0 100170 0
[pid=1153] ppid=1151 vsize=467024 CPUtime=100.23 cores=0-7
/proc/1153/stat : 1153 (TNM) T 1151 1153 1153 0 -1 4202496 6840 0 0 0 10022 1 0 0 25 0 1 0 548593378 478232576 6558 33554432000 134512640 135008748 4294080752 18446744073709551615 134529409 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/1153/statm: 116756 6558 46 122 0 115656 0
[pid=1151/tid=1171] ppid=1018 vsize=657332 CPUtime=0 cores=0-7
/proc/1151/task/1171/stat : 1171 (python) S 1018 1018 32572 0 -1 4202560 100 0 0 0 0 0 0 0 18 0 2 0 548603413 673107968 15228 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 514 18446604445796129600 0 0 -1 1 0 0 0
[pid=1155] ppid=1018 vsize=667588 CPUtime=0.25 cores=0-7
/proc/1155/stat : 1155 (python) S 1018 1018 32572 0 -1 4202560 1247 0 0 0 12 13 0 0 18 0 2 0 548593416 683610112 15169 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/1155/statm: 166897 15169 407 364 0 102731 0
[pid=1157] ppid=1155 vsize=467024 CPUtime=99.07 cores=0-7
/proc/1157/stat : 1157 (TNM) T 1155 1157 1157 0 -1 4202496 6848 0 0 0 9906 1 0 0 25 0 1 0 548593416 478232576 6557 33554432000 134512640 135008748 4294796256 18446744073709551615 134527773 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/1157/statm: 116756 6557 46 122 0 115656 0
[pid=1155/tid=1175] ppid=1018 vsize=667588 CPUtime=0 cores=0-7
/proc/1155/task/1175/stat : 1175 (python) S 1018 1018 32572 0 -1 4202560 94 0 0 0 0 0 0 0 19 0 2 0 548603441 683610112 15169 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 514 18446604441494248448 0 0 -1 7 0 0 0
[pid=1160] ppid=1018 vsize=677844 CPUtime=0.05 cores=0-7
/proc/1160/stat : 1160 (python) S 1018 1018 32572 0 -1 4202560 1046 0 0 0 3 2 0 0 18 0 1 0 548600875 694112256 15319 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 12354763560574746883 0 0 17 2 0 0 0
/proc/1160/statm: 169461 15319 379 364 0 105292 0
[pid=1162] ppid=1160 vsize=467024 CPUtime=25.81 cores=0-7
/proc/1162/stat : 1162 (TNM) R 1160 1162 1162 0 -1 4202496 6849 0 0 0 2580 1 0 0 25 0 1 0 548600879 478232576 6558 33554432000 134512640 135008748 4290296992 18446744073709551615 134527809 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1162/statm: 116756 6558 46 122 0 115656 0
[pid=1164] ppid=1018 vsize=688100 CPUtime=0.02 cores=0-7
/proc/1164/stat : 1164 (python) S 1018 1018 32572 0 -1 4202560 1058 0 0 0 1 1 0 0 18 0 1 0 548601969 704614400 15266 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 12354763560574746883 0 0 17 2 0 0 0
/proc/1164/statm: 172025 15266 379 364 0 107853 0
[pid=1166] ppid=1164 vsize=467024 CPUtime=15.82 cores=0-7
/proc/1166/stat : 1166 (TNM) R 1164 1166 1166 0 -1 4202496 6851 0 0 0 1582 0 0 0 25 0 1 0 548601969 478232576 6558 33554432000 134512640 135008748 4294909248 18446744073709551615 134529367 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1166/statm: 116756 6558 46 122 0 115656 0
[pid=1168] ppid=1018 vsize=698356 CPUtime=0.01 cores=0-7
/proc/1168/stat : 1168 (python) S 1018 1018 32572 0 -1 4202560 1058 0 0 0 1 0 0 0 18 0 1 0 548602897 715116544 15332 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 16351981737678438657 0 0 17 2 0 0 0
/proc/1168/statm: 174589 15332 379 364 0 110414 0
[pid=1170] ppid=1168 vsize=467024 CPUtime=6.53 cores=0-7
/proc/1170/stat : 1170 (TNM) R 1168 1170 1170 0 -1 4202496 6850 0 0 0 652 1 0 0 25 0 1 0 548602898 478232576 6559 33554432000 134512640 135008748 4289855248 18446744073709551615 134527066 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1170/statm: 116756 6559 46 122 0 115656 0
[pid=1172] ppid=1018 vsize=708612 CPUtime=0 cores=0-7
/proc/1172/stat : 1172 (python) S 1018 1018 32572 0 -1 4202560 983 0 0 0 0 0 0 0 18 0 1 0 548603425 725618688 15255 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 16351977889387773951 0 0 17 2 0 0 0
/proc/1172/statm: 177153 15255 356 364 0 112975 0
[pid=1174] ppid=1172 vsize=467024 CPUtime=1.16 cores=0-7
/proc/1174/stat : 1174 (TNM) R 1172 1174 1174 0 -1 4202496 6855 0 0 0 115 1 0 0 25 0 1 0 548603425 478232576 6558 33554432000 134512640 135008748 4286574288 18446744073709551615 134527693 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1174/statm: 116756 6558 46 122 0 115656 0
[pid=1176] ppid=1018 vsize=718868 CPUtime=0 cores=0-7
/proc/1176/stat : 1176 (python) S 1018 1018 32572 0 -1 4202560 946 0 0 0 0 0 0 0 19 0 1 0 548603453 736120832 15184 33554432000 4194304 5683644 140733708475248 18446744073709551615 230809185862 0 0 16781312 514 16351974041097076735 0 0 17 2 0 0 0
/proc/1176/statm: 179717 15184 345 364 0 115536 0
[pid=1178] ppid=1176 vsize=467024 CPUtime=0.98 cores=0-7
/proc/1178/stat : 1178 (TNM) R 1176 1178 1178 0 -1 4202496 6851 0 0 0 97 1 0 0 23 0 1 0 548603453 478232576 6559 33554432000 134512640 135008748 4291219088 18446744073709551615 134527542 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1178/statm: 116756 6559 46 122 0 115656 0
[pid=1018/tid=1025] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1025/stat : 1025 (python) S 1016 1018 32572 0 -1 4202560 34 935 0 0 0 0 0 0 18 0 35 0 548513131 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1028] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1028/stat : 1028 (python) S 1016 1018 32572 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 35 0 548513135 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1031] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1031/stat : 1031 (python) S 1016 1018 32572 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 35 0 548513139 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1034] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1034/stat : 1034 (python) S 1016 1018 32572 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 35 0 548513143 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 1 0 0 0
[pid=1018/tid=1037] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1037/stat : 1037 (python) S 1016 1018 32572 0 -1 4202560 29 935 0 0 0 0 0 0 18 0 35 0 548513148 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1040] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1040/stat : 1040 (python) S 1016 1018 32572 0 -1 4202560 29 935 0 0 0 0 0 0 18 0 35 0 548513152 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1043] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1043/stat : 1043 (python) S 1016 1018 32572 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 35 0 548513156 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 0 0 0 0
[pid=1018/tid=1046] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1046/stat : 1046 (python) S 1016 1018 32572 0 -1 4202560 34 935 0 0 0 0 0 0 18 0 35 0 548513160 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1055] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1055/stat : 1055 (python) S 1016 1018 32572 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 35 0 548523183 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 1 0 0 0
[pid=1018/tid=1068] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1068/stat : 1068 (python) S 1016 1018 32572 0 -1 4202560 37 935 0 0 0 0 0 0 18 0 35 0 548542358 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 4 0 0 0
[pid=1018/tid=1071] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1071/stat : 1071 (python) S 1016 1018 32572 0 -1 4202560 44 935 0 0 0 0 0 0 18 0 35 0 548542363 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1074] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1074/stat : 1074 (python) S 1016 1018 32572 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 35 0 548542372 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1077] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1077/stat : 1077 (python) S 1016 1018 32572 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 35 0 548542850 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1081] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1081/stat : 1081 (python) S 1016 1018 32572 0 -1 4202560 36 935 0 0 0 0 0 0 18 0 35 0 548542959 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1084] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1084/stat : 1084 (python) S 1016 1018 32572 0 -1 4202560 42 935 0 0 0 0 0 0 18 0 35 0 548543051 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1091] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1091/stat : 1091 (python) S 1016 1018 32572 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 35 0 548552879 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1094] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1094/stat : 1094 (python) S 1016 1018 32572 0 -1 4202560 37 935 0 0 0 0 0 0 18 0 35 0 548553004 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 6 0 0 0
[pid=1018/tid=1104] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1104/stat : 1104 (python) S 1016 1018 32572 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 35 0 548562609 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 1 0 0 0
[pid=1018/tid=1109] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1109/stat : 1109 (python) S 1016 1018 32572 0 -1 4202560 117 935 0 0 0 0 0 0 20 0 35 0 548563412 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1114] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1114/stat : 1114 (python) S 1016 1018 32572 0 -1 4202560 47 935 0 0 0 0 0 0 18 0 35 0 548571598 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 1 0 0 0
[pid=1018/tid=1118] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1118/stat : 1118 (python) S 1016 1018 32572 0 -1 4202560 38 935 0 0 0 0 0 0 20 0 35 0 548572711 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1122] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1122/stat : 1122 (python) S 1016 1018 32572 0 -1 4202560 41 935 0 0 0 0 0 0 20 0 35 0 548573444 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1129] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1129/stat : 1129 (python) S 1016 1018 32572 0 -1 4202560 39 935 0 0 0 0 0 0 20 0 35 0 548582927 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 1 0 0 0
[pid=1018/tid=1133] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1133/stat : 1133 (python) S 1016 1018 32572 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 35 0 548583344 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1137] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1137/stat : 1137 (python) S 1016 1018 32572 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 35 0 548583478 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1143] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1143/stat : 1143 (python) S 1016 1018 32572 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 35 0 548591331 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 1 0 0 0
[pid=1018/tid=1148] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1148/stat : 1148 (python) S 1016 1018 32572 0 -1 4202560 165 935 0 0 0 0 0 0 20 0 35 0 548592961 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1152] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1152/stat : 1152 (python) S 1016 1018 32572 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 35 0 548593378 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1156] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1156/stat : 1156 (python) S 1016 1018 32572 0 -1 4202560 35 935 0 0 0 0 0 0 20 0 35 0 548593416 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1161] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1161/stat : 1161 (python) S 1016 1018 32572 0 -1 4202560 35 935 0 0 0 0 0 0 20 0 35 0 548600875 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1165] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1165/stat : 1165 (python) S 1016 1018 32572 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 35 0 548601969 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1169] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1169/stat : 1169 (python) S 1016 1018 32572 0 -1 4202560 35 935 0 0 0 0 0 0 20 0 35 0 548602898 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 1 0 0 0
[pid=1018/tid=1173] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1173/stat : 1173 (python) S 1016 1018 32572 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 35 0 548603425 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
[pid=1018/tid=1177] ppid=1016 vsize=729112 CPUtime=0 cores=0-7
/proc/1018/task/1177/stat : 1177 (python) S 1016 1018 32572 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 35 0 548603453 746610688 16785 33554432000 4194304 5683644 140733708475248 18446744073709551615 230820989361 0 0 16781312 2 18446604452206684864 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7215.06
Current children cumulated vsize (KiB) 31952600

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1018 and gives
#  childrusage.ru_utime.tv_sec=12
#  childrusage.ru_utime.tv_usec=200145
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=321951
# CPU time returned by wait4() is 12.5221
# while last known CPU time is 7215.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 913.115
CPU time (s): 7215.06
CPU user time (s): 7206.27
CPU system time (s): 8.79
CPU usage (%): 790.159
Max. virtual memory (cumulated for all children) (KiB): 31952600

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 12.2001
system time used= 0.321951
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 71467
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3134
involuntary context switches= 215

runsolver used 6.62799 second user time and 18.1142 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-02 22:45:18
IDJOB=3321892
IDBENCH=82670
IDSOLVER=1712
FILE ID=node104/3321892-1304369118
RUNJOBID= node104-1304366469-32586
PBS_JOBID= 13181766
Free space on /tmp= 73380 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v40000-c168000-S386300535-065-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321892-1304369118/watcher-3321892-1304369118 -o /tmp/evaluation-result-3321892-1304369118/solver-3321892-1304369118 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321892-1304369118.cnf -seed 1112615086 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2ca6073d25d8d5f2648d590c0edc75c0
RANDOM SEED=1112615086

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15065596 kB
Buffers:         24000 kB
Cached:         323864 kB
SwapCached:      43940 kB
Active:       10035076 kB
Inactive:      7652596 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15065596 kB
SwapTotal:    67111528 kB
SwapFree:     59766108 kB
Dirty:           34952 kB
Writeback:           0 kB
AnonPages:    17307696 kB
Mapped:          18528 kB
Slab:            64264 kB
PageTables:      66760 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 48751272 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73348 MiB
End job on node104 at 2011-05-02 23:00:33