Trace number 3321851

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9421.83 1521.42

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S1275797759-041-UNKNOWN.cnf
MD5SUM374e3ba6783d13d6d478972802d8dba0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.29/0.61	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.29/0.61	c INFO: solving HOME/instance-3321851-1304368247.cnf
0.29/0.61	c INFO: computing task features
0.49/0.84	c INFO: computed variable-clause graph statistics
0.49/0.85	c INFO: computed clause balance statistics
1.69/2.09	c INFO: computed variable balance statistics
2.19/2.59	c INFO: computed small-clause counts
2.19/2.59	c INFO: computed Horn-clause counts
2.29/2.64	c INFO: computed variable graph statistics
2.29/2.64	c INFO: collected features for HOME/instance-3321851-1304368247.cnf in 2.02 s
2.29/2.67	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.38)
2.39/2.71	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.13)
2.39/2.75	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.08)
2.39/2.78	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.07)
2.48/2.82	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.05)
2.48/2.86	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.04)
2.58/2.90	c INFO: running FH@0 for 97 with 39997 remaining (b = 0.03)
2.58/2.94	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.03)
610.86/102.98	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
686.48/115.22	c INFO: running FH@0 for 97 with 39885 remaining (b = 0.02)
687.06/115.34	c INFO: running hybridGM3@0 for 194 with 39885 remaining (b = 0.04)
833.35/139.17	c INFO: running gnovelty+2@0 for 97 with 39861 remaining (b = 0.02)
872.26/145.11	c INFO: running hybridGM3@0 for 194 with 39855 remaining (b = 0.03)
872.26/145.17	c INFO: running adaptg2wsat2009++@0 for 97 with 39855 remaining (b = 0.01)
911.03/151.12	c INFO: running hybridGM3@0 for 194 with 39849 remaining (b = 0.03)
1021.06/169.53	c INFO: running hybridGM3@0 for 194 with 39831 remaining (b = 0.02)
1258.32/209.28	c INFO: running TNM@0 for 1552 with 39791 remaining (b = 0.18)
1331.74/221.55	c INFO: running FH@0 for 97 with 39779 remaining (b = 0.01)
1525.84/251.57	c INFO: running adaptg2wsat2009++@100 for 97 with 39749 remaining (b = 0.01)
1909.26/311.81	c INFO: running hybridGM3@0 for 194 with 39688 remaining (b = 0.02)
1988.26/324.02	c INFO: running hybridGM3@97 for 97 with 39676 remaining (b = 0.01)
2308.25/369.95	c INFO: running hybridGM3@0 for 194 with 39630 remaining (b = 0.02)
2401.55/383.87	c INFO: running hybridGM3@97 for 97 with 39616 remaining (b = 0.01)
2409.26/384.95	c INFO: running TNM@0 for 1552 with 39615 remaining (b = 0.14)
2446.04/390.26	c INFO: running hybridGM3@101 for 97 with 39610 remaining (b = 0.01)
2521.22/401.90	c INFO: running hybridGM3@100 for 97 with 39598 remaining (b = 0.01)
2850.75/455.40	c INFO: running adaptg2wsat2009++@0 for 97 with 39545 remaining (b = 0.01)
3173.20/509.24	c INFO: running adaptg2wsat2009++@0 for 97 with 39491 remaining (b = 0.01)
3211.51/515.62	c INFO: running hybridGM3@297 for 97 with 39485 remaining (b = 0.01)
3280.91/527.26	c INFO: running adaptg2wsat2009++@0 for 97 with 39473 remaining (b = 0.01)
3424.17/550.53	c INFO: running adaptg2wsat2009++@102 for 97 with 39450 remaining (b = 0.01)
3602.70/577.68	c INFO: running iPAWS@0 for 97 with 39422 remaining (b = 0.01)
3782.65/606.55	c INFO: running FH@0 for 291 with 39394 remaining (b = 0.03)
3946.36/629.90	c INFO: running gnovelty+2@0 for 97 with 39370 remaining (b = 0.01)
4034.74/642.62	c INFO: running hybridGM3@0 for 194 with 39358 remaining (b = 0.02)
4139.67/658.90	c INFO: running adaptg2wsat2009++@297 for 291 with 39341 remaining (b = 0.02)
4249.08/676.11	c INFO: running hybridGM3@395 for 97 with 39324 remaining (b = 0.01)
4296.33/684.03	c INFO: running FH@100 for 291 with 39316 remaining (b = 0.02)
4824.42/772.42	c INFO: running hybridGM3@0 for 194 with 39228 remaining (b = 0.01)
4995.66/800.53	c INFO: running TNM@0 for 1552 with 39200 remaining (b = 0.11)
5633.13/905.44	c INFO: running hybridGM3@94 for 97 with 39095 remaining (b = 0.01)
6009.45/968.50	c INFO: running iPAWS@0 for 97 with 39032 remaining (b = 0.01)
6130.51/987.16	c INFO: running hybridGM3@99 for 97 with 39013 remaining (b = 0.01)
6277.56/1009.89	c INFO: running FH@199 for 194 with 38990 remaining (b = 0.01)
6438.81/1036.88	c INFO: running adaptg2wsat2009++@393 for 194 with 38963 remaining (b = 0.02)
6510.59/1048.88	c INFO: running hybridGM3@385 for 97 with 38951 remaining (b = 0.01)
6747.19/1088.49	c INFO: running hybridGM3@393 for 97 with 38912 remaining (b = 0.01)
6989.84/1129.04	c INFO: running adaptg2wsat2009++@101 for 97 with 38871 remaining (b = 0.01)
7218.11/1167.26	c INFO: running hybridGM3@484 for 97 with 38833 remaining (b = 0.01)
7518.00/1217.48	c INFO: running NCVWr@0 for 485 with 38783 remaining (b = 0.03)
7533.55/1219.90	c INFO: running FH@0 for 97 with 38780 remaining (b = 0.01)
7854.99/1267.62	c INFO: running adaptg2wsat2009++@92 for 97 with 38733 remaining (b = 0.01)
7860.54/1268.49	c INFO: running adaptg2wsat2009++@95 for 97 with 38732 remaining (b = 0.01)
8199.46/1318.64	c INFO: running adaptg2wsat2009++@491 for 97 with 38682 remaining (b = 0.01)
8464.63/1362.35	c INFO: running iPAWS@0 for 97 with 38638 remaining (b = 0.01)
8485.63/1365.83	c INFO: running gnovelty+2@0 for 97 with 38634 remaining (b = 0.01)
8516.31/1370.98	c INFO: running hybridGM3@0 for 194 with 38629 remaining (b = 0.01)
9029.69/1456.08	c INFO: running adaptg2wsat2009++@188 for 97 with 38544 remaining (b = 0.01)
9142.17/1474.75	c INFO: running FH@99 for 291 with 38525 remaining (b = 0.02)
9416.83/1520.47	c INFO: running hybridGM3@0 for 194 with 38480 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321851-1304368247/watcher-3321851-1304368247 -o /tmp/evaluation-result-3321851-1304368247/solver-3321851-1304368247 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321851-1304368247.cnf -seed 1752398625 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.61 9.61 8.13 3/291 29292
/proc/meminfo: memFree=22448600/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=15776 CPUtime=0 cores=0-7
/proc/29292/stat : 29292 (python) R 29290 29292 28735 0 -1 4202496 877 0 0 0 0 0 0 0 20 0 1 0 548422399 16154624 758 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905391813 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/29292/statm: 3944 758 343 364 0 431 0

[startup+0.0992 s]
/proc/loadavg: 9.61 9.61 8.13 3/291 29292
/proc/meminfo: memFree=22448600/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=93960 CPUtime=0.05 cores=0-7
/proc/29292/stat : 29292 (python) S 29290 29292 28735 0 -1 4202496 2693 0 0 0 4 1 0 0 17 0 1 0 548422399 96215040 2407 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905726821 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/29292/statm: 23490 2407 764 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93960

[startup+0.100196 s]
/proc/loadavg: 9.61 9.61 8.13 3/291 29292
/proc/meminfo: memFree=22448600/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=93960 CPUtime=0.05 cores=0-7
/proc/29292/stat : 29292 (python) S 29290 29292 28735 0 -1 4202496 2694 0 0 0 4 1 0 0 17 0 1 0 548422399 96215040 2407 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905729024 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/29292/statm: 23490 2407 764 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93960

[startup+0.30017 s]
/proc/loadavg: 9.61 9.61 8.13 3/291 29292
/proc/meminfo: memFree=22448600/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=135748 CPUtime=0.14 cores=0-7
/proc/29292/stat : 29292 (python) R 29290 29292 28735 0 -1 4202496 5965 934 1 0 12 2 0 0 18 0 1 0 548422399 139005952 4151 33554432000 4194304 5683644 140733917139584 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/29292/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 135748

[startup+0.701084 s]
/proc/loadavg: 9.61 9.61 8.13 3/291 29292
/proc/meminfo: memFree=22448600/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=282688 CPUtime=0.39 cores=0-7
/proc/29292/stat : 29292 (python) R 29290 29292 28735 0 -1 4202496 10289 934 1 0 34 5 0 0 17 0 1 0 548422399 289472512 7969 33554432000 4194304 5683644 140733917139584 18446744073709551615 4423308 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/29292/statm: 70672 7969 1761 364 0 6596 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 282688

[startup+1.50095 s]
/proc/loadavg: 9.61 9.61 8.13 4/292 29297
/proc/meminfo: memFree=22415856/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=289500 CPUtime=1.19 cores=0-7
/proc/29292/stat : 29292 (python) R 29290 29292 28735 0 -1 4202496 13885 934 1 0 114 5 0 0 18 0 1 0 548422399 296448000 9760 33554432000 4194304 5683644 140733917139584 18446744073709551615 47211051990146 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/29292/statm: 72375 9760 1826 364 0 8299 0
Current children cumulated CPU time (s) 1.19
Current children cumulated vsize (KiB) 289500

[startup+3.10062 s]
/proc/loadavg: 9.08 9.50 8.10 4/292 29297
/proc/meminfo: memFree=22415388/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=429400 CPUtime=2.63 cores=0-7
/proc/29292/stat : 29292 (python) S 29290 29292 28735 0 -1 4202496 19783 934 1 0 256 7 0 0 25 0 9 0 548422399 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29292/statm: 107350 8077 1891 364 0 43247 0
Current children cumulated CPU time (s) 2.63
Current children cumulated vsize (KiB) 429400

[startup+6.30104 s]
/proc/loadavg: 9.08 9.50 8.10 11/316 29321
/proc/meminfo: memFree=22354548/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=429400 CPUtime=2.63 cores=0-7
/proc/29292/stat : 29292 (python) S 29290 29292 28735 0 -1 4202496 19783 934 1 0 256 7 0 0 25 0 9 0 548422399 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29292/statm: 107350 8077 1891 364 0 43247 0
[pid=29298] ppid=29292 vsize=282244 CPUtime=0 cores=0-7
/proc/29298/stat : 29298 (python) S 29292 29292 28735 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 548422667 289017856 6332 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751055 0 0 16781312 514 17903629589226160387 0 0 17 1 0 0 0
/proc/29298/statm: 70561 6332 355 364 0 6479 0
[pid=29300] ppid=29298 vsize=1020188 CPUtime=3.61 cores=0-7
/proc/29300/stat : 29300 (gnovelty+2) R 29298 29300 29300 0 -1 4202496 1136 0 0 0 361 0 0 0 25 0 1 0 548422668 1044672512 876 33554432000 134512640 135663704 4288048736 18446744073709551615 134525699 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29300/statm: 255047 876 113 282 0 254763 0
[pid=29301] ppid=29292 vsize=293176 CPUtime=0 cores=0-7
/proc/29301/stat : 29301 (python) S 29292 29292 28735 0 -1 4202560 746 0 0 0 0 0 0 0 18 0 1 0 548422671 300212224 6381 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 9478918059776246018 0 0 17 1 0 0 0
/proc/29301/statm: 73294 6381 349 364 0 9209 0
[pid=29303] ppid=29301 vsize=1020188 CPUtime=1.95 cores=0-7
/proc/29303/stat : 29303 (gnovelty+2) R 29301 29303 29303 0 -1 4202496 1138 0 0 0 195 0 0 0 25 0 1 0 548422671 1044672512 876 33554432000 134512640 135663704 4286913168 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29303/statm: 255047 876 113 282 0 254763 0
[pid=29304] ppid=29292 vsize=367876 CPUtime=0 cores=0-7
/proc/29304/stat : 29304 (python) S 29292 29292 28735 0 -1 4202560 711 0 0 0 0 0 0 0 18 0 1 0 548422675 376705024 6556 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 9478925756357640451 0 0 17 1 0 0 0
/proc/29304/statm: 91969 6556 348 364 0 27881 0
[pid=29306] ppid=29304 vsize=421140 CPUtime=1.91 cores=0-7
/proc/29306/stat : 29306 (adaptg2wsat2009) R 29304 29306 29306 0 -1 4202496 1789 0 0 0 191 0 0 0 25 0 1 0 548422675 431247360 1538 33554432000 134512640 135107411 4294793008 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29306/statm: 105285 1538 49 146 0 104161 0
[pid=29307] ppid=29292 vsize=378132 CPUtime=0 cores=0-7
/proc/29307/stat : 29307 (python) S 29292 29292 28735 0 -1 4202560 719 0 0 0 0 0 0 0 18 0 1 0 548422678 387207168 6514 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 4261060560717578497 0 0 17 1 0 0 0
/proc/29307/statm: 94533 6514 348 364 0 30442 0
[pid=29309] ppid=29307 vsize=421140 CPUtime=3.46 cores=0-7
/proc/29309/stat : 29309 (adaptg2wsat2009) R 29307 29309 29309 0 -1 4202496 1794 0 0 0 346 0 0 0 25 0 1 0 548422679 431247360 1540 33554432000 134512640 135107411 4288131280 18446744073709551615 134523455 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29309/statm: 105285 1540 49 146 0 104161 0
[pid=29310] ppid=29292 vsize=388388 CPUtime=0 cores=0-7
/proc/29310/stat : 29310 (python) S 29292 29292 28735 0 -1 4202560 726 0 0 0 0 0 0 0 18 0 1 0 548422682 397709312 6638 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 1172003258323927300 0 0 17 1 0 0 0
/proc/29310/statm: 97097 6638 348 364 0 33003 0
[pid=29312] ppid=29310 vsize=421140 CPUtime=3.44 cores=0-7
/proc/29312/stat : 29312 (adaptg2wsat2009) R 29310 29312 29312 0 -1 4202496 1796 0 0 0 344 0 0 0 25 0 1 0 548422684 431247360 1538 33554432000 134512640 135107411 4294495568 18446744073709551615 134523457 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29312/statm: 105285 1538 49 146 0 104161 0
[pid=29313] ppid=29292 vsize=398644 CPUtime=0 cores=0-7
/proc/29313/stat : 29313 (python) S 29292 29292 28735 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 548422686 408211456 6641 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 1171991713451835651 0 0 17 2 0 0 0
/proc/29313/statm: 99661 6641 348 364 0 35564 0
[pid=29315] ppid=29313 vsize=1020188 CPUtime=1.62 cores=0-7
/proc/29315/stat : 29315 (gnovelty+2) R 29313 29315 29315 0 -1 4202496 1133 0 0 0 162 0 0 0 25 0 1 0 548422688 1044672512 877 33554432000 134512640 135663704 4287060272 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29315/statm: 255047 877 113 282 0 254763 0
[pid=29316] ppid=29292 vsize=408900 CPUtime=0 cores=0-7
/proc/29316/stat : 29316 (python) S 29292 29292 28735 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 548422690 418713600 6544 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 4180932551331774724 0 0 17 2 0 0 0
/proc/29316/statm: 102225 6544 348 364 0 38125 0
[pid=29318] ppid=29316 vsize=249144 CPUtime=3.34 cores=0-7
/proc/29318/stat : 29318 (FH) R 29316 29318 29318 0 -1 4202496 1555 0 0 0 334 0 0 0 25 0 1 0 548422692 255123456 1295 33554432000 134512640 134936988 4291400592 18446744073709551615 134523505 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29318/statm: 62286 1295 37 104 0 61790 0
[pid=29319] ppid=29292 vsize=419156 CPUtime=0 cores=0-7
/proc/29319/stat : 29319 (python) S 29292 29292 28735 0 -1 4202560 771 0 0 0 0 0 0 0 18 0 1 0 548422694 429215744 6536 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 10860100652210553089 0 0 17 2 0 0 0
/proc/29319/statm: 104789 6536 354 364 0 40686 0
[pid=29321] ppid=29319 vsize=421140 CPUtime=1.61 cores=0-7
/proc/29321/stat : 29321 (adaptg2wsat2009) R 29319 29321 29321 0 -1 4202496 1803 0 0 0 161 0 0 0 25 0 1 0 548422695 431247360 1538 33554432000 134512640 135107411 4288450176 18446744073709551615 134523261 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29321/statm: 105285 1538 49 146 0 104161 0
[pid=29292/tid=29299] ppid=29290 vsize=429400 CPUtime=0 cores=0-7
/proc/29292/task/29299/stat : 29299 (python) S 29290 29292 28735 0 -1 4202560 27 934 0 0 0 0 0 0 21 0 9 0 548422667 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 0 0 0 0
[pid=29292/tid=29302] ppid=29290 vsize=429400 CPUtime=0 cores=0-7
/proc/29292/task/29302/stat : 29302 (python) S 29290 29292 28735 0 -1 4202560 27 934 0 0 0 0 0 0 22 0 9 0 548422671 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29305] ppid=29290 vsize=429400 CPUtime=0 cores=0-7
/proc/29292/task/29305/stat : 29305 (python) S 29290 29292 28735 0 -1 4202560 89 934 0 0 0 0 0 0 19 0 9 0 548422675 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 0 0 0 0
[pid=29292/tid=29308] ppid=29290 vsize=429400 CPUtime=0 cores=0-7
/proc/29292/task/29308/stat : 29308 (python) S 29290 29292 28735 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 9 0 548422679 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 7 0 0 0
[pid=29292/tid=29311] ppid=29290 vsize=429400 CPUtime=0 cores=0-7
/proc/29292/task/29311/stat : 29311 (python) S 29290 29292 28735 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 9 0 548422682 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 1 0 0 0
[pid=29292/tid=29314] ppid=29290 vsize=429400 CPUtime=0 cores=0-7
/proc/29292/task/29314/stat : 29314 (python) S 29290 29292 28735 0 -1 4202560 29 934 0 0 0 0 0 0 21 0 9 0 548422686 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29317] ppid=29290 vsize=429400 CPUtime=0 cores=0-7
/proc/29292/task/29317/stat : 29317 (python) S 29290 29292 28735 0 -1 4202560 36 934 0 0 0 0 0 0 23 0 9 0 548422690 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29320] ppid=29290 vsize=429400 CPUtime=0 cores=0-7
/proc/29292/task/29320/stat : 29320 (python) S 29290 29292 28735 0 -1 4202560 83 934 0 0 0 0 0 0 25 0 9 0 548422695 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 23.57
Current children cumulated vsize (KiB) 8360184

[startup+12.7019 s]
/proc/loadavg: 9.30 9.53 8.13 11/316 29322
/proc/meminfo: memFree=22349620/32951124 swapFree=67111356/67111528
[pid=29292] ppid=29290 vsize=429400 CPUtime=2.63 cores=0-7
/proc/29292/stat : 29292 (python) S 29290 29292 28735 0 -1 4202496 19783 934 1 0 256 7 0 0 25 0 9 0 548422399 439705600 8077 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29292/statm: 107350 8077 1891 364 0 43247 0
[pid=29298] ppid=29292 vsize=282244 CPUtime=0 cores=0-7
/proc/29298/stat : 29298 (python) S 29292 29292 28735 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 548422667 289017856 6355 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751055 0 0 16781312 514 17903629589226160387 0 0 17 1 0 0 0
/proc/29298/statm: 70561 6355 378 364 0 6479 0
[pid=29300] ppid=29298 vsize=1020188 CPUtime=10.01 cores=0-7
/proc/29300/stat : 29300 (gnovelty+2) R 29298 29300 29300 0 -1 4202496 1136 0 0 0 1001 0 0 0 25 0 1 0 548422668 1044672512 876 33554432000 134512640 135663704 4288048736 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29300/statm: 255047 876 113 282 0 254763 0
[pid=29301] ppid=29292 vsize=293176 CPUtime=0 cores=0-7
/proc/29301/stat : 29301 (python) S 29292 29292 28735 0 -1 4202560 912 0 0 0 0 0 0 0 18 0 1 0 548422671 300212224 6404 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 9478918059776246018 0 0 17 1 0 0 0
/proc/29301/statm: 73294 6404 372 364 0 9209 0
[pid=29303] ppid=29301 vsize=1020188 CPUtime=5.16 cores=0-7
/proc/29303/stat : 29303 (gnovelty+2) R 29301 29303 29303 0 -1 4202496 1138 0 0 0 516 0 0 0 25 0 1 0 548422671 1044672512 876 33554432000 134512640 135663704 4286913168 18446744073709551615 134525243 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29303/statm: 255047 876 113 282 0 254763 0
[pid=29304] ppid=29292 vsize=367876 CPUtime=0 cores=0-7
/proc/29304/stat : 29304 (python) S 29292 29292 28735 0 -1 4202560 786 0 0 0 0 0 0 0 18 0 1 0 548422675 376705024 6579 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 9478925756357640451 0 0 17 1 0 0 0
/proc/29304/statm: 91969 6579 371 364 0 27881 0
[pid=29306] ppid=29304 vsize=421140 CPUtime=5.11 cores=0-7
/proc/29306/stat : 29306 (adaptg2wsat2009) R 29304 29306 29306 0 -1 4202496 1789 0 0 0 511 0 0 0 25 0 1 0 548422675 431247360 1538 33554432000 134512640 135107411 4294793008 18446744073709551615 134523261 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29306/statm: 105285 1538 49 146 0 104161 0
[pid=29307] ppid=29292 vsize=378132 CPUtime=0 cores=0-7
/proc/29307/stat : 29307 (python) S 29292 29292 28735 0 -1 4202560 795 0 0 0 0 0 0 0 18 0 1 0 548422678 387207168 6537 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 4261060560717578497 0 0 17 1 0 0 0
/proc/29307/statm: 94533 6537 371 364 0 30442 0
[pid=29309] ppid=29307 vsize=421804 CPUtime=9.79 cores=0-7
/proc/29309/stat : 29309 (adaptg2wsat2009) R 29307 29309 29309 0 -1 4202496 2127 0 0 0 979 0 0 0 25 0 1 0 548422679 431927296 1873 33554432000 134512640 135107411 4288131280 18446744073709551615 134531435 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29309/statm: 105451 1873 59 146 0 104327 0
[pid=29310] ppid=29292 vsize=388388 CPUtime=0 cores=0-7
/proc/29310/stat : 29310 (python) S 29292 29292 28735 0 -1 4202560 802 0 0 0 0 0 0 0 18 0 1 0 548422682 397709312 6661 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 1172003258323927300 0 0 17 1 0 0 0
/proc/29310/statm: 97097 6661 371 364 0 33003 0
[pid=29312] ppid=29310 vsize=421804 CPUtime=9.78 cores=0-7
/proc/29312/stat : 29312 (adaptg2wsat2009) R 29310 29312 29312 0 -1 4202496 2129 0 0 0 978 0 0 0 25 0 1 0 548422684 431927296 1871 33554432000 134512640 135107411 4294495568 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29312/statm: 105451 1871 59 146 0 104327 0
[pid=29313] ppid=29292 vsize=398644 CPUtime=0 cores=0-7
/proc/29313/stat : 29313 (python) S 29292 29292 28735 0 -1 4202560 817 0 0 0 0 0 0 0 18 0 1 0 548422686 408211456 6664 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 1171991713451835651 0 0 17 2 0 0 0
/proc/29313/statm: 99661 6664 371 364 0 35564 0
[pid=29315] ppid=29313 vsize=1020188 CPUtime=4.82 cores=0-7
/proc/29315/stat : 29315 (gnovelty+2) R 29313 29315 29315 0 -1 4202496 1133 0 0 0 482 0 0 0 25 0 1 0 548422688 1044672512 877 33554432000 134512640 135663704 4287060272 18446744073709551615 134525049 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29315/statm: 255047 877 113 282 0 254763 0
[pid=29316] ppid=29292 vsize=408900 CPUtime=0 cores=0-7
/proc/29316/stat : 29316 (python) S 29292 29292 28735 0 -1 4202560 820 0 0 0 0 0 0 0 18 0 1 0 548422690 418713600 6567 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 4180932551331774724 0 0 17 2 0 0 0
/proc/29316/statm: 102225 6567 371 364 0 38125 0

################
# More data... #
################

/proc/29398/statm: 83999 1748 59 147 0 83851 0
[pid=29396/tid=29407] ppid=29292 vsize=562740 CPUtime=0 cores=0-7
/proc/29396/task/29407/stat : 29407 (python) S 29292 29292 28735 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 548490794 576245760 6913 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 514 18446604460337391552 0 0 -1 1 0 0 0
[pid=29400] ppid=29292 vsize=572996 CPUtime=0.35 cores=0-7
/proc/29400/stat : 29400 (python) S 29292 29292 28735 0 -1 4202560 1195 0 0 0 19 16 0 0 19 0 2 0 548485390 586747904 6917 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29400/statm: 143249 6917 407 364 0 79101 0
[pid=29402] ppid=29400 vsize=1020188 CPUtime=99.09 cores=0-7
/proc/29402/stat : 29402 (gnovelty+2) T 29400 29402 29402 0 -1 4202496 1161 0 0 0 9909 0 0 0 25 0 1 0 548485391 1044672512 877 33554432000 134512640 135663704 4287928448 18446744073709551615 134525265 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29402/statm: 255047 877 113 282 0 254763 0
[pid=29400/tid=29411] ppid=29292 vsize=572996 CPUtime=0 cores=0-7
/proc/29400/task/29411/stat : 29411 (python) S 29292 29292 28735 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 548499633 586747904 6917 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 514 18446604460337389760 0 0 -1 5 0 0 0
[pid=29403] ppid=29292 vsize=583252 CPUtime=1.57 cores=0-7
/proc/29403/stat : 29403 (python) S 29292 29292 28735 0 -1 4202560 1208 0 0 0 78 79 0 0 18 0 2 0 548486662 597250048 6967 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29403/statm: 145813 6967 406 364 0 81662 0
[pid=29405] ppid=29403 vsize=268424 CPUtime=485.69 cores=0-7
/proc/29405/stat : 29405 (hybridGM3) T 29403 29405 29405 0 -1 4202496 5660 0 0 0 48569 0 0 0 25 0 1 0 548486663 274866176 5378 33554432000 134512640 135204385 4289923728 18446744073709551615 134538444 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29405/statm: 67106 5378 63 169 0 66936 0
[pid=29403/tid=29421] ppid=29292 vsize=583252 CPUtime=0 cores=0-7
/proc/29403/task/29421/stat : 29421 (python) S 29292 29292 28735 0 -1 4202560 87 0 0 0 0 0 0 0 18 0 2 0 548512935 597250048 6967 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 514 18446604461242728704 0 0 -1 5 0 0 0
[pid=29412] ppid=29292 vsize=593508 CPUtime=1.12 cores=0-7
/proc/29412/stat : 29412 (python) S 29292 29292 28735 0 -1 4202560 1193 0 0 0 59 53 0 0 18 0 2 0 548499642 607752192 6935 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29412/statm: 148377 6935 400 364 0 84223 0
[pid=29414] ppid=29412 vsize=268420 CPUtime=388.34 cores=0-7
/proc/29414/stat : 29414 (hybridGM3) T 29412 29414 29414 0 -1 4202496 5659 0 0 0 38833 1 0 0 25 0 1 0 548499642 274862080 5377 33554432000 134512640 135204385 4290796384 18446744073709551615 134538293 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29414/statm: 67105 5377 63 169 0 66935 0
[pid=29412/tid=29428] ppid=29292 vsize=593508 CPUtime=0 cores=0-7
/proc/29412/task/29428/stat : 29428 (python) S 29292 29292 28735 0 -1 4202560 83 0 0 0 0 0 0 0 18 0 2 0 548521106 607752192 6935 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 514 18446604461242730496 0 0 -1 5 0 0 0
[pid=29416] ppid=29292 vsize=603764 CPUtime=1.8 cores=0-7
/proc/29416/stat : 29416 (python) S 29292 29292 28735 0 -1 4202560 998 0 0 0 92 88 0 0 18 0 1 0 548502453 618254336 6894 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 3082696352749027588 0 0 17 5 0 0 0
/proc/29416/statm: 150941 6894 373 364 0 86784 0
[pid=29418] ppid=29416 vsize=459772 CPUtime=514.2 cores=0-7
/proc/29418/stat : 29418 (TNM) R 29416 29418 29418 0 -1 4202496 1938 0 0 0 51420 0 0 0 25 0 1 0 548502453 470806528 1657 33554432000 134512640 135008748 4286925632 18446744073709551615 134527795 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29418/statm: 114943 1657 46 122 0 113843 0
[pid=29424] ppid=29292 vsize=614020 CPUtime=0.4 cores=0-7
/proc/29424/stat : 29424 (python) S 29292 29292 28735 0 -1 4202560 1200 0 0 0 23 17 0 0 19 0 2 0 548519250 628756480 6978 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29424/statm: 153505 6978 400 364 0 89345 0
[pid=29426] ppid=29424 vsize=335996 CPUtime=99.78 cores=0-7
/proc/29426/stat : 29426 (iPAWS) T 29424 29426 29426 0 -1 4202496 2031 0 0 0 9978 0 0 0 25 0 1 0 548519250 344059904 1750 33554432000 134512640 135114423 4293616752 18446744073709551615 134517528 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/29426/statm: 83999 1750 59 147 0 83851 0
[pid=29424/tid=29432] ppid=29292 vsize=614020 CPUtime=0 cores=0-7
/proc/29424/task/29432/stat : 29432 (python) S 29292 29292 28735 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 548535295 628756480 6978 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 514 18446604458874675520 0 0 -1 0 0 0 0
[pid=29436] ppid=29292 vsize=624276 CPUtime=0.77 cores=0-7
/proc/29436/stat : 29436 (python) S 29292 29292 28735 0 -1 4202560 1026 0 0 0 40 37 0 0 18 0 1 0 548544148 639258624 6956 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 3082696352749027591 0 0 17 3 0 0 0
/proc/29436/statm: 156069 6956 373 364 0 91906 0
[pid=29438] ppid=29436 vsize=421344 CPUtime=254.98 cores=0-7
/proc/29438/stat : 29438 (NCVWr) R 29436 29438 29438 0 -1 4202496 1996 0 0 0 25498 0 0 0 25 0 1 0 548544149 431456256 1713 33554432000 134512640 135113558 4291580896 18446744073709551615 134531927 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29438/statm: 105336 1713 58 147 0 104211 0
[pid=29439] ppid=29292 vsize=634532 CPUtime=0.36 cores=0-7
/proc/29439/stat : 29439 (python) S 29292 29292 28735 0 -1 4202560 1248 0 0 0 20 16 0 0 19 0 2 0 548544390 649760768 7107 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29439/statm: 158633 7107 406 364 0 94467 0
[pid=29441] ppid=29439 vsize=251292 CPUtime=102.64 cores=0-7
/proc/29441/stat : 29441 (FH) T 29439 29441 29441 0 -1 4202496 1984 0 0 0 10264 0 0 0 25 0 1 0 548544390 257323008 1693 33554432000 134512640 134936988 4289133232 18446744073709551615 134553445 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/29441/statm: 62823 1693 41 104 0 62327 0
[pid=29439/tid=29446] ppid=29292 vsize=634532 CPUtime=0 cores=0-7
/proc/29439/task/29446/stat : 29446 (python) S 29292 29292 28735 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 548558624 649760768 7107 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 514 18446604468300014848 0 0 -1 6 0 0 0
[pid=29447] ppid=29292 vsize=644788 CPUtime=0.29 cores=0-7
/proc/29447/stat : 29447 (python) S 29292 29292 28735 0 -1 4202560 1257 0 0 0 16 13 0 0 19 0 2 0 548558635 660262912 7003 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29447/statm: 161197 7003 407 364 0 97028 0
[pid=29449] ppid=29447 vsize=335996 CPUtime=98.33 cores=0-7
/proc/29449/stat : 29449 (iPAWS) T 29447 29449 29449 0 -1 4202496 2034 0 0 0 9833 0 0 0 25 0 1 0 548558636 344059904 1750 33554432000 134512640 135114423 4289719520 18446744073709551615 134549803 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29449/statm: 83999 1750 59 147 0 83851 0
[pid=29447/tid=29458] ppid=29292 vsize=644788 CPUtime=0 cores=0-7
/proc/29447/task/29458/stat : 29458 (python) S 29292 29292 28735 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 548569864 660262912 7003 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 514 18446604453886760128 0 0 -1 1 0 0 0
[pid=29450] ppid=29292 vsize=655044 CPUtime=0.4 cores=0-7
/proc/29450/stat : 29450 (python) S 29292 29292 28735 0 -1 4202560 1263 0 0 0 18 22 0 0 19 0 2 0 548558983 670765056 7126 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29450/statm: 163761 7126 406 364 0 99589 0
[pid=29452] ppid=29450 vsize=1020188 CPUtime=99.74 cores=0-7
/proc/29452/stat : 29452 (gnovelty+2) T 29450 29452 29452 0 -1 4202496 1165 0 0 0 9974 0 0 0 25 0 1 0 548558984 1044672512 876 33554432000 134512640 135663704 4292128864 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29452/statm: 255047 876 113 282 0 254763 0
[pid=29450/tid=29461] ppid=29292 vsize=655044 CPUtime=0 cores=0-7
/proc/29450/task/29461/stat : 29461 (python) S 29292 29292 28735 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 548574436 670765056 7126 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 514 18446604453886761920 0 0 -1 1 0 0 0
[pid=29453] ppid=29292 vsize=665300 CPUtime=0.37 cores=0-7
/proc/29453/stat : 29453 (python) S 29292 29292 28735 0 -1 4202560 1078 0 0 0 20 17 0 0 18 0 1 0 548559498 681267200 6985 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 3082696352749027587 0 0 17 4 0 0 0
/proc/29453/statm: 166325 6985 378 364 0 102150 0
[pid=29455] ppid=29453 vsize=268420 CPUtime=146.71 cores=0-7
/proc/29455/stat : 29455 (hybridGM3) R 29453 29455 29455 0 -1 4202496 5668 0 0 0 14671 0 0 0 25 0 1 0 548559498 274862080 5377 33554432000 134512640 135204385 4293692544 18446744073709551615 134537815 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29455/statm: 67105 5377 63 169 0 66935 0
[pid=29462] ppid=29292 vsize=675556 CPUtime=0 cores=0-7
/proc/29462/stat : 29462 (python) S 29292 29292 28735 0 -1 4202560 963 0 0 0 0 0 0 0 18 0 1 0 548574447 691769344 7000 33554432000 4194304 5683644 140733917139584 18446744073709551615 218905751110 0 0 16781312 514 3653884126458544127 0 0 17 6 0 0 0
/proc/29462/statm: 168889 7000 356 364 0 104711 0
[pid=29464] ppid=29462 vsize=268424 CPUtime=0.36 cores=0-7
/proc/29464/stat : 29464 (hybridGM3) R 29462 29464 29464 0 -1 4202496 5671 0 0 0 36 0 0 0 21 0 1 0 548574448 274866176 5378 33554432000 134512640 135204385 4286870736 18446744073709551615 134538264 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29464/statm: 67106 5378 63 169 0 66936 0
[pid=29292/tid=29299] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29299/stat : 29299 (python) S 29290 29292 28735 0 -1 4202560 27 934 0 0 0 0 0 0 21 0 34 0 548422667 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 0 0 0 0
[pid=29292/tid=29302] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29302/stat : 29302 (python) S 29290 29292 28735 0 -1 4202560 27 934 0 0 0 0 0 0 22 0 34 0 548422671 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29305] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29305/stat : 29305 (python) S 29290 29292 28735 0 -1 4202560 93 934 0 0 0 0 0 0 18 0 34 0 548422675 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 0 0 0 0
[pid=29292/tid=29308] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29308/stat : 29308 (python) S 29290 29292 28735 0 -1 4202560 44 934 0 0 0 0 0 0 18 0 34 0 548422679 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 7 0 0 0
[pid=29292/tid=29311] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29311/stat : 29311 (python) S 29290 29292 28735 0 -1 4202560 44 934 0 0 0 0 0 0 18 0 34 0 548422682 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 1 0 0 0
[pid=29292/tid=29314] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29314/stat : 29314 (python) S 29290 29292 28735 0 -1 4202560 29 934 0 0 0 0 0 0 21 0 34 0 548422686 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29317] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29317/stat : 29317 (python) S 29290 29292 28735 0 -1 4202560 42 934 0 0 0 0 0 0 18 0 34 0 548422690 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29320] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29320/stat : 29320 (python) S 29290 29292 28735 0 -1 4202560 88 934 0 0 0 0 0 0 18 0 34 0 548422695 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29327] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29327/stat : 29327 (python) S 29290 29292 28735 0 -1 4202560 58 934 0 0 0 0 0 0 18 0 34 0 548432698 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29331] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29331/stat : 29331 (python) S 29290 29292 28735 0 -1 4202560 46 934 0 0 0 0 0 0 18 0 34 0 548433922 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29335] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29335/stat : 29335 (python) S 29290 29292 28735 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 34 0 548433935 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29340] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29340/stat : 29340 (python) S 29290 29292 28735 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 34 0 548436317 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29345] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29345/stat : 29345 (python) S 29290 29292 28735 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 34 0 548436912 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29348] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29348/stat : 29348 (python) S 29290 29292 28735 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 34 0 548436918 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29352] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29352/stat : 29352 (python) S 29290 29292 28735 0 -1 4202560 38 934 0 0 0 0 0 0 18 0 34 0 548437512 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29357] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29357/stat : 29357 (python) S 29290 29292 28735 0 -1 4202560 47 934 0 0 0 0 0 0 18 0 34 0 548439354 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29362] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29362/stat : 29362 (python) S 29290 29292 28735 0 -1 4202560 33 934 0 0 0 0 0 0 20 0 34 0 548443328 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29366] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29366/stat : 29366 (python) S 29290 29292 28735 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 34 0 548444555 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29374] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29374/stat : 29374 (python) S 29290 29292 28735 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 34 0 548453581 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29380] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29380/stat : 29380 (python) S 29290 29292 28735 0 -1 4202560 37 934 0 0 0 0 0 0 20 0 34 0 548459396 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29384] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29384/stat : 29384 (python) S 29290 29292 28735 0 -1 4202560 38 934 0 0 0 0 0 0 20 0 34 0 548460895 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 0 0 0 0
[pid=29292/tid=29397] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29397/stat : 29397 (python) S 29290 29292 28735 0 -1 4202560 41 934 0 0 0 0 0 0 20 0 34 0 548480168 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29401] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29401/stat : 29401 (python) S 29290 29292 28735 0 -1 4202560 38 934 0 0 0 0 0 0 20 0 34 0 548485391 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 0 0 0 0
[pid=29292/tid=29404] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29404/stat : 29404 (python) S 29290 29292 28735 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 34 0 548486663 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 0 0 0 0
[pid=29292/tid=29413] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29413/stat : 29413 (python) S 29290 29292 28735 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 34 0 548499642 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29417] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29417/stat : 29417 (python) S 29290 29292 28735 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 34 0 548502453 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29425] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29425/stat : 29425 (python) S 29290 29292 28735 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 34 0 548519250 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 2 0 0 0
[pid=29292/tid=29437] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29437/stat : 29437 (python) S 29290 29292 28735 0 -1 4202560 37 934 0 0 0 0 0 0 20 0 34 0 548544149 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 0 0 0 0
[pid=29292/tid=29440] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29440/stat : 29440 (python) S 29290 29292 28735 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 34 0 548544390 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29448] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29448/stat : 29448 (python) S 29290 29292 28735 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 34 0 548558635 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 4 0 0 0
[pid=29292/tid=29451] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29451/stat : 29451 (python) S 29290 29292 28735 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 34 0 548558984 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 3 0 0 0
[pid=29292/tid=29454] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29454/stat : 29454 (python) S 29290 29292 28735 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 34 0 548559498 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 4 0 0 0
[pid=29292/tid=29463] ppid=29290 vsize=685800 CPUtime=0 cores=0-7
/proc/29292/task/29463/stat : 29463 (python) S 29290 29292 28735 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 34 0 548574447 702259200 8590 33554432000 4194304 5683644 140733917139584 18446744073709551615 218917554609 0 0 16781312 2 18446604450823910528 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 9421.83
Current children cumulated vsize (KiB) 32660184

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29292 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=965941
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=214967
# CPU time returned by wait4() is 7.18091
# while last known CPU time is 9421.83
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1521.42
CPU time (s): 9421.83
CPU user time (s): 9407.31
CPU system time (s): 14.52
CPU usage (%): 619.278
Max. virtual memory (cumulated for all children) (KiB): 32660184

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.96594
system time used= 0.214967
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 72801
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2812
involuntary context switches= 120

runsolver used 15.5366 second user time and 37.4923 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-02 22:30:47
IDJOB=3321851
IDBENCH=82629
IDSOLVER=1712
FILE ID=node137/3321851-1304368247
RUNJOBID= node137-1304366465-28749
PBS_JOBID= 13181736
Free space on /tmp= 73624 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S1275797759-041-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321851-1304368247/watcher-3321851-1304368247 -o /tmp/evaluation-result-3321851-1304368247/solver-3321851-1304368247 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321851-1304368247.cnf -seed 1752398625 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 374e3ba6783d13d6d478972802d8dba0
RANDOM SEED=1752398625

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22449004 kB
Buffers:        962580 kB
Cached:        2698940 kB
SwapCached:         48 kB
Active:        6898548 kB
Inactive:      3109420 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22449004 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           32780 kB
Writeback:           0 kB
AnonPages:     6347264 kB
Mapped:          25196 kB
Slab:           400196 kB
PageTables:      27996 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 51144860 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73592 MiB
End job on node137 at 2011-05-02 22:56:10