Trace number 3385243

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 7870.86 998.947

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v35000-c147000-S883457431-033-UNKNOWN.cnf
MD5SUM0d0abbf84f73b4226aa3bedf08367d2e
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark132.892
Satisfiable
(Un)Satisfiability was proved
Number of variables35000
Number of clauses147000
Sum of the clauses size441000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3147000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.43/4.21	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.43/4.21	c INFO: solving HOME/instance-3385243-1305564961.cnf
0.43/4.21	c INFO: computing task features
0.92/4.74	c INFO: computed variable-clause graph statistics
0.92/4.76	c INFO: computed clause balance statistics
3.62/7.41	c INFO: computed variable balance statistics
5.62/9.45	c INFO: computed small-clause counts
5.62/9.46	c INFO: computed Horn-clause counts
7.24/11.03	c INFO: computed variable graph statistics
7.24/11.03	c INFO: collected features for HOME/instance-3385243-1305564961.cnf in 6.80 s
7.24/11.06	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.36)
7.24/11.09	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.21)
7.32/11.12	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.14)
7.32/11.15	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.10)
7.32/11.19	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.07)
7.42/11.22	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.05)
7.42/11.25	c INFO: running hybridGM3@0 for 194 with 4992 remaining (b = 0.08)
7.42/11.29	c INFO: running hybridGM3@0 for 194 with 4992 remaining (b = 0.06)
808.32/111.51	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
808.32/111.54	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
808.32/111.58	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
809.05/111.61	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
809.05/111.64	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
809.05/111.67	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
1568.49/206.86	c INFO: running hybridGM3@98 for 97 with 4797 remaining (b = 0.03)
1569.15/206.92	c INFO: running hybridGM3@100 for 97 with 4797 remaining (b = 0.03)
1569.15/206.99	c INFO: running hybridGM3@100 for 97 with 4797 remaining (b = 0.03)
1569.88/207.02	c INFO: running TNM@0 for 97 with 4797 remaining (b = 0.03)
1577.13/207.99	c INFO: running hybridGM3@95 for 97 with 4796 remaining (b = 0.03)
1577.82/208.05	c INFO: running hybridGM3@0 for 97 with 4796 remaining (b = 0.03)
1616.12/212.85	c INFO: running hybridGM3@100 for 97 with 4791 remaining (b = 0.03)
1616.92/212.93	c INFO: running hybridGM3@100 for 97 with 4791 remaining (b = 0.03)
2370.61/307.44	c INFO: running hybridGM3@100 for 97 with 4696 remaining (b = 0.03)
2376.18/308.20	c INFO: running hybridGM3@0 for 194 with 4696 remaining (b = 0.04)
2376.99/308.25	c INFO: running hybridGM3@0 for 194 with 4695 remaining (b = 0.03)
2376.99/308.29	c INFO: running TNM@0 for 97 with 4695 remaining (b = 0.02)
2377.63/308.33	c INFO: running TNM@0 for 97 with 4695 remaining (b = 0.01)
2377.63/308.38	c INFO: running TNM@0 for 97 with 4695 remaining (b = 0.01)
2386.40/309.40	c INFO: running hybridGM3@98 for 97 with 4694 remaining (b = 0.02)
2392.06/310.20	c INFO: running TNM@0 for 97 with 4694 remaining (b = 0.01)
3146.30/404.74	c INFO: running TNM@0 for 97 with 4599 remaining (b = 0.01)
3146.30/404.80	c INFO: running TNM@0 for 97 with 4599 remaining (b = 0.01)
3177.23/408.66	c INFO: running hybridGM3@0 for 194 with 4595 remaining (b = 0.02)
3177.99/408.76	c INFO: running TNM@195 for 1843 with 4595 remaining (b = 0.18)
3185.16/409.67	c INFO: running hybridGM3@0 for 194 with 4594 remaining (b = 0.02)
3217.78/413.79	c INFO: running adaptg2wsat2009++@0 for 97 with 4590 remaining (b = 0.01)
3945.03/505.03	c INFO: running hybridGM3@93 for 97 with 4499 remaining (b = 0.01)
3945.03/505.08	c INFO: running hybridGM3@100 for 97 with 4499 remaining (b = 0.01)
3945.80/505.13	c INFO: running hybridGM3@0 for 194 with 4499 remaining (b = 0.02)
3947.94/505.46	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.02)
4017.45/514.18	c INFO: running adaptg2wsat2009++@0 for 194 with 4490 remaining (b = 0.01)
4703.26/600.39	c INFO: running hybridGM3@0 for 194 with 4403 remaining (b = 0.01)
4744.60/605.54	c INFO: running hybridGM3@99 for 97 with 4398 remaining (b = 0.01)
4751.77/606.49	c INFO: running TNM@0 for 97 with 4397 remaining (b = 0.01)
4752.50/606.55	c INFO: running hybridGM3@102 for 97 with 4397 remaining (b = 0.01)
5503.50/700.94	c INFO: running TNM@0 for 97 with 4303 remaining (b = 0.01)
5512.23/702.04	c INFO: running hybridGM3@99 for 97 with 4302 remaining (b = 0.01)
5514.63/702.31	c INFO: running hybridGM3@99 for 97 with 4301 remaining (b = 0.01)
5551.21/706.94	c INFO: running TNM@0 for 97 with 4297 remaining (b = 0.01)
5559.14/707.94	c INFO: running hybridGM3@194 for 291 with 4296 remaining (b = 0.02)
5574.25/709.90	c INFO: running adaptg2wsat2009++@95 for 97 with 4294 remaining (b = 0.01)
6269.61/797.28	c INFO: running TNM@0 for 97 with 4206 remaining (b = 0.01)
6294.38/800.39	c INFO: running adaptg2wsat2009++@0 for 194 with 4203 remaining (b = 0.01)
6318.87/803.45	c INFO: running hybridGM3@295 for 194 with 4200 remaining (b = 0.01)
6320.47/803.70	c INFO: running TNM@0 for 97 with 4200 remaining (b = 0.01)
6342.68/806.42	c INFO: running TNM@0 for 97 with 4197 remaining (b = 0.01)
6380.82/811.30	c INFO: running adaptg2wsat2009++@291 for 291 with 4192 remaining (b = 0.02)
7067.50/897.70	c INFO: running TNM@0 for 97 with 4106 remaining (b = 0.01)
7119.10/904.12	c INFO: running TNM@0 for 97 with 4100 remaining (b = 0.01)
7140.43/906.84	c INFO: running hybridGM3@200 for 291 with 4097 remaining (b = 0.02)
7842.05/995.16	c INFO: running hybridGM3@396 for 97 with 4009 remaining (b = 0.01)
7850.78/996.24	c INFO: running TNM@0 for 97 with 4008 remaining (b = 0.01)
7864.27/997.99	c INFO: running hybridGM3@389 for 97 with 4006 remaining (b = 0.01)
7865.88/998.12	c INFO: running TNM@0 for 97 with 4006 remaining (b = 0.01)
7870.86/998.82	c INFO: running TNM@0 for 97 with 4005 remaining (b = 0.00)
7870.86/998.90	c INFO: running hybridGM3@195 for 291 with 4005 remaining (b = 0.01)
7870.86/998.90	Traceback (most recent call last):
7870.86/998.90	  File "HOME/solve", line 33, in <module>
7870.86/998.90	    plac.call(main)
7870.86/998.90	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385243-1305564961/watcher-3385243-1305564961 -o /tmp/evaluation-result-3385243-1305564961/solver-3385243-1305564961 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385243-1305564961.cnf -seed 1352173723 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/398 15676
/proc/meminfo: memFree=15515760/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=15080 CPUtime=0 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 616 0 0 0 0 0 0 0 18 0 1 0 648912279 15441920 513 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106766848 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15676/statm: 3770 513 300 364 0 257 0

[startup+0.0659189 s]
/proc/loadavg: 0.00 0.00 0.00 2/398 15676
/proc/meminfo: memFree=15515760/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=16396 CPUtime=0.01 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 1117 0 0 0 1 0 0 0 17 0 1 0 648912279 16789504 985 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106764645 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15676/statm: 4099 985 409 364 0 586 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16396

[startup+0.100908 s]
/proc/loadavg: 0.00 0.00 0.00 2/398 15676
/proc/meminfo: memFree=15515760/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=16396 CPUtime=0.01 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 1121 0 0 0 1 0 0 0 17 0 1 0 648912279 16789504 989 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106764645 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15676/statm: 4099 989 413 364 0 586 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16396

[startup+0.300889 s]
/proc/loadavg: 0.00 0.00 0.00 2/398 15676
/proc/meminfo: memFree=15515760/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=50012 CPUtime=0.03 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 1948 0 0 0 3 0 0 0 15 0 1 0 648912279 51212288 1713 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106764645 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15676/statm: 12503 1713 476 364 0 1203 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 50012

[startup+0.700817 s]
/proc/loadavg: 0.00 0.00 0.00 2/398 15676
/proc/meminfo: memFree=15515760/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=115428 CPUtime=0.1 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 3594 0 0 0 7 3 0 0 15 0 1 0 648912279 118198272 3236 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106764645 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15676/statm: 28857 3236 889 364 0 2358 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 115428

[startup+1.50068 s]
/proc/loadavg: 0.00 0.00 0.00 2/399 15681
/proc/meminfo: memFree=15502132/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=135748 CPUtime=0.18 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 5964 935 1 0 13 5 0 0 15 0 1 0 648912279 139005952 4151 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106764805 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15676/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+3.10039 s]
/proc/loadavg: 0.00 0.00 0.00 1/399 15681
/proc/meminfo: memFree=15501388/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=210652 CPUtime=0.31 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 7326 935 1 0 22 9 0 0 15 0 1 0 648912279 215707648 5342 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106766848 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/15676/statm: 52663 5342 1508 364 0 4043 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 210652
heavy processes:

[startup+6.30082 s]
/proc/loadavg: 0.00 0.00 0.00 2/399 15681
/proc/meminfo: memFree=15458080/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=312976 CPUtime=2.52 cores=0-7
/proc/15676/stat : 15676 (python) R 15674 15676 15650 0 -1 4202496 21969 935 1 0 238 14 0 0 18 0 1 0 648912279 320487424 15629 33554432000 4194304 5683644 140737235854032 18446744073709551615 5005731 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/15676/statm: 78244 15629 1826 364 0 14168 0
Current children cumulated CPU time (s) 2.52
Current children cumulated vsize (KiB) 312976
heavy processes:

[startup+12.7017 s]
/proc/loadavg: 0.08 0.02 0.01 9/423 15705
/proc/meminfo: memFree=15301804/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=392304 CPUtime=7.51 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 28543 935 1 0 734 17 0 0 20 0 9 0 648912279 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/15676/statm: 98076 15041 1889 364 0 33973 0
[pid=15682] ppid=15676 vsize=310268 CPUtime=0 cores=0-7
/proc/15682/stat : 15682 (python) S 15676 15676 15650 0 -1 4202560 740 0 0 0 0 0 0 0 17 0 1 0 648913385 317714432 13473 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788879 0 0 16781312 514 5816719980439240964 0 0 17 1 0 0 0
/proc/15682/statm: 77567 13473 353 364 0 13485 0
[pid=15684] ppid=15682 vsize=268424 CPUtime=1.63 cores=0-7
/proc/15684/stat : 15684 (hybridGM3) R 15682 15684 15684 0 -1 4202496 8085 0 0 0 162 1 0 0 25 0 1 0 648913386 274866176 7824 33554432000 134512640 135204385 4287084112 18446744073709551615 134547707 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/15684/statm: 67106 7824 64 169 0 66936 0
[pid=15685] ppid=15676 vsize=320524 CPUtime=0 cores=0-7
/proc/15685/stat : 15685 (python) S 15676 15676 15650 0 -1 4202560 750 0 0 0 0 0 0 0 17 0 1 0 648913388 328216576 13471 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 11070560371906412802 0 0 17 4 0 0 0
/proc/15685/statm: 80131 13471 347 364 0 16046 0
[pid=15687] ppid=15685 vsize=268424 CPUtime=1.59 cores=0-7
/proc/15687/stat : 15687 (hybridGM3) R 15685 15687 15687 0 -1 4202496 8085 0 0 0 159 0 0 0 25 0 1 0 648913389 274866176 7822 33554432000 134512640 135204385 4292408800 18446744073709551615 134547843 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15687/statm: 67106 7822 64 169 0 66936 0
[pid=15688] ppid=15676 vsize=330780 CPUtime=0 cores=0-7
/proc/15688/stat : 15688 (python) S 15676 15676 15650 0 -1 4202560 748 0 0 0 0 0 0 0 16 0 1 0 648913392 338718720 13475 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 14267953379618554114 0 0 17 0 0 0 0
/proc/15688/statm: 82695 13475 347 364 0 18607 0
[pid=15690] ppid=15688 vsize=268420 CPUtime=1.54 cores=0-7
/proc/15690/stat : 15690 (hybridGM3) R 15688 15690 15690 0 -1 4202496 8080 0 0 0 153 1 0 0 25 0 1 0 648913392 274862080 7818 33554432000 134512640 135204385 4292263712 18446744073709551615 134536843 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/15690/statm: 67105 7818 64 169 0 66935 0
[pid=15691] ppid=15676 vsize=341036 CPUtime=0 cores=0-7
/proc/15691/stat : 15691 (python) S 15676 15676 15650 0 -1 4202560 757 0 0 0 0 0 0 0 17 0 1 0 648913395 349220864 13479 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 1359057948877226241 0 0 17 6 0 0 0
/proc/15691/statm: 85259 13479 347 364 0 21168 0
[pid=15693] ppid=15691 vsize=268420 CPUtime=1.53 cores=0-7
/proc/15693/stat : 15693 (hybridGM3) R 15691 15693 15693 0 -1 4202496 8076 0 0 0 152 1 0 0 25 0 1 0 648913395 274862080 7816 33554432000 134512640 135204385 4287020224 18446744073709551615 134537565 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15693/statm: 67105 7816 64 169 0 66935 0
[pid=15694] ppid=15676 vsize=351292 CPUtime=0 cores=0-7
/proc/15694/stat : 15694 (python) S 15676 15676 15650 0 -1 4202560 763 0 0 0 0 0 0 0 17 0 1 0 648913398 359723008 13483 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 15958720788161331457 0 0 17 4 0 0 0
/proc/15694/statm: 87823 13483 347 364 0 23729 0
[pid=15696] ppid=15694 vsize=268428 CPUtime=1.49 cores=0-7
/proc/15696/stat : 15696 (hybridGM3) R 15694 15696 15696 0 -1 4202496 8091 0 0 0 148 1 0 0 25 0 1 0 648913399 274870272 7823 33554432000 134512640 135204385 4289734784 18446744073709551615 134537544 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15696/statm: 67107 7823 64 169 0 66937 0
[pid=15697] ppid=15676 vsize=361548 CPUtime=0 cores=0-7
/proc/15697/stat : 15697 (python) S 15676 15676 15650 0 -1 4202560 768 0 0 0 0 0 0 0 17 0 1 0 648913402 370225152 13487 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 3503879679226380546 0 0 17 2 0 0 0
/proc/15697/statm: 90387 13487 347 364 0 26290 0
[pid=15699] ppid=15697 vsize=268420 CPUtime=1.46 cores=0-7
/proc/15699/stat : 15699 (hybridGM3) R 15697 15699 15699 0 -1 4202496 8086 0 0 0 145 1 0 0 25 0 1 0 648913402 274862080 7821 33554432000 134512640 135204385 4294576976 18446744073709551615 134536663 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/15699/statm: 67105 7821 64 169 0 66935 0
[pid=15700] ppid=15676 vsize=371804 CPUtime=0 cores=0-7
/proc/15700/stat : 15700 (python) S 15676 15676 15650 0 -1 4202560 783 0 0 0 0 0 0 0 17 0 1 0 648913405 380727296 13491 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 3503870883133358337 0 0 17 2 0 0 0
/proc/15700/statm: 92951 13491 347 364 0 28851 0
[pid=15702] ppid=15700 vsize=268428 CPUtime=1.42 cores=0-7
/proc/15702/stat : 15702 (hybridGM3) R 15700 15702 15702 0 -1 4202496 8084 0 0 0 141 1 0 0 25 0 1 0 648913405 274870272 7818 33554432000 134512640 135204385 4293081248 18446744073709551615 134545866 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15702/statm: 67107 7818 64 169 0 66937 0
[pid=15703] ppid=15676 vsize=382060 CPUtime=0 cores=0-7
/proc/15703/stat : 15703 (python) S 15676 15676 15650 0 -1 4202560 813 0 0 0 0 0 0 0 17 0 1 0 648913408 391229440 13501 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 5844150596528996610 0 0 17 4 0 0 0
/proc/15703/statm: 95515 13501 353 364 0 31412 0
[pid=15705] ppid=15703 vsize=268424 CPUtime=1.35 cores=0-7
/proc/15705/stat : 15705 (hybridGM3) R 15703 15705 15705 0 -1 4202496 8092 0 0 0 135 0 0 0 25 0 1 0 648913409 274866176 7822 33554432000 134512640 135204385 4290917264 18446744073709551615 134547435 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/15705/statm: 67106 7822 64 169 0 66936 0
[pid=15676/tid=15683] ppid=15674 vsize=392304 CPUtime=0 cores=0-7
/proc/15676/task/15683/stat : 15683 (python) S 15674 15676 15650 0 -1 4202560 26 935 0 0 0 0 0 0 25 0 9 0 648913385 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 6 0 0 0
[pid=15676/tid=15686] ppid=15674 vsize=392304 CPUtime=0 cores=0-7
/proc/15676/task/15686/stat : 15686 (python) S 15674 15676 15650 0 -1 4202560 24 935 0 0 0 0 0 0 18 0 9 0 648913389 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 4 0 0 0
[pid=15676/tid=15689] ppid=15674 vsize=392304 CPUtime=0 cores=0-7
/proc/15676/task/15689/stat : 15689 (python) S 15674 15676 15650 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 9 0 648913392 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 0 0 0 0
[pid=15676/tid=15692] ppid=15674 vsize=392304 CPUtime=0 cores=0-7
/proc/15676/task/15692/stat : 15692 (python) S 15674 15676 15650 0 -1 4202560 26 935 0 0 0 0 0 0 20 0 9 0 648913395 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 0 0 0 0
[pid=15676/tid=15695] ppid=15674 vsize=392304 CPUtime=0 cores=0-7
/proc/15676/task/15695/stat : 15695 (python) S 15674 15676 15650 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 9 0 648913399 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 6 0 0 0
[pid=15676/tid=15698] ppid=15674 vsize=392304 CPUtime=0 cores=0-7
/proc/15676/task/15698/stat : 15698 (python) S 15674 15676 15650 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 9 0 648913402 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15701] ppid=15674 vsize=392304 CPUtime=0 cores=0-7
/proc/15676/task/15701/stat : 15701 (python) S 15674 15676 15650 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 648913405 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15704] ppid=15674 vsize=392304 CPUtime=0 cores=0-7
/proc/15676/task/15704/stat : 15704 (python) S 15674 15676 15650 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 9 0 648913409 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 19.52
Current children cumulated vsize (KiB) 5309004

[startup+25.5014 s]
/proc/loadavg: 1.83 0.41 0.13 9/423 15705
/proc/meminfo: memFree=15174500/32951124 swapFree=67111348/67111528
[pid=15676] ppid=15674 vsize=392304 CPUtime=7.51 cores=0-7
/proc/15676/stat : 15676 (python) S 15674 15676 15650 0 -1 4202496 28543 935 1 0 734 17 0 0 20 0 9 0 648912279 401719296 15041 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/15676/statm: 98076 15041 1889 364 0 33973 0
[pid=15682] ppid=15676 vsize=310268 CPUtime=0.03 cores=0-7
/proc/15682/stat : 15682 (python) S 15676 15676 15650 0 -1 4202560 904 0 0 0 1 2 0 0 15 0 1 0 648913385 317714432 13496 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788879 0 0 16781312 514 12409352113870569732 0 0 17 1 0 0 0
/proc/15682/statm: 77567 13496 376 364 0 13485 0
[pid=15684] ppid=15682 vsize=268424 CPUtime=14.43 cores=0-7
/proc/15684/stat : 15684 (hybridGM3) R 15682 15684 15684 0 -1 4202496 8085 0 0 0 1442 1 0 0 25 0 1 0 648913386 274866176 7824 33554432000 134512640 135204385 4287084112 18446744073709551615 134545975 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/15684/statm: 67106 7824 64 169 0 66936 0
[pid=15685] ppid=15676 vsize=320524 CPUtime=0.03 cores=0-7
/proc/15685/stat : 15685 (python) S 15676 15676 15650 0 -1 4202560 931 0 0 0 2 1 0 0 15 0 1 0 648913388 328216576 13494 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 12409352113870569730 0 0 17 4 0 0 0
/proc/15685/statm: 80131 13494 370 364 0 16046 0
[pid=15687] ppid=15685 vsize=268424 CPUtime=14.39 cores=0-7
/proc/15687/stat : 15687 (hybridGM3) R 15685 15687 15687 0 -1 4202496 8086 0 0 0 1439 0 0 0 25 0 1 0 648913389 274866176 7823 33554432000 134512640 135204385 4292408800 18446744073709551615 134536663 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15687/statm: 67106 7823 64 169 0 66936 0
[pid=15688] ppid=15676 vsize=330780 CPUtime=0.03 cores=0-7
/proc/15688/stat : 15688 (python) S 15676 15676 15650 0 -1 4202560 913 0 0 0 2 1 0 0 15 0 1 0 648913392 338718720 13498 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 12409352113870569730 0 0 17 0 0 0 0
/proc/15688/statm: 82695 13498 370 364 0 18607 0
[pid=15690] ppid=15688 vsize=268420 CPUtime=14.15 cores=0-7
/proc/15690/stat : 15690 (hybridGM3) R 15688 15690 15690 0 -1 4202496 8080 0 0 0 1414 1 0 0 25 0 1 0 648913392 274862080 7818 33554432000 134512640 135204385 4292263712 18446744073709551615 134547687 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/15690/statm: 67105 7818 64 169 0 66935 0
[pid=15691] ppid=15676 vsize=341036 CPUtime=0.03 cores=0-7
/proc/15691/stat : 15691 (python) S 15676 15676 15650 0 -1 4202560 940 0 0 0 2 1 0 0 15 0 1 0 648913395 349220864 13502 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 12409352113870569729 0 0 17 6 0 0 0
/proc/15691/statm: 85259 13502 370 364 0 21168 0
[pid=15693] ppid=15691 vsize=268420 CPUtime=14.29 cores=0-7
/proc/15693/stat : 15693 (hybridGM3) R 15691 15693 15693 0 -1 4202496 8079 0 0 0 1428 1 0 0 25 0 1 0 648913395 274862080 7819 33554432000 134512640 135204385 4287020224 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15693/statm: 67105 7819 64 169 0 66935 0
[pid=15694] ppid=15676 vsize=351292 CPUtime=0.03 cores=0-7
/proc/15694/stat : 15694 (python) S 15676 15676 15650 0 -1 4202560 947 0 0 0 1 2 0 0 15 0 1 0 648913398 359723008 13506 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 12409352113870569729 0 0 17 4 0 0 0
/proc/15694/statm: 87823 13506 370 364 0 23729 0
[pid=15696] ppid=15694 vsize=268428 CPUtime=14.25 cores=0-7

################
# More data... #
################

[pid=15794/tid=15817] ppid=15676 vsize=611692 CPUtime=0 cores=0-7
/proc/15794/task/15817/stat : 15817 (python) S 15676 15676 15650 0 -1 4202560 101 0 0 0 0 0 0 0 17 0 2 0 648992001 626372608 13974 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604451012119232 0 0 -1 5 0 0 0
[pid=15799] ppid=15676 vsize=621948 CPUtime=0.35 cores=0-7
/proc/15799/stat : 15799 (python) S 15676 15676 15650 0 -1 4202560 1282 0 0 0 16 19 0 0 19 0 2 0 648972928 636874752 13806 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/15799/statm: 155487 13806 400 364 0 91333 0
[pid=15801] ppid=15799 vsize=465044 CPUtime=100.33 cores=0-7
/proc/15801/stat : 15801 (TNM) T 15799 15801 15801 0 -1 4202496 6036 0 0 0 10032 1 0 0 25 0 1 0 648972930 476205056 5749 33554432000 134512640 135008748 4293478736 18446744073709551615 134529409 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15801/statm: 116261 5749 46 122 0 115161 0
[pid=15799/tid=15810] ppid=15676 vsize=621948 CPUtime=0 cores=0-7
/proc/15799/task/15810/stat : 15810 (python) S 15676 15676 15650 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 648982965 636874752 13806 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604447569858688 0 0 -1 0 0 0 0
[pid=15804] ppid=15676 vsize=632204 CPUtime=0.36 cores=0-7
/proc/15804/stat : 15804 (python) S 15676 15676 15650 0 -1 4202560 1267 0 0 0 18 18 0 0 19 0 2 0 648982374 647376896 13810 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15804/statm: 158051 13810 400 364 0 93894 0
[pid=15806] ppid=15804 vsize=465044 CPUtime=98.98 cores=0-7
/proc/15806/stat : 15806 (TNM) T 15804 15806 15806 0 -1 4202496 6035 0 0 0 9897 1 0 0 25 0 1 0 648982374 476205056 5749 33554432000 134512640 135008748 4287307952 18446744073709551615 134529448 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/15806/statm: 116261 5749 46 122 0 115161 0
[pid=15804/tid=15821] ppid=15676 vsize=632204 CPUtime=0 cores=0-7
/proc/15804/task/15821/stat : 15821 (python) S 15676 15676 15650 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 648992312 647376896 13810 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604453931593792 0 0 -1 4 0 0 0
[pid=15811] ppid=15676 vsize=642460 CPUtime=0.35 cores=0-7
/proc/15811/stat : 15811 (python) S 15676 15676 15650 0 -1 4202560 1248 0 0 0 16 19 0 0 19 0 2 0 648982973 657879040 13939 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/15811/statm: 160615 13939 400 364 0 96455 0
[pid=15813] ppid=15811 vsize=465044 CPUtime=99.29 cores=0-7
/proc/15813/stat : 15813 (TNM) T 15811 15813 15813 0 -1 4202496 6028 0 0 0 9928 1 0 0 25 0 1 0 648982974 476205056 5749 33554432000 134512640 135008748 4291374800 18446744073709551615 134527416 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/15813/statm: 116261 5749 46 122 0 115161 0
[pid=15811/tid=15828] ppid=15676 vsize=642460 CPUtime=0 cores=0-7
/proc/15811/task/15828/stat : 15828 (python) S 15676 15676 15650 0 -1 4202560 153 0 0 0 0 0 0 0 19 0 2 0 648992914 657879040 13939 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604444385708224 0 0 -1 1 0 0 0
[pid=15818] ppid=15676 vsize=652716 CPUtime=0.35 cores=0-7
/proc/15818/stat : 15818 (python) S 15676 15676 15650 0 -1 4202560 1200 0 0 0 19 16 0 0 19 0 2 0 648992008 668381184 13928 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/15818/statm: 163179 13928 401 364 0 99016 0
[pid=15820] ppid=15818 vsize=465044 CPUtime=99.86 cores=0-7
/proc/15820/stat : 15820 (TNM) T 15818 15820 15820 0 -1 4202496 6033 0 0 0 9986 0 0 0 25 0 1 0 648992008 476205056 5750 33554432000 134512640 135008748 4291633984 18446744073709551615 134527320 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/15820/statm: 116261 5750 46 122 0 115161 0
[pid=15818/tid=15835] ppid=15676 vsize=652716 CPUtime=0 cores=0-7
/proc/15818/task/15835/stat : 15835 (python) S 15676 15676 15650 0 -1 4202560 102 0 0 0 0 0 0 0 19 0 2 0 649002043 668381184 13928 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604453946389696 0 0 -1 4 0 0 0
[pid=15822] ppid=15676 vsize=662972 CPUtime=0.68 cores=0-7
/proc/15822/stat : 15822 (python) S 15676 15676 15650 0 -1 4202560 1248 0 0 0 37 31 0 0 19 0 2 0 648992318 678883328 14017 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15822/statm: 165743 14017 406 364 0 101577 0
[pid=15824] ppid=15822 vsize=431704 CPUtime=195.04 cores=0-7
/proc/15824/stat : 15824 (adaptg2wsat2009) T 15822 15824 15824 0 -1 4202496 6271 0 0 0 19503 1 0 0 25 0 1 0 648992319 442064896 5982 33554432000 134512640 135107411 4293057136 18446744073709551615 134531817 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/15824/statm: 107926 5982 59 146 0 106802 0
[pid=15822/tid=15846] ppid=15676 vsize=662972 CPUtime=0 cores=0-7
/proc/15822/task/15846/stat : 15846 (python) S 15676 15676 15650 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 649011897 678883328 14017 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604447722817408 0 0 -1 2 0 0 0
[pid=15825] ppid=15676 vsize=673228 CPUtime=0.35 cores=0-7
/proc/15825/stat : 15825 (python) S 15676 15676 15650 0 -1 4202560 1240 0 0 0 19 16 0 0 19 0 2 0 648992649 689385472 14007 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15825/statm: 168307 14007 407 364 0 104138 0
[pid=15827] ppid=15825 vsize=465044 CPUtime=100.34 cores=0-7
/proc/15827/stat : 15827 (TNM) T 15825 15827 15827 0 -1 4202496 6034 0 0 0 10033 1 0 0 25 0 1 0 648992650 476205056 5749 33554432000 134512640 135008748 4286664144 18446744073709551615 134527327 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/15827/statm: 116261 5749 46 122 0 115161 0
[pid=15825/tid=15839] ppid=15676 vsize=673228 CPUtime=0 cores=0-7
/proc/15825/task/15839/stat : 15839 (python) S 15676 15676 15650 0 -1 4202560 94 0 0 0 0 0 0 0 19 0 2 0 649002684 689385472 14007 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604441327658944 0 0 -1 3 0 0 0
[pid=15829] ppid=15676 vsize=683484 CPUtime=0.35 cores=0-7
/proc/15829/stat : 15829 (python) S 15676 15676 15650 0 -1 4202560 1244 0 0 0 19 16 0 0 19 0 2 0 648992921 699887616 14071 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15829/statm: 170871 14071 407 364 0 106699 0
[pid=15831] ppid=15829 vsize=465044 CPUtime=100.23 cores=0-7
/proc/15831/stat : 15831 (TNM) T 15829 15831 15831 0 -1 4202496 6037 0 0 0 10022 1 0 0 25 0 1 0 648992922 476205056 5749 33554432000 134512640 135008748 4286771680 18446744073709551615 134527416 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/15831/statm: 116261 5749 46 122 0 115161 0
[pid=15829/tid=15843] ppid=15676 vsize=683484 CPUtime=0 cores=0-7
/proc/15829/task/15843/stat : 15843 (python) S 15676 15676 15650 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 649002956 699887616 14071 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604450098505728 0 0 -1 5 0 0 0
[pid=15836] ppid=15676 vsize=693740 CPUtime=0.36 cores=0-7
/proc/15836/stat : 15836 (python) S 15676 15676 15650 0 -1 4202560 1260 0 0 0 19 17 0 0 19 0 2 0 649002050 710389760 14051 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/15836/statm: 173435 14051 407 364 0 109260 0
[pid=15838] ppid=15836 vsize=465044 CPUtime=100.19 cores=0-7
/proc/15838/stat : 15838 (TNM) T 15836 15838 15838 0 -1 4202496 6042 0 0 0 10018 1 0 0 25 0 1 0 649002050 476205056 5750 33554432000 134512640 135008748 4291535056 18446744073709551615 134535688 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/15838/statm: 116261 5750 46 122 0 115161 0
[pid=15836/tid=15850] ppid=15676 vsize=693740 CPUtime=0 cores=0-7
/proc/15836/task/15850/stat : 15850 (python) S 15676 15676 15650 0 -1 4202560 97 0 0 0 0 0 0 0 19 0 2 0 649012085 710389760 14051 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 514 18446604452861482944 0 0 -1 3 0 0 0
[pid=15840] ppid=15676 vsize=703996 CPUtime=0.33 cores=0-7
/proc/15840/stat : 15840 (python) S 15676 15676 15650 0 -1 4202560 1070 0 0 0 17 16 0 0 18 0 1 0 649002692 720891904 13955 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 12409352113870569731 0 0 17 2 0 0 0
/proc/15840/statm: 175999 13955 379 364 0 111821 0
[pid=15842] ppid=15840 vsize=465044 CPUtime=94.53 cores=0-7
/proc/15842/stat : 15842 (TNM) R 15840 15842 15842 0 -1 4202496 6039 0 0 0 9452 1 0 0 25 0 1 0 649002692 476205056 5750 33554432000 134512640 135008748 4286968336 18446744073709551615 134529448 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15842/statm: 116261 5750 46 122 0 115161 0
[pid=15847] ppid=15676 vsize=714252 CPUtime=0 cores=0-7
/proc/15847/stat : 15847 (python) S 15676 15676 15650 0 -1 4202560 977 0 0 0 0 0 0 0 18 0 1 0 649011904 731394048 13865 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 5642330014570479875 0 0 17 1 0 0 0
/proc/15847/statm: 178563 13865 349 364 0 114382 0
[pid=15849] ppid=15847 vsize=465044 CPUtime=2.45 cores=0-7
/proc/15849/stat : 15849 (TNM) R 15847 15849 15849 0 -1 4202496 6042 0 0 0 244 1 0 0 25 0 1 0 649011905 476205056 5750 33554432000 134512640 135008748 4290389328 18446744073709551615 134529183 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/15849/statm: 116261 5750 46 122 0 115161 0
[pid=15851] ppid=15676 vsize=724508 CPUtime=0 cores=0-7
/proc/15851/stat : 15851 (python) S 15676 15676 15650 0 -1 4202560 957 0 0 0 0 0 0 0 19 0 1 0 649012092 741896192 13864 33554432000 4194304 5683644 140737235854032 18446744073709551615 255106788934 0 0 16781312 514 1461060467219759103 0 0 17 2 0 0 0
/proc/15851/statm: 181127 13864 344 364 0 116943 0
[pid=15853] ppid=15851 vsize=465044 CPUtime=0.59 cores=0-7
/proc/15853/stat : 15853 (TNM) R 15851 15853 15853 0 -1 4202496 6041 0 0 0 58 1 0 0 22 0 1 0 649012093 476205056 5749 33554432000 134512640 135008748 4286805872 18446744073709551615 134528182 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/15853/statm: 116261 5749 46 122 0 115161 0
[pid=15676/tid=15683] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15683/stat : 15683 (python) S 15674 15676 15650 0 -1 4202560 38 935 0 0 0 0 0 0 16 0 36 0 648913385 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 6 0 0 0
[pid=15676/tid=15686] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15686/stat : 15686 (python) S 15674 15676 15650 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 36 0 648913389 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 4 0 0 0
[pid=15676/tid=15689] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15689/stat : 15689 (python) S 15674 15676 15650 0 -1 4202560 34 935 0 0 0 0 0 0 15 0 36 0 648913392 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 0 0 0 0
[pid=15676/tid=15692] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15692/stat : 15692 (python) S 15674 15676 15650 0 -1 4202560 29 935 0 0 0 0 0 0 15 0 36 0 648913395 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 0 0 0 0
[pid=15676/tid=15695] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15695/stat : 15695 (python) S 15674 15676 15650 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 36 0 648913399 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15698] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15698/stat : 15698 (python) S 15674 15676 15650 0 -1 4202560 37 935 0 0 0 0 0 0 18 0 36 0 648913402 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15701] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15701/stat : 15701 (python) S 15674 15676 15650 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 36 0 648913405 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15704] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15704/stat : 15704 (python) S 15674 15676 15650 0 -1 4202560 33 935 0 0 0 0 0 0 18 0 36 0 648913409 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 4 0 0 0
[pid=15676/tid=15718] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15718/stat : 15718 (python) S 15674 15676 15650 0 -1 4202560 34 935 0 0 0 0 0 0 18 0 36 0 648932981 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 6 0 0 0
[pid=15676/tid=15736] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15736/stat : 15736 (python) S 15674 15676 15650 0 -1 4202560 34 935 0 0 0 0 0 0 18 0 36 0 648943100 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 0 0 0 0
[pid=15676/tid=15739] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15739/stat : 15739 (python) S 15674 15676 15650 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 36 0 648943105 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 0 0 0 0
[pid=15676/tid=15742] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15742/stat : 15742 (python) S 15674 15676 15650 0 -1 4202560 24 935 0 0 0 0 0 0 18 0 36 0 648943109 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15745] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15745/stat : 15745 (python) S 15674 15676 15650 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 36 0 648943113 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 6 0 0 0
[pid=15676/tid=15748] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15748/stat : 15748 (python) S 15674 15676 15650 0 -1 4202560 32 935 0 0 0 0 0 0 22 0 36 0 648943118 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15751] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15751/stat : 15751 (python) S 15674 15676 15650 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 36 0 648943300 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15757] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15757/stat : 15757 (python) S 15674 15676 15650 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 36 0 648952754 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15760] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15760/stat : 15760 (python) S 15674 15676 15650 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 36 0 648952760 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15764] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15764/stat : 15764 (python) S 15674 15676 15650 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 36 0 648953145 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15769] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15769/stat : 15769 (python) S 15674 15676 15650 0 -1 4202560 37 935 0 0 0 0 0 0 18 0 36 0 648953247 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15773] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15773/stat : 15773 (python) S 15674 15676 15650 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 36 0 648953659 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15781] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15781/stat : 15781 (python) S 15674 15676 15650 0 -1 4202560 56 935 0 0 0 0 0 0 18 0 36 0 648962793 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 1 0 0 0
[pid=15676/tid=15785] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15785/stat : 15785 (python) S 15674 15676 15650 0 -1 4202560 149 935 0 0 0 0 0 0 18 0 36 0 648962826 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15789] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15789/stat : 15789 (python) S 15674 15676 15650 0 -1 4202560 47 935 0 0 0 0 0 0 18 0 36 0 648963698 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15795] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15795/stat : 15795 (python) S 15674 15676 15650 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 36 0 648972319 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 1 0 0 0
[pid=15676/tid=15800] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15800/stat : 15800 (python) S 15674 15676 15650 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 36 0 648972928 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15805] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15805/stat : 15805 (python) S 15674 15676 15650 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 36 0 648982374 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 1 0 0 0
[pid=15676/tid=15812] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15812/stat : 15812 (python) S 15674 15676 15650 0 -1 4202560 99 935 0 0 0 0 0 0 20 0 36 0 648982974 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15819] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15819/stat : 15819 (python) S 15674 15676 15650 0 -1 4202560 39 935 0 0 0 0 0 0 19 0 36 0 648992008 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 3 0 0 0
[pid=15676/tid=15823] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15823/stat : 15823 (python) S 15674 15676 15650 0 -1 4202560 38 935 0 0 0 0 0 0 20 0 36 0 648992319 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15826] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15826/stat : 15826 (python) S 15674 15676 15650 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 36 0 648992650 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15830] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15830/stat : 15830 (python) S 15674 15676 15650 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 36 0 648992922 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15837] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15837/stat : 15837 (python) S 15674 15676 15650 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 36 0 649002050 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 3 0 0 0
[pid=15676/tid=15841] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15841/stat : 15841 (python) S 15674 15676 15650 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 36 0 649002692 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15848] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15848/stat : 15848 (python) S 15674 15676 15650 0 -1 4202560 29 935 0 0 0 0 0 0 19 0 36 0 649011904 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
[pid=15676/tid=15852] ppid=15674 vsize=734752 CPUtime=0 cores=0-7
/proc/15676/task/15852/stat : 15852 (python) S 15674 15676 15650 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 36 0 649012093 752386048 15468 33554432000 4194304 5683644 140737235854032 18446744073709551615 255118592433 0 0 16781312 2 18446604443192665088 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7870.86
Current children cumulated vsize (KiB) 32113552

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15676 and gives
#  childrusage.ru_utime.tv_sec=1063
#  childrusage.ru_utime.tv_usec=823274
#  childrusage.ru_stime.tv_sec=7
#  childrusage.ru_stime.tv_usec=516857
# CPU time returned by wait4() is 1071.34
# while last known CPU time is 7870.86
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 998.947
CPU time (s): 7870.86
CPU user time (s): 7857.52
CPU system time (s): 13.34
CPU usage (%): 787.915
Max. virtual memory (cumulated for all children) (KiB): 32113552

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1063.82
system time used= 7.51686
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 96691
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11431
involuntary context switches= 15886

runsolver used 10.0125 second user time and 25.6621 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-16 18:56:01
IDJOB=3385243
IDBENCH=82508
IDSOLVER=1870
FILE ID=node144/3385243-1305564961
RUNJOBID= node144-1305564961-15664
PBS_JOBID= 13350106
Free space on /tmp= 73284 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v35000-c147000-S883457431-033-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385243-1305564961/watcher-3385243-1305564961 -o /tmp/evaluation-result-3385243-1305564961/solver-3385243-1305564961 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385243-1305564961.cnf -seed 1352173723 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0d0abbf84f73b4226aa3bedf08367d2e
RANDOM SEED=1352173723

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15516040 kB
Buffers:        327748 kB
Cached:        4111920 kB
SwapCached:          0 kB
Active:       14222676 kB
Inactive:      2848276 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15516040 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           34556 kB
Writeback:           0 kB
AnonPages:    12630928 kB
Mapped:          35404 kB
Slab:           245560 kB
PageTables:      52564 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 113614436 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73256 MiB
End job on node144 at 2011-05-16 19:12:42