Trace number 3385429

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 10209.1 1284.92

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S1116436500-050-UNKNOWN.cnf
MD5SUMcfa9ddae87a68697f7100e24d97d7728
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.37/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.67	c INFO: solving HOME/instance-3385429-1305566511.cnf
0.37/0.67	c INFO: computing task features
0.54/0.81	c INFO: computed variable-clause graph statistics
0.54/0.82	c INFO: computed clause balance statistics
1.24/1.55	c INFO: computed variable balance statistics
1.54/1.85	c INFO: computed small-clause counts
1.54/1.85	c INFO: computed Horn-clause counts
1.54/1.87	c INFO: computed variable graph statistics
1.54/1.87	c INFO: collected features for HOME/instance-3385429-1305566511.cnf in 1.20 s
1.64/1.90	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.36)
1.64/1.93	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
1.64/1.96	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
1.64/1.99	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
1.74/2.02	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.05)
1.74/2.05	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.04)
1.74/2.08	c INFO: running FH@0 for 97 with 4998 remaining (b = 0.03)
2.52/2.11	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.03)
801.56/102.31	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.02)
802.43/102.35	c INFO: running FH@0 for 97 with 4898 remaining (b = 0.02)
802.43/102.39	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.04)
802.89/102.43	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.02)
802.89/102.48	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.03)
803.24/102.52	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.03)
803.24/102.57	c INFO: running TNM@0 for 1552 with 4898 remaining (b = 0.20)
803.34/102.62	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.01)
1602.27/202.72	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1602.27/202.77	c INFO: running hybridGM3@0 for 194 with 4797 remaining (b = 0.02)
1602.97/202.90	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1604.18/203.08	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
2370.01/299.18	c INFO: running hybridGM3@100 for 97 with 4701 remaining (b = 0.01)
2371.57/299.40	c INFO: running hybridGM3@100 for 97 with 4701 remaining (b = 0.01)
2378.77/300.30	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.01)
2380.29/300.48	c INFO: running adaptg2wsat2009++@100 for 97 with 4700 remaining (b = 0.01)
2401.83/303.15	c INFO: running hybridGM3@0 for 194 with 4697 remaining (b = 0.02)
2411.38/304.36	c INFO: running hybridGM3@98 for 97 with 4696 remaining (b = 0.01)
3129.77/394.57	c INFO: running hybridGM3@296 for 97 with 4606 remaining (b = 0.01)
3131.36/394.77	c INFO: running TNM@0 for 1455 with 4605 remaining (b = 0.14)
3132.18/394.84	c INFO: running adaptg2wsat2009++@100 for 97 with 4605 remaining (b = 0.01)
3164.77/398.99	c INFO: running gnovelty+2@0 for 97 with 4601 remaining (b = 0.01)
3170.33/399.64	c INFO: running hybridGM3@100 for 97 with 4601 remaining (b = 0.01)
3218.92/405.77	c INFO: running hybridGM3@193 for 97 with 4594 remaining (b = 0.01)
3907.79/492.25	c INFO: running hybridGM3@0 for 194 with 4508 remaining (b = 0.02)
3930.23/495.03	c INFO: running iPAWS@0 for 97 with 4505 remaining (b = 0.01)
3936.40/495.98	c INFO: running hybridGM3@391 for 97 with 4504 remaining (b = 0.01)
3970.67/500.16	c INFO: running FH@0 for 97 with 4500 remaining (b = 0.01)
4009.67/505.03	c INFO: running hybridGM3@0 for 194 with 4495 remaining (b = 0.02)
4012.48/505.48	c INFO: running adaptg2wsat2009++@100 for 97 with 4495 remaining (b = 0.01)
4713.61/593.51	c INFO: running FH@0 for 291 with 4407 remaining (b = 0.02)
4743.96/597.40	c INFO: running hybridGM3@484 for 97 with 4403 remaining (b = 0.01)
4762.11/599.61	c INFO: running FH@196 for 194 with 4401 remaining (b = 0.02)
4788.37/602.92	c INFO: running iPAWS@0 for 97 with 4397 remaining (b = 0.01)
5502.69/692.80	c INFO: running hybridGM3@0 for 194 with 4307 remaining (b = 0.01)
5521.80/695.13	c INFO: running hybridGM3@95 for 97 with 4305 remaining (b = 0.01)
5575.79/701.91	c INFO: running hybridGM3@102 for 97 with 4298 remaining (b = 0.01)
5586.92/703.36	c INFO: running adaptg2wsat2009++@98 for 97 with 4297 remaining (b = 0.01)
6328.26/796.56	c INFO: running hybridGM3@292 for 97 with 4204 remaining (b = 0.01)
6334.63/797.32	c INFO: running TNM@0 for 1552 with 4203 remaining (b = 0.11)
6334.63/797.41	c INFO: running FH@293 for 97 with 4203 remaining (b = 0.01)
6361.69/800.79	c INFO: running adaptg2wsat2009++@97 for 97 with 4199 remaining (b = 0.01)
7060.82/888.71	c INFO: running iPAWS@0 for 97 with 4112 remaining (b = 0.01)
7061.63/888.78	c INFO: running hybridGM3@0 for 194 with 4111 remaining (b = 0.01)
7087.01/891.97	c INFO: running hybridGM3@386 for 194 with 4108 remaining (b = 0.02)
7094.17/892.82	c INFO: running NCVWr@0 for 485 with 4107 remaining (b = 0.03)
7137.10/898.25	c INFO: running adaptg2wsat2009++@292 for 291 with 4102 remaining (b = 0.02)
7859.92/989.16	c INFO: running FH@100 for 291 with 4011 remaining (b = 0.02)
8659.08/1089.76	c INFO: running hybridGM3@481 for 97 with 3910 remaining (b = 0.01)
8666.22/1090.69	c INFO: running hybridGM3@93 for 97 with 3910 remaining (b = 0.01)
9417.62/1185.17	c INFO: running gnovelty+2@0 for 97 with 3815 remaining (b = 0.01)
9473.23/1192.13	c INFO: running hybridGM3@188 for 97 with 3808 remaining (b = 0.01)
9474.86/1192.38	c INFO: running adaptg2wsat2009++@392 for 194 with 3808 remaining (b = 0.01)
10165.25/1279.29	c INFO: running FH@297 for 97 with 3721 remaining (b = 0.01)
10200.23/1283.70	c INFO: running hybridGM3@0 for 194 with 3717 remaining (b = 0.01)
10209.07/1284.82	c INFO: running hybridGM3@0 for 194 with 3715 remaining (b = 0.01)
10209.07/1284.89	c INFO: running TNM@0 for 1552 with 3715 remaining (b = 0.08)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385429-1305566511/watcher-3385429-1305566511 -o /tmp/evaluation-result-3385429-1305566511/solver-3385429-1305566511 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385429-1305566511.cnf -seed 1266908400 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.17 8.48 6.83 2/460 4219
/proc/meminfo: memFree=19545012/32950928 swapFree=38710912/67111528
[pid=4219] ppid=4217 vsize=15380 CPUtime=0 cores=0-7
/proc/4219/stat : 4219 (python) R 4217 4219 3915 0 -1 4202496 790 0 0 0 0 0 0 0 20 0 1 0 746881844 15749120 679 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367544832 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/4219/statm: 3845 679 322 364 0 332 0

[startup+0.07142 s]
/proc/loadavg: 8.17 8.48 6.83 2/460 4219
/proc/meminfo: memFree=19545012/32950928 swapFree=38710912/67111528
[pid=4219] ppid=4217 vsize=36508 CPUtime=0.04 cores=0-7
/proc/4219/stat : 4219 (python) S 4217 4219 3915 0 -1 4202496 1618 0 0 0 3 1 0 0 20 0 1 0 746881844 37384192 1450 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/4219/statm: 9127 1450 452 364 0 944 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 36508

[startup+0.100417 s]
/proc/loadavg: 8.17 8.48 6.83 2/460 4219
/proc/meminfo: memFree=19545012/32950928 swapFree=38710912/67111528
[pid=4219] ppid=4217 vsize=89768 CPUtime=0.06 cores=0-7
/proc/4219/stat : 4219 (python) R 4217 4219 3915 0 -1 4202496 2671 0 0 0 4 2 0 0 20 0 1 0 746881844 91922432 2388 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367544832 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/4219/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89768

[startup+0.300347 s]
/proc/loadavg: 8.17 8.48 6.83 2/460 4219
/proc/meminfo: memFree=19545012/32950928 swapFree=38710912/67111528
[pid=4219] ppid=4217 vsize=135748 CPUtime=0.19 cores=0-7
/proc/4219/stat : 4219 (python) R 4217 4219 3915 0 -1 4202496 5963 938 1 0 14 5 0 0 17 0 1 0 746881844 139005952 4151 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367542789 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/4219/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700298 s]
/proc/loadavg: 8.17 8.48 6.83 2/460 4219
/proc/meminfo: memFree=19545012/32950928 swapFree=38710912/67111528
[pid=4219] ppid=4217 vsize=279508 CPUtime=0.44 cores=0-7
/proc/4219/stat : 4219 (python) R 4217 4219 3915 0 -1 4202496 9526 938 1 0 32 12 0 0 16 0 1 0 746881844 286216192 7209 33554432000 4194304 5683644 140734389033856 18446744073709551615 4527934 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/4219/statm: 69877 7209 1761 364 0 5801 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 279508

[startup+1.50114 s]
/proc/loadavg: 8.17 8.48 6.83 2/461 4224
/proc/meminfo: memFree=19518780/32950928 swapFree=38710912/67111528
[pid=4219] ppid=4217 vsize=283912 CPUtime=1.24 cores=0-7
/proc/4219/stat : 4219 (python) R 4217 4219 3915 0 -1 4202496 11841 938 1 0 112 12 0 0 17 0 1 0 746881844 290725888 8363 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367233248 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/4219/statm: 70978 8363 1826 364 0 6902 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 283912

[startup+3.10075 s]
/proc/loadavg: 8.17 8.48 6.83 9/481 4244
/proc/meminfo: memFree=19478684/32950928 swapFree=38710912/67111528
[pid=4219] ppid=4217 vsize=427652 CPUtime=1.86 cores=0-7
/proc/4219/stat : 4219 (python) S 4217 4219 3915 0 -1 4202496 17820 938 1 0 171 15 0 0 22 0 9 0 746881844 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/4219/statm: 106913 7651 1891 364 0 42810 0
[pid=4225] ppid=4219 vsize=279924 CPUtime=0 cores=0-7
/proc/4225/stat : 4225 (python) S 4219 4219 3915 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 746882034 286642176 5769 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566863 0 0 16781312 514 8724272926976606466 0 0 17 1 0 0 0
/proc/4225/statm: 69981 5769 355 364 0 5899 0
[pid=4227] ppid=4225 vsize=1018820 CPUtime=1.18 cores=0-7
/proc/4227/stat : 4227 (gnovelty+2) R 4225 4227 4227 0 -1 4202496 859 0 0 0 118 0 0 0 22 0 1 0 746882035 1043271680 595 33554432000 134512640 135663704 4288953120 18446744073709551615 134545619 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/4227/statm: 254705 595 113 282 0 254421 0
[pid=4228] ppid=4219 vsize=290820 CPUtime=0 cores=0-7
/proc/4228/stat : 4228 (python) S 4219 4219 3915 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 746882037 297799680 5792 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 3920191890019811586 0 0 17 1 0 0 0
/proc/4228/statm: 72705 5792 349 364 0 8620 0
[pid=4230] ppid=4228 vsize=1018820 CPUtime=1.15 cores=0-7
/proc/4230/stat : 4230 (gnovelty+2) R 4228 4230 4230 0 -1 4202496 859 0 0 0 115 0 0 0 25 0 1 0 746882037 1043271680 595 33554432000 134512640 135663704 4289281584 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/4230/statm: 254705 595 113 282 0 254421 0
[pid=4231] ppid=4219 vsize=366128 CPUtime=0 cores=0-7
/proc/4231/stat : 4231 (python) S 4219 4219 3915 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 746882040 374915072 5930 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 8358845014805053439 0 0 17 1 0 0 0
/proc/4231/statm: 91532 5930 347 364 0 27444 0
[pid=4233] ppid=4231 vsize=419160 CPUtime=1.13 cores=0-7
/proc/4233/stat : 4233 (adaptg2wsat2009) R 4231 4233 4233 0 -1 4202496 1257 0 0 0 113 0 0 0 25 0 1 0 746882041 429219840 990 33554432000 134512640 135107411 4290795200 18446744073709551615 134523500 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/4233/statm: 104790 990 49 146 0 103666 0
[pid=4234] ppid=4219 vsize=376384 CPUtime=0 cores=0-7
/proc/4234/stat : 4234 (python) S 4219 4219 3915 0 -1 4202560 748 0 0 0 0 0 0 0 18 0 1 0 746882043 385417216 5935 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 4453826114665578495 0 0 17 1 0 0 0
/proc/4234/statm: 94096 5935 347 364 0 30005 0
[pid=4236] ppid=4234 vsize=419160 CPUtime=1.09 cores=0-7
/proc/4236/stat : 4236 (adaptg2wsat2009) R 4234 4236 4236 0 -1 4202496 1255 0 0 0 109 0 0 0 25 0 1 0 746882043 429219840 990 33554432000 134512640 135107411 4291782752 18446744073709551615 134523261 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/4236/statm: 104790 990 49 146 0 103666 0
[pid=4237] ppid=4219 vsize=386640 CPUtime=0 cores=0-7
/proc/4237/stat : 4237 (python) S 4219 4219 3915 0 -1 4202560 720 0 0 0 0 0 0 0 18 0 1 0 746882046 395919360 6110 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 9451340109128400895 0 0 17 1 0 0 0
/proc/4237/statm: 96660 6110 348 364 0 32566 0
[pid=4239] ppid=4237 vsize=419160 CPUtime=1.06 cores=0-7
/proc/4239/stat : 4239 (adaptg2wsat2009) R 4237 4239 4239 0 -1 4202496 1249 0 0 0 106 0 0 0 24 0 1 0 746882047 429219840 991 33554432000 134512640 135107411 4291829792 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/4239/statm: 104790 991 49 146 0 103666 0
[pid=4240] ppid=4219 vsize=396896 CPUtime=0 cores=0-7
/proc/4240/stat : 4240 (python) S 4219 4219 3915 0 -1 4202560 729 0 0 0 0 0 0 0 18 0 1 0 746882049 406421504 6078 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 14692637821701685505 0 0 17 1 0 0 0
/proc/4240/statm: 99224 6078 348 364 0 35127 0
[pid=4242] ppid=4240 vsize=1018820 CPUtime=1.02 cores=0-7
/proc/4242/stat : 4242 (gnovelty+2) R 4240 4242 4242 0 -1 4202496 854 0 0 0 102 0 0 0 25 0 1 0 746882050 1043271680 596 33554432000 134512640 135663704 4288000288 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/4242/statm: 254705 596 113 282 0 254421 0
[pid=4243] ppid=4219 vsize=407152 CPUtime=0 cores=0-7
/proc/4243/stat : 4243 (python) S 4219 4219 3915 0 -1 4202560 719 0 0 0 0 0 0 0 21 0 1 0 746882052 416923648 6079 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 8497096782247886847 0 0 17 1 0 0 0
/proc/4243/statm: 101788 6079 344 364 0 37688 0
[pid=4219/tid=4226] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4226/stat : 4226 (python) S 4217 4219 3915 0 -1 4202560 26 938 0 0 0 0 0 0 18 0 9 0 746882034 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4229] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4229/stat : 4229 (python) S 4217 4219 3915 0 -1 4202560 20 938 0 0 0 0 0 0 19 0 9 0 746882037 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 3 0 0 0
[pid=4219/tid=4232] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4232/stat : 4232 (python) S 4217 4219 3915 0 -1 4202560 24 938 0 0 0 0 0 0 19 0 9 0 746882040 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 6 0 0 0
[pid=4219/tid=4235] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4235/stat : 4235 (python) S 4217 4219 3915 0 -1 4202560 21 938 0 0 0 0 0 0 18 0 9 0 746882043 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 5 0 0 0
[pid=4219/tid=4238] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4238/stat : 4238 (python) S 4217 4219 3915 0 -1 4202560 89 938 0 0 0 0 0 0 19 0 9 0 746882046 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 0 0 0 0
[pid=4219/tid=4241] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4241/stat : 4241 (python) S 4217 4219 3915 0 -1 4202560 33 938 0 0 0 0 0 0 20 0 9 0 746882049 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 7 0 0 0
[pid=4219/tid=4244] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4244/stat : 4244 (python) S 4217 4219 3915 0 -1 4202560 42 938 0 0 0 0 0 0 21 0 9 0 746882053 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 8.49
Current children cumulated vsize (KiB) 7245536

[startup+6.30116 s]
/proc/loadavg: 8.15 8.48 6.83 9/485 4248
/proc/meminfo: memFree=19466732/32950928 swapFree=38710912/67111528
[pid=4219] ppid=4217 vsize=427652 CPUtime=1.86 cores=0-7
/proc/4219/stat : 4219 (python) S 4217 4219 3915 0 -1 4202496 17820 938 1 0 171 15 0 0 22 0 9 0 746881844 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/4219/statm: 106913 7651 1891 364 0 42810 0
[pid=4225] ppid=4219 vsize=279924 CPUtime=0.02 cores=0-7
/proc/4225/stat : 4225 (python) S 4219 4219 3915 0 -1 4202560 902 0 0 0 1 1 0 0 18 0 1 0 746882034 286642176 5792 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566863 0 0 16781312 514 8724272926976606466 0 0 17 1 0 0 0
/proc/4225/statm: 69981 5792 378 364 0 5899 0
[pid=4227] ppid=4225 vsize=1018820 CPUtime=4.36 cores=0-7
/proc/4227/stat : 4227 (gnovelty+2) R 4225 4227 4227 0 -1 4202496 859 0 0 0 436 0 0 0 25 0 1 0 746882035 1043271680 595 33554432000 134512640 135663704 4288953120 18446744073709551615 134545619 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/4227/statm: 254705 595 113 282 0 254421 0
[pid=4228] ppid=4219 vsize=290820 CPUtime=0.01 cores=0-7
/proc/4228/stat : 4228 (python) S 4219 4219 3915 0 -1 4202560 903 0 0 0 0 1 0 0 18 0 1 0 746882037 297799680 5815 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 3920191890019811586 0 0 17 4 0 0 0
/proc/4228/statm: 72705 5815 372 364 0 8620 0
[pid=4230] ppid=4228 vsize=1018820 CPUtime=4.35 cores=0-7
/proc/4230/stat : 4230 (gnovelty+2) R 4228 4230 4230 0 -1 4202496 859 0 0 0 435 0 0 0 25 0 1 0 746882037 1043271680 595 33554432000 134512640 135663704 4289281584 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/4230/statm: 254705 595 113 282 0 254421 0
[pid=4231] ppid=4219 vsize=366128 CPUtime=0.02 cores=0-7
/proc/4231/stat : 4231 (python) S 4219 4219 3915 0 -1 4202560 915 0 0 0 1 1 0 0 18 0 1 0 746882040 374915072 5953 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 8358845014805020932 0 0 17 1 0 0 0
/proc/4231/statm: 91532 5953 370 364 0 27444 0
[pid=4233] ppid=4231 vsize=419428 CPUtime=4.32 cores=0-7
/proc/4233/stat : 4233 (adaptg2wsat2009) R 4231 4233 4233 0 -1 4202496 1443 0 0 0 432 0 0 0 25 0 1 0 746882041 429494272 1176 33554432000 134512640 135107411 4290795200 18446744073709551615 134532088 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/4233/statm: 104857 1176 59 146 0 103733 0
[pid=4234] ppid=4219 vsize=376384 CPUtime=0.01 cores=0-7
/proc/4234/stat : 4234 (python) S 4219 4219 3915 0 -1 4202560 936 0 0 0 0 1 0 0 18 0 1 0 746882043 385417216 5957 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 4453826114665545985 0 0 17 1 0 0 0
/proc/4234/statm: 94096 5957 369 364 0 30005 0
[pid=4236] ppid=4234 vsize=419428 CPUtime=4.29 cores=0-7
/proc/4236/stat : 4236 (adaptg2wsat2009) R 4234 4236 4236 0 -1 4202496 1441 0 0 0 429 0 0 0 25 0 1 0 746882043 429494272 1176 33554432000 134512640 135107411 4291782752 18446744073709551615 134531604 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/4236/statm: 104857 1176 59 146 0 103733 0
[pid=4237] ppid=4219 vsize=386640 CPUtime=0.01 cores=0-7
/proc/4237/stat : 4237 (python) S 4219 4219 3915 0 -1 4202560 799 0 0 0 1 0 0 0 18 0 1 0 746882046 395919360 6132 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 9451340109128368385 0 0 17 1 0 0 0
/proc/4237/statm: 96660 6132 370 364 0 32566 0
[pid=4239] ppid=4237 vsize=419428 CPUtime=4.26 cores=0-7
/proc/4239/stat : 4239 (adaptg2wsat2009) R 4237 4239 4239 0 -1 4202496 1434 0 0 0 426 0 0 0 25 0 1 0 746882047 429494272 1176 33554432000 134512640 135107411 4291829792 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/4239/statm: 104857 1176 59 146 0 103733 0
[pid=4240] ppid=4219 vsize=396896 CPUtime=0.02 cores=0-7
/proc/4240/stat : 4240 (python) S 4219 4219 3915 0 -1 4202560 809 0 0 0 1 1 0 0 18 0 1 0 746882049 406421504 6101 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 14692637821701685505 0 0 17 1 0 0 0
/proc/4240/statm: 99224 6101 371 364 0 35127 0
[pid=4242] ppid=4240 vsize=1018820 CPUtime=4.09 cores=0-7
/proc/4242/stat : 4242 (gnovelty+2) R 4240 4242 4242 0 -1 4202496 854 0 0 0 409 0 0 0 25 0 1 0 746882050 1043271680 596 33554432000 134512640 135663704 4288000288 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/4242/statm: 254705 596 113 282 0 254421 0
[pid=4243] ppid=4219 vsize=407152 CPUtime=0.02 cores=0-7
/proc/4243/stat : 4243 (python) S 4219 4219 3915 0 -1 4202560 825 0 0 0 1 1 0 0 18 0 1 0 746882052 416923648 6105 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 8497096782247854338 0 0 17 1 0 0 0
/proc/4243/statm: 101788 6105 370 364 0 37688 0
[pid=4247] ppid=4243 vsize=249188 CPUtime=4.17 cores=0-7
/proc/4247/stat : 4247 (FH) R 4243 4247 4247 0 -1 4202496 1318 0 0 0 417 0 0 0 25 0 1 0 746882056 255168512 1058 33554432000 134512640 134936988 4293148288 18446744073709551615 134544962 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/4247/statm: 62297 1058 41 104 0 61801 0
[pid=4245] ppid=4219 vsize=417408 CPUtime=0.01 cores=0-7
/proc/4245/stat : 4245 (python) S 4219 4219 3915 0 -1 4202560 861 0 0 0 1 0 0 0 18 0 1 0 746882056 427425792 6133 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 14692630125120291074 0 0 17 7 0 0 0
/proc/4245/statm: 104352 6133 377 364 0 40249 0
[pid=4248] ppid=4245 vsize=419428 CPUtime=4.1 cores=0-7
/proc/4248/stat : 4248 (adaptg2wsat2009) R 4245 4248 4248 0 -1 4202496 1444 0 0 0 410 0 0 0 25 0 1 0 746882056 429494272 1177 33554432000 134512640 135107411 4287922960 18446744073709551615 134532347 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/4248/statm: 104857 1177 59 146 0 103733 0
[pid=4219/tid=4226] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4226/stat : 4226 (python) S 4217 4219 3915 0 -1 4202560 26 938 0 0 0 0 0 0 18 0 9 0 746882034 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4229] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4229/stat : 4229 (python) S 4217 4219 3915 0 -1 4202560 20 938 0 0 0 0 0 0 19 0 9 0 746882037 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 3 0 0 0
[pid=4219/tid=4232] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4232/stat : 4232 (python) S 4217 4219 3915 0 -1 4202560 24 938 0 0 0 0 0 0 19 0 9 0 746882040 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 6 0 0 0
[pid=4219/tid=4235] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4235/stat : 4235 (python) S 4217 4219 3915 0 -1 4202560 21 938 0 0 0 0 0 0 18 0 9 0 746882043 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 5 0 0 0
[pid=4219/tid=4238] ppid=4217 vsize=427652 CPUtime=0 cores=0-7
/proc/4219/task/4238/stat : 4238 (python) S 4217 4219 3915 0 -1 4202560 89 938 0 0 0 0 0 0 19 0 9 0 746882046 437915648 7651 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 0 0 0 0
[pid=4219/tid=4241] ppid=4217 vsize=427652 CPUtime=0 cores=0-7

################
# More data... #
################

/proc/4318/statm: 140248 6415 406 364 0 76103 0
[pid=4320] ppid=4318 vsize=268428 CPUtime=682.18 cores=0-7
/proc/4320/stat : 4320 (hybridGM3) T 4318 4320 4320 0 -1 4202496 5295 0 0 0 68218 0 0 0 25 0 1 0 746931070 274870272 5010 33554432000 134512640 135204385 4294383840 18446744073709551615 134538355 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/4320/statm: 67107 5010 63 169 0 66937 0
[pid=4318/tid=4345] ppid=4219 vsize=560992 CPUtime=0 cores=0-7
/proc/4318/task/4345/stat : 4345 (python) S 4219 4219 3915 0 -1 4202560 87 0 0 0 0 0 0 0 18 0 2 0 746951351 574455808 6415 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604460274143680 0 0 -1 4 0 0 0
[pid=4321] ppid=4219 vsize=571248 CPUtime=0.38 cores=0-7
/proc/4321/stat : 4321 (python) S 4219 4219 3915 0 -1 4202560 1173 0 0 0 20 18 0 0 19 0 2 0 746931347 584957952 6496 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/4321/statm: 142812 6496 406 364 0 78664 0
[pid=4323] ppid=4321 vsize=335996 CPUtime=98 cores=0-7
/proc/4323/stat : 4323 (iPAWS) T 4321 4323 4323 0 -1 4202496 1711 0 0 0 9800 0 0 0 25 0 1 0 746931348 344059904 1427 33554432000 134512640 135114423 4290211920 18446744073709551615 134514774 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/4323/statm: 83999 1427 59 147 0 83851 0
[pid=4321/tid=4334] ppid=4219 vsize=571248 CPUtime=0 cores=0-7
/proc/4321/task/4334/stat : 4334 (python) S 4219 4219 3915 0 -1 4202560 80 0 0 0 0 0 0 0 19 0 2 0 746941189 584957952 6496 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604462966848256 0 0 -1 4 0 0 0
[pid=4324] ppid=4219 vsize=581504 CPUtime=1.52 cores=0-7
/proc/4324/stat : 4324 (python) S 4219 4219 3915 0 -1 4202560 1197 0 0 0 77 75 0 0 18 0 2 0 746931861 595460096 6508 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/4324/statm: 145376 6508 406 364 0 81225 0
[pid=4326] ppid=4324 vsize=249192 CPUtime=391.9 cores=0-7
/proc/4326/stat : 4326 (FH) T 4324 4326 4326 0 -1 4202496 1343 0 0 0 39190 0 0 0 25 0 1 0 746931861 255172608 1059 33554432000 134512640 134936988 4286604992 18446744073709551615 134553480 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/4326/statm: 62298 1059 41 104 0 61802 0
[pid=4324/tid=4336] ppid=4219 vsize=581504 CPUtime=0 cores=0-7
/proc/4324/task/4336/stat : 4336 (python) S 4219 4219 3915 0 -1 4202560 86 0 0 0 0 0 0 0 18 0 2 0 746941799 595460096 6508 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604460791759296 0 0 -1 0 0 0 0
[pid=4328] ppid=4219 vsize=591760 CPUtime=1.1 cores=0-7
/proc/4328/stat : 4328 (python) S 4219 4219 3915 0 -1 4202560 1187 0 0 0 58 52 0 0 18 0 2 0 746932347 605962240 6462 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/4328/statm: 147940 6462 400 364 0 83786 0
[pid=4330] ppid=4328 vsize=268428 CPUtime=291.41 cores=0-7
/proc/4330/stat : 4330 (hybridGM3) T 4328 4330 4330 0 -1 4202496 5297 0 0 0 29140 1 0 0 25 0 1 0 746932347 274870272 5010 33554432000 134512640 135204385 4293003488 18446744073709551615 134538452 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/4330/statm: 67107 5010 63 169 0 66937 0
[pid=4328/tid=4347] ppid=4219 vsize=591760 CPUtime=0 cores=0-7
/proc/4328/task/4347/stat : 4347 (python) S 4219 4219 3915 0 -1 4202560 85 0 0 0 0 0 0 0 18 0 2 0 746952029 605962240 6462 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604460437533056 0 0 -1 4 0 0 0
[pid=4337] ppid=4219 vsize=602016 CPUtime=0.38 cores=0-7
/proc/4337/stat : 4337 (python) S 4219 4219 3915 0 -1 4202560 1182 0 0 0 19 19 0 0 19 0 2 0 746942136 616464384 6438 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/4337/statm: 150504 6438 400 364 0 86347 0
[pid=4339] ppid=4337 vsize=335996 CPUtime=98.55 cores=0-7
/proc/4339/stat : 4339 (iPAWS) T 4337 4339 4339 0 -1 4202496 1706 0 0 0 9855 0 0 0 25 0 1 0 746942136 344059904 1427 33554432000 134512640 135114423 4288354416 18446744073709551615 134515504 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/4339/statm: 83999 1427 59 147 0 83851 0
[pid=4337/tid=4348] ppid=4219 vsize=602016 CPUtime=0 cores=0-7
/proc/4337/task/4348/stat : 4348 (python) S 4219 4219 3915 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 746952174 616464384 6438 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604466272519104 0 0 -1 0 0 0 0
[pid=4342] ppid=4219 vsize=612272 CPUtime=0.75 cores=0-7
/proc/4342/stat : 4342 (python) S 4219 4219 3915 0 -1 4202560 1195 0 0 0 40 35 0 0 19 0 2 0 746951124 626966528 6529 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/4342/statm: 153068 6529 400 364 0 88908 0
[pid=4344] ppid=4342 vsize=268424 CPUtime=195.25 cores=0-7
/proc/4344/stat : 4344 (hybridGM3) T 4342 4344 4344 0 -1 4202496 5293 0 0 0 19525 0 0 0 25 0 1 0 746951125 274866176 5010 33554432000 134512640 135204385 4289864640 18446744073709551615 134538541 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/4344/statm: 67106 5010 63 169 0 66936 0
[pid=4342/tid=4356] ppid=4219 vsize=612272 CPUtime=0 cores=0-7
/proc/4342/task/4356/stat : 4356 (python) S 4219 4219 3915 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 746970709 626966528 6529 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604462791930112 0 0 -1 7 0 0 0
[pid=4351] ppid=4219 vsize=622528 CPUtime=1.86 cores=0-7
/proc/4351/stat : 4351 (python) S 4219 4219 3915 0 -1 4202560 1011 0 0 0 101 85 0 0 18 0 1 0 746961576 637468672 6482 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 12434720046146617606 0 0 17 0 0 0 0
/proc/4351/statm: 155632 6482 372 364 0 91469 0
[pid=4353] ppid=4351 vsize=457660 CPUtime=485.53 cores=0-7
/proc/4353/stat : 4353 (TNM) R 4351 4353 4353 0 -1 4202496 1321 0 0 0 48553 0 0 0 25 0 1 0 746961579 468643840 1036 33554432000 134512640 135008748 4289465728 18446744073709551615 134527809 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/4353/statm: 114415 1036 46 122 0 113315 0
[pid=4357] ppid=4219 vsize=632784 CPUtime=0.39 cores=0-7
/proc/4357/stat : 4357 (python) S 4219 4219 3915 0 -1 4202560 1257 0 0 0 21 18 0 0 19 0 2 0 746970715 647970816 6523 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/4357/statm: 158196 6523 407 364 0 94030 0
[pid=4359] ppid=4357 vsize=335996 CPUtime=99.98 cores=0-7
/proc/4359/stat : 4359 (iPAWS) T 4357 4359 4359 0 -1 4202496 1723 0 0 0 9998 0 0 0 25 0 1 0 746970715 344059904 1428 33554432000 134512640 135114423 4289533200 18446744073709551615 134514774 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/4359/statm: 83999 1428 59 147 0 83851 0
[pid=4357/tid=4369] ppid=4219 vsize=632784 CPUtime=0 cores=0-7
/proc/4357/task/4369/stat : 4369 (python) S 4219 4219 3915 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 746980753 647970816 6523 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604463873713152 0 0 -1 1 0 0 0
[pid=4360] ppid=4219 vsize=643040 CPUtime=1.51 cores=0-7
/proc/4360/stat : 4360 (python) S 4219 4219 3915 0 -1 4202560 1247 0 0 0 76 75 0 0 18 0 2 0 746970722 658472960 6619 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/4360/statm: 160760 6619 407 364 0 96591 0
[pid=4362] ppid=4360 vsize=268420 CPUtime=388.18 cores=0-7
/proc/4362/stat : 4362 (hybridGM3) R 4360 4362 4362 0 -1 4202496 5297 0 0 0 38817 1 0 0 25 0 1 0 746970723 274862080 5008 33554432000 134512640 135204385 4289531792 18446744073709551615 134538284 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/4362/statm: 67105 5008 63 169 0 66935 0
[pid=4360/tid=4376] ppid=4219 vsize=643040 CPUtime=0 cores=0-7
/proc/4360/task/4376/stat : 4376 (python) S 4219 4219 3915 0 -1 4202560 90 0 0 0 0 0 0 0 18 0 2 0 746990907 658472960 6619 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604470105246400 0 0 -1 1 0 0 0
[pid=4363] ppid=4219 vsize=653296 CPUtime=1.5 cores=0-7
/proc/4363/stat : 4363 (python) S 4219 4219 3915 0 -1 4202560 1066 0 0 0 78 72 0 0 18 0 1 0 746971127 668975104 6485 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 12434720046146617606 0 0 17 1 0 0 0
/proc/4363/statm: 163324 6485 379 364 0 99152 0
[pid=4365] ppid=4363 vsize=419072 CPUtime=384.96 cores=0-7
/proc/4365/stat : 4365 (NCVWr) R 4363 4365 4365 0 -1 4202496 1362 0 0 0 38496 0 0 0 25 0 1 0 746971127 429129728 1078 33554432000 134512640 135113558 4293685168 18446744073709551615 134531906 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/4365/statm: 104768 1078 58 147 0 103643 0
[pid=4379] ppid=4219 vsize=663552 CPUtime=0.39 cores=0-7
/proc/4379/stat : 4379 (python) S 4219 4219 3915 0 -1 4202560 1260 0 0 0 20 19 0 0 19 0 2 0 747000361 679477248 6584 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/4379/statm: 165888 6584 407 364 0 101713 0
[pid=4381] ppid=4379 vsize=1018820 CPUtime=97.38 cores=0-7
/proc/4381/stat : 4381 (gnovelty+2) T 4379 4381 4381 0 -1 4202496 884 0 0 0 9738 0 0 0 25 0 1 0 747000362 1043271680 595 33554432000 134512640 135663704 4288147424 18446744073709551615 134524553 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/4381/statm: 254705 595 113 282 0 254421 0
[pid=4379/tid=4385] ppid=4219 vsize=663552 CPUtime=0 cores=0-7
/proc/4379/task/4385/stat : 4385 (python) S 4219 4219 3915 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 747010209 679477248 6584 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 514 18446604465858291712 0 0 -1 1 0 0 0
[pid=4386] ppid=4219 vsize=673808 CPUtime=0 cores=0-7
/proc/4386/stat : 4386 (python) S 4219 4219 3915 0 -1 4202560 965 0 0 0 0 0 0 0 19 0 1 0 747010215 689979392 6502 33554432000 4194304 5683644 140734389033856 18446744073709551615 251367566918 0 0 16781312 514 260685964903448575 0 0 17 7 0 0 0
/proc/4386/statm: 168452 6502 356 364 0 104274 0
[pid=4388] ppid=4386 vsize=268420 CPUtime=0.94 cores=0-7
/proc/4388/stat : 4388 (hybridGM3) R 4386 4388 4388 0 -1 4202496 5298 0 0 0 94 0 0 0 23 0 1 0 747010215 274862080 5009 33554432000 134512640 135204385 4293964672 18446744073709551615 134538041 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/4388/statm: 67105 5009 63 169 0 66935 0
[pid=4219/tid=4226] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4226/stat : 4226 (python) S 4217 4219 3915 0 -1 4202560 26 938 0 0 0 0 0 0 18 0 34 0 746882034 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4229] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4229/stat : 4229 (python) S 4217 4219 3915 0 -1 4202560 20 938 0 0 0 0 0 0 19 0 34 0 746882037 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 3 0 0 0
[pid=4219/tid=4232] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4232/stat : 4232 (python) S 4217 4219 3915 0 -1 4202560 37 938 0 0 0 0 0 0 16 0 34 0 746882040 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4235] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4235/stat : 4235 (python) S 4217 4219 3915 0 -1 4202560 26 938 0 0 0 0 0 0 18 0 34 0 746882043 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 5 0 0 0
[pid=4219/tid=4238] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4238/stat : 4238 (python) S 4217 4219 3915 0 -1 4202560 107 938 0 0 0 0 0 0 18 0 34 0 746882046 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 0 0 0 0
[pid=4219/tid=4241] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4241/stat : 4241 (python) S 4217 4219 3915 0 -1 4202560 33 938 0 0 0 0 0 0 20 0 34 0 746882049 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 7 0 0 0
[pid=4219/tid=4244] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4244/stat : 4244 (python) S 4217 4219 3915 0 -1 4202560 50 938 0 0 0 0 0 0 18 0 34 0 746882053 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 2 0 0 0
[pid=4219/tid=4246] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4246/stat : 4246 (python) S 4217 4219 3915 0 -1 4202560 33 938 0 0 0 0 0 0 18 0 34 0 746882056 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 7 0 0 0
[pid=4219/tid=4255] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4255/stat : 4255 (python) S 4217 4219 3915 0 -1 4202560 43 938 0 0 0 0 0 0 18 0 34 0 746892076 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 4 0 0 0
[pid=4219/tid=4260] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4260/stat : 4260 (python) S 4217 4219 3915 0 -1 4202560 43 938 0 0 0 0 0 0 18 0 34 0 746892079 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 2 0 0 0
[pid=4219/tid=4264] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4264/stat : 4264 (python) S 4217 4219 3915 0 -1 4202560 56 938 0 0 0 0 0 0 18 0 34 0 746892083 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 4 0 0 0
[pid=4219/tid=4267] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4267/stat : 4267 (python) S 4217 4219 3915 0 -1 4202560 29 938 0 0 0 0 0 0 25 0 34 0 746892087 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 3 0 0 0
[pid=4219/tid=4272] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4272/stat : 4272 (python) S 4217 4219 3915 0 -1 4202560 42 938 0 0 0 0 0 0 18 0 34 0 746892092 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 6 0 0 0
[pid=4219/tid=4276] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4276/stat : 4276 (python) S 4217 4219 3915 0 -1 4202560 41 938 0 0 0 0 0 0 18 0 34 0 746892097 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 3 0 0 0
[pid=4219/tid=4279] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4279/stat : 4279 (python) S 4217 4219 3915 0 -1 4202560 33 938 0 0 0 0 0 0 19 0 34 0 746892101 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 6 0 0 0
[pid=4219/tid=4282] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4282/stat : 4282 (python) S 4217 4219 3915 0 -1 4202560 41 938 0 0 0 0 0 0 18 0 34 0 746892106 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4289] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4289/stat : 4289 (python) S 4217 4219 3915 0 -1 4202560 34 938 0 0 0 0 0 0 19 0 34 0 746902117 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 5 0 0 0
[pid=4219/tid=4292] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4292/stat : 4292 (python) S 4217 4219 3915 0 -1 4202560 40 938 0 0 0 0 0 0 18 0 34 0 746902122 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4303] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4303/stat : 4303 (python) S 4217 4219 3915 0 -1 4202560 39 938 0 0 0 0 0 0 20 0 34 0 746912159 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 0 0 0 0
[pid=4219/tid=4309] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4309/stat : 4309 (python) S 4217 4219 3915 0 -1 4202560 31 938 0 0 0 0 0 0 19 0 34 0 746921321 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 6 0 0 0
[pid=4219/tid=4312] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4312/stat : 4312 (python) S 4217 4219 3915 0 -1 4202560 35 938 0 0 0 0 0 0 20 0 34 0 746921744 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4319] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4319/stat : 4319 (python) S 4217 4219 3915 0 -1 4202560 57 938 0 0 0 0 0 0 18 0 34 0 746931070 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 0 0 0 0
[pid=4219/tid=4322] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4322/stat : 4322 (python) S 4217 4219 3915 0 -1 4202560 32 938 0 0 0 0 0 0 20 0 34 0 746931348 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4325] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4325/stat : 4325 (python) S 4217 4219 3915 0 -1 4202560 42 938 0 0 0 0 0 0 18 0 34 0 746931861 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4329] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4329/stat : 4329 (python) S 4217 4219 3915 0 -1 4202560 36 938 0 0 0 0 0 0 18 0 34 0 746932347 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4338] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4338/stat : 4338 (python) S 4217 4219 3915 0 -1 4202560 37 938 0 0 0 0 0 0 20 0 34 0 746942136 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4343] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4343/stat : 4343 (python) S 4217 4219 3915 0 -1 4202560 34 938 0 0 0 0 0 0 19 0 34 0 746951124 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 1 0 0 0
[pid=4219/tid=4352] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4352/stat : 4352 (python) S 4217 4219 3915 0 -1 4202560 39 938 0 0 0 0 0 0 18 0 34 0 746961576 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 2 0 0 0
[pid=4219/tid=4358] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4358/stat : 4358 (python) S 4217 4219 3915 0 -1 4202560 36 938 0 0 0 0 0 0 18 0 34 0 746970715 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 0 0 0 0
[pid=4219/tid=4361] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4361/stat : 4361 (python) S 4217 4219 3915 0 -1 4202560 41 938 0 0 0 0 0 0 18 0 34 0 746970723 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 7 0 0 0
[pid=4219/tid=4364] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4364/stat : 4364 (python) S 4217 4219 3915 0 -1 4202560 34 938 0 0 0 0 0 0 20 0 34 0 746971127 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 7 0 0 0
[pid=4219/tid=4380] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4380/stat : 4380 (python) S 4217 4219 3915 0 -1 4202560 37 938 0 0 0 0 0 0 20 0 34 0 747000362 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 0 0 0 0
[pid=4219/tid=4387] ppid=4217 vsize=684052 CPUtime=0 cores=0-7
/proc/4219/task/4387/stat : 4387 (python) S 4217 4219 3915 0 -1 4202560 36 938 0 0 0 0 0 0 20 0 34 0 747010215 700469248 8085 33554432000 4194304 5683644 140734389033856 18446744073709551615 251379370417 0 0 16781312 2 18446604447518915264 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10209.1
Current children cumulated vsize (KiB) 32494572

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4219 and gives
#  childrusage.ru_utime.tv_sec=2750
#  childrusage.ru_utime.tv_usec=395876
#  childrusage.ru_stime.tv_sec=17
#  childrusage.ru_stime.tv_usec=499339
# CPU time returned by wait4() is 2767.9
# while last known CPU time is 10209.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1284.92
CPU time (s): 10209.1
CPU user time (s): 10189.9
CPU system time (s): 19.18
CPU usage (%): 794.53
Max. virtual memory (cumulated for all children) (KiB): 32494572

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2750.4
system time used= 17.4993
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 111749
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14839
involuntary context switches= 20710

runsolver used 16.2645 second user time and 36.0995 second system time

The end

Launcher Data 

Begin job on node113 at 2011-05-16 19:21:52
IDJOB=3385429
IDBENCH=82694
IDSOLVER=1870
FILE ID=node113/3385429-1305566511
RUNJOBID= node113-1305564965-3929
PBS_JOBID= 13350137
Free space on /tmp= 73424 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S1116436500-050-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385429-1305566511/watcher-3385429-1305566511 -o /tmp/evaluation-result-3385429-1305566511/solver-3385429-1305566511 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385429-1305566511.cnf -seed 1266908400 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= cfa9ddae87a68697f7100e24d97d7728
RANDOM SEED=1266908400

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19545168 kB
Buffers:        302656 kB
Cached:        3960116 kB
SwapCached:      93692 kB
Active:        5482968 kB
Inactive:      7609180 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19545168 kB
SwapTotal:    67111528 kB
SwapFree:     38710912 kB
Dirty:           32308 kB
Writeback:           0 kB
AnonPages:     8748024 kB
Mapped:          23696 kB
Slab:           127920 kB
PageTables:     112640 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 142240208 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73392 MiB
End job on node113 at 2011-05-16 19:43:19