Trace number 3321919

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 10231.8 1287.11

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S415002759-031-UNKNOWN.cnf
MD5SUM6d4469ea6d617a494594ad07b4996367
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.67	c INFO: solving HOME/instance-3321919-1304369545.cnf
0.35/0.67	c INFO: computing task features
0.53/0.84	c INFO: computed variable-clause graph statistics
0.53/0.85	c INFO: computed clause balance statistics
1.44/1.73	c INFO: computed variable balance statistics
1.74/2.08	c INFO: computed small-clause counts
1.74/2.08	c INFO: computed Horn-clause counts
1.85/2.11	c INFO: computed variable graph statistics
1.85/2.11	c INFO: collected features for HOME/instance-3321919-1304369545.cnf in 1.44 s
1.85/2.15	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.37)
1.85/2.18	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
1.94/2.23	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
1.94/2.27	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.03/2.31	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.05)
2.03/2.35	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.04)
2.03/2.39	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.03)
2.13/2.43	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
801.79/102.43	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.02)
801.79/102.47	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
802.41/102.52	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
802.41/102.57	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
802.85/102.64	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
803.00/102.70	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.01)
803.00/102.76	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
803.10/102.82	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.02)
1601.41/202.71	c INFO: running TNM@0 for 1552 with 39798 remaining (b = 0.19)
1601.41/202.78	c INFO: running FH@0 for 97 with 39797 remaining (b = 0.01)
1602.66/202.94	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
1603.25/203.00	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2369.79/299.18	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2372.07/299.41	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2372.84/299.50	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2377.62/300.21	c INFO: running adaptg2wsat2009++@0 for 97 with 39700 remaining (b = 0.01)
2378.48/300.28	c INFO: running adaptg2wsat2009++@100 for 97 with 39700 remaining (b = 0.01)
2393.55/302.11	c INFO: running hybridGM3@99 for 97 with 39698 remaining (b = 0.01)
2401.51/303.11	c INFO: running hybridGM3@0 for 194 with 39697 remaining (b = 0.02)
3129.24/394.44	c INFO: running hybridGM3@295 for 97 with 39606 remaining (b = 0.01)
3153.92/397.55	c INFO: running TNM@0 for 1552 with 39603 remaining (b = 0.15)
3178.63/400.70	c INFO: running hybridGM3@295 for 97 with 39600 remaining (b = 0.01)
3179.41/400.79	c INFO: running adaptg2wsat2009++@100 for 97 with 39599 remaining (b = 0.01)
3192.95/402.40	c INFO: running iPAWS@0 for 97 with 39598 remaining (b = 0.01)
3201.70/403.52	c INFO: running FH@0 for 291 with 39597 remaining (b = 0.03)
3936.55/495.74	c INFO: running hybridGM3@393 for 97 with 39504 remaining (b = 0.01)
3938.15/495.98	c INFO: running gnovelty+2@0 for 97 with 39504 remaining (b = 0.01)
3947.76/497.13	c INFO: running hybridGM3@396 for 97 with 39503 remaining (b = 0.01)
3960.44/498.70	c INFO: running hybridGM3@95 for 97 with 39502 remaining (b = 0.01)
3991.59/502.71	c INFO: running hybridGM3@0 for 194 with 39498 remaining (b = 0.02)
4695.76/591.03	c INFO: running adaptg2wsat2009++@294 for 291 with 39409 remaining (b = 0.02)
4698.97/591.43	c INFO: running FH@100 for 291 with 39409 remaining (b = 0.02)
4738.01/596.35	c INFO: running iPAWS@0 for 97 with 39404 remaining (b = 0.01)
4767.47/600.01	c INFO: running hybridGM3@0 for 194 with 39400 remaining (b = 0.02)
5508.55/693.25	c INFO: running hybridGM3@0 for 194 with 39307 remaining (b = 0.01)
5535.60/696.67	c INFO: running TNM@0 for 1552 with 39304 remaining (b = 0.11)
5557.07/699.38	c INFO: running hybridGM3@94 for 97 with 39301 remaining (b = 0.01)
6323.70/795.69	c INFO: running adaptg2wsat2009++@99 for 97 with 39205 remaining (b = 0.01)
6363.47/800.71	c INFO: running gnovelty+2@0 for 97 with 39200 remaining (b = 0.01)
6996.35/880.17	c INFO: running hybridGM3@0 for 194 with 39120 remaining (b = 0.01)
7048.85/886.79	c INFO: running adaptg2wsat2009++@388 for 194 with 39113 remaining (b = 0.01)
7066.36/888.92	c INFO: running hybridGM3@99 for 97 with 39111 remaining (b = 0.01)
7091.10/892.02	c INFO: running FH@200 for 194 with 39108 remaining (b = 0.01)
7162.66/901.08	c INFO: running FH@0 for 97 with 39099 remaining (b = 0.01)
7872.62/990.26	c INFO: running hybridGM3@0 for 194 with 39010 remaining (b = 0.01)
7961.74/1001.43	c INFO: running NCVWr@0 for 485 with 38999 remaining (b = 0.03)
8560.44/1076.81	c INFO: running hybridGM3@293 for 194 with 38923 remaining (b = 0.01)
8573.12/1078.34	c INFO: running adaptg2wsat2009++@100 for 97 with 38922 remaining (b = 0.01)
8678.10/1091.59	c INFO: running FH@300 for 97 with 38909 remaining (b = 0.01)
9346.73/1175.69	c INFO: running adaptg2wsat2009++@299 for 291 with 38825 remaining (b = 0.02)
9421.48/1185.03	c INFO: running hybridGM3@99 for 97 with 38815 remaining (b = 0.01)
9436.66/1186.93	c INFO: running FH@100 for 291 with 38813 remaining (b = 0.02)
10131.49/1274.38	c INFO: running hybridGM3@484 for 97 with 38726 remaining (b = 0.01)
10226.91/1286.38	c INFO: running iPAWS@0 for 97 with 38714 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321919-1304369545/watcher-3321919-1304369545 -o /tmp/evaluation-result-3321919-1304369545/solver-3321919-1304369545 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321919-1304369545.cnf -seed 235606590 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.69 8.35 7.93 2/277 13304
/proc/meminfo: memFree=10343156/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=15756 CPUtime=0 cores=0-7
/proc/13304/stat : 13304 (python) S 13302 13304 12767 0 -1 4202496 841 0 0 0 0 0 0 0 20 0 1 0 548557163 16134144 724 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634513408 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/13304/statm: 3939 724 334 364 0 426 0

[startup+0.0883979 s]
/proc/loadavg: 7.69 8.35 7.93 2/277 13304
/proc/meminfo: memFree=10343156/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=56644 CPUtime=0.05 cores=0-7
/proc/13304/stat : 13304 (python) R 13302 13304 12767 0 -1 4202496 2090 0 0 0 3 2 0 0 20 0 1 0 548557163 58003456 1844 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634201808 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/13304/statm: 14161 1844 498 364 0 1284 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 56644

[startup+0.1004 s]
/proc/loadavg: 7.69 8.35 7.93 2/277 13304
/proc/meminfo: memFree=10343156/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=87704 CPUtime=0.06 cores=0-7
/proc/13304/stat : 13304 (python) S 13302 13304 12767 0 -1 4202496 2639 0 0 0 4 2 0 0 17 0 1 0 548557163 89808896 2354 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634513408 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/13304/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87704

[startup+0.300386 s]
/proc/loadavg: 7.69 8.35 7.93 2/277 13304
/proc/meminfo: memFree=10343156/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=135748 CPUtime=0.18 cores=0-7
/proc/13304/stat : 13304 (python) R 13302 13304 12767 0 -1 4202496 5963 933 1 0 13 5 0 0 17 0 1 0 548557163 139005952 4151 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634511365 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/13304/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700285 s]
/proc/loadavg: 7.69 8.35 7.93 2/277 13304
/proc/meminfo: memFree=10343156/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=279712 CPUtime=0.43 cores=0-7
/proc/13304/stat : 13304 (python) R 13302 13304 12767 0 -1 4202496 9586 933 1 0 32 11 0 0 16 0 1 0 548557163 286425088 7269 33554432000 4194304 5683644 140736523649248 18446744073709551615 4951589 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/13304/statm: 69928 7269 1761 364 0 5852 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 279712

[startup+1.50114 s]
/proc/loadavg: 7.69 8.35 7.93 2/278 13309
/proc/meminfo: memFree=10314948/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=285636 CPUtime=1.24 cores=0-7
/proc/13304/stat : 13304 (python) R 13302 13304 12767 0 -1 4202496 12501 933 1 0 112 12 0 0 17 0 1 0 548557163 292491264 8794 33554432000 4194304 5683644 140736523649248 18446744073709551615 5014064 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/13304/statm: 71409 8794 1826 364 0 7333 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 285636

[startup+3.10079 s]
/proc/loadavg: 7.69 8.35 7.93 2/278 13309
/proc/meminfo: memFree=10314328/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=362448 CPUtime=2.17 cores=0-7
/proc/13304/stat : 13304 (python) S 13302 13304 12767 0 -1 4202496 19000 933 1 0 202 15 0 0 20 0 9 0 548557163 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/13304/statm: 90612 7579 1891 364 0 26509 0
Current children cumulated CPU time (s) 2.17
Current children cumulated vsize (KiB) 362448
heavy processes:

[startup+6.30122 s]
/proc/loadavg: 7.72 8.34 7.93 9/302 13333
/proc/meminfo: memFree=10256748/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=362448 CPUtime=2.17 cores=0-7
/proc/13304/stat : 13304 (python) S 13302 13304 12767 0 -1 4202496 19000 933 1 0 202 15 0 0 20 0 9 0 548557163 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/13304/statm: 90612 7579 1891 364 0 26509 0
[pid=13310] ppid=13304 vsize=280760 CPUtime=0 cores=0-7
/proc/13310/stat : 13310 (python) S 13304 13304 12767 0 -1 4202560 886 0 0 0 0 0 0 0 18 0 1 0 548557378 287498240 6001 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535439 0 0 16781312 514 14832161174342041859 0 0 17 1 0 0 0
/proc/13310/statm: 70190 6001 378 364 0 6108 0
[pid=13312] ppid=13310 vsize=1019708 CPUtime=4.12 cores=0-7
/proc/13312/stat : 13312 (gnovelty+2) R 13310 13312 13312 0 -1 4202496 955 0 0 0 412 0 0 0 25 0 1 0 548557379 1044180992 690 33554432000 134512640 135663704 4293427648 18446744073709551615 134546752 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/13312/statm: 254927 690 113 282 0 254643 0
[pid=13313] ppid=13304 vsize=291084 CPUtime=0 cores=0-7
/proc/13313/stat : 13313 (python) S 13304 13304 12767 0 -1 4202560 913 0 0 0 0 0 0 0 18 0 1 0 548557382 298070016 5999 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 1080407892416233730 0 0 17 3 0 0 0
/proc/13313/statm: 72771 5999 372 364 0 8686 0
[pid=13315] ppid=13313 vsize=1019708 CPUtime=4.1 cores=0-7
/proc/13315/stat : 13315 (gnovelty+2) R 13313 13315 13315 0 -1 4202496 953 0 0 0 410 0 0 0 25 0 1 0 548557382 1044180992 689 33554432000 134512640 135663704 4290543792 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/13315/statm: 254927 689 113 282 0 254643 0
[pid=13316] ppid=13304 vsize=301272 CPUtime=0 cores=0-7
/proc/13316/stat : 13316 (python) S 13304 13304 12767 0 -1 4202560 890 0 0 0 0 0 0 0 18 0 1 0 548557386 308502528 6019 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 7746701811645382915 0 0 17 6 0 0 0
/proc/13316/statm: 75318 6019 371 364 0 11230 0
[pid=13318] ppid=13316 vsize=420220 CPUtime=4.05 cores=0-7
/proc/13318/stat : 13318 (adaptg2wsat2009) R 13316 13318 13318 0 -1 4202496 1663 0 0 0 405 0 0 0 25 0 1 0 548557386 430305280 1399 33554432000 134512640 135107411 4287588688 18446744073709551615 134532349 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/13318/statm: 105055 1399 59 146 0 103931 0
[pid=13319] ppid=13304 vsize=312136 CPUtime=0 cores=0-7
/proc/13319/stat : 13319 (python) S 13304 13304 12767 0 -1 4202560 929 0 0 0 0 0 0 0 18 0 1 0 548557390 319627264 6024 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 8513909414548177156 0 0 17 2 0 0 0
/proc/13319/statm: 78034 6024 372 364 0 13943 0
[pid=13321] ppid=13319 vsize=420220 CPUtime=4 cores=0-7
/proc/13321/stat : 13321 (adaptg2wsat2009) R 13319 13321 13321 0 -1 4202496 1663 0 0 0 400 0 0 0 25 0 1 0 548557391 430305280 1400 33554432000 134512640 135107411 4289791968 18446744073709551615 134532277 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/13321/statm: 105055 1400 59 146 0 103931 0
[pid=13322] ppid=13304 vsize=321852 CPUtime=0 cores=0-7
/proc/13322/stat : 13322 (python) S 13304 13304 12767 0 -1 4202560 750 0 0 0 0 0 0 0 18 0 1 0 548557394 329576448 6005 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 6729574665993289988 0 0 17 1 0 0 0
/proc/13322/statm: 80463 6005 349 364 0 16369 0
[pid=13324] ppid=13322 vsize=419820 CPUtime=3.94 cores=0-7
/proc/13324/stat : 13324 (adaptg2wsat2009) R 13322 13324 13324 0 -1 4202496 1439 0 0 0 394 0 0 0 25 0 1 0 548557395 429895680 1173 33554432000 134512640 135107411 4293678160 18446744073709551615 134523448 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13324/statm: 104955 1173 49 146 0 103831 0
[pid=13325] ppid=13304 vsize=332176 CPUtime=0 cores=0-7
/proc/13325/stat : 13325 (python) S 13304 13304 12767 0 -1 4202560 773 0 0 0 0 0 0 0 18 0 1 0 548557398 340148224 6009 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 2911476283198112002 0 0 17 2 0 0 0
/proc/13325/statm: 83044 6009 349 364 0 18947 0
[pid=13327] ppid=13325 vsize=1019708 CPUtime=3.91 cores=0-7
/proc/13327/stat : 13327 (gnovelty+2) R 13325 13327 13327 0 -1 4202496 955 0 0 0 391 0 0 0 25 0 1 0 548557399 1044180992 689 33554432000 134512640 135663704 4290660784 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/13327/statm: 254927 689 113 282 0 254643 0
[pid=13328] ppid=13304 vsize=342296 CPUtime=0 cores=0-7
/proc/13328/stat : 13328 (python) S 13304 13304 12767 0 -1 4202560 757 0 0 0 0 0 0 0 18 0 1 0 548557402 350511104 6030 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 12170099212595200258 0 0 17 1 0 0 0
/proc/13328/statm: 85574 6030 349 364 0 21474 0
[pid=13330] ppid=13328 vsize=247956 CPUtime=3.86 cores=0-7
/proc/13330/stat : 13330 (FH) R 13328 13330 13330 0 -1 4202496 1248 0 0 0 386 0 0 0 25 0 1 0 548557403 253906944 986 33554432000 134512640 134936988 4294422032 18446744073709551615 134523497 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/13330/statm: 61989 986 37 104 0 61493 0
[pid=13331] ppid=13304 vsize=353192 CPUtime=0 cores=0-7
/proc/13331/stat : 13331 (python) S 13304 13304 12767 0 -1 4202560 799 0 0 0 0 0 0 0 18 0 1 0 548557406 361668608 6040 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 7746705659936080130 0 0 17 0 0 0 0
/proc/13331/statm: 88298 6040 355 364 0 24195 0
[pid=13333] ppid=13331 vsize=419820 CPUtime=3.85 cores=0-7
/proc/13333/stat : 13333 (adaptg2wsat2009) R 13331 13333 13333 0 -1 4202496 1445 0 0 0 385 0 0 0 25 0 1 0 548557407 429895680 1173 33554432000 134512640 135107411 4287070816 18446744073709551615 134523302 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/13333/statm: 104955 1173 49 146 0 103831 0
[pid=13304/tid=13311] ppid=13302 vsize=362448 CPUtime=0 cores=0-7
/proc/13304/task/13311/stat : 13311 (python) S 13302 13304 12767 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 548557378 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13314] ppid=13302 vsize=362448 CPUtime=0 cores=0-7
/proc/13304/task/13314/stat : 13314 (python) S 13302 13304 12767 0 -1 4202560 24 933 0 0 0 0 0 0 21 0 9 0 548557382 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13317] ppid=13302 vsize=362448 CPUtime=0 cores=0-7
/proc/13304/task/13317/stat : 13317 (python) S 13302 13304 12767 0 -1 4202560 20 933 0 0 0 0 0 0 23 0 9 0 548557386 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 6 0 0 0
[pid=13304/tid=13320] ppid=13302 vsize=362448 CPUtime=0 cores=0-7
/proc/13304/task/13320/stat : 13320 (python) S 13302 13304 12767 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 548557390 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 6 0 0 0
[pid=13304/tid=13323] ppid=13302 vsize=362448 CPUtime=0 cores=0-7
/proc/13304/task/13323/stat : 13323 (python) S 13302 13304 12767 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548557394 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 2 0 0 0
[pid=13304/tid=13326] ppid=13302 vsize=362448 CPUtime=0 cores=0-7
/proc/13304/task/13326/stat : 13326 (python) S 13302 13304 12767 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 548557399 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 2 0 0 0
[pid=13304/tid=13329] ppid=13302 vsize=362448 CPUtime=0 cores=0-7
/proc/13304/task/13329/stat : 13329 (python) S 13302 13304 12767 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 548557403 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13332] ppid=13302 vsize=362448 CPUtime=0 cores=0-7
/proc/13304/task/13332/stat : 13332 (python) S 13302 13304 12767 0 -1 4202560 88 933 0 0 0 0 0 0 21 0 9 0 548557407 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 34
Current children cumulated vsize (KiB) 7884376

[startup+12.7011 s]
/proc/loadavg: 7.74 8.34 7.93 9/302 13334
/proc/meminfo: memFree=10250556/32951124 swapFree=67111524/67111528
[pid=13304] ppid=13302 vsize=362448 CPUtime=2.17 cores=0-7
/proc/13304/stat : 13304 (python) S 13302 13304 12767 0 -1 4202496 19000 933 1 0 202 15 0 0 20 0 9 0 548557163 371146752 7579 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/13304/statm: 90612 7579 1891 364 0 26509 0
[pid=13310] ppid=13304 vsize=280760 CPUtime=0.02 cores=0-7
/proc/13310/stat : 13310 (python) S 13304 13304 12767 0 -1 4202560 892 0 0 0 1 1 0 0 18 0 1 0 548557378 287498240 6001 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535439 0 0 16781312 514 5151871683107193091 0 0 17 1 0 0 0
/proc/13310/statm: 70190 6001 378 364 0 6108 0
[pid=13312] ppid=13310 vsize=1019708 CPUtime=10.51 cores=0-7
/proc/13312/stat : 13312 (gnovelty+2) R 13310 13312 13312 0 -1 4202496 955 0 0 0 1051 0 0 0 25 0 1 0 548557379 1044180992 690 33554432000 134512640 135663704 4293427648 18446744073709551615 134525715 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/13312/statm: 254927 690 113 282 0 254643 0
[pid=13313] ppid=13304 vsize=291084 CPUtime=0.02 cores=0-7
/proc/13313/stat : 13313 (python) S 13304 13304 12767 0 -1 4202560 917 0 0 0 1 1 0 0 18 0 1 0 548557382 298070016 5999 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 5151871683107193090 0 0 17 3 0 0 0
/proc/13313/statm: 72771 5999 372 364 0 8686 0
[pid=13315] ppid=13313 vsize=1019708 CPUtime=10.5 cores=0-7
/proc/13315/stat : 13315 (gnovelty+2) R 13313 13315 13315 0 -1 4202496 953 0 0 0 1050 0 0 0 25 0 1 0 548557382 1044180992 689 33554432000 134512640 135663704 4290543792 18446744073709551615 134524594 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/13315/statm: 254927 689 113 282 0 254643 0
[pid=13316] ppid=13304 vsize=301272 CPUtime=0.02 cores=0-7
/proc/13316/stat : 13316 (python) S 13304 13304 12767 0 -1 4202560 894 0 0 0 1 1 0 0 18 0 1 0 548557386 308502528 6020 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 5151871683107193091 0 0 17 6 0 0 0
/proc/13316/statm: 75318 6020 372 364 0 11230 0
[pid=13318] ppid=13316 vsize=420220 CPUtime=10.45 cores=0-7
/proc/13318/stat : 13318 (adaptg2wsat2009) R 13316 13318 13318 0 -1 4202496 1663 0 0 0 1045 0 0 0 25 0 1 0 548557386 430305280 1399 33554432000 134512640 135107411 4287588688 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/13318/statm: 105055 1399 59 146 0 103931 0
[pid=13319] ppid=13304 vsize=312136 CPUtime=0.02 cores=0-7
/proc/13319/stat : 13319 (python) S 13304 13304 12767 0 -1 4202560 931 0 0 0 1 1 0 0 18 0 1 0 548557390 319627264 6024 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 5151871683107193092 0 0 17 2 0 0 0
/proc/13319/statm: 78034 6024 372 364 0 13943 0
[pid=13321] ppid=13319 vsize=420220 CPUtime=10.39 cores=0-7
/proc/13321/stat : 13321 (adaptg2wsat2009) R 13319 13321 13321 0 -1 4202496 1663 0 0 0 1039 0 0 0 25 0 1 0 548557391 430305280 1400 33554432000 134512640 135107411 4289791968 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/13321/statm: 105055 1400 59 146 0 103931 0
[pid=13322] ppid=13304 vsize=321852 CPUtime=0.02 cores=0-7
/proc/13322/stat : 13322 (python) S 13304 13304 12767 0 -1 4202560 938 0 0 0 1 1 0 0 18 0 1 0 548557394 329576448 6028 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 5151871683107193092 0 0 17 1 0 0 0
/proc/13322/statm: 80463 6028 372 364 0 16369 0
[pid=13324] ppid=13322 vsize=420220 CPUtime=10.27 cores=0-7
/proc/13324/stat : 13324 (adaptg2wsat2009) R 13322 13324 13324 0 -1 4202496 1666 0 0 0 1027 0 0 0 25 0 1 0 548557395 430305280 1400 33554432000 134512640 135107411 4293678160 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13324/statm: 105055 1400 59 146 0 103931 0
[pid=13325] ppid=13304 vsize=332176 CPUtime=0.01 cores=0-7
/proc/13325/stat : 13325 (python) S 13304 13304 12767 0 -1 4202560 963 0 0 0 1 0 0 0 18 0 1 0 548557398 340148224 6032 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 5151871683107193090 0 0 17 2 0 0 0
/proc/13325/statm: 83044 6032 372 364 0 18947 0
[pid=13327] ppid=13325 vsize=1019708 CPUtime=10.28 cores=0-7
/proc/13327/stat : 13327 (gnovelty+2) R 13325 13327 13327 0 -1 4202496 955 0 0 0 1028 0 0 0 25 0 1 0 548557399 1044180992 689 33554432000 134512640 135663704 4290660784 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/13327/statm: 254927 689 113 282 0 254643 0
[pid=13328] ppid=13304 vsize=342296 CPUtime=0.01 cores=0-7
/proc/13328/stat : 13328 (python) S 13304 13304 12767 0 -1 4202560 948 0 0 0 0 1 0 0 18 0 1 0 548557402 350511104 6053 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 5151871683107193090 0 0 17 1 0 0 0

################
# More data... #
################

/proc/13404/statm: 140556 6659 407 364 0 76411 0
[pid=13406] ppid=13404 vsize=1019708 CPUtime=100.24 cores=0-7
/proc/13406/stat : 13406 (gnovelty+2) T 13404 13406 13406 0 -1 4202496 969 0 0 0 10024 0 0 0 25 0 1 0 548606762 1044180992 689 33554432000 134512640 135663704 4289941344 18446744073709551615 134545622 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/13406/statm: 254927 689 113 282 0 254643 0
[pid=13404/tid=13423] ppid=13304 vsize=562224 CPUtime=0 cores=0-7
/proc/13404/task/13423/stat : 13423 (python) S 13304 13304 12767 0 -1 4202560 100 0 0 0 0 0 0 0 19 0 2 0 548616789 575717376 6659 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604453909256960 0 0 -1 5 0 0 0
[pid=13409] ppid=13304 vsize=572480 CPUtime=0.7 cores=0-7
/proc/13409/stat : 13409 (python) S 13304 13304 12767 0 -1 4202560 1198 0 0 0 39 31 0 0 18 0 2 0 548607434 586219520 6665 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/13409/statm: 143120 6665 407 364 0 78972 0
[pid=13411] ppid=13409 vsize=268420 CPUtime=295.96 cores=0-7
/proc/13411/stat : 13411 (hybridGM3) T 13409 13411 13411 0 -1 4202496 5405 0 0 0 29595 1 0 0 25 0 1 0 548607435 274862080 5126 33554432000 134512640 135204385 4293874416 18446744073709551615 134538320 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/13411/statm: 67105 5126 63 169 0 66935 0
[pid=13409/tid=13443] ppid=13304 vsize=572480 CPUtime=0 cores=0-7
/proc/13409/task/13443/stat : 13443 (python) S 13304 13304 12767 0 -1 4202560 99 0 0 0 0 0 0 0 18 0 2 0 548627091 586219520 6665 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604449178027136 0 0 -1 1 0 0 0
[pid=13424] ppid=13304 vsize=582736 CPUtime=0.23 cores=0-7
/proc/13424/stat : 13424 (python) S 13304 13304 12767 0 -1 4202560 1205 0 0 0 12 11 0 0 19 0 2 0 548616798 596721664 6670 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/13424/statm: 145684 6670 406 364 0 81533 0
[pid=13426] ppid=13424 vsize=335996 CPUtime=99.94 cores=0-7
/proc/13426/stat : 13426 (iPAWS) T 13424 13426 13426 0 -1 4202496 1818 0 0 0 9994 0 0 0 25 0 1 0 548616798 344059904 1537 33554432000 134512640 135114423 4292592784 18446744073709551615 134514640 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/13426/statm: 83999 1537 59 147 0 83851 0
[pid=13424/tid=13439] ppid=13304 vsize=582736 CPUtime=0 cores=0-7
/proc/13424/task/13439/stat : 13439 (python) S 13304 13304 12767 0 -1 4202560 99 0 0 0 0 0 0 0 19 0 2 0 548626821 596721664 6670 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604442778969088 0 0 -1 0 0 0 0
[pid=13427] ppid=13304 vsize=593424 CPUtime=0.46 cores=0-7
/proc/13427/stat : 13427 (python) S 13304 13304 12767 0 -1 4202560 1258 0 0 0 25 21 0 0 19 0 2 0 548617164 607666176 6655 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/13427/statm: 148356 6655 401 364 0 84202 0
[pid=13429] ppid=13427 vsize=268424 CPUtime=194.47 cores=0-7
/proc/13429/stat : 13429 (hybridGM3) T 13427 13429 13429 0 -1 4202496 5411 0 0 0 19447 0 0 0 25 0 1 0 548617165 274866176 5127 33554432000 134512640 135204385 4290590304 18446744073709551615 134538328 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/13429/statm: 67106 5127 63 169 0 66936 0
[pid=13427/tid=13447] ppid=13304 vsize=593424 CPUtime=0 cores=0-7
/proc/13427/task/13447/stat : 13447 (python) S 13304 13304 12767 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 548636723 607666176 6655 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604442778970880 0 0 -1 7 0 0 0
[pid=13436] ppid=13304 vsize=603884 CPUtime=0.74 cores=0-7
/proc/13436/stat : 13436 (python) S 13304 13304 12767 0 -1 4202560 1331 0 0 0 41 33 0 0 18 0 2 0 548626488 618377216 6713 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/13436/statm: 150971 6713 401 364 0 86814 0
[pid=13438] ppid=13436 vsize=268420 CPUtime=296.02 cores=0-7
/proc/13438/stat : 13438 (hybridGM3) T 13436 13438 13438 0 -1 4202496 5414 0 0 0 29602 0 0 0 25 0 1 0 548626490 274862080 5126 33554432000 134512640 135204385 4290741056 18446744073709551615 134537704 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/13438/statm: 67105 5126 63 169 0 66935 0
[pid=13436/tid=13456] ppid=13304 vsize=603884 CPUtime=0 cores=0-7
/proc/13436/task/13456/stat : 13456 (python) S 13304 13304 12767 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 548646045 618377216 6713 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604453654294656 0 0 -1 2 0 0 0
[pid=13440] ppid=13304 vsize=613660 CPUtime=1.42 cores=0-7
/proc/13440/stat : 13440 (python) S 13304 13304 12767 0 -1 4202560 986 0 0 0 74 68 0 0 18 0 1 0 548626830 628387840 6739 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 5151871683107193092 0 0 17 0 0 0 0
/proc/13440/statm: 153415 6739 372 364 0 89255 0
[pid=13442] ppid=13440 vsize=458348 CPUtime=567.86 cores=0-7
/proc/13442/stat : 13442 (TNM) R 13440 13442 13442 0 -1 4202496 1521 0 0 0 56786 0 0 0 25 0 1 0 548626831 469348352 1239 33554432000 134512640 135008748 4287200112 18446744073709551615 134527111 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13442/statm: 114587 1239 46 122 0 113487 0
[pid=13448] ppid=13304 vsize=623916 CPUtime=0.23 cores=0-7
/proc/13448/stat : 13448 (python) S 13304 13304 12767 0 -1 4202560 1205 0 0 0 10 13 0 0 19 0 2 0 548637234 638889984 6829 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/13448/statm: 155979 6829 401 364 0 91816 0
[pid=13450] ppid=13448 vsize=1019708 CPUtime=99.78 cores=0-7
/proc/13450/stat : 13450 (gnovelty+2) T 13448 13450 13450 0 -1 4202496 973 0 0 0 9978 0 0 0 25 0 1 0 548637235 1044180992 689 33554432000 134512640 135663704 4292211392 18446744073709551615 134524821 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/13450/statm: 254927 689 113 282 0 254643 0
[pid=13448/tid=13457] ppid=13304 vsize=623916 CPUtime=0 cores=0-7
/proc/13448/task/13457/stat : 13457 (python) S 13304 13304 12767 0 -1 4202560 100 0 0 0 0 0 0 0 19 0 2 0 548647261 638889984 6829 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604441594644352 0 0 -1 1 0 0 0
[pid=13453] ppid=13304 vsize=634172 CPUtime=1 cores=0-7
/proc/13453/stat : 13453 (python) S 13304 13304 12767 0 -1 4202560 1258 0 0 0 52 48 0 0 18 0 2 0 548645181 649392128 6894 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/13453/statm: 158543 6894 406 364 0 94377 0
[pid=13455] ppid=13453 vsize=268420 CPUtime=403.72 cores=0-7
/proc/13455/stat : 13455 (hybridGM3) R 13453 13455 13455 0 -1 4202496 5416 0 0 0 40368 4 0 0 25 0 1 0 548645181 274862080 5126 33554432000 134512640 135204385 4294358032 18446744073709551615 134538395 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/13455/statm: 67105 5126 63 169 0 66935 0
[pid=13453/tid=13473] ppid=13304 vsize=634172 CPUtime=0 cores=0-7
/proc/13453/task/13473/stat : 13473 (python) S 13304 13304 12767 0 -1 4202560 94 0 0 0 0 0 0 0 18 0 2 0 548664833 649392128 6894 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604452805564352 0 0 -1 1 0 0 0
[pid=13458] ppid=13304 vsize=644428 CPUtime=0.24 cores=0-7
/proc/13458/stat : 13458 (python) S 13304 13304 12767 0 -1 4202560 1252 0 0 0 11 13 0 0 19 0 2 0 548647271 659894272 6869 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/13458/statm: 161107 6869 407 364 0 96938 0
[pid=13460] ppid=13458 vsize=249868 CPUtime=99.96 cores=0-7
/proc/13460/stat : 13460 (FH) T 13458 13460 13460 0 -1 4202496 1551 0 0 0 9995 1 0 0 25 0 1 0 548647272 255864832 1263 33554432000 134512640 134936988 4292161664 18446744073709551615 134554109 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/13460/statm: 62467 1263 41 104 0 61971 0
[pid=13458/tid=13467] ppid=13304 vsize=644428 CPUtime=0 cores=0-7
/proc/13458/task/13467/stat : 13467 (python) S 13304 13304 12767 0 -1 4202560 98 0 0 0 0 0 0 0 19 0 2 0 548657295 659894272 6869 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604441099385856 0 0 -1 2 0 0 0
[pid=13464] ppid=13304 vsize=654684 CPUtime=0.74 cores=0-7
/proc/13464/stat : 13464 (python) S 13304 13304 12767 0 -1 4202560 1271 0 0 0 36 38 0 0 18 0 2 0 548656190 670396416 6964 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/13464/statm: 163671 6964 406 364 0 99499 0
[pid=13466] ppid=13464 vsize=268420 CPUtime=295.12 cores=0-7
/proc/13466/stat : 13466 (hybridGM3) T 13464 13466 13466 0 -1 4202496 5414 0 0 0 29511 1 0 0 25 0 1 0 548656190 274862080 5126 33554432000 134512640 135204385 4292440448 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/13466/statm: 67105 5126 63 169 0 66935 0
[pid=13464/tid=13477] ppid=13304 vsize=654684 CPUtime=0 cores=0-7
/proc/13464/task/13477/stat : 13477 (python) S 13304 13304 12767 0 -1 4202560 95 0 0 0 0 0 0 0 18 0 2 0 548675655 670396416 6964 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 514 18446604441099383168 0 0 -1 2 0 0 0
[pid=13468] ppid=13304 vsize=664940 CPUtime=0.69 cores=0-7
/proc/13468/stat : 13468 (python) S 13304 13304 12767 0 -1 4202560 1059 0 0 0 36 33 0 0 18 0 1 0 548657306 680898560 7032 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 5151871683107193089 0 0 17 1 0 0 0
/proc/13468/statm: 166235 7032 379 364 0 102060 0
[pid=13470] ppid=13468 vsize=419772 CPUtime=284.76 cores=0-7
/proc/13470/stat : 13470 (NCVWr) R 13468 13470 13470 0 -1 4202496 1567 0 0 0 28476 0 0 0 25 0 1 0 548657307 429846528 1281 33554432000 134512640 135113558 4286746496 18446744073709551615 134531476 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/13470/statm: 104943 1281 58 147 0 103818 0
[pid=13481] ppid=13304 vsize=675196 CPUtime=0 cores=0-7
/proc/13481/stat : 13481 (python) S 13304 13304 12767 0 -1 4202560 921 0 0 0 0 0 0 0 19 0 1 0 548685801 691400704 6919 33554432000 4194304 5683644 140736523649248 18446744073709551615 216634535494 0 0 16781312 514 4344533009597202431 0 0 17 4 0 0 0
/proc/13481/statm: 168799 6919 345 364 0 104621 0
[pid=13483] ppid=13481 vsize=335996 CPUtime=0.53 cores=0-7
/proc/13483/stat : 13483 (iPAWS) R 13481 13483 13483 0 -1 4202496 1825 0 0 0 53 0 0 0 22 0 1 0 548685802 344059904 1534 33554432000 134512640 135114423 4292202064 18446744073709551615 134517024 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/13483/statm: 83999 1534 59 147 0 83851 0
[pid=13304/tid=13311] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13311/stat : 13311 (python) S 13302 13304 12767 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 34 0 548557378 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13314] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13314/stat : 13314 (python) S 13302 13304 12767 0 -1 4202560 24 933 0 0 0 0 0 0 21 0 34 0 548557382 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13317] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13317/stat : 13317 (python) S 13302 13304 12767 0 -1 4202560 35 933 0 0 0 0 0 0 15 0 34 0 548557386 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 6 0 0 0
[pid=13304/tid=13320] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13320/stat : 13320 (python) S 13302 13304 12767 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 34 0 548557390 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 6 0 0 0
[pid=13304/tid=13323] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13323/stat : 13323 (python) S 13302 13304 12767 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 34 0 548557394 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 2 0 0 0
[pid=13304/tid=13326] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13326/stat : 13326 (python) S 13302 13304 12767 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 34 0 548557399 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 2 0 0 0
[pid=13304/tid=13329] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13329/stat : 13329 (python) S 13302 13304 12767 0 -1 4202560 33 933 0 0 0 0 0 0 18 0 34 0 548557403 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13332] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13332/stat : 13332 (python) S 13302 13304 12767 0 -1 4202560 102 933 0 0 0 0 0 0 18 0 34 0 548557407 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13340] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13340/stat : 13340 (python) S 13302 13304 12767 0 -1 4202560 33 933 0 0 0 0 0 0 18 0 34 0 548567406 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13345] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13345/stat : 13345 (python) S 13302 13304 12767 0 -1 4202560 124 933 0 0 0 0 0 0 18 0 34 0 548567411 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13349] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13349/stat : 13349 (python) S 13302 13304 12767 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 34 0 548567416 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 7 0 0 0
[pid=13304/tid=13352] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13352/stat : 13352 (python) S 13302 13304 12767 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 34 0 548567421 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13358] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13358/stat : 13358 (python) S 13302 13304 12767 0 -1 4202560 41 933 0 0 0 0 0 0 18 0 34 0 548567427 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 6 0 0 0
[pid=13304/tid=13361] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13361/stat : 13361 (python) S 13302 13304 12767 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 34 0 548567433 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13364] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13364/stat : 13364 (python) S 13302 13304 12767 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 34 0 548567440 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13367] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13367/stat : 13367 (python) S 13302 13304 12767 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 34 0 548567446 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 2 0 0 0
[pid=13304/tid=13375] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13375/stat : 13375 (python) S 13302 13304 12767 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 34 0 548577434 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 2 0 0 0
[pid=13304/tid=13378] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13378/stat : 13378 (python) S 13302 13304 12767 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 34 0 548577441 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13390] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13390/stat : 13390 (python) S 13302 13304 12767 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 34 0 548587475 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13396] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13396/stat : 13396 (python) S 13302 13304 12767 0 -1 4202560 148 933 0 0 0 0 0 0 20 0 34 0 548596919 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13399] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13399/stat : 13399 (python) S 13302 13304 12767 0 -1 4202560 46 933 0 0 0 0 0 0 20 0 34 0 548597404 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13405] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13405/stat : 13405 (python) S 13302 13304 12767 0 -1 4202560 39 933 0 0 0 0 0 0 20 0 34 0 548606762 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13410] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13410/stat : 13410 (python) S 13302 13304 12767 0 -1 4202560 43 933 0 0 0 0 0 0 18 0 34 0 548607435 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13425] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13425/stat : 13425 (python) S 13302 13304 12767 0 -1 4202560 41 933 0 0 0 0 0 0 20 0 34 0 548616798 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13428] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13428/stat : 13428 (python) S 13302 13304 12767 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 34 0 548617165 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13437] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13437/stat : 13437 (python) S 13302 13304 12767 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 34 0 548626488 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13441] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13441/stat : 13441 (python) S 13302 13304 12767 0 -1 4202560 160 933 0 0 0 0 0 0 19 0 34 0 548626830 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 3 0 0 0
[pid=13304/tid=13449] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13449/stat : 13449 (python) S 13302 13304 12767 0 -1 4202560 40 933 0 0 0 0 0 0 20 0 34 0 548637234 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 0 0 0 0
[pid=13304/tid=13454] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13454/stat : 13454 (python) S 13302 13304 12767 0 -1 4202560 44 933 0 0 0 0 0 0 18 0 34 0 548645181 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 1 0 0 0
[pid=13304/tid=13459] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13459/stat : 13459 (python) S 13302 13304 12767 0 -1 4202560 44 933 0 0 0 0 0 0 20 0 34 0 548647272 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 4 0 0 0
[pid=13304/tid=13465] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13465/stat : 13465 (python) S 13302 13304 12767 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 34 0 548656190 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 4 0 0 0
[pid=13304/tid=13469] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13469/stat : 13469 (python) S 13302 13304 12767 0 -1 4202560 36 933 0 0 0 0 0 0 19 0 34 0 548657306 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 4 0 0 0
[pid=13304/tid=13482] ppid=13302 vsize=685440 CPUtime=0 cores=0-7
/proc/13304/task/13482/stat : 13482 (python) S 13302 13304 12767 0 -1 4202560 48 933 0 0 0 0 0 0 20 0 34 0 548685801 701890560 8520 33554432000 4194304 5683644 140736523649248 18446744073709551615 216646338993 0 0 16781312 2 18446604443312822272 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10231.8
Current children cumulated vsize (KiB) 32090704

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 13304 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=453018
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=273958
# CPU time returned by wait4() is 6.72698
# while last known CPU time is 10231.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1287.11
CPU time (s): 10231.8
CPU user time (s): 10220
CPU system time (s): 11.85
CPU usage (%): 794.946
Max. virtual memory (cumulated for all children) (KiB): 32090704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.45302
system time used= 0.273958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 69445
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3709
involuntary context switches= 96

runsolver used 13.202 second user time and 31.7742 second system time

The end

Launcher Data 

Begin job on node103 at 2011-05-02 22:52:25
IDJOB=3321919
IDBENCH=82697
IDSOLVER=1712
FILE ID=node103/3321919-1304369545
RUNJOBID= node103-1304366469-12781
PBS_JOBID= 13181767
Free space on /tmp= 73464 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S415002759-031-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321919-1304369545/watcher-3321919-1304369545 -o /tmp/evaluation-result-3321919-1304369545/solver-3321919-1304369545 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321919-1304369545.cnf -seed 235606590 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6d4469ea6d617a494594ad07b4996367
RANDOM SEED=235606590

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10343684 kB
Buffers:       2137848 kB
Cached:        8327124 kB
SwapCached:          4 kB
Active:       13306188 kB
Inactive:      8672976 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10343684 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           32316 kB
Writeback:           0 kB
AnonPages:    11514592 kB
Mapped:          26212 kB
Slab:           522384 kB
PageTables:      39064 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 50010904 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73432 MiB
End job on node103 at 2011-05-02 23:13:55