Trace number 3386515

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (MO) 3459.8 3447.44

General information on the benchmark

Namerandom/large/
unif-k7-r85-v200-c17000-S1227169170-092-UNKNOWN.cnf
MD5SUM51cac83217796c0d85d5add5d2ed2d64
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2870.73
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.47	c INFO: solving HOME/instance-3386515-1305586164.cnf
0.31/0.47	c INFO: computing task features
0.41/0.58	c INFO: computed variable-clause graph statistics
0.41/0.58	c INFO: computed clause balance statistics
1.03/1.19	c INFO: computed variable balance statistics
1.31/1.43	c INFO: computed small-clause counts
1.31/1.43	c INFO: computed Horn-clause counts
1.31/1.45	c INFO: computed variable graph statistics
1.31/1.45	c INFO: collected features for HOME/instance-3386515-1305586164.cnf in 0.98 s
1.31/1.48	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.35)
102.01/101.88	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.12)
200.75/200.28	c INFO: running adaptg2wsat2009++@0 for 97 with 4800 remaining (b = 0.08)
300.47/299.66	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.06)
401.22/400.04	c INFO: running adaptg2wsat2009++@0 for 97 with 4600 remaining (b = 0.05)
499.92/498.42	c INFO: running gnovelty+2@0 for 97 with 4502 remaining (b = 0.04)
599.63/597.85	c INFO: running FH@0 for 97 with 4402 remaining (b = 0.03)
699.38/697.25	c INFO: running adaptg2wsat2009++@0 for 97 with 4303 remaining (b = 0.03)
799.12/796.65	c INFO: running adaptg2wsat2009++@0 for 97 with 4203 remaining (b = 0.02)
898.81/896.06	c INFO: running FH@0 for 97 with 4104 remaining (b = 0.02)
998.59/995.48	c INFO: running hybridGM3@0 for 194 with 4005 remaining (b = 0.04)
1196.08/1192.25	c INFO: running gnovelty+2@0 for 97 with 3808 remaining (b = 0.02)
1296.93/1292.70	c INFO: running hybridGM3@0 for 194 with 3707 remaining (b = 0.03)
1494.44/1489.59	c INFO: running hybridGM3@0 for 194 with 3511 remaining (b = 0.03)
1694.10/1688.48	c INFO: running TNM@0 for 1552 with 3312 remaining (b = 0.20)
3255.38/3243.81	c INFO: running adaptg2wsat2009++@0 for 97 with 1756 remaining (b = 0.01)
3356.29/3344.21	c INFO: running FH@0 for 97 with 1656 remaining (b = 0.01)
3459.05/3446.68	c INFO: running hybridGM3@0 for 194 with 1554 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386515-1305586164/watcher-3386515-1305586164 -o /tmp/evaluation-result-3386515-1305586164/solver-3386515-1305586164 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386515-1305586164.cnf -seed 1217366361 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.62 0.17 1.33 3/459 24544
/proc/meminfo: memFree=17736720/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=16240 CPUtime=0 cores=0,2,4,6
/proc/24544/stat : 24544 (python) R 24542 24544 24428 0 -1 4202496 1049 0 0 0 0 0 0 0 25 0 1 0 651031994 16629760 921 33554432000 4194304 5683644 140734118034496 18446744073709551615 5293775 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/24544/statm: 4060 921 381 364 0 547 0

[startup+0.0732661 s]
/proc/loadavg: 0.62 0.17 1.33 3/459 24544
/proc/meminfo: memFree=17736720/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=64660 CPUtime=0.04 cores=0,2,4,6
/proc/24544/stat : 24544 (python) R 24542 24544 24428 0 -1 4202496 2126 0 0 0 3 1 0 0 25 0 1 0 651031994 66211840 1880 33554432000 4194304 5683644 140734118034496 18446744073709551615 264721481351 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/24544/statm: 16723 1884 521 364 0 1323 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 64660

[startup+0.101226 s]
/proc/loadavg: 0.62 0.17 1.33 3/459 24544
/proc/meminfo: memFree=17736720/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=104224 CPUtime=0.07 cores=0,2,4,6
/proc/24544/stat : 24544 (python) R 24542 24544 24428 0 -1 4202496 3057 0 0 0 5 2 0 0 25 0 1 0 651031994 106725376 2740 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726403072 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/24544/statm: 26057 2741 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104224

[startup+0.300206 s]
/proc/loadavg: 0.62 0.17 1.33 3/459 24544
/proc/meminfo: memFree=17736720/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=170756 CPUtime=0.23 cores=0,2,4,6
/proc/24544/stat : 24544 (python) R 24542 24544 24428 0 -1 4202496 6737 931 1 0 17 6 0 0 17 0 1 0 651031994 174854144 4805 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726403072 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/24544/statm: 42689 4805 1336 364 0 3454 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 170756

[startup+0.70113 s]
/proc/loadavg: 0.62 0.17 1.33 3/459 24544
/proc/meminfo: memFree=17736720/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=282560 CPUtime=0.61 cores=0,2,4,6
/proc/24544/stat : 24544 (python) R 24542 24544 24428 0 -1 4202496 11216 931 1 0 52 9 0 0 17 0 1 0 651031994 289341440 8052 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726064387 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/24544/statm: 70640 8052 1826 364 0 6564 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 282560

[startup+1.50094 s]
/proc/loadavg: 0.62 0.17 1.33 3/460 24549
/proc/meminfo: memFree=17709556/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=289440 CPUtime=1.4 cores=0,2,4,6
/proc/24544/stat : 24544 (python) S 24542 24544 24428 0 -1 4202496 11595 931 1 0 131 9 0 0 21 0 2 0 651031994 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24544/statm: 72360 7232 1877 364 0 8278 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 289440

[startup+3.10066 s]
/proc/loadavg: 0.62 0.17 1.33 3/463 24552
/proc/meminfo: memFree=17709456/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=289440 CPUtime=1.4 cores=0,2,4,6
/proc/24544/stat : 24544 (python) S 24542 24544 24428 0 -1 4202496 11595 931 1 0 131 9 0 0 21 0 2 0 651031994 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24544/statm: 72360 7232 1877 364 0 8278 0
[pid=24550] ppid=24544 vsize=279196 CPUtime=0 cores=0,2,4,6
/proc/24550/stat : 24550 (python) S 24544 24544 24428 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 651032143 285896704 5705 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726425103 0 0 16781312 514 756623983146664194 0 0 17 2 0 0 0
/proc/24550/statm: 69799 5705 354 364 0 5717 0
[pid=24552] ppid=24550 vsize=1018616 CPUtime=1.6 cores=0,2,4,6
/proc/24552/stat : 24552 (gnovelty+2) R 24550 24552 24552 0 -1 4202496 764 0 0 0 160 0 0 0 25 0 1 0 651032143 1043062784 501 33554432000 134512640 135663704 4287754240 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24552/statm: 254654 501 113 282 0 254370 0
[pid=24544/tid=24551] ppid=24542 vsize=289440 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24551/stat : 24551 (python) S 24542 24544 24428 0 -1 4202560 31 931 0 0 0 0 0 0 21 0 2 0 651032143 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 1587252

[startup+6.30105 s]
/proc/loadavg: 0.73 0.20 1.33 3/463 24552
/proc/meminfo: memFree=17708608/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=289440 CPUtime=1.4 cores=0,2,4,6
/proc/24544/stat : 24544 (python) S 24542 24544 24428 0 -1 4202496 11595 931 1 0 131 9 0 0 21 0 2 0 651031994 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24544/statm: 72360 7232 1877 364 0 8278 0
[pid=24550] ppid=24544 vsize=279196 CPUtime=0.01 cores=0,2,4,6
/proc/24550/stat : 24550 (python) S 24544 24544 24428 0 -1 4202560 892 0 0 0 0 1 0 0 18 0 1 0 651032143 285896704 5728 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726425103 0 0 16781312 514 756623983146664194 0 0 17 6 0 0 0
/proc/24550/statm: 69799 5728 377 364 0 5717 0
[pid=24552] ppid=24550 vsize=1018616 CPUtime=4.8 cores=0,2,4,6
/proc/24552/stat : 24552 (gnovelty+2) R 24550 24552 24552 0 -1 4202496 764 0 0 0 480 0 0 0 25 0 1 0 651032143 1043062784 501 33554432000 134512640 135663704 4287754240 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24552/statm: 254654 501 113 282 0 254370 0
[pid=24544/tid=24551] ppid=24542 vsize=289440 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24551/stat : 24551 (python) S 24542 24544 24428 0 -1 4202560 31 931 0 0 0 0 0 0 21 0 2 0 651032143 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 1587252

[startup+12.7009 s]
/proc/loadavg: 0.83 0.23 1.33 3/463 24552
/proc/meminfo: memFree=17708224/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=289440 CPUtime=1.4 cores=0,2,4,6
/proc/24544/stat : 24544 (python) S 24542 24544 24428 0 -1 4202496 11595 931 1 0 131 9 0 0 21 0 2 0 651031994 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24544/statm: 72360 7232 1877 364 0 8278 0
[pid=24550] ppid=24544 vsize=279196 CPUtime=0.03 cores=0,2,4,6
/proc/24550/stat : 24550 (python) S 24544 24544 24428 0 -1 4202560 893 0 0 0 1 2 0 0 18 0 1 0 651032143 285896704 5728 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726425103 0 0 16781312 514 7717621648941089026 0 0 17 6 0 0 0
/proc/24550/statm: 69799 5728 377 364 0 5717 0
[pid=24552] ppid=24550 vsize=1018616 CPUtime=11.2 cores=0,2,4,6
/proc/24552/stat : 24552 (gnovelty+2) R 24550 24552 24552 0 -1 4202496 764 0 0 0 1120 0 0 0 25 0 1 0 651032143 1043062784 501 33554432000 134512640 135663704 4287754240 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24552/statm: 254654 501 113 282 0 254370 0
[pid=24544/tid=24551] ppid=24542 vsize=289440 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24551/stat : 24551 (python) S 24542 24544 24428 0 -1 4202560 31 931 0 0 0 0 0 0 21 0 2 0 651032143 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.63
Current children cumulated vsize (KiB) 1587252

[startup+25.5004 s]
/proc/loadavg: 1.09 0.31 1.35 3/463 24552
/proc/meminfo: memFree=17708452/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=289440 CPUtime=1.4 cores=0,2,4,6
/proc/24544/stat : 24544 (python) S 24542 24544 24428 0 -1 4202496 11595 931 1 0 131 9 0 0 21 0 2 0 651031994 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24544/statm: 72360 7232 1877 364 0 8278 0
[pid=24550] ppid=24544 vsize=279196 CPUtime=0.07 cores=0,2,4,6
/proc/24550/stat : 24550 (python) S 24544 24544 24428 0 -1 4202560 900 0 0 0 3 4 0 0 18 0 1 0 651032143 285896704 5728 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726425103 0 0 16781312 514 7717621648941089026 0 0 17 6 0 0 0
/proc/24550/statm: 69799 5728 377 364 0 5717 0
[pid=24552] ppid=24550 vsize=1018616 CPUtime=24 cores=0,2,4,6
/proc/24552/stat : 24552 (gnovelty+2) R 24550 24552 24552 0 -1 4202496 764 0 0 0 2400 0 0 0 25 0 1 0 651032143 1043062784 501 33554432000 134512640 135663704 4287754240 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24552/statm: 254654 501 113 282 0 254370 0
[pid=24544/tid=24551] ppid=24542 vsize=289440 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24551/stat : 24551 (python) S 24542 24544 24428 0 -1 4202560 31 931 0 0 0 0 0 0 21 0 2 0 651032143 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 1587252

[startup+51.1006 s]
/proc/loadavg: 1.40 0.45 1.36 3/463 24553
/proc/meminfo: memFree=17709052/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=289440 CPUtime=1.4 cores=0,2,4,6
/proc/24544/stat : 24544 (python) S 24542 24544 24428 0 -1 4202496 11595 931 1 0 131 9 0 0 21 0 2 0 651031994 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24544/statm: 72360 7232 1877 364 0 8278 0
[pid=24550] ppid=24544 vsize=279196 CPUtime=0.15 cores=0,2,4,6
/proc/24550/stat : 24550 (python) S 24544 24544 24428 0 -1 4202560 909 0 0 0 7 8 0 0 18 0 1 0 651032143 285896704 5728 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726425103 0 0 16781312 514 7717621648941089026 0 0 17 6 0 0 0
/proc/24550/statm: 69799 5728 377 364 0 5717 0
[pid=24552] ppid=24550 vsize=1018616 CPUtime=49.6 cores=0,2,4,6
/proc/24552/stat : 24552 (gnovelty+2) R 24550 24552 24552 0 -1 4202496 764 0 0 0 4960 0 0 0 25 0 1 0 651032143 1043062784 501 33554432000 134512640 135663704 4287754240 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24552/statm: 254654 501 113 282 0 254370 0
[pid=24544/tid=24551] ppid=24542 vsize=289440 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24551/stat : 24551 (python) S 24542 24544 24428 0 -1 4202560 31 931 0 0 0 0 0 0 21 0 2 0 651032143 296386560 7232 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 51.15
Current children cumulated vsize (KiB) 1587252

[startup+102.317 s]
/proc/loadavg: 1.78 0.70 1.40 3/471 24562
/proc/meminfo: memFree=17666092/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=299900 CPUtime=1.42 cores=0,2,4,6
/proc/24544/stat : 24544 (python) S 24542 24544 24428 0 -1 4202496 12440 931 1 0 133 9 0 0 20 0 3 0 651031994 307097600 7307 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24544/statm: 74975 7307 1880 364 0 10890 0
[pid=24550] ppid=24544 vsize=289440 CPUtime=0.33 cores=0,2,4,6
/proc/24550/stat : 24550 (python) S 24544 24544 24428 0 -1 4202560 1085 0 0 0 16 17 0 0 19 0 2 0 651032143 296386560 5766 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24550/statm: 72360 5766 410 364 0 8278 0
[pid=24552] ppid=24550 vsize=1018616 CPUtime=100.36 cores=0,2,4,6
/proc/24552/stat : 24552 (gnovelty+2) T 24550 24552 24552 0 -1 4202496 764 0 0 0 10036 0 0 0 25 0 1 0 651032143 1043062784 501 33554432000 134512640 135663704 4287754240 18446744073709551615 134545566 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/24552/statm: 254654 501 113 282 0 254370 0
[pid=24550/tid=24559] ppid=24544 vsize=289440 CPUtime=0 cores=0,2,4,6
/proc/24550/task/24559/stat : 24559 (python) S 24544 24544 24428 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 651042180 296386560 5766 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604448793891200 0 0 -1 6 0 0 0
[pid=24560] ppid=24544 vsize=289656 CPUtime=0 cores=0,2,4,6
/proc/24560/stat : 24560 (python) S 24544 24544 24428 0 -1 4202560 746 0 0 0 0 0 0 0 19 0 1 0 651042183 296607744 5771 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726425158 0 0 16781312 514 4148065949754327039 0 0 17 2 0 0 0
/proc/24560/statm: 72414 5771 348 364 0 8329 0
[pid=24562] ppid=24560 vsize=1018616 CPUtime=0.42 cores=0,2,4,6
/proc/24562/stat : 24562 (gnovelty+2) R 24560 24562 24562 0 -1 4202496 763 0 0 0 42 0 0 0 21 0 1 0 651042183 1043062784 500 33554432000 134512640 135663704 4287430048 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/24562/statm: 254654 500 113 282 0 254370 0
[pid=24544/tid=24551] ppid=24542 vsize=299900 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24551/stat : 24551 (python) S 24542 24544 24428 0 -1 4202560 31 931 0 0 0 0 0 0 21 0 3 0 651032143 307097600 7307 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 2 0 0 0
[pid=24544/tid=24561] ppid=24542 vsize=299900 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24561/stat : 24561 (python) S 24542 24544 24428 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 3 0 651042183 307097600 7307 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 102.53
Current children cumulated vsize (KiB) 2916228

[startup+162.301 s]
/proc/loadavg: 1.92 0.93 1.43 3/471 24564
/proc/meminfo: memFree=17664688/32951124 swapFree=63083192/67111528
[pid=24544] ppid=24542 vsize=299900 CPUtime=1.42 cores=0,2,4,6
/proc/24544/stat : 24544 (python) S 24542 24544 24428 0 -1 4202496 12440 931 1 0 133 9 0 0 20 0 3 0 651031994 307097600 7307 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/24544/statm: 74975 7307 1880 364 0 10890 0
[pid=24550] ppid=24544 vsize=289440 CPUtime=0.33 cores=0,2,4,6
/proc/24550/stat : 24550 (python) S 24544 24544 24428 0 -1 4202560 1085 0 0 0 16 17 0 0 19 0 2 0 651032143 296386560 5766 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24550/statm: 72360 5766 410 364 0 8278 0
[pid=24552] ppid=24550 vsize=1018616 CPUtime=100.36 cores=0,2,4,6
/proc/24552/stat : 24552 (gnovelty+2) T 24550 24552 24552 0 -1 4202496 764 0 0 0 10036 0 0 0 25 0 1 0 651032143 1043062784 501 33554432000 134512640 135663704 4287754240 18446744073709551615 134545566 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/24552/statm: 254654 501 113 282 0 254370 0
[pid=24550/tid=24559] ppid=24544 vsize=289440 CPUtime=0 cores=0,2,4,6
/proc/24550/task/24559/stat : 24559 (python) S 24544 24544 24428 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 651042180 296386560 5766 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604448793891200 0 0 -1 6 0 0 0
[pid=24560] ppid=24544 vsize=289656 CPUtime=0.19 cores=0,2,4,6

################
# More data... #
################

[pid=24579] ppid=24544 vsize=310776 CPUtime=0.33 cores=0,2,4,6
/proc/24579/stat : 24579 (python) S 24544 24544 24428 0 -1 4202560 1107 0 0 0 19 14 0 0 19 0 2 0 651061960 318234624 5967 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24579/statm: 77694 5967 400 364 0 13603 0
[pid=24581] ppid=24579 vsize=418636 CPUtime=100.34 cores=0,2,4,6
/proc/24581/stat : 24581 (adaptg2wsat2009) T 24579 24581 24581 0 -1 4202496 1224 0 0 0 10034 0 0 0 25 0 1 0 651061961 428683264 957 33554432000 134512640 135107411 4290371456 18446744073709551615 134532212 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/24581/statm: 104659 957 59 146 0 103535 0
[pid=24579/tid=24584] ppid=24544 vsize=310776 CPUtime=0 cores=0,2,4,6
/proc/24579/task/24584/stat : 24584 (python) S 24544 24544 24428 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 651071996 318234624 5967 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604449366074624 0 0 -1 6 0 0 0
[pid=24585] ppid=24544 vsize=321032 CPUtime=0.33 cores=0,2,4,6
/proc/24585/stat : 24585 (python) S 24544 24544 24428 0 -1 4202560 1122 0 0 0 17 16 0 0 19 0 2 0 651071999 328736768 5971 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24585/statm: 80258 5971 399 364 0 16164 0
[pid=24587] ppid=24585 vsize=418636 CPUtime=98.33 cores=0,2,4,6
/proc/24587/stat : 24587 (adaptg2wsat2009) T 24585 24587 24587 0 -1 4202496 1226 0 0 0 9833 0 0 0 25 0 1 0 651071999 428683264 956 33554432000 134512640 135107411 4288192896 18446744073709551615 134532097 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/24587/statm: 104659 956 59 146 0 103535 0
[pid=24585/tid=24594] ppid=24544 vsize=321032 CPUtime=0 cores=0,2,4,6
/proc/24585/task/24594/stat : 24594 (python) S 24544 24544 24428 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 651081834 328736768 5971 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604445990493056 0 0 -1 6 0 0 0
[pid=24595] ppid=24544 vsize=331288 CPUtime=0.35 cores=0,2,4,6
/proc/24595/stat : 24595 (python) S 24544 24544 24428 0 -1 4202560 1129 0 0 0 19 16 0 0 19 0 2 0 651081837 339238912 5975 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/24595/statm: 82822 5975 400 364 0 18725 0
[pid=24597] ppid=24595 vsize=1018616 CPUtime=99.37 cores=0,2,4,6
/proc/24597/stat : 24597 (gnovelty+2) T 24595 24597 24597 0 -1 4202496 768 0 0 0 9937 0 0 0 25 0 1 0 651081837 1043062784 500 33554432000 134512640 135663704 4291668464 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/24597/statm: 254654 500 113 282 0 254370 0
[pid=24595/tid=24602] ppid=24544 vsize=331288 CPUtime=0 cores=0,2,4,6
/proc/24595/task/24602/stat : 24602 (python) S 24544 24544 24428 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 651091776 339238912 5975 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604450801095872 0 0 -1 0 0 0 0
[pid=24603] ppid=24544 vsize=341716 CPUtime=0.35 cores=0,2,4,6
/proc/24603/stat : 24603 (python) S 24544 24544 24428 0 -1 4202560 1186 0 0 0 21 14 0 0 19 0 2 0 651091780 349917184 6028 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24603/statm: 85429 6028 405 364 0 21329 0
[pid=24605] ppid=24603 vsize=248652 CPUtime=99.35 cores=0,2,4,6
/proc/24605/stat : 24605 (FH) T 24603 24605 24605 0 -1 4202496 1125 0 0 0 9935 0 0 0 25 0 1 0 651091780 254619648 858 33554432000 134512640 134936988 4292225040 18446744073709551615 134554216 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/24605/statm: 62163 858 41 104 0 61667 0
[pid=24603/tid=24611] ppid=24544 vsize=341716 CPUtime=0 cores=0,2,4,6
/proc/24603/task/24611/stat : 24611 (python) S 24544 24544 24428 0 -1 4202560 98 0 0 0 0 0 0 0 19 0 2 0 651101716 349917184 6028 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604440686683072 0 0 -1 6 0 0 0
[pid=24612] ppid=24544 vsize=351972 CPUtime=0.36 cores=0,2,4,6
/proc/24612/stat : 24612 (python) S 24544 24544 24428 0 -1 4202560 1161 0 0 0 19 17 0 0 19 0 2 0 651101720 360419328 6032 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24612/statm: 87993 6032 406 364 0 23890 0
[pid=24614] ppid=24612 vsize=418636 CPUtime=99.35 cores=0,2,4,6
/proc/24614/stat : 24614 (adaptg2wsat2009) T 24612 24614 24614 0 -1 4202496 1231 0 0 0 9935 0 0 0 25 0 1 0 651101720 428683264 956 33554432000 134512640 135107411 4288782496 18446744073709551615 134531935 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/24614/statm: 104659 956 59 146 0 103535 0
[pid=24612/tid=24627] ppid=24544 vsize=351972 CPUtime=0 cores=0,2,4,6
/proc/24612/task/24627/stat : 24627 (python) S 24544 24544 24428 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 651111656 360419328 6032 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604453947385920 0 0 -1 2 0 0 0
[pid=24628] ppid=24544 vsize=362228 CPUtime=0.36 cores=0,2,4,6
/proc/24628/stat : 24628 (python) S 24544 24544 24428 0 -1 4202560 1139 0 0 0 18 18 0 0 19 0 2 0 651111660 370921472 6030 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24628/statm: 90557 6030 400 364 0 26451 0
[pid=24630] ppid=24628 vsize=418636 CPUtime=99.3 cores=0,2,4,6
/proc/24630/stat : 24630 (adaptg2wsat2009) T 24628 24630 24630 0 -1 4202496 1226 0 0 0 9930 0 0 0 25 0 1 0 651111660 428683264 956 33554432000 134512640 135107411 4293214544 18446744073709551615 134531830 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/24630/statm: 104659 956 59 146 0 103535 0
[pid=24628/tid=24637] ppid=24544 vsize=362228 CPUtime=0 cores=0,2,4,6
/proc/24628/task/24637/stat : 24637 (python) S 24544 24544 24428 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 651121596 370921472 6030 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604440686682176 0 0 -1 0 0 0 0
[pid=24638] ppid=24544 vsize=438020 CPUtime=0.36 cores=0,2,4,6
/proc/24638/stat : 24638 (python) S 24544 24544 24428 0 -1 4202560 1134 0 0 0 20 16 0 0 19 0 2 0 651121600 448532480 6036 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24638/statm: 109505 6036 400 364 0 45396 0
[pid=24640] ppid=24638 vsize=248652 CPUtime=99.37 cores=0,2,4,6
/proc/24640/stat : 24640 (FH) T 24638 24640 24640 0 -1 4202496 1129 0 0 0 9937 0 0 0 25 0 1 0 651121601 254619648 857 33554432000 134512640 134936988 4294794480 18446744073709551615 134553498 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/24640/statm: 62163 857 41 104 0 61667 0
[pid=24638/tid=24644] ppid=24544 vsize=438020 CPUtime=0 cores=0,2,4,6
/proc/24638/task/24644/stat : 24644 (python) S 24544 24544 24428 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 651131538 448532480 6036 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604441127592064 0 0 -1 6 0 0 0
[pid=24645] ppid=24544 vsize=448276 CPUtime=0.7 cores=0,2,4,6
/proc/24645/stat : 24645 (python) S 24544 24544 24428 0 -1 4202560 1150 0 0 0 38 32 0 0 19 0 2 0 651131542 459034624 6040 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24645/statm: 112069 6040 400 364 0 47957 0
[pid=24647] ppid=24645 vsize=268420 CPUtime=196.73 cores=0,2,4,6
/proc/24647/stat : 24647 (hybridGM3) T 24645 24647 24647 0 -1 4202496 5166 0 0 0 19673 0 0 0 25 0 1 0 651131543 274862080 4896 33554432000 134512640 135204385 4294800656 18446744073709551615 134538494 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/24647/statm: 67105 4896 63 169 0 66935 0
[pid=24645/tid=24657] ppid=24544 vsize=448276 CPUtime=0 cores=0,2,4,6
/proc/24645/task/24657/stat : 24657 (python) S 24544 24544 24428 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 651151216 459034624 6040 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604450801094976 0 0 -1 6 0 0 0
[pid=24658] ppid=24544 vsize=458532 CPUtime=0.35 cores=0,2,4,6
/proc/24658/stat : 24658 (python) S 24544 24544 24428 0 -1 4202560 1146 0 0 0 21 14 0 0 19 0 2 0 651151220 469536768 6046 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24658/statm: 114633 6046 400 364 0 50518 0
[pid=24660] ppid=24658 vsize=1018616 CPUtime=100.39 cores=0,2,4,6
/proc/24660/stat : 24660 (gnovelty+2) T 24658 24660 24660 0 -1 4202496 772 0 0 0 10039 0 0 0 25 0 1 0 651151220 1043062784 501 33554432000 134512640 135663704 4289306704 18446744073709551615 134524498 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/24660/statm: 254654 501 113 282 0 254370 0
[pid=24658/tid=24668] ppid=24544 vsize=458532 CPUtime=0 cores=0,2,4,6
/proc/24658/task/24668/stat : 24668 (python) S 24544 24544 24428 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 651161260 469536768 6046 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604449984669632 0 0 -1 6 0 0 0
[pid=24669] ppid=24544 vsize=468788 CPUtime=0.74 cores=0,2,4,6
/proc/24669/stat : 24669 (python) S 24544 24544 24428 0 -1 4202560 1164 0 0 0 39 35 0 0 19 0 2 0 651161264 480038912 6052 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24669/statm: 117197 6052 400 364 0 53079 0
[pid=24671] ppid=24669 vsize=268420 CPUtime=196.84 cores=0,2,4,6
/proc/24671/stat : 24671 (hybridGM3) T 24669 24671 24671 0 -1 4202496 5167 0 0 0 19684 0 0 0 25 0 1 0 651161265 274862080 4895 33554432000 134512640 135204385 4294237056 18446744073709551615 134538000 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/24671/statm: 67105 4895 63 169 0 66935 0
[pid=24669/tid=24681] ppid=24544 vsize=468788 CPUtime=0 cores=0,2,4,6
/proc/24669/task/24681/stat : 24681 (python) S 24544 24544 24428 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 651180949 480038912 6052 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604452600602816 0 0 -1 6 0 0 0
[pid=24682] ppid=24544 vsize=479044 CPUtime=0.75 cores=0,2,4,6
/proc/24682/stat : 24682 (python) S 24544 24544 24428 0 -1 4202560 1191 0 0 0 42 33 0 0 19 0 2 0 651180953 490541056 6056 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24682/statm: 119761 6056 400 364 0 55640 0
[pid=24684] ppid=24682 vsize=268424 CPUtime=198.84 cores=0,2,4,6
/proc/24684/stat : 24684 (hybridGM3) T 24682 24684 24684 0 -1 4202496 5168 0 0 0 19884 0 0 0 25 0 1 0 651180954 274866176 4896 33554432000 134512640 135204385 4291322496 18446744073709551615 134538541 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/24684/statm: 67106 4896 63 169 0 66936 0
[pid=24682/tid=24695] ppid=24544 vsize=479044 CPUtime=0 cores=0,2,4,6
/proc/24682/task/24695/stat : 24695 (python) S 24544 24544 24428 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 651200838 490541056 6056 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604449984667840 0 0 -1 6 0 0 0
[pid=24696] ppid=24544 vsize=489496 CPUtime=5.96 cores=0,2,4,6
/proc/24696/stat : 24696 (python) S 24544 24544 24428 0 -1 4202560 1234 0 0 0 325 271 0 0 19 0 2 0 651200842 501243904 6113 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24696/statm: 122374 6113 408 364 0 58250 0
[pid=24698] ppid=24696 vsize=457128 CPUtime=1555.35 cores=0,2,4,6
/proc/24698/stat : 24698 (TNM) T 24696 24698 24698 0 -1 4202496 1114 0 0 0 155535 0 0 0 25 0 1 0 651200843 468099072 838 33554432000 134512640 135008748 4287266800 18446744073709551615 134527773 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/24698/statm: 114282 838 46 122 0 113182 0
[pid=24696/tid=24752] ppid=24544 vsize=489496 CPUtime=0 cores=0,2,4,6
/proc/24696/task/24752/stat : 24752 (python) S 24544 24544 24428 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 651356373 501243904 6113 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604445170300928 0 0 -1 6 0 0 0
[pid=24753] ppid=24544 vsize=499752 CPUtime=0.38 cores=0,2,4,6
/proc/24753/stat : 24753 (python) S 24544 24544 24428 0 -1 4202560 1195 0 0 0 20 18 0 0 19 0 2 0 651356375 511746048 6116 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24753/statm: 124938 6116 407 364 0 60811 0
[pid=24755] ppid=24753 vsize=418636 CPUtime=100.37 cores=0,2,4,6
/proc/24755/stat : 24755 (adaptg2wsat2009) T 24753 24755 24755 0 -1 4202496 1232 0 0 0 10037 0 0 0 25 0 1 0 651356376 428683264 955 33554432000 134512640 135107411 4291387216 18446744073709551615 134532376 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/24755/statm: 104659 955 59 146 0 103535 0
[pid=24753/tid=24759] ppid=24544 vsize=499752 CPUtime=0 cores=0,2,4,6
/proc/24753/task/24759/stat : 24759 (python) S 24544 24544 24428 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 651366413 511746048 6116 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604445170299136 0 0 -1 6 0 0 0
[pid=24760] ppid=24544 vsize=510008 CPUtime=0.4 cores=0,2,4,6
/proc/24760/stat : 24760 (python) S 24544 24544 24428 0 -1 4202560 1168 0 0 0 22 18 0 0 19 0 2 0 651366415 522248192 6121 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/24760/statm: 127502 6121 401 364 0 63372 0
[pid=24762] ppid=24760 vsize=248652 CPUtime=102.44 cores=0,2,4,6
/proc/24762/stat : 24762 (FH) T 24760 24762 24762 0 -1 4202496 1131 0 0 0 10244 0 0 0 25 0 1 0 651366416 254619648 857 33554432000 134512640 134936988 4293438608 18446744073709551615 134544800 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/24762/statm: 62163 857 41 104 0 61667 0
[pid=24760/tid=24766] ppid=24544 vsize=510008 CPUtime=0 cores=0,2,4,6
/proc/24760/task/24766/stat : 24766 (python) S 24544 24544 24428 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 651376661 522248192 6121 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 514 18446604453729161600 0 0 -1 6 0 0 0
[pid=24767] ppid=24544 vsize=520480 CPUtime=0 cores=0,2,4,6
/proc/24767/stat : 24767 (python) S 24544 24544 24428 0 -1 4202560 853 0 0 0 0 0 0 0 19 0 1 0 651376663 532971520 6119 33554432000 4194304 5683644 140734118034496 18446744073709551615 264726425158 0 0 16781312 514 3640162496221806591 0 0 17 6 0 0 0
/proc/24767/statm: 130120 6119 349 364 0 65987 0
[pid=24769] ppid=24767 vsize=268424 CPUtime=0.64 cores=0,2,4,6
/proc/24769/stat : 24769 (hybridGM3) R 24767 24769 24769 0 -1 4202496 5173 0 0 0 64 0 0 0 22 0 1 0 651376663 274866176 4897 33554432000 134512640 135204385 4287232144 18446744073709551615 134538257 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/24769/statm: 67106 4897 63 169 0 66936 0
[pid=24544/tid=24551] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24551/stat : 24551 (python) S 24542 24544 24428 0 -1 4202560 31 931 0 0 0 0 0 0 21 0 19 0 651032143 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 2 0 0 0
[pid=24544/tid=24561] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24561/stat : 24561 (python) S 24542 24544 24428 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 19 0 651042183 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 6 0 0 0
[pid=24544/tid=24572] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24572/stat : 24572 (python) S 24542 24544 24428 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 19 0 651052023 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 4 0 0 0
[pid=24544/tid=24580] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24580/stat : 24580 (python) S 24542 24544 24428 0 -1 4202560 24 931 0 0 0 0 0 0 20 0 19 0 651061961 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 4 0 0 0
[pid=24544/tid=24586] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24586/stat : 24586 (python) S 24542 24544 24428 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 19 0 651071999 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 4 0 0 0
[pid=24544/tid=24596] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24596/stat : 24596 (python) S 24542 24544 24428 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 19 0 651081837 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 6 0 0 0
[pid=24544/tid=24604] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24604/stat : 24604 (python) S 24542 24544 24428 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 19 0 651091780 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 6 0 0 0
[pid=24544/tid=24613] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24613/stat : 24613 (python) S 24542 24544 24428 0 -1 4202560 34 931 0 0 0 0 0 0 20 0 19 0 651101720 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 6 0 0 0
[pid=24544/tid=24629] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24629/stat : 24629 (python) S 24542 24544 24428 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 19 0 651111660 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 2 0 0 0
[pid=24544/tid=24639] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24639/stat : 24639 (python) S 24542 24544 24428 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 19 0 651121601 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 0 0 0 0
[pid=24544/tid=24646] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24646/stat : 24646 (python) S 24542 24544 24428 0 -1 4202560 33 931 0 0 0 0 0 0 20 0 19 0 651131542 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 0 0 0 0
[pid=24544/tid=24659] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24659/stat : 24659 (python) S 24542 24544 24428 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 19 0 651151220 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 0 0 0 0
[pid=24544/tid=24670] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24670/stat : 24670 (python) S 24542 24544 24428 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 19 0 651161265 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 6 0 0 0
[pid=24544/tid=24683] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24683/stat : 24683 (python) S 24542 24544 24428 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 19 0 651180954 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 0 0 0 0
[pid=24544/tid=24697] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24697/stat : 24697 (python) S 24542 24544 24428 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 19 0 651200843 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 0 0 0 0
[pid=24544/tid=24754] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24754/stat : 24754 (python) S 24542 24544 24428 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 19 0 651356375 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 0 0 0 0
[pid=24544/tid=24761] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24761/stat : 24761 (python) S 24542 24544 24428 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 19 0 651366415 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 0 0 0 0
[pid=24544/tid=24768] ppid=24542 vsize=530724 CPUtime=0 cores=0,2,4,6
/proc/24544/task/24768/stat : 24768 (python) S 24542 24544 24428 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 19 0 651376663 543461376 7686 33554432000 4194304 5683644 140734118034496 18446744073709551615 264738228657 0 0 16781312 2 18446604445990491264 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3459.8
Current children cumulated vsize (KiB) 16604800

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24544 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=877714
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=152976
# CPU time returned by wait4() is 2.03069
# while last known CPU time is 3459.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3447.44
CPU time (s): 3459.8
CPU user time (s): 3453.86
CPU system time (s): 5.94
CPU usage (%): 100.359
Max. virtual memory (cumulated for all children) (KiB): 16604800

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.87771
system time used= 0.152976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29138
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1074
involuntary context switches= 44

runsolver used 28.1207 second user time and 54.1978 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-17 00:49:24
IDJOB=3386515
IDBENCH=82580
IDSOLVER=1872
FILE ID=node141/3386515-1305586164
RUNJOBID= node141-1305586143-24446
PBS_JOBID= 13350337
Free space on /tmp= 73224 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v200-c17000-S1227169170-092-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386515-1305586164/watcher-3386515-1305586164 -o /tmp/evaluation-result-3386515-1305586164/solver-3386515-1305586164 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386515-1305586164.cnf -seed 1217366361 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 51cac83217796c0d85d5add5d2ed2d64
RANDOM SEED=1217366361

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17737008 kB
Buffers:        297824 kB
Cached:        5731324 kB
SwapCached:      15708 kB
Active:        9548400 kB
Inactive:      5385212 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17737008 kB
SwapTotal:    67111528 kB
SwapFree:     63083192 kB
Dirty:           68104 kB
Writeback:           0 kB
AnonPages:     8895516 kB
Mapped:          25568 kB
Slab:           150228 kB
PageTables:      63704 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 125347572 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73192 MiB
End job on node141 at 2011-05-17 01:46:53