Trace number 3317127

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 2383.59 599.517

General information on the benchmark

Namerandom/large/
unif-k7-r85-v200-c17000-S949556727-080-UNKNOWN.cnf
MD5SUM274f6c2fc3e630d8716a09f7c87233f2
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data 

0.33/0.55	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.55	c INFO: solving HOME/instance-3317127-1304267413.cnf
0.33/0.55	c INFO: computing task features
0.42/0.66	c INFO: computed variable-clause graph statistics
0.42/0.67	c INFO: computed clause balance statistics
1.02/1.25	c INFO: computed variable balance statistics
1.22/1.47	c INFO: computed small-clause counts
1.22/1.47	c INFO: computed Horn-clause counts
1.22/1.49	c INFO: computed variable graph statistics
1.22/1.49	c INFO: collected features for HOME/instance-3317127-1304267413.cnf in 0.94 s
1.32/1.52	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.35)
1.32/1.55	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.12)
1.32/1.58	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.08)
1.42/1.61	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.06)
401.29/101.70	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.05)
401.29/101.73	c INFO: running gnovelty+2@0 for 97 with 4698 remaining (b = 0.04)
401.29/101.77	c INFO: running FH@0 for 97 with 4698 remaining (b = 0.03)
401.45/101.81	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.03)
796.72/200.88	c INFO: running adaptg2wsat2009++@0 for 97 with 4599 remaining (b = 0.02)
797.10/200.96	c INFO: running FH@0 for 97 with 4599 remaining (b = 0.02)
801.09/201.94	c INFO: running hybridGM3@0 for 194 with 4598 remaining (b = 0.04)
801.09/202.00	c INFO: running gnovelty+2@0 for 97 with 4598 remaining (b = 0.02)
1195.83/301.07	c INFO: running hybridGM3@0 for 194 with 4499 remaining (b = 0.03)
1196.22/301.14	c INFO: running hybridGM3@0 for 194 with 4499 remaining (b = 0.03)
1200.59/302.21	c INFO: running TNM@0 for 1552 with 4498 remaining (b = 0.20)
1583.28/398.34	c INFO: running adaptg2wsat2009++@0 for 97 with 4402 remaining (b = 0.01)
1978.17/497.56	c INFO: running hybridGM3@100 for 97 with 4303 remaining (b = 0.01)
1982.15/498.54	c INFO: running hybridGM3@100 for 97 with 4302 remaining (b = 0.01)
2001.65/503.49	c INFO: running hybridGM3@99 for 97 with 4297 remaining (b = 0.01)
2366.52/595.18	c INFO: running FH@0 for 97 with 4205 remaining (b = 0.01)
2380.40/598.68	c INFO: running hybridGM3@0 for 194 with 4201 remaining (b = 0.02)
2380.77/598.76	c INFO: running hybridGM3@298 for 97 with 4201 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317127-1304267413/watcher-3317127-1304267413 -o /tmp/evaluation-result-3317127-1304267413/solver-3317127-1304267413 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317127-1304267413.cnf -seed 1962411866 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.83 2.48 0.89 6/205 20219
/proc/meminfo: memFree=24073636/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=15384 CPUtime=0 cores=0,2,4,6
/proc/20219/stat : 20219 (python) R 20217 20219 20058 0 -1 4202496 820 0 0 0 0 0 0 0 17 0 1 0 538339076 15753216 705 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687673344 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/20219/statm: 3846 705 334 364 0 333 0

[startup+0.0538059 s]
/proc/loadavg: 6.83 2.48 0.89 6/205 20219
/proc/meminfo: memFree=24073636/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=32172 CPUtime=0.03 cores=0,2,4,6
/proc/20219/stat : 20219 (python) S 20217 20219 20058 0 -1 4202496 1518 0 0 0 3 0 0 0 17 0 1 0 538339076 32944128 1355 33554432000 4194304 5683644 140733314661968 18446744073709551615 212682751623 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/20219/statm: 8043 1355 445 364 0 898 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 32172

[startup+0.100813 s]
/proc/loadavg: 6.83 2.48 0.89 6/205 20219
/proc/meminfo: memFree=24073636/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=104228 CPUtime=0.07 cores=0,2,4,6
/proc/20219/stat : 20219 (python) S 20217 20219 20058 0 -1 4202496 3059 0 0 0 5 2 0 0 17 0 1 0 538339076 106729472 2742 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/20219/statm: 26057 2742 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.300789 s]
/proc/loadavg: 6.83 2.48 0.89 6/205 20219
/proc/meminfo: memFree=24073636/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=135752 CPUtime=0.19 cores=0,2,4,6
/proc/20219/stat : 20219 (python) R 20217 20219 20058 0 -1 4202496 5964 933 1 0 14 5 0 0 17 0 1 0 538339076 139010048 4152 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687671301 0 2147483391 16781312 2 0 0 0 17 4 0 0 0
/proc/20219/statm: 33938 4152 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700672 s]
/proc/loadavg: 6.83 2.48 0.89 6/205 20219
/proc/meminfo: memFree=24073636/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=282588 CPUtime=0.52 cores=0,2,4,6
/proc/20219/stat : 20219 (python) R 20217 20219 20058 0 -1 4202496 11328 933 1 0 43 9 0 0 17 0 1 0 538339076 289370112 8059 33554432000 4194304 5683644 140733314661968 18446744073709551615 47186925345447 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/20219/statm: 70647 8059 1826 364 0 6571 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 282588

[startup+1.50052 s]
/proc/loadavg: 6.83 2.48 0.89 7/206 20224
/proc/meminfo: memFree=24047216/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=279220 CPUtime=1.32 cores=0,2,4,6
/proc/20219/stat : 20219 (python) R 20217 20219 20058 0 -1 4202496 11432 933 1 0 123 9 0 0 18 0 1 0 538339076 285921280 7220 33554432000 4194304 5683644 140733314661968 18446744073709551615 212691083957 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/20219/statm: 69805 7220 1859 364 0 5726 0
Current children cumulated CPU time (s) 1.32
Current children cumulated vsize (KiB) 279220

[startup+3.10119 s]
/proc/loadavg: 6.68 2.52 0.91 9/218 20236
/proc/meminfo: memFree=24026900/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=320512 CPUtime=1.43 cores=0,2,4,6
/proc/20219/stat : 20219 (python) S 20217 20219 20058 0 -1 4202496 14160 933 1 0 133 10 0 0 20 0 5 0 538339076 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/20219/statm: 80128 7327 1883 364 0 16037 0
[pid=20225] ppid=20219 vsize=279232 CPUtime=0 cores=0,2,4,6
/proc/20225/stat : 20225 (python) S 20219 20219 20058 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 538339228 285933568 5715 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695375 0 0 16781312 514 4353406068433322244 0 0 17 6 0 0 0
/proc/20225/statm: 69808 5715 354 364 0 5726 0
[pid=20227] ppid=20225 vsize=1018616 CPUtime=1.56 cores=0,2,4,6
/proc/20227/stat : 20227 (gnovelty+2) R 20225 20227 20227 0 -1 4202496 761 0 0 0 156 0 0 0 25 0 1 0 538339229 1043062784 500 33554432000 134512640 135663704 4294552704 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/20227/statm: 254654 500 113 282 0 254370 0
[pid=20228] ppid=20219 vsize=289624 CPUtime=0 cores=0,2,4,6
/proc/20228/stat : 20228 (python) S 20219 20219 20058 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 538339231 296574976 5763 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 4360869553362665729 0 0 17 4 0 0 0
/proc/20228/statm: 72406 5763 348 364 0 8321 0
[pid=20230] ppid=20228 vsize=1018616 CPUtime=1.54 cores=0,2,4,6
/proc/20230/stat : 20230 (gnovelty+2) R 20228 20230 20230 0 -1 4202496 764 0 0 0 154 0 0 0 25 0 1 0 538339231 1043062784 501 33554432000 134512640 135663704 4287195088 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/20230/statm: 254654 501 113 282 0 254370 0
[pid=20231] ppid=20219 vsize=300012 CPUtime=0 cores=0,2,4,6
/proc/20231/stat : 20231 (python) S 20219 20219 20058 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 538339234 307212288 5784 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 4183131024831545343 0 0 17 4 0 0 0
/proc/20231/statm: 75003 5784 348 364 0 10915 0
[pid=20233] ppid=20231 vsize=418500 CPUtime=1.51 cores=0,2,4,6
/proc/20233/stat : 20233 (adaptg2wsat2009) R 20231 20233 20233 0 -1 4202496 1073 0 0 0 151 0 0 0 25 0 1 0 538339234 428544000 810 33554432000 134512640 135107411 4286669280 18446744073709551615 134523503 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/20233/statm: 104625 810 49 146 0 103501 0
[pid=20234] ppid=20219 vsize=310268 CPUtime=0 cores=0,2,4,6
/proc/20234/stat : 20234 (python) S 20219 20219 20058 0 -1 4202560 749 0 0 0 0 0 0 0 18 0 1 0 538339237 317714432 5788 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 14132972109512572927 0 0 17 6 0 0 0
/proc/20234/statm: 77567 5788 348 364 0 13476 0
[pid=20236] ppid=20234 vsize=418500 CPUtime=1.48 cores=0,2,4,6
/proc/20236/stat : 20236 (adaptg2wsat2009) R 20234 20236 20236 0 -1 4202496 1074 0 0 0 148 0 0 0 25 0 1 0 538339237 428544000 809 33554432000 134512640 135107411 4288114464 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/20236/statm: 104625 809 49 146 0 103501 0
[pid=20219/tid=20226] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20226/stat : 20226 (python) S 20217 20219 20058 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 5 0 538339228 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 0 0 0 0
[pid=20219/tid=20229] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20229/stat : 20229 (python) S 20217 20219 20058 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 5 0 538339231 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20232] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20232/stat : 20232 (python) S 20217 20219 20058 0 -1 4202560 23 933 0 0 0 0 0 0 22 0 5 0 538339234 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 4 0 0 0
[pid=20219/tid=20235] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20235/stat : 20235 (python) S 20217 20219 20058 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 5 0 538339237 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 7.52
Current children cumulated vsize (KiB) 4373880

[startup+6.30061 s]
/proc/loadavg: 6.68 2.52 0.91 10/218 20236
/proc/meminfo: memFree=24025592/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=320512 CPUtime=1.43 cores=0,2,4,6
/proc/20219/stat : 20219 (python) S 20217 20219 20058 0 -1 4202496 14160 933 1 0 133 10 0 0 20 0 5 0 538339076 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/20219/statm: 80128 7327 1883 364 0 16037 0
[pid=20225] ppid=20219 vsize=279232 CPUtime=0 cores=0,2,4,6
/proc/20225/stat : 20225 (python) S 20219 20219 20058 0 -1 4202560 897 0 0 0 0 0 0 0 18 0 1 0 538339228 285933568 5738 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695375 0 0 16781312 514 4353406068433322244 0 0 17 6 0 0 0
/proc/20225/statm: 69808 5738 377 364 0 5726 0
[pid=20227] ppid=20225 vsize=1018616 CPUtime=4.72 cores=0,2,4,6
/proc/20227/stat : 20227 (gnovelty+2) R 20225 20227 20227 0 -1 4202496 761 0 0 0 472 0 0 0 25 0 1 0 538339229 1043062784 500 33554432000 134512640 135663704 4294552704 18446744073709551615 134524526 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/20227/statm: 254654 500 113 282 0 254370 0
[pid=20228] ppid=20219 vsize=289624 CPUtime=0 cores=0,2,4,6
/proc/20228/stat : 20228 (python) S 20219 20219 20058 0 -1 4202560 906 0 0 0 0 0 0 0 18 0 1 0 538339231 296574976 5786 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 4360869553362665729 0 0 17 4 0 0 0
/proc/20228/statm: 72406 5786 371 364 0 8321 0
[pid=20230] ppid=20228 vsize=1018616 CPUtime=4.74 cores=0,2,4,6
/proc/20230/stat : 20230 (gnovelty+2) R 20228 20230 20230 0 -1 4202496 764 0 0 0 474 0 0 0 25 0 1 0 538339231 1043062784 501 33554432000 134512640 135663704 4287195088 18446744073709551615 134545619 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/20230/statm: 254654 501 113 282 0 254370 0
[pid=20231] ppid=20219 vsize=300012 CPUtime=0 cores=0,2,4,6
/proc/20231/stat : 20231 (python) S 20219 20219 20058 0 -1 4202560 893 0 0 0 0 0 0 0 18 0 1 0 538339234 307212288 5807 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 4183131024831512836 0 0 17 4 0 0 0
/proc/20231/statm: 75003 5807 371 364 0 10915 0
[pid=20233] ppid=20231 vsize=418636 CPUtime=4.69 cores=0,2,4,6
/proc/20233/stat : 20233 (adaptg2wsat2009) R 20231 20233 20233 0 -1 4202496 1220 0 0 0 469 0 0 0 25 0 1 0 538339234 428683264 957 33554432000 134512640 135107411 4286669280 18446744073709551615 134532349 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/20233/statm: 104659 957 59 146 0 103535 0
[pid=20234] ppid=20219 vsize=310268 CPUtime=0 cores=0,2,4,6
/proc/20234/stat : 20234 (python) S 20219 20219 20058 0 -1 4202560 919 0 0 0 0 0 0 0 18 0 1 0 538339237 317714432 5810 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 14132972109512540419 0 0 17 6 0 0 0
/proc/20234/statm: 77567 5810 370 364 0 13476 0
[pid=20236] ppid=20234 vsize=418636 CPUtime=4.68 cores=0,2,4,6
/proc/20236/stat : 20236 (adaptg2wsat2009) R 20234 20236 20236 0 -1 4202496 1221 0 0 0 468 0 0 0 25 0 1 0 538339237 428683264 956 33554432000 134512640 135107411 4288114464 18446744073709551615 134531822 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/20236/statm: 104659 956 59 146 0 103535 0
[pid=20219/tid=20226] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20226/stat : 20226 (python) S 20217 20219 20058 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 5 0 538339228 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 0 0 0 0
[pid=20219/tid=20229] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20229/stat : 20229 (python) S 20217 20219 20058 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 5 0 538339231 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20232] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20232/stat : 20232 (python) S 20217 20219 20058 0 -1 4202560 23 933 0 0 0 0 0 0 22 0 5 0 538339234 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 4 0 0 0
[pid=20219/tid=20235] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20235/stat : 20235 (python) S 20217 20219 20058 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 5 0 538339237 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 20.26
Current children cumulated vsize (KiB) 4374152

[startup+12.7014 s]
/proc/loadavg: 6.97 2.72 1.00 10/218 20236
/proc/meminfo: memFree=24024348/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=320512 CPUtime=1.43 cores=0,2,4,6
/proc/20219/stat : 20219 (python) S 20217 20219 20058 0 -1 4202496 14160 933 1 0 133 10 0 0 20 0 5 0 538339076 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/20219/statm: 80128 7327 1883 364 0 16037 0
[pid=20225] ppid=20219 vsize=279232 CPUtime=0.01 cores=0,2,4,6
/proc/20225/stat : 20225 (python) S 20219 20219 20058 0 -1 4202560 900 0 0 0 0 1 0 0 18 0 1 0 538339228 285933568 5738 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695375 0 0 16781312 514 11123416090581893380 0 0 17 6 0 0 0
/proc/20225/statm: 69808 5738 377 364 0 5726 0
[pid=20227] ppid=20225 vsize=1018616 CPUtime=11.07 cores=0,2,4,6
/proc/20227/stat : 20227 (gnovelty+2) R 20225 20227 20227 0 -1 4202496 761 0 0 0 1107 0 0 0 25 0 1 0 538339229 1043062784 500 33554432000 134512640 135663704 4294552704 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/20227/statm: 254654 500 113 282 0 254370 0
[pid=20228] ppid=20219 vsize=289624 CPUtime=0 cores=0,2,4,6
/proc/20228/stat : 20228 (python) S 20219 20219 20058 0 -1 4202560 908 0 0 0 0 0 0 0 18 0 1 0 538339231 296574976 5786 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 11123416090581893377 0 0 17 4 0 0 0
/proc/20228/statm: 72406 5786 371 364 0 8321 0
[pid=20230] ppid=20228 vsize=1018616 CPUtime=11.14 cores=0,2,4,6
/proc/20230/stat : 20230 (gnovelty+2) R 20228 20230 20230 0 -1 4202496 764 0 0 0 1114 0 0 0 25 0 1 0 538339231 1043062784 501 33554432000 134512640 135663704 4287195088 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/20230/statm: 254654 501 113 282 0 254370 0
[pid=20231] ppid=20219 vsize=300012 CPUtime=0 cores=0,2,4,6
/proc/20231/stat : 20231 (python) S 20219 20219 20058 0 -1 4202560 898 0 0 0 0 0 0 0 18 0 1 0 538339234 307212288 5807 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 11123416090581893380 0 0 17 4 0 0 0
/proc/20231/statm: 75003 5807 371 364 0 10915 0
[pid=20233] ppid=20231 vsize=418636 CPUtime=11.08 cores=0,2,4,6
/proc/20233/stat : 20233 (adaptg2wsat2009) R 20231 20233 20233 0 -1 4202496 1220 0 0 0 1108 0 0 0 25 0 1 0 538339234 428683264 957 33554432000 134512640 135107411 4286669280 18446744073709551615 134531674 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/20233/statm: 104659 957 59 146 0 103535 0
[pid=20234] ppid=20219 vsize=310268 CPUtime=0 cores=0,2,4,6
/proc/20234/stat : 20234 (python) S 20219 20219 20058 0 -1 4202560 923 0 0 0 0 0 0 0 18 0 1 0 538339237 317714432 5811 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 11123416090581893379 0 0 17 6 0 0 0
/proc/20234/statm: 77567 5811 371 364 0 13476 0
[pid=20236] ppid=20234 vsize=418636 CPUtime=11.08 cores=0,2,4,6
/proc/20236/stat : 20236 (adaptg2wsat2009) R 20234 20236 20236 0 -1 4202496 1221 0 0 0 1108 0 0 0 25 0 1 0 538339237 428683264 956 33554432000 134512640 135107411 4288114464 18446744073709551615 134532306 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/20236/statm: 104659 956 59 146 0 103535 0
[pid=20219/tid=20226] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20226/stat : 20226 (python) S 20217 20219 20058 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 5 0 538339228 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 0 0 0 0
[pid=20219/tid=20229] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20229/stat : 20229 (python) S 20217 20219 20058 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 5 0 538339231 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20232] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20232/stat : 20232 (python) S 20217 20219 20058 0 -1 4202560 23 933 0 0 0 0 0 0 22 0 5 0 538339234 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 4 0 0 0
[pid=20219/tid=20235] ppid=20217 vsize=320512 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20235/stat : 20235 (python) S 20217 20219 20058 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 5 0 538339237 328204288 7327 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 45.81
Current children cumulated vsize (KiB) 4374152

[startup+25.5011 s]
/proc/loadavg: 7.12 2.89 1.07 10/218 20237
/proc/meminfo: memFree=24024392/32951124 swapFree=67111524/67111528
[pid=20219] ppid=20217 vsize=320512 CPUtime=1.43 cores=0,2,4,6

################
# More data... #
################

/proc/20234/stat : 20234 (python) S 20219 20219 20058 0 -1 4202560 1108 0 0 0 6 7 0 0 19 0 2 0 538339237 317714432 5841 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/20234/statm: 77567 5841 400 364 0 13476 0
[pid=20236] ppid=20234 vsize=418636 CPUtime=100.11 cores=0,2,4,6
/proc/20236/stat : 20236 (adaptg2wsat2009) T 20234 20236 20236 0 -1 4202496 1221 0 0 0 10011 0 0 0 25 0 1 0 538339237 428683264 956 33554432000 134512640 135107411 4288114464 18446744073709551615 134539275 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/20236/statm: 104659 956 59 146 0 103535 0
[pid=20234/tid=20262] ppid=20219 vsize=310268 CPUtime=0 cores=0,2,4,6
/proc/20234/task/20262/stat : 20262 (python) S 20219 20219 20058 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538349249 317714432 5841 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604443318380352 0 0 -1 6 0 0 0
[pid=20258] ppid=20219 vsize=320524 CPUtime=0.15 cores=0,2,4,6
/proc/20258/stat : 20258 (python) S 20219 20219 20058 0 -1 4202560 1125 0 0 0 8 7 0 0 19 0 2 0 538349247 328216576 5845 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/20258/statm: 80131 5845 400 364 0 16037 0
[pid=20260] ppid=20258 vsize=418636 CPUtime=98 cores=0,2,4,6
/proc/20260/stat : 20260 (adaptg2wsat2009) T 20258 20260 20260 0 -1 4202496 1221 0 0 0 9800 0 0 0 25 0 1 0 538349247 428683264 955 33554432000 134512640 135107411 4290612528 18446744073709551615 134532349 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/20260/statm: 104659 955 59 146 0 103535 0
[pid=20258/tid=20286] ppid=20219 vsize=320524 CPUtime=0 cores=0,2,4,6
/proc/20258/task/20286/stat : 20286 (python) S 20219 20219 20058 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538359161 328216576 5845 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453942916928 0 0 -1 6 0 0 0
[pid=20263] ppid=20219 vsize=330932 CPUtime=0.15 cores=0,2,4,6
/proc/20263/stat : 20263 (python) S 20219 20219 20058 0 -1 4202560 1124 0 0 0 8 7 0 0 19 0 2 0 538349250 338874368 5887 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/20263/statm: 82733 5887 400 364 0 18636 0
[pid=20265] ppid=20263 vsize=1018616 CPUtime=99.86 cores=0,2,4,6
/proc/20265/stat : 20265 (gnovelty+2) T 20263 20265 20265 0 -1 4202496 765 0 0 0 9986 0 0 0 25 0 1 0 538349250 1043062784 500 33554432000 134512640 135663704 4288267072 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/20265/statm: 254654 500 113 282 0 254370 0
[pid=20263/tid=20295] ppid=20219 vsize=330932 CPUtime=0 cores=0,2,4,6
/proc/20263/task/20295/stat : 20295 (python) S 20219 20219 20058 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538359267 338874368 5887 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453951223808 0 0 -1 0 0 0 0
[pid=20266] ppid=20219 vsize=341188 CPUtime=0.15 cores=0,2,4,6
/proc/20266/stat : 20266 (python) S 20219 20219 20058 0 -1 4202560 1168 0 0 0 8 7 0 0 19 0 2 0 538349253 349376512 5897 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/20266/statm: 85297 5897 406 364 0 21197 0
[pid=20268] ppid=20266 vsize=248652 CPUtime=99.14 cores=0,2,4,6
/proc/20268/stat : 20268 (FH) T 20266 20268 20268 0 -1 4202496 1124 0 0 0 9914 0 0 0 25 0 1 0 538349254 254619648 858 33554432000 134512640 134936988 4288598336 18446744073709551615 134553279 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/20268/statm: 62163 858 41 104 0 61667 0
[pid=20266/tid=20290] ppid=20219 vsize=341188 CPUtime=0 cores=0,2,4,6
/proc/20266/task/20290/stat : 20290 (python) S 20219 20219 20058 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 538359168 349376512 5897 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453922633536 0 0 -1 6 0 0 0
[pid=20269] ppid=20219 vsize=351932 CPUtime=0.15 cores=0,2,4,6
/proc/20269/stat : 20269 (python) S 20219 20219 20058 0 -1 4202560 1157 0 0 0 7 8 0 0 19 0 2 0 538349257 360378368 6023 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/20269/statm: 87983 6023 406 364 0 23880 0
[pid=20271] ppid=20269 vsize=418636 CPUtime=100.13 cores=0,2,4,6
/proc/20271/stat : 20271 (adaptg2wsat2009) T 20269 20271 20271 0 -1 4202496 1226 0 0 0 10013 0 0 0 25 0 1 0 538349257 428683264 956 33554432000 134512640 135107411 4291834096 18446744073709551615 134532293 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/20271/statm: 104659 956 59 146 0 103535 0
[pid=20269/tid=20298] ppid=20219 vsize=351932 CPUtime=0 cores=0,2,4,6
/proc/20269/task/20298/stat : 20298 (python) S 20219 20219 20058 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538359272 360378368 6023 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453951222912 0 0 -1 2 0 0 0
[pid=20287] ppid=20219 vsize=362188 CPUtime=0.15 cores=0,2,4,6
/proc/20287/stat : 20287 (python) S 20219 20219 20058 0 -1 4202560 1157 0 0 0 9 6 0 0 19 0 2 0 538359165 370880512 6021 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/20287/statm: 90547 6021 400 364 0 26441 0
[pid=20289] ppid=20287 vsize=418636 CPUtime=98.49 cores=0,2,4,6
/proc/20289/stat : 20289 (adaptg2wsat2009) T 20287 20289 20289 0 -1 4202496 1225 0 0 0 9849 0 0 0 25 0 1 0 538359165 428683264 955 33554432000 134512640 135107411 4290128144 18446744073709551615 134539318 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/20289/statm: 104659 955 59 146 0 103535 0
[pid=20287/tid=20309] ppid=20219 vsize=362188 CPUtime=0 cores=0,2,4,6
/proc/20287/task/20309/stat : 20309 (python) S 20219 20219 20058 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538369179 370880512 6021 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453636131520 0 0 -1 6 0 0 0
[pid=20291] ppid=20219 vsize=372444 CPUtime=0.15 cores=0,2,4,6
/proc/20291/stat : 20291 (python) S 20219 20219 20058 0 -1 4202560 1157 0 0 0 8 7 0 0 19 0 2 0 538359172 381382656 6025 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/20291/statm: 93111 6025 400 364 0 29002 0
[pid=20293] ppid=20291 vsize=248648 CPUtime=99.68 cores=0,2,4,6
/proc/20293/stat : 20293 (FH) T 20291 20293 20293 0 -1 4202496 1130 0 0 0 9968 0 0 0 25 0 1 0 538359172 254615552 856 33554432000 134512640 134936988 4287647248 18446744073709551615 134554594 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/20293/statm: 62162 856 41 104 0 61666 0
[pid=20291/tid=20313] ppid=20219 vsize=372444 CPUtime=0 cores=0,2,4,6
/proc/20291/task/20313/stat : 20313 (python) S 20219 20219 20058 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538369186 381382656 6025 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453636129728 0 0 -1 2 0 0 0
[pid=20296] ppid=20219 vsize=382700 CPUtime=0.48 cores=0,2,4,6
/proc/20296/stat : 20296 (python) S 20219 20219 20058 0 -1 4202560 1186 0 0 0 26 22 0 0 18 0 2 0 538359271 391884800 6029 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/20296/statm: 95675 6029 400 364 0 31563 0
[pid=20299] ppid=20296 vsize=268428 CPUtime=291.44 cores=0,2,4,6
/proc/20299/stat : 20299 (hybridGM3) T 20296 20299 20299 0 -1 4202496 5167 0 0 0 29143 1 0 0 25 0 1 0 538359272 274870272 4897 33554432000 134512640 135204385 4293158960 18446744073709551615 134538284 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/20299/statm: 67107 4897 63 169 0 66937 0
[pid=20296/tid=20327] ppid=20219 vsize=382700 CPUtime=0 cores=0,2,4,6
/proc/20296/task/20327/stat : 20327 (python) S 20219 20219 20058 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538378905 391884800 6029 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453948739968 0 0 -1 0 0 0 0
[pid=20300] ppid=20219 vsize=392956 CPUtime=0.15 cores=0,2,4,6
/proc/20300/stat : 20300 (python) S 20219 20219 20058 0 -1 4202560 1160 0 0 0 7 8 0 0 19 0 2 0 538359276 402386944 6033 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/20300/statm: 98239 6033 400 364 0 34124 0
[pid=20302] ppid=20300 vsize=1018616 CPUtime=100.15 cores=0,2,4,6
/proc/20302/stat : 20302 (gnovelty+2) T 20300 20302 20302 0 -1 4202496 772 0 0 0 10015 0 0 0 25 0 1 0 538359276 1043062784 500 33554432000 134512640 135663704 4294279376 18446744073709551615 134525271 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/20302/statm: 254654 500 113 282 0 254370 0
[pid=20300/tid=20317] ppid=20219 vsize=392956 CPUtime=0 cores=0,2,4,6
/proc/20300/task/20317/stat : 20317 (python) S 20219 20219 20058 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538369293 402386944 6033 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453926297792 0 0 -1 0 0 0 0
[pid=20310] ppid=20219 vsize=403212 CPUtime=0.49 cores=0,2,4,6
/proc/20310/stat : 20310 (python) S 20219 20219 20058 0 -1 4202560 1200 0 0 0 27 22 0 0 18 0 2 0 538369184 412889088 6037 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/20310/statm: 100803 6037 400 364 0 36685 0
[pid=20312] ppid=20310 vsize=268424 CPUtime=293.05 cores=0,2,4,6
/proc/20312/stat : 20312 (hybridGM3) T 20310 20312 20312 0 -1 4202496 5169 0 0 0 29304 1 0 0 25 0 1 0 538369184 274866176 4897 33554432000 134512640 135204385 4288534832 18446744073709551615 134538330 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/20312/statm: 67106 4897 63 169 0 66936 0
[pid=20310/tid=20339] ppid=20219 vsize=403212 CPUtime=0 cores=0,2,4,6
/proc/20310/task/20339/stat : 20339 (python) S 20219 20219 20058 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 538389421 412889088 6037 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453903501312 0 0 -1 2 0 0 0
[pid=20314] ppid=20219 vsize=413468 CPUtime=0.49 cores=0,2,4,6
/proc/20314/stat : 20314 (python) S 20219 20219 20058 0 -1 4202560 1193 0 0 0 26 23 0 0 18 0 2 0 538369191 423391232 6041 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/20314/statm: 103367 6041 400 364 0 39246 0
[pid=20316] ppid=20314 vsize=268424 CPUtime=296.68 cores=0,2,4,6
/proc/20316/stat : 20316 (hybridGM3) R 20314 20316 20316 0 -1 4202496 5168 0 0 0 29667 1 0 0 25 0 1 0 538369191 274866176 4895 33554432000 134512640 135204385 4289732112 18446744073709551615 134537939 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/20316/statm: 67106 4895 63 169 0 66936 0
[pid=20314/tid=20336] ppid=20219 vsize=413468 CPUtime=0 cores=0,2,4,6
/proc/20314/task/20336/stat : 20336 (python) S 20219 20219 20058 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538388828 423391232 6041 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453922632640 0 0 -1 6 0 0 0
[pid=20318] ppid=20219 vsize=423896 CPUtime=0.48 cores=0,2,4,6
/proc/20318/stat : 20318 (python) S 20219 20219 20058 0 -1 4202560 1085 0 0 0 25 23 0 0 18 0 1 0 538369298 434069504 6066 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 11123416090581893380 0 0 17 2 0 0 0
/proc/20318/statm: 105974 6066 379 364 0 41850 0
[pid=20320] ppid=20318 vsize=457128 CPUtime=297.19 cores=0,2,4,6
/proc/20320/stat : 20320 (TNM) R 20318 20320 20320 0 -1 4202496 1111 0 0 0 29719 0 0 0 25 0 1 0 538369298 468099072 837 33554432000 134512640 135008748 4289490416 18446744073709551615 134527807 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/20320/statm: 114282 837 46 122 0 113182 0
[pid=20328] ppid=20219 vsize=434152 CPUtime=0.16 cores=0,2,4,6
/proc/20328/stat : 20328 (python) S 20219 20219 20058 0 -1 4202560 1180 0 0 0 8 8 0 0 19 0 2 0 538378910 444571648 6100 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/20328/statm: 108538 6100 408 364 0 44411 0
[pid=20330] ppid=20328 vsize=418636 CPUtime=99.65 cores=0,2,4,6
/proc/20330/stat : 20330 (adaptg2wsat2009) T 20328 20330 20330 0 -1 4202496 1233 0 0 0 9965 0 0 0 25 0 1 0 538378911 428683264 957 33554432000 134512640 135107411 4294230576 18446744073709551615 134532135 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/20330/statm: 104659 957 59 146 0 103535 0
[pid=20328/tid=20337] ppid=20219 vsize=434152 CPUtime=0 cores=0,2,4,6
/proc/20328/task/20337/stat : 20337 (python) S 20219 20219 20058 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538388926 444571648 6100 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 514 18446604453632266368 0 0 -1 2 0 0 0
[pid=20352] ppid=20219 vsize=444408 CPUtime=0 cores=0,2,4,6
/proc/20352/stat : 20352 (python) S 20219 20219 20058 0 -1 4202560 1001 0 0 0 0 0 0 0 18 0 1 0 538398595 455073792 6068 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 17761494071836115202 0 0 17 2 0 0 0
/proc/20352/statm: 111102 6068 373 364 0 46972 0
[pid=20354] ppid=20352 vsize=248652 CPUtime=4.17 cores=0,2,4,6
/proc/20354/stat : 20354 (FH) R 20352 20354 20354 0 -1 4202496 1132 0 0 0 415 2 0 0 25 0 1 0 538398595 254619648 857 33554432000 134512640 134936988 4294907152 18446744073709551615 134552497 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/20354/statm: 62163 857 41 104 0 61667 0
[pid=20386] ppid=20219 vsize=454664 CPUtime=0 cores=0,2,4,6
/proc/20386/stat : 20386 (python) S 20219 20219 20058 0 -1 4202560 849 0 0 0 0 0 0 0 19 0 1 0 538398945 465575936 6048 33554432000 4194304 5683644 140733314661968 18446744073709551615 212687695430 0 0 16781312 514 1078413103445573631 0 0 17 2 0 0 0
/proc/20386/statm: 113666 6048 349 364 0 49533 0
[pid=20388] ppid=20386 vsize=268424 CPUtime=0.71 cores=0,2,4,6
/proc/20388/stat : 20388 (hybridGM3) R 20386 20388 20388 0 -1 4202496 5170 0 0 0 71 0 0 0 22 0 1 0 538398945 274866176 4897 33554432000 134512640 135204385 4288174656 18446744073709551615 134537939 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/20388/statm: 67106 4897 63 169 0 66936 0
[pid=20219/tid=20226] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20226/stat : 20226 (python) S 20217 20219 20058 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 19 0 538339228 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 0 0 0 0
[pid=20219/tid=20229] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20229/stat : 20229 (python) S 20217 20219 20058 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 19 0 538339231 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20232] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20232/stat : 20232 (python) S 20217 20219 20058 0 -1 4202560 23 933 0 0 0 0 0 0 22 0 19 0 538339234 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 4 0 0 0
[pid=20219/tid=20235] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20235/stat : 20235 (python) S 20217 20219 20058 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 19 0 538339237 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 6 0 0 0
[pid=20219/tid=20259] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20259/stat : 20259 (python) S 20217 20219 20058 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 19 0 538349247 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 6 0 0 0
[pid=20219/tid=20264] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20264/stat : 20264 (python) S 20217 20219 20058 0 -1 4202560 25 933 0 0 0 0 0 0 22 0 19 0 538349250 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 4 0 0 0
[pid=20219/tid=20267] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20267/stat : 20267 (python) S 20217 20219 20058 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 19 0 538349254 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 6 0 0 0
[pid=20219/tid=20270] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20270/stat : 20270 (python) S 20217 20219 20058 0 -1 4202560 28 933 0 0 0 0 0 0 22 0 19 0 538349257 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20288] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20288/stat : 20288 (python) S 20217 20219 20058 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 19 0 538359165 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20292] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20292/stat : 20292 (python) S 20217 20219 20058 0 -1 4202560 27 933 0 0 0 0 0 0 21 0 19 0 538359172 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20297] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20297/stat : 20297 (python) S 20217 20219 20058 0 -1 4202560 25 933 0 0 0 0 0 0 18 0 19 0 538359271 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 0 0 0 0
[pid=20219/tid=20301] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20301/stat : 20301 (python) S 20217 20219 20058 0 -1 4202560 30 933 0 0 0 0 0 0 21 0 19 0 538359276 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20311] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20311/stat : 20311 (python) S 20217 20219 20058 0 -1 4202560 29 933 0 0 0 0 0 0 18 0 19 0 538369184 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20315] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20315/stat : 20315 (python) S 20217 20219 20058 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 19 0 538369191 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20319] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20319/stat : 20319 (python) S 20217 20219 20058 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 19 0 538369298 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20329] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20329/stat : 20329 (python) S 20217 20219 20058 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 19 0 538378910 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20353] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20353/stat : 20353 (python) S 20217 20219 20058 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 19 0 538398595 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
[pid=20219/tid=20387] ppid=20217 vsize=464908 CPUtime=0 cores=0,2,4,6
/proc/20219/task/20387/stat : 20387 (python) S 20217 20219 20058 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 19 0 538398945 476065792 7628 33554432000 4194304 5683644 140733314661968 18446744073709551615 212699498929 0 0 16781312 2 18446604453632267264 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2383.59
Current children cumulated vsize (KiB) 15946012

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20219 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=96681
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=145977
# CPU time returned by wait4() is 2.24266
# while last known CPU time is 2383.59
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 599.517
CPU time (s): 2383.59
CPU user time (s): 2381.66
CPU system time (s): 1.93
CPU usage (%): 397.585
Max. virtual memory (cumulated for all children) (KiB): 15946012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.09668
system time used= 0.145977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29146
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1909
involuntary context switches= 63

runsolver used 3.01854 second user time and 5.80412 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-01 18:30:13
IDJOB=3317127
IDBENCH=82592
IDSOLVER=1705
FILE ID=node139/3317127-1304267413
RUNJOBID= node139-1304267280-20076
PBS_JOBID= 13173940
Free space on /tmp= 73024 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v200-c17000-S949556727-080-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317127-1304267413/watcher-3317127-1304267413 -o /tmp/evaluation-result-3317127-1304267413/solver-3317127-1304267413 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317127-1304267413.cnf -seed 1962411866 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 274f6c2fc3e630d8716a09f7c87233f2
RANDOM SEED=1962411866

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24073916 kB
Buffers:       2073392 kB
Cached:        6107264 kB
SwapCached:          4 kB
Active:        1515476 kB
Inactive:      6828896 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24073916 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           32684 kB
Writeback:           0 kB
AnonPages:      163336 kB
Mapped:          21640 kB
Slab:           462944 kB
PageTables:      11004 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  5833152 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72980 MiB
End job on node139 at 2011-05-01 18:40:15