Trace number 3386573

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (MO) 3455.23 3445.24

General information on the benchmark

Namerandom/large/
unif-k7-r85-v200-c17000-S970203146-047-UNKNOWN.cnf
MD5SUM635ea520fe16a78d41337039f98997e5
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark580.671
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data 

0.34/0.63	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.63	c INFO: solving HOME/instance-3386573-1305587569.cnf
0.34/0.63	c INFO: computing task features
0.43/0.75	c INFO: computed variable-clause graph statistics
0.43/0.75	c INFO: computed clause balance statistics
1.03/1.34	c INFO: computed variable balance statistics
1.23/1.58	c INFO: computed small-clause counts
1.23/1.58	c INFO: computed Horn-clause counts
1.33/1.60	c INFO: computed variable graph statistics
1.33/1.60	c INFO: collected features for HOME/instance-3386573-1305587569.cnf in 0.96 s
1.33/1.63	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.35)
101.86/101.99	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.12)
202.57/202.36	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.08)
301.28/300.71	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.06)
401.76/401.04	c INFO: running adaptg2wsat2009++@0 for 97 with 4599 remaining (b = 0.05)
501.37/500.40	c INFO: running gnovelty+2@0 for 97 with 4500 remaining (b = 0.04)
602.00/600.78	c INFO: running FH@0 for 97 with 4400 remaining (b = 0.03)
702.63/701.12	c INFO: running adaptg2wsat2009++@0 for 97 with 4299 remaining (b = 0.03)
803.22/801.49	c INFO: running adaptg2wsat2009++@0 for 97 with 4199 remaining (b = 0.02)
903.81/901.85	c INFO: running FH@0 for 97 with 4099 remaining (b = 0.02)
1003.54/1001.22	c INFO: running hybridGM3@0 for 194 with 4000 remaining (b = 0.04)
1200.66/1197.93	c INFO: running gnovelty+2@0 for 97 with 3803 remaining (b = 0.02)
1301.25/1298.31	c INFO: running hybridGM3@0 for 194 with 3703 remaining (b = 0.03)
1496.56/1493.07	c INFO: running hybridGM3@0 for 194 with 3508 remaining (b = 0.03)
1692.03/1687.83	c INFO: running TNM@0 for 1552 with 3313 remaining (b = 0.20)
3253.67/3244.12	c INFO: running adaptg2wsat2009++@0 for 97 with 1757 remaining (b = 0.01)
3354.15/3344.47	c INFO: running FH@0 for 97 with 1657 remaining (b = 0.01)
3454.90/3444.86	c INFO: running hybridGM3@0 for 194 with 1556 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386573-1305587569/watcher-3386573-1305587569 -o /tmp/evaluation-result-3386573-1305587569/solver-3386573-1305587569 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386573-1305587569.cnf -seed 785539133 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.01 4.02 4.06 4/423 7264
/proc/meminfo: memFree=12942096/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=15772 CPUtime=0 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 893 0 0 0 0 0 0 0 22 0 1 0 670354755 16150528 776 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377299456 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 0
/proc/7264/statm: 3943 776 343 364 0 430 0

[startup+0.025026 s]
/proc/loadavg: 4.01 4.02 4.06 4/423 7264
/proc/meminfo: memFree=12942096/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=16392 CPUtime=0.01 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 1077 0 0 0 1 0 0 0 22 0 1 0 670354755 16785408 949 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377299456 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 0
/proc/7264/statm: 4098 949 385 364 0 585 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16392

[startup+0.101012 s]
/proc/loadavg: 4.01 4.02 4.06 4/423 7264
/proc/meminfo: memFree=12942096/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=93960 CPUtime=0.06 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 2691 0 0 0 5 1 0 0 17 0 1 0 670354755 96215040 2407 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377299456 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 0
/proc/7264/statm: 23490 2407 764 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 93960

[startup+0.301013 s]
/proc/loadavg: 4.01 4.02 4.06 4/423 7264
/proc/meminfo: memFree=12942096/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=135748 CPUtime=0.18 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 5970 931 1 0 15 3 0 0 17 0 1 0 670354755 139005952 4149 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377297413 0 2147483391 16781312 2 18446744071699453118 0 0 17 2 0 0 0
/proc/7264/statm: 33937 4149 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700981 s]
/proc/loadavg: 4.01 4.02 4.06 4/423 7264
/proc/meminfo: memFree=12942096/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=281008 CPUtime=0.43 cores=0,2,4,6
/proc/7264/stat : 7264 (python) R 7262 7264 7023 0 -1 4202496 9898 931 1 0 35 8 0 0 16 0 1 0 670354755 287752192 7574 33554432000 4194304 5683644 140736955095872 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/7264/statm: 70252 7574 1761 364 0 6176 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 281008

[startup+1.50075 s]
/proc/loadavg: 4.01 4.02 4.06 5/424 7269
/proc/meminfo: memFree=12915300/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=282556 CPUtime=1.23 cores=0,2,4,6
/proc/7264/stat : 7264 (python) R 7262 7264 7023 0 -1 4202496 11214 931 1 0 115 8 0 0 17 0 1 0 670354755 289337344 8053 33554432000 4194304 5683644 140736955095872 18446744073709551615 47351135124295 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/7264/statm: 70639 8053 1827 364 0 6563 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 282556

[startup+3.10052 s]
/proc/loadavg: 4.01 4.02 4.06 5/427 7272
/proc/meminfo: memFree=12914904/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=289436 CPUtime=1.36 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 11586 931 1 0 128 8 0 0 19 0 2 0 670354755 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/7264/statm: 72359 7232 1877 364 0 8277 0
[pid=7270] ppid=7264 vsize=279192 CPUtime=0 cores=0,2,4,6
/proc/7270/stat : 7270 (python) S 7264 7264 7023 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 670354918 285892608 5705 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377321487 0 0 16781312 514 11943542092912886020 0 0 17 2 0 0 0
/proc/7270/statm: 69798 5705 354 364 0 5716 0
[pid=7272] ppid=7270 vsize=1018616 CPUtime=1.46 cores=0,2,4,6
/proc/7272/stat : 7272 (gnovelty+2) R 7270 7272 7272 0 -1 4202496 764 0 0 0 146 0 0 0 23 0 1 0 670354918 1043062784 500 33554432000 134512640 135663704 4287106768 18446744073709551615 134524734 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7272/statm: 254654 500 113 282 0 254370 0
[pid=7264/tid=7271] ppid=7262 vsize=289436 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7271/stat : 7271 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 19 0 2 0 670354918 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 1587244

[startup+6.30091 s]
/proc/loadavg: 4.01 4.02 4.06 5/427 7272
/proc/meminfo: memFree=12914532/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=289436 CPUtime=1.36 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 11586 931 1 0 128 8 0 0 19 0 2 0 670354755 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/7264/statm: 72359 7232 1877 364 0 8277 0
[pid=7270] ppid=7264 vsize=279192 CPUtime=0.01 cores=0,2,4,6
/proc/7270/stat : 7270 (python) S 7264 7264 7023 0 -1 4202560 875 0 0 0 0 1 0 0 18 0 1 0 670354918 285892608 5728 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377321487 0 0 16781312 514 11943542092912886020 0 0 17 2 0 0 0
/proc/7270/statm: 69798 5728 377 364 0 5716 0
[pid=7272] ppid=7270 vsize=1018616 CPUtime=4.66 cores=0,2,4,6
/proc/7272/stat : 7272 (gnovelty+2) R 7270 7272 7272 0 -1 4202496 764 0 0 0 466 0 0 0 25 0 1 0 670354918 1043062784 500 33554432000 134512640 135663704 4287106768 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7272/statm: 254654 500 113 282 0 254370 0
[pid=7264/tid=7271] ppid=7262 vsize=289436 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7271/stat : 7271 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 19 0 2 0 670354918 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 1587244

[startup+12.7007 s]
/proc/loadavg: 4.01 4.02 4.06 5/427 7272
/proc/meminfo: memFree=12913608/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=289436 CPUtime=1.36 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 11586 931 1 0 128 8 0 0 19 0 2 0 670354755 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/7264/statm: 72359 7232 1877 364 0 8277 0
[pid=7270] ppid=7264 vsize=279192 CPUtime=0.03 cores=0,2,4,6
/proc/7270/stat : 7270 (python) S 7264 7264 7023 0 -1 4202560 878 0 0 0 1 2 0 0 18 0 1 0 670354918 285892608 5728 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377321487 0 0 16781312 514 15412127165419847940 0 0 17 2 0 0 0
/proc/7270/statm: 69798 5728 377 364 0 5716 0
[pid=7272] ppid=7270 vsize=1018616 CPUtime=11.06 cores=0,2,4,6
/proc/7272/stat : 7272 (gnovelty+2) R 7270 7272 7272 0 -1 4202496 764 0 0 0 1106 0 0 0 25 0 1 0 670354918 1043062784 500 33554432000 134512640 135663704 4287106768 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7272/statm: 254654 500 113 282 0 254370 0
[pid=7264/tid=7271] ppid=7262 vsize=289436 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7271/stat : 7271 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 19 0 2 0 670354918 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.45
Current children cumulated vsize (KiB) 1587244

[startup+25.5004 s]
/proc/loadavg: 4.01 4.02 4.06 5/427 7273
/proc/meminfo: memFree=12912736/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=289436 CPUtime=1.36 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 11586 931 1 0 128 8 0 0 19 0 2 0 670354755 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/7264/statm: 72359 7232 1877 364 0 8277 0
[pid=7270] ppid=7264 vsize=279192 CPUtime=0.07 cores=0,2,4,6
/proc/7270/stat : 7270 (python) S 7264 7264 7023 0 -1 4202560 885 0 0 0 3 4 0 0 18 0 1 0 670354918 285892608 5728 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377321487 0 0 16781312 514 15412127165419847940 0 0 17 2 0 0 0
/proc/7270/statm: 69798 5728 377 364 0 5716 0
[pid=7272] ppid=7270 vsize=1018616 CPUtime=23.86 cores=0,2,4,6
/proc/7272/stat : 7272 (gnovelty+2) R 7270 7272 7272 0 -1 4202496 764 0 0 0 2386 0 0 0 25 0 1 0 670354918 1043062784 500 33554432000 134512640 135663704 4287106768 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7272/statm: 254654 500 113 282 0 254370 0
[pid=7264/tid=7271] ppid=7262 vsize=289436 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7271/stat : 7271 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 19 0 2 0 670354918 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.29
Current children cumulated vsize (KiB) 1587244

[startup+51.1006 s]
/proc/loadavg: 4.00 4.02 4.05 5/427 7273
/proc/meminfo: memFree=12912200/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=289436 CPUtime=1.36 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 11586 931 1 0 128 8 0 0 19 0 2 0 670354755 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/7264/statm: 72359 7232 1877 364 0 8277 0
[pid=7270] ppid=7264 vsize=279192 CPUtime=0.14 cores=0,2,4,6
/proc/7270/stat : 7270 (python) S 7264 7264 7023 0 -1 4202560 897 0 0 0 6 8 0 0 18 0 1 0 670354918 285892608 5728 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377321487 0 0 16781312 514 15412127165419847940 0 0 17 6 0 0 0
/proc/7270/statm: 69798 5728 377 364 0 5716 0
[pid=7272] ppid=7270 vsize=1018616 CPUtime=49.44 cores=0,2,4,6
/proc/7272/stat : 7272 (gnovelty+2) R 7270 7272 7272 0 -1 4202496 764 0 0 0 4944 0 0 0 25 0 1 0 670354918 1043062784 500 33554432000 134512640 135663704 4287106768 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/7272/statm: 254654 500 113 282 0 254370 0
[pid=7264/tid=7271] ppid=7262 vsize=289436 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7271/stat : 7271 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 19 0 2 0 670354918 296382464 7232 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 1587244

[startup+102.316 s]
/proc/loadavg: 4.00 4.01 4.05 5/435 7283
/proc/meminfo: memFree=12870072/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=299896 CPUtime=1.39 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 12430 931 1 0 131 8 0 0 20 0 3 0 670354755 307093504 7307 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/7264/statm: 74974 7307 1880 364 0 10889 0
[pid=7270] ppid=7264 vsize=289436 CPUtime=0.3 cores=0,2,4,6
/proc/7270/stat : 7270 (python) S 7264 7264 7023 0 -1 4202560 1071 0 0 0 15 15 0 0 19 0 2 0 670354918 296382464 5766 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7270/statm: 72359 5766 410 364 0 8277 0
[pid=7272] ppid=7270 vsize=1018616 CPUtime=100.28 cores=0,2,4,6
/proc/7272/stat : 7272 (gnovelty+2) T 7270 7272 7272 0 -1 4202496 764 0 0 0 10028 0 0 0 25 0 1 0 670354918 1043062784 500 33554432000 134512640 135663704 4287106768 18446744073709551615 134524553 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7272/statm: 254654 500 113 282 0 254370 0
[pid=7270/tid=7280] ppid=7264 vsize=289436 CPUtime=0 cores=0,2,4,6
/proc/7270/task/7280/stat : 7280 (python) S 7264 7264 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670364952 296382464 5766 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604447103581248 0 0 -1 6 0 0 0
[pid=7281] ppid=7264 vsize=289652 CPUtime=0 cores=0,2,4,6
/proc/7281/stat : 7281 (python) S 7264 7264 7023 0 -1 4202560 736 0 0 0 0 0 0 0 19 0 1 0 670364954 296603648 5771 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377321542 0 0 16781312 514 16371658872647057407 0 0 17 6 0 0 0
/proc/7281/statm: 72413 5771 348 364 0 8328 0
[pid=7283] ppid=7281 vsize=1018616 CPUtime=0.31 cores=0,2,4,6
/proc/7283/stat : 7283 (gnovelty+2) R 7281 7283 7283 0 -1 4202496 767 0 0 0 31 0 0 0 21 0 1 0 670364955 1043062784 501 33554432000 134512640 135663704 4294020880 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7283/statm: 254654 501 113 282 0 254370 0
[pid=7264/tid=7271] ppid=7262 vsize=299896 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7271/stat : 7271 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 19 0 3 0 670354918 307093504 7307 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 4 0 0 0
[pid=7264/tid=7282] ppid=7262 vsize=299896 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7282/stat : 7282 (python) S 7262 7264 7023 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 3 0 670364955 307093504 7307 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2916216

[startup+162.301 s]
/proc/loadavg: 4.11 4.04 4.05 5/435 7284
/proc/meminfo: memFree=12869184/32951124 swapFree=63308196/67111528
[pid=7264] ppid=7262 vsize=299896 CPUtime=1.39 cores=0,2,4,6
/proc/7264/stat : 7264 (python) S 7262 7264 7023 0 -1 4202496 12430 931 1 0 131 8 0 0 20 0 3 0 670354755 307093504 7307 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/7264/statm: 74974 7307 1880 364 0 10889 0
[pid=7270] ppid=7264 vsize=289436 CPUtime=0.3 cores=0,2,4,6
/proc/7270/stat : 7270 (python) S 7264 7264 7023 0 -1 4202560 1071 0 0 0 15 15 0 0 19 0 2 0 670354918 296382464 5766 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7270/statm: 72359 5766 410 364 0 8277 0
[pid=7272] ppid=7270 vsize=1018616 CPUtime=100.28 cores=0,2,4,6
/proc/7272/stat : 7272 (gnovelty+2) T 7270 7272 7272 0 -1 4202496 764 0 0 0 10028 0 0 0 25 0 1 0 670354918 1043062784 500 33554432000 134512640 135663704 4287106768 18446744073709551615 134524553 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7272/statm: 254654 500 113 282 0 254370 0
[pid=7270/tid=7280] ppid=7264 vsize=289436 CPUtime=0 cores=0,2,4,6
/proc/7270/task/7280/stat : 7280 (python) S 7264 7264 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670364952 296382464 5766 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604447103581248 0 0 -1 6 0 0 0
[pid=7281] ppid=7264 vsize=289652 CPUtime=0.18 cores=0,2,4,6

################
# More data... #
################

[pid=7298] ppid=7264 vsize=310772 CPUtime=0.3 cores=0,2,4,6
/proc/7298/stat : 7298 (python) S 7264 7264 7023 0 -1 4202560 1085 0 0 0 16 14 0 0 19 0 2 0 670384827 318230528 5967 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7298/statm: 77693 5967 399 364 0 13602 0
[pid=7300] ppid=7298 vsize=418636 CPUtime=100.18 cores=0,2,4,6
/proc/7300/stat : 7300 (adaptg2wsat2009) T 7298 7300 7300 0 -1 4202496 1225 0 0 0 10018 0 0 0 25 0 1 0 670384827 428683264 956 33554432000 134512640 135107411 4287705504 18446744073709551615 134532326 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7300/statm: 104659 956 59 146 0 103535 0
[pid=7298/tid=7308] ppid=7264 vsize=310772 CPUtime=0 cores=0,2,4,6
/proc/7298/task/7308/stat : 7308 (python) S 7264 7264 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670394856 318230528 5967 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604443839617920 0 0 -1 6 0 0 0
[pid=7309] ppid=7264 vsize=321028 CPUtime=0.32 cores=0,2,4,6
/proc/7309/stat : 7309 (python) S 7264 7264 7023 0 -1 4202560 1105 0 0 0 16 16 0 0 19 0 2 0 670394859 328732672 5971 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7309/statm: 80257 5971 400 364 0 16163 0
[pid=7311] ppid=7309 vsize=418636 CPUtime=99.32 cores=0,2,4,6
/proc/7311/stat : 7311 (adaptg2wsat2009) T 7309 7311 7311 0 -1 4202496 1224 0 0 0 9932 0 0 0 25 0 1 0 670394860 428683264 956 33554432000 134512640 135107411 4288403360 18446744073709551615 134531768 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7311/statm: 104659 956 59 146 0 103535 0
[pid=7309/tid=7314] ppid=7264 vsize=321028 CPUtime=0 cores=0,2,4,6
/proc/7309/task/7314/stat : 7314 (python) S 7264 7264 7023 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670404792 328732672 5971 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604450049689472 0 0 -1 2 0 0 0
[pid=7315] ppid=7264 vsize=331284 CPUtime=0.31 cores=0,2,4,6
/proc/7315/stat : 7315 (python) S 7264 7264 7023 0 -1 4202560 1121 0 0 0 18 13 0 0 19 0 2 0 670404795 339234816 5975 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7315/statm: 82821 5975 400 364 0 18724 0
[pid=7317] ppid=7315 vsize=1018616 CPUtime=100.25 cores=0,2,4,6
/proc/7317/stat : 7317 (gnovelty+2) T 7315 7317 7317 0 -1 4202496 768 0 0 0 10025 0 0 0 25 0 1 0 670404796 1043062784 500 33554432000 134512640 135663704 4288539840 18446744073709551615 134525678 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7317/statm: 254654 500 113 282 0 254370 0
[pid=7315/tid=7325] ppid=7264 vsize=331284 CPUtime=0 cores=0,2,4,6
/proc/7315/task/7325/stat : 7325 (python) S 7264 7264 7023 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670414829 339234816 5975 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604448118698048 0 0 -1 6 0 0 0
[pid=7326] ppid=7264 vsize=341540 CPUtime=0.32 cores=0,2,4,6
/proc/7326/stat : 7326 (python) S 7264 7264 7023 0 -1 4202560 1159 0 0 0 17 15 0 0 19 0 2 0 670414833 349736960 5985 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7326/statm: 85385 5985 405 364 0 21285 0
[pid=7328] ppid=7326 vsize=248652 CPUtime=100.21 cores=0,2,4,6
/proc/7328/stat : 7328 (FH) T 7326 7328 7328 0 -1 4202496 1124 0 0 0 10021 0 0 0 25 0 1 0 670414833 254619648 858 33554432000 134512640 134936988 4287350080 18446744073709551615 134552080 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7328/statm: 62163 858 41 104 0 61667 0
[pid=7326/tid=7332] ppid=7264 vsize=341540 CPUtime=0 cores=0,2,4,6
/proc/7326/task/7332/stat : 7332 (python) S 7264 7264 7023 0 -1 4202560 94 0 0 0 0 0 0 0 19 0 2 0 670424864 349736960 5985 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604449196964672 0 0 -1 6 0 0 0
[pid=7333] ppid=7264 vsize=351796 CPUtime=0.32 cores=0,2,4,6
/proc/7333/stat : 7333 (python) S 7264 7264 7023 0 -1 4202560 1164 0 0 0 17 15 0 0 19 0 2 0 670424868 360239104 5989 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7333/statm: 87949 5989 406 364 0 23846 0
[pid=7335] ppid=7333 vsize=418636 CPUtime=100.31 cores=0,2,4,6
/proc/7335/stat : 7335 (adaptg2wsat2009) T 7333 7335 7335 0 -1 4202496 1230 0 0 0 10031 0 0 0 25 0 1 0 670424868 428683264 955 33554432000 134512640 135107411 4292024032 18446744073709551615 134531604 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7335/statm: 104659 955 59 146 0 103535 0
[pid=7333/tid=7342] ppid=7264 vsize=351796 CPUtime=0 cores=0,2,4,6
/proc/7333/task/7342/stat : 7342 (python) S 7264 7264 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670434900 360239104 5989 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604452160834496 0 0 -1 6 0 0 0
[pid=7343] ppid=7264 vsize=362284 CPUtime=0.33 cores=0,2,4,6
/proc/7343/stat : 7343 (python) S 7264 7264 7023 0 -1 4202560 1129 0 0 0 21 12 0 0 19 0 2 0 670434904 370978816 6045 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7343/statm: 90571 6045 400 364 0 26465 0
[pid=7345] ppid=7343 vsize=418636 CPUtime=100.19 cores=0,2,4,6
/proc/7345/stat : 7345 (adaptg2wsat2009) T 7343 7345 7345 0 -1 4202496 1225 0 0 0 10019 0 0 0 25 0 1 0 670434904 428683264 955 33554432000 134512640 135107411 4294453984 18446744073709551615 134531246 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7345/statm: 104659 955 59 146 0 103535 0
[pid=7343/tid=7350] ppid=7264 vsize=362284 CPUtime=0 cores=0,2,4,6
/proc/7343/task/7350/stat : 7350 (python) S 7264 7264 7023 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 670444936 370978816 6045 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604442652042496 0 0 -1 6 0 0 0
[pid=7351] ppid=7264 vsize=372540 CPUtime=0.32 cores=0,2,4,6
/proc/7351/stat : 7351 (python) S 7264 7264 7023 0 -1 4202560 1129 0 0 0 18 14 0 0 19 0 2 0 670444940 381480960 6048 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7351/statm: 93135 6048 399 364 0 29026 0
[pid=7353] ppid=7351 vsize=248648 CPUtime=99.32 cores=0,2,4,6
/proc/7353/stat : 7353 (FH) T 7351 7353 7353 0 -1 4202496 1127 0 0 0 9932 0 0 0 25 0 1 0 670444941 254615552 857 33554432000 134512640 134936988 4287390672 18446744073709551615 134552382 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7353/statm: 62162 857 41 104 0 61666 0
[pid=7351/tid=7357] ppid=7264 vsize=372540 CPUtime=0 cores=0,2,4,6
/proc/7351/task/7357/stat : 7357 (python) S 7264 7264 7023 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670454874 381480960 6048 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604436123776128 0 0 -1 6 0 0 0
[pid=7358] ppid=7264 vsize=382796 CPUtime=0.64 cores=0,2,4,6
/proc/7358/stat : 7358 (python) S 7264 7264 7023 0 -1 4202560 1152 0 0 0 33 31 0 0 19 0 2 0 670454878 391983104 6053 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7358/statm: 95699 6053 400 364 0 31587 0
[pid=7360] ppid=7358 vsize=268424 CPUtime=196.44 cores=0,2,4,6
/proc/7360/stat : 7360 (hybridGM3) T 7358 7360 7360 0 -1 4202496 5170 0 0 0 19644 0 0 0 25 0 1 0 670454878 274866176 4897 33554432000 134512640 135204385 4290635008 18446744073709551615 134537724 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7360/statm: 67106 4897 63 169 0 66936 0
[pid=7358/tid=7366] ppid=7264 vsize=382796 CPUtime=0 cores=0,2,4,6
/proc/7358/task/7366/stat : 7366 (python) S 7264 7264 7023 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670474545 391983104 6053 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604452486973376 0 0 -1 6 0 0 0
[pid=7367] ppid=7264 vsize=393052 CPUtime=0.32 cores=0,2,4,6
/proc/7367/stat : 7367 (python) S 7264 7264 7023 0 -1 4202560 1136 0 0 0 17 15 0 0 19 0 2 0 670474549 402485248 6086 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7367/statm: 98263 6086 399 364 0 34148 0
[pid=7369] ppid=7367 vsize=1018616 CPUtime=100.23 cores=0,2,4,6
/proc/7369/stat : 7369 (gnovelty+2) T 7367 7369 7369 0 -1 4202496 777 0 0 0 10023 0 0 0 25 0 1 0 670474549 1043062784 501 33554432000 134512640 135663704 4291499088 18446744073709551615 134524553 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7369/statm: 254654 501 113 282 0 254370 0
[pid=7367/tid=7373] ppid=7264 vsize=393052 CPUtime=0 cores=0,2,4,6
/proc/7367/task/7373/stat : 7373 (python) S 7264 7264 7023 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670484583 402485248 6086 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604452486972480 0 0 -1 6 0 0 0
[pid=7374] ppid=7264 vsize=403308 CPUtime=0.65 cores=0,2,4,6
/proc/7374/stat : 7374 (python) S 7264 7264 7023 0 -1 4202560 1159 0 0 0 36 29 0 0 19 0 2 0 670484587 412987392 6091 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7374/statm: 100827 6091 400 364 0 36709 0
[pid=7376] ppid=7374 vsize=268420 CPUtime=194.7 cores=0,2,4,6
/proc/7376/stat : 7376 (hybridGM3) T 7374 7376 7376 0 -1 4202496 5170 0 0 0 19470 0 0 0 25 0 1 0 670484587 274862080 4895 33554432000 134512640 135204385 4288667216 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7376/statm: 67105 4895 63 169 0 66935 0
[pid=7374/tid=7382] ppid=7264 vsize=403308 CPUtime=0 cores=0,2,4,6
/proc/7374/task/7382/stat : 7382 (python) S 7264 7264 7023 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670504058 412987392 6091 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604440955560256 0 0 -1 6 0 0 0
[pid=7383] ppid=7264 vsize=413564 CPUtime=0.66 cores=0,2,4,6
/proc/7383/stat : 7383 (python) S 7264 7264 7023 0 -1 4202560 1178 0 0 0 35 31 0 0 19 0 2 0 670504062 423489536 6095 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7383/statm: 103391 6095 400 364 0 39270 0
[pid=7385] ppid=7383 vsize=268420 CPUtime=194.71 cores=0,2,4,6
/proc/7385/stat : 7385 (hybridGM3) T 7383 7385 7385 0 -1 4202496 5167 0 0 0 19471 0 0 0 25 0 1 0 670504062 274862080 4895 33554432000 134512640 135204385 4289199344 18446744073709551615 134537776 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7385/statm: 67105 4895 63 169 0 66935 0
[pid=7383/tid=7391] ppid=7264 vsize=413564 CPUtime=0 cores=0,2,4,6
/proc/7383/task/7391/stat : 7391 (python) S 7264 7264 7023 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670523534 423489536 6095 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604440955561152 0 0 -1 6 0 0 0
[pid=7392] ppid=7264 vsize=423820 CPUtime=5.31 cores=0,2,4,6
/proc/7392/stat : 7392 (python) S 7264 7264 7023 0 -1 4202560 1224 0 0 0 285 246 0 0 19 0 2 0 670523538 433991680 6106 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7392/statm: 105955 6106 407 364 0 41831 0
[pid=7394] ppid=7392 vsize=457128 CPUtime=1556.3 cores=0,2,4,6
/proc/7394/stat : 7394 (TNM) T 7392 7394 7394 0 -1 4202496 1115 0 0 0 155630 0 0 0 25 0 1 0 670523538 468099072 837 33554432000 134512640 135008748 4292951584 18446744073709551615 134527795 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7394/statm: 114282 837 46 122 0 113182 0
[pid=7392/tid=7472] ppid=7264 vsize=423820 CPUtime=0 cores=0,2,4,6
/proc/7392/task/7472/stat : 7472 (python) S 7264 7264 7023 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 670679165 433991680 6106 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604446916821056 0 0 -1 2 0 0 0
[pid=7473] ppid=7264 vsize=434340 CPUtime=0.34 cores=0,2,4,6
/proc/7473/stat : 7473 (python) S 7264 7264 7023 0 -1 4202560 1169 0 0 0 18 16 0 0 19 0 2 0 670679167 444764160 6146 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/7473/statm: 108585 6146 407 364 0 44458 0
[pid=7475] ppid=7473 vsize=418636 CPUtime=100.19 cores=0,2,4,6
/proc/7475/stat : 7475 (adaptg2wsat2009) T 7473 7475 7475 0 -1 4202496 1229 0 0 0 10019 0 0 0 25 0 1 0 670679167 428683264 955 33554432000 134512640 135107411 4290239568 18446744073709551615 134532326 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/7475/statm: 104659 955 59 146 0 103535 0
[pid=7473/tid=7479] ppid=7264 vsize=434340 CPUtime=0 cores=0,2,4,6
/proc/7473/task/7479/stat : 7479 (python) S 7264 7264 7023 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 670689200 444764160 6146 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604453855270848 0 0 -1 6 0 0 0
[pid=7480] ppid=7264 vsize=444776 CPUtime=0.35 cores=0,2,4,6
/proc/7480/stat : 7480 (python) S 7264 7264 7023 0 -1 4202560 1162 0 0 0 19 16 0 0 19 0 2 0 670689202 455450624 6189 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/7480/statm: 111194 6189 401 364 0 47064 0
[pid=7482] ppid=7480 vsize=248652 CPUtime=100.36 cores=0,2,4,6
/proc/7482/stat : 7482 (FH) T 7480 7482 7482 0 -1 4202496 1131 0 0 0 10036 0 0 0 25 0 1 0 670689203 254619648 857 33554432000 134512640 134936988 4286679488 18446744073709551615 134552455 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/7482/statm: 62163 857 41 104 0 61667 0
[pid=7480/tid=7486] ppid=7264 vsize=444776 CPUtime=0 cores=0,2,4,6
/proc/7480/task/7486/stat : 7486 (python) S 7264 7264 7023 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670699239 455450624 6189 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 514 18446604446916821952 0 0 -1 6 0 0 0
[pid=7487] ppid=7264 vsize=455032 CPUtime=0 cores=0,2,4,6
/proc/7487/stat : 7487 (python) S 7264 7264 7023 0 -1 4202560 843 0 0 0 0 0 0 0 19 0 1 0 670699241 465952768 6140 33554432000 4194304 5683644 140736955095872 18446744073709551615 255377321542 0 0 16781312 514 3988741767087259647 0 0 17 2 0 0 0
/proc/7487/statm: 113758 6140 349 364 0 49625 0
[pid=7489] ppid=7487 vsize=268420 CPUtime=0.25 cores=0,2,4,6
/proc/7489/stat : 7489 (hybridGM3) R 7487 7489 7489 0 -1 4202496 5170 0 0 0 25 0 0 0 21 0 1 0 670699241 274862080 4895 33554432000 134512640 135204385 4286958992 18446744073709551615 134538355 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/7489/statm: 67105 4895 63 169 0 66935 0
[pid=7264/tid=7271] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7271/stat : 7271 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 19 0 19 0 670354918 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 4 0 0 0
[pid=7264/tid=7282] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7282/stat : 7282 (python) S 7262 7264 7023 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 19 0 670364955 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7288] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7288/stat : 7288 (python) S 7262 7264 7023 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 19 0 670374991 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7299] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7299/stat : 7299 (python) S 7262 7264 7023 0 -1 4202560 21 931 0 0 0 0 0 0 20 0 19 0 670384827 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7310] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7310/stat : 7310 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 19 0 670394860 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7316] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7316/stat : 7316 (python) S 7262 7264 7023 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 19 0 670404796 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7327] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7327/stat : 7327 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 19 0 670414833 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7334] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7334/stat : 7334 (python) S 7262 7264 7023 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 19 0 670424868 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7344] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7344/stat : 7344 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 19 0 670434904 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7352] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7352/stat : 7352 (python) S 7262 7264 7023 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 19 0 670444940 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7359] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7359/stat : 7359 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 19 0 670454878 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7368] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7368/stat : 7368 (python) S 7262 7264 7023 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 19 0 670474549 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 4 0 0 0
[pid=7264/tid=7375] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7375/stat : 7375 (python) S 7262 7264 7023 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 19 0 670484587 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7384] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7384/stat : 7384 (python) S 7262 7264 7023 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 19 0 670504062 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7393] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7393/stat : 7393 (python) S 7262 7264 7023 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 19 0 670523538 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 6 0 0 0
[pid=7264/tid=7474] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7474/stat : 7474 (python) S 7262 7264 7023 0 -1 4202560 24 931 0 0 0 0 0 0 20 0 19 0 670679167 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7481] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7481/stat : 7481 (python) S 7262 7264 7023 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 19 0 670689202 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
[pid=7264/tid=7488] ppid=7262 vsize=465276 CPUtime=0 cores=0,2,4,6
/proc/7264/task/7488/stat : 7488 (python) S 7262 7264 7023 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 19 0 670699241 476442624 7707 33554432000 4194304 5683644 140736955095872 18446744073709551615 255389125041 0 0 16781312 2 18446604436123777920 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3455.23
Current children cumulated vsize (KiB) 15949856

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7264 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=824722
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=139978
# CPU time returned by wait4() is 1.9647
# while last known CPU time is 3455.23
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3445.24
CPU time (s): 3455.23
CPU user time (s): 3449.85
CPU system time (s): 5.38
CPU usage (%): 100.29
Max. virtual memory (cumulated for all children) (KiB): 15949856

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.82472
system time used= 0.139978
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28851
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2929
involuntary context switches= 54

runsolver used 26.8229 second user time and 53.1649 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-17 01:12:49
IDJOB=3386573
IDBENCH=82638
IDSOLVER=1872
FILE ID=node135/3386573-1305587569
RUNJOBID= node135-1305586144-7041
PBS_JOBID= 13350343
Free space on /tmp= 73472 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v200-c17000-S970203146-047-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386573-1305587569/watcher-3386573-1305587569 -o /tmp/evaluation-result-3386573-1305587569/solver-3386573-1305587569 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386573-1305587569.cnf -seed 785539133 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 635ea520fe16a78d41337039f98997e5
RANDOM SEED=785539133

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12942376 kB
Buffers:        326304 kB
Cached:        6539952 kB
SwapCached:      18100 kB
Active:       11153544 kB
Inactive:      8574484 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12942376 kB
SwapTotal:    67111528 kB
SwapFree:     63308196 kB
Dirty:           32268 kB
Writeback:           4 kB
AnonPages:    12849276 kB
Mapped:          28724 kB
Slab:           149356 kB
PageTables:      65844 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 107619352 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73436 MiB
End job on node135 at 2011-05-17 02:10:16