Trace number 3317103

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 2405.54 605.02

General information on the benchmark

Namerandom/large/
unif-k7-r85-v200-c17000-S283489555-036-UNKNOWN.cnf
MD5SUMdd0dfae1a7fca71616878d93d3870a71
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark656.835
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data 

0.39/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.39/0.67	c INFO: solving HOME/instance-3317103-1304267315.cnf
0.39/0.67	c INFO: computing task features
0.48/0.79	c INFO: computed variable-clause graph statistics
0.48/0.79	c INFO: computed clause balance statistics
1.17/1.41	c INFO: computed variable balance statistics
1.37/1.67	c INFO: computed small-clause counts
1.37/1.67	c INFO: computed Horn-clause counts
1.37/1.69	c INFO: computed variable graph statistics
1.37/1.69	c INFO: collected features for HOME/instance-3317103-1304267315.cnf in 1.02 s
1.47/1.72	c INFO: running gnovelty+2@0 for 97 with 4798 remaining (b = 0.35)
1.47/1.75	c INFO: running gnovelty+2@0 for 97 with 4798 remaining (b = 0.12)
1.47/1.78	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.08)
1.56/1.81	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.06)
401.49/101.90	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.05)
401.49/101.94	c INFO: running gnovelty+2@0 for 97 with 4698 remaining (b = 0.04)
401.49/101.97	c INFO: running FH@0 for 97 with 4698 remaining (b = 0.03)
401.65/102.01	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.03)
801.01/202.07	c INFO: running adaptg2wsat2009++@0 for 97 with 4598 remaining (b = 0.02)
801.40/202.13	c INFO: running FH@0 for 97 with 4598 remaining (b = 0.02)
801.40/202.17	c INFO: running hybridGM3@0 for 194 with 4598 remaining (b = 0.04)
801.56/202.22	c INFO: running gnovelty+2@0 for 97 with 4598 remaining (b = 0.02)
1200.05/302.25	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.03)
1200.40/302.32	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.03)
1201.21/302.53	c INFO: running TNM@0 for 1552 with 4498 remaining (b = 0.20)
1583.59/398.55	c INFO: running hybridGM3@99 for 97 with 4402 remaining (b = 0.01)
1982.33/498.69	c INFO: running hybridGM3@99 for 97 with 4302 remaining (b = 0.01)
1986.71/499.75	c INFO: running hybridGM3@295 for 97 with 4300 remaining (b = 0.01)
2006.22/504.67	c INFO: running adaptg2wsat2009++@0 for 97 with 4296 remaining (b = 0.01)
2365.73/594.94	c INFO: running hybridGM3@100 for 97 with 4205 remaining (b = 0.01)
2385.25/599.89	c INFO: running FH@0 for 97 with 4200 remaining (b = 0.01)
2405.10/604.87	c INFO: running hybridGM3@0 for 194 with 4195 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317103-1304267315/watcher-3317103-1304267315 -o /tmp/evaluation-result-3317103-1304267315/solver-3317103-1304267315 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317103-1304267315.cnf -seed 1621517985 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.62 0.37 0.12 5/189 12402
/proc/meminfo: memFree=29839348/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/12402/stat : 12402 (python) S 12400 12402 12303 0 -1 4202496 724 0 0 0 0 0 0 0 25 0 1 0 538328640 15548416 614 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/12402/statm: 3796 614 321 364 0 283 0

[startup+0.08614 s]
/proc/loadavg: 1.62 0.37 0.12 5/189 12402
/proc/meminfo: memFree=29839348/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=54536 CPUtime=0.06 cores=0,2,4,6
/proc/12402/stat : 12402 (python) S 12400 12402 12303 0 -1 4202496 2050 0 0 0 4 2 0 0 25 0 1 0 538328640 55844864 1808 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/12402/statm: 13635 1810 492 364 0 1285 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 54536

[startup+0.10114 s]
/proc/loadavg: 1.62 0.37 0.12 5/189 12402
/proc/meminfo: memFree=29839348/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=89768 CPUtime=0.07 cores=0,2,4,6
/proc/12402/stat : 12402 (python) S 12400 12402 12303 0 -1 4202496 2673 0 0 0 4 3 0 0 25 0 1 0 538328640 91922432 2388 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/12402/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 89768

[startup+0.301147 s]
/proc/loadavg: 1.62 0.37 0.12 5/189 12402
/proc/meminfo: memFree=29839348/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=135748 CPUtime=0.21 cores=0,2,4,6
/proc/12402/stat : 12402 (python) S 12400 12402 12303 0 -1 4202496 5966 936 1 0 14 7 0 0 17 0 1 0 538328640 139005952 4151 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476690949 0 2147483391 16781312 2 18446744071699207358 0 0 17 0 0 0 0
/proc/12402/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 135748

[startup+0.701024 s]
/proc/loadavg: 1.62 0.37 0.12 5/189 12402
/proc/meminfo: memFree=29839348/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=279684 CPUtime=0.48 cores=0,2,4,6
/proc/12402/stat : 12402 (python) R 12400 12402 12303 0 -1 4202496 9590 936 1 0 34 14 0 0 15 0 1 0 538328640 286396416 7271 33554432000 4194304 5683644 140734157708000 18446744073709551615 46943533887433 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/12402/statm: 69921 7271 1761 364 0 5845 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 279684

[startup+1.50087 s]
/proc/loadavg: 1.62 0.37 0.12 6/190 12407
/proc/meminfo: memFree=29814064/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=282584 CPUtime=1.27 cores=0,2,4,6
/proc/12402/stat : 12402 (python) R 12400 12402 12303 0 -1 4202496 11330 936 1 0 113 14 0 0 16 0 1 0 538328640 289366016 8059 33554432000 4194304 5683644 140734157708000 18446744073709551615 46943365797474 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/12402/statm: 70646 8059 1827 364 0 6570 0
Current children cumulated CPU time (s) 1.27
Current children cumulated vsize (KiB) 282584

[startup+3.10049 s]
/proc/loadavg: 1.62 0.37 0.12 9/202 12419
/proc/meminfo: memFree=29792640/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=320508 CPUtime=1.58 cores=0,2,4,6
/proc/12402/stat : 12402 (python) S 12400 12402 12303 0 -1 4202496 14159 936 1 0 143 15 0 0 24 0 5 0 538328640 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/12402/statm: 80127 7326 1883 364 0 16036 0
[pid=12408] ppid=12402 vsize=279228 CPUtime=0 cores=0,2,4,6
/proc/12408/stat : 12408 (python) S 12402 12402 12303 0 -1 4202560 725 0 0 0 0 0 0 0 18 0 1 0 538328812 285929472 5714 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715023 0 0 16781312 514 4364253300397146370 0 0 17 0 0 0 0
/proc/12408/statm: 69807 5714 354 364 0 5725 0
[pid=12410] ppid=12408 vsize=1018616 CPUtime=1.37 cores=0,2,4,6
/proc/12410/stat : 12410 (gnovelty+2) R 12408 12410 12410 0 -1 4202496 766 0 0 0 137 0 0 0 23 0 1 0 538328812 1043062784 501 33554432000 134512640 135663704 4287653376 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/12410/statm: 254654 501 113 282 0 254370 0
[pid=12411] ppid=12402 vsize=289620 CPUtime=0 cores=0,2,4,6
/proc/12411/stat : 12411 (python) S 12402 12402 12303 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 538328815 296570880 5762 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 4245330397614801156 0 0 17 4 0 0 0
/proc/12411/statm: 72405 5762 348 364 0 8320 0
[pid=12413] ppid=12411 vsize=1018616 CPUtime=1.33 cores=0,2,4,6
/proc/12413/stat : 12413 (gnovelty+2) R 12411 12413 12413 0 -1 4202496 762 0 0 0 133 0 0 0 25 0 1 0 538328815 1043062784 500 33554432000 134512640 135663704 4289127280 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/12413/statm: 254654 500 113 282 0 254370 0
[pid=12414] ppid=12402 vsize=300008 CPUtime=0 cores=0,2,4,6
/proc/12414/stat : 12414 (python) S 12402 12402 12303 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 538328818 307208192 5783 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 4348695485742055423 0 0 17 0 0 0 0
/proc/12414/statm: 75002 5783 348 364 0 10914 0
[pid=12416] ppid=12414 vsize=418500 CPUtime=1.31 cores=0,2,4,6
/proc/12416/stat : 12416 (adaptg2wsat2009) R 12414 12416 12416 0 -1 4202496 1077 0 0 0 131 0 0 0 25 0 1 0 538328818 428544000 810 33554432000 134512640 135107411 4289703984 18446744073709551615 134523426 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/12416/statm: 104625 810 49 146 0 103501 0
[pid=12417] ppid=12402 vsize=310264 CPUtime=0 cores=0,2,4,6
/proc/12417/stat : 12417 (python) S 12402 12402 12303 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 538328821 317710336 5787 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 4223361880413962239 0 0 17 4 0 0 0
/proc/12417/statm: 77566 5787 348 364 0 13475 0
[pid=12419] ppid=12417 vsize=418500 CPUtime=1.28 cores=0,2,4,6
/proc/12419/stat : 12419 (adaptg2wsat2009) R 12417 12419 12419 0 -1 4202496 1073 0 0 0 128 0 0 0 25 0 1 0 538328821 428544000 808 33554432000 134512640 135107411 4290672704 18446744073709551615 134523296 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/12419/statm: 104625 808 49 146 0 103501 0
[pid=12402/tid=12409] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12409/stat : 12409 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 19 0 5 0 538328812 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 6 0 0 0
[pid=12402/tid=12412] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12412/stat : 12412 (python) S 12400 12402 12303 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 5 0 538328815 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12415] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12415/stat : 12415 (python) S 12400 12402 12303 0 -1 4202560 22 936 0 0 0 0 0 0 22 0 5 0 538328818 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12418] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12418/stat : 12418 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 24 0 5 0 538328821 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 6.87
Current children cumulated vsize (KiB) 4373860

[startup+6.30088 s]
/proc/loadavg: 2.13 0.50 0.16 9/202 12419
/proc/meminfo: memFree=29791004/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=320508 CPUtime=1.58 cores=0,2,4,6
/proc/12402/stat : 12402 (python) S 12400 12402 12303 0 -1 4202496 14159 936 1 0 143 15 0 0 24 0 5 0 538328640 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/12402/statm: 80127 7326 1883 364 0 16036 0
[pid=12408] ppid=12402 vsize=279228 CPUtime=0 cores=0,2,4,6
/proc/12408/stat : 12408 (python) S 12402 12402 12303 0 -1 4202560 879 0 0 0 0 0 0 0 18 0 1 0 538328812 285929472 5737 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715023 0 0 16781312 514 4364253300397146370 0 0 17 0 0 0 0
/proc/12408/statm: 69807 5737 377 364 0 5725 0
[pid=12410] ppid=12408 vsize=1018616 CPUtime=4.56 cores=0,2,4,6
/proc/12410/stat : 12410 (gnovelty+2) R 12408 12410 12410 0 -1 4202496 766 0 0 0 456 0 0 0 25 0 1 0 538328812 1043062784 501 33554432000 134512640 135663704 4287653376 18446744073709551615 134525260 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/12410/statm: 254654 501 113 282 0 254370 0
[pid=12411] ppid=12402 vsize=289620 CPUtime=0 cores=0,2,4,6
/proc/12411/stat : 12411 (python) S 12402 12402 12303 0 -1 4202560 888 0 0 0 0 0 0 0 18 0 1 0 538328815 296570880 5785 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 4245330397614801156 0 0 17 4 0 0 0
/proc/12411/statm: 72405 5785 371 364 0 8320 0
[pid=12413] ppid=12411 vsize=1018616 CPUtime=4.51 cores=0,2,4,6
/proc/12413/stat : 12413 (gnovelty+2) R 12411 12413 12413 0 -1 4202496 762 0 0 0 451 0 0 0 25 0 1 0 538328815 1043062784 500 33554432000 134512640 135663704 4289127280 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/12413/statm: 254654 500 113 282 0 254370 0
[pid=12414] ppid=12402 vsize=300008 CPUtime=0 cores=0,2,4,6
/proc/12414/stat : 12414 (python) S 12402 12402 12303 0 -1 4202560 888 0 0 0 0 0 0 0 18 0 1 0 538328818 307208192 5806 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 4348695485742022916 0 0 17 0 0 0 0
/proc/12414/statm: 75002 5806 371 364 0 10914 0
[pid=12416] ppid=12414 vsize=418636 CPUtime=4.49 cores=0,2,4,6
/proc/12416/stat : 12416 (adaptg2wsat2009) R 12414 12416 12416 0 -1 4202496 1224 0 0 0 449 0 0 0 25 0 1 0 538328818 428683264 957 33554432000 134512640 135107411 4289703984 18446744073709551615 134539290 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/12416/statm: 104659 957 59 146 0 103535 0
[pid=12417] ppid=12402 vsize=310264 CPUtime=0 cores=0,2,4,6
/proc/12417/stat : 12417 (python) S 12402 12402 12303 0 -1 4202560 913 0 0 0 0 0 0 0 18 0 1 0 538328821 317710336 5810 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 4223361880413929732 0 0 17 4 0 0 0
/proc/12417/statm: 77566 5810 371 364 0 13475 0
[pid=12419] ppid=12417 vsize=418636 CPUtime=4.46 cores=0,2,4,6
/proc/12419/stat : 12419 (adaptg2wsat2009) R 12417 12419 12419 0 -1 4202496 1221 0 0 0 446 0 0 0 25 0 1 0 538328821 428683264 956 33554432000 134512640 135107411 4290672704 18446744073709551615 134532121 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/12419/statm: 104659 956 59 146 0 103535 0
[pid=12402/tid=12409] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12409/stat : 12409 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 19 0 5 0 538328812 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 6 0 0 0
[pid=12402/tid=12412] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12412/stat : 12412 (python) S 12400 12402 12303 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 5 0 538328815 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12415] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12415/stat : 12415 (python) S 12400 12402 12303 0 -1 4202560 22 936 0 0 0 0 0 0 22 0 5 0 538328818 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12418] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12418/stat : 12418 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 24 0 5 0 538328821 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 19.6
Current children cumulated vsize (KiB) 4374132

[startup+12.7007 s]
/proc/loadavg: 2.60 0.62 0.20 9/202 12419
/proc/meminfo: memFree=29789772/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=320508 CPUtime=1.58 cores=0,2,4,6
/proc/12402/stat : 12402 (python) S 12400 12402 12303 0 -1 4202496 14159 936 1 0 143 15 0 0 24 0 5 0 538328640 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/12402/statm: 80127 7326 1883 364 0 16036 0
[pid=12408] ppid=12402 vsize=279228 CPUtime=0 cores=0,2,4,6
/proc/12408/stat : 12408 (python) S 12402 12402 12303 0 -1 4202560 882 0 0 0 0 0 0 0 18 0 1 0 538328812 285929472 5737 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715023 0 0 16781312 514 16496896541290627330 0 0 17 0 0 0 0
/proc/12408/statm: 69807 5737 377 364 0 5725 0
[pid=12410] ppid=12408 vsize=1018616 CPUtime=10.96 cores=0,2,4,6
/proc/12410/stat : 12410 (gnovelty+2) R 12408 12410 12410 0 -1 4202496 766 0 0 0 1096 0 0 0 25 0 1 0 538328812 1043062784 501 33554432000 134512640 135663704 4287653376 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/12410/statm: 254654 501 113 282 0 254370 0
[pid=12411] ppid=12402 vsize=289620 CPUtime=0.01 cores=0,2,4,6
/proc/12411/stat : 12411 (python) S 12402 12402 12303 0 -1 4202560 891 0 0 0 0 1 0 0 18 0 1 0 538328815 296570880 5785 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 16496896541290627332 0 0 17 4 0 0 0
/proc/12411/statm: 72405 5785 371 364 0 8320 0
[pid=12413] ppid=12411 vsize=1018616 CPUtime=10.88 cores=0,2,4,6
/proc/12413/stat : 12413 (gnovelty+2) R 12411 12413 12413 0 -1 4202496 762 0 0 0 1088 0 0 0 25 0 1 0 538328815 1043062784 500 33554432000 134512640 135663704 4289127280 18446744073709551615 134525213 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/12413/statm: 254654 500 113 282 0 254370 0
[pid=12414] ppid=12402 vsize=300008 CPUtime=0.01 cores=0,2,4,6
/proc/12414/stat : 12414 (python) S 12402 12402 12303 0 -1 4202560 892 0 0 0 1 0 0 0 18 0 1 0 538328818 307208192 5806 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 16496896541290627332 0 0 17 0 0 0 0
/proc/12414/statm: 75002 5806 371 364 0 10914 0
[pid=12416] ppid=12414 vsize=418636 CPUtime=10.88 cores=0,2,4,6
/proc/12416/stat : 12416 (adaptg2wsat2009) R 12414 12416 12416 0 -1 4202496 1224 0 0 0 1088 0 0 0 25 0 1 0 538328818 428683264 957 33554432000 134512640 135107411 4289703984 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/12416/statm: 104659 957 59 146 0 103535 0
[pid=12417] ppid=12402 vsize=310264 CPUtime=0 cores=0,2,4,6
/proc/12417/stat : 12417 (python) S 12402 12402 12303 0 -1 4202560 915 0 0 0 0 0 0 0 18 0 1 0 538328821 317710336 5810 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 16496896541290627332 0 0 17 4 0 0 0
/proc/12417/statm: 77566 5810 371 364 0 13475 0
[pid=12419] ppid=12417 vsize=418636 CPUtime=10.85 cores=0,2,4,6
/proc/12419/stat : 12419 (adaptg2wsat2009) R 12417 12419 12419 0 -1 4202496 1221 0 0 0 1085 0 0 0 25 0 1 0 538328821 428683264 956 33554432000 134512640 135107411 4290672704 18446744073709551615 134531905 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/12419/statm: 104659 956 59 146 0 103535 0
[pid=12402/tid=12409] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12409/stat : 12409 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 19 0 5 0 538328812 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 6 0 0 0
[pid=12402/tid=12412] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12412/stat : 12412 (python) S 12400 12402 12303 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 5 0 538328815 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12415] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12415/stat : 12415 (python) S 12400 12402 12303 0 -1 4202560 22 936 0 0 0 0 0 0 22 0 5 0 538328818 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12418] ppid=12400 vsize=320508 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12418/stat : 12418 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 24 0 5 0 538328821 328200192 7326 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 45.17
Current children cumulated vsize (KiB) 4374132

[startup+25.5012 s]
/proc/loadavg: 3.80 0.98 0.33 9/202 12419
/proc/meminfo: memFree=29790328/32950928 swapFree=67086616/67111528
[pid=12402] ppid=12400 vsize=320508 CPUtime=1.58 cores=0,2,4,6

################
# More data... #
################

/proc/12416/stat : 12416 (adaptg2wsat2009) T 12414 12416 12416 0 -1 4202496 1224 0 0 0 9987 0 0 0 25 0 1 0 538328818 428683264 957 33554432000 134512640 135107411 4289703984 18446744073709551615 134532242 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/12416/statm: 104659 957 59 146 0 103535 0
[pid=12414/tid=12443] ppid=12402 vsize=300008 CPUtime=0 cores=0,2,4,6
/proc/12414/task/12443/stat : 12443 (python) S 12402 12402 12303 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538338832 307208192 5836 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453925202816 0 0 -1 0 0 0 0
[pid=12417] ppid=12402 vsize=310264 CPUtime=0.11 cores=0,2,4,6
/proc/12417/stat : 12417 (python) S 12402 12402 12303 0 -1 4202560 1102 0 0 0 4 7 0 0 19 0 2 0 538328821 317710336 5840 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12417/statm: 77566 5840 400 364 0 13475 0
[pid=12419] ppid=12417 vsize=418636 CPUtime=99.89 cores=0,2,4,6
/proc/12419/stat : 12419 (adaptg2wsat2009) T 12417 12419 12419 0 -1 4202496 1221 0 0 0 9989 0 0 0 25 0 1 0 538328821 428683264 956 33554432000 134512640 135107411 4290672704 18446744073709551615 134532302 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/12419/statm: 104659 956 59 146 0 103535 0
[pid=12417/tid=12445] ppid=12402 vsize=310264 CPUtime=0 cores=0,2,4,6
/proc/12417/task/12445/stat : 12445 (python) S 12402 12402 12303 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538338834 317710336 5840 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453896021312 0 0 -1 0 0 0 0
[pid=12439] ppid=12402 vsize=320520 CPUtime=0.13 cores=0,2,4,6
/proc/12439/stat : 12439 (python) S 12402 12402 12303 0 -1 4202560 1123 0 0 0 7 6 0 0 19 0 2 0 538338830 328212480 5844 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/12439/statm: 80130 5844 400 364 0 16036 0
[pid=12442] ppid=12439 vsize=418636 CPUtime=99.98 cores=0,2,4,6
/proc/12442/stat : 12442 (adaptg2wsat2009) T 12439 12442 12442 0 -1 4202496 1224 0 0 0 9998 0 0 0 25 0 1 0 538338831 428683264 956 33554432000 134512640 135107411 4288071072 18446744073709551615 134531942 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/12442/statm: 104659 956 59 146 0 103535 0
[pid=12439/tid=12473] ppid=12402 vsize=320520 CPUtime=0 cores=0,2,4,6
/proc/12439/task/12473/stat : 12473 (python) S 12402 12402 12303 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538348843 328212480 5844 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453945938240 0 0 -1 6 0 0 0
[pid=12444] ppid=12402 vsize=330928 CPUtime=0.13 cores=0,2,4,6
/proc/12444/stat : 12444 (python) S 12402 12402 12303 0 -1 4202560 1113 0 0 0 7 6 0 0 19 0 2 0 538338834 338870272 5886 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12444/statm: 82732 5886 400 364 0 18635 0
[pid=12447] ppid=12444 vsize=1018616 CPUtime=100.14 cores=0,2,4,6
/proc/12447/stat : 12447 (gnovelty+2) T 12444 12447 12447 0 -1 4202496 765 0 0 0 10014 0 0 0 25 0 1 0 538338834 1043062784 501 33554432000 134512640 135663704 4292151088 18446744073709551615 134525213 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/12447/statm: 254654 501 113 282 0 254370 0
[pid=12444/tid=12477] ppid=12402 vsize=330928 CPUtime=0 cores=0,2,4,6
/proc/12444/task/12477/stat : 12477 (python) S 12402 12402 12303 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538348850 338870272 5886 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453945940928 0 0 -1 0 0 0 0
[pid=12448] ppid=12402 vsize=341184 CPUtime=0.13 cores=0,2,4,6
/proc/12448/stat : 12448 (python) S 12402 12402 12303 0 -1 4202560 1172 0 0 0 7 6 0 0 19 0 2 0 538338838 349372416 5917 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/12448/statm: 85296 5917 406 364 0 21196 0
[pid=12450] ppid=12448 vsize=248656 CPUtime=99.25 cores=0,2,4,6
/proc/12450/stat : 12450 (FH) T 12448 12450 12450 0 -1 4202496 1124 0 0 0 9925 0 0 0 25 0 1 0 538338838 254623744 858 33554432000 134512640 134936988 4291743056 18446744073709551615 134553579 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/12450/statm: 62164 858 41 104 0 61668 0
[pid=12448/tid=12478] ppid=12402 vsize=341184 CPUtime=0 cores=0,2,4,6
/proc/12448/task/12478/stat : 12478 (python) S 12402 12402 12303 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538348850 349372416 5917 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453944359104 0 0 -1 4 0 0 0
[pid=12451] ppid=12402 vsize=351440 CPUtime=0.13 cores=0,2,4,6
/proc/12451/stat : 12451 (python) S 12402 12402 12303 0 -1 4202560 1152 0 0 0 6 7 0 0 19 0 2 0 538338841 359874560 5921 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12451/statm: 87860 5921 406 364 0 23757 0
[pid=12453] ppid=12451 vsize=418636 CPUtime=99.86 cores=0,2,4,6
/proc/12453/stat : 12453 (adaptg2wsat2009) T 12451 12453 12453 0 -1 4202496 1226 0 0 0 9985 1 0 0 25 0 1 0 538338842 428683264 957 33554432000 134512640 135107411 4288348576 18446744073709551615 134531739 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/12453/statm: 104659 957 59 146 0 103535 0
[pid=12451/tid=12482] ppid=12402 vsize=351440 CPUtime=0 cores=0,2,4,6
/proc/12451/task/12482/stat : 12482 (python) S 12402 12402 12303 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538348856 359874560 5921 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453920119872 0 0 -1 0 0 0 0
[pid=12474] ppid=12402 vsize=361696 CPUtime=0.14 cores=0,2,4,6
/proc/12474/stat : 12474 (python) S 12402 12402 12303 0 -1 4202560 1144 0 0 0 7 7 0 0 19 0 2 0 538348847 370376704 5925 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12474/statm: 90424 5925 400 364 0 26318 0
[pid=12476] ppid=12474 vsize=418636 CPUtime=98.48 cores=0,2,4,6
/proc/12476/stat : 12476 (adaptg2wsat2009) T 12474 12476 12476 0 -1 4202496 1226 0 0 0 9848 0 0 0 25 0 1 0 538348847 428683264 955 33554432000 134512640 135107411 4292950112 18446744073709551615 134531822 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/12476/statm: 104659 955 59 146 0 103535 0
[pid=12474/tid=12504] ppid=12402 vsize=361696 CPUtime=0 cores=0,2,4,6
/proc/12474/task/12504/stat : 12504 (python) S 12402 12402 12303 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 538358861 370376704 5925 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453960290432 0 0 -1 0 0 0 0
[pid=12479] ppid=12402 vsize=372164 CPUtime=0.14 cores=0,2,4,6
/proc/12479/stat : 12479 (python) S 12402 12402 12303 0 -1 4202560 1148 0 0 0 7 7 0 0 19 0 2 0 538348854 381095936 5955 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12479/statm: 93041 5955 400 364 0 28932 0
[pid=12481] ppid=12479 vsize=248648 CPUtime=100.12 cores=0,2,4,6
/proc/12481/stat : 12481 (FH) T 12479 12481 12481 0 -1 4202496 1127 0 0 0 10012 0 0 0 25 0 1 0 538348854 254615552 856 33554432000 134512640 134936988 4288819504 18446744073709551615 134552326 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/12481/statm: 62162 856 41 104 0 61666 0
[pid=12479/tid=12508] ppid=12402 vsize=372164 CPUtime=0 cores=0,2,4,6
/proc/12479/task/12508/stat : 12508 (python) S 12402 12402 12303 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538358868 381095936 5955 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453960291328 0 0 -1 0 0 0 0
[pid=12483] ppid=12402 vsize=382420 CPUtime=0.63 cores=0,2,4,6
/proc/12483/stat : 12483 (python) S 12402 12402 12303 0 -1 4202560 1178 0 0 0 31 32 0 0 18 0 2 0 538348858 391598080 5959 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/12483/statm: 95605 5959 400 364 0 31493 0
[pid=12485] ppid=12483 vsize=268424 CPUtime=390.11 cores=0,2,4,6
/proc/12485/stat : 12485 (hybridGM3) T 12483 12485 12485 0 -1 4202496 5166 0 0 0 39010 1 0 0 25 0 1 0 538348858 274866176 4895 33554432000 134512640 135204385 4292357168 18446744073709551615 134537726 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/12485/statm: 67106 4895 63 169 0 66936 0
[pid=12483/tid=12522] ppid=12402 vsize=382420 CPUtime=0 cores=0,2,4,6
/proc/12483/task/12522/stat : 12522 (python) S 12402 12402 12303 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538368491 391598080 5959 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453944357312 0 0 -1 4 0 0 0
[pid=12486] ppid=12402 vsize=392832 CPUtime=0.15 cores=0,2,4,6
/proc/12486/stat : 12486 (python) S 12402 12402 12303 0 -1 4202560 1168 0 0 0 8 7 0 0 19 0 2 0 538348862 402259968 6002 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12486/statm: 98208 6002 400 364 0 34093 0
[pid=12488] ppid=12486 vsize=1018616 CPUtime=99.79 cores=0,2,4,6
/proc/12488/stat : 12488 (gnovelty+2) T 12486 12488 12488 0 -1 4202496 771 0 0 0 9978 1 0 0 25 0 1 0 538348863 1043062784 500 33554432000 134512640 135663704 4294815184 18446744073709551615 134525278 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/12488/statm: 254654 500 113 282 0 254370 0
[pid=12486/tid=12512] ppid=12402 vsize=392832 CPUtime=0 cores=0,2,4,6
/proc/12486/task/12512/stat : 12512 (python) S 12402 12402 12303 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 538358888 402259968 6002 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453951806528 0 0 -1 0 0 0 0
[pid=12505] ppid=12402 vsize=403088 CPUtime=0.35 cores=0,2,4,6
/proc/12505/stat : 12505 (python) S 12402 12402 12303 0 -1 4202560 1196 0 0 0 20 15 0 0 18 0 2 0 538358865 412762112 6006 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12505/statm: 100772 6006 400 364 0 36654 0
[pid=12507] ppid=12505 vsize=268424 CPUtime=208.77 cores=0,2,4,6
/proc/12507/stat : 12507 (hybridGM3) R 12505 12507 12507 0 -1 4202496 5170 0 0 0 20877 0 0 0 25 0 1 0 538358866 274866176 4895 33554432000 134512640 135204385 4294834944 18446744073709551615 134538264 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/12507/statm: 67106 4895 63 169 0 66936 0
[pid=12505/tid=12530] ppid=12402 vsize=403088 CPUtime=0 cores=0,2,4,6
/proc/12505/task/12530/stat : 12530 (python) S 12402 12402 12303 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538379103 412762112 6006 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453919193024 0 0 -1 6 0 0 0
[pid=12509] ppid=12402 vsize=413656 CPUtime=0.48 cores=0,2,4,6
/proc/12509/stat : 12509 (python) S 12402 12402 12303 0 -1 4202560 1201 0 0 0 25 23 0 0 18 0 2 0 538358872 423583744 6087 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12509/statm: 103414 6087 399 364 0 39293 0
[pid=12511] ppid=12509 vsize=268424 CPUtime=296.68 cores=0,2,4,6
/proc/12511/stat : 12511 (hybridGM3) T 12509 12511 12511 0 -1 4202496 5170 0 0 0 29666 2 0 0 25 0 1 0 538358873 274866176 4897 33554432000 134512640 135204385 4293285712 18446744073709551615 134538284 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/12511/statm: 67106 4897 63 169 0 66936 0
[pid=12509/tid=12529] ppid=12402 vsize=413656 CPUtime=0 cores=0,2,4,6
/proc/12509/task/12529/stat : 12529 (python) S 12402 12402 12303 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538378505 423583744 6087 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453942448384 0 0 -1 4 0 0 0
[pid=12513] ppid=12402 vsize=423912 CPUtime=0.49 cores=0,2,4,6
/proc/12513/stat : 12513 (python) S 12402 12402 12303 0 -1 4202560 1091 0 0 0 27 22 0 0 18 0 1 0 538358893 434085888 6070 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 16496896541290627330 0 0 17 0 0 0 0
/proc/12513/statm: 105978 6070 379 364 0 41854 0
[pid=12515] ppid=12513 vsize=457132 CPUtime=302.35 cores=0,2,4,6
/proc/12515/stat : 12515 (TNM) R 12513 12515 12515 0 -1 4202496 1114 0 0 0 30235 0 0 0 25 0 1 0 538358893 468103168 837 33554432000 134512640 135008748 4288420096 18446744073709551615 134529176 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/12515/statm: 114283 837 46 122 0 113183 0
[pid=12531] ppid=12402 vsize=434168 CPUtime=0.16 cores=0,2,4,6
/proc/12531/stat : 12531 (python) S 12402 12402 12303 0 -1 4202560 1214 0 0 0 10 6 0 0 19 0 2 0 538379107 444588032 6127 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12531/statm: 108542 6127 408 364 0 44415 0
[pid=12533] ppid=12531 vsize=418636 CPUtime=99.65 cores=0,2,4,6
/proc/12533/stat : 12533 (adaptg2wsat2009) T 12531 12533 12533 0 -1 4202496 1234 0 0 0 9964 1 0 0 25 0 1 0 538379108 428683264 956 33554432000 134512640 135107411 4291691808 18446744073709551615 134531582 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/12533/statm: 104659 956 59 146 0 103535 0
[pid=12531/tid=12543] ppid=12402 vsize=434168 CPUtime=0 cores=0,2,4,6
/proc/12531/task/12543/stat : 12543 (python) S 12402 12402 12303 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538389123 444588032 6127 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 514 18446604453932675200 0 0 -1 4 0 0 0
[pid=12540] ppid=12402 vsize=444424 CPUtime=0 cores=0,2,4,6
/proc/12540/stat : 12540 (python) S 12402 12402 12303 0 -1 4202560 1027 0 0 0 0 0 0 0 18 0 1 0 538388629 455090176 6095 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 4270230487693230340 0 0 17 0 0 0 0
/proc/12540/statm: 111106 6095 373 364 0 46976 0
[pid=12542] ppid=12540 vsize=248656 CPUtime=4.97 cores=0,2,4,6
/proc/12542/stat : 12542 (FH) R 12540 12542 12542 0 -1 4202496 1131 0 0 0 497 0 0 0 25 0 1 0 538388630 254623744 857 33554432000 134512640 134936988 4286805536 18446744073709551615 134553579 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/12542/statm: 62164 857 41 104 0 61668 0
[pid=12544] ppid=12402 vsize=454680 CPUtime=0 cores=0,2,4,6
/proc/12544/stat : 12544 (python) S 12402 12402 12303 0 -1 4202560 829 0 0 0 0 0 0 0 19 0 1 0 538389128 465592320 6071 33554432000 4194304 5683644 140734157708000 18446744073709551615 239476715078 0 0 16781312 514 4348691637451358207 0 0 17 0 0 0 0
/proc/12544/statm: 113670 6071 345 364 0 49537 0
[pid=12546] ppid=12544 vsize=268416 CPUtime=0.03 cores=0,2,4,6
/proc/12546/stat : 12546 (hybridGM3) R 12544 12546 12546 0 -1 4202496 2156 0 0 0 3 0 0 0 21 0 1 0 538389128 274857984 1881 33554432000 134512640 135204385 4292410720 18446744073709551615 134543223 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/12546/statm: 67104 1886 57 169 0 66934 0
[pid=12402/tid=12409] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12409/stat : 12409 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 19 0 19 0 538328812 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 6 0 0 0
[pid=12402/tid=12412] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12412/stat : 12412 (python) S 12400 12402 12303 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 19 0 538328815 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12415] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12415/stat : 12415 (python) S 12400 12402 12303 0 -1 4202560 22 936 0 0 0 0 0 0 22 0 19 0 538328818 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12418] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12418/stat : 12418 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 24 0 19 0 538328821 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 4 0 0 0
[pid=12402/tid=12440] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12440/stat : 12440 (python) S 12400 12402 12303 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 19 0 538338831 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 6 0 0 0
[pid=12402/tid=12446] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12446/stat : 12446 (python) S 12400 12402 12303 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 19 0 538338834 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 2 0 0 0
[pid=12402/tid=12449] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12449/stat : 12449 (python) S 12400 12402 12303 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 19 0 538338838 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 4 0 0 0
[pid=12402/tid=12452] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12452/stat : 12452 (python) S 12400 12402 12303 0 -1 4202560 28 936 0 0 0 0 0 0 22 0 19 0 538338842 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12475] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12475/stat : 12475 (python) S 12400 12402 12303 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 19 0 538348847 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12480] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12480/stat : 12480 (python) S 12400 12402 12303 0 -1 4202560 24 936 0 0 0 0 0 0 21 0 19 0 538348854 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12484] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12484/stat : 12484 (python) S 12400 12402 12303 0 -1 4202560 28 936 0 0 0 0 0 0 18 0 19 0 538348858 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12487] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12487/stat : 12487 (python) S 12400 12402 12303 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 19 0 538348863 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12506] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12506/stat : 12506 (python) S 12400 12402 12303 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 19 0 538358866 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12510] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12510/stat : 12510 (python) S 12400 12402 12303 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 19 0 538358872 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12514] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12514/stat : 12514 (python) S 12400 12402 12303 0 -1 4202560 28 936 0 0 0 0 0 0 21 0 19 0 538358893 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12532] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12532/stat : 12532 (python) S 12400 12402 12303 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 19 0 538379107 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12541] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12541/stat : 12541 (python) S 12400 12402 12303 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 19 0 538388629 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
[pid=12402/tid=12545] ppid=12400 vsize=464924 CPUtime=0 cores=0,2,4,6
/proc/12402/task/12545/stat : 12545 (python) S 12400 12402 12303 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 19 0 538389128 476082176 7642 33554432000 4194304 5683644 140734157708000 18446744073709551615 239488518577 0 0 16781312 2 18446604453891580096 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2405.54
Current children cumulated vsize (KiB) 15944460

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12402 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=198665
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=186971
# CPU time returned by wait4() is 2.38564
# while last known CPU time is 2405.54
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 605.02
CPU time (s): 2405.54
CPU user time (s): 2403.61
CPU system time (s): 1.93
CPU usage (%): 397.596
Max. virtual memory (cumulated for all children) (KiB): 15944464

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.19867
system time used= 0.186971
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28990
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3034
involuntary context switches= 68

runsolver used 2.46862 second user time and 5.69513 second system time

The end

Launcher Data 

Begin job on node148 at 2011-05-01 18:28:36
IDJOB=3317103
IDBENCH=82568
IDSOLVER=1705
FILE ID=node148/3317103-1304267315
RUNJOBID= node148-1304267279-12321
PBS_JOBID= 13173931
Free space on /tmp= 73088 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v200-c17000-S283489555-036-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317103-1304267315/watcher-3317103-1304267315 -o /tmp/evaluation-result-3317103-1304267315/solver-3317103-1304267315 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317103-1304267315.cnf -seed 1621517985 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dd0dfae1a7fca71616878d93d3870a71
RANDOM SEED=1621517985

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29839380 kB
Buffers:        796704 kB
Cached:        1844604 kB
SwapCached:       3772 kB
Active:         366376 kB
Inactive:      2364556 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29839380 kB
SwapTotal:    67111528 kB
SwapFree:     67086616 kB
Dirty:           44864 kB
Writeback:           0 kB
AnonPages:       88592 kB
Mapped:          20332 kB
Slab:           311908 kB
PageTables:       7492 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  3300156 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73056 MiB
End job on node148 at 2011-05-01 18:38:43