Trace number 3321506

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40001.7 5008.7

General information on the benchmark

NameCRAFTED/rbsat/crafted/unforced/
rbsat-v2400c266431g9.cnf
MD5SUM35278b3ce28129761cf8ae7994f37d3f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

0.00/0.05	c clasp version 2.0.0-RC2
0.00/0.05	c Reading from ...356814/instance-3321506-1304356814.cnf
1.44/1.54	c Solving...
40000.86/5007.91	
40000.86/5007.91	*** INTERRUPTED! ***
40000.86/5007.91	*** Shutting down threads...
40001.59/5008.69	s UNKNOWN
40001.59/5008.69	
40001.59/5008.69	c INTERRUPTED   : 1
40001.59/5008.69	c Models        : 0+    
40001.59/5008.69	c Time          : 5007.866s (Solving: 5006.37s 1st Model: 0.00s Unsat: 0.00s)
40001.59/5008.69	c CPU Time      : 40000.910s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321506-1304356814/watcher-3321506-1304356814 -o /tmp/evaluation-result-3321506-1304356814/solver-3321506-1304356814 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321506-1304356814.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.78 7.88 7.39 2/277 14795
/proc/meminfo: memFree=8800800/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=8916 CPUtime=0 cores=0-7
/proc/14795/stat : 14795 (claspmt) D 14793 14795 13108 0 -1 4194304 93 0 2 0 0 0 0 0 21 0 1 0 625912142 9129984 49 33554432000 4194304 4964704 140735481617088 18446744073709551615 224280005510 0 0 4096 0 18446744071562154983 0 0 17 4 0 0 0
/proc/14795/statm: 2229 49 37 189 0 46 0

[startup+0.011842 s]
/proc/loadavg: 8.78 7.88 7.39 2/277 14795
/proc/meminfo: memFree=8800800/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=8916 CPUtime=0 cores=0-7
/proc/14795/stat : 14795 (claspmt) D 14793 14795 13108 0 -1 4194304 93 0 2 0 0 0 0 0 21 0 1 0 625912142 9129984 49 33554432000 4194304 4964704 140735481617088 18446744073709551615 224280005510 0 0 4096 0 18446744071562154983 0 0 17 4 0 0 0
/proc/14795/statm: 2229 49 37 189 0 46 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8916

[startup+0.100804 s]
/proc/loadavg: 8.78 7.88 7.39 2/277 14795
/proc/meminfo: memFree=8800800/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=30724 CPUtime=0.04 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 3965 0 7 0 4 0 0 0 21 0 1 0 625912142 31461376 2734 33554432000 4194304 4964704 140735481617088 18446744073709551615 224284586693 0 0 4096 18946 0 0 0 17 2 0 0 4
/proc/14795/statm: 7681 2736 386 189 0 2555 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 30724

[startup+0.300771 s]
/proc/loadavg: 8.78 7.88 7.39 2/277 14795
/proc/meminfo: memFree=8800800/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=37904 CPUtime=0.24 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 5836 0 7 0 24 0 0 0 21 0 1 0 625912142 38813696 4582 33554432000 4194304 4964704 140735481617088 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 2 0 0 4
/proc/14795/statm: 9476 4582 399 189 0 4350 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 37904

[startup+0.700706 s]
/proc/loadavg: 8.78 7.88 7.39 2/277 14795
/proc/meminfo: memFree=8800800/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=37904 CPUtime=0.64 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 5836 0 7 0 64 0 0 0 23 0 1 0 625912142 38813696 4582 33554432000 4194304 4964704 140735481617088 18446744073709551615 4607472 0 0 4096 18946 0 0 0 17 2 0 0 4
/proc/14795/statm: 9476 4582 399 189 0 4350 0
Current children cumulated CPU time (s) 0.64
Current children cumulated vsize (KiB) 37904

[startup+1.50057 s]
/proc/loadavg: 8.78 7.88 7.39 2/278 14796
/proc/meminfo: memFree=8781292/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=41468 CPUtime=1.44 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 6719 0 7 0 144 0 0 0 25 0 1 0 625912142 42463232 5465 33554432000 4194304 4964704 140735481617088 18446744073709551615 4607479 0 0 4096 18946 0 0 0 17 2 0 0 4
/proc/14795/statm: 10367 5465 400 189 0 5241 0
Current children cumulated CPU time (s) 1.44
Current children cumulated vsize (KiB) 41468

[startup+3.10127 s]
/proc/loadavg: 8.16 7.77 7.36 9/285 14803
/proc/meminfo: memFree=8759044/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=464920 CPUtime=11.55 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 19732 0 8 0 1147 8 0 0 19 0 8 0 625912142 476078080 17938 33554432000 4194304 4964704 140735481617088 18446744073709551615 4668953 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 12
/proc/14795/statm: 116230 17938 464 189 0 110579 0
[pid=14795/tid=14797] ppid=14793 vsize=464920 CPUtime=1.23 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 1379 0 0 0 122 1 0 0 17 0 8 0 625912305 476078080 17938 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670354 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=464920 CPUtime=1.22 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 1852 0 0 0 121 1 0 0 17 0 8 0 625912305 476078080 17938 33554432000 4194304 4964704 140735481617088 18446744073709551615 224284969143 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=464920 CPUtime=1.22 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 1445 0 0 0 122 0 0 0 17 0 8 0 625912305 476078080 17938 33554432000 4194304 4964704 140735481617088 18446744073709551615 4668958 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=464920 CPUtime=1.22 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 1340 0 0 0 122 0 0 0 17 0 8 0 625912305 476078080 17938 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=464920 CPUtime=1.44 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 873 0 0 0 144 0 0 0 19 0 8 0 625912305 476078080 17939 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=464920 CPUtime=1.22 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 1985 0 0 0 121 1 0 0 17 0 8 0 625912305 476078080 17939 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=464920 CPUtime=1.23 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 2847 0 0 0 122 1 0 0 17 0 8 0 625912305 476078080 17940 33554432000 4194304 4964704 140735481617088 18446744073709551615 224284587041 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.55
Current children cumulated vsize (KiB) 464920

[startup+6.30074 s]
/proc/loadavg: 8.16 7.77 7.36 9/285 14803
/proc/meminfo: memFree=8682272/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=471872 CPUtime=37.1 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 37324 0 8 0 3692 18 0 0 25 0 8 0 625912142 483196928 35530 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670590 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 12
/proc/14795/statm: 117968 35530 466 189 0 112317 0
[pid=14795/tid=14797] ppid=14793 vsize=471872 CPUtime=4.42 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 3474 0 0 0 440 2 0 0 23 0 8 0 625912305 483196928 35530 33554432000 4194304 4964704 140735481617088 18446744073709551615 4647525 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=471872 CPUtime=4.42 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 3466 0 0 0 440 2 0 0 23 0 8 0 625912305 483196928 35530 33554432000 4194304 4964704 140735481617088 18446744073709551615 4690385 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=471872 CPUtime=4.42 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 3359 0 0 0 441 1 0 0 23 0 8 0 625912305 483196928 35530 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=471872 CPUtime=4.43 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 3328 0 0 0 441 2 0 0 23 0 8 0 625912305 483196928 35530 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=471872 CPUtime=4.63 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 1554 0 0 0 463 0 0 0 25 0 8 0 625912305 483196928 35530 33554432000 4194304 4964704 140735481617088 18446744073709551615 4683900 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=471872 CPUtime=4.43 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 3950 0 0 0 440 3 0 0 23 0 8 0 625912305 483196928 35530 33554432000 4194304 4964704 140735481617088 18446744073709551615 4660156 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=471872 CPUtime=4.43 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 8088 0 0 0 440 3 0 0 23 0 8 0 625912305 483196928 35530 33554432000 4194304 4964704 140735481617088 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37.1
Current children cumulated vsize (KiB) 471872

[startup+12.7007 s]
/proc/loadavg: 8.13 7.77 7.36 9/285 14803
/proc/meminfo: memFree=8574084/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=486476 CPUtime=88.24 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 63787 0 8 0 8792 32 0 0 25 0 8 0 625912142 498151424 61993 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 12
/proc/14795/statm: 121619 61993 466 189 0 115968 0
[pid=14795/tid=14797] ppid=14793 vsize=486476 CPUtime=10.83 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 7088 0 0 0 1079 4 0 0 25 0 8 0 625912305 498151424 61993 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=486476 CPUtime=10.81 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 6127 0 0 0 1078 3 0 0 25 0 8 0 625912305 498151424 61993 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=486476 CPUtime=10.81 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 5630 0 0 0 1079 2 0 0 25 0 8 0 625912305 498151424 61993 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627213 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=486476 CPUtime=10.83 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 5845 0 0 0 1080 3 0 0 25 0 8 0 625912305 498151424 61993 33554432000 4194304 4964704 140735481617088 18446744073709551615 224284587041 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=486476 CPUtime=11.03 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 4129 0 0 0 1102 1 0 0 25 0 8 0 625912305 498151424 61993 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=486476 CPUtime=10.83 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 5259 0 0 0 1079 4 0 0 25 0 8 0 625912305 498151424 61993 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=486476 CPUtime=10.83 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 16709 0 0 0 1075 8 0 0 25 0 8 0 625912305 498151424 61993 33554432000 4194304 4964704 140735481617088 18446744073709551615 224284969143 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 88.24
Current children cumulated vsize (KiB) 486476

[startup+25.5005 s]
/proc/loadavg: 8.11 7.78 7.37 9/285 14805
/proc/meminfo: memFree=8456532/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=504596 CPUtime=190.5 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 90693 0 8 0 19002 48 0 0 25 0 8 0 625912142 516706304 88899 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 12
/proc/14795/statm: 126149 88899 466 189 0 120498 0
[pid=14795/tid=14797] ppid=14793 vsize=504596 CPUtime=23.62 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 10344 0 0 0 2357 5 0 0 25 0 8 0 625912305 516706304 88899 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627309 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=504596 CPUtime=23.61 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 8925 0 0 0 2356 5 0 0 25 0 8 0 625912305 516706304 88899 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=504596 CPUtime=23.61 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 7648 0 0 0 2357 4 0 0 25 0 8 0 625912305 516706304 88899 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=504596 CPUtime=23.63 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 8968 0 0 0 2359 4 0 0 25 0 8 0 625912305 516706304 88899 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=504596 CPUtime=23.83 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 6252 0 0 0 2381 2 0 0 25 0 8 0 625912305 516706304 88899 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=504596 CPUtime=23.62 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 6044 0 0 0 2358 4 0 0 25 0 8 0 625912305 516706304 88899 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=504596 CPUtime=23.62 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 27491 0 0 0 2348 14 0 0 25 0 8 0 625912305 516706304 88899 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 190.5
Current children cumulated vsize (KiB) 504596

[startup+51.1013 s]
/proc/loadavg: 8.15 7.81 7.39 9/285 14805
/proc/meminfo: memFree=8420712/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=573976 CPUtime=395.04 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 99797 0 8 0 39448 56 0 0 25 0 8 0 625912142 587751424 97999 33554432000 4194304 4964704 140735481617088 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 12
/proc/14795/statm: 143494 97999 466 189 0 137843 0
[pid=14795/tid=14797] ppid=14793 vsize=573976 CPUtime=49.21 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 11154 0 0 0 4914 7 0 0 25 0 8 0 625912305 587751424 97999 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=573976 CPUtime=49.21 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 10236 0 0 0 4915 6 0 0 25 0 8 0 625912305 587751424 97999 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=573976 CPUtime=49.21 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 8142 0 0 0 4916 5 0 0 25 0 8 0 625912305 587751424 97999 33554432000 4194304 4964704 140735481617088 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=573976 CPUtime=49.22 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 9450 0 0 0 4918 4 0 0 25 0 8 0 625912305 587751424 97999 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=573976 CPUtime=49.43 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 6353 0 0 0 4941 2 0 0 25 0 8 0 625912305 587751424 97999 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627968 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=573976 CPUtime=49.21 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 6456 0 0 0 4917 4 0 0 25 0 8 0 625912305 587751424 97999 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627259 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=573976 CPUtime=49.22 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 32443 0 0 0 4904 18 0 0 25 0 8 0 625912305 587751424 97999 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 395.04
Current children cumulated vsize (KiB) 573976

[startup+102.311 s]
/proc/loadavg: 8.13 7.86 7.43 9/285 14807
/proc/meminfo: memFree=8329184/32951124 swapFree=61019336/67111528
[pid=14795] ppid=14793 vsize=786576 CPUtime=804.2 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 122634 0 8 0 80343 77 0 0 25 0 8 0 625912142 805453824 120797 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 12
/proc/14795/statm: 196644 120797 466 189 0 190993 0
[pid=14795/tid=14797] ppid=14793 vsize=786576 CPUtime=100.4 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 14746 0 0 0 10030 10 0 0 25 0 8 0 625912305 805453824 120797 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=786576 CPUtime=100.43 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 11181 0 0 0 10035 8 0 0 25 0 8 0 625912305 805453824 120797 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=786576 CPUtime=100.42 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 10696 0 0 0 10034 8 0 0 25 0 8 0 625912305 805453824 120797 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0

################
# More data... #
################

/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 19795 0 0 0 465951 24 0 0 25 0 8 0 625912305 2761396224 615986 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=2696676 CPUtime=4660.31 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 344880 0 0 0 465602 429 0 0 25 0 8 0 625912305 2761396224 615986 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37240.1
Current children cumulated vsize (KiB) 2696676

[startup+4722.31 s]
/proc/loadavg: 8.07 8.05 8.00 9/285 14943
/proc/meminfo: memFree=6275540/32951124 swapFree=61019368/67111528
[pid=14795] ppid=14793 vsize=2698796 CPUtime=37719.6 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 628416 0 8 0 3771183 775 0 0 25 0 8 0 625912142 2763567104 616454 33554432000 4194304 4964704 140735481617088 18446744073709551615 4628021 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 12
/proc/14795/statm: 674699 616454 466 189 0 669048 0
[pid=14795/tid=14797] ppid=14793 vsize=2698796 CPUtime=4685.5 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 55918 0 0 0 468482 68 0 0 25 0 8 0 625912305 2763567104 616454 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=2698796 CPUtime=4720.36 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 27601 0 0 0 472013 23 0 0 25 0 8 0 625912305 2763567104 616454 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=2698796 CPUtime=4720.02 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 29397 0 0 0 471961 41 0 0 25 0 8 0 625912305 2763567104 616454 33554432000 4194304 4964704 140735481617088 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=2698796 CPUtime=4717.52 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 32664 0 0 0 471713 39 0 0 25 0 8 0 625912305 2763567104 616454 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=2698796 CPUtime=4719.79 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 34916 0 0 0 471942 37 0 0 25 0 8 0 625912305 2763567104 616454 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=2698796 CPUtime=4719.77 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 19797 0 0 0 471953 24 0 0 25 0 8 0 625912305 2763567104 616454 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=2698796 CPUtime=4720.32 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 344880 0 0 0 471603 429 0 0 25 0 8 0 625912305 2763567104 616454 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37719.6
Current children cumulated vsize (KiB) 2698796

[startup+4782.3 s]
/proc/loadavg: 8.25 8.13 8.03 9/285 14946
/proc/meminfo: memFree=6271924/32951124 swapFree=61019368/67111528
[pid=14795] ppid=14793 vsize=2701144 CPUtime=38198.1 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 629227 0 8 0 3819029 778 0 0 25 0 8 0 625912142 2765971456 617264 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 12
/proc/14795/statm: 675286 617264 466 189 0 669635 0
[pid=14795/tid=14797] ppid=14793 vsize=2701144 CPUtime=4745.43 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 56549 0 0 0 474473 70 0 0 25 0 8 0 625912305 2765971456 617264 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=2701144 CPUtime=4780.35 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 27754 0 0 0 478012 23 0 0 25 0 8 0 625912305 2765971456 617264 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=2701144 CPUtime=4779.86 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 29397 0 0 0 477945 41 0 0 25 0 8 0 625912305 2765971456 617264 33554432000 4194304 4964704 140735481617088 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=2701144 CPUtime=4776.97 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 32664 0 0 0 477658 39 0 0 25 0 8 0 625912305 2765971456 617264 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=2701144 CPUtime=4779.76 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 34943 0 0 0 477939 37 0 0 25 0 8 0 625912305 2765971456 617264 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=2701144 CPUtime=4779.09 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 19797 0 0 0 477885 24 0 0 25 0 8 0 625912305 2765971456 617264 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627365 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=2701144 CPUtime=4780.31 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 344880 0 0 0 477602 429 0 0 25 0 8 0 625912305 2765971456 617264 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38198.1
Current children cumulated vsize (KiB) 2701144

[startup+4842.3 s]
/proc/loadavg: 8.13 8.12 8.03 9/285 14948
/proc/meminfo: memFree=6271616/32951124 swapFree=61019368/67111528
[pid=14795] ppid=14793 vsize=2701144 CPUtime=38677.5 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 629466 0 8 0 3866973 778 0 0 25 0 8 0 625912142 2765971456 617487 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 12
/proc/14795/statm: 675286 617487 466 189 0 669635 0
[pid=14795/tid=14797] ppid=14793 vsize=2701144 CPUtime=4805.43 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 56549 0 0 0 480473 70 0 0 25 0 8 0 625912305 2765971456 617487 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320993 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=2701144 CPUtime=4840.35 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 27776 0 0 0 484012 23 0 0 25 0 8 0 625912305 2765971456 617487 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=2701144 CPUtime=4839.85 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 29397 0 0 0 483944 41 0 0 25 0 8 0 625912305 2765971456 617487 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=2701144 CPUtime=4836.73 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 32744 0 0 0 483634 39 0 0 25 0 8 0 625912305 2765971456 617487 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=2701144 CPUtime=4839.76 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 34949 0 0 0 483939 37 0 0 25 0 8 0 625912305 2765971456 617487 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=2701144 CPUtime=4839.09 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 19928 0 0 0 483885 24 0 0 25 0 8 0 625912305 2765971456 617487 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=2701144 CPUtime=4840 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 344880 0 0 0 483571 429 0 0 25 0 8 0 625912305 2765971456 617487 33554432000 4194304 4964704 140735481617088 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38677.5
Current children cumulated vsize (KiB) 2701144

[startup+4902.3 s]
/proc/loadavg: 8.08 8.11 8.03 9/285 14950
/proc/meminfo: memFree=6270580/32951124 swapFree=61019368/67111528
[pid=14795] ppid=14793 vsize=2702532 CPUtime=39157 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 629829 0 8 0 3914918 779 0 0 25 0 8 0 625912142 2767392768 617850 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 12
/proc/14795/statm: 675633 617850 466 189 0 669982 0
[pid=14795/tid=14797] ppid=14793 vsize=2702532 CPUtime=4865.43 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 56549 0 0 0 486473 70 0 0 25 0 8 0 625912305 2767392768 617850 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=2702532 CPUtime=4900.36 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 27908 0 0 0 490013 23 0 0 25 0 8 0 625912305 2767392768 617850 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=2702532 CPUtime=4899.85 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 29454 0 0 0 489944 41 0 0 25 0 8 0 625912305 2767392768 617850 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=2702532 CPUtime=4896.73 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 32745 0 0 0 489634 39 0 0 25 0 8 0 625912305 2767392768 617850 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=2702532 CPUtime=4899.74 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 35084 0 0 0 489937 37 0 0 25 0 8 0 625912305 2767392768 617850 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=2702532 CPUtime=4899.09 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 19931 0 0 0 489885 24 0 0 25 0 8 0 625912305 2767392768 617850 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=2702532 CPUtime=4899.45 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 344915 0 0 0 489516 429 0 0 25 0 8 0 625912305 2767392768 617850 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39157
Current children cumulated vsize (KiB) 2702532

[startup+4962.3 s]
/proc/loadavg: 8.12 8.11 8.03 9/285 14950
/proc/meminfo: memFree=6261116/32951124 swapFree=61019368/67111528
[pid=14795] ppid=14793 vsize=2768068 CPUtime=39636.4 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 632270 0 8 0 3962858 782 0 0 25 0 8 0 625912142 2834501632 620291 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 12
/proc/14795/statm: 692017 620291 466 189 0 686366 0
[pid=14795/tid=14797] ppid=14793 vsize=2768068 CPUtime=4925.43 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 56549 0 0 0 492473 70 0 0 25 0 8 0 625912305 2834501632 620291 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=2768068 CPUtime=4960.36 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 27958 0 0 0 496013 23 0 0 25 0 8 0 625912305 2834501632 620291 33554432000 4194304 4964704 140735481617088 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=2768068 CPUtime=4959.84 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 29483 0 0 0 495943 41 0 0 25 0 8 0 625912305 2834501632 620291 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=2768068 CPUtime=4956.73 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 32761 0 0 0 495634 39 0 0 25 0 8 0 625912305 2834501632 620291 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=2768068 CPUtime=4959.74 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 35223 0 0 0 495936 38 0 0 25 0 8 0 625912305 2834501632 620291 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=2768068 CPUtime=4959.1 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 20057 0 0 0 495885 25 0 0 25 0 8 0 625912305 2834501632 620291 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=2768068 CPUtime=4958.9 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 346996 0 0 0 495458 432 0 0 25 0 8 0 625912305 2834501632 620291 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39636.4
Current children cumulated vsize (KiB) 2768068



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5007.9 s]
/proc/loadavg: 8.06 8.10 8.03 9/285 14952
/proc/meminfo: memFree=6252028/32951124 swapFree=61019368/67111528
[pid=14795] ppid=14793 vsize=2768068 CPUtime=40000.9 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 634558 0 8 0 3999300 786 0 0 25 0 8 0 625912142 2834501632 622579 33554432000 4194304 4964704 140735481617088 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 12
/proc/14795/statm: 692017 622579 466 189 0 686366 0
[pid=14795/tid=14797] ppid=14793 vsize=2768068 CPUtime=4971.04 cores=0-7
/proc/14795/task/14797/stat : 14797 (claspmt) R 14793 14795 13108 0 -1 4202560 56549 0 0 0 497034 70 0 0 25 0 8 0 625912305 2834501632 622579 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=14795/tid=14798] ppid=14793 vsize=2768068 CPUtime=5005.97 cores=0-7
/proc/14795/task/14798/stat : 14798 (claspmt) R 14793 14795 13108 0 -1 4202560 28150 0 0 0 500574 23 0 0 25 0 8 0 625912305 2834501632 622579 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=14795/tid=14799] ppid=14793 vsize=2768068 CPUtime=5005.46 cores=0-7
/proc/14795/task/14799/stat : 14799 (claspmt) R 14793 14795 13108 0 -1 4202560 31127 0 0 0 500502 44 0 0 25 0 8 0 625912305 2834501632 622579 33554432000 4194304 4964704 140735481617088 18446744073709551615 4668937 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=14795/tid=14800] ppid=14793 vsize=2768068 CPUtime=5002.34 cores=0-7
/proc/14795/task/14800/stat : 14800 (claspmt) R 14793 14795 13108 0 -1 4202560 32778 0 0 0 500195 39 0 0 25 0 8 0 625912305 2834501632 622579 33554432000 4194304 4964704 140735481617088 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=14795/tid=14801] ppid=14793 vsize=2768068 CPUtime=5005.34 cores=0-7
/proc/14795/task/14801/stat : 14801 (claspmt) R 14793 14795 13108 0 -1 4202560 35376 0 0 0 500496 38 0 0 25 0 8 0 625912305 2834501632 622579 33554432000 4194304 4964704 140735481617088 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14795/tid=14802] ppid=14793 vsize=2768068 CPUtime=5004.71 cores=0-7
/proc/14795/task/14802/stat : 14802 (claspmt) R 14793 14795 13108 0 -1 4202560 20062 0 0 0 500446 25 0 0 25 0 8 0 625912305 2834501632 622579 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=14795/tid=14803] ppid=14793 vsize=2768068 CPUtime=5004.1 cores=0-7
/proc/14795/task/14803/stat : 14803 (claspmt) R 14793 14795 13108 0 -1 4202560 347270 0 0 0 499977 433 0 0 25 0 8 0 625912305 2834501632 622579 33554432000 4194304 4964704 140735481617088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 2768068

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5008.2 s]
/proc/loadavg: 8.06 8.10 8.03 2/279 14953
/proc/meminfo: memFree=6290764/32951124 swapFree=61019368/67111528
[pid=14795] ppid=14793 vsize=2759560 CPUtime=40001.2 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 634568 0 8 0 3999334 786 0 0 25 0 1 0 625912142 2825789440 612800 33554432000 4194304 4964704 140735481617088 18446744073709551615 224284581217 0 0 4096 18946 0 0 0 17 1 0 0 12
/proc/14795/statm: 689890 612800 476 189 0 684239 0
Current children cumulated CPU time (s) 40001.2
Current children cumulated vsize (KiB) 2759560

[startup+5008.6 s]
/proc/loadavg: 8.06 8.10 8.03 2/279 14953
/proc/meminfo: memFree=6290764/32951124 swapFree=61019368/67111528
[pid=14795] ppid=14793 vsize=2314024 CPUtime=40001.6 cores=0-7
/proc/14795/stat : 14795 (claspmt) R 14793 14795 13108 0 -1 4202496 634568 0 8 0 3999371 788 0 0 25 0 1 0 625912142 2369560576 522157 33554432000 4194304 4964704 140735481617088 18446744073709551615 224284969319 0 0 4096 18946 0 0 0 17 1 0 0 12
/proc/14795/statm: 578506 521645 476 189 0 572855 0
Current children cumulated CPU time (s) 40001.6
Current children cumulated vsize (KiB) 2314024

Child status: 0
Real time (s): 5008.7
CPU time (s): 40001.7
CPU user time (s): 39993.7
CPU system time (s): 7.97879
CPU usage (%): 798.645
Max. virtual memory (cumulated for all children) (KiB): 2768068

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993.7
system time used= 7.97879
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 634569
page faults= 8
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 62779
involuntary context switches= 190412

runsolver used 12.5441 second user time and 33.002 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-02 19:20:15
IDJOB=3321506
IDBENCH=71492
IDSOLVER=1711
FILE ID=node118/3321506-1304356814
RUNJOBID= node118-1304335528-13122
PBS_JOBID= 13178014
Free space on /tmp= 73272 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/unforced/rbsat-v2400c266431g9.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321506-1304356814/watcher-3321506-1304356814 -o /tmp/evaluation-result-3321506-1304356814/solver-3321506-1304356814 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321506-1304356814.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 35278b3ce28129761cf8ae7994f37d3f
RANDOM SEED=407710806

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8800956 kB
Buffers:          1132 kB
Cached:          29900 kB
SwapCached:      88432 kB
Active:       10925108 kB
Inactive:     12997404 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8800956 kB
SwapTotal:    67111528 kB
SwapFree:     61019336 kB
Dirty:            4380 kB
Writeback:           0 kB
AnonPages:    23811504 kB
Mapped:          10420 kB
Slab:            76928 kB
PageTables:      76524 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 53746224 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73272 MiB
End job on node118 at 2011-05-02 20:43:45