Trace number 3373125

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.47 1203.67

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_15_90_1-dir.shuffled-as.sat03-136.cnf
MD5SUM5bd7c76aed56f767985526812cdb8e0e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark935.889
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses31962
Sum of the clauses size64344
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 231947
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 515

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...429420/instance-3373125-1305429420.cnf
0.09/0.11	c Solving...
4800.39/1203.61	
4800.39/1203.61	*** INTERRUPTED! ***
4800.39/1203.61	*** Shutting down threads...
4800.39/1203.66	s UNKNOWN
4800.39/1203.66	
4800.39/1203.66	c INTERRUPTED   : 1
4800.39/1203.66	c Models        : 0+    
4800.39/1203.66	c Time          : 1203.617s (Solving: 1203.51s 1st Model: 0.00s Unsat: 0.00s)
4800.39/1203.66	c CPU Time      : 4800.410s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373125-1305429420/watcher-3373125-1305429420 -o /tmp/evaluation-result-3373125-1305429420/solver-3373125-1305429420 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373125-1305429420.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.10 8.15 5/353 30701
/proc/meminfo: memFree=24094264/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=22732 CPUtime=0.01 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 1069 0 0 0 1 0 0 0 25 0 1 0 654538727 23277568 904 33554432000 4194304 4964800 140737300370016 18446744073709551615 254500388960 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/30701/statm: 5683 904 396 189 0 557 0

[startup+0.0586039 s]
/proc/loadavg: 8.12 8.10 8.15 5/353 30701
/proc/meminfo: memFree=24094264/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=23084 CPUtime=0.05 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 1130 0 0 0 5 0 0 0 25 0 1 0 654538727 23638016 965 33554432000 4194304 4964800 140737300370016 18446744073709551615 4607513 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/30701/statm: 5771 965 398 189 0 645 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 23084

[startup+0.100591 s]
/proc/loadavg: 8.12 8.10 8.15 5/353 30701
/proc/meminfo: memFree=24094264/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=23216 CPUtime=0.09 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 1169 0 0 0 9 0 0 0 25 0 1 0 654538727 23773184 1004 33554432000 4194304 4964800 140737300370016 18446744073709551615 4600372 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/30701/statm: 5804 1004 399 189 0 678 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 23216

[startup+0.300487 s]
/proc/loadavg: 8.12 8.10 8.15 5/353 30701
/proc/meminfo: memFree=24094264/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=172340 CPUtime=0.84 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 3787 0 0 0 84 0 0 0 25 0 4 0 654538727 176476160 3558 33554432000 4194304 4964800 140737300370016 18446744073709551615 4325338 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 43085 3558 458 189 0 37434 0
Current children cumulated CPU time (s) 0.84
Current children cumulated vsize (KiB) 172340

[startup+0.700409 s]
/proc/loadavg: 8.12 8.10 8.15 5/353 30701
/proc/meminfo: memFree=24094264/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=174796 CPUtime=2.44 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 5684 0 0 0 243 1 0 0 25 0 4 0 654538727 178991104 5455 33554432000 4194304 4964800 140737300370016 18446744073709551615 4332341 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 43699 5455 458 189 0 38048 0
Current children cumulated CPU time (s) 2.44
Current children cumulated vsize (KiB) 174796

[startup+1.50025 s]
/proc/loadavg: 8.11 8.09 8.15 9/357 30705
/proc/meminfo: memFree=24056120/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=178660 CPUtime=5.62 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 8445 0 0 0 560 2 0 0 25 0 4 0 654538727 182947840 8216 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670323 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 44665 8216 458 189 0 39014 0
[pid=30701/tid=30703] ppid=30699 vsize=178660 CPUtime=1.37 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 1971 0 0 0 137 0 0 0 25 0 4 0 654538739 182947840 8216 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=178660 CPUtime=1.37 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 1571 0 0 0 137 0 0 0 25 0 4 0 654538739 182947840 8216 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=178660 CPUtime=1.37 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 2111 0 0 0 137 0 0 0 19 0 4 0 654538739 182947840 8216 33554432000 4194304 4964800 140737300370016 18446744073709551615 4321038 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.62
Current children cumulated vsize (KiB) 178660

[startup+3.10093 s]
/proc/loadavg: 8.11 8.09 8.15 9/357 30705
/proc/meminfo: memFree=24039256/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=182056 CPUtime=12.01 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 10846 0 0 0 1198 3 0 0 25 0 4 0 654538727 186425344 10617 33554432000 4194304 4964800 140737300370016 18446744073709551615 4654543 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 45514 10617 460 189 0 39863 0
[pid=30701/tid=30703] ppid=30699 vsize=182056 CPUtime=2.97 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 2444 0 0 0 296 1 0 0 25 0 4 0 654538739 186425344 10617 33554432000 4194304 4964800 140737300370016 18446744073709551615 4663933 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=182056 CPUtime=2.97 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 2409 0 0 0 297 0 0 0 25 0 4 0 654538739 186425344 10617 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=182056 CPUtime=2.97 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 2543 0 0 0 297 0 0 0 25 0 4 0 654538739 186425344 10617 33554432000 4194304 4964800 140737300370016 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.01
Current children cumulated vsize (KiB) 182056

[startup+6.30029 s]
/proc/loadavg: 8.11 8.09 8.15 9/357 30706
/proc/meminfo: memFree=24018224/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=185220 CPUtime=24.78 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 14007 0 0 0 2474 4 0 0 25 0 4 0 654538727 189665280 13777 33554432000 4194304 4964800 140737300370016 18446744073709551615 4627281 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 46305 13777 460 189 0 40654 0
[pid=30701/tid=30703] ppid=30699 vsize=185220 CPUtime=6.17 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 3193 0 0 0 616 1 0 0 25 0 4 0 654538739 189665280 13777 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=185220 CPUtime=6.18 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 3046 0 0 0 617 1 0 0 25 0 4 0 654538739 189665280 13777 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=185220 CPUtime=6.17 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 3634 0 0 0 617 0 0 0 25 0 4 0 654538739 189665280 13777 33554432000 4194304 4964800 140737300370016 18446744073709551615 4627272 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.78
Current children cumulated vsize (KiB) 185220

[startup+12.701 s]
/proc/loadavg: 8.09 8.09 8.15 9/357 30706
/proc/meminfo: memFree=23972376/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=191140 CPUtime=50.29 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 18188 0 0 0 5023 6 0 0 25 0 4 0 654538727 195727360 17958 33554432000 4194304 4964800 140737300370016 18446744073709551615 4684040 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 47785 17958 460 189 0 42134 0
[pid=30701/tid=30703] ppid=30699 vsize=191140 CPUtime=12.56 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 3862 0 0 0 1255 1 0 0 25 0 4 0 654538739 195727360 17958 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=191140 CPUtime=12.58 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 4781 0 0 0 1257 1 0 0 25 0 4 0 654538739 195727360 17958 33554432000 4194304 4964800 140737300370016 18446744073709551615 4627923 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=191140 CPUtime=12.57 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 4438 0 0 0 1256 1 0 0 24 0 4 0 654538739 195727360 17958 33554432000 4194304 4964800 140737300370016 18446744073709551615 4363605 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.29
Current children cumulated vsize (KiB) 191140

[startup+25.5005 s]
/proc/loadavg: 8.08 8.09 8.15 9/357 30706
/proc/meminfo: memFree=23912864/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=208576 CPUtime=101.34 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 28430 0 0 0 10124 10 0 0 25 0 4 0 654538727 213581824 28196 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670330 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 52144 28196 460 189 0 46493 0
[pid=30701/tid=30703] ppid=30699 vsize=208576 CPUtime=25.35 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 5441 0 0 0 2533 2 0 0 25 0 4 0 654538739 213581824 28196 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=208576 CPUtime=25.37 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 7681 0 0 0 2536 1 0 0 25 0 4 0 654538739 213581824 28196 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=208576 CPUtime=25.37 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 6928 0 0 0 2535 2 0 0 25 0 4 0 654538739 213581824 28196 33554432000 4194304 4964800 140737300370016 18446744073709551615 4363324 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.34
Current children cumulated vsize (KiB) 208576

[startup+51.1004 s]
/proc/loadavg: 8.05 8.08 8.14 9/357 30707
/proc/meminfo: memFree=23833348/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=226188 CPUtime=203.44 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 41317 0 0 0 20328 16 0 0 25 0 4 0 654538727 231616512 40764 33554432000 4194304 4964800 140737300370016 18446744073709551615 4660163 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 56547 40764 460 189 0 50896 0
[pid=30701/tid=30703] ppid=30699 vsize=226188 CPUtime=50.94 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 8481 0 0 0 5090 4 0 0 25 0 4 0 654538739 231616512 40764 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=226188 CPUtime=50.97 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 10519 0 0 0 5095 2 0 0 25 0 4 0 654538739 231616512 40764 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=226188 CPUtime=50.97 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 10625 0 0 0 5094 3 0 0 25 0 4 0 654538739 231616512 40764 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.44
Current children cumulated vsize (KiB) 226188

[startup+102.313 s]
/proc/loadavg: 8.06 8.08 8.14 9/357 30708
/proc/meminfo: memFree=23760044/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=299176 CPUtime=407.69 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 49166 0 0 0 40749 20 0 0 25 0 4 0 654538727 306356224 48329 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320848 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30701/statm: 74794 48329 460 189 0 69143 0
[pid=30701/tid=30703] ppid=30699 vsize=299176 CPUtime=102.12 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 10418 0 0 0 10208 4 0 0 25 0 4 0 654538739 306356224 48329 33554432000 4194304 4964800 140737300370016 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=299176 CPUtime=102.19 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 14099 0 0 0 10215 4 0 0 25 0 4 0 654538739 306356224 48329 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=299176 CPUtime=102.18 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 12156 0 0 0 10214 4 0 0 25 0 4 0 654538739 306356224 48329 33554432000 4194304 4964800 140737300370016 18446744073709551615 4644900 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.69
Current children cumulated vsize (KiB) 299176

[startup+162.3 s]
/proc/loadavg: 8.02 8.06 8.12 9/357 30710
/proc/meminfo: memFree=23672712/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=382392 CPUtime=646.95 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 60390 0 0 0 64667 28 0 0 25 0 4 0 654538727 391569408 59304 33554432000 4194304 4964800 140737300370016 18446744073709551615 4321029 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 95598 59304 460 189 0 89947 0
[pid=30701/tid=30703] ppid=30699 vsize=382392 CPUtime=162.08 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 12333 0 0 0 16202 6 0 0 25 0 4 0 654538739 391569408 59304 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=382392 CPUtime=162.17 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 16505 0 0 0 16213 4 0 0 25 0 4 0 654538739 391569408 59304 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=382392 CPUtime=162.12 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 14183 0 0 0 16205 7 0 0 25 0 4 0 654538739 391569408 59304 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 646.95
Current children cumulated vsize (KiB) 382392

[startup+222.3 s]
/proc/loadavg: 8.04 8.06 8.12 9/357 30711
/proc/meminfo: memFree=23616520/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=388200 CPUtime=886.25 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 63716 0 0 0 88594 31 0 0 25 0 4 0 654538727 397516800 62468 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 97050 62468 460 189 0 91399 0
[pid=30701/tid=30703] ppid=30699 vsize=388200 CPUtime=222.05 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 13181 0 0 0 22198 7 0 0 25 0 4 0 654538739 397516800 62468 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=388200 CPUtime=222.17 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 18022 0 0 0 22212 5 0 0 25 0 4 0 654538739 397516800 62468 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=388200 CPUtime=221.44 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 14883 0 0 0 22137 7 0 0 25 0 4 0 654538739 397516800 62468 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 886.25
Current children cumulated vsize (KiB) 388200

[startup+282.3 s]

################
# More data... #
################

[pid=30701] ppid=30699 vsize=474384 CPUtime=2561.49 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 92328 0 0 0 256092 57 0 0 25 0 4 0 654538727 485769216 90639 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 118596 90639 460 189 0 112945 0
[pid=30701/tid=30703] ppid=30699 vsize=474384 CPUtime=641.88 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 20828 0 0 0 64173 15 0 0 25 0 4 0 654538739 485769216 90639 33554432000 4194304 4964800 140737300370016 18446744073709551615 4684749 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=474384 CPUtime=642.18 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 28021 0 0 0 64208 10 0 0 25 0 4 0 654538739 485769216 90639 33554432000 4194304 4964800 140737300370016 18446744073709551615 4321076 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=474384 CPUtime=636.86 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 20564 0 0 0 63673 13 0 0 25 0 4 0 654538739 485769216 90639 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2561.49
Current children cumulated vsize (KiB) 474384

[startup+702.301 s]
/proc/loadavg: 8.11 8.11 8.09 9/357 30724
/proc/meminfo: memFree=23389640/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=474384 CPUtime=2800.79 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 94135 0 0 0 280020 59 0 0 25 0 4 0 654538727 485769216 92265 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320955 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 118596 92265 460 189 0 112945 0
[pid=30701/tid=30703] ppid=30699 vsize=474384 CPUtime=701.85 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 20992 0 0 0 70170 15 0 0 25 0 4 0 654538739 485769216 92265 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=474384 CPUtime=702.17 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 28106 0 0 0 70207 10 0 0 25 0 4 0 654538739 485769216 92265 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=474384 CPUtime=696.19 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 22084 0 0 0 69605 14 0 0 25 0 4 0 654538739 485769216 92265 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2800.79
Current children cumulated vsize (KiB) 474384

[startup+762.313 s]
/proc/loadavg: 8.08 8.10 8.09 9/357 30726
/proc/meminfo: memFree=23355248/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=475076 CPUtime=3040.16 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 95427 0 0 0 303956 60 0 0 25 0 4 0 654538727 486477824 93357 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 118769 93357 460 189 0 113118 0
[pid=30701/tid=30703] ppid=30699 vsize=475076 CPUtime=761.84 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 21476 0 0 0 76169 15 0 0 25 0 4 0 654538739 486477824 93357 33554432000 4194304 4964800 140737300370016 18446744073709551615 4627540 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=475076 CPUtime=762.18 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 28816 0 0 0 76208 10 0 0 25 0 4 0 654538739 486477824 93357 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=475076 CPUtime=755.55 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 22152 0 0 0 75540 15 0 0 25 0 4 0 654538739 486477824 93357 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3040.16
Current children cumulated vsize (KiB) 475076

[startup+822.301 s]
/proc/loadavg: 8.11 8.11 8.09 9/357 30727
/proc/meminfo: memFree=23321004/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=477260 CPUtime=3279.43 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 96236 0 0 0 327883 60 0 0 25 0 4 0 654538727 488714240 94126 33554432000 4194304 4964800 140737300370016 18446744073709551615 4342232 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 119315 94126 460 189 0 113664 0
[pid=30701/tid=30703] ppid=30699 vsize=477260 CPUtime=821.81 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 21589 0 0 0 82165 16 0 0 25 0 4 0 654538739 488714240 94126 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=477260 CPUtime=822.17 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 29414 0 0 0 82207 10 0 0 25 0 4 0 654538739 488714240 94126 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=477260 CPUtime=814.89 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 22249 0 0 0 81474 15 0 0 25 0 4 0 654538739 488714240 94126 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3279.43
Current children cumulated vsize (KiB) 477260

[startup+882.301 s]
/proc/loadavg: 8.16 8.13 8.10 9/357 30729
/proc/meminfo: memFree=23299772/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=478492 CPUtime=3518.75 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 96853 0 0 0 351813 62 0 0 25 0 4 0 654538727 489975808 94703 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 119623 94703 460 189 0 113972 0
[pid=30701/tid=30703] ppid=30699 vsize=478492 CPUtime=881.78 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 21707 0 0 0 88162 16 0 0 25 0 4 0 654538739 489975808 94703 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=478492 CPUtime=882.17 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 29616 0 0 0 88206 11 0 0 25 0 4 0 654538739 489975808 94703 33554432000 4194304 4964800 140737300370016 18446744073709551615 4321042 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=478492 CPUtime=874.22 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 22311 0 0 0 87407 15 0 0 25 0 4 0 654538739 489975808 94703 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3518.75
Current children cumulated vsize (KiB) 478492

[startup+942.301 s]
/proc/loadavg: 8.17 8.13 8.10 9/357 30730
/proc/meminfo: memFree=23256220/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=489016 CPUtime=3758.09 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 100149 0 0 0 375745 64 0 0 25 0 4 0 654538727 500752384 97959 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 122254 97959 460 189 0 116603 0
[pid=30701/tid=30703] ppid=30699 vsize=489016 CPUtime=941.76 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 21814 0 0 0 94160 16 0 0 25 0 4 0 654538739 500752384 97959 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=489016 CPUtime=942.16 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 30134 0 0 0 94205 11 0 0 25 0 4 0 654538739 500752384 97959 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=489016 CPUtime=933.58 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 22318 0 0 0 93342 16 0 0 25 0 4 0 654538739 500752384 97959 33554432000 4194304 4964800 140737300370016 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3758.09
Current children cumulated vsize (KiB) 489016

[startup+1002.3 s]
/proc/loadavg: 8.13 8.12 8.09 9/357 30732
/proc/meminfo: memFree=23241568/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=554552 CPUtime=3997.41 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 101827 0 0 0 399674 67 0 0 25 0 4 0 654538727 567861248 99637 33554432000 4194304 4964800 140737300370016 18446744073709551615 4627968 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 138638 99637 460 189 0 132987 0
[pid=30701/tid=30703] ppid=30699 vsize=554552 CPUtime=1001.75 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 21832 0 0 0 100158 17 0 0 25 0 4 0 654538739 567861248 99637 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=554552 CPUtime=1002.17 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 30137 0 0 0 100206 11 0 0 25 0 4 0 654538739 567861248 99637 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=554552 CPUtime=992.92 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 23962 0 0 0 99273 19 0 0 25 0 4 0 654538739 567861248 99637 33554432000 4194304 4964800 140737300370016 18446744073709551615 4644919 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3997.41
Current children cumulated vsize (KiB) 554552

[startup+1062.3 s]
/proc/loadavg: 8.08 8.11 8.09 9/357 30734
/proc/meminfo: memFree=23221828/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=554552 CPUtime=4236.75 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 105869 0 0 0 423604 71 0 0 25 0 4 0 654538727 567861248 103599 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 138638 103599 460 189 0 132987 0
[pid=30701/tid=30703] ppid=30699 vsize=554552 CPUtime=1061.73 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 21982 0 0 0 106156 17 0 0 25 0 4 0 654538739 567861248 103599 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=554552 CPUtime=1062.18 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 30421 0 0 0 106206 12 0 0 25 0 4 0 654538739 567861248 103599 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=554552 CPUtime=1052.27 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 24678 0 0 0 105207 20 0 0 25 0 4 0 654538739 567861248 103599 33554432000 4194304 4964800 140737300370016 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4236.75
Current children cumulated vsize (KiB) 554552

[startup+1122.3 s]
/proc/loadavg: 8.03 8.09 8.08 9/357 30735
/proc/meminfo: memFree=23191432/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=554552 CPUtime=4476.06 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 106458 0 0 0 447534 72 0 0 25 0 4 0 654538727 567861248 104148 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 138638 104148 460 189 0 132987 0
[pid=30701/tid=30703] ppid=30699 vsize=554552 CPUtime=1121.7 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 22097 0 0 0 112153 17 0 0 25 0 4 0 654538739 567861248 104148 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=554552 CPUtime=1122.17 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 30881 0 0 0 112205 12 0 0 25 0 4 0 654538739 567861248 104148 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=554552 CPUtime=1111.62 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 24692 0 0 0 111142 20 0 0 25 0 4 0 654538739 567861248 104148 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4476.06
Current children cumulated vsize (KiB) 554552

[startup+1182.3 s]
/proc/loadavg: 8.09 8.09 8.08 9/357 30737
/proc/meminfo: memFree=23186700/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=554552 CPUtime=4715.39 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 106931 0 0 0 471467 72 0 0 25 0 4 0 654538727 567861248 104543 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 138638 104543 460 189 0 132987 0
[pid=30701/tid=30703] ppid=30699 vsize=554552 CPUtime=1181.69 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 22240 0 0 0 118151 18 0 0 25 0 4 0 654538739 567861248 104543 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=554552 CPUtime=1182.18 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 31148 0 0 0 118206 12 0 0 25 0 4 0 654538739 567861248 104543 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=554552 CPUtime=1170.97 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 24753 0 0 0 117077 20 0 0 25 0 4 0 654538739 567861248 104543 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4715.39
Current children cumulated vsize (KiB) 554552



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.6 s]
/proc/loadavg: 8.06 8.08 8.08 5/352 30739
/proc/meminfo: memFree=23691656/32950928 swapFree=45937192/67111528
[pid=30701] ppid=30699 vsize=554552 CPUtime=4800.39 cores=0,2,4,6
/proc/30701/stat : 30701 (claspmt) R 30699 30701 23744 0 -1 4202496 106939 0 0 0 479967 72 0 0 25 0 4 0 654538727 567861248 104551 33554432000 4194304 4964800 140737300370016 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/30701/statm: 138638 104551 460 189 0 132987 0
[pid=30701/tid=30703] ppid=30699 vsize=554552 CPUtime=1203 cores=0,2,4,6
/proc/30701/task/30703/stat : 30703 (claspmt) R 30699 30701 23744 0 -1 4202560 22240 0 0 0 120282 18 0 0 25 0 4 0 654538739 567861248 104551 33554432000 4194304 4964800 140737300370016 18446744073709551615 4362243 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30701/tid=30704] ppid=30699 vsize=554552 CPUtime=1203.49 cores=0,2,4,6
/proc/30701/task/30704/stat : 30704 (claspmt) R 30699 30701 23744 0 -1 4202560 31148 0 0 0 120337 12 0 0 25 0 4 0 654538739 567861248 104551 33554432000 4194304 4964800 140737300370016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30701/tid=30705] ppid=30699 vsize=554552 CPUtime=1192.03 cores=0,2,4,6
/proc/30701/task/30705/stat : 30705 (claspmt) R 30699 30701 23744 0 -1 4202560 24760 0 0 0 119183 20 0 0 25 0 4 0 654538739 567861248 104551 33554432000 4194304 4964800 140737300370016 18446744073709551615 4684063 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 554552

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1203.67
CPU time (s): 4800.47
CPU user time (s): 4799.72
CPU system time (s): 0.747886
CPU usage (%): 398.821
Max. virtual memory (cumulated for all children) (KiB): 554552

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.72
system time used= 0.747886
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 106951
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 35807
involuntary context switches= 25135

runsolver used 3.74843 second user time and 9.42557 second system time

The end

Launcher Data 

Begin job on node149 at 2011-05-15 05:17:00
IDJOB=3373125
IDBENCH=83985
IDSOLVER=1853
FILE ID=node149/3373125-1305429420
RUNJOBID= node149-1305428213-30512
PBS_JOBID= 13324600
Free space on /tmp= 73620 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_15_90_1-dir.shuffled-as.sat03-136.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373125-1305429420/watcher-3373125-1305429420 -o /tmp/evaluation-result-3373125-1305429420/solver-3373125-1305429420 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373125-1305429420.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5bd7c76aed56f767985526812cdb8e0e
RANDOM SEED=1888501927

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      24094420 kB
Buffers:        316236 kB
Cached:        3890664 kB
SwapCached:      19984 kB
Active:        6342040 kB
Inactive:      2221096 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      24094420 kB
SwapTotal:    67111528 kB
SwapFree:     45937192 kB
Dirty:            2768 kB
Writeback:           0 kB
AnonPages:     4348740 kB
Mapped:          14612 kB
Slab:           156872 kB
PageTables:      71532 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 80236528 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73620 MiB
End job on node149 at 2011-05-15 05:37:06