Trace number 3380987

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.8 5020.83

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n120-s55656844-unsat.cnf
MD5SUM4877ca9f3fe317c84d3087c8296a2a0b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark716.736
Satisfiable
(Un)Satisfiability was proved
Number of variables121
Number of clauses252
Sum of the clauses size756
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3252
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...499059/instance-3380987-1305499059.cnf
0.00/0.00	c Solving...
40000.74/5020.82	
40000.74/5020.82	*** INTERRUPTED! ***
40000.74/5020.82	*** Shutting down threads...
40000.74/5020.82	s UNKNOWN
40000.74/5020.82	
40000.74/5020.82	c INTERRUPTED   : 1
40000.74/5020.82	c Models        : 0+    
40000.74/5020.82	c Time          : 5020.818s (Solving: 5020.82s 1st Model: 0.00s Unsat: 0.00s)
40000.74/5020.82	c CPU Time      : 40000.810s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380987-1305499059/watcher-3380987-1305499059 -o /tmp/evaluation-result-3380987-1305499059/solver-3380987-1305499059 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380987-1305499059.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.45 7.95 7.97 1/443 18314
/proc/meminfo: memFree=25789076/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=249912 CPUtime=0.02 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 833 0 0 0 2 0 0 0 18 0 8 0 661506872 255909888 762 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18314/statm: 62478 762 462 189 0 56827 0
[pid=18314/tid=18316] ppid=18312 vsize=249912 CPUtime=0 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 44 0 0 0 0 0 0 0 25 0 8 0 661506872 255909888 784 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215726 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=249912 CPUtime=0 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 27 0 0 0 0 0 0 0 18 0 8 0 661506872 255909888 785 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=249912 CPUtime=0 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 33 0 0 0 0 0 0 0 25 0 8 0 661506872 255909888 785 33554432000 4194304 4964800 140736838942704 18446744073709551615 4653536 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=249912 CPUtime=0 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 19 0 0 0 0 0 0 0 18 0 8 0 661506872 255909888 785 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=249912 CPUtime=0 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 18 0 0 0 0 0 0 0 25 0 8 0 661506872 255909888 785 33554432000 4194304 4964800 140736838942704 18446744073709551615 4400099 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=249912 CPUtime=0 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 5 0 0 0 0 0 0 0 25 0 8 0 661506872 255909888 786 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215726 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=249912 CPUtime=0 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 25 0 0 0 0 0 0 0 25 0 8 0 661506872 255909888 786 33554432000 4194304 4964800 140736838942704 18446744073709551615 270612771525 0 0 4096 18946 0 0 0 -1 2 0 0 0

[startup+0.0556801 s]
/proc/loadavg: 7.45 7.95 7.97 1/443 18314
/proc/meminfo: memFree=25789076/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=315448 CPUtime=0.37 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 1031 0 0 0 37 0 0 0 18 0 8 0 661506872 323018752 961 33554432000 4194304 4964800 140736838942704 18446744073709551615 4312128 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18314/statm: 78862 961 464 189 0 73211 0
[pid=18314/tid=18316] ppid=18312 vsize=315448 CPUtime=0.01 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 47 0 0 0 1 0 0 0 25 0 8 0 661506872 323018752 961 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=315448 CPUtime=0.05 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 58 0 0 0 5 0 0 0 18 0 8 0 661506872 323018752 961 33554432000 4194304 4964800 140736838942704 18446744073709551615 4684009 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=315448 CPUtime=0.04 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 46 0 0 0 4 0 0 0 18 0 8 0 661506872 323018752 961 33554432000 4194304 4964800 140736838942704 18446744073709551615 4361118 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=315448 CPUtime=0.05 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 30 0 0 0 5 0 0 0 18 0 8 0 661506872 323018752 961 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215726 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=315448 CPUtime=0.04 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 29 0 0 0 4 0 0 0 18 0 8 0 661506872 323018752 961 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=315448 CPUtime=0.04 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 28 0 0 0 4 0 0 0 18 0 8 0 661506872 323018752 961 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=315448 CPUtime=0.05 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 73 0 0 0 5 0 0 0 25 0 8 0 661506872 323018752 961 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 315448

[startup+0.110416 s]
/proc/loadavg: 7.45 7.95 7.97 1/443 18314
/proc/meminfo: memFree=25789076/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=315580 CPUtime=0.68 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 1138 0 0 0 67 1 0 0 18 0 8 0 661506872 323153920 1067 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18314/statm: 78895 1067 464 189 0 73244 0
[pid=18314/tid=18316] ppid=18312 vsize=315580 CPUtime=0.01 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 47 0 0 0 1 0 0 0 25 0 8 0 661506872 323153920 1067 33554432000 4194304 4964800 140736838942704 18446744073709551615 4669272 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=315580 CPUtime=0.1 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 77 0 0 0 10 0 0 0 18 0 8 0 661506872 323153920 1067 33554432000 4194304 4964800 140736838942704 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=315580 CPUtime=0.09 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 54 0 0 0 9 0 0 0 18 0 8 0 661506872 323153920 1067 33554432000 4194304 4964800 140736838942704 18446744073709551615 4361072 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=315580 CPUtime=0.09 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 44 0 0 0 9 0 0 0 18 0 8 0 661506872 323153920 1067 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=315580 CPUtime=0.09 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 37 0 0 0 9 0 0 0 18 0 8 0 661506872 323153920 1067 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215726 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=315580 CPUtime=0.08 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 30 0 0 0 8 0 0 0 18 0 8 0 661506872 323153920 1067 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=315580 CPUtime=0.09 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 100 0 0 0 9 0 0 0 18 0 8 0 661506872 323153920 1067 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 315580

[startup+0.300351 s]
/proc/loadavg: 7.45 7.95 7.97 1/443 18314
/proc/meminfo: memFree=25789076/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=315844 CPUtime=2.18 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 1467 0 0 0 216 2 0 0 18 0 8 0 661506872 323424256 1396 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18314/statm: 78961 1396 464 189 0 73310 0
[pid=18314/tid=18316] ppid=18312 vsize=315844 CPUtime=0.18 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 97 0 0 0 18 0 0 0 18 0 8 0 661506872 323424256 1396 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=315844 CPUtime=0.28 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 116 0 0 0 28 0 0 0 18 0 8 0 661506872 323424256 1396 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660557 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=315844 CPUtime=0.27 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 64 0 0 0 27 0 0 0 18 0 8 0 661506872 323424256 1396 33554432000 4194304 4964800 140736838942704 18446744073709551615 4668753 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=315844 CPUtime=0.28 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 82 0 0 0 28 0 0 0 18 0 8 0 661506872 323424256 1396 33554432000 4194304 4964800 140736838942704 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=315844 CPUtime=0.27 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 56 0 0 0 27 0 0 0 18 0 8 0 661506872 323424256 1396 33554432000 4194304 4964800 140736838942704 18446744073709551615 4644938 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=315844 CPUtime=0.27 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 54 0 0 0 27 0 0 0 18 0 8 0 661506872 323424256 1397 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660384 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=315844 CPUtime=0.27 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 194 0 0 0 27 0 0 0 18 0 8 0 661506872 323424256 1397 33554432000 4194304 4964800 140736838942704 18446744073709551615 270612771873 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.18
Current children cumulated vsize (KiB) 315844

[startup+0.700279 s]
/proc/loadavg: 7.45 7.95 7.97 1/443 18314
/proc/meminfo: memFree=25789076/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=316100 CPUtime=5.35 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 1764 0 0 0 531 4 0 0 18 0 8 0 661506872 323686400 1693 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18314/statm: 79025 1693 464 189 0 73374 0
[pid=18314/tid=18316] ppid=18312 vsize=316100 CPUtime=0.57 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 159 0 0 0 57 0 0 0 18 0 8 0 661506872 323686400 1693 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670190 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=316100 CPUtime=0.68 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 145 0 0 0 68 0 0 0 18 0 8 0 661506872 323686400 1693 33554432000 4194304 4964800 140736838942704 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=316100 CPUtime=0.66 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 73 0 0 0 66 0 0 0 18 0 8 0 661506872 323686400 1693 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670674 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=316100 CPUtime=0.67 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 108 0 0 0 67 0 0 0 18 0 8 0 661506872 323686400 1693 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660415 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=316100 CPUtime=0.67 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 63 0 0 0 67 0 0 0 18 0 8 0 661506872 323686400 1693 33554432000 4194304 4964800 140736838942704 18446744073709551615 4668822 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=316100 CPUtime=0.67 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 62 0 0 0 67 0 0 0 18 0 8 0 661506872 323686400 1693 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=316100 CPUtime=0.67 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 287 0 0 0 67 0 0 0 18 0 8 0 661506872 323686400 1693 33554432000 4194304 4964800 140736838942704 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.35
Current children cumulated vsize (KiB) 316100

[startup+1.50114 s]
/proc/loadavg: 7.45 7.95 7.97 9/451 18323
/proc/meminfo: memFree=25783988/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=316372 CPUtime=11.72 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 2062 0 0 0 1165 7 0 0 20 0 8 0 661506872 323964928 1991 33554432000 4194304 4964800 140736838942704 18446744073709551615 4333225 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18314/statm: 79093 1991 464 189 0 73442 0
[pid=18314/tid=18316] ppid=18312 vsize=316372 CPUtime=1.36 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 228 0 0 0 135 1 0 0 19 0 8 0 661506872 323964928 1991 33554432000 4194304 4964800 140736838942704 18446744073709551615 4668611 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=316372 CPUtime=1.48 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 167 0 0 0 148 0 0 0 18 0 8 0 661506872 323964928 1991 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=316372 CPUtime=1.46 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 79 0 0 0 145 1 0 0 18 0 8 0 661506872 323964928 1991 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=316372 CPUtime=1.48 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 122 0 0 0 147 1 0 0 18 0 8 0 661506872 323964928 1991 33554432000 4194304 4964800 140736838942704 18446744073709551615 4362383 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=316372 CPUtime=1.46 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 75 0 0 0 146 0 0 0 18 0 8 0 661506872 323964928 1991 33554432000 4194304 4964800 140736838942704 18446744073709551615 4668801 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=316372 CPUtime=1.46 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 66 0 0 0 146 0 0 0 18 0 8 0 661506872 323964928 1991 33554432000 4194304 4964800 140736838942704 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=316372 CPUtime=1.47 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 382 0 0 0 146 1 0 0 19 0 8 0 661506872 323964928 1991 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.72
Current children cumulated vsize (KiB) 316372

[startup+3.10085 s]
/proc/loadavg: 7.45 7.95 7.97 9/451 18324
/proc/meminfo: memFree=25781880/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=316636 CPUtime=24.46 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 2362 0 0 0 2433 13 0 0 25 0 8 0 661506872 324235264 2291 33554432000 4194304 4964800 140736838942704 18446744073709551615 4653595 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18314/statm: 79159 2291 464 189 0 73508 0
[pid=18314/tid=18316] ppid=18312 vsize=316636 CPUtime=2.95 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 341 0 0 0 293 2 0 0 18 0 8 0 661506872 324235264 2291 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=316636 CPUtime=3.07 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 177 0 0 0 307 0 0 0 18 0 8 0 661506872 324235264 2291 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=316636 CPUtime=3.04 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 88 0 0 0 303 1 0 0 18 0 8 0 661506872 324235264 2291 33554432000 4194304 4964800 140736838942704 18446744073709551615 4363274 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=316636 CPUtime=3.06 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 136 0 0 0 305 1 0 0 21 0 8 0 661506872 324235264 2291 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215726 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=316636 CPUtime=3.07 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 77 0 0 0 306 1 0 0 18 0 8 0 661506872 324235264 2291 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=316636 CPUtime=3.05 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 70 0 0 0 304 1 0 0 18 0 8 0 661506872 324235264 2291 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=316636 CPUtime=3.06 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 466 0 0 0 305 1 0 0 18 0 8 0 661506872 324235264 2291 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.46
Current children cumulated vsize (KiB) 316636

[startup+6.30029 s]
/proc/loadavg: 7.50 7.95 7.97 9/451 18324
/proc/meminfo: memFree=25780356/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=316892 CPUtime=49.95 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 2744 0 0 0 4972 23 0 0 19 0 8 0 661506872 324497408 2673 33554432000 4194304 4964800 140736838942704 18446744073709551615 4321084 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18314/statm: 79223 2673 464 189 0 73572 0
[pid=18314/tid=18316] ppid=18312 vsize=316892 CPUtime=6.09 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 497 0 0 0 606 3 0 0 18 0 8 0 661506872 324497408 2673 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660255 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=316892 CPUtime=6.27 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 205 0 0 0 626 1 0 0 18 0 8 0 661506872 324497408 2673 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660263 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=316892 CPUtime=6.23 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 94 0 0 0 620 3 0 0 20 0 8 0 661506872 324497408 2673 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=316892 CPUtime=6.26 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 146 0 0 0 623 3 0 0 18 0 8 0 661506872 324497408 2673 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=316892 CPUtime=6.26 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 89 0 0 0 624 2 0 0 18 0 8 0 661506872 324497408 2673 33554432000 4194304 4964800 140736838942704 18446744073709551615 4333247 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=316892 CPUtime=6.25 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 88 0 0 0 622 3 0 0 18 0 8 0 661506872 324497408 2673 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660444 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=316892 CPUtime=6.25 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 535 0 0 0 623 2 0 0 25 0 8 0 661506872 324497408 2673 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 2 0 0 0

################
# More data... #
################


[startup+4662.3 s]
/proc/loadavg: 7.99 8.00 7.99 9/451 18466
/proc/meminfo: memFree=25764908/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=449596 CPUtime=37143.9 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 5562 0 0 0 3704268 10120 0 0 25 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18314/statm: 112399 5491 468 189 0 106748 0
[pid=18314/tid=18316] ppid=18312 vsize=449596 CPUtime=4642.2 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 1446 0 0 0 463176 1044 0 0 19 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=449596 CPUtime=4645.38 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 292 0 0 0 463172 1366 0 0 20 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=449596 CPUtime=4639.29 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 181 0 0 0 462585 1344 0 0 21 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660933 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=449596 CPUtime=4637.72 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 219 0 0 0 462414 1358 0 0 18 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4627186 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=449596 CPUtime=4642.88 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 184 0 0 0 462940 1348 0 0 19 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=449596 CPUtime=4639.69 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 197 0 0 0 462642 1327 0 0 20 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=449596 CPUtime=4647.32 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 1365 0 0 0 463499 1233 0 0 25 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660933 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37143.9
Current children cumulated vsize (KiB) 449596

[startup+4722.32 s]
/proc/loadavg: 8.04 8.01 8.00 9/451 18467
/proc/meminfo: memFree=25764996/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=449596 CPUtime=37622.1 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 5562 0 0 0 3751960 10251 0 0 18 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18314/statm: 112399 5491 468 189 0 106748 0
[pid=18314/tid=18316] ppid=18312 vsize=449596 CPUtime=4702.16 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 1446 0 0 0 469160 1056 0 0 18 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4668715 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=449596 CPUtime=4705.28 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 292 0 0 0 469143 1385 0 0 19 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 270612777986 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=449596 CPUtime=4698.64 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 181 0 0 0 468503 1361 0 0 19 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4669192 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=449596 CPUtime=4697.53 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 219 0 0 0 468374 1379 0 0 18 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4658520 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=449596 CPUtime=4702.49 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 184 0 0 0 468884 1365 0 0 25 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=449596 CPUtime=4699.58 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 197 0 0 0 468614 1344 0 0 18 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=449596 CPUtime=4707.15 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 1365 0 0 0 469466 1249 0 0 19 0 8 0 661506872 460386304 5491 33554432000 4194304 4964800 140736838942704 18446744073709551615 4668564 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37622.1
Current children cumulated vsize (KiB) 449596

[startup+4782.3 s]
/proc/loadavg: 8.01 8.01 8.00 9/451 18469
/proc/meminfo: memFree=25764952/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=449596 CPUtime=38100.1 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 5566 0 0 0 3799625 10389 0 0 18 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18314/statm: 112399 5495 468 189 0 106748 0
[pid=18314/tid=18316] ppid=18312 vsize=449596 CPUtime=4762.07 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 1446 0 0 0 475137 1070 0 0 19 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=449596 CPUtime=4765.14 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 292 0 0 0 475111 1403 0 0 25 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4660114 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=449596 CPUtime=4758.49 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 181 0 0 0 474470 1379 0 0 25 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4320911 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=449596 CPUtime=4757.35 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 219 0 0 0 474339 1396 0 0 19 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=449596 CPUtime=4762.05 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 184 0 0 0 474824 1381 0 0 19 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4673253 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=449596 CPUtime=4758.91 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 197 0 0 0 474529 1362 0 0 20 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4669187 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=449596 CPUtime=4766.96 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 1369 0 0 0 475427 1269 0 0 25 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38100.1
Current children cumulated vsize (KiB) 449596

[startup+4842.3 s]
/proc/loadavg: 8.08 8.03 8.01 9/451 18471
/proc/meminfo: memFree=25765044/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=449596 CPUtime=38578.3 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 5566 0 0 0 3847312 10517 0 0 22 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 270612777856 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18314/statm: 112399 5495 468 189 0 106748 0
[pid=18314/tid=18316] ppid=18312 vsize=449596 CPUtime=4822.03 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 1446 0 0 0 481119 1084 0 0 25 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4659398 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=449596 CPUtime=4825.01 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 292 0 0 0 481081 1420 0 0 18 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4653198 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=449596 CPUtime=4818.36 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 181 0 0 0 480440 1396 0 0 25 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=449596 CPUtime=4817.17 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 219 0 0 0 480304 1413 0 0 25 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4346000 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=449596 CPUtime=4821.11 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 184 0 0 0 480713 1398 0 0 22 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=449596 CPUtime=4818.78 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 197 0 0 0 480500 1378 0 0 25 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=449596 CPUtime=4826.79 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 1369 0 0 0 481394 1285 0 0 25 0 8 0 661506872 460386304 5495 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38578.3
Current children cumulated vsize (KiB) 449596

[startup+4902.3 s]
/proc/loadavg: 8.06 8.04 8.01 9/451 18472
/proc/meminfo: memFree=25764872/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=449596 CPUtime=39056.4 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 5570 0 0 0 3895001 10642 0 0 20 0 8 0 661506872 460386304 5499 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670407 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18314/statm: 112399 5499 468 189 0 106748 0
[pid=18314/tid=18316] ppid=18312 vsize=449596 CPUtime=4881.96 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 1446 0 0 0 487099 1097 0 0 19 0 8 0 661506872 460386304 5499 33554432000 4194304 4964800 140736838942704 18446744073709551615 4675467 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=449596 CPUtime=4884.32 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 292 0 0 0 486995 1437 0 0 18 0 8 0 661506872 460386304 5499 33554432000 4194304 4964800 140736838942704 18446744073709551615 4320883 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=449596 CPUtime=4877.96 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 181 0 0 0 486385 1411 0 0 21 0 8 0 661506872 460386304 5499 33554432000 4194304 4964800 140736838942704 18446744073709551615 4684110 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=449596 CPUtime=4876.97 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 219 0 0 0 486268 1429 0 0 19 0 8 0 661506872 460386304 5499 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=449596 CPUtime=4880.98 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 184 0 0 0 486683 1415 0 0 19 0 8 0 661506872 460386304 5499 33554432000 4194304 4964800 140736838942704 18446744073709551615 4342180 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=449596 CPUtime=4878.68 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 197 0 0 0 486472 1396 0 0 19 0 8 0 661506872 460386304 5499 33554432000 4194304 4964800 140736838942704 18446744073709551615 4668627 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=449596 CPUtime=4886.64 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 1369 0 0 0 487364 1300 0 0 18 0 8 0 661506872 460386304 5499 33554432000 4194304 4964800 140736838942704 18446744073709551615 4321042 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39056.4
Current children cumulated vsize (KiB) 449596

[startup+4962.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/451 18474
/proc/meminfo: memFree=25764836/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=449596 CPUtime=39534.5 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 5573 0 0 0 3942678 10775 0 0 25 0 8 0 661506872 460386304 5502 33554432000 4194304 4964800 140736838942704 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18314/statm: 112399 5502 468 189 0 106748 0
[pid=18314/tid=18316] ppid=18312 vsize=449596 CPUtime=4941.91 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 1446 0 0 0 493082 1109 0 0 22 0 8 0 661506872 460386304 5502 33554432000 4194304 4964800 140736838942704 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=449596 CPUtime=4944.18 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 292 0 0 0 492966 1452 0 0 20 0 8 0 661506872 460386304 5502 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215726 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=449596 CPUtime=4937.54 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 181 0 0 0 492323 1431 0 0 23 0 8 0 661506872 460386304 5502 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=449596 CPUtime=4936.76 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 219 0 0 0 492230 1446 0 0 18 0 8 0 661506872 460386304 5502 33554432000 4194304 4964800 140736838942704 18446744073709551615 4364704 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=449596 CPUtime=4940.34 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 184 0 0 0 492603 1431 0 0 25 0 8 0 661506872 460386304 5502 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=449596 CPUtime=4938.53 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 197 0 0 0 492437 1416 0 0 18 0 8 0 661506872 460386304 5502 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=449596 CPUtime=4946.49 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 1372 0 0 0 493332 1317 0 0 18 0 8 0 661506872 460386304 5502 33554432000 4194304 4964800 140736838942704 18446744073709551615 270613215775 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39534.5
Current children cumulated vsize (KiB) 449596



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5020.8 s]
/proc/loadavg: 8.01 8.02 8.00 9/451 18485
/proc/meminfo: memFree=25763200/32951124 swapFree=60609076/67111528
[pid=18314] ppid=18312 vsize=449596 CPUtime=40000.7 cores=0-7
/proc/18314/stat : 18314 (claspmt) R 18312 18314 17807 0 -1 4202496 5574 0 0 0 3989168 10906 0 0 23 0 8 0 661506872 460386304 5503 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670534 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18314/statm: 112399 5503 468 189 0 106748 0
[pid=18314/tid=18316] ppid=18312 vsize=449596 CPUtime=5000.36 cores=0-7
/proc/18314/task/18316/stat : 18316 (claspmt) R 18312 18314 17807 0 -1 4202560 1446 0 0 0 498915 1121 0 0 25 0 8 0 661506872 460386304 5503 33554432000 4194304 4964800 140736838942704 18446744073709551615 4683782 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18314/tid=18317] ppid=18312 vsize=449596 CPUtime=5002.08 cores=0-7
/proc/18314/task/18317/stat : 18317 (claspmt) R 18312 18314 17807 0 -1 4202560 292 0 0 0 498738 1470 0 0 19 0 8 0 661506872 460386304 5503 33554432000 4194304 4964800 140736838942704 18446744073709551615 4342199 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18314/tid=18318] ppid=18312 vsize=449596 CPUtime=4995.94 cores=0-7
/proc/18314/task/18318/stat : 18318 (claspmt) R 18312 18314 17807 0 -1 4202560 181 0 0 0 498147 1447 0 0 18 0 8 0 661506872 460386304 5503 33554432000 4194304 4964800 140736838942704 18446744073709551615 4378505 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18314/tid=18319] ppid=18312 vsize=449596 CPUtime=4995.06 cores=0-7
/proc/18314/task/18319/stat : 18319 (claspmt) R 18312 18314 17807 0 -1 4202560 219 0 0 0 498042 1464 0 0 21 0 8 0 661506872 460386304 5503 33554432000 4194304 4964800 140736838942704 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18314/tid=18320] ppid=18312 vsize=449596 CPUtime=4998.76 cores=0-7
/proc/18314/task/18320/stat : 18320 (claspmt) R 18312 18314 17807 0 -1 4202560 184 0 0 0 498429 1447 0 0 19 0 8 0 661506872 460386304 5503 33554432000 4194304 4964800 140736838942704 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18314/tid=18321] ppid=18312 vsize=449596 CPUtime=4996.53 cores=0-7
/proc/18314/task/18321/stat : 18321 (claspmt) R 18312 18314 17807 0 -1 4202560 197 0 0 0 498218 1435 0 0 18 0 8 0 661506872 460386304 5503 33554432000 4194304 4964800 140736838942704 18446744073709551615 4669095 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18314/tid=18322] ppid=18312 vsize=449596 CPUtime=5004.85 cores=0-7
/proc/18314/task/18322/stat : 18322 (claspmt) R 18312 18314 17807 0 -1 4202560 1373 0 0 0 499149 1336 0 0 18 0 8 0 661506872 460386304 5503 33554432000 4194304 4964800 140736838942704 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 449596

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 5020.83
CPU time (s): 40000.8
CPU user time (s): 39891.8
CPU system time (s): 109.069
CPU usage (%): 796.698
Max. virtual memory (cumulated for all children) (KiB): 449596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39891.8
system time used= 109.069
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5585
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16887881
involuntary context switches= 185110

runsolver used 22.0596 second user time and 50.6953 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-16 00:37:39
IDJOB=3380987
IDBENCH=83147
IDSOLVER=1865
FILE ID=node108/3380987-1305499059
RUNJOBID= node108-1305492452-17821
PBS_JOBID= 13325423
Free space on /tmp= 73504 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n120-s55656844-unsat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380987-1305499059/watcher-3380987-1305499059 -o /tmp/evaluation-result-3380987-1305499059/solver-3380987-1305499059 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380987-1305499059.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4877ca9f3fe317c84d3087c8296a2a0b
RANDOM SEED=1097240664

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25789604 kB
Buffers:          7124 kB
Cached:         193508 kB
SwapCached:      25300 kB
Active:         120356 kB
Inactive:      6847272 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25789604 kB
SwapTotal:    67111528 kB
SwapFree:     60609076 kB
Dirty:             784 kB
Writeback:           0 kB
AnonPages:     6751436 kB
Mapped:          25272 kB
Slab:            66440 kB
PageTables:      56800 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 113027536 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node108 at 2011-05-16 02:01:22