Trace number 3380645

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)UNSAT 15989.5 2297.2

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UR-20-10p0.cnf
MD5SUMfaef1c850bb82ceddc7da5a4c445dd25
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1428.89
Satisfiable
(Un)Satisfiability was proved
Number of variables258781
Number of clauses1372095
Sum of the clauses size3305764
Maximum clause length10
Minimum clause length1
Number of clauses of size 113149
Number of clauses of size 2980303
Number of clauses of size 3313283
Number of clauses of size 47260
Number of clauses of size 529040
Number of clauses of size over 529060

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...486256/instance-3380645-1305486256.cnf
2.29/2.39	c Solving...
15989.37/2297.17	s UNSATISFIABLE
15989.37/2297.17	
15989.37/2297.17	c Models        : 0     
15989.37/2297.17	c Time          : 2296.487s (Solving: 2294.10s 1st Model: 0.00s Unsat: 2294.10s)
15989.37/2297.17	c CPU Time      : 15988.750s

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380645-1305486256/watcher-3380645-1305486256 -o /tmp/evaluation-result-3380645-1305486256/solver-3380645-1305486256 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380645-1305486256.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.96 7.29 7.72 1/396 27883
/proc/meminfo: memFree=14551700/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=53736 CPUtime=0 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 4080 0 0 0 0 0 0 0 21 0 1 0 738856408 55025664 4010 33554432000 4194304 4964800 140736486384736 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/27883/statm: 13434 4017 376 189 0 8308 0

[startup+0.0278931 s]
/proc/loadavg: 4.96 7.29 7.72 1/396 27883
/proc/meminfo: memFree=14551700/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=56772 CPUtime=0.01 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 9166 0 0 0 1 0 0 0 21 0 1 0 738856408 58134528 9096 33554432000 4194304 4964800 140736486384736 18446744073709551615 4680699 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/27883/statm: 14193 9125 377 189 0 9067 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 56772

[startup+0.100874 s]
/proc/loadavg: 4.96 7.29 7.72 1/396 27883
/proc/meminfo: memFree=14551700/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=81316 CPUtime=0.09 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 18362 0 0 0 7 2 0 0 21 0 1 0 738856408 83267584 15121 33554432000 4194304 4964800 140736486384736 18446744073709551615 256415052485 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/27883/statm: 20329 15123 386 189 0 15203 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 81316

[startup+0.300844 s]
/proc/loadavg: 4.96 7.29 7.72 1/396 27883
/proc/meminfo: memFree=14551700/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=112300 CPUtime=0.29 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 29030 0 0 0 26 3 0 0 22 0 1 0 738856408 114995200 22901 33554432000 4194304 4964800 140736486384736 18446744073709551615 256415052485 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/27883/statm: 28075 22902 389 189 0 22949 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 112300

[startup+0.700772 s]
/proc/loadavg: 4.96 7.29 7.72 1/396 27883
/proc/meminfo: memFree=14551700/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=168556 CPUtime=0.69 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 47252 0 0 0 64 5 0 0 23 0 1 0 738856408 172601344 36481 33554432000 4194304 4964800 140736486384736 18446744073709551615 4615428 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/27883/statm: 42139 36481 400 189 0 37013 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 168556

[startup+1.50061 s]
/proc/loadavg: 4.96 7.29 7.72 2/397 27884
/proc/meminfo: memFree=14397940/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=178812 CPUtime=1.49 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 49592 0 0 0 144 5 0 0 25 0 1 0 738856408 183103488 38821 33554432000 4194304 4964800 140736486384736 18446744073709551615 4623989 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/27883/statm: 44703 38821 404 189 0 39577 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 178812

[startup+3.10023 s]
/proc/loadavg: 4.96 7.29 7.72 2/397 27884
/proc/meminfo: memFree=14396948/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=666144 CPUtime=3.77 cores=0-7
/proc/27883/stat : 27883 (claspmt) S 27881 27883 27571 0 -1 4202496 116986 0 0 0 345 32 0 0 19 0 8 0 738856408 682131456 86844 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 166536 86844 442 189 0 160885 0
Current children cumulated CPU time (s) 3.77
Current children cumulated vsize (KiB) 666144

[startup+6.30071 s]
/proc/loadavg: 4.80 7.22 7.70 2/404 27891
/proc/meminfo: memFree=14205792/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=666144 CPUtime=6.97 cores=0-7
/proc/27883/stat : 27883 (claspmt) S 27881 27883 27571 0 -1 4202496 117125 0 0 0 665 32 0 0 19 0 8 0 738856408 682131456 86983 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 166536 86983 442 189 0 160885 0
[pid=27883/tid=27885] ppid=27881 vsize=666144 CPUtime=0.1 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) S 27881 27883 27571 0 -1 4202560 8207 0 0 0 6 4 0 0 18 0 8 0 738856647 682131456 86983 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) S 27881 27883 27571 0 -1 4202560 10469 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 86983 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=666144 CPUtime=0.12 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) S 27881 27883 27571 0 -1 4202560 10804 0 0 0 8 4 0 0 18 0 8 0 738856647 682131456 86983 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=666144 CPUtime=0.07 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) S 27881 27883 27571 0 -1 4202560 7181 0 0 0 5 2 0 0 18 0 8 0 738856647 682131456 86983 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=666144 CPUtime=3.82 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 10120 0 0 0 378 4 0 0 25 0 8 0 738856647 682131456 86983 33554432000 4194304 4964800 140736486384736 18446744073709551615 4399280 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) S 27881 27883 27571 0 -1 4202560 8306 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 86983 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=666144 CPUtime=0.15 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) S 27881 27883 27571 0 -1 4202560 11175 0 0 0 11 4 0 0 18 0 8 0 738856647 682131456 86983 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.97
Current children cumulated vsize (KiB) 666144

[startup+12.7005 s]
/proc/loadavg: 4.50 7.11 7.66 2/404 27891
/proc/meminfo: memFree=14204980/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=666144 CPUtime=13.37 cores=0-7
/proc/27883/stat : 27883 (claspmt) S 27881 27883 27571 0 -1 4202496 117208 0 0 0 1305 32 0 0 19 0 8 0 738856408 682131456 87066 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 166536 87066 442 189 0 160885 0
[pid=27883/tid=27885] ppid=27881 vsize=666144 CPUtime=0.1 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) S 27881 27883 27571 0 -1 4202560 8207 0 0 0 6 4 0 0 18 0 8 0 738856647 682131456 87066 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) S 27881 27883 27571 0 -1 4202560 10469 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 87066 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=666144 CPUtime=0.12 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) S 27881 27883 27571 0 -1 4202560 10804 0 0 0 8 4 0 0 18 0 8 0 738856647 682131456 87066 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=666144 CPUtime=0.07 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) S 27881 27883 27571 0 -1 4202560 7181 0 0 0 5 2 0 0 18 0 8 0 738856647 682131456 87066 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=666144 CPUtime=10.22 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 10203 0 0 0 1018 4 0 0 25 0 8 0 738856647 682131456 87066 33554432000 4194304 4964800 140736486384736 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) S 27881 27883 27571 0 -1 4202560 8306 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 87066 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=666144 CPUtime=0.15 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) S 27881 27883 27571 0 -1 4202560 11175 0 0 0 11 4 0 0 18 0 8 0 738856647 682131456 87066 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 13.37
Current children cumulated vsize (KiB) 666144

[startup+25.5011 s]
/proc/loadavg: 3.72 6.81 7.56 2/404 27891
/proc/meminfo: memFree=14204856/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=666144 CPUtime=26.17 cores=0-7
/proc/27883/stat : 27883 (claspmt) S 27881 27883 27571 0 -1 4202496 117378 0 0 0 2585 32 0 0 19 0 8 0 738856408 682131456 87236 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 166536 87236 442 189 0 160885 0
[pid=27883/tid=27885] ppid=27881 vsize=666144 CPUtime=0.1 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) S 27881 27883 27571 0 -1 4202560 8207 0 0 0 6 4 0 0 18 0 8 0 738856647 682131456 87236 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) S 27881 27883 27571 0 -1 4202560 10469 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 87236 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=666144 CPUtime=0.12 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) S 27881 27883 27571 0 -1 4202560 10804 0 0 0 8 4 0 0 18 0 8 0 738856647 682131456 87236 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=666144 CPUtime=0.07 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) S 27881 27883 27571 0 -1 4202560 7181 0 0 0 5 2 0 0 18 0 8 0 738856647 682131456 87236 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=666144 CPUtime=23.02 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 10373 0 0 0 2298 4 0 0 25 0 8 0 738856647 682131456 87236 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) S 27881 27883 27571 0 -1 4202560 8306 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 87236 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=666144 CPUtime=0.15 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) S 27881 27883 27571 0 -1 4202560 11175 0 0 0 11 4 0 0 18 0 8 0 738856647 682131456 87236 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 26.17
Current children cumulated vsize (KiB) 666144

[startup+51.1012 s]
/proc/loadavg: 2.79 6.34 7.38 2/404 27892
/proc/meminfo: memFree=14203872/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=666144 CPUtime=51.77 cores=0-7
/proc/27883/stat : 27883 (claspmt) S 27881 27883 27571 0 -1 4202496 117537 0 0 0 5145 32 0 0 19 0 8 0 738856408 682131456 87395 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 166536 87395 442 189 0 160885 0
[pid=27883/tid=27885] ppid=27881 vsize=666144 CPUtime=0.1 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) S 27881 27883 27571 0 -1 4202560 8207 0 0 0 6 4 0 0 18 0 8 0 738856647 682131456 87395 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) S 27881 27883 27571 0 -1 4202560 10469 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 87395 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=666144 CPUtime=0.12 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) S 27881 27883 27571 0 -1 4202560 10804 0 0 0 8 4 0 0 18 0 8 0 738856647 682131456 87395 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=666144 CPUtime=0.07 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) S 27881 27883 27571 0 -1 4202560 7181 0 0 0 5 2 0 0 18 0 8 0 738856647 682131456 87395 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=666144 CPUtime=48.62 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 10532 0 0 0 4858 4 0 0 25 0 8 0 738856647 682131456 87395 33554432000 4194304 4964800 140736486384736 18446744073709551615 4669140 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) S 27881 27883 27571 0 -1 4202560 8306 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 87395 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=666144 CPUtime=0.15 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) S 27881 27883 27571 0 -1 4202560 11175 0 0 0 11 4 0 0 18 0 8 0 738856647 682131456 87395 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 51.77
Current children cumulated vsize (KiB) 666144

[startup+102.316 s]
/proc/loadavg: 1.78 5.52 7.04 2/404 27893
/proc/meminfo: memFree=14201776/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=666144 CPUtime=102.99 cores=0-7
/proc/27883/stat : 27883 (claspmt) S 27881 27883 27571 0 -1 4202496 117968 0 0 0 10266 33 0 0 19 0 8 0 738856408 682131456 87826 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 166536 87826 442 189 0 160885 0
[pid=27883/tid=27885] ppid=27881 vsize=666144 CPUtime=0.1 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) S 27881 27883 27571 0 -1 4202560 8207 0 0 0 6 4 0 0 18 0 8 0 738856647 682131456 87826 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) S 27881 27883 27571 0 -1 4202560 10469 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 87826 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=666144 CPUtime=0.12 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) S 27881 27883 27571 0 -1 4202560 10804 0 0 0 8 4 0 0 18 0 8 0 738856647 682131456 87826 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=666144 CPUtime=0.07 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) S 27881 27883 27571 0 -1 4202560 7181 0 0 0 5 2 0 0 18 0 8 0 738856647 682131456 87826 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=666144 CPUtime=99.83 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 10963 0 0 0 9979 4 0 0 25 0 8 0 738856647 682131456 87826 33554432000 4194304 4964800 140736486384736 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=666144 CPUtime=0.13 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) S 27881 27883 27571 0 -1 4202560 8306 0 0 0 10 3 0 0 18 0 8 0 738856647 682131456 87826 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=666144 CPUtime=0.15 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) S 27881 27883 27571 0 -1 4202560 11175 0 0 0 11 4 0 0 18 0 8 0 738856647 682131456 87826 33554432000 4194304 4964800 140736486384736 18446744073709551615 256427207577 0 0 4096 18946 18446604442867259328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 102.99
Current children cumulated vsize (KiB) 666144

[startup+162.301 s]
/proc/loadavg: 1.28 4.69 6.66 2/404 27895
/proc/meminfo: memFree=14200248/32950928 swapFree=67111200/67111528

################
# More data... #
################

[pid=27883/tid=27887] ppid=27881 vsize=3891836 CPUtime=1866.17 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) R 27881 27883 27571 0 -1 4202560 60678 0 0 0 186543 74 0 0 25 0 8 0 738856647 3985240064 927866 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=3891836 CPUtime=1865.06 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) R 27881 27883 27571 0 -1 4202560 139710 0 0 0 186367 139 0 0 25 0 8 0 738856647 3985240064 927866 33554432000 4194304 4964800 140736486384736 18446744073709551615 4660157 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=3891836 CPUtime=2199.67 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 11453 0 0 0 219962 5 0 0 25 0 8 0 738856647 3985240064 927866 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=3891836 CPUtime=1866.15 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) R 27881 27883 27571 0 -1 4202560 36182 0 0 0 186569 46 0 0 25 0 8 0 738856647 3985240064 927866 33554432000 4194304 4964800 140736486384736 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=3891836 CPUtime=1866.21 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) R 27881 27883 27571 0 -1 4202560 329962 0 0 0 186334 287 0 0 25 0 8 0 738856647 3985240064 927866 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670371 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15238.8
Current children cumulated vsize (KiB) 3891836

[startup+2262.3 s]
/proc/loadavg: 8.03 8.05 7.73 9/404 27954
/proc/meminfo: memFree=10835956/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=3891836 CPUtime=15718 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 958017 0 0 0 1570843 955 0 0 25 0 8 0 738856408 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 972959 927868 466 189 0 967308 0
[pid=27883/tid=27885] ppid=27881 vsize=3891836 CPUtime=1926.16 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) R 27881 27883 27571 0 -1 4202560 44929 0 0 0 192548 68 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4668763 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=3891836 CPUtime=1926.18 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) R 27881 27883 27571 0 -1 4202560 253525 0 0 0 192341 277 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670496 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=3891836 CPUtime=1926.17 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) R 27881 27883 27571 0 -1 4202560 60679 0 0 0 192543 74 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=3891836 CPUtime=1925.05 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) R 27881 27883 27571 0 -1 4202560 139711 0 0 0 192366 139 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4647774 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=3891836 CPUtime=2259.67 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 11453 0 0 0 225962 5 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=3891836 CPUtime=1926.14 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) R 27881 27883 27571 0 -1 4202560 36182 0 0 0 192568 46 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 256415050456 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=3891836 CPUtime=1926.22 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) R 27881 27883 27571 0 -1 4202560 329962 0 0 0 192335 287 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15718
Current children cumulated vsize (KiB) 3891836

Solver just ended. Dumping a history of the last processes samples

[startup+2278.3 s]
/proc/loadavg: 8.08 8.06 7.74 9/404 27954
/proc/meminfo: memFree=10835940/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=3891836 CPUtime=15845.8 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 958017 0 0 0 1583620 955 0 0 25 0 8 0 738856408 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 972959 927868 466 189 0 967308 0
[pid=27883/tid=27885] ppid=27881 vsize=3891836 CPUtime=1942.16 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) R 27881 27883 27571 0 -1 4202560 44929 0 0 0 194148 68 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=3891836 CPUtime=1942.18 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) R 27881 27883 27571 0 -1 4202560 253525 0 0 0 193941 277 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=3891836 CPUtime=1942.17 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) R 27881 27883 27571 0 -1 4202560 60679 0 0 0 194143 74 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=3891836 CPUtime=1941.04 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) R 27881 27883 27571 0 -1 4202560 139711 0 0 0 193965 139 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=3891836 CPUtime=2275.67 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 11453 0 0 0 227562 5 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4399339 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=3891836 CPUtime=1942.14 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) R 27881 27883 27571 0 -1 4202560 36182 0 0 0 194168 46 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=3891836 CPUtime=1942.22 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) R 27881 27883 27571 0 -1 4202560 329962 0 0 0 193935 287 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15845.8
Current children cumulated vsize (KiB) 3891836

[startup+2284.72 s]
/proc/loadavg: 8.07 8.06 7.74 9/404 27954
/proc/meminfo: memFree=10835936/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=3891836 CPUtime=15897 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 958017 0 0 0 1588743 955 0 0 25 0 8 0 738856408 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4669011 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 972959 927868 466 189 0 967308 0
[pid=27883/tid=27885] ppid=27881 vsize=3891836 CPUtime=1948.58 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) R 27881 27883 27571 0 -1 4202560 44929 0 0 0 194790 68 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=3891836 CPUtime=1948.6 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) R 27881 27883 27571 0 -1 4202560 253525 0 0 0 194583 277 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670678 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=3891836 CPUtime=1948.58 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) R 27881 27883 27571 0 -1 4202560 60679 0 0 0 194784 74 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4660419 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=3891836 CPUtime=1947.46 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) R 27881 27883 27571 0 -1 4202560 139711 0 0 0 194607 139 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=3891836 CPUtime=2282.08 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 11453 0 0 0 228203 5 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=3891836 CPUtime=1948.56 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) R 27881 27883 27571 0 -1 4202560 36182 0 0 0 194810 46 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4627252 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=3891836 CPUtime=1948.63 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) R 27881 27883 27571 0 -1 4202560 329962 0 0 0 194576 287 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15897
Current children cumulated vsize (KiB) 3891836

[startup+2291.1 s]
/proc/loadavg: 8.07 8.06 7.74 9/404 27955
/proc/meminfo: memFree=10835936/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=3891836 CPUtime=15948 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 958017 0 0 0 1593843 955 0 0 25 0 8 0 738856408 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 972959 927868 466 189 0 967308 0
[pid=27883/tid=27885] ppid=27881 vsize=3891836 CPUtime=1954.96 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) R 27881 27883 27571 0 -1 4202560 44929 0 0 0 195428 68 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=3891836 CPUtime=1954.98 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) R 27881 27883 27571 0 -1 4202560 253525 0 0 0 195221 277 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=3891836 CPUtime=1954.97 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) R 27881 27883 27571 0 -1 4202560 60679 0 0 0 195423 74 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=3891836 CPUtime=1953.84 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) R 27881 27883 27571 0 -1 4202560 139711 0 0 0 195245 139 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4342213 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=3891836 CPUtime=2288.47 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 11453 0 0 0 228842 5 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4678036 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=3891836 CPUtime=1954.94 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) R 27881 27883 27571 0 -1 4202560 36182 0 0 0 195448 46 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=3891836 CPUtime=1955.02 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) R 27881 27883 27571 0 -1 4202560 329962 0 0 0 195215 287 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15948
Current children cumulated vsize (KiB) 3891836

[startup+2294.3 s]
/proc/loadavg: 8.06 8.06 7.74 9/404 27955
/proc/meminfo: memFree=10835936/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=3891836 CPUtime=15973.5 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 958017 0 0 0 1596390 956 0 0 25 0 8 0 738856408 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4668900 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 972959 927868 466 189 0 967308 0
[pid=27883/tid=27885] ppid=27881 vsize=3891836 CPUtime=1958.16 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) R 27881 27883 27571 0 -1 4202560 44929 0 0 0 195748 68 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=3891836 CPUtime=1958.17 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) R 27881 27883 27571 0 -1 4202560 253525 0 0 0 195540 277 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4363545 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=3891836 CPUtime=1958.15 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) R 27881 27883 27571 0 -1 4202560 60679 0 0 0 195741 74 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4363327 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=3891836 CPUtime=1957 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) R 27881 27883 27571 0 -1 4202560 139711 0 0 0 195561 139 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4313818 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=3891836 CPUtime=2291.67 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 11453 0 0 0 229162 5 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=3891836 CPUtime=1958.13 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) R 27881 27883 27571 0 -1 4202560 36182 0 0 0 195767 46 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=3891836 CPUtime=1958.22 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) R 27881 27883 27571 0 -1 4202560 329962 0 0 0 195535 287 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4668585 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15973.5
Current children cumulated vsize (KiB) 3891836

[startup+2295.9 s]
/proc/loadavg: 8.06 8.06 7.74 9/404 27955
/proc/meminfo: memFree=10835812/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=3891836 CPUtime=15986.2 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 958017 0 0 0 1597659 956 0 0 25 0 8 0 738856408 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4684054 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/27883/statm: 972959 927868 466 189 0 967308 0
[pid=27883/tid=27885] ppid=27881 vsize=3891836 CPUtime=1959.76 cores=0-7
/proc/27883/task/27885/stat : 27885 (claspmt) R 27881 27883 27571 0 -1 4202560 44929 0 0 0 195908 68 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27883/tid=27886] ppid=27881 vsize=3891836 CPUtime=1959.77 cores=0-7
/proc/27883/task/27886/stat : 27886 (claspmt) R 27881 27883 27571 0 -1 4202560 253525 0 0 0 195700 277 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4313804 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27883/tid=27887] ppid=27881 vsize=3891836 CPUtime=1959.74 cores=0-7
/proc/27883/task/27887/stat : 27887 (claspmt) R 27881 27883 27571 0 -1 4202560 60679 0 0 0 195900 74 0 0 18 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4313792 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27883/tid=27888] ppid=27881 vsize=3891836 CPUtime=1958.57 cores=0-7
/proc/27883/task/27888/stat : 27888 (claspmt) R 27881 27883 27571 0 -1 4202560 139711 0 0 0 195718 139 0 0 18 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4313804 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27883/tid=27889] ppid=27881 vsize=3891836 CPUtime=2293.27 cores=0-7
/proc/27883/task/27889/stat : 27889 (claspmt) R 27881 27883 27571 0 -1 4202560 11453 0 0 0 229322 5 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27883/tid=27890] ppid=27881 vsize=3891836 CPUtime=1959.69 cores=0-7
/proc/27883/task/27890/stat : 27890 (claspmt) R 27881 27883 27571 0 -1 4202560 36182 0 0 0 195923 46 0 0 17 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 256415496735 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27883/tid=27891] ppid=27881 vsize=3891836 CPUtime=1959.81 cores=0-7
/proc/27883/task/27891/stat : 27891 (claspmt) R 27881 27883 27571 0 -1 4202560 329962 0 0 0 195694 287 0 0 25 0 8 0 738856647 3985240064 927868 33554432000 4194304 4964800 140736486384736 18446744073709551615 4313736 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15986.1
Current children cumulated vsize (KiB) 3891836

[startup+2296.7 s]
/proc/loadavg: 8.06 8.06 7.74 2/397 27955
/proc/meminfo: memFree=10867980/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=3859232 CPUtime=15989 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 958027 0 0 0 1597939 960 0 0 16 0 1 0 738856408 3951853568 919727 33554432000 4194304 4964800 140736486384736 18446744073709551615 256415047009 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/27883/statm: 964808 919727 476 189 0 959157 0
Current children cumulated CPU time (s) 15989
Current children cumulated vsize (KiB) 3859232

[startup+2297.1 s]
/proc/loadavg: 8.06 8.06 7.74 2/397 27955
/proc/meminfo: memFree=10867980/32950928 swapFree=67111200/67111528
[pid=27883] ppid=27881 vsize=2155296 CPUtime=15989.4 cores=0-7
/proc/27883/stat : 27883 (claspmt) R 27881 27883 27571 0 -1 4202496 958027 0 0 0 1597969 968 0 0 16 0 1 0 738856408 2207023104 473431 33554432000 4194304 4964800 140736486384736 18446744073709551615 256415434887 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/27883/statm: 538824 473431 476 189 0 533173 0
Current children cumulated CPU time (s) 15989.4
Current children cumulated vsize (KiB) 2155296

Child status: 20
Real time (s): 2297.2
CPU time (s): 15989.5
CPU user time (s): 15979.7
CPU system time (s): 9.78051
CPU usage (%): 696.043
Max. virtual memory (cumulated for all children) (KiB): 3891836

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 15979.7
system time used= 9.78051
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 958028
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 28431
involuntary context switches= 71881

runsolver used 8.5447 second user time and 22.4606 second system time

The end

Launcher Data 

Begin job on node115 at 2011-05-15 21:04:17
IDJOB=3380645
IDBENCH=71036
IDSOLVER=1865
FILE ID=node115/3380645-1305486256
RUNJOBID= node115-1305481205-27585
PBS_JOBID= 13325365
Free space on /tmp= 73220 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UR-20-10p0.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380645-1305486256/watcher-3380645-1305486256 -o /tmp/evaluation-result-3380645-1305486256/solver-3380645-1305486256 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380645-1305486256.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= faef1c850bb82ceddc7da5a4c445dd25
RANDOM SEED=215151353

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14552104 kB
Buffers:        272568 kB
Cached:        3140088 kB
SwapCached:          0 kB
Active:       14961596 kB
Inactive:      3112640 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14552104 kB
SwapTotal:    67111528 kB
SwapFree:     67111200 kB
Dirty:           26948 kB
Writeback:           0 kB
AnonPages:    14661436 kB
Mapped:          33816 kB
Slab:           199820 kB
PageTables:      56788 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 100270160 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73220 MiB
End job on node115 at 2011-05-15 21:42:35