Trace number 3292947

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24UNSAT 4768.18 1193.98

General information on the benchmark

NameSAT02/industrial/goldberg/rand_net/
rand_net70-60-10.shuffled.cnf
MD5SUM6ebe2de27b5534e626cb88c01abcf6c6
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.028995
Satisfiable
(Un)Satisfiability was proved
Number of variables8400
Number of clauses25061
Sum of the clauses size58730
Maximum clause length70
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 216520
Number of clauses of size 38540
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51

Solver Data 

4767.80/1193.86	
4767.80/1193.86	s UNSATISFIABLE
4767.80/1193.86	c Import unit

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3292947-1304114804/watcher-3292947-1304114804 -o /tmp/evaluation-result-3292947-1304114804/solver-3292947-1304114804 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3292947-1304114804.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.48 7.97 7.99 2/174 19859
/proc/meminfo: memFree=21159268/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=20128 CPUtime=0 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 708 0 0 0 0 0 0 0 23 0 1 0 503896011 20611072 645 33554432000 4194304 4623224 140733729246432 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19859/statm: 5032 647 296 105 0 536 0

[startup+0.0314479 s]
/proc/loadavg: 7.48 7.97 7.99 2/174 19859
/proc/meminfo: memFree=21159268/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=252892 CPUtime=0.07 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 2352 0 0 0 7 0 0 0 24 0 4 0 503896011 258961408 1997 33554432000 4194304 4623224 140733729246432 18446744073709551615 4412464 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 63223 1997 335 105 0 58727 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 252892

[startup+0.100434 s]
/proc/loadavg: 7.48 7.97 7.99 2/174 19859
/proc/meminfo: memFree=21159268/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=252892 CPUtime=0.34 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 2527 0 0 0 34 0 0 0 24 0 4 0 503896011 258961408 2172 33554432000 4194304 4623224 140733729246432 18446744073709551615 4523592 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 63223 2172 342 105 0 58727 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 252892

[startup+0.3004 s]
/proc/loadavg: 7.48 7.97 7.99 2/174 19859
/proc/meminfo: memFree=21159268/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=255448 CPUtime=1.14 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 4923 0 0 0 113 1 0 0 25 0 4 0 503896011 261578752 3016 33554432000 4194304 4623224 140733729246432 18446744073709551615 4526860 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 63862 3016 342 105 0 59366 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 255448

[startup+0.700324 s]
/proc/loadavg: 7.48 7.97 7.99 2/174 19859
/proc/meminfo: memFree=21159268/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=257628 CPUtime=2.74 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 7322 0 0 0 273 1 0 0 25 0 4 0 503896011 263811072 4173 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 64407 4173 343 105 0 59911 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 257628

[startup+1.50117 s]
/proc/loadavg: 7.48 7.97 7.99 9/184 19932
/proc/meminfo: memFree=21117396/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=281788 CPUtime=5.93 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 23929 0 0 0 589 4 0 0 25 0 4 0 503896011 288550912 14487 33554432000 4194304 4623224 140733729246432 18446744073709551615 4388305 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 70447 14487 344 105 0 65951 0
[pid=19859/tid=19861] ppid=19857 vsize=281788 CPUtime=1.47 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 4132 0 0 0 147 0 0 0 20 0 4 0 503896013 288550912 14487 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376714 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=281788 CPUtime=1.47 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 4620 0 0 0 147 0 0 0 25 0 4 0 503896013 288550912 14487 33554432000 4194304 4623224 140733729246432 18446744073709551615 4289775 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=281788 CPUtime=1.47 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 4182 0 0 0 146 1 0 0 25 0 4 0 503896013 288550912 14487 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 281788

[startup+3.10087 s]
/proc/loadavg: 7.52 7.97 7.99 9/184 19932
/proc/meminfo: memFree=21070896/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=286680 CPUtime=12.33 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 27303 0 0 0 1228 5 0 0 25 0 4 0 503896011 293560320 15423 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510627 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 71670 15423 344 105 0 67174 0
[pid=19859/tid=19861] ppid=19857 vsize=286680 CPUtime=3.07 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 5106 0 0 0 307 0 0 0 25 0 4 0 503896013 293560320 15423 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376960 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=286680 CPUtime=3.07 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 4991 0 0 0 307 0 0 0 25 0 4 0 503896013 293560320 15423 33554432000 4194304 4623224 140733729246432 18446744073709551615 4463039 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=286680 CPUtime=3.07 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 4182 0 0 0 306 1 0 0 25 0 4 0 503896013 293560320 15423 33554432000 4194304 4623224 140733729246432 18446744073709551615 4550459 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 286680

[startup+6.30027 s]
/proc/loadavg: 7.52 7.97 7.99 9/184 19932
/proc/meminfo: memFree=21047592/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=290992 CPUtime=25.11 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 30071 0 0 0 2505 6 0 0 25 0 4 0 503896011 297975808 17378 33554432000 4194304 4623224 140733729246432 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 72748 17378 344 105 0 68252 0
[pid=19859/tid=19861] ppid=19857 vsize=290992 CPUtime=6.27 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 5337 0 0 0 627 0 0 0 25 0 4 0 503896013 297975808 17378 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=290992 CPUtime=6.28 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 6468 0 0 0 627 1 0 0 25 0 4 0 503896013 297975808 17378 33554432000 4194304 4623224 140733729246432 18446744073709551615 4289875 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=290992 CPUtime=6.25 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 4815 0 0 0 624 1 0 0 25 0 4 0 503896013 297975808 17378 33554432000 4194304 4623224 140733729246432 18446744073709551615 4577410 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 290992

[startup+12.7011 s]
/proc/loadavg: 7.67 7.99 8.00 9/184 19932
/proc/meminfo: memFree=21002740/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=305244 CPUtime=50.67 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 37691 0 0 0 5059 8 0 0 25 0 4 0 503896011 312569856 21335 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 76311 21335 344 105 0 71815 0
[pid=19859/tid=19861] ppid=19857 vsize=305244 CPUtime=12.68 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 7013 0 0 0 1267 1 0 0 25 0 4 0 503896013 312569856 21335 33554432000 4194304 4623224 140733729246432 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=305244 CPUtime=12.67 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 8646 0 0 0 1265 2 0 0 25 0 4 0 503896013 312569856 21335 33554432000 4194304 4623224 140733729246432 18446744073709551615 4377484 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=305244 CPUtime=12.61 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 6571 0 0 0 1260 1 0 0 25 0 4 0 503896013 312569856 21335 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 305244

[startup+25.5006 s]
/proc/loadavg: 7.72 7.99 8.00 9/184 19933
/proc/meminfo: memFree=20913348/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=324076 CPUtime=101.8 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 50914 0 0 0 10167 13 0 0 25 0 4 0 503896011 331853824 29877 33554432000 4194304 4623224 140733729246432 18446744073709551615 4278624 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 81019 29877 344 105 0 76523 0
[pid=19859/tid=19861] ppid=19857 vsize=324076 CPUtime=25.47 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 10198 0 0 0 2546 1 0 0 25 0 4 0 503896013 331853824 29877 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=324076 CPUtime=25.48 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 11020 0 0 0 2544 4 0 0 25 0 4 0 503896013 331853824 29877 33554432000 4194304 4623224 140733729246432 18446744073709551615 4316616 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=324076 CPUtime=25.33 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 10912 0 0 0 2531 2 0 0 25 0 4 0 503896013 331853824 29877 33554432000 4194304 4623224 140733729246432 18446744073709551615 4363853 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 324076

[startup+51.1008 s]
/proc/loadavg: 7.81 7.99 8.00 9/184 19933
/proc/meminfo: memFree=20822816/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=353768 CPUtime=204.06 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 104944 0 0 0 20377 29 0 0 25 0 4 0 503896011 362258432 45085 33554432000 4194304 4623224 140733729246432 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 88442 45085 344 105 0 83946 0
[pid=19859/tid=19861] ppid=19857 vsize=353768 CPUtime=51.07 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 16822 0 0 0 5101 6 0 0 25 0 4 0 503896013 362258432 45085 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=353768 CPUtime=51.08 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 15390 0 0 0 5102 6 0 0 25 0 4 0 503896013 362258432 45085 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=353768 CPUtime=50.8 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 46725 0 0 0 5070 10 0 0 25 0 4 0 503896013 362258432 45085 33554432000 4194304 4623224 140733729246432 18446744073709551615 4553582 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 353768

[startup+102.307 s]
/proc/loadavg: 8.00 8.01 8.00 9/184 19935
/proc/meminfo: memFree=20665560/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=394192 CPUtime=408.61 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 332456 0 0 0 40786 75 0 0 25 0 4 0 503896011 403652608 66846 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510101 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 98548 66846 346 105 0 94052 0
[pid=19859/tid=19861] ppid=19857 vsize=394192 CPUtime=102.28 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 26980 0 0 0 10219 9 0 0 25 0 4 0 503896013 403652608 66846 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=394192 CPUtime=102.28 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 19851 0 0 0 10220 8 0 0 25 0 4 0 503896013 403652608 66846 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=394192 CPUtime=101.72 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 248061 0 0 0 10126 46 0 0 25 0 4 0 503896013 403652608 66846 33554432000 4194304 4623224 140733729246432 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.61
Current children cumulated vsize (KiB) 394192

[startup+162.301 s]
/proc/loadavg: 7.79 7.97 7.99 10/184 19996
/proc/meminfo: memFree=20742744/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=599188 CPUtime=648.22 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 479350 0 0 0 64719 103 0 0 25 0 4 0 503896011 613568512 97937 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510486 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 149797 97937 344 105 0 145301 0
[pid=19859/tid=19861] ppid=19857 vsize=599188 CPUtime=162.25 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 45367 0 0 0 16212 13 0 0 25 0 4 0 503896013 613568512 97937 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=599188 CPUtime=162 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 27267 0 0 0 16190 10 0 0 25 0 4 0 503896013 613568512 97937 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=599188 CPUtime=161.66 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 326128 0 0 0 16105 61 0 0 25 0 4 0 503896013 613568512 97937 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 648.22
Current children cumulated vsize (KiB) 599188

[startup+222.3 s]
/proc/loadavg: 8.13 8.03 8.01 10/184 19998
/proc/meminfo: memFree=20481680/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=747244 CPUtime=887.9 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 795116 0 0 0 88630 160 0 0 25 0 4 0 503896011 765177856 128706 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 186811 128706 355 105 0 182315 0
[pid=19859/tid=19861] ppid=19857 vsize=747244 CPUtime=222.26 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 46280 0 0 0 22212 14 0 0 25 0 4 0 503896013 765177856 128706 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=747244 CPUtime=221.67 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 27638 0 0 0 22157 10 0 0 25 0 4 0 503896013 765177856 128706 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=747244 CPUtime=221.66 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 604836 0 0 0 22054 112 0 0 25 0 4 0 503896013 765177856 128706 33554432000 4194304 4623224 140733729246432 18446744073709551615 4364427 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.9
Current children cumulated vsize (KiB) 747244

[startup+282.301 s]

################
# More data... #
################

/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 129333 0 0 0 88182 44 0 0 25 0 4 0 503896013 2461073408 493565 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376917 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=2403392 CPUtime=878.09 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 55631 0 0 0 87786 23 0 0 25 0 4 0 503896013 2461073408 493565 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=2403392 CPUtime=881.62 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 2928769 0 0 0 87658 504 0 0 25 0 4 0 503896013 2461073408 493565 33554432000 4194304 4623224 140733729246432 18446744073709551615 4550506 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.31
Current children cumulated vsize (KiB) 2403392

[startup+942.301 s]
/proc/loadavg: 8.14 8.10 8.03 10/184 20017
/proc/meminfo: memFree=17962732/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=2488452 CPUtime=3763.99 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 4083009 0 0 0 375658 741 0 0 25 0 4 0 503896011 2548174848 512327 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 622113 512327 438 105 0 617617 0
[pid=19859/tid=19861] ppid=19857 vsize=2488452 CPUtime=942.27 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 131392 0 0 0 94182 45 0 0 25 0 4 0 503896013 2548174848 512327 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=2488452 CPUtime=937.77 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 56495 0 0 0 93753 24 0 0 25 0 4 0 503896013 2548174848 512327 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=2488452 CPUtime=941.62 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3130959 0 0 0 93625 537 0 0 25 0 4 0 503896013 2548174848 512327 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3763.99
Current children cumulated vsize (KiB) 2488452

[startup+1002.3 s]
/proc/loadavg: 8.05 8.08 8.02 10/184 20019
/proc/meminfo: memFree=17797904/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=2599520 CPUtime=4003.68 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 4240290 0 0 0 399601 767 0 0 25 0 4 0 503896011 2661908480 532223 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 649880 532223 430 105 0 645384 0
[pid=19859/tid=19861] ppid=19857 vsize=2599520 CPUtime=1002.27 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 133049 0 0 0 100181 46 0 0 25 0 4 0 503896013 2661908480 532223 33554432000 4194304 4623224 140733729246432 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=2599520 CPUtime=997.44 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 57501 0 0 0 99718 26 0 0 25 0 4 0 503896013 2661908480 532223 33554432000 4194304 4623224 140733729246432 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=2599520 CPUtime=1001.62 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3269650 0 0 0 99606 556 0 0 25 0 4 0 503896013 2661908480 532223 33554432000 4194304 4623224 140733729246432 18446744073709551615 4289794 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.68
Current children cumulated vsize (KiB) 2599520

[startup+1062.3 s]
/proc/loadavg: 8.10 8.08 8.02 9/184 20020
/proc/meminfo: memFree=17644732/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=2749200 CPUtime=4243.36 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 4386666 0 0 0 423546 790 0 0 25 0 4 0 503896011 2815180800 558769 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19859/statm: 687300 558769 347 105 0 682804 0
[pid=19859/tid=19861] ppid=19857 vsize=2749200 CPUtime=1062.27 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 134525 0 0 0 106179 48 0 0 25 0 4 0 503896013 2815180800 558769 33554432000 4194304 4623224 140733729246432 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=2749200 CPUtime=1057.12 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 58025 0 0 0 105686 26 0 0 25 0 4 0 503896013 2815180800 558769 33554432000 4194304 4623224 140733729246432 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=2749200 CPUtime=1061.62 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3344591 0 0 0 105594 568 0 0 25 0 4 0 503896013 2815180800 558769 33554432000 4194304 4623224 140733729246432 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.36
Current children cumulated vsize (KiB) 2749200

[startup+1122.3 s]
/proc/loadavg: 8.37 8.14 8.04 10/184 20025
/proc/meminfo: memFree=17469580/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=3002104 CPUtime=4482.2 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 4708409 0 0 0 447374 846 0 0 25 0 4 0 503896011 3074154496 587538 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510146 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19859/statm: 750526 587538 344 105 0 746030 0
[pid=19859/tid=19861] ppid=19857 vsize=3002104 CPUtime=1122.27 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 170957 0 0 0 112174 53 0 0 25 0 4 0 503896013 3074154496 587538 33554432000 4194304 4623224 140733729246432 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=3002104 CPUtime=1116.4 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 59093 0 0 0 111613 27 0 0 25 0 4 0 503896013 3074154496 587538 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=3002104 CPUtime=1121.62 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3594408 0 0 0 111550 612 0 0 25 0 4 0 503896013 3074154496 587538 33554432000 4194304 4623224 140733729246432 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4482.2
Current children cumulated vsize (KiB) 3002104

[startup+1182.3 s]
/proc/loadavg: 8.22 8.13 8.04 10/184 20027
/proc/meminfo: memFree=17258820/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=3056564 CPUtime=4721.87 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 5027251 0 0 0 471287 900 0 0 25 0 4 0 503896011 3129921536 635261 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19859/statm: 764141 635261 346 105 0 759645 0
[pid=19859/tid=19861] ppid=19857 vsize=3056564 CPUtime=1182.26 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 171155 0 0 0 118173 53 0 0 25 0 4 0 503896013 3129921536 635261 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=3056564 CPUtime=1176.4 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 59442 0 0 0 117613 27 0 0 25 0 4 0 503896013 3129921536 635261 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=3056564 CPUtime=1181.61 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3868244 0 0 0 117505 656 0 0 25 0 4 0 503896013 3129921536 635261 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4721.87
Current children cumulated vsize (KiB) 3056564

Solver just ended. Dumping a history of the last processes samples

[startup+1183.9 s]
/proc/loadavg: 8.20 8.13 8.04 10/184 20027
/proc/meminfo: memFree=17253488/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=3058164 CPUtime=4728.25 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 5034262 0 0 0 471924 901 0 0 25 0 4 0 503896011 3131559936 636142 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19859/statm: 764541 636142 344 105 0 760045 0
[pid=19859/tid=19861] ppid=19857 vsize=3058164 CPUtime=1183.86 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 171155 0 0 0 118333 53 0 0 25 0 4 0 503896013 3131559936 636143 33554432000 4194304 4623224 140733729246432 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=3058164 CPUtime=1178 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 59482 0 0 0 117773 27 0 0 25 0 4 0 503896013 3131559936 636143 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=3058164 CPUtime=1183.22 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3874292 0 0 0 117665 657 0 0 25 0 4 0 503896013 3131559936 636143 33554432000 4194304 4623224 140733729246432 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4728.25
Current children cumulated vsize (KiB) 3058164

[startup+1190.3 s]
/proc/loadavg: 8.18 8.13 8.04 10/184 20027
/proc/meminfo: memFree=17236360/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=3067004 CPUtime=4753.81 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 5061218 0 0 0 474477 904 0 0 25 0 4 0 503896011 3140612096 639888 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510302 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19859/statm: 766751 639888 345 105 0 762255 0
[pid=19859/tid=19861] ppid=19857 vsize=3067004 CPUtime=1190.25 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 171155 0 0 0 118972 53 0 0 25 0 4 0 503896013 3140612096 639888 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376708 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=3067004 CPUtime=1184.4 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 59521 0 0 0 118413 27 0 0 25 0 4 0 503896013 3140612096 639888 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=3067004 CPUtime=1189.62 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3898915 0 0 0 118302 660 0 0 25 0 4 0 503896013 3140612096 639888 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4753.81
Current children cumulated vsize (KiB) 3067004

[startup+1191.9 s]
/proc/loadavg: 8.18 8.13 8.04 10/184 20027
/proc/meminfo: memFree=17235864/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=3067004 CPUtime=4760.21 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 5067111 0 0 0 475116 905 0 0 25 0 4 0 503896011 3140612096 639719 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19859/statm: 766751 639719 344 105 0 762255 0
[pid=19859/tid=19861] ppid=19857 vsize=3067004 CPUtime=1191.85 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 171155 0 0 0 119132 53 0 0 25 0 4 0 503896013 3140612096 639719 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=3067004 CPUtime=1186 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 59522 0 0 0 118573 27 0 0 25 0 4 0 503896013 3140612096 639719 33554432000 4194304 4623224 140733729246432 18446744073709551615 4366460 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=3067004 CPUtime=1191.21 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3904661 0 0 0 118461 660 0 0 25 0 4 0 503896013 3140612096 639719 33554432000 4194304 4623224 140733729246432 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4760.21
Current children cumulated vsize (KiB) 3067004

[startup+1192.7 s]
/proc/loadavg: 8.17 8.12 8.04 10/184 20027
/proc/meminfo: memFree=17235368/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=3067004 CPUtime=4763.4 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 5070333 0 0 0 475435 905 0 0 25 0 4 0 503896011 3140612096 639801 33554432000 4194304 4623224 140733729246432 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19859/statm: 766751 639801 344 105 0 762255 0
[pid=19859/tid=19861] ppid=19857 vsize=3067004 CPUtime=1192.65 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 171155 0 0 0 119212 53 0 0 25 0 4 0 503896013 3140612096 639801 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376872 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=3067004 CPUtime=1186.8 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 59522 0 0 0 118653 27 0 0 25 0 4 0 503896013 3140612096 639801 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376829 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=3067004 CPUtime=1192.02 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3907808 0 0 0 118541 661 0 0 25 0 4 0 503896013 3140612096 639801 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4763.4
Current children cumulated vsize (KiB) 3067004

[startup+1193.51 s]
/proc/loadavg: 8.17 8.12 8.04 10/184 20027
/proc/meminfo: memFree=17219744/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=3075664 CPUtime=4766.62 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) R 19857 19859 19501 0 -1 4202496 5077022 0 0 0 475755 907 0 0 25 0 4 0 503896011 3149479936 644038 33554432000 4194304 4623224 140733729246432 18446744073709551615 4388116 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19859/statm: 768916 644038 344 105 0 764420 0
[pid=19859/tid=19861] ppid=19857 vsize=3075664 CPUtime=1193.46 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4202560 171155 0 0 0 119293 53 0 0 25 0 4 0 503896013 3149479936 644038 33554432000 4194304 4623224 140733729246432 18446744073709551615 4377410 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19859/tid=19862] ppid=19857 vsize=3075664 CPUtime=1187.6 cores=1,3,5,7
/proc/19859/task/19862/stat : 19862 (SArTagnan) R 19857 19859 19501 0 -1 4202560 59532 0 0 0 118733 27 0 0 25 0 4 0 503896013 3149479936 644038 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19859/tid=19863] ppid=19857 vsize=3075664 CPUtime=1192.82 cores=1,3,5,7
/proc/19859/task/19863/stat : 19863 (SArTagnan) R 19857 19859 19501 0 -1 4202560 3910447 0 0 0 118621 661 0 0 25 0 4 0 503896013 3149479936 644038 33554432000 4194304 4623224 140733729246432 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4766.62
Current children cumulated vsize (KiB) 3075664

[startup+1193.9 s]
/proc/loadavg: 8.17 8.12 8.04 10/184 20027
/proc/meminfo: memFree=17219744/32951124 swapFree=67111524/67111528
[pid=19859] ppid=19857 vsize=0 CPUtime=4768.09 cores=1,3,5,7
/proc/19859/stat : 19859 (SArTagnan) Z 19857 19859 19501 0 -1 4203548 5079558 0 0 0 475898 911 0 0 25 0 2 0 503896011 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19859/statm: 0 0 0 0 0 0 0
[pid=19859/tid=19861] ppid=19857 vsize=0 CPUtime=1193.86 cores=1,3,5,7
/proc/19859/task/19861/stat : 19861 (SArTagnan) R 19857 19859 19501 0 -1 4203588 171155 0 0 0 119329 57 0 0 25 0 2 0 503896013 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4768.09
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 1193.98
CPU time (s): 4768.18
CPU user time (s): 4758.99
CPU system time (s): 9.1916
CPU usage (%): 399.352
Max. virtual memory (cumulated for all children) (KiB): 3132816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4758.99
system time used= 9.1916
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5079558
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3102
involuntary context switches= 30911

runsolver used 1.92471 second user time and 4.5903 second system time

The end

Launcher Data 

Begin job on node141 at 2011-04-30 00:06:44
IDJOB=3292947
IDBENCH=87988
IDSOLVER=1656
FILE ID=node141/3292947-1304114804
RUNJOBID= node141-1304114804-19846
PBS_JOBID= 13170684
Free space on /tmp= 71424 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT02/industrial/goldberg/rand_net/rand_net70-60-10.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3292947-1304114804/watcher-3292947-1304114804 -o /tmp/evaluation-result-3292947-1304114804/solver-3292947-1304114804 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3292947-1304114804.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6ebe2de27b5534e626cb88c01abcf6c6
RANDOM SEED=1675233360

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21159300 kB
Buffers:       1398744 kB
Cached:        9750464 kB
SwapCached:          4 kB
Active:        3001156 kB
Inactive:      8214696 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21159300 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            1276 kB
Writeback:           0 kB
AnonPages:       66760 kB
Mapped:          14484 kB
Slab:           512176 kB
PageTables:       4884 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   190104 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71424 MiB
End job on node141 at 2011-04-30 00:26:38