Trace number 3438786

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001.2 5012.32

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-17x30.cnf
MD5SUM3a506c7557d86d0d326e3b3cdee85b69
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2040
Number of clauses240210
Sum of the clauses size954720
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23060
Number of clauses of size 30
Number of clauses of size 4237150
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438786-1306923212/watcher-3438786-1306923212 -o /tmp/evaluation-result-3438786-1306923212/solver-3438786-1306923212 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438786-1306923212.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.41 7.94 7.96 1/507 25413
/proc/meminfo: memFree=22479932/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=26988 CPUtime=0.01 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 1860 0 0 0 1 0 0 0 25 0 1 0 784736799 27635712 1156 33554432000 4194304 4625164 140735561358656 18446744073709551615 264726065861 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/25413/statm: 6747 1157 296 106 0 2250 0

[startup+0.0209739 s]
/proc/loadavg: 7.41 7.94 7.96 1/507 25413
/proc/meminfo: memFree=22479932/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=27448 CPUtime=0.01 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 2124 0 0 0 1 0 0 0 25 0 1 0 784736799 28106752 1255 33554432000 4194304 4625164 140735561358656 18446744073709551615 264726065861 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/25413/statm: 6862 1257 296 106 0 2365 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 27448

[startup+0.100952 s]
/proc/loadavg: 7.41 7.94 7.96 1/507 25413
/proc/meminfo: memFree=22479932/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=40380 CPUtime=0.09 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 9577 0 0 0 8 1 0 0 25 0 1 0 784736799 41349120 4714 33554432000 4194304 4625164 140735561358656 18446744073709551615 264726023658 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/25413/statm: 10095 4715 296 106 0 5598 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 40380

[startup+0.330223 s]
/proc/loadavg: 7.41 7.94 7.96 1/507 25413
/proc/meminfo: memFree=22479932/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=507428 CPUtime=1.17 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 38097 0 0 0 112 5 0 0 18 0 8 0 784736799 519606272 30734 33554432000 4194304 4625164 140735561358656 18446744073709551615 4393038 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 126857 30734 343 106 0 122360 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 507428

[startup+1.31767 s]
/proc/loadavg: 7.41 7.94 7.96 1/507 25413
/proc/meminfo: memFree=22479932/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=584164 CPUtime=8.94 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 64111 0 0 0 883 11 0 0 19 0 8 0 784736799 598183936 43638 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 146041 43638 345 106 0 141544 0
Current children cumulated CPU time (s) 8.94
Current children cumulated vsize (KiB) 584164

[startup+1.51763 s]
/proc/loadavg: 7.41 7.94 7.96 1/507 25413
/proc/meminfo: memFree=22479932/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=595572 CPUtime=10.53 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 74749 0 0 0 1041 12 0 0 19 0 8 0 784736799 609865728 45952 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 148893 45977 345 106 0 144396 0
Current children cumulated CPU time (s) 10.53
Current children cumulated vsize (KiB) 595572

[startup+3.10033 s]
/proc/loadavg: 7.46 7.94 7.96 9/515 25422
/proc/meminfo: memFree=22248368/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=603184 CPUtime=23.15 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 113234 0 0 0 2296 19 0 0 23 0 8 0 784736799 617660416 59682 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 150796 59682 345 106 0 146299 0
[pid=25413/tid=25415] ppid=25411 vsize=603184 CPUtime=2.9 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 4896 0 0 0 290 0 0 0 23 0 8 0 784736816 617660416 59682 33554432000 4194304 4625164 140735561358656 18446744073709551615 4352731 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=603184 CPUtime=2.87 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 5326 0 0 0 287 0 0 0 23 0 8 0 784736816 617660416 59682 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=603184 CPUtime=2.72 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 52390 0 0 0 265 7 0 0 23 0 8 0 784736816 617660416 59682 33554432000 4194304 4625164 140735561358656 18446744073709551615 4552608 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=603184 CPUtime=2.9 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 4747 0 0 0 289 1 0 0 23 0 8 0 784736817 617660416 59682 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=603184 CPUtime=2.87 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 5607 0 0 0 286 1 0 0 23 0 8 0 784736817 617660416 59682 33554432000 4194304 4625164 140735561358656 18446744073709551615 4437680 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=603184 CPUtime=2.9 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 5041 0 0 0 289 1 0 0 23 0 8 0 784736817 617660416 59682 33554432000 4194304 4625164 140735561358656 18446744073709551615 4352812 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=603184 CPUtime=2.86 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 4631 0 0 0 285 1 0 0 23 0 8 0 784736817 617660416 59682 33554432000 4194304 4625164 140735561358656 18446744073709551615 4339541 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.15
Current children cumulated vsize (KiB) 603184

[startup+6.31973 s]
/proc/loadavg: 7.46 7.94 7.96 9/515 25423
/proc/meminfo: memFree=22143216/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=625568 CPUtime=48.85 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 204335 0 0 0 4851 34 0 0 25 0 8 0 784736799 640581632 84574 33554432000 4194304 4625164 140735561358656 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 156392 84574 348 106 0 151895 0
[pid=25413/tid=25415] ppid=25411 vsize=625568 CPUtime=6.12 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 9175 0 0 0 611 1 0 0 25 0 8 0 784736816 640581632 84574 33554432000 4194304 4625164 140735561358656 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=625568 CPUtime=6.1 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 10594 0 0 0 609 1 0 0 25 0 8 0 784736816 640581632 84574 33554432000 4194304 4625164 140735561358656 18446744073709551615 4339559 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=625568 CPUtime=5.94 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 115079 0 0 0 578 16 0 0 25 0 8 0 784736816 640581632 84574 33554432000 4194304 4625164 140735561358656 18446744073709551615 4552367 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=625568 CPUtime=6.12 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 5962 0 0 0 610 2 0 0 25 0 8 0 784736817 640581632 84574 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=625568 CPUtime=6.09 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 10418 0 0 0 607 2 0 0 25 0 8 0 784736817 640581632 84574 33554432000 4194304 4625164 140735561358656 18446744073709551615 4348864 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=625568 CPUtime=6.12 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 9714 0 0 0 610 2 0 0 25 0 8 0 784736817 640581632 84574 33554432000 4194304 4625164 140735561358656 18446744073709551615 4327764 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=625568 CPUtime=6.03 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 8751 0 0 0 601 2 0 0 25 0 8 0 784736817 640581632 84574 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 48.85
Current children cumulated vsize (KiB) 625568

[startup+12.7005 s]
/proc/loadavg: 7.50 7.94 7.96 9/515 25423
/proc/meminfo: memFree=21991016/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=795336 CPUtime=99.81 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 351262 0 0 0 9923 58 0 0 25 0 8 0 784736799 814424064 127545 33554432000 4194304 4625164 140735561358656 18446744073709551615 4396706 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 198834 127547 348 106 0 194337 0
[pid=25413/tid=25415] ppid=25411 vsize=795336 CPUtime=12.51 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 11299 0 0 0 1249 2 0 0 25 0 8 0 784736816 814424064 127548 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=795336 CPUtime=12.48 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 14174 0 0 0 1246 2 0 0 25 0 8 0 784736816 814424064 127549 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=795336 CPUtime=12.32 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 230406 0 0 0 1199 33 0 0 25 0 8 0 784736816 814424064 127549 33554432000 4194304 4625164 140735561358656 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=795336 CPUtime=12.5 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 15978 0 0 0 1247 3 0 0 25 0 8 0 784736817 814424064 127551 33554432000 4194304 4625164 140735561358656 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=795336 CPUtime=12.47 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 13712 0 0 0 1244 3 0 0 25 0 8 0 784736817 814424064 127551 33554432000 4194304 4625164 140735561358656 18446744073709551615 4349129 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=795336 CPUtime=12.5 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 17489 0 0 0 1246 4 0 0 25 0 8 0 784736817 814424064 127553 33554432000 4194304 4625164 140735561358656 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=795336 CPUtime=12.31 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 10591 0 0 0 1229 2 0 0 25 0 8 0 784736817 814424064 127553 33554432000 4194304 4625164 140735561358656 18446744073709551615 4339581 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 99.81
Current children cumulated vsize (KiB) 795336

[startup+25.5011 s]
/proc/loadavg: 7.68 7.96 7.96 9/515 25423
/proc/meminfo: memFree=21711892/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=1139572 CPUtime=201.98 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 648855 0 0 0 20096 102 0 0 25 0 8 0 784736799 1166921728 193817 33554432000 4194304 4625164 140735561358656 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 284893 193817 349 106 0 280396 0
[pid=25413/tid=25415] ppid=25411 vsize=1139572 CPUtime=25.3 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 19852 0 0 0 2527 3 0 0 25 0 8 0 784736816 1166921728 193817 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=1139572 CPUtime=25.28 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 25387 0 0 0 2524 4 0 0 25 0 8 0 784736816 1166921728 193817 33554432000 4194304 4625164 140735561358656 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=1139572 CPUtime=25.13 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 454817 0 0 0 2450 63 0 0 25 0 8 0 784736816 1166921728 193817 33554432000 4194304 4625164 140735561358656 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=1139572 CPUtime=25.3 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 27319 0 0 0 2525 5 0 0 25 0 8 0 784736817 1166921728 193817 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=1139572 CPUtime=25.27 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 22393 0 0 0 2522 5 0 0 25 0 8 0 784736817 1166921728 193817 33554432000 4194304 4625164 140735561358656 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=1139572 CPUtime=25.3 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 30060 0 0 0 2523 7 0 0 25 0 8 0 784736817 1166921728 193817 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=1139572 CPUtime=24.88 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 26944 0 0 0 2483 5 0 0 25 0 8 0 784736817 1166921728 193817 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 201.98
Current children cumulated vsize (KiB) 1139572

[startup+51.1013 s]
/proc/loadavg: 7.79 7.97 7.96 9/515 25424
/proc/meminfo: memFree=21298148/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=1554168 CPUtime=406.33 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 1129640 0 0 0 40455 178 0 0 25 0 8 0 784736799 1591468032 298402 33554432000 4194304 4625164 140735561358656 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 388542 298402 348 106 0 384045 0
[pid=25413/tid=25415] ppid=25411 vsize=1554168 CPUtime=50.91 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 43319 0 0 0 5083 8 0 0 25 0 8 0 784736816 1591468032 298402 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=1554168 CPUtime=50.87 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 40278 0 0 0 5079 8 0 0 25 0 8 0 784736816 1591468032 298402 33554432000 4194304 4625164 140735561358656 18446744073709551615 264726066209 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=1554168 CPUtime=50.72 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 832769 0 0 0 4955 117 0 0 25 0 8 0 784736816 1591468032 298402 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=1554168 CPUtime=50.9 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 30746 0 0 0 5084 6 0 0 25 0 8 0 784736817 1591468032 298402 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=1554168 CPUtime=50.87 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 37671 0 0 0 5079 8 0 0 25 0 8 0 784736817 1591468032 298402 33554432000 4194304 4625164 140735561358656 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=1554168 CPUtime=50.89 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 46861 0 0 0 5079 10 0 0 25 0 8 0 784736817 1591468032 298402 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=1554168 CPUtime=50.04 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 43744 0 0 0 4995 9 0 0 25 0 8 0 784736817 1591468032 298402 33554432000 4194304 4625164 140735561358656 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 406.33
Current children cumulated vsize (KiB) 1554168

[startup+102.301 s]
/proc/loadavg: 7.91 7.97 7.96 9/515 25425
/proc/meminfo: memFree=20619328/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=2327152 CPUtime=815.01 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 1846393 0 0 0 81206 295 0 0 25 0 8 0 784736799 2383003648 466999 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 581788 466999 351 106 0 577291 0
[pid=25413/tid=25415] ppid=25411 vsize=2327152 CPUtime=102.1 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 67203 0 0 0 10198 12 0 0 25 0 8 0 784736816 2383003648 466999 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=2327152 CPUtime=102.06 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 64450 0 0 0 10193 13 0 0 25 0 8 0 784736816 2383003648 466999 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=2327152 CPUtime=101.91 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 1345442 0 0 0 9999 192 0 0 25 0 8 0 784736816 2383003648 466999 33554432000 4194304 4625164 140735561358656 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0

################
# More data... #
################

/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 209443 0 0 0 457541 64 0 0 25 0 8 0 784736817 8673824768 1874701 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37210.3
Current children cumulated vsize (KiB) 8470532

[startup+4722.3 s]
/proc/loadavg: 8.06 8.09 8.09 9/515 25563
/proc/meminfo: memFree=14937840/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=8470532 CPUtime=37689.2 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 25640283 0 0 0 3764164 4752 0 0 25 0 8 0 784736799 8673824768 1881857 33554432000 4194304 4625164 140735561358656 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 2117633 1881857 358 106 0 2113136 0
[pid=25413/tid=25415] ppid=25411 vsize=8470532 CPUtime=4722.26 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 213641 0 0 0 472155 71 0 0 25 0 8 0 784736816 8673824768 1881857 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=8470532 CPUtime=4720.93 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 107073 0 0 0 472067 26 0 0 25 0 8 0 784736816 8673824768 1881857 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=8470532 CPUtime=4721.85 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 21638493 0 0 0 468436 3749 0 0 25 0 8 0 784736816 8673824768 1881857 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=8470532 CPUtime=4722.24 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 378432 0 0 0 472081 143 0 0 25 0 8 0 784736817 8673824768 1881857 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330825 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=8470532 CPUtime=4722.22 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 105840 0 0 0 472194 28 0 0 25 0 8 0 784736817 8673824768 1881857 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=8470532 CPUtime=4722.26 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 193548 0 0 0 472166 60 0 0 25 0 8 0 784736817 8673824768 1881857 33554432000 4194304 4625164 140735561358656 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=8470532 CPUtime=4634.95 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 209488 0 0 0 463431 64 0 0 25 0 8 0 784736817 8673824768 1881857 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37689.2
Current children cumulated vsize (KiB) 8470532

[startup+4782.3 s]
/proc/loadavg: 8.16 8.11 8.09 9/515 25565
/proc/meminfo: memFree=14917340/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=8536068 CPUtime=38168.1 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 25963551 0 0 0 3811992 4816 0 0 25 0 8 0 784736799 8740933632 1887610 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329142 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 2134017 1887610 353 106 0 2129520 0
[pid=25413/tid=25415] ppid=25411 vsize=8536068 CPUtime=4782.26 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 213667 0 0 0 478155 71 0 0 25 0 8 0 784736816 8740933632 1887610 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=8536068 CPUtime=4780.91 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 107114 0 0 0 478064 27 0 0 25 0 8 0 784736816 8740933632 1887610 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=8536068 CPUtime=4781.84 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 21884644 0 0 0 474394 3790 0 0 25 0 8 0 784736816 8740933632 1887610 33554432000 4194304 4625164 140735561358656 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=8536068 CPUtime=4782.24 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 378465 0 0 0 478081 143 0 0 25 0 8 0 784736817 8740933632 1887610 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=8536068 CPUtime=4782.23 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 105887 0 0 0 478195 28 0 0 25 0 8 0 784736817 8740933632 1887610 33554432000 4194304 4625164 140735561358656 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=8536068 CPUtime=4782.26 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 193569 0 0 0 478166 60 0 0 25 0 8 0 784736817 8740933632 1887610 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=8536068 CPUtime=4693.88 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 209532 0 0 0 469323 65 0 0 25 0 8 0 784736817 8740933632 1887610 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38168.1
Current children cumulated vsize (KiB) 8536068

[startup+4842.3 s]
/proc/loadavg: 8.09 8.10 8.09 9/515 25567
/proc/meminfo: memFree=14890120/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=8536068 CPUtime=38647 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 26253586 0 0 0 3859823 4874 0 0 25 0 8 0 784736799 8740933632 1892521 33554432000 4194304 4625164 140735561358656 18446744073709551615 4512012 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 2134017 1892521 352 106 0 2129520 0
[pid=25413/tid=25415] ppid=25411 vsize=8536068 CPUtime=4842.26 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 213698 0 0 0 484155 71 0 0 25 0 8 0 784736816 8740933632 1892521 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330814 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=8536068 CPUtime=4840.9 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 107175 0 0 0 484063 27 0 0 25 0 8 0 784736816 8740933632 1892521 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=8536068 CPUtime=4841.84 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 22093289 0 0 0 480355 3829 0 0 25 0 8 0 784736816 8740933632 1892521 33554432000 4194304 4625164 140735561358656 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=8536068 CPUtime=4842.25 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 378492 0 0 0 484081 144 0 0 25 0 8 0 784736817 8740933632 1892521 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=8536068 CPUtime=4842.23 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 105923 0 0 0 484195 28 0 0 25 0 8 0 784736817 8740933632 1892521 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=8536068 CPUtime=4842.27 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 193589 0 0 0 484167 60 0 0 25 0 8 0 784736817 8740933632 1892521 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330844 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=8536068 CPUtime=4752.78 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 209581 0 0 0 475213 65 0 0 25 0 8 0 784736817 8740933632 1892521 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38647
Current children cumulated vsize (KiB) 8536068

[startup+4902.3 s]
/proc/loadavg: 8.13 8.11 8.09 9/515 25568
/proc/meminfo: memFree=14863160/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=8536068 CPUtime=39126 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 26569058 0 0 0 3907665 4937 0 0 25 0 8 0 784736799 8740933632 1900071 33554432000 4194304 4625164 140735561358656 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 2134017 1900071 348 106 0 2129520 0
[pid=25413/tid=25415] ppid=25411 vsize=8536068 CPUtime=4902.28 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 213727 0 0 0 490157 71 0 0 25 0 8 0 784736816 8740933632 1900071 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=8536068 CPUtime=4900.91 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 107207 0 0 0 490064 27 0 0 25 0 8 0 784736816 8740933632 1900071 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330844 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=8536068 CPUtime=4901.87 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 22335731 0 0 0 486314 3873 0 0 25 0 8 0 784736816 8740933632 1900071 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=8536068 CPUtime=4902.27 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 378519 0 0 0 490083 144 0 0 25 0 8 0 784736817 8740933632 1900071 33554432000 4194304 4625164 140735561358656 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=8536068 CPUtime=4902.25 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 105971 0 0 0 490197 28 0 0 25 0 8 0 784736817 8740933632 1900071 33554432000 4194304 4625164 140735561358656 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=8536068 CPUtime=4902.29 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 193609 0 0 0 490169 60 0 0 25 0 8 0 784736817 8740933632 1900071 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=8536068 CPUtime=4811.7 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 209634 0 0 0 481105 65 0 0 25 0 8 0 784736817 8740933632 1900071 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39126
Current children cumulated vsize (KiB) 8536068

[startup+4962.3 s]
/proc/loadavg: 8.12 8.11 8.09 9/515 25570
/proc/meminfo: memFree=14844388/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=8536068 CPUtime=39604.8 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 26869590 0 0 0 3955479 4999 0 0 25 0 8 0 784736799 8740933632 1904655 33554432000 4194304 4625164 140735561358656 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 2134017 1904655 348 106 0 2129520 0
[pid=25413/tid=25415] ppid=25411 vsize=8536068 CPUtime=4962.26 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 213747 0 0 0 496155 71 0 0 25 0 8 0 784736816 8740933632 1904655 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=8536068 CPUtime=4960.87 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 107233 0 0 0 496060 27 0 0 25 0 8 0 784736816 8740933632 1904655 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=8536068 CPUtime=4961.84 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 22560886 0 0 0 492270 3914 0 0 25 0 8 0 784736816 8740933632 1904655 33554432000 4194304 4625164 140735561358656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=8536068 CPUtime=4962.26 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 378547 0 0 0 496082 144 0 0 25 0 8 0 784736817 8740933632 1904655 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=8536068 CPUtime=4962.23 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 106050 0 0 0 496195 28 0 0 25 0 8 0 784736817 8740933632 1904655 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=8536068 CPUtime=4962.27 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 193629 0 0 0 496167 60 0 0 25 0 8 0 784736817 8740933632 1904655 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=8536068 CPUtime=4870.6 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 209664 0 0 0 486995 65 0 0 25 0 8 0 784736817 8740933632 1904655 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39604.8
Current children cumulated vsize (KiB) 8536068



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.9 s]
/proc/loadavg: 8.12 8.10 8.09 9/515 25571
/proc/meminfo: memFree=14817684/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=8601604 CPUtime=40000.8 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) R 25411 25413 25151 0 -1 4202496 27112050 0 0 0 3995033 5048 0 0 25 0 8 0 784736799 8808042496 1911628 33554432000 4194304 4625164 140735561358656 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 2150401 1911629 351 106 0 2145904 0
[pid=25413/tid=25415] ppid=25411 vsize=8601604 CPUtime=5011.89 cores=0-7
/proc/25413/task/25415/stat : 25415 (SArTagnan) R 25411 25413 25151 0 -1 4202560 213763 0 0 0 501118 71 0 0 25 0 8 0 784736816 8808042496 1911632 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25413/tid=25416] ppid=25411 vsize=8601604 CPUtime=5010.48 cores=0-7
/proc/25413/task/25416/stat : 25416 (SArTagnan) R 25411 25413 25151 0 -1 4202560 107274 0 0 0 501021 27 0 0 25 0 8 0 784736816 8808042496 1911632 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25413/tid=25417] ppid=25411 vsize=8601604 CPUtime=5011.46 cores=0-7
/proc/25413/task/25417/stat : 25417 (SArTagnan) R 25411 25413 25151 0 -1 4202560 22739503 0 0 0 497199 3947 0 0 25 0 8 0 784736816 8808042496 1911632 33554432000 4194304 4625164 140735561358656 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25413/tid=25419] ppid=25411 vsize=8601604 CPUtime=5011.88 cores=0-7
/proc/25413/task/25419/stat : 25419 (SArTagnan) R 25411 25413 25151 0 -1 4202560 378568 0 0 0 501044 144 0 0 25 0 8 0 784736817 8808042496 1911632 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25413/tid=25420] ppid=25411 vsize=8601604 CPUtime=5011.85 cores=0-7
/proc/25413/task/25420/stat : 25420 (SArTagnan) R 25411 25413 25151 0 -1 4202560 106127 0 0 0 501157 28 0 0 25 0 8 0 784736817 8808042496 1911633 33554432000 4194304 4625164 140735561358656 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25413/tid=25421] ppid=25411 vsize=8601604 CPUtime=5011.89 cores=0-7
/proc/25413/task/25421/stat : 25421 (SArTagnan) R 25411 25413 25151 0 -1 4202560 193645 0 0 0 501129 60 0 0 25 0 8 0 784736817 8808042496 1911633 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=8601604 CPUtime=4919.3 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4202560 209691 0 0 0 491865 65 0 0 25 0 8 0 784736817 8808042496 1911635 33554432000 4194304 4625164 140735561358656 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 8601604

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5012.2 s]
/proc/loadavg: 8.12 8.10 8.09 9/515 25571
/proc/meminfo: memFree=14817684/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=0 CPUtime=40001.1 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) Z 25411 25413 25151 0 -1 4203548 27112709 0 0 0 3995037 5076 0 0 25 0 2 0 784736799 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 0 0 0 0 0 0 0
[pid=25413/tid=25422] ppid=25411 vsize=0 CPUtime=4919.57 cores=0-7
/proc/25413/task/25422/stat : 25422 (SArTagnan) R 25411 25413 25151 0 -1 4203588 209691 0 0 0 491865 92 0 0 25 0 2 0 784736817 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40001.1
Current children cumulated vsize (KiB) 0

[startup+5012.3 s]
/proc/loadavg: 8.12 8.10 8.09 2/510 25572
/proc/meminfo: memFree=22462100/32951124 swapFree=62999000/67111528
[pid=25413] ppid=25411 vsize=0 CPUtime=40001.2 cores=0-7
/proc/25413/stat : 25413 (SArTagnan) Z 25411 25413 25151 0 -1 4203548 27112709 0 0 0 3995037 5086 0 0 25 0 1 0 784736799 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/25413/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 40001.2
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.32
CPU time (s): 40001.2
CPU user time (s): 39950.4
CPU system time (s): 50.8643
CPU usage (%): 798.058
Max. virtual memory (cumulated for all children) (KiB): 8601604

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39950.4
system time used= 50.8643
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27112709
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4516
involuntary context switches= 127318

runsolver used 22.6556 second user time and 68.2076 second system time

The end

Launcher Data 

Begin job on node141 at 2011-06-01 12:13:32
IDJOB=3438786
IDBENCH=83172
IDSOLVER=1936
FILE ID=node141/3438786-1306923212
RUNJOBID= node141-1306918198-25166
PBS_JOBID= 13488525
Free space on /tmp= 73852 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-17x30.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438786-1306923212/watcher-3438786-1306923212 -o /tmp/evaluation-result-3438786-1306923212/solver-3438786-1306923212 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438786-1306923212.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3a506c7557d86d0d326e3b3cdee85b69
RANDOM SEED=546332237

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22480212 kB
Buffers:        113832 kB
Cached:         120208 kB
SwapCached:       8848 kB
Active:       10077388 kB
Inactive:       141980 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22480212 kB
SwapTotal:    67111528 kB
SwapFree:     62999000 kB
Dirty:            5848 kB
Writeback:           0 kB
AnonPages:     9983792 kB
Mapped:          24760 kB
Slab:           109120 kB
PageTables:      69880 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 150649688 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73852 MiB
End job on node141 at 2011-06-01 13:37:06