Trace number 3273876

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.46 1201.76

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n130-s30940966-unsat.cnf
MD5SUMca44a78076b8228fbb99ecc0147f157f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4645.03
Satisfiable
(Un)Satisfiability was proved
Number of variables133
Number of clauses276
Sum of the clauses size828
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3276
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273876-1304086111/watcher-3273876-1304086111 -o /tmp/evaluation-result-3273876-1304086111/solver-3273876-1304086111 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3273876-1304086111.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.41 7.94 7.98 6/180 32640
/proc/meminfo: memFree=24409240/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 445 0 0 0 0 0 0 0 18 0 4 0 520208872 50388992 381 33554432000 4194304 4623224 140735570305616 18446744073709551615 47652487813040 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 12302 381 301 105 0 7806 0
[pid=32640/tid=32641] ppid=32638 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 4 0 520208872 50388992 381 33554432000 4194304 4623224 140735570305616 18446744073709551615 212687731697 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 4 0 520208872 50388992 381 33554432000 4194304 4623224 140735570305616 18446744073709551615 212687731697 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 4 0 520208872 50388992 381 33554432000 4194304 4623224 140735570305616 18446744073709551615 212682707176 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.0387411 s]
/proc/loadavg: 7.41 7.94 7.98 6/180 32640
/proc/meminfo: memFree=24409240/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=255676 CPUtime=3.2 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 8209 0 0 0 320 0 0 0 19 0 4 0 520208872 261812224 4939 33554432000 4194304 4623224 140735570305616 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 63919 4939 343 105 0 59423 0
[pid=32640/tid=32641] ppid=32638 vsize=255676 CPUtime=0.79 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 1911 0 0 0 79 0 0 0 21 0 4 0 520208872 261812224 4939 33554432000 4194304 4623224 140735570305616 18446744073709551615 4367191 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=255676 CPUtime=0.79 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2508 0 0 0 79 0 0 0 19 0 4 0 520208872 261812224 4939 33554432000 4194304 4623224 140735570305616 18446744073709551615 4366446 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=255676 CPUtime=0.8 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2358 0 0 0 80 0 0 0 19 0 4 0 520208872 261812224 4939 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.2
Current children cumulated vsize (KiB) 255676

[startup+0.90793 s]
/proc/loadavg: 7.41 7.94 7.98 6/180 32640
/proc/meminfo: memFree=24409240/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=256644 CPUtime=3.6 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 8979 0 0 0 360 0 0 0 19 0 4 0 520208872 262803456 5092 33554432000 4194304 4623224 140735570305616 18446744073709551615 4511014 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 64161 5092 343 105 0 59665 0
[pid=32640/tid=32641] ppid=32638 vsize=256644 CPUtime=0.89 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2449 0 0 0 89 0 0 0 21 0 4 0 520208872 262803456 5092 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376646 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=256644 CPUtime=0.89 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2545 0 0 0 89 0 0 0 19 0 4 0 520208872 262803456 5092 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=256644 CPUtime=0.9 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2522 0 0 0 90 0 0 0 19 0 4 0 520208872 262803456 5092 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.6
Current children cumulated vsize (KiB) 256644

[startup+1.00791 s]
/proc/loadavg: 7.41 7.94 7.98 6/180 32640
/proc/meminfo: memFree=24409240/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=256780 CPUtime=4 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 9525 0 0 0 400 0 0 0 19 0 4 0 520208872 262942720 5314 33554432000 4194304 4623224 140735570305616 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 64195 5314 343 105 0 59699 0
[pid=32640/tid=32641] ppid=32638 vsize=256780 CPUtime=0.99 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2505 0 0 0 99 0 0 0 21 0 4 0 520208872 262942720 5314 33554432000 4194304 4623224 140735570305616 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=256780 CPUtime=0.99 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2658 0 0 0 99 0 0 0 19 0 4 0 520208872 262942720 5314 33554432000 4194304 4623224 140735570305616 18446744073709551615 4463682 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=256780 CPUtime=1 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2870 0 0 0 100 0 0 0 19 0 4 0 520208872 262942720 5314 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550432 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4
Current children cumulated vsize (KiB) 256780

[startup+1.10789 s]
/proc/loadavg: 7.41 7.94 7.98 6/180 32640
/proc/meminfo: memFree=24409240/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=256928 CPUtime=4.41 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 10402 0 0 0 440 1 0 0 19 0 4 0 520208872 263094272 5547 33554432000 4194304 4623224 140735570305616 18446744073709551615 4517428 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 64232 5547 343 105 0 59736 0
[pid=32640/tid=32641] ppid=32638 vsize=256928 CPUtime=1.09 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2537 0 0 0 109 0 0 0 22 0 4 0 520208872 263094272 5547 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376853 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=256928 CPUtime=1.09 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2733 0 0 0 109 0 0 0 19 0 4 0 520208872 263094272 5547 33554432000 4194304 4623224 140735570305616 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=256928 CPUtime=1.09 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 3591 0 0 0 109 0 0 0 19 0 4 0 520208872 263094272 5547 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4.41
Current children cumulated vsize (KiB) 256928

[startup+1.50082 s]
/proc/loadavg: 7.41 7.94 7.98 6/180 32640
/proc/meminfo: memFree=24409240/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=259792 CPUtime=5.98 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 15605 0 0 0 596 2 0 0 20 0 4 0 520208872 266027008 6767 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510896 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 64948 6767 352 105 0 60452 0
[pid=32640/tid=32641] ppid=32638 vsize=259792 CPUtime=1.49 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 3463 0 0 0 149 0 0 0 23 0 4 0 520208872 266027008 6767 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=259792 CPUtime=1.49 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 3730 0 0 0 149 0 0 0 20 0 4 0 520208872 266027008 6767 33554432000 4194304 4623224 140735570305616 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=259792 CPUtime=1.49 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 6511 0 0 0 148 1 0 0 20 0 4 0 520208872 266027008 6767 33554432000 4194304 4623224 140735570305616 18446744073709551615 4545864 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.98
Current children cumulated vsize (KiB) 259792

[startup+3.10053 s]
/proc/loadavg: 7.45 7.94 7.98 9/184 32645
/proc/meminfo: memFree=24329948/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=268608 CPUtime=12.36 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 24157 0 0 0 1233 3 0 0 25 0 4 0 520208872 275054592 10687 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 67152 10687 372 105 0 62656 0
[pid=32640/tid=32641] ppid=32638 vsize=268608 CPUtime=3.08 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 5540 0 0 0 308 0 0 0 25 0 4 0 520208872 275054592 10687 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376617 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=268608 CPUtime=3.07 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 5521 0 0 0 307 0 0 0 25 0 4 0 520208872 275054592 10687 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376714 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=268608 CPUtime=3.08 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 9960 0 0 0 307 1 0 0 25 0 4 0 520208872 275054592 10687 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550519 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 268608

[startup+6.30695 s]
/proc/loadavg: 7.45 7.94 7.98 9/184 32645
/proc/meminfo: memFree=24296348/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=279796 CPUtime=25.17 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 32965 0 0 0 2511 6 0 0 25 0 4 0 520208872 286511104 15213 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 69949 15213 346 105 0 65453 0
[pid=32640/tid=32641] ppid=32638 vsize=279796 CPUtime=6.29 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 8364 0 0 0 629 0 0 0 25 0 4 0 520208872 286511104 15213 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=279796 CPUtime=6.26 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 8761 0 0 0 624 2 0 0 25 0 4 0 520208872 286511104 15213 33554432000 4194304 4623224 140735570305616 18446744073709551615 4377031 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=279796 CPUtime=6.29 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 12213 0 0 0 627 2 0 0 25 0 4 0 520208872 286511104 15213 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550420 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.17
Current children cumulated vsize (KiB) 279796

[startup+12.7008 s]
/proc/loadavg: 7.54 7.94 7.98 9/184 32645
/proc/meminfo: memFree=24239472/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=291516 CPUtime=50.71 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 76245 0 0 0 5056 15 0 0 25 0 4 0 520208872 298512384 24515 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 72879 24515 520 105 0 68383 0
[pid=32640/tid=32641] ppid=32638 vsize=291516 CPUtime=12.68 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 12548 0 0 0 1267 1 0 0 25 0 4 0 520208872 298512384 24515 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=291516 CPUtime=12.63 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 13522 0 0 0 1259 4 0 0 25 0 4 0 520208872 298512384 24515 33554432000 4194304 4623224 140735570305616 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=291516 CPUtime=12.68 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 43039 0 0 0 1261 7 0 0 25 0 4 0 520208872 298512384 24515 33554432000 4194304 4623224 140735570305616 18446744073709551615 4366369 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 291516

[startup+25.5005 s]
/proc/loadavg: 7.61 7.94 7.98 9/184 32645
/proc/meminfo: memFree=24154000/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=325452 CPUtime=101.85 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 119286 0 0 0 10160 25 0 0 25 0 4 0 520208872 333262848 33507 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 81363 33507 377 105 0 76867 0
[pid=32640/tid=32641] ppid=32638 vsize=325452 CPUtime=25.49 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 20020 0 0 0 2545 4 0 0 25 0 4 0 520208872 333262848 33507 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=325452 CPUtime=25.35 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 19821 0 0 0 2529 6 0 0 25 0 4 0 520208872 333262848 33507 33554432000 4194304 4623224 140735570305616 18446744073709551615 4366446 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=325452 CPUtime=25.49 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 68621 0 0 0 2538 11 0 0 25 0 4 0 520208872 333262848 33507 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.85
Current children cumulated vsize (KiB) 325452

[startup+51.1008 s]
/proc/loadavg: 7.74 7.95 7.98 9/184 32646
/proc/meminfo: memFree=24056760/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=361032 CPUtime=204.11 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 249246 0 0 0 20362 49 0 0 25 0 4 0 520208872 369696768 46692 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 90258 46692 356 105 0 85762 0
[pid=32640/tid=32641] ppid=32638 vsize=361032 CPUtime=51.09 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 22370 0 0 0 5103 6 0 0 25 0 4 0 520208872 369696768 46692 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=361032 CPUtime=50.82 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 28611 0 0 0 5072 10 0 0 25 0 4 0 520208872 369696768 46692 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=361032 CPUtime=51.08 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 181188 0 0 0 5079 29 0 0 25 0 4 0 520208872 369696768 46692 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204.11
Current children cumulated vsize (KiB) 361032

[startup+102.3 s]
/proc/loadavg: 7.93 7.97 7.98 9/184 32647
/proc/meminfo: memFree=23833056/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=466280 CPUtime=408.63 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 339905 0 0 0 40792 71 0 0 25 0 4 0 520208872 477470720 73347 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 116570 73347 767 105 0 112074 0
[pid=32640/tid=32641] ppid=32638 vsize=466280 CPUtime=102.28 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 32832 0 0 0 10221 7 0 0 25 0 4 0 520208872 477470720 73347 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=466280 CPUtime=101.73 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 45536 0 0 0 10155 18 0 0 25 0 4 0 520208872 477470720 73347 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376773 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=466280 CPUtime=102.28 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 235169 0 0 0 10189 39 0 0 25 0 4 0 520208872 477470720 73347 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550548 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.63
Current children cumulated vsize (KiB) 466280

[startup+162.301 s]

################
# More data... #
################

[pid=32640] ppid=32638 vsize=1012076 CPUtime=2805.44 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 979556 0 0 0 280310 234 0 0 25 0 4 0 520208872 1036365824 192510 33554432000 4194304 4623224 140735570305616 18446744073709551615 4517548 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 253019 192510 1990 105 0 248523 0
[pid=32640/tid=32641] ppid=32638 vsize=1012076 CPUtime=702.31 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 111012 0 0 0 70184 47 0 0 25 0 4 0 520208872 1036365824 192510 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1012076 CPUtime=698.54 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 116462 0 0 0 69797 57 0 0 25 0 4 0 520208872 1036365824 192510 33554432000 4194304 4623224 140735570305616 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1012076 CPUtime=702.25 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 677077 0 0 0 70111 114 0 0 25 0 4 0 520208872 1036365824 192510 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2805.44
Current children cumulated vsize (KiB) 1012076

[startup+762.301 s]
/proc/loadavg: 8.02 8.03 8.00 9/184 32665
/proc/meminfo: memFree=22911948/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1083112 CPUtime=3045.12 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 1220505 0 0 0 304234 278 0 0 25 0 4 0 520208872 1109106688 200998 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 270778 200998 2054 105 0 266282 0
[pid=32640/tid=32641] ppid=32638 vsize=1083112 CPUtime=762.31 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 113272 0 0 0 76179 52 0 0 25 0 4 0 520208872 1109106688 200998 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1083112 CPUtime=758.54 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 118651 0 0 0 75795 59 0 0 25 0 4 0 520208872 1109106688 200998 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1083112 CPUtime=761.92 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 900429 0 0 0 76042 150 0 0 25 0 4 0 520208872 1109106688 200998 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3045.12
Current children cumulated vsize (KiB) 1083112

[startup+822.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/184 32666
/proc/meminfo: memFree=22858368/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1090504 CPUtime=3284.79 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 1475825 0 0 0 328156 323 0 0 25 0 4 0 520208872 1116676096 207136 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510146 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 272626 207136 2069 105 0 268130 0
[pid=32640/tid=32641] ppid=32638 vsize=1090504 CPUtime=822.31 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 115606 0 0 0 82176 55 0 0 25 0 4 0 520208872 1116676096 207136 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1090504 CPUtime=818.53 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 121650 0 0 0 81793 60 0 0 25 0 4 0 520208872 1116676096 207136 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1090504 CPUtime=821.6 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 1149985 0 0 0 81969 191 0 0 25 0 4 0 520208872 1116676096 207136 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3284.79
Current children cumulated vsize (KiB) 1090504

[startup+882.3 s]
/proc/loadavg: 8.12 8.06 8.01 9/184 32668
/proc/meminfo: memFree=22755812/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1203696 CPUtime=3524.46 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 1778913 0 0 0 352073 373 0 0 25 0 4 0 520208872 1232584704 222130 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 300924 222130 2043 105 0 296428 0
[pid=32640/tid=32641] ppid=32638 vsize=1203696 CPUtime=882.31 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 117272 0 0 0 88173 58 0 0 25 0 4 0 520208872 1232584704 222130 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1203696 CPUtime=878.54 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 161286 0 0 0 87787 67 0 0 25 0 4 0 520208872 1232584704 222130 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1203696 CPUtime=881.28 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 1411496 0 0 0 87896 232 0 0 25 0 4 0 520208872 1232584704 222130 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3524.46
Current children cumulated vsize (KiB) 1203696

[startup+942.3 s]
/proc/loadavg: 8.14 8.08 8.01 9/184 32670
/proc/meminfo: memFree=22646048/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1255660 CPUtime=3764.17 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 2032912 0 0 0 376002 415 0 0 25 0 4 0 520208872 1285795840 233392 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 313915 233392 1990 105 0 309419 0
[pid=32640/tid=32641] ppid=32638 vsize=1255660 CPUtime=942.32 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 124352 0 0 0 94173 59 0 0 25 0 4 0 520208872 1285795840 233392 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1255660 CPUtime=938.55 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 163548 0 0 0 93787 68 0 0 25 0 4 0 520208872 1285795840 233392 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1255660 CPUtime=940.95 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 1654707 0 0 0 93825 270 0 0 25 0 4 0 520208872 1285795840 233392 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3764.17
Current children cumulated vsize (KiB) 1255660

[startup+1002.3 s]
/proc/loadavg: 8.14 8.09 8.02 9/184 32671
/proc/meminfo: memFree=22609692/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1255660 CPUtime=4003.83 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 2241958 0 0 0 399932 451 0 0 25 0 4 0 520208872 1285795840 236672 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 313915 236672 2047 105 0 309419 0
[pid=32640/tid=32641] ppid=32638 vsize=1255660 CPUtime=1002.32 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 125029 0 0 0 100172 60 0 0 25 0 4 0 520208872 1285795840 236672 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1255660 CPUtime=998.54 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 164058 0 0 0 99786 68 0 0 25 0 4 0 520208872 1285795840 236672 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1255660 CPUtime=1000.62 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 1861258 0 0 0 99757 305 0 0 25 0 4 0 520208872 1285795840 236672 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4003.83
Current children cumulated vsize (KiB) 1255660

[startup+1062.31 s]
/proc/loadavg: 8.21 8.11 8.03 9/184 32673
/proc/meminfo: memFree=22574956/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1255660 CPUtime=4243.53 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 2512045 0 0 0 423859 494 0 0 25 0 4 0 520208872 1285795840 241554 33554432000 4194304 4623224 140735570305616 18446744073709551615 4414955 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 313915 241554 1920 105 0 309419 0
[pid=32640/tid=32641] ppid=32638 vsize=1255660 CPUtime=1062.32 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 126470 0 0 0 106172 60 0 0 25 0 4 0 520208872 1285795840 241554 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1255660 CPUtime=1058.55 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 165966 0 0 0 105787 68 0 0 25 0 4 0 520208872 1285795840 241554 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1255660 CPUtime=1060.3 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2126985 0 0 0 105683 347 0 0 25 0 4 0 520208872 1285795840 241554 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.53
Current children cumulated vsize (KiB) 1255660

[startup+1122.3 s]
/proc/loadavg: 8.19 8.12 8.03 9/184 32674
/proc/meminfo: memFree=22494960/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1255660 CPUtime=4483.19 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 2749190 0 0 0 447787 532 0 0 25 0 4 0 520208872 1285795840 245560 33554432000 4194304 4623224 140735570305616 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 313915 245560 1958 105 0 309419 0
[pid=32640/tid=32641] ppid=32638 vsize=1255660 CPUtime=1122.31 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 127245 0 0 0 112171 60 0 0 25 0 4 0 520208872 1285795840 245560 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1255660 CPUtime=1118.55 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 166670 0 0 0 111786 69 0 0 25 0 4 0 520208872 1285795840 245560 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1255660 CPUtime=1119.97 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2361064 0 0 0 111613 384 0 0 25 0 4 0 520208872 1285795840 245560 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4483.19
Current children cumulated vsize (KiB) 1255660

[startup+1182.3 s]
/proc/loadavg: 8.12 8.11 8.03 9/184 32676
/proc/meminfo: memFree=22448704/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1322568 CPUtime=4722.86 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 3033733 0 0 0 471705 581 0 0 25 0 4 0 520208872 1354309632 254119 33554432000 4194304 4623224 140735570305616 18446744073709551615 4510202 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 330642 254119 1941 105 0 326146 0
[pid=32640/tid=32641] ppid=32638 vsize=1322568 CPUtime=1182.32 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 166058 0 0 0 118165 67 0 0 25 0 4 0 520208872 1354309632 254119 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1322568 CPUtime=1178.54 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 167740 0 0 0 117785 69 0 0 25 0 4 0 520208872 1354309632 254119 33554432000 4194304 4623224 140735570305616 18446744073709551615 4460800 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1322568 CPUtime=1179.65 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2605475 0 0 0 117539 426 0 0 25 0 4 0 520208872 1354309632 254119 33554432000 4194304 4623224 140735570305616 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.86
Current children cumulated vsize (KiB) 1322568



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.08 8.10 8.03 6/183 32677
/proc/meminfo: memFree=22665328/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1323624 CPUtime=4800.39 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 3127897 0 0 0 479441 598 0 0 25 0 4 0 520208872 1355390976 256613 33554432000 4194304 4623224 140735570305616 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 330906 256613 1974 105 0 326410 0
[pid=32640/tid=32641] ppid=32638 vsize=1323624 CPUtime=1201.72 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 167763 0 0 0 120105 67 0 0 25 0 4 0 520208872 1355390976 256613 33554432000 4194304 4623224 140735570305616 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1323624 CPUtime=1197.96 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 168077 0 0 0 119726 70 0 0 25 0 4 0 520208872 1355390976 256613 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1323624 CPUtime=1198.94 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2697466 0 0 0 119453 441 0 0 25 0 4 0 520208872 1355390976 256613 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 1323624

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.08 8.10 8.03 6/183 32677
/proc/meminfo: memFree=22665328/32951124 swapFree=67111524/67111528
[pid=32640] ppid=32638 vsize=1323624 CPUtime=4800.39 cores=1,3,5,7
/proc/32640/stat : 32640 (SArTagnan) R 32638 32640 31855 0 -1 4202496 3127897 0 0 0 479441 598 0 0 25 0 4 0 520208872 1355390976 256613 33554432000 4194304 4623224 140735570305616 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/32640/statm: 330906 256613 1974 105 0 326410 0
[pid=32640/tid=32641] ppid=32638 vsize=1323624 CPUtime=1201.72 cores=1,3,5,7
/proc/32640/task/32641/stat : 32641 (SArTagnan) R 32638 32640 31855 0 -1 4202560 167763 0 0 0 120105 67 0 0 25 0 4 0 520208872 1355390976 256613 33554432000 4194304 4623224 140735570305616 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=32640/tid=32642] ppid=32638 vsize=1323624 CPUtime=1197.96 cores=1,3,5,7
/proc/32640/task/32642/stat : 32642 (SArTagnan) R 32638 32640 31855 0 -1 4202560 168077 0 0 0 119726 70 0 0 25 0 4 0 520208872 1355390976 256613 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=32640/tid=32643] ppid=32638 vsize=1323624 CPUtime=1198.94 cores=1,3,5,7
/proc/32640/task/32643/stat : 32643 (SArTagnan) R 32638 32640 31855 0 -1 4202560 2697466 0 0 0 119453 441 0 0 25 0 4 0 520208872 1355390976 256613 33554432000 4194304 4623224 140735570305616 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 1323624

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.76
CPU time (s): 4800.46
CPU user time (s): 4794.43
CPU system time (s): 6.02608
CPU usage (%): 399.453
Max. virtual memory (cumulated for all children) (KiB): 1451048

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.43
system time used= 6.02608
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3127899
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 374
involuntary context switches= 32461

runsolver used 1.82972 second user time and 4.72728 second system time

The end

Launcher Data 

Begin job on node139 at 2011-04-29 16:08:31
IDJOB=3273876
IDBENCH=83148
IDSOLVER=1656
FILE ID=node139/3273876-1304086111
RUNJOBID= node139-1304086111-32618
PBS_JOBID= 13170525
Free space on /tmp= 72552 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n130-s30940966-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273876-1304086111/watcher-3273876-1304086111 -o /tmp/evaluation-result-3273876-1304086111/solver-3273876-1304086111 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3273876-1304086111.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ca44a78076b8228fbb99ecc0147f157f
RANDOM SEED=1697791765

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24409628 kB
Buffers:       2040688 kB
Cached:        5917476 kB
SwapCached:          4 kB
Active:         911196 kB
Inactive:      7112048 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24409628 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             800 kB
Writeback:           0 kB
AnonPages:       64976 kB
Mapped:          14884 kB
Slab:           453596 kB
PageTables:       4508 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   238588 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72552 MiB
End job on node139 at 2011-04-29 16:28:35