Trace number 3273500

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.35 1201.97

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n180-s33098896-unsat.cnf
MD5SUM1221fb51c407dee7559369d7c6eedb4e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables181
Number of clauses372
Sum of the clauses size1116
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3372
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273500-1304084876/watcher-3273500-1304084876 -o /tmp/evaluation-result-3273500-1304084876/solver-3273500-1304084876 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3273500-1304084876.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.49 7.98 8.00 1/172 23332
/proc/meminfo: memFree=18801996/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 454 0 0 0 0 0 0 0 22 0 4 0 520085537 50388992 390 33554432000 4194304 4623224 140736972745408 18446744073709551615 47236455098290 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 12302 390 301 105 0 7806 0
[pid=23332/tid=23333] ppid=23330 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 0 0 0 0 0 0 0 0 23 0 4 0 520085537 50388992 390 33554432000 4194304 4623224 140736972745408 18446744073709551615 228122770417 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 0 0 0 0 0 0 0 0 23 0 4 0 520085537 50388992 390 33554432000 4194304 4623224 140736972745408 18446744073709551615 228134511670 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=49208 CPUtime=0 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 4 0 520085537 50388992 390 33554432000 4194304 4623224 140736972745408 18446744073709551615 47236455098290 0 0 4096 2 0 0 0 -1 5 0 0 0

[startup+0.0680229 s]
/proc/loadavg: 7.49 7.98 8.00 1/172 23332
/proc/meminfo: memFree=18801996/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=247176 CPUtime=0.25 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 1541 0 0 0 25 0 0 0 23 0 4 0 520085537 253108224 1220 33554432000 4194304 4623224 140736972745408 18446744073709551615 4366247 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 61794 1220 342 105 0 57298 0
[pid=23332/tid=23333] ppid=23330 vsize=247176 CPUtime=0.06 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 270 0 0 0 6 0 0 0 24 0 4 0 520085537 253108224 1220 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=247176 CPUtime=0.06 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 268 0 0 0 6 0 0 0 24 0 4 0 520085537 253108224 1220 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377460 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=247176 CPUtime=0.06 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 295 0 0 0 6 0 0 0 24 0 4 0 520085537 253108224 1220 33554432000 4194304 4623224 140736972745408 18446744073709551615 4548731 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 247176

[startup+0.101016 s]
/proc/loadavg: 7.49 7.98 8.00 1/172 23332
/proc/meminfo: memFree=18801996/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=247948 CPUtime=0.38 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 2013 0 0 0 38 0 0 0 23 0 4 0 520085537 253898752 1537 33554432000 4194304 4623224 140736972745408 18446744073709551615 4384412 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 61987 1537 343 105 0 57491 0
[pid=23332/tid=23333] ppid=23330 vsize=247948 CPUtime=0.09 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 456 0 0 0 9 0 0 0 24 0 4 0 520085537 253898752 1537 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=247948 CPUtime=0.09 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 435 0 0 0 9 0 0 0 24 0 4 0 520085537 253898752 1538 33554432000 4194304 4623224 140736972745408 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=247948 CPUtime=0.09 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 367 0 0 0 9 0 0 0 24 0 4 0 520085537 253898752 1538 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 247948

[startup+0.300982 s]
/proc/loadavg: 7.49 7.98 8.00 1/172 23332
/proc/meminfo: memFree=18801996/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=249956 CPUtime=1.18 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 4292 0 0 0 118 0 0 0 23 0 4 0 520085537 255954944 2950 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510017 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 62489 2950 343 105 0 57993 0
[pid=23332/tid=23333] ppid=23330 vsize=249956 CPUtime=0.29 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 1072 0 0 0 29 0 0 0 25 0 4 0 520085537 255954944 2950 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=249956 CPUtime=0.29 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 1085 0 0 0 29 0 0 0 25 0 4 0 520085537 255954944 2950 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=249956 CPUtime=0.29 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 955 0 0 0 29 0 0 0 25 0 4 0 520085537 255954944 2950 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.18
Current children cumulated vsize (KiB) 249956

[startup+0.700911 s]
/proc/loadavg: 7.49 7.98 8.00 1/172 23332
/proc/meminfo: memFree=18801996/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=253668 CPUtime=2.77 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 7404 0 0 0 277 0 0 0 25 0 4 0 520085537 259756032 5072 33554432000 4194304 4623224 140736972745408 18446744073709551615 4526875 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 63417 5072 343 105 0 58921 0
[pid=23332/tid=23333] ppid=23330 vsize=253668 CPUtime=0.69 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 1795 0 0 0 69 0 0 0 25 0 4 0 520085537 259756032 5072 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377579 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=253668 CPUtime=0.69 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 1942 0 0 0 69 0 0 0 25 0 4 0 520085537 259756032 5072 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=253668 CPUtime=0.69 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 2170 0 0 0 69 0 0 0 25 0 4 0 520085537 259756032 5072 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550436 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 253668

[startup+1.50077 s]
/proc/loadavg: 7.49 7.98 8.00 9/184 23349
/proc/meminfo: memFree=18759128/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=257576 CPUtime=5.98 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 14801 0 0 0 596 2 0 0 25 0 4 0 520085537 263757824 7614 33554432000 4194304 4623224 140736972745408 18446744073709551615 4360087 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 64394 7614 344 105 0 59898 0
[pid=23332/tid=23333] ppid=23330 vsize=257576 CPUtime=1.48 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 2675 0 0 0 148 0 0 0 25 0 4 0 520085537 263757824 7614 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=257576 CPUtime=1.49 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 3406 0 0 0 149 0 0 0 25 0 4 0 520085537 263757824 7614 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377885 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=257576 CPUtime=1.48 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 6085 0 0 0 148 0 0 0 25 0 4 0 520085537 263757824 7614 33554432000 4194304 4623224 140736972745408 18446744073709551615 4577479 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.98
Current children cumulated vsize (KiB) 257576

[startup+3.10048 s]
/proc/loadavg: 7.49 7.98 8.00 9/184 23349
/proc/meminfo: memFree=18732220/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=263816 CPUtime=12.37 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 26384 0 0 0 1233 4 0 0 25 0 4 0 520085537 270147584 11527 33554432000 4194304 4623224 140736972745408 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 65954 11527 344 105 0 61458 0
[pid=23332/tid=23333] ppid=23330 vsize=263816 CPUtime=3.07 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 4274 0 0 0 307 0 0 0 25 0 4 0 520085537 270147584 11527 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=263816 CPUtime=3.08 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 5729 0 0 0 308 0 0 0 25 0 4 0 520085537 270147584 11527 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=263816 CPUtime=3.08 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 13220 0 0 0 307 1 0 0 25 0 4 0 520085537 270147584 11527 33554432000 4194304 4623224 140736972745408 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.37
Current children cumulated vsize (KiB) 263816

[startup+6.30091 s]
/proc/loadavg: 7.53 7.98 8.00 9/184 23349
/proc/meminfo: memFree=18678060/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=280764 CPUtime=25.15 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 40624 0 0 0 2508 7 0 0 25 0 4 0 520085537 287502336 17965 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 70191 17965 347 105 0 65695 0
[pid=23332/tid=23333] ppid=23330 vsize=280764 CPUtime=6.26 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 8850 0 0 0 624 2 0 0 25 0 4 0 520085537 287502336 17965 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=280764 CPUtime=6.28 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 8849 0 0 0 627 1 0 0 25 0 4 0 520085537 287502336 17965 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=280764 CPUtime=6.29 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 18189 0 0 0 627 2 0 0 25 0 4 0 520085537 287502336 17965 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 280764

[startup+12.7008 s]
/proc/loadavg: 7.57 7.98 8.00 9/184 23349
/proc/meminfo: memFree=18609788/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=291476 CPUtime=50.71 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 53111 0 0 0 5059 12 0 0 25 0 4 0 520085537 298471424 26045 33554432000 4194304 4623224 140736972745408 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 72869 26045 462 105 0 68373 0
[pid=23332/tid=23333] ppid=23330 vsize=291476 CPUtime=12.62 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 13592 0 0 0 1258 4 0 0 25 0 4 0 520085537 298471424 26045 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=291476 CPUtime=12.69 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 12767 0 0 0 1265 4 0 0 25 0 4 0 520085537 298471424 26045 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=291476 CPUtime=12.68 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 18936 0 0 0 1266 2 0 0 25 0 4 0 520085537 298471424 26045 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 291476

[startup+25.5004 s]
/proc/loadavg: 7.66 7.98 8.00 9/184 23350
/proc/meminfo: memFree=18496716/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=330528 CPUtime=101.84 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 95989 0 0 0 10162 22 0 0 25 0 4 0 520085537 338460672 40451 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 82632 40451 697 105 0 78136 0
[pid=23332/tid=23333] ppid=23330 vsize=330528 CPUtime=25.35 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 19736 0 0 0 2530 5 0 0 25 0 4 0 520085537 338460672 40451 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=330528 CPUtime=25.49 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 19424 0 0 0 2542 7 0 0 25 0 4 0 520085537 338460672 40451 33554432000 4194304 4623224 140736972745408 18446744073709551615 4367191 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=330528 CPUtime=25.49 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 43175 0 0 0 2542 7 0 0 25 0 4 0 520085537 338460672 40451 33554432000 4194304 4623224 140736972745408 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 330528

[startup+51.1008 s]
/proc/loadavg: 7.78 7.98 8.00 9/184 23350
/proc/meminfo: memFree=18367364/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=381332 CPUtime=204.1 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 179725 0 0 0 20369 41 0 0 25 0 4 0 520085537 390483968 57482 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 95333 57482 750 105 0 90837 0
[pid=23332/tid=23333] ppid=23330 vsize=381332 CPUtime=50.81 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 29246 0 0 0 5073 8 0 0 25 0 4 0 520085537 390483968 57482 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=381332 CPUtime=51.09 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 28695 0 0 0 5098 11 0 0 25 0 4 0 520085537 390483968 57482 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=381332 CPUtime=51.09 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 100150 0 0 0 5091 18 0 0 25 0 4 0 520085537 390483968 57482 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 204.1
Current children cumulated vsize (KiB) 381332

[startup+102.307 s]
/proc/loadavg: 7.90 7.98 8.00 9/184 23352
/proc/meminfo: memFree=18189272/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=421124 CPUtime=408.65 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 283317 0 0 0 40801 64 0 0 25 0 4 0 520085537 431230976 77447 33554432000 4194304 4623224 140736972745408 18446744073709551615 4414880 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 105281 77447 427 105 0 100785 0
[pid=23332/tid=23333] ppid=23330 vsize=421124 CPUtime=101.73 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 44130 0 0 0 10159 14 0 0 25 0 4 0 520085537 431230976 77447 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=421124 CPUtime=102.3 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 38370 0 0 0 10217 13 0 0 25 0 4 0 520085537 431230976 77447 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=421124 CPUtime=102.29 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 163146 0 0 0 10200 29 0 0 25 0 4 0 520085537 431230976 77447 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.65
Current children cumulated vsize (KiB) 421124

[startup+162.301 s]

################
# More data... #
################

[pid=23332] ppid=23330 vsize=1166224 CPUtime=2805.4 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 868937 0 0 0 280295 245 0 0 25 0 4 0 520085537 1194213376 227993 33554432000 4194304 4623224 140736972745408 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 291556 227993 475 105 0 287060 0
[pid=23332/tid=23333] ppid=23330 vsize=1166224 CPUtime=700.16 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 155520 0 0 0 69951 65 0 0 25 0 4 0 520085537 1194213376 227993 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1166224 CPUtime=700.61 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 139427 0 0 0 69988 73 0 0 25 0 4 0 520085537 1194213376 227993 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1166224 CPUtime=702.29 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 407324 0 0 0 70157 72 0 0 25 0 4 0 520085537 1194213376 227993 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2805.4
Current children cumulated vsize (KiB) 1166224

[startup+762.307 s]
/proc/loadavg: 8.24 8.10 8.02 9/184 23369
/proc/meminfo: memFree=16881468/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1293132 CPUtime=3045.1 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 895721 0 0 0 304251 259 0 0 25 0 4 0 520085537 1324167168 243905 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 323283 243905 440 105 0 318787 0
[pid=23332/tid=23333] ppid=23330 vsize=1293132 CPUtime=760.17 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 159832 0 0 0 75945 72 0 0 25 0 4 0 520085537 1324167168 243905 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1293132 CPUtime=760.29 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 143079 0 0 0 75952 77 0 0 25 0 4 0 520085537 1324167168 243905 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1293132 CPUtime=762.3 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 414312 0 0 0 76157 73 0 0 25 0 4 0 520085537 1324167168 243905 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376714 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3045.1
Current children cumulated vsize (KiB) 1293132

[startup+822.301 s]
/proc/loadavg: 8.16 8.09 8.02 9/184 23380
/proc/meminfo: memFree=16806900/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1341136 CPUtime=3284.74 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 908356 0 0 0 328207 267 0 0 25 0 4 0 520085537 1373323264 256118 33554432000 4194304 4623224 140736972745408 18446744073709551615 4415016 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 335284 256118 385 105 0 330788 0
[pid=23332/tid=23333] ppid=23330 vsize=1341136 CPUtime=820.16 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 163568 0 0 0 81940 76 0 0 25 0 4 0 520085537 1373323264 256118 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1341136 CPUtime=819.97 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 150682 0 0 0 81915 82 0 0 25 0 4 0 520085537 1373323264 256118 33554432000 4194304 4623224 140736972745408 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1341136 CPUtime=822.29 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 414708 0 0 0 82156 73 0 0 25 0 4 0 520085537 1373323264 256118 33554432000 4194304 4623224 140736972745408 18446744073709551615 4546788 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.74
Current children cumulated vsize (KiB) 1341136

[startup+882.3 s]
/proc/loadavg: 8.12 8.09 8.02 9/184 23382
/proc/meminfo: memFree=16705920/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1419844 CPUtime=3524.41 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 939780 0 0 0 352165 276 0 0 25 0 4 0 520085537 1453920256 272438 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 354961 272438 385 105 0 350465 0
[pid=23332/tid=23333] ppid=23330 vsize=1419844 CPUtime=880.16 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 173437 0 0 0 87934 82 0 0 25 0 4 0 520085537 1453920256 272438 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1419844 CPUtime=879.63 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 154371 0 0 0 87881 82 0 0 25 0 4 0 520085537 1453920256 272438 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1419844 CPUtime=882.28 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 415023 0 0 0 88155 73 0 0 25 0 4 0 520085537 1453920256 272438 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3524.41
Current children cumulated vsize (KiB) 1419844

[startup+942.3 s]
/proc/loadavg: 8.11 8.09 8.01 9/184 23383
/proc/meminfo: memFree=16614128/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1508088 CPUtime=3764.09 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 990631 0 0 0 376123 286 0 0 25 0 4 0 520085537 1544282112 280896 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 377022 280896 385 105 0 372526 0
[pid=23332/tid=23333] ppid=23330 vsize=1508088 CPUtime=940.16 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 222688 0 0 0 93925 91 0 0 25 0 4 0 520085537 1544282112 280896 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1508088 CPUtime=939.31 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 154899 0 0 0 93849 82 0 0 25 0 4 0 520085537 1544282112 280896 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1508088 CPUtime=942.29 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 415345 0 0 0 94155 74 0 0 25 0 4 0 520085537 1544282112 280896 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3764.09
Current children cumulated vsize (KiB) 1508088

[startup+1002.3 s]
/proc/loadavg: 8.40 8.15 8.04 10/185 23388
/proc/meminfo: memFree=16512984/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1508088 CPUtime=4003 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 1000989 0 0 0 400004 296 0 0 25 0 4 0 520085537 1544282112 291232 33554432000 4194304 4623224 140736972745408 18446744073709551615 4517548 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 377022 291232 385 105 0 372526 0
[pid=23332/tid=23333] ppid=23330 vsize=1508088 CPUtime=1000.16 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 227925 0 0 0 99920 96 0 0 25 0 4 0 520085537 1544282112 291232 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377608 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1508088 CPUtime=998.22 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 158664 0 0 0 99735 87 0 0 25 0 4 0 520085537 1544282112 291232 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1508088 CPUtime=1002.29 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 415564 0 0 0 100155 74 0 0 25 0 4 0 520085537 1544282112 291232 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003
Current children cumulated vsize (KiB) 1508088

[startup+1062.3 s]
/proc/loadavg: 8.23 8.15 8.04 9/184 23389
/proc/meminfo: memFree=16498136/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1508088 CPUtime=4242.6 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 1007985 0 0 0 423955 305 0 0 25 0 4 0 520085537 1544282112 298197 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 377022 298197 385 105 0 372526 0
[pid=23332/tid=23333] ppid=23330 vsize=1508088 CPUtime=1060.16 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 230889 0 0 0 105916 100 0 0 25 0 4 0 520085537 1544282112 298197 33554432000 4194304 4623224 140736972745408 18446744073709551615 228122757303 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1508088 CPUtime=1057.83 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 161689 0 0 0 105691 92 0 0 25 0 4 0 520085537 1544282112 298197 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1508088 CPUtime=1062.28 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 415782 0 0 0 106154 74 0 0 25 0 4 0 520085537 1544282112 298197 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550495 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.6
Current children cumulated vsize (KiB) 1508088

[startup+1122.3 s]
/proc/loadavg: 8.19 8.15 8.05 9/184 23391
/proc/meminfo: memFree=16443152/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1508088 CPUtime=4482.27 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 1015967 0 0 0 447913 314 0 0 25 0 4 0 520085537 1544282112 306145 33554432000 4194304 4623224 140736972745408 18446744073709551615 4517479 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 377022 306145 385 105 0 372526 0
[pid=23332/tid=23333] ppid=23330 vsize=1508088 CPUtime=1120.16 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 233597 0 0 0 111912 104 0 0 25 0 4 0 520085537 1544282112 306145 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1508088 CPUtime=1117.49 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 165065 0 0 0 111653 96 0 0 25 0 4 0 520085537 1544282112 306145 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1508088 CPUtime=1122.28 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 416031 0 0 0 112154 74 0 0 25 0 4 0 520085537 1544282112 306145 33554432000 4194304 4623224 140736972745408 18446744073709551615 4577479 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4482.27
Current children cumulated vsize (KiB) 1508088

[startup+1182.3 s]
/proc/loadavg: 8.12 8.14 8.04 9/184 23393
/proc/meminfo: memFree=16389164/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1573624 CPUtime=4721.96 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 1022964 0 0 0 471872 324 0 0 25 0 4 0 520085537 1611390976 313101 33554432000 4194304 4623224 140736972745408 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 393406 313101 385 105 0 388910 0
[pid=23332/tid=23333] ppid=23330 vsize=1573624 CPUtime=1180.16 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 236799 0 0 0 117907 109 0 0 25 0 4 0 520085537 1611390976 313101 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1573624 CPUtime=1177.17 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 168102 0 0 0 117617 100 0 0 25 0 4 0 520085537 1611390976 313101 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1573624 CPUtime=1182.28 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 416272 0 0 0 118154 74 0 0 25 0 4 0 520085537 1611390976 313101 33554432000 4194304 4623224 140736972745408 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4721.96
Current children cumulated vsize (KiB) 1573624



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.08 8.13 8.04 5/179 23394
/proc/meminfo: memFree=17530616/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1573624 CPUtime=4800.26 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 1026959 0 0 0 479699 327 0 0 25 0 4 0 520085537 1611390976 317084 33554432000 4194304 4623224 140736972745408 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 393406 317084 385 105 0 388910 0
[pid=23332/tid=23333] ppid=23330 vsize=1573624 CPUtime=1199.77 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 239715 0 0 0 119865 112 0 0 25 0 4 0 520085537 1611390976 317084 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1573624 CPUtime=1196.67 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 168913 0 0 0 119565 102 0 0 25 0 4 0 520085537 1611390976 317084 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1573624 CPUtime=1201.88 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 416302 0 0 0 120114 74 0 0 25 0 4 0 520085537 1611390976 317084 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377613 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 1573624

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.9 s]
/proc/loadavg: 8.08 8.13 8.04 5/179 23394
/proc/meminfo: memFree=17530616/32951124 swapFree=67111528/67111528
[pid=23332] ppid=23330 vsize=1573624 CPUtime=4800.26 cores=1,3,5,7
/proc/23332/stat : 23332 (SArTagnan) R 23330 23332 22817 0 -1 4202496 1026959 0 0 0 479699 327 0 0 25 0 4 0 520085537 1611390976 317084 33554432000 4194304 4623224 140736972745408 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23332/statm: 393406 317084 385 105 0 388910 0
[pid=23332/tid=23333] ppid=23330 vsize=1573624 CPUtime=1199.77 cores=1,3,5,7
/proc/23332/task/23333/stat : 23333 (SArTagnan) R 23330 23332 22817 0 -1 4202560 239715 0 0 0 119865 112 0 0 25 0 4 0 520085537 1611390976 317084 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23332/tid=23334] ppid=23330 vsize=1573624 CPUtime=1196.67 cores=1,3,5,7
/proc/23332/task/23334/stat : 23334 (SArTagnan) R 23330 23332 22817 0 -1 4202560 168913 0 0 0 119565 102 0 0 25 0 4 0 520085537 1611390976 317084 33554432000 4194304 4623224 140736972745408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23332/tid=23335] ppid=23330 vsize=1573624 CPUtime=1201.88 cores=1,3,5,7
/proc/23332/task/23335/stat : 23335 (SArTagnan) R 23330 23332 22817 0 -1 4202560 416302 0 0 0 120114 74 0 0 25 0 4 0 520085537 1611390976 317084 33554432000 4194304 4623224 140736972745408 18446744073709551615 4377613 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 1573624

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.97
CPU time (s): 4800.35
CPU user time (s): 4797.02
CPU system time (s): 3.33149
CPU usage (%): 399.375
Max. virtual memory (cumulated for all children) (KiB): 1678868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.02
system time used= 3.33149
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1026959
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 389
involuntary context switches= 33404

runsolver used 1.84972 second user time and 4.71428 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-29 15:47:56
IDJOB=3273500
IDBENCH=83140
IDSOLVER=1656
FILE ID=node138/3273500-1304084876
RUNJOBID= node138-1304084875-23323
PBS_JOBID= 13170524
Free space on /tmp= 71816 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n180-s33098896-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273500-1304084876/watcher-3273500-1304084876 -o /tmp/evaluation-result-3273500-1304084876/solver-3273500-1304084876 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3273500-1304084876.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1221fb51c407dee7559369d7c6eedb4e
RANDOM SEED=722210669

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18802276 kB
Buffers:       2041684 kB
Cached:       11478780 kB
SwapCached:          0 kB
Active:        3277024 kB
Inactive:     10307172 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18802276 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:             488 kB
Writeback:           0 kB
AnonPages:       63732 kB
Mapped:          14488 kB
Slab:           500524 kB
PageTables:       4396 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   191184 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71816 MiB
End job on node138 at 2011-04-29 16:08:00