Trace number 3378505

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 1586.83 398.744

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v100-c2130-S1336161514-068.UNKNOWN.cnf
MD5SUMbf9c7e319eca3277c9c5b6246acb470c
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark391.674
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of clauses2130
Sum of the clauses size10650
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52130
Number of clauses of size over 50

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.67	c INFO: solving HOME/instance-3378505-1305465968.cnf
0.36/0.67	c INFO: computing task features
0.36/0.68	c INFO: computed variable-clause graph statistics
0.36/0.68	c INFO: computed clause balance statistics
0.44/0.73	c INFO: computed variable balance statistics
0.44/0.76	c INFO: computed small-clause counts
0.44/0.77	c INFO: computed Horn-clause counts
0.44/0.77	c INFO: computed variable graph statistics
0.44/0.77	c INFO: collected features for HOME/instance-3378505-1305465968.cnf in 0.10 s
0.44/0.78	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.62)
0.44/0.79	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.32)
0.53/0.80	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.07)
0.53/0.81	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.30)
396.35/100.12	c INFO: running march_hi@0 for 679 with 1100 remaining (b = 0.37)
399.37/101.12	c INFO: running march_hi@0 for 679 with 1099 remaining (b = 0.33)
1567.87/394.00	c INFO: running march_hi@99 for 97 with 806 remaining (b = 0.06)
1575.03/395.81	c INFO: running march_hi@0 for 291 with 804 remaining (b = 0.18)
1586.57/398.72	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378505-1305465968/watcher-3378505-1305465968 -o /tmp/evaluation-result-3378505-1305465968/solver-3378505-1305465968 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378505-1305465968.cnf -seed 939559850 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.16 7.96 5/445 29766
/proc/meminfo: memFree=20982700/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=15772 CPUtime=0 cores=1,3,5,7
/proc/29766/stat : 29766 (python) R 29764 29766 28586 0 -1 4202496 920 0 0 0 0 0 0 0 25 0 1 0 736827464 16150528 800 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905390085 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29766/statm: 3943 801 351 364 0 430 0

[startup+0.109774 s]
/proc/loadavg: 8.08 8.16 7.96 5/445 29766
/proc/meminfo: memFree=20982700/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=96948 CPUtime=0.06 cores=1,3,5,7
/proc/29766/stat : 29766 (python) R 29764 29766 28586 0 -1 4202496 2816 0 0 0 4 2 0 0 25 0 1 0 736827464 99274752 2520 33554432000 4194304 5683644 140736229483120 18446744073709551615 4690456 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29766/statm: 24237 2520 790 364 0 1685 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96948

[startup+0.200759 s]
/proc/loadavg: 8.08 8.16 7.96 5/445 29766
/proc/meminfo: memFree=20982700/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=124228 CPUtime=0.12 cores=1,3,5,7
/proc/29766/stat : 29766 (python) R 29764 29766 28586 0 -1 4202496 4271 0 1 0 8 4 0 0 25 0 1 0 736827464 127209472 3878 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905392128 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/29766/statm: 31057 3878 996 364 0 2868 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 124228

[startup+0.300773 s]
/proc/loadavg: 8.08 8.16 7.96 5/445 29766
/proc/meminfo: memFree=20982700/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=135744 CPUtime=0.18 cores=1,3,5,7
/proc/29766/stat : 29766 (python) S 29764 29766 28586 0 -1 4202496 5965 937 1 0 12 6 0 0 17 0 1 0 736827464 139001856 4150 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905390085 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 0
/proc/29766/statm: 33936 4150 1032 364 0 3122 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135744

[startup+0.700664 s]
/proc/loadavg: 8.08 8.16 7.96 5/445 29766
/proc/meminfo: memFree=20982700/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=278428 CPUtime=0.44 cores=1,3,5,7
/proc/29766/stat : 29766 (python) R 29764 29766 28586 0 -1 4202496 9333 937 1 0 33 11 0 0 15 0 1 0 736827464 285110272 7000 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905049516 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29766/statm: 69607 7000 1826 364 0 5531 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 278428

[startup+1.50052 s]
/proc/loadavg: 8.08 8.16 7.96 9/458 29783
/proc/meminfo: memFree=20942916/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=320164 CPUtime=0.53 cores=1,3,5,7
/proc/29766/stat : 29766 (python) S 29764 29766 28586 0 -1 4202496 12154 937 1 0 42 11 0 0 22 0 5 0 736827464 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29766/statm: 80041 7230 1873 364 0 15950 0
[pid=29772] ppid=29766 vsize=278452 CPUtime=0 cores=1,3,5,7
/proc/29772/stat : 29772 (python) S 29766 29766 28586 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 736827542 285134848 5528 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414159 0 0 16781312 514 5055989600535707647 0 0 17 7 0 0 0
/proc/29772/statm: 69613 5528 354 364 0 5531 0
[pid=29774] ppid=29772 vsize=1017800 CPUtime=0.71 cores=1,3,5,7
/proc/29774/stat : 29774 (gnovelty+2) R 29772 29774 29774 0 -1 4202496 435 0 0 0 71 0 0 0 21 0 1 0 736827542 1042227200 171 33554432000 134512640 135663704 4294410432 18446744073709551615 134525353 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29774/statm: 254450 171 113 282 0 254166 0
[pid=29775] ppid=29766 vsize=289276 CPUtime=0 cores=1,3,5,7
/proc/29775/stat : 29775 (python) S 29766 29766 28586 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 736827543 296218624 5676 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 10131960071832174852 0 0 17 7 0 0 0
/proc/29775/statm: 72319 5676 348 364 0 8234 0
[pid=29777] ppid=29775 vsize=1560 CPUtime=0.68 cores=1,3,5,7
/proc/29777/stat : 29777 (march_hi) R 29775 29777 29777 0 -1 4202496 512 0 0 0 68 0 0 0 22 0 1 0 736827543 1597440 240 33554432000 4194304 4955518 140734815571808 18446744073709551615 4297483 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29777/statm: 390 240 106 186 0 203 0
[pid=29778] ppid=29766 vsize=299532 CPUtime=0 cores=1,3,5,7
/proc/29778/stat : 29778 (python) S 29766 29766 28586 0 -1 4202560 738 0 0 0 0 0 0 0 19 0 1 0 736827544 306720768 5680 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 5055981903954313215 0 0 17 5 0 0 0
/proc/29778/statm: 74883 5680 348 364 0 10795 0
[pid=29780] ppid=29778 vsize=1017800 CPUtime=0.69 cores=1,3,5,7
/proc/29780/stat : 29780 (gnovelty+2) R 29778 29780 29780 0 -1 4202496 429 0 0 0 69 0 0 0 22 0 1 0 736827545 1042227200 171 33554432000 134512640 135663704 4286847344 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29780/statm: 254450 171 113 282 0 254166 0
[pid=29781] ppid=29766 vsize=309920 CPUtime=0 cores=1,3,5,7
/proc/29781/stat : 29781 (python) S 29766 29766 28586 0 -1 4202560 752 0 0 0 0 0 0 0 16 0 1 0 736827545 317358080 5701 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 16312609600677314822 0 0 17 5 0 0 0
/proc/29781/statm: 77480 5701 348 364 0 13389 0
[pid=29783] ppid=29781 vsize=1560 CPUtime=0.68 cores=1,3,5,7
/proc/29783/stat : 29783 (march_hi) R 29781 29783 29783 0 -1 4202496 500 0 0 0 68 0 0 0 25 0 1 0 736827545 1597440 241 33554432000 4194304 4955518 140736987863824 18446744073709551615 4224434 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29783/statm: 390 241 106 186 0 203 0
[pid=29766/tid=29773] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29773/stat : 29773 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 5 0 736827542 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29776] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29776/stat : 29776 (python) S 29764 29766 28586 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 5 0 736827543 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29779] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29779/stat : 29779 (python) S 29764 29766 28586 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 5 0 736827544 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29782] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29782/stat : 29782 (python) S 29764 29766 28586 0 -1 4202560 27 937 0 0 0 0 0 0 22 0 5 0 736827545 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3.29
Current children cumulated vsize (KiB) 3536064

[startup+3.10122 s]
/proc/loadavg: 8.08 8.16 7.96 9/458 29783
/proc/meminfo: memFree=20941552/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=320164 CPUtime=0.53 cores=1,3,5,7
/proc/29766/stat : 29766 (python) S 29764 29766 28586 0 -1 4202496 12154 937 1 0 42 11 0 0 22 0 5 0 736827464 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29766/statm: 80041 7230 1873 364 0 15950 0
[pid=29772] ppid=29766 vsize=278452 CPUtime=0 cores=1,3,5,7
/proc/29772/stat : 29772 (python) S 29766 29766 28586 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 736827542 285134848 5528 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414159 0 0 16781312 514 5055989600535675142 0 0 17 7 0 0 0
/proc/29772/statm: 69613 5528 354 364 0 5531 0
[pid=29774] ppid=29772 vsize=1017800 CPUtime=2.31 cores=1,3,5,7
/proc/29774/stat : 29774 (gnovelty+2) R 29772 29774 29774 0 -1 4202496 435 0 0 0 231 0 0 0 25 0 1 0 736827542 1042227200 171 33554432000 134512640 135663704 4294410432 18446744073709551615 134525253 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29774/statm: 254450 171 113 282 0 254166 0
[pid=29775] ppid=29766 vsize=289276 CPUtime=0 cores=1,3,5,7
/proc/29775/stat : 29775 (python) S 29766 29766 28586 0 -1 4202560 754 0 0 0 0 0 0 0 15 0 1 0 736827543 296218624 5676 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 10131960071832174852 0 0 17 7 0 0 0
/proc/29775/statm: 72319 5676 348 364 0 8234 0
[pid=29777] ppid=29775 vsize=1560 CPUtime=2.27 cores=1,3,5,7
/proc/29777/stat : 29777 (march_hi) R 29775 29777 29777 0 -1 4202496 512 0 0 0 227 0 0 0 25 0 1 0 736827543 1597440 240 33554432000 4194304 4955518 140734815571808 18446744073709551615 4235327 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29777/statm: 390 240 106 186 0 203 0
[pid=29778] ppid=29766 vsize=299532 CPUtime=0 cores=1,3,5,7
/proc/29778/stat : 29778 (python) S 29766 29766 28586 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 736827544 306720768 5680 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 5055981903954280711 0 0 17 5 0 0 0
/proc/29778/statm: 74883 5680 348 364 0 10795 0
[pid=29780] ppid=29778 vsize=1017800 CPUtime=2.29 cores=1,3,5,7
/proc/29780/stat : 29780 (gnovelty+2) R 29778 29780 29780 0 -1 4202496 429 0 0 0 229 0 0 0 25 0 1 0 736827545 1042227200 171 33554432000 134512640 135663704 4286847344 18446744073709551615 134545605 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29780/statm: 254450 171 113 282 0 254166 0
[pid=29781] ppid=29766 vsize=309920 CPUtime=0 cores=1,3,5,7
/proc/29781/stat : 29781 (python) S 29766 29766 28586 0 -1 4202560 754 0 0 0 0 0 0 0 15 0 1 0 736827545 317358080 5701 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 16312609600677314822 0 0 17 5 0 0 0
/proc/29781/statm: 77480 5701 348 364 0 13389 0
[pid=29783] ppid=29781 vsize=1560 CPUtime=2.28 cores=1,3,5,7
/proc/29783/stat : 29783 (march_hi) R 29781 29783 29783 0 -1 4202496 500 0 0 0 228 0 0 0 25 0 1 0 736827545 1597440 241 33554432000 4194304 4955518 140736987863824 18446744073709551615 4224450 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29783/statm: 390 241 106 186 0 203 0
[pid=29766/tid=29773] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29773/stat : 29773 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 5 0 736827542 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29776] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29776/stat : 29776 (python) S 29764 29766 28586 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 5 0 736827543 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29779] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29779/stat : 29779 (python) S 29764 29766 28586 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 5 0 736827544 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29782] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29782/stat : 29782 (python) S 29764 29766 28586 0 -1 4202560 27 937 0 0 0 0 0 0 22 0 5 0 736827545 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 9.68
Current children cumulated vsize (KiB) 3536064

[startup+6.30064 s]
/proc/loadavg: 8.15 8.18 7.96 9/458 29784
/proc/meminfo: memFree=20937520/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=320164 CPUtime=0.53 cores=1,3,5,7
/proc/29766/stat : 29766 (python) S 29764 29766 28586 0 -1 4202496 12154 937 1 0 42 11 0 0 22 0 5 0 736827464 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29766/statm: 80041 7230 1873 364 0 15950 0
[pid=29772] ppid=29766 vsize=278452 CPUtime=0.01 cores=1,3,5,7
/proc/29772/stat : 29772 (python) S 29766 29766 28586 0 -1 4202560 892 0 0 0 1 0 0 0 18 0 1 0 736827542 285134848 5551 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414159 0 0 16781312 514 5055989600535675142 0 0 17 7 0 0 0
/proc/29772/statm: 69613 5551 377 364 0 5531 0
[pid=29774] ppid=29772 vsize=1017800 CPUtime=5.51 cores=1,3,5,7
/proc/29774/stat : 29774 (gnovelty+2) R 29772 29774 29774 0 -1 4202496 435 0 0 0 551 0 0 0 25 0 1 0 736827542 1042227200 171 33554432000 134512640 135663704 4294410432 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29774/statm: 254450 171 113 282 0 254166 0
[pid=29775] ppid=29766 vsize=289276 CPUtime=0.01 cores=1,3,5,7
/proc/29775/stat : 29775 (python) S 29766 29766 28586 0 -1 4202560 920 0 0 0 1 0 0 0 15 0 1 0 736827543 296218624 5699 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 10131960071832174852 0 0 17 7 0 0 0
/proc/29775/statm: 72319 5699 371 364 0 8234 0
[pid=29777] ppid=29775 vsize=1692 CPUtime=5.38 cores=1,3,5,7
/proc/29777/stat : 29777 (march_hi) R 29775 29777 29777 0 -1 4202496 522 0 0 0 538 0 0 0 25 0 1 0 736827543 1732608 250 33554432000 4194304 4955518 140734815571808 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29777/statm: 423 250 106 186 0 236 0
[pid=29778] ppid=29766 vsize=299532 CPUtime=0.01 cores=1,3,5,7
/proc/29778/stat : 29778 (python) S 29766 29766 28586 0 -1 4202560 897 0 0 0 1 0 0 0 18 0 1 0 736827544 306720768 5703 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 5055981903954280711 0 0 17 5 0 0 0
/proc/29778/statm: 74883 5703 371 364 0 10795 0
[pid=29780] ppid=29778 vsize=1017800 CPUtime=5.49 cores=1,3,5,7
/proc/29780/stat : 29780 (gnovelty+2) R 29778 29780 29780 0 -1 4202496 429 0 0 0 549 0 0 0 25 0 1 0 736827545 1042227200 171 33554432000 134512640 135663704 4286847344 18446744073709551615 134524901 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29780/statm: 254450 171 113 282 0 254166 0
[pid=29781] ppid=29766 vsize=309920 CPUtime=0.01 cores=1,3,5,7
/proc/29781/stat : 29781 (python) S 29766 29766 28586 0 -1 4202560 914 0 0 0 0 1 0 0 15 0 1 0 736827545 317358080 5724 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 16312609600677314822 0 0 17 5 0 0 0
/proc/29781/statm: 77480 5724 371 364 0 13389 0
[pid=29783] ppid=29781 vsize=1692 CPUtime=5.44 cores=1,3,5,7
/proc/29783/stat : 29783 (march_hi) R 29781 29783 29783 0 -1 4202496 510 0 0 0 544 0 0 0 25 0 1 0 736827545 1732608 251 33554432000 4194304 4955518 140736987863824 18446744073709551615 4224406 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29783/statm: 423 251 106 186 0 236 0
[pid=29766/tid=29773] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29773/stat : 29773 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 5 0 736827542 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29776] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29776/stat : 29776 (python) S 29764 29766 28586 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 5 0 736827543 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29779] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29779/stat : 29779 (python) S 29764 29766 28586 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 5 0 736827544 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29782] ppid=29764 vsize=320164 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29782/stat : 29782 (python) S 29764 29766 28586 0 -1 4202560 27 937 0 0 0 0 0 0 22 0 5 0 736827545 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.39
Current children cumulated vsize (KiB) 3536328

[startup+12.7005 s]
/proc/loadavg: 8.22 8.19 7.97 9/458 29784
/proc/meminfo: memFree=20933796/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=320164 CPUtime=0.53 cores=1,3,5,7
/proc/29766/stat : 29766 (python) S 29764 29766 28586 0 -1 4202496 12154 937 1 0 42 11 0 0 22 0 5 0 736827464 327847936 7230 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29766/statm: 80041 7230 1873 364 0 15950 0
[pid=29772] ppid=29766 vsize=278452 CPUtime=0.03 cores=1,3,5,7
/proc/29772/stat : 29772 (python) S 29766 29766 28586 0 -1 4202560 895 0 0 0 2 1 0 0 18 0 1 0 736827542 285134848 5551 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414159 0 0 16781312 514 10439801333081932038 0 0 17 7 0 0 0
/proc/29772/statm: 69613 5551 377 364 0 5531 0
[pid=29774] ppid=29772 vsize=1017800 CPUtime=11.91 cores=1,3,5,7
/proc/29774/stat : 29774 (gnovelty+2) R 29772 29774 29774 0 -1 4202496 435 0 0 0 1191 0 0 0 25 0 1 0 736827542 1042227200 171 33554432000 134512640 135663704 4294410432 18446744073709551615 134525148 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29774/statm: 254450 171 113 282 0 254166 0
[pid=29775] ppid=29766 vsize=289276 CPUtime=0.04 cores=1,3,5,7

################
# More data... #
################

/proc/29778/statm: 74883 5733 400 364 0 10795 0
[pid=29780] ppid=29778 vsize=1017800 CPUtime=100.3 cores=1,3,5,7
/proc/29780/stat : 29780 (gnovelty+2) T 29778 29780 29780 0 -1 4202496 429 0 0 0 10030 0 0 0 25 0 1 0 736827545 1042227200 171 33554432000 134512640 135663704 4286847344 18446744073709551615 134524534 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29780/statm: 254450 171 113 282 0 254166 0
[pid=29778/tid=29796] ppid=29766 vsize=299532 CPUtime=0 cores=1,3,5,7
/proc/29778/task/29796/stat : 29796 (python) S 29766 29766 28586 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 736837575 306720768 5733 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604462679815360 0 0 -1 3 0 0 0
[pid=29781] ppid=29766 vsize=309920 CPUtime=1.42 cores=1,3,5,7
/proc/29781/stat : 29781 (python) S 29766 29766 28586 0 -1 4202560 1172 0 0 0 79 63 0 0 15 0 2 0 736827545 317358080 5754 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29781/statm: 77480 5754 400 364 0 13389 0
[pid=29783] ppid=29781 vsize=13516 CPUtime=395.33 cores=1,3,5,7
/proc/29783/stat : 29783 (march_hi) R 29781 29783 29783 0 -1 4202496 3195 0 0 0 39533 0 0 0 25 0 1 0 736827545 13840384 2936 33554432000 4194304 4955518 140736987863824 18446744073709551615 4226515 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29783/statm: 3379 2936 106 186 0 3192 0
[pid=29781/tid=29817] ppid=29766 vsize=309920 CPUtime=0 cores=1,3,5,7
/proc/29781/task/29817/stat : 29817 (python) S 29766 29766 28586 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 736866864 317358080 5754 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604465368003648 0 0 -1 5 0 0 0
[pid=29793] ppid=29766 vsize=320176 CPUtime=1.08 cores=1,3,5,7
/proc/29793/stat : 29793 (python) S 29766 29766 28586 0 -1 4202560 1000 0 0 0 62 46 0 0 16 0 1 0 736837477 327860224 5728 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 10439801333081932039 0 0 17 3 0 0 0
/proc/29793/statm: 80044 5728 371 364 0 15950 0
[pid=29795] ppid=29793 vsize=9456 CPUtime=297.32 cores=1,3,5,7
/proc/29795/stat : 29795 (march_hi) R 29793 29795 29795 0 -1 4202496 2069 0 0 0 29732 0 0 0 25 0 1 0 736837477 9682944 1811 33554432000 4194304 4955518 140734950116048 18446744073709551615 4238084 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29795/statm: 2364 1811 106 186 0 2177 0
[pid=29797] ppid=29766 vsize=329908 CPUtime=1.08 cores=1,3,5,7
/proc/29797/stat : 29797 (python) S 29766 29766 28586 0 -1 4202560 1007 0 0 0 60 48 0 0 15 0 1 0 736837576 337825792 5633 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 11019674973772939527 0 0 17 7 0 0 0
/proc/29797/statm: 82477 5633 371 364 0 18380 0
[pid=29799] ppid=29797 vsize=9456 CPUtime=292.25 cores=1,3,5,7
/proc/29799/stat : 29799 (march_hi) R 29797 29799 29799 0 -1 4202496 2020 0 0 0 29225 0 0 0 25 0 1 0 736837577 9682944 1759 33554432000 4194304 4955518 140733912571728 18446744073709551615 4297376 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29799/statm: 2364 1759 106 186 0 2177 0
[pid=29766/tid=29773] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29773/stat : 29773 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 736827542 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29776] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29776/stat : 29776 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 736827543 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29779] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29779/stat : 29779 (python) S 29764 29766 28586 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 7 0 736827544 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29782] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29782/stat : 29782 (python) S 29764 29766 28586 0 -1 4202560 32 937 0 0 0 0 0 0 18 0 7 0 736827545 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29794] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29794/stat : 29794 (python) S 29764 29766 28586 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 7 0 736837477 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29798] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29798/stat : 29798 (python) S 29764 29766 28586 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 7 0 736837577 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1585.37
Current children cumulated vsize (KiB) 4259828

[startup+398.601 s]
/proc/loadavg: 8.32 8.23 8.04 9/480 29819
/proc/meminfo: memFree=20690948/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=340776 CPUtime=0.57 cores=1,3,5,7
/proc/29766/stat : 29766 (python) S 29764 29766 28586 0 -1 4202496 14355 937 1 0 45 12 0 0 18 0 7 0 736827464 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29766/statm: 85194 7290 1878 364 0 21097 0
[pid=29772] ppid=29766 vsize=288696 CPUtime=0.32 cores=1,3,5,7
/proc/29772/stat : 29772 (python) S 29766 29766 28586 0 -1 4202560 1166 0 0 0 19 13 0 0 19 0 2 0 736827542 295624704 5595 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29772/statm: 72174 5595 416 364 0 8092 0
[pid=29774] ppid=29772 vsize=1017800 CPUtime=99.32 cores=1,3,5,7
/proc/29774/stat : 29774 (gnovelty+2) T 29772 29774 29774 0 -1 4202496 435 0 0 0 9932 0 0 0 25 0 1 0 736827542 1042227200 171 33554432000 134512640 135663704 4294410432 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29774/statm: 254450 171 113 282 0 254166 0
[pid=29772/tid=29792] ppid=29766 vsize=288696 CPUtime=0 cores=1,3,5,7
/proc/29772/task/29792/stat : 29792 (python) S 29766 29766 28586 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 736837476 295624704 5595 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604462679817152 0 0 -1 7 0 0 0
[pid=29775] ppid=29766 vsize=289276 CPUtime=1.44 cores=1,3,5,7
/proc/29775/stat : 29775 (python) S 29766 29766 28586 0 -1 4202560 1160 0 0 0 78 66 0 0 15 0 2 0 736827543 296218624 5729 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29775/statm: 72319 5729 400 364 0 8234 0
[pid=29777] ppid=29775 vsize=13516 CPUtime=394.83 cores=1,3,5,7
/proc/29777/stat : 29777 (march_hi) R 29775 29777 29777 0 -1 4202496 3179 0 0 0 39483 0 0 0 25 0 1 0 736827543 13840384 2907 33554432000 4194304 4955518 140734815571808 18446744073709551615 4208669 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29777/statm: 3379 2907 106 186 0 3192 0
[pid=29775/tid=29819] ppid=29766 vsize=289276 CPUtime=0 cores=1,3,5,7
/proc/29775/task/29819/stat : 29819 (python) S 29766 29766 28586 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 736867045 296218624 5729 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604462679816256 0 0 -1 1 0 0 0
[pid=29778] ppid=29766 vsize=299532 CPUtime=0.31 cores=1,3,5,7
/proc/29778/stat : 29778 (python) S 29766 29766 28586 0 -1 4202560 1092 0 0 0 17 14 0 0 19 0 2 0 736827544 306720768 5733 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29778/statm: 74883 5733 400 364 0 10795 0
[pid=29780] ppid=29778 vsize=1017800 CPUtime=100.3 cores=1,3,5,7
/proc/29780/stat : 29780 (gnovelty+2) T 29778 29780 29780 0 -1 4202496 429 0 0 0 10030 0 0 0 25 0 1 0 736827545 1042227200 171 33554432000 134512640 135663704 4286847344 18446744073709551615 134524534 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29780/statm: 254450 171 113 282 0 254166 0
[pid=29778/tid=29796] ppid=29766 vsize=299532 CPUtime=0 cores=1,3,5,7
/proc/29778/task/29796/stat : 29796 (python) S 29766 29766 28586 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 736837575 306720768 5733 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604462679815360 0 0 -1 3 0 0 0
[pid=29781] ppid=29766 vsize=309920 CPUtime=1.42 cores=1,3,5,7
/proc/29781/stat : 29781 (python) S 29766 29766 28586 0 -1 4202560 1174 0 0 0 79 63 0 0 15 0 2 0 736827545 317358080 5754 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29781/statm: 77480 5754 400 364 0 13389 0
[pid=29783] ppid=29781 vsize=13516 CPUtime=395.53 cores=1,3,5,7
/proc/29783/stat : 29783 (march_hi) R 29781 29783 29783 0 -1 4202496 3198 0 0 0 39553 0 0 0 25 0 1 0 736827545 13840384 2939 33554432000 4194304 4955518 140736987863824 18446744073709551615 4224648 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29783/statm: 3379 2939 106 186 0 3192 0
[pid=29781/tid=29817] ppid=29766 vsize=309920 CPUtime=0 cores=1,3,5,7
/proc/29781/task/29817/stat : 29817 (python) S 29766 29766 28586 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 736866864 317358080 5754 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604465368003648 0 0 -1 5 0 0 0
[pid=29793] ppid=29766 vsize=320176 CPUtime=1.08 cores=1,3,5,7
/proc/29793/stat : 29793 (python) S 29766 29766 28586 0 -1 4202560 1000 0 0 0 62 46 0 0 16 0 1 0 736837477 327860224 5728 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 10439801333081932039 0 0 17 3 0 0 0
/proc/29793/statm: 80044 5728 371 364 0 15950 0
[pid=29795] ppid=29793 vsize=9456 CPUtime=297.52 cores=1,3,5,7
/proc/29795/stat : 29795 (march_hi) R 29793 29795 29795 0 -1 4202496 2070 0 0 0 29752 0 0 0 25 0 1 0 736837477 9682944 1812 33554432000 4194304 4955518 140734950116048 18446744073709551615 4315128 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29795/statm: 2364 1812 106 186 0 2177 0
[pid=29797] ppid=29766 vsize=329908 CPUtime=1.08 cores=1,3,5,7
/proc/29797/stat : 29797 (python) S 29766 29766 28586 0 -1 4202560 1007 0 0 0 60 48 0 0 15 0 1 0 736837576 337825792 5633 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 11019674973772939527 0 0 17 7 0 0 0
/proc/29797/statm: 82477 5633 371 364 0 18380 0
[pid=29799] ppid=29797 vsize=9456 CPUtime=292.45 cores=1,3,5,7
/proc/29799/stat : 29799 (march_hi) R 29797 29799 29799 0 -1 4202496 2022 0 0 0 29245 0 0 0 25 0 1 0 736837577 9682944 1761 33554432000 4194304 4955518 140733912571728 18446744073709551615 4224468 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29799/statm: 2364 1761 106 186 0 2177 0
[pid=29766/tid=29773] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29773/stat : 29773 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 736827542 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29776] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29776/stat : 29776 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 736827543 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29779] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29779/stat : 29779 (python) S 29764 29766 28586 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 7 0 736827544 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29782] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29782/stat : 29782 (python) S 29764 29766 28586 0 -1 4202560 32 937 0 0 0 0 0 0 18 0 7 0 736827545 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29794] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29794/stat : 29794 (python) S 29764 29766 28586 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 7 0 736837477 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29798] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29798/stat : 29798 (python) S 29764 29766 28586 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 7 0 736837577 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1586.17
Current children cumulated vsize (KiB) 4259828

[startup+398.701 s]
/proc/loadavg: 8.32 8.23 8.04 9/480 29819
/proc/meminfo: memFree=20690948/32950928 swapFree=65730864/67111528
[pid=29766] ppid=29764 vsize=340776 CPUtime=0.57 cores=1,3,5,7
/proc/29766/stat : 29766 (python) S 29764 29766 28586 0 -1 4202496 14355 937 1 0 45 12 0 0 18 0 7 0 736827464 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29766/statm: 85194 7290 1878 364 0 21097 0
[pid=29772] ppid=29766 vsize=288696 CPUtime=0.32 cores=1,3,5,7
/proc/29772/stat : 29772 (python) S 29766 29766 28586 0 -1 4202560 1166 0 0 0 19 13 0 0 19 0 2 0 736827542 295624704 5595 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29772/statm: 72174 5595 416 364 0 8092 0
[pid=29774] ppid=29772 vsize=1017800 CPUtime=99.32 cores=1,3,5,7
/proc/29774/stat : 29774 (gnovelty+2) T 29772 29774 29774 0 -1 4202496 435 0 0 0 9932 0 0 0 25 0 1 0 736827542 1042227200 171 33554432000 134512640 135663704 4294410432 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29774/statm: 254450 171 113 282 0 254166 0
[pid=29772/tid=29792] ppid=29766 vsize=288696 CPUtime=0 cores=1,3,5,7
/proc/29772/task/29792/stat : 29792 (python) S 29766 29766 28586 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 736837476 295624704 5595 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604462679817152 0 0 -1 7 0 0 0
[pid=29775] ppid=29766 vsize=289276 CPUtime=1.44 cores=1,3,5,7
/proc/29775/stat : 29775 (python) S 29766 29766 28586 0 -1 4202560 1160 0 0 0 78 66 0 0 15 0 2 0 736827543 296218624 5729 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29775/statm: 72319 5729 400 364 0 8234 0
[pid=29777] ppid=29775 vsize=13516 CPUtime=394.93 cores=1,3,5,7
/proc/29777/stat : 29777 (march_hi) R 29775 29777 29777 0 -1 4202496 3180 0 0 0 39493 0 0 0 25 0 1 0 736827543 13840384 2908 33554432000 4194304 4955518 140734815571808 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29777/statm: 3379 2908 106 186 0 3192 0
[pid=29775/tid=29819] ppid=29766 vsize=289276 CPUtime=0 cores=1,3,5,7
/proc/29775/task/29819/stat : 29819 (python) S 29766 29766 28586 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 736867045 296218624 5729 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604462679816256 0 0 -1 1 0 0 0
[pid=29778] ppid=29766 vsize=299532 CPUtime=0.31 cores=1,3,5,7
/proc/29778/stat : 29778 (python) S 29766 29766 28586 0 -1 4202560 1092 0 0 0 17 14 0 0 19 0 2 0 736827544 306720768 5733 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29778/statm: 74883 5733 400 364 0 10795 0
[pid=29780] ppid=29778 vsize=1017800 CPUtime=100.3 cores=1,3,5,7
/proc/29780/stat : 29780 (gnovelty+2) T 29778 29780 29780 0 -1 4202496 429 0 0 0 10030 0 0 0 25 0 1 0 736827545 1042227200 171 33554432000 134512640 135663704 4286847344 18446744073709551615 134524534 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29780/statm: 254450 171 113 282 0 254166 0
[pid=29778/tid=29796] ppid=29766 vsize=299532 CPUtime=0 cores=1,3,5,7
/proc/29778/task/29796/stat : 29796 (python) S 29766 29766 28586 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 736837575 306720768 5733 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604462679815360 0 0 -1 3 0 0 0
[pid=29781] ppid=29766 vsize=309920 CPUtime=1.42 cores=1,3,5,7
/proc/29781/stat : 29781 (python) S 29766 29766 28586 0 -1 4202560 1176 0 0 0 79 63 0 0 15 0 2 0 736827545 317358080 5754 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29781/statm: 77480 5754 400 364 0 13389 0
[pid=29783] ppid=29781 vsize=13516 CPUtime=395.63 cores=1,3,5,7
/proc/29783/stat : 29783 (march_hi) R 29781 29783 29783 0 -1 4202496 3200 0 0 0 39563 0 0 0 25 0 1 0 736827545 13840384 2941 33554432000 4194304 4955518 140736987863824 18446744073709551615 4263575 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29783/statm: 3379 2941 106 186 0 3192 0
[pid=29781/tid=29817] ppid=29766 vsize=309920 CPUtime=0 cores=1,3,5,7
/proc/29781/task/29817/stat : 29817 (python) S 29766 29766 28586 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 736866864 317358080 5754 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 514 18446604465368003648 0 0 -1 5 0 0 0
[pid=29793] ppid=29766 vsize=320176 CPUtime=1.08 cores=1,3,5,7
/proc/29793/stat : 29793 (python) S 29766 29766 28586 0 -1 4202560 1000 0 0 0 62 46 0 0 16 0 1 0 736837477 327860224 5728 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 10439801333081932039 0 0 17 3 0 0 0
/proc/29793/statm: 80044 5728 371 364 0 15950 0
[pid=29795] ppid=29793 vsize=9456 CPUtime=297.62 cores=1,3,5,7
/proc/29795/stat : 29795 (march_hi) R 29793 29795 29795 0 -1 4202496 2070 0 0 0 29762 0 0 0 25 0 1 0 736837477 9682944 1812 33554432000 4194304 4955518 140734950116048 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29795/statm: 2364 1812 106 186 0 2177 0
[pid=29797] ppid=29766 vsize=329908 CPUtime=1.08 cores=1,3,5,7
/proc/29797/stat : 29797 (python) S 29766 29766 28586 0 -1 4202560 1007 0 0 0 60 48 0 0 15 0 1 0 736837576 337825792 5633 33554432000 4194304 5683644 140736229483120 18446744073709551615 260905414214 0 0 16781312 514 11019674973772939527 0 0 17 7 0 0 0
/proc/29797/statm: 82477 5633 371 364 0 18380 0
[pid=29799] ppid=29797 vsize=9456 CPUtime=292.55 cores=1,3,5,7
/proc/29799/stat : 29799 (march_hi) R 29797 29799 29799 0 -1 4202496 2023 0 0 0 29255 0 0 0 25 0 1 0 736837577 9682944 1762 33554432000 4194304 4955518 140733912571728 18446744073709551615 4237830 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29799/statm: 2364 1762 106 186 0 2177 0
[pid=29766/tid=29773] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29773/stat : 29773 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 736827542 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29776] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29776/stat : 29776 (python) S 29764 29766 28586 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 736827543 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 7 0 0 0
[pid=29766/tid=29779] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29779/stat : 29779 (python) S 29764 29766 28586 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 7 0 736827544 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29782] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29782/stat : 29782 (python) S 29764 29766 28586 0 -1 4202560 32 937 0 0 0 0 0 0 18 0 7 0 736827545 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29794] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29794/stat : 29794 (python) S 29764 29766 28586 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 7 0 736837477 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
[pid=29766/tid=29798] ppid=29764 vsize=340776 CPUtime=0 cores=1,3,5,7
/proc/29766/task/29798/stat : 29798 (python) S 29764 29766 28586 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 7 0 736837577 348954624 7290 33554432000 4194304 5683644 140736229483120 18446744073709551615 260917217713 0 0 16781312 2 18446604459312697536 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1586.57
Current children cumulated vsize (KiB) 4259828

Child status: 0
Real time (s): 398.744
CPU time (s): 1586.83
CPU user time (s): 1584.12
CPU system time (s): 2.71159
CPU usage (%): 397.957
Max. virtual memory (cumulated for all children) (KiB): 4259832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1584.12
system time used= 2.71159
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37536
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6448
involuntary context switches= 14729

runsolver used 1.68074 second user time and 3.79742 second system time

The end

Launcher Data 

Begin job on node116 at 2011-05-15 15:26:08
IDJOB=3378505
IDBENCH=82914
IDSOLVER=1859
FILE ID=node116/3378505-1305465968
RUNJOBID= node116-1305463137-28605
PBS_JOBID= 13324982
Free space on /tmp= 73108 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v100-c2130-S1336161514-068.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378505-1305465968/watcher-3378505-1305465968 -o /tmp/evaluation-result-3378505-1305465968/solver-3378505-1305465968 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378505-1305465968.cnf -seed 939559850 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bf9c7e319eca3277c9c5b6246acb470c
RANDOM SEED=939559850

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20982980 kB
Buffers:        126080 kB
Cached:        1337288 kB
SwapCached:      12356 kB
Active:       10809928 kB
Inactive:       920052 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20982980 kB
SwapTotal:    67111528 kB
SwapFree:     65730864 kB
Dirty:           31876 kB
Writeback:          40 kB
AnonPages:    10265000 kB
Mapped:          26552 kB
Slab:           113792 kB
PageTables:      57476 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 116099296 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73076 MiB
End job on node116 at 2011-05-15 15:32:47