Trace number 3378508

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 432.977 140.935

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v50-c4450-S1374457799-001.UNKNOWN.cnf
MD5SUM0448cdbfc0b1241b735cac942d079298
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark33.021
Satisfiable
(Un)Satisfiability was proved
Number of variables50
Number of clauses4450
Sum of the clauses size31150
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 54450

Solver Data 

0.29/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.29/0.47	c INFO: solving HOME/instance-3378508-1305465976.cnf
0.29/0.47	c INFO: computing task features
0.38/0.50	c INFO: computed variable-clause graph statistics
0.38/0.50	c INFO: computed clause balance statistics
0.47/0.66	c INFO: computed variable balance statistics
0.57/0.73	c INFO: computed small-clause counts
0.57/0.73	c INFO: computed Horn-clause counts
0.57/0.73	c INFO: computed variable graph statistics
0.57/0.73	c INFO: collected features for HOME/instance-3378508-1305465976.cnf in 0.26 s
0.57/0.74	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.57)
0.57/0.75	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.09)
0.57/0.76	c INFO: running adaptg2wsat2009++@0 for 97 with 1199 remaining (b = 0.04)
0.57/0.77	c INFO: running adaptg2wsat2009++@0 for 97 with 1199 remaining (b = 0.03)
301.49/101.03	c INFO: running march_hi@0 for 485 with 1099 remaining (b = 0.15)
385.88/125.22	c INFO: running march_hi@0 for 485 with 1075 remaining (b = 0.13)
403.51/131.14	c INFO: running adaptg2wsat2009++@0 for 97 with 1069 remaining (b = 0.02)
432.77/140.91	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378508-1305465976/watcher-3378508-1305465976 -o /tmp/evaluation-result-3378508-1305465976/solver-3378508-1305465976 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378508-1305465976.cnf -seed 1176177376 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.21 7.14 7.52 5/384 28028
/proc/meminfo: memFree=20692668/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=16240 CPUtime=0 cores=1,3,5,7
/proc/28028/stat : 28028 (python) R 28026 28028 27281 0 -1 4202496 1033 0 0 0 0 0 0 0 25 0 1 0 658197203 16629760 906 33554432000 4194304 5683644 140737071522432 18446744073709551615 5259291 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28028/statm: 4060 908 380 364 0 547 0

[startup+0.0463661 s]
/proc/loadavg: 6.21 7.14 7.52 5/384 28028
/proc/meminfo: memFree=20692668/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=29788 CPUtime=0.02 cores=1,3,5,7
/proc/28028/stat : 28028 (python) R 28026 28028 27281 0 -1 4202496 1400 0 0 0 2 0 0 0 17 0 1 0 658197203 30502912 1245 33554432000 4194304 5683644 140737071522432 18446744073709551615 4870133 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28028/statm: 7447 1245 443 364 0 817 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 29788

[startup+0.100362 s]
/proc/loadavg: 6.21 7.14 7.52 5/384 28028
/proc/meminfo: memFree=20692668/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=104220 CPUtime=0.06 cores=1,3,5,7
/proc/28028/stat : 28028 (python) R 28026 28028 27281 0 -1 4202496 3044 0 0 0 5 1 0 0 17 0 1 0 658197203 106721280 2732 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647144448 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28028/statm: 26055 2732 847 364 0 1803 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104220

[startup+0.300331 s]
/proc/loadavg: 6.21 7.14 7.52 5/384 28028
/proc/meminfo: memFree=20692668/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=166544 CPUtime=0.21 cores=1,3,5,7
/proc/28028/stat : 28028 (python) R 28026 28028 27281 0 -1 4202496 6679 934 1 0 16 5 0 0 17 0 1 0 658197203 170541056 4772 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647144448 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28028/statm: 41637 4773 1322 364 0 3454 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 166544

[startup+0.700256 s]
/proc/loadavg: 6.21 7.14 7.52 5/384 28028
/proc/meminfo: memFree=20692668/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=279220 CPUtime=0.57 cores=1,3,5,7
/proc/28028/stat : 28028 (python) R 28026 28028 27281 0 -1 4202496 9528 934 1 0 49 8 0 0 17 0 1 0 658197203 285921280 7200 33554432000 4194304 5683644 140737071522432 18446744073709551615 46974585872640 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28028/statm: 69805 7200 1827 364 0 5729 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 279220

[startup+1.50106 s]
/proc/loadavg: 6.21 7.14 7.52 8/397 28045
/proc/meminfo: memFree=20652752/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=320644 CPUtime=0.64 cores=1,3,5,7
/proc/28028/stat : 28028 (python) S 28026 28028 27281 0 -1 4202496 12413 934 1 0 56 8 0 0 24 0 5 0 658197203 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28028/statm: 80161 7352 1875 364 0 16070 0
[pid=28034] ppid=28028 vsize=279244 CPUtime=0 cores=1,3,5,7
/proc/28034/stat : 28034 (python) S 28028 28028 27281 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 658197277 285945856 5727 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166479 0 0 16781312 514 12192533372970467327 0 0 17 5 0 0 0
/proc/28034/statm: 69811 5727 354 364 0 5729 0
[pid=28036] ppid=28034 vsize=1017932 CPUtime=0.75 cores=1,3,5,7
/proc/28036/stat : 28036 (gnovelty+2) R 28034 28036 28036 0 -1 4202496 488 0 0 0 75 0 0 0 21 0 1 0 658197277 1042362368 226 33554432000 134512640 135663704 4287720512 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28036/statm: 254483 226 113 282 0 254199 0
[pid=28037] ppid=28028 vsize=289888 CPUtime=0 cores=1,3,5,7
/proc/28037/stat : 28037 (python) S 28028 28028 27281 0 -1 4202560 733 0 0 0 0 0 0 0 20 0 1 0 658197278 296845312 5813 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 13818962858613932031 0 0 17 7 0 0 0
/proc/28037/statm: 72472 5813 348 364 0 8387 0
[pid=28039] ppid=28037 vsize=1017932 CPUtime=0.41 cores=1,3,5,7
/proc/28039/stat : 28039 (gnovelty+2) R 28037 28039 28039 0 -1 4202496 488 0 0 0 41 0 0 0 22 0 1 0 658197278 1042362368 227 33554432000 134512640 135663704 4289607952 18446744073709551615 134525684 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28039/statm: 254483 227 113 282 0 254199 0
[pid=28040] ppid=28028 vsize=300144 CPUtime=0 cores=1,3,5,7
/proc/28040/stat : 28040 (python) S 28028 28028 27281 0 -1 4202560 717 0 0 0 0 0 0 0 22 0 1 0 658197279 307347456 5813 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2765768452529455103 0 0 17 5 0 0 0
/proc/28040/statm: 75036 5813 344 364 0 10948 0
[pid=28044] ppid=28040 vsize=416524 CPUtime=0.71 cores=1,3,5,7
/proc/28044/stat : 28044 (adaptg2wsat2009) R 28040 28044 28044 0 -1 4202496 582 0 0 0 71 0 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4293838592 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/28044/statm: 104131 321 59 146 0 103007 0
[pid=28042] ppid=28028 vsize=310400 CPUtime=0 cores=1,3,5,7
/proc/28042/stat : 28042 (python) S 28028 28028 27281 0 -1 4202560 721 0 0 0 0 0 0 0 24 0 1 0 658197280 317849600 5817 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2765764604238757887 0 0 17 5 0 0 0
/proc/28042/statm: 77600 5817 344 364 0 13509 0
[pid=28045] ppid=28042 vsize=416520 CPUtime=0.32 cores=1,3,5,7
/proc/28045/stat : 28045 (adaptg2wsat2009) R 28042 28045 28045 0 -1 4202496 526 0 0 0 32 0 0 0 25 0 1 0 658197280 426516480 265 33554432000 134512640 135107411 4291185904 18446744073709551615 134523245 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28045/statm: 104130 265 49 146 0 103006 0
[pid=28028/tid=28035] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28035/stat : 28035 (python) S 28026 28028 27281 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 5 0 658197277 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28038] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28038/stat : 28038 (python) S 28026 28028 27281 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 5 0 658197278 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 7 0 0 0
[pid=28028/tid=28041] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28041/stat : 28041 (python) S 28026 28028 27281 0 -1 4202560 40 934 0 0 0 0 0 0 23 0 5 0 658197279 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28043] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28043/stat : 28043 (python) S 28026 28028 27281 0 -1 4202560 17 934 0 0 0 0 0 0 25 0 5 0 658197280 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 4369228

[startup+3.10079 s]
/proc/loadavg: 6.21 7.14 7.52 8/397 28045
/proc/meminfo: memFree=20650892/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=320644 CPUtime=0.64 cores=1,3,5,7
/proc/28028/stat : 28028 (python) S 28026 28028 27281 0 -1 4202496 12413 934 1 0 56 8 0 0 24 0 5 0 658197203 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28028/statm: 80161 7352 1875 364 0 16070 0
[pid=28034] ppid=28028 vsize=279244 CPUtime=0 cores=1,3,5,7
/proc/28034/stat : 28034 (python) S 28028 28028 27281 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 658197277 285945856 5727 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166479 0 0 16781312 514 12192533372970434823 0 0 17 5 0 0 0
/proc/28034/statm: 69811 5727 354 364 0 5729 0
[pid=28036] ppid=28034 vsize=1017932 CPUtime=2.35 cores=1,3,5,7
/proc/28036/stat : 28036 (gnovelty+2) R 28034 28036 28036 0 -1 4202496 488 0 0 0 235 0 0 0 25 0 1 0 658197277 1042362368 226 33554432000 134512640 135663704 4287720512 18446744073709551615 134525116 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28036/statm: 254483 226 113 282 0 254199 0
[pid=28037] ppid=28028 vsize=289888 CPUtime=0 cores=1,3,5,7
/proc/28037/stat : 28037 (python) S 28028 28028 27281 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 658197278 296845312 5813 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 13818962858613899525 0 0 17 7 0 0 0
/proc/28037/statm: 72472 5813 348 364 0 8387 0
[pid=28039] ppid=28037 vsize=1017932 CPUtime=1.21 cores=1,3,5,7
/proc/28039/stat : 28039 (gnovelty+2) R 28037 28039 28039 0 -1 4202496 488 0 0 0 121 0 0 0 25 0 1 0 658197278 1042362368 227 33554432000 134512640 135663704 4289607952 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28039/statm: 254483 227 113 282 0 254199 0
[pid=28040] ppid=28028 vsize=300144 CPUtime=0 cores=1,3,5,7
/proc/28040/stat : 28040 (python) S 28028 28028 27281 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 658197279 307347456 5817 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2765768452529422599 0 0 17 5 0 0 0
/proc/28040/statm: 75036 5817 348 364 0 10948 0
[pid=28044] ppid=28040 vsize=416524 CPUtime=2.31 cores=1,3,5,7
/proc/28044/stat : 28044 (adaptg2wsat2009) R 28040 28044 28044 0 -1 4202496 582 0 0 0 231 0 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4293838592 18446744073709551615 134531741 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/28044/statm: 104131 321 59 146 0 103007 0
[pid=28042] ppid=28028 vsize=310400 CPUtime=0 cores=1,3,5,7
/proc/28042/stat : 28042 (python) S 28028 28028 27281 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 658197280 317849600 5821 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2765764604238725383 0 0 17 5 0 0 0
/proc/28042/statm: 77600 5821 348 364 0 13509 0
[pid=28045] ppid=28042 vsize=416524 CPUtime=1.12 cores=1,3,5,7
/proc/28045/stat : 28045 (adaptg2wsat2009) R 28042 28045 28045 0 -1 4202496 582 0 0 0 112 0 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4291185904 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28045/statm: 104131 321 59 146 0 103007 0
[pid=28028/tid=28035] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28035/stat : 28035 (python) S 28026 28028 27281 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 5 0 658197277 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28038] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28038/stat : 28038 (python) S 28026 28028 27281 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 5 0 658197278 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 7 0 0 0
[pid=28028/tid=28041] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28041/stat : 28041 (python) S 28026 28028 27281 0 -1 4202560 40 934 0 0 0 0 0 0 23 0 5 0 658197279 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28043] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28043/stat : 28043 (python) S 28026 28028 27281 0 -1 4202560 17 934 0 0 0 0 0 0 25 0 5 0 658197280 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7.63
Current children cumulated vsize (KiB) 4369232

[startup+6.30126 s]
/proc/loadavg: 6.27 7.14 7.51 8/397 28045
/proc/meminfo: memFree=20647104/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=320644 CPUtime=0.64 cores=1,3,5,7
/proc/28028/stat : 28028 (python) S 28026 28028 27281 0 -1 4202496 12413 934 1 0 56 8 0 0 24 0 5 0 658197203 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28028/statm: 80161 7352 1875 364 0 16070 0
[pid=28034] ppid=28028 vsize=279244 CPUtime=0 cores=1,3,5,7
/proc/28034/stat : 28034 (python) S 28028 28028 27281 0 -1 4202560 897 0 0 0 0 0 0 0 18 0 1 0 658197277 285945856 5750 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166479 0 0 16781312 514 12192533372970434823 0 0 17 5 0 0 0
/proc/28034/statm: 69811 5750 377 364 0 5729 0
[pid=28036] ppid=28034 vsize=1017932 CPUtime=5.55 cores=1,3,5,7
/proc/28036/stat : 28036 (gnovelty+2) R 28034 28036 28036 0 -1 4202496 488 0 0 0 555 0 0 0 25 0 1 0 658197277 1042362368 226 33554432000 134512640 135663704 4287720512 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28036/statm: 254483 226 113 282 0 254199 0
[pid=28037] ppid=28028 vsize=289888 CPUtime=0.01 cores=1,3,5,7
/proc/28037/stat : 28037 (python) S 28028 28028 27281 0 -1 4202560 909 0 0 0 1 0 0 0 18 0 1 0 658197278 296845312 5836 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 13818962858613899525 0 0 17 7 0 0 0
/proc/28037/statm: 72472 5836 371 364 0 8387 0
[pid=28039] ppid=28037 vsize=1017932 CPUtime=2.81 cores=1,3,5,7
/proc/28039/stat : 28039 (gnovelty+2) R 28037 28039 28039 0 -1 4202496 488 0 0 0 281 0 0 0 25 0 1 0 658197278 1042362368 227 33554432000 134512640 135663704 4289607952 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28039/statm: 254483 227 113 282 0 254199 0
[pid=28040] ppid=28028 vsize=300144 CPUtime=0.01 cores=1,3,5,7
/proc/28040/stat : 28040 (python) S 28028 28028 27281 0 -1 4202560 906 0 0 0 0 1 0 0 18 0 1 0 658197279 307347456 5840 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2765768452529422599 0 0 17 5 0 0 0
/proc/28040/statm: 75036 5840 371 364 0 10948 0
[pid=28044] ppid=28040 vsize=416524 CPUtime=5.46 cores=1,3,5,7
/proc/28044/stat : 28044 (adaptg2wsat2009) R 28040 28044 28044 0 -1 4202496 582 0 0 0 546 0 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4293838592 18446744073709551615 134531856 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/28044/statm: 104131 321 59 146 0 103007 0
[pid=28042] ppid=28028 vsize=310400 CPUtime=0.01 cores=1,3,5,7
/proc/28042/stat : 28042 (python) S 28028 28028 27281 0 -1 4202560 911 0 0 0 1 0 0 0 18 0 1 0 658197280 317849600 5844 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2765764604238725383 0 0 17 5 0 0 0
/proc/28042/statm: 77600 5844 371 364 0 13509 0
[pid=28045] ppid=28042 vsize=416524 CPUtime=2.72 cores=1,3,5,7
/proc/28045/stat : 28045 (adaptg2wsat2009) R 28042 28045 28045 0 -1 4202496 582 0 0 0 272 0 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4291185904 18446744073709551615 134532288 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28045/statm: 104131 321 59 146 0 103007 0
[pid=28028/tid=28035] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28035/stat : 28035 (python) S 28026 28028 27281 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 5 0 658197277 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28038] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28038/stat : 28038 (python) S 28026 28028 27281 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 5 0 658197278 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 7 0 0 0
[pid=28028/tid=28041] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28041/stat : 28041 (python) S 28026 28028 27281 0 -1 4202560 40 934 0 0 0 0 0 0 23 0 5 0 658197279 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28043] ppid=28026 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28043/stat : 28043 (python) S 28026 28028 27281 0 -1 4202560 17 934 0 0 0 0 0 0 25 0 5 0 658197280 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 17.21
Current children cumulated vsize (KiB) 4369232

[startup+12.7012 s]
/proc/loadavg: 6.49 7.17 7.52 8/397 28045
/proc/meminfo: memFree=20643756/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=320644 CPUtime=0.64 cores=1,3,5,7
/proc/28028/stat : 28028 (python) S 28026 28028 27281 0 -1 4202496 12413 934 1 0 56 8 0 0 24 0 5 0 658197203 328339456 7352 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28028/statm: 80161 7352 1875 364 0 16070 0
[pid=28034] ppid=28028 vsize=279244 CPUtime=0.02 cores=1,3,5,7
/proc/28034/stat : 28034 (python) S 28028 28028 27281 0 -1 4202560 901 0 0 0 1 1 0 0 18 0 1 0 658197277 285945856 5750 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166479 0 0 16781312 514 3023463462337478919 0 0 17 5 0 0 0
/proc/28034/statm: 69811 5750 377 364 0 5729 0
[pid=28036] ppid=28034 vsize=1017932 CPUtime=11.95 cores=1,3,5,7
/proc/28036/stat : 28036 (gnovelty+2) R 28034 28036 28036 0 -1 4202496 488 0 0 0 1195 0 0 0 25 0 1 0 658197277 1042362368 226 33554432000 134512640 135663704 4287720512 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28036/statm: 254483 226 113 282 0 254199 0
[pid=28037] ppid=28028 vsize=289888 CPUtime=0.02 cores=1,3,5,7

################
# More data... #
################

[pid=28054] ppid=28028 vsize=330912 CPUtime=0.05 cores=1,3,5,7
/proc/28054/stat : 28054 (python) S 28028 28028 27281 0 -1 4202560 923 0 0 0 3 2 0 0 15 0 1 0 658209725 338853888 5852 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 9437517323821875461 0 0 17 5 0 0 0
/proc/28054/statm: 82728 5852 371 364 0 18631 0
[pid=28056] ppid=28054 vsize=2264 CPUtime=11.64 cores=1,3,5,7
/proc/28056/stat : 28056 (march_hi) R 28054 28056 28056 0 -1 4202496 985 0 0 0 1164 0 0 0 25 0 1 0 658209726 2318336 391 33554432000 4194304 4955518 140733778084720 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/28056/statm: 566 391 106 186 0 379 0
[pid=28058] ppid=28028 vsize=341168 CPUtime=0.01 cores=1,3,5,7
/proc/28058/stat : 28058 (python) S 28028 28028 27281 0 -1 4202560 907 0 0 0 0 1 0 0 18 0 1 0 658210317 349356032 5856 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2962156347535098118 0 0 17 5 0 0 0
/proc/28058/statm: 85292 5856 371 364 0 21192 0
[pid=28060] ppid=28058 vsize=416524 CPUtime=4.37 cores=1,3,5,7
/proc/28060/stat : 28060 (adaptg2wsat2009) R 28058 28060 28060 0 -1 4202496 584 0 0 0 437 0 0 0 25 0 1 0 658210318 426520576 321 33554432000 134512640 135107411 4287847600 18446744073709551615 134531942 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28060/statm: 104131 321 59 146 0 103007 0
[pid=28028/tid=28035] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28035/stat : 28035 (python) S 28026 28028 27281 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 8 0 658197277 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28038] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28038/stat : 28038 (python) S 28026 28028 27281 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 8 0 658197278 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 7 0 0 0
[pid=28028/tid=28041] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28041/stat : 28041 (python) S 28026 28028 27281 0 -1 4202560 40 934 0 0 0 0 0 0 23 0 8 0 658197279 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28043] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28043/stat : 28043 (python) S 28026 28028 27281 0 -1 4202560 17 934 0 0 0 0 0 0 25 0 8 0 658197280 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28051] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28051/stat : 28051 (python) S 28026 28028 27281 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 8 0 658207307 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28055] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28055/stat : 28055 (python) S 28026 28028 27281 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 8 0 658209725 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28059] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28059/stat : 28059 (python) S 28026 28028 27281 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 8 0 658210318 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 429.77
Current children cumulated vsize (KiB) 5821768

[startup+140.702 s]
/proc/loadavg: 7.00 7.14 7.46 10/409 28060
/proc/meminfo: memFree=20567088/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=351412 CPUtime=0.68 cores=1,3,5,7
/proc/28028/stat : 28028 (python) S 28026 28028 27281 0 -1 4202496 14920 934 1 0 59 9 0 0 19 0 8 0 658197203 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28028/statm: 87853 7371 1882 364 0 23753 0
[pid=28034] ppid=28028 vsize=289488 CPUtime=0.28 cores=1,3,5,7
/proc/28034/stat : 28034 (python) S 28028 28028 27281 0 -1 4202560 1167 0 0 0 14 14 0 0 19 0 2 0 658197277 296435712 5794 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28034/statm: 72372 5794 416 364 0 8290 0
[pid=28036] ppid=28034 vsize=1017932 CPUtime=100.28 cores=1,3,5,7
/proc/28036/stat : 28036 (gnovelty+2) T 28034 28036 28036 0 -1 4202496 488 0 0 0 10028 0 0 0 25 0 1 0 658197277 1042362368 226 33554432000 134512640 135663704 4287720512 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/28036/statm: 254483 226 113 282 0 254199 0
[pid=28034/tid=28049] ppid=28028 vsize=289488 CPUtime=0 cores=1,3,5,7
/proc/28034/task/28049/stat : 28049 (python) S 28028 28028 27281 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 658207306 296435712 5794 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 514 18446604460046455936 0 0 -1 5 0 0 0
[pid=28037] ppid=28028 vsize=289888 CPUtime=0.4 cores=1,3,5,7
/proc/28037/stat : 28037 (python) S 28028 28028 27281 0 -1 4202560 956 0 0 0 20 20 0 0 18 0 1 0 658197278 296845312 5836 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 3023463462337478917 0 0 17 1 0 0 0
/proc/28037/statm: 72472 5836 371 364 0 8387 0
[pid=28039] ppid=28037 vsize=1017932 CPUtime=75.3 cores=1,3,5,7
/proc/28039/stat : 28039 (gnovelty+2) R 28037 28039 28039 0 -1 4202496 488 0 0 0 7522 8 0 0 25 0 1 0 658197278 1042362368 227 33554432000 134512640 135663704 4289607952 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28039/statm: 254483 227 113 282 0 254199 0
[pid=28040] ppid=28028 vsize=300144 CPUtime=0.36 cores=1,3,5,7
/proc/28040/stat : 28040 (python) S 28028 28028 27281 0 -1 4202560 1107 0 0 0 19 17 0 0 19 0 2 0 658197279 307347456 5870 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28040/statm: 75036 5870 400 364 0 10948 0
[pid=28044] ppid=28040 vsize=416524 CPUtime=98.98 cores=1,3,5,7
/proc/28044/stat : 28044 (adaptg2wsat2009) T 28040 28044 28044 0 -1 4202496 582 0 0 0 9898 0 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4293838592 18446744073709551615 134531600 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/28044/statm: 104131 321 59 146 0 103007 0
[pid=28040/tid=28057] ppid=28028 vsize=300144 CPUtime=0 cores=1,3,5,7
/proc/28040/task/28057/stat : 28057 (python) S 28028 28028 27281 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 658210316 307347456 5870 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 514 18446604462146583488 0 0 -1 5 0 0 0
[pid=28042] ppid=28028 vsize=310400 CPUtime=0.35 cores=1,3,5,7
/proc/28042/stat : 28042 (python) S 28028 28028 27281 0 -1 4202560 1103 0 0 0 18 17 0 0 19 0 2 0 658197280 317849600 5874 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28042/statm: 77600 5874 400 364 0 13509 0
[pid=28045] ppid=28042 vsize=416524 CPUtime=101.76 cores=1,3,5,7
/proc/28045/stat : 28045 (adaptg2wsat2009) T 28042 28045 28045 0 -1 4202496 582 0 0 0 10169 7 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4291185904 18446744073709551615 134531928 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/28045/statm: 104131 321 59 146 0 103007 0
[pid=28042/tid=28053] ppid=28028 vsize=310400 CPUtime=0 cores=1,3,5,7
/proc/28042/task/28053/stat : 28053 (python) S 28028 28028 27281 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 658209724 317849600 5874 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 514 18446604462146582592 0 0 -1 1 0 0 0
[pid=28050] ppid=28028 vsize=320656 CPUtime=2.5 cores=1,3,5,7
/proc/28050/stat : 28050 (python) R 28028 28028 27281 0 -1 4202560 949 0 0 0 216 34 0 0 18 0 1 0 658207306 328351744 5848 33554432000 4194304 5683644 140737071522432 18446744073709551615 4962948 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/28050/statm: 80164 5848 371 364 0 16070 0
[pid=28052] ppid=28050 vsize=0 CPUtime=34.02 cores=1,3,5,7
/proc/28052/stat : 28052 (march_hi) R 28050 28052 28052 0 -1 4202500 988 0 0 0 3402 0 0 0 25 0 1 0 658207309 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/28052/statm: 0 0 0 0 0 0 0
[pid=28054] ppid=28028 vsize=330912 CPUtime=0.05 cores=1,3,5,7
/proc/28054/stat : 28054 (python) S 28028 28028 27281 0 -1 4202560 923 0 0 0 3 2 0 0 15 0 1 0 658209725 338853888 5852 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 9437517323821875461 0 0 17 5 0 0 0
/proc/28054/statm: 82728 5852 371 364 0 18631 0
[pid=28056] ppid=28054 vsize=2264 CPUtime=12.45 cores=1,3,5,7
/proc/28056/stat : 28056 (march_hi) R 28054 28056 28056 0 -1 4202496 985 0 0 0 1245 0 0 0 25 0 1 0 658209726 2318336 391 33554432000 4194304 4955518 140733778084720 18446744073709551615 4237796 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/28056/statm: 566 391 106 186 0 379 0
[pid=28058] ppid=28028 vsize=341168 CPUtime=0.01 cores=1,3,5,7
/proc/28058/stat : 28058 (python) S 28028 28028 27281 0 -1 4202560 907 0 0 0 0 1 0 0 18 0 1 0 658210317 349356032 5856 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2962156347535098118 0 0 17 5 0 0 0
/proc/28058/statm: 85292 5856 371 364 0 21192 0
[pid=28060] ppid=28058 vsize=416524 CPUtime=4.78 cores=1,3,5,7
/proc/28060/stat : 28060 (adaptg2wsat2009) R 28058 28060 28060 0 -1 4202496 584 0 0 0 478 0 0 0 25 0 1 0 658210318 426520576 321 33554432000 134512640 135107411 4287847600 18446744073709551615 134532304 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28060/statm: 104131 321 59 146 0 103007 0
[pid=28028/tid=28035] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28035/stat : 28035 (python) S 28026 28028 27281 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 8 0 658197277 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28038] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28038/stat : 28038 (python) S 28026 28028 27281 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 8 0 658197278 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 7 0 0 0
[pid=28028/tid=28041] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28041/stat : 28041 (python) S 28026 28028 27281 0 -1 4202560 40 934 0 0 0 0 0 0 23 0 8 0 658197279 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28043] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28043/stat : 28043 (python) S 28026 28028 27281 0 -1 4202560 17 934 0 0 0 0 0 0 25 0 8 0 658197280 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28051] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28051/stat : 28051 (python) S 28026 28028 27281 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 8 0 658207307 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28055] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28055/stat : 28055 (python) S 28026 28028 27281 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 8 0 658209725 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28059] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28059/stat : 28059 (python) S 28026 28028 27281 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 8 0 658210318 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 432.2
Current children cumulated vsize (KiB) 5821768

[startup+140.902 s]
/proc/loadavg: 7.00 7.14 7.46 10/409 28060
/proc/meminfo: memFree=20567088/32951132 swapFree=64495980/67111528
[pid=28028] ppid=28026 vsize=351412 CPUtime=0.68 cores=1,3,5,7
/proc/28028/stat : 28028 (python) S 28026 28028 27281 0 -1 4202496 14920 934 1 0 59 9 0 0 19 0 8 0 658197203 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28028/statm: 87853 7371 1882 364 0 23753 0
[pid=28034] ppid=28028 vsize=289488 CPUtime=0.28 cores=1,3,5,7
/proc/28034/stat : 28034 (python) S 28028 28028 27281 0 -1 4202560 1167 0 0 0 14 14 0 0 19 0 2 0 658197277 296435712 5794 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28034/statm: 72372 5794 416 364 0 8290 0
[pid=28036] ppid=28034 vsize=1017932 CPUtime=100.28 cores=1,3,5,7
/proc/28036/stat : 28036 (gnovelty+2) T 28034 28036 28036 0 -1 4202496 488 0 0 0 10028 0 0 0 25 0 1 0 658197277 1042362368 226 33554432000 134512640 135663704 4287720512 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/28036/statm: 254483 226 113 282 0 254199 0
[pid=28034/tid=28049] ppid=28028 vsize=289488 CPUtime=0 cores=1,3,5,7
/proc/28034/task/28049/stat : 28049 (python) S 28028 28028 27281 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 658207306 296435712 5794 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 514 18446604460046455936 0 0 -1 5 0 0 0
[pid=28037] ppid=28028 vsize=289888 CPUtime=0.4 cores=1,3,5,7
/proc/28037/stat : 28037 (python) S 28028 28028 27281 0 -1 4202560 956 0 0 0 20 20 0 0 18 0 1 0 658197278 296845312 5836 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 3023463462337478917 0 0 17 1 0 0 0
/proc/28037/statm: 72472 5836 371 364 0 8387 0
[pid=28039] ppid=28037 vsize=1017932 CPUtime=75.4 cores=1,3,5,7
/proc/28039/stat : 28039 (gnovelty+2) R 28037 28039 28039 0 -1 4202496 488 0 0 0 7532 8 0 0 25 0 1 0 658197278 1042362368 227 33554432000 134512640 135663704 4289607952 18446744073709551615 134524553 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28039/statm: 254483 227 113 282 0 254199 0
[pid=28040] ppid=28028 vsize=300144 CPUtime=0.36 cores=1,3,5,7
/proc/28040/stat : 28040 (python) S 28028 28028 27281 0 -1 4202560 1107 0 0 0 19 17 0 0 19 0 2 0 658197279 307347456 5870 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28040/statm: 75036 5870 400 364 0 10948 0
[pid=28044] ppid=28040 vsize=416524 CPUtime=98.98 cores=1,3,5,7
/proc/28044/stat : 28044 (adaptg2wsat2009) T 28040 28044 28044 0 -1 4202496 582 0 0 0 9898 0 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4293838592 18446744073709551615 134531600 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/28044/statm: 104131 321 59 146 0 103007 0
[pid=28040/tid=28057] ppid=28028 vsize=300144 CPUtime=0 cores=1,3,5,7
/proc/28040/task/28057/stat : 28057 (python) S 28028 28028 27281 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 658210316 307347456 5870 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 514 18446604462146583488 0 0 -1 5 0 0 0
[pid=28042] ppid=28028 vsize=310400 CPUtime=0.35 cores=1,3,5,7
/proc/28042/stat : 28042 (python) S 28028 28028 27281 0 -1 4202560 1103 0 0 0 18 17 0 0 19 0 2 0 658197280 317849600 5874 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28042/statm: 77600 5874 400 364 0 13509 0
[pid=28045] ppid=28042 vsize=416524 CPUtime=101.76 cores=1,3,5,7
/proc/28045/stat : 28045 (adaptg2wsat2009) T 28042 28045 28045 0 -1 4202496 582 0 0 0 10169 7 0 0 25 0 1 0 658197280 426520576 321 33554432000 134512640 135107411 4291185904 18446744073709551615 134531928 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/28045/statm: 104131 321 59 146 0 103007 0
[pid=28042/tid=28053] ppid=28028 vsize=310400 CPUtime=0 cores=1,3,5,7
/proc/28042/task/28053/stat : 28053 (python) S 28028 28028 27281 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 658209724 317849600 5874 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 514 18446604462146582592 0 0 -1 1 0 0 0
[pid=28050] ppid=28028 vsize=320656 CPUtime=2.69 cores=1,3,5,7
/proc/28050/stat : 28050 (python) R 28028 28028 27281 0 -1 4202560 949 0 0 0 232 37 0 0 18 0 1 0 658207306 328351744 5848 33554432000 4194304 5683644 140737071522432 18446744073709551615 4299507 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/28050/statm: 80164 5848 371 364 0 16070 0
[pid=28052] ppid=28050 vsize=0 CPUtime=34.02 cores=1,3,5,7
/proc/28052/stat : 28052 (march_hi) R 28050 28052 28052 0 -1 4202500 988 0 0 0 3402 0 0 0 25 0 1 0 658207309 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/28052/statm: 0 0 0 0 0 0 0
[pid=28054] ppid=28028 vsize=330912 CPUtime=0.05 cores=1,3,5,7
/proc/28054/stat : 28054 (python) S 28028 28028 27281 0 -1 4202560 923 0 0 0 3 2 0 0 15 0 1 0 658209725 338853888 5852 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 9437517323821875461 0 0 17 5 0 0 0
/proc/28054/statm: 82728 5852 371 364 0 18631 0
[pid=28056] ppid=28054 vsize=2264 CPUtime=12.64 cores=1,3,5,7
/proc/28056/stat : 28056 (march_hi) R 28054 28056 28056 0 -1 4202496 985 0 0 0 1264 0 0 0 25 0 1 0 658209726 2318336 391 33554432000 4194304 4955518 140733778084720 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/28056/statm: 566 391 106 186 0 379 0
[pid=28058] ppid=28028 vsize=341168 CPUtime=0.01 cores=1,3,5,7
/proc/28058/stat : 28058 (python) S 28028 28028 27281 0 -1 4202560 907 0 0 0 0 1 0 0 18 0 1 0 658210317 349356032 5856 33554432000 4194304 5683644 140737071522432 18446744073709551615 210647166534 0 0 16781312 514 2962156347535098118 0 0 17 5 0 0 0
/proc/28058/statm: 85292 5856 371 364 0 21192 0
[pid=28060] ppid=28058 vsize=416524 CPUtime=4.87 cores=1,3,5,7
/proc/28060/stat : 28060 (adaptg2wsat2009) R 28058 28060 28060 0 -1 4202496 584 0 0 0 487 0 0 0 25 0 1 0 658210318 426520576 321 33554432000 134512640 135107411 4287847600 18446744073709551615 134532135 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28060/statm: 104131 321 59 146 0 103007 0
[pid=28028/tid=28035] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28035/stat : 28035 (python) S 28026 28028 27281 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 8 0 658197277 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28038] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28038/stat : 28038 (python) S 28026 28028 27281 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 8 0 658197278 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 7 0 0 0
[pid=28028/tid=28041] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28041/stat : 28041 (python) S 28026 28028 27281 0 -1 4202560 40 934 0 0 0 0 0 0 23 0 8 0 658197279 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28043] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28043/stat : 28043 (python) S 28026 28028 27281 0 -1 4202560 17 934 0 0 0 0 0 0 25 0 8 0 658197280 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28051] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28051/stat : 28051 (python) S 28026 28028 27281 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 8 0 658207307 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28055] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28055/stat : 28055 (python) S 28026 28028 27281 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 8 0 658209725 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
[pid=28028/tid=28059] ppid=28026 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/28028/task/28059/stat : 28059 (python) S 28026 28028 27281 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 8 0 658210318 359845888 7371 33554432000 4194304 5683644 140737071522432 18446744073709551615 210658970033 0 0 16781312 2 18446604470479688768 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 432.77
Current children cumulated vsize (KiB) 5821768

Child status: 0
Real time (s): 140.935
CPU time (s): 432.977
CPU user time (s): 431.577
CPU system time (s): 1.39979
CPU usage (%): 307.219
Max. virtual memory (cumulated for all children) (KiB): 5824032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 431.577
system time used= 1.39979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 32520
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2644
involuntary context switches= 3848

runsolver used 0.545917 second user time and 1.16182 second system time

The end

Launcher Data 

Begin job on node129 at 2011-05-15 15:26:16
IDJOB=3378508
IDBENCH=82917
IDSOLVER=1859
FILE ID=node129/3378508-1305465976
RUNJOBID= node129-1305463314-27300
PBS_JOBID= 13324993
Free space on /tmp= 73364 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v50-c4450-S1374457799-001.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378508-1305465976/watcher-3378508-1305465976 -o /tmp/evaluation-result-3378508-1305465976/solver-3378508-1305465976 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378508-1305465976.cnf -seed 1176177376 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0448cdbfc0b1241b735cac942d079298
RANDOM SEED=1176177376

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      20693692 kB
Buffers:        269220 kB
Cached:        6414080 kB
SwapCached:      52668 kB
Active:        3496408 kB
Inactive:      8519452 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      20693692 kB
SwapTotal:    67111528 kB
SwapFree:     64495980 kB
Dirty:           32772 kB
Writeback:          20 kB
AnonPages:     5288704 kB
Mapped:          26812 kB
Slab:           133892 kB
PageTables:      42524 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 93435528 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73332 MiB
End job on node129 at 2011-05-15 15:28:37