|
cctools
|
Statistics describing a manager. More...
#include <taskvine.h>
Data Fields | |
| int | workers_connected |
| Number of workers currently connected to the manager. More... | |
| int | workers_init |
| Number of workers connected, but that have not send their available resources report yet. More... | |
| int | workers_idle |
| Number of workers that are not running a task. More... | |
| int | workers_busy |
| Number of workers that are running at least one task. More... | |
| int | workers_able |
| Number of workers on which the largest task can run. More... | |
| int | workers_joined |
| Total number of worker connections that were established to the manager. More... | |
| int | workers_removed |
| Total number of worker connections that were terminated. More... | |
| int | workers_released |
| Total number of worker connections that were asked by the manager to disconnect. More... | |
| int | workers_idled_out |
| Total number of worker that disconnected for being idle. More... | |
| int | workers_slow |
| Total number of workers disconnected for being too slow. More... | |
| int | workers_blocked |
| Total number of workers blocked by the manager. More... | |
| int | workers_lost |
| Total number of worker connections that were unexpectedly lost. More... | |
| int | tasks_waiting |
| Number of tasks waiting to be dispatched. More... | |
| int | tasks_on_workers |
| Number of tasks currently dispatched to some worker. More... | |
| int | tasks_running |
| Number of tasks currently executing at some worker. More... | |
| int | tasks_with_results |
| Number of tasks with retrieved results and waiting to be returned to user. More... | |
| int | tasks_submitted |
| Total number of tasks submitted to the manager. More... | |
| int | tasks_dispatched |
| Total number of tasks dispatch to workers. More... | |
| int | tasks_done |
| Total number of tasks completed and returned to user. More... | |
| int | tasks_failed |
| Total number of tasks completed and returned to user with result other than VINE_RESULT_SUCCESS. More... | |
| int | tasks_cancelled |
| Total number of tasks cancelled. More... | |
| int | tasks_exhausted_attempts |
| Total number of task executions that failed given resource exhaustion. More... | |
| timestamp_t | time_when_started |
| Absolute time at which the manager started. More... | |
| timestamp_t | time_send |
| Total time spent in sending tasks to workers (tasks descriptions, and input files.). More... | |
| timestamp_t | time_receive |
| Total time spent in receiving results from workers (output files.). More... | |
| timestamp_t | time_send_good |
| Total time spent in sending data to workers for tasks with result VINE_RESULT_SUCCESS. More... | |
| timestamp_t | time_receive_good |
| Total time spent in sending data to workers for tasks with result VINE_RESULT_SUCCESS. More... | |
| timestamp_t | time_status_msgs |
| Total time spent sending and receiving status messages to and from workers, including workers' standard output, new workers connections, resources updates, etc. More... | |
| timestamp_t | time_internal |
| Total time the manager spents in internal processing. More... | |
| timestamp_t | time_polling |
| Total time blocking waiting for worker communications (i.e., manager idle waiting for a worker message). More... | |
| timestamp_t | time_application |
| Total time spent outside vine_wait. More... | |
| timestamp_t | time_scheduling |
| Total time spend matching tasks to workers. More... | |
| timestamp_t | time_workers_execute |
| Total time workers spent executing done tasks. More... | |
| timestamp_t | time_workers_execute_good |
| Total time workers spent executing done tasks with result VINE_RESULT_SUCCESS. More... | |
| timestamp_t | time_workers_execute_exhaustion |
| Total time workers spent executing tasks that exhausted resources. More... | |
| int64_t | bytes_sent |
| Total number of file bytes (not including protocol control msg bytes) sent out to the workers by the manager. More... | |
| int64_t | bytes_received |
| Total number of file bytes (not including protocol control msg bytes) received from the workers by the manager. More... | |
| double | bandwidth |
| Average network bandwidth in MB/S observed by the manager when transferring to workers. More... | |
| int | capacity_tasks |
| The estimated number of tasks that this manager can effectively support. More... | |
| int | capacity_cores |
| The estimated number of workers' cores that this manager can effectively support. More... | |
| int | capacity_memory |
| The estimated number of workers' MB of RAM that this manager can effectively support. More... | |
| int | capacity_disk |
| The estimated number of workers' MB of disk that this manager can effectively support. More... | |
| int | capacity_gpus |
| The estimated number of workers' GPUs that this manager can effectively support. More... | |
| int | capacity_instantaneous |
| The estimated number of tasks that this manager can support considering only the most recently completed task. More... | |
| int | capacity_weighted |
| The estimated number of tasks that this manager can support placing greater weight on the most recently completed task. More... | |
| int64_t | total_cores |
| Total number of cores aggregated across the connected workers. More... | |
| int64_t | total_memory |
| Total memory in MB aggregated across the connected workers. More... | |
| int64_t | total_disk |
| Total disk space in MB aggregated across the connected workers. More... | |
| int64_t | total_gpus |
| Total number of gpus aggregated across the connected workers. More... | |
| int64_t | committed_cores |
| Committed number of cores aggregated across the connected workers. More... | |
| int64_t | committed_memory |
| Committed memory in MB aggregated across the connected workers. More... | |
| int64_t | committed_disk |
| Committed disk space in MB aggregated across the connected workers. More... | |
| int64_t | committed_gpus |
| Committed number of gpus aggregated across the connected workers. More... | |
| int64_t | max_cores |
| The highest number of cores observed among the connected workers. More... | |
| int64_t | max_memory |
| The largest memory size in MB observed among the connected workers. More... | |
| int64_t | max_disk |
| The largest disk space in MB observed among the connected workers. More... | |
| int64_t | max_gpus |
| The highest number of gpus observed among the connected workers. More... | |
| int64_t | min_cores |
| The lowest number of cores observed among the connected workers. More... | |
| int64_t | min_memory |
| The smallest memory size in MB observed among the connected workers. More... | |
| int64_t | min_disk |
| The smallest disk space in MB observed among the connected workers. More... | |
| int64_t | min_gpus |
| The smallest number of gpus observed among the connected workers. More... | |
| int64_t | inuse_cache |
| Used disk space of declared files in MB aggregated across the connected workers. More... | |
Statistics describing a manager.
| int vine_stats::workers_connected |
Number of workers currently connected to the manager.
| int vine_stats::workers_init |
Number of workers connected, but that have not send their available resources report yet.
| int vine_stats::workers_idle |
Number of workers that are not running a task.
| int vine_stats::workers_busy |
Number of workers that are running at least one task.
| int vine_stats::workers_able |
Number of workers on which the largest task can run.
| int vine_stats::workers_joined |
Total number of worker connections that were established to the manager.
| int vine_stats::workers_removed |
Total number of worker connections that were terminated.
| int vine_stats::workers_released |
Total number of worker connections that were asked by the manager to disconnect.
| int vine_stats::workers_idled_out |
Total number of worker that disconnected for being idle.
| int vine_stats::workers_slow |
Total number of workers disconnected for being too slow.
| int vine_stats::workers_blocked |
Total number of workers blocked by the manager.
(Includes workers_slow.)
| int vine_stats::workers_lost |
Total number of worker connections that were unexpectedly lost.
(does not include workers_idle_out or workers_slow)
| int vine_stats::tasks_waiting |
Number of tasks waiting to be dispatched.
| int vine_stats::tasks_on_workers |
Number of tasks currently dispatched to some worker.
| int vine_stats::tasks_running |
Number of tasks currently executing at some worker.
| int vine_stats::tasks_with_results |
Number of tasks with retrieved results and waiting to be returned to user.
| int vine_stats::tasks_submitted |
Total number of tasks submitted to the manager.
| int vine_stats::tasks_dispatched |
Total number of tasks dispatch to workers.
| int vine_stats::tasks_done |
Total number of tasks completed and returned to user.
(includes tasks_failed)
| int vine_stats::tasks_failed |
Total number of tasks completed and returned to user with result other than VINE_RESULT_SUCCESS.
| int vine_stats::tasks_cancelled |
Total number of tasks cancelled.
| int vine_stats::tasks_exhausted_attempts |
Total number of task executions that failed given resource exhaustion.
| timestamp_t vine_stats::time_when_started |
Absolute time at which the manager started.
| timestamp_t vine_stats::time_send |
Total time spent in sending tasks to workers (tasks descriptions, and input files.).
| timestamp_t vine_stats::time_receive |
Total time spent in receiving results from workers (output files.).
| timestamp_t vine_stats::time_send_good |
Total time spent in sending data to workers for tasks with result VINE_RESULT_SUCCESS.
| timestamp_t vine_stats::time_receive_good |
Total time spent in sending data to workers for tasks with result VINE_RESULT_SUCCESS.
| timestamp_t vine_stats::time_status_msgs |
Total time spent sending and receiving status messages to and from workers, including workers' standard output, new workers connections, resources updates, etc.
| timestamp_t vine_stats::time_internal |
Total time the manager spents in internal processing.
| timestamp_t vine_stats::time_polling |
Total time blocking waiting for worker communications (i.e., manager idle waiting for a worker message).
| timestamp_t vine_stats::time_application |
Total time spent outside vine_wait.
| timestamp_t vine_stats::time_scheduling |
Total time spend matching tasks to workers.
| timestamp_t vine_stats::time_workers_execute |
Total time workers spent executing done tasks.
| timestamp_t vine_stats::time_workers_execute_good |
Total time workers spent executing done tasks with result VINE_RESULT_SUCCESS.
| timestamp_t vine_stats::time_workers_execute_exhaustion |
Total time workers spent executing tasks that exhausted resources.
| int64_t vine_stats::bytes_sent |
Total number of file bytes (not including protocol control msg bytes) sent out to the workers by the manager.
| int64_t vine_stats::bytes_received |
Total number of file bytes (not including protocol control msg bytes) received from the workers by the manager.
| double vine_stats::bandwidth |
Average network bandwidth in MB/S observed by the manager when transferring to workers.
| int vine_stats::capacity_tasks |
The estimated number of tasks that this manager can effectively support.
| int vine_stats::capacity_cores |
The estimated number of workers' cores that this manager can effectively support.
| int vine_stats::capacity_memory |
The estimated number of workers' MB of RAM that this manager can effectively support.
| int vine_stats::capacity_disk |
The estimated number of workers' MB of disk that this manager can effectively support.
| int vine_stats::capacity_gpus |
The estimated number of workers' GPUs that this manager can effectively support.
| int vine_stats::capacity_instantaneous |
The estimated number of tasks that this manager can support considering only the most recently completed task.
| int vine_stats::capacity_weighted |
The estimated number of tasks that this manager can support placing greater weight on the most recently completed task.
| int64_t vine_stats::total_cores |
Total number of cores aggregated across the connected workers.
| int64_t vine_stats::total_memory |
Total memory in MB aggregated across the connected workers.
| int64_t vine_stats::total_disk |
Total disk space in MB aggregated across the connected workers.
| int64_t vine_stats::total_gpus |
Total number of gpus aggregated across the connected workers.
| int64_t vine_stats::committed_cores |
Committed number of cores aggregated across the connected workers.
| int64_t vine_stats::committed_memory |
Committed memory in MB aggregated across the connected workers.
| int64_t vine_stats::committed_disk |
Committed disk space in MB aggregated across the connected workers.
| int64_t vine_stats::committed_gpus |
Committed number of gpus aggregated across the connected workers.
| int64_t vine_stats::max_cores |
The highest number of cores observed among the connected workers.
| int64_t vine_stats::max_memory |
The largest memory size in MB observed among the connected workers.
| int64_t vine_stats::max_disk |
The largest disk space in MB observed among the connected workers.
| int64_t vine_stats::max_gpus |
The highest number of gpus observed among the connected workers.
| int64_t vine_stats::min_cores |
The lowest number of cores observed among the connected workers.
| int64_t vine_stats::min_memory |
The smallest memory size in MB observed among the connected workers.
| int64_t vine_stats::min_disk |
The smallest disk space in MB observed among the connected workers.
| int64_t vine_stats::min_gpus |
The smallest number of gpus observed among the connected workers.
| int64_t vine_stats::inuse_cache |
Used disk space of declared files in MB aggregated across the connected workers.