minicluster.number-of-taskmanagers |
1 |
Integer |
The number of task managers of MiniCluster. |
task.cancellation.interval |
30 s |
Duration |
Time interval between two successive task cancellation attempts. |
task.cancellation.timeout |
3 min |
Duration |
Timeout after which a task cancellation times out and leads to a fatal TaskManager error. A value of 0 deactivates the watch dog. Notice that a task cancellation is different from both a task failure and a clean shutdown. Task cancellation timeout only applies to task cancellation and does not apply to task closing/clean-up caused by a task failure or a clean shutdown. |
task.cancellation.timers.timeout |
7500 ms |
Duration |
Time we wait for the timers to finish all pending timer threads when the stream task is cancelled. |
taskmanager.bind-host |
(none) |
String |
The local address of the network interface that the task manager binds to. If not configured, '0.0.0.0' will be used. |
taskmanager.collect-sink.port |
0 |
Integer |
The port used for the client to retrieve query results from the TaskManager. The default value is 0, which corresponds to a random port assignment. |
taskmanager.data.bind-port |
(none) |
String |
The task manager's bind port used for data exchange operations. Also accepts a list of ports (“50100,50101”), ranges (“50100-50200”) or a combination of both. If not configured, 'taskmanager.data.port' will be used. |
taskmanager.data.port |
0 |
Integer |
The task manager’s external port used for data exchange operations. |
taskmanager.data.ssl.enabled |
true |
Boolean |
Enable SSL support for the taskmanager data transport. This is applicable only when the global flag for internal SSL (security.ssl.internal.enabled) is set to true |
taskmanager.debug.memory.log |
false |
Boolean |
Flag indicating whether to start a thread, which repeatedly logs the memory usage of the JVM. |
taskmanager.debug.memory.log-interval |
5 s |
Duration |
The interval for the log thread to log the current memory usage. |
taskmanager.host |
(none) |
String |
The external address of the network interface where the TaskManager is exposed. Because different TaskManagers need different values for this option, usually it is specified in an additional non-shared TaskManager-specific config file. |
taskmanager.jvm-exit-on-oom |
false |
Boolean |
Whether to kill the TaskManager when the task thread throws an OutOfMemoryError. |
taskmanager.load-balance.mode |
NONE |
Enum |
Mode for the load-balance allocation strategy across all available TaskManagers .- The
SLOTS mode tries to spread out the slots evenly across all available TaskManagers . - The
NONE mode is the default mode without any specified strategy.
Possible values: |
taskmanager.log.path |
System.getProperty("log.file") |
String |
The path to the log file of the task manager. |
taskmanager.memory.min-segment-size |
256 bytes |
MemorySize |
Minimum possible size of memory buffers used by the network stack and the memory manager. ex. can be used for automatic buffer size adjustment. |
taskmanager.memory.segment-size |
32 kb |
MemorySize |
Size of memory buffers used by the network stack and the memory manager. |
taskmanager.memory.starting-segment-size |
1 kb |
MemorySize |
Starting size of memory buffers used by the network stack and the memory manager, when using automatic buffer size adjustment. |
taskmanager.network.bind-policy |
"ip" |
String |
The automatic address binding policy used by the TaskManager if "taskmanager.host" is not set. The value should be one of the following:
- "name" - uses hostname as binding address
- "ip" - uses host's ip address as binding address
|
taskmanager.numberOfTaskSlots |
1 |
Integer |
The number of parallel operator or user function instances that a single TaskManager can run. If this value is larger than 1, a single TaskManager takes multiple instances of a function or operator. That way, the TaskManager can utilize multiple CPU cores, but at the same time, the available memory is divided between the different operator or function instances. This value is typically proportional to the number of physical CPU cores that the TaskManager's machine has (e.g., equal to the number of cores, or half the number of cores). |
taskmanager.registration.timeout |
5 min |
Duration |
Defines the timeout for the TaskManager registration. If the duration is exceeded without a successful registration, then the TaskManager terminates. |
taskmanager.resource-id |
(none) |
String |
The TaskManager's ResourceID. If not configured, the ResourceID will be generated with the "RpcAddress:RpcPort" and a 6-character random string. Notice that this option is not valid in Yarn and Native Kubernetes mode. |
taskmanager.rpc.bind-port |
(none) |
Integer |
The local RPC port that the TaskManager binds to. If not configured, the external port (configured by 'taskmanager.rpc.port') will be used. |
taskmanager.rpc.port |
"0" |
String |
The external RPC port where the TaskManager is exposed. Accepts a list of ports (“50100,50101”), ranges (“50100-50200”) or a combination of both. It is recommended to set a range of ports to avoid collisions when multiple TaskManagers are running on the same machine. |
taskmanager.runtime.fs-timeout |
0 ms |
Duration |
The timeout for filesystem stream opening. A value of 0 indicates infinite waiting. |
taskmanager.slot.timeout |
10 s |
Duration |
Timeout used for identifying inactive slots. The TaskManager will free the slot if it does not become active within the given amount of time. Inactive slots can be caused by an out-dated slot request. If no value is configured, then it will fall back to pekko.ask.timeout . |
taskmanager.system-out.log.cache-upper-size |
100 kb |
MemorySize |
The cache upper size when Flink caches current line context of System.out or System.err when taskmanager.system-out.mode is LOG. |
taskmanager.system-out.log.thread-name.enabled |
false |
Boolean |
Whether to log the thread name when taskmanager.system-out.mode is LOG. |
taskmanager.system-out.mode |
DEFAULT |
Enum |
Redirection mode of System.out and System.err for all TaskManagers .DEFAULT : TaskManagers don't redirect the System.out and System.err , it's the default value.LOG : TaskManagers redirect System.out and System.err to LOG.info and LOG.error.IGNORE : TaskManagers ignore System.out and System.err directly.
Possible values: |