Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
Motivation
There is one problem in the current task manager logs Web UI design, the logs only display the taskmanager.log and taskmanager.out, but there may exist other log files created by the user or GC log files.
The job manager logs have the same problem with the task manger.
Proposed Changes
We should add a log list tab in the task manager/job manager page, In frontend part, the logs should support reload, download and the fullscreen view.
Frontend Design
The task manager log list page
The job manager log list page
The taskmanager log detail page
The job manager log detail page
REST API Design
- read log
- url: /taskmanagers/:taskmanagerid/logs/:filename
- response: same as taskmanager’s log
- list taskmanager all log file
- url: /taskmanagers/:taskmanagerid/logs
- response:
{ "logs": [ "type" : "array", "id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:LogsInfo", "properties" : { "name" : { "type" : "string" }, "size" : { "type" : "long" } } ] } |
- add new handler JobManagerFileRangeHandler for jobmanager to get log
- the user could read log
- url /jobmanager/logs/[filename]
- response: same as taskmanager’s log
- list jobmanager all log file
- url /jobmanager/logs
{ "logs": [ "type" : "array", "id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:LogsInfo", "properties" : { "name" : { "type" : "string" }, "size" : { "type" : "long" } } ] } |
Test Plan
Covered by unit tests.