Run
A central component in data science projects is the runs of a job. In AskAnna you can track all relevant information related to a run. For example you can track input, metrics, parameters, code version, artifacts and results. If you want to track something, and we currently don't support it, contact ([email protected]) us.
The information you track in a run can be used for later comparison. In the phase of experimentation you can compare runs and see which settings will perform the best. Or in production phase you can monitor the stability of the model over time. Via AskAnna you can easily extract/query the project information and build your own dashboards to get insights from your runs.
Starting a run
Check the jobs documentation to read about How to run a job. Here you can find the information about how to run a job using the:
Retrieving run data via the AskAnna CLI, SDK & API
The information that we show on the run page can always be retrieved via the AskAnna API and in most cases also the AskAnna CLI. The only relevant information you need to know is the SUUID of the run. You can find the SUUID of the run on the run page or you can copy the SUUID from the run overview.
Get Payload
AskAnna CLI:
askanna-run-utils get-payload --run "RUN SUUID"
Optionally you can also specify the output path via --output
.
AskAnna API:
curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/run/{{ RUN SUUID }}/payload/'
Get Result
AskAnna CLI:
askanna result get --id "RUN SUUID"
Python SDK:
from askanna import result
result = result.get(run_suuid="RUN SUUID")
AskAnna API:
curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/result/{{ RUN SUUID }}/'
Get Metrics
AskAnna SDK:
from askanna import metrics
run_metrics = metrics.get(run="RUN SUUID")
AskAnna API:
curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/run/{{ RUN SUUID }}/metric/'
Get Artifact
AskAnna CLI:
askanna artifact get --id "RUN SUUID"
Optionally you can also specify the output path via --output
.
AskAnna API:
curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/artifact/{{ RUN SUUID }}/'
Get Variables
AskAnna API:
curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/run/{{ RUN SUUID }}/variable/'
Get Log
AskAnna API:
curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/run/{{ RUN SUUID }}/log/'
Edit run info
AskAnna is designed to empower you to reproduce results. Most of the information of a run cannot be edited. Exception is the name and description of the run.
To edit the name and description of the run, on the run page you can click on . In this menu select EDIT RUN INFO
and a form to edit the run info opens. Save your changes, and you are done.
Run failures
It can happen that a run fails. When this happens, AskAnna will always try to save the latest log and the specified artifact of the run. Because the run was not succesfull, we will not save a result for the run.
In case something went wrong with running your code, you can probably find information about the error in the run log. Our jobs run in containers, and we keep them for 24 hours. So in case the logs doesn't help you to figure out what went wrong, you can always contact us ([email protected]). With your permission we can check the container used for the run and see if we can help you.
Remove a run
In the web interface you can remove a run via the run page. Click on at the right side. Then click on Remove this run
.
When you remove a run, this it what happens:
- the run will be removed
- all data related to the run will be removed
- if other projects, systems or jobs use information or files from the run, they are not able to use it anymore
Recovery period of 30 days
When you remove a run, you will not have access to the run anymore. After 30 days, the system will entirely delete the run from the backend. Within 30 days, you can contact us if you want to undo the removal.
If the run and related files should be removed as soon as possible, you can contact us.