Run

A central component in data science projects is the runs of a job. In AskAnna you can track all relevant information related to a run. For example you can track input, metrics, parameters, code version, artifacts and results. If you want to track something, and we currently don't support it, contact ([email protected]) us.

The information you track in a run can be used for later comparison. In the phase of experimentation you can compare runs and see which settings will perform the best. Or in production phase you can monitor the stability of the model over time. Via AskAnna you can easily extract/query the project information and build your own dashboards to get insights from your runs.

Starting a run

Check the jobs documentation to read about How to run a job. Here you can find the information about how to run a job using the:

• Web interface
• Command line
• Python SDK

Retrieving run data via the AskAnna CLI, SDK & API

The information that we show on the run page can always be retrieved via the AskAnna API and in most cases also the AskAnna CLI. The only relevant information you need to know is the SUUID of the run. You can find the SUUID of the run on the run page or you can copy the SUUID from the run overview.

Get Payload

AskAnna CLI:

askanna-run-utils get-payload --run "RUN SUUID"

Optionally you can also specify the output path via --output.

AskAnna API:

curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/run/{{ RUN SUUID }}/payload/'

Get Result

AskAnna CLI:

askanna result get --id "RUN SUUID"

Python SDK:

from askanna import result

result = result.get(run_suuid="RUN SUUID")

AskAnna API:

curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/result/{{ RUN SUUID }}/'

Get Metrics

AskAnna SDK:

from askanna import metrics

run_metrics = metrics.get(run="RUN SUUID")

AskAnna API:

curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/run/{{ RUN SUUID }}/metric/'

Get Artifact

AskAnna CLI:

askanna artifact get --id "RUN SUUID"

Optionally you can also specify the output path via --output.

AskAnna API:

curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/artifact/{{ RUN SUUID }}/'

Get Variables

AskAnna API:

curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/run/{{ RUN SUUID }}/variable/'

Get Log

AskAnna API:

curl -X GET \
-H 'Authorization: Token {{ YOUR TOKEN }}' \
'https://beta-api.askanna.eu/v1/run/{{ RUN SUUID }}/log/'

Edit run info

AskAnna is designed to empower you to reproduce results. Most of the information of a run cannot be edited. Exception is the name and description of the run.

To edit the name and description of the run, on the run page you can click on . In this menu select EDIT RUN INFO and a form to edit the run info opens. Save your changes, and you are done.

Run failures

It can happen that a run fails. When this happens, AskAnna will always try to save the latest log and the specified artifact of the run. Because the run was not succesfull, we will not save a result for the run.

In case something went wrong with running your code, you can probably find information about the error in the run log. Our jobs run in containers, and we keep them for 24 hours. So in case the logs doesn't help you to figure out what went wrong, you can always contact us ([email protected]). With your permission we can check the container used for the run and see if we can help you.

Remove a run

In the web interface you can remove a run via the run page. Click on at the right side. Then click on Remove this run.

When you remove a run, this it what happens:

• the run will be removed
• all data related to the run will be removed
• if other projects, systems or jobs use information or files from the run, they are not able to use it anymore