About Domino
Domino Data LabKnowledge BaseData Science BlogTraining

Get your files and data into a Jupyter Workspace

There are two strategies to working with data in Domino:

  • You can copy your data into Domino

    If you are working with data that is on your local machine or in a shared server, you might want to upload your data into Domino.

  • You can query your data from Domino

    If you have a large dataset stored in a database or data service, you might just have to query the database or the API for the data service.

In this step, you’ll copy your data into the project using the Jupyter terminal. If you have not done so yet, first start a Jupyter workspace.

The starting file path in your Jupyter workspace is /mnt. By default, this is considered the root of your Domino project. If you add or modify files in /mnt, you can save them back to your project when you stop or sync the workspace.

Note

Your outbound internet access may be blocked in Trial or POC instances. If you have access to a hardware tier with egress, use that as the hardware tier and follow the normal steps. If you do not have access to a hardware tier with egress, follow these steps.

  1. Copy and paste the following URL into your browser to download the data: https://data.elexon.co.uk/bmrs/api/v1/datasets/FUELINST?format=csv&PublishDateTimeFrom=2019-09-29T20:30:00.000Z&PublishDateTimeTo=2019-10-02T20:30:00.000Z.

  2. Rename the file to data.csv.

  3. From the navigation pane, in your project, click Code.

  4. Click the upload file to upload the file.

  5. Skip to the last item in the normal steps.

  1. Go to New > Terminal to open a Jupyter terminal.

    New terminal in Jupyter

  2. In the new terminal, run the following command to fetch some data from the BMRS:

    curl -o data.csv "https://data.elexon.co.uk/bmrs/api/v1/datasets/FUELINST?format=csv&PublishDateTimeFrom=2019-09-29T20:30:00.000Z&PublishDateTimeTo=2019-10-02T20:30:00.000Z"

  3. In the File Changes tab of your workspace, type a commit message in the text box.

  4. Click Sync All Changes to synchronize the information and save data.csv to your Domino project.

    Sync All Changes button

  5. Stop the workspace.

  6. Click the Domino logo to return to your project in Domino. In the navigation pane, click Code. The raw data is saved in the latest revision.

See the documentation for other methods to copy data into Domino (with curl or Wget) and query data from Domino.