About Domino
Domino Data LabKnowledge BaseData Science BlogTraining

Get your files and data into R

There are two strategies to working with data in Domino:

  • You can copy your data into Domino

    If you are working with data that is on your local machine or in a shared server, you might want to upload your data into Domino.

  • You can query your data from Domino

    If you have a large dataset stored in a database or data service, you might just have to query the database or the API for the data service.

In this tutorial, we will use the terminal in Rstudio to copy data into the project.

  1. If you have not done so yet, first start an RStudio workspace. Your starting file path is /mnt. By default, this is considered the root of your Domino project. If you add or modify files in /mnt, you can save them back to your project when you stop or sync the workspace.

    Note

    Your outbound internet access may be blocked in Trial or POC instances. If you have access to a hardware tier with egress, use that as the hardware tier and follow the normal steps. If you do not have access to a hardware tier with egress, follow these steps.

    1. Copy and paste the following URL into your browser to download the data: https://data.elexon.co.uk/bmrs/api/v1/datasets/FUELINST?format=csv&PublishDateTimeFrom=2019-09-29T20:30:00.000Z&PublishDateTimeTo=2019-10-02T20:30:00.000Z.

    2. Rename the file to data.csv.

    3. From the navigation pane, in your project, click Files.

    4. Click the upload file to upload the file.

    5. Skip to the last item in the normal steps.

  2. Use the Tools > Terminal > New Terminal menu to open a Rstudio terminal.

    New terminal in Rstudio

  3. In the new terminal, run the following command to fetch some data from the BMRS:

    curl -o data.csv "https://data.elexon.co.uk/bmrs/api/v1/datasets/FUELINST?format=csv&PublishDateTimeFrom=2019-09-29T20:30:00.000Z&PublishDateTimeTo=2019-10-02T20:30:00.000Z"

    Rstudio terminal after wget

  4. In the File Changes tab of your workspace, type a commit message in the text box.

  5. Sync All Changes to save the new file data.csv to Domino.

    Full Sync button r

    This saves any changes that were made in your workspace session back to your project.

  6. Stop your workspace.

  7. Click the Domino logo to return to your project. In the navigation pane, go to the Code section of Domino. Notice that the raw data has been saved in the latest revision.

    Files after full sync

See the documentation for other methods to copy data into Domino (curl or Wget) and query data from Domino.