Step 4: Get your files and dataΒΆ

There are basically two strategies to working with data in Domino:

  • You can copy your data into Domino
    If you are working with data that is on your local machine or in a shared server, you might want to copy your data into Domino.
  • You can query your data from Domino
    If you have a large dataset stored in a database or data service, you may just need to query the database or the API for the data service.

In this tutorial, we will use the terminal in Jupyter to copy data into the project.

  1. If you have not done so, please complete Step 3 to start a Jupyter workspace.

Your starting file path is /mnt. By default, this is considered the root of your Domino project. If you add or modify files in /mnt, you can save them back to your project when you stop or sync the workspace.

  1. Use the New menu to open a Jupyter terminal.

    New terminal in Jupyter

  2. In the new terminal, run the following command to fetch some data from the BMRS:

    curl -o data.csv "https://www.bmreports.com/bmrs/?q=ajax/filter_csv_download/FUELHH/csv/FromDate%3D2019-09-15%26ToDate%3D2019-10-02/&filename=GenerationbyFuelType_20191002_1657"
    

    Jupyter terminal after wget

  3. Do a Full Sync to save the new file data.csv to Domino.

    Full Sync button

Full sync will save any changes that were made in your workspace session back to your project. After clicking Full Sync, Domino will show you which files have changed during your workspace session.

  1. Enter an informative commit message, then click Continue with Sync.

    Full sync modal

If you return to your project in Domino and look at the Files page, you will see the raw data has been saved in the latest revision.

Files after full sync

See the documentation on other methods of both copying data into Domino and querying data from Domino.