HPC Beta - Logo
Dashdark X Webflow Template - Icon
Overview
Getting Started
Core Concepts
Data Storage
Cluster Control
Snapshot
Guide
Convergence plot
File tailing
Use SSH
Whitelist / blacklist
Launch a simulation
Tutorials
OpenFOAM Motorbike
StarCCM+ on Qarnot HPC
Data and Licenses
Configure IP Whitelisting and Port Forwarding to allow Qarnot to access to your self-hosted licenses
Configuring your licence server to use it with Qarnot
Manage your data using rclone cli
Manage your data with a dedicated UI
Essayez dès maintenant !
HPC Beta - Logo

Manage your data with a dedicated UI

To efficiently manage your data, we recommend using dedicated S3 client software instead of the TasQ integrated file manager. External clients allow for:

  • Uploading and downloading files larger than 5 GB.
  • Synchronizing local and remote (bucket) folders.

This document provides instructions for configuring three popular S3 clients: S3 Browser, Cyberduck, and rclone (with Web UI).

Cyberduck

Cyberduck is only compatible with windows and macos, if you use linux please use rclone

Prerequisites

  1. Download and Install: Download and install Cyberduck from https://cyberduck.io/.
  2. Qarnot Credentials: Prepare your Qarnot credentials:
    • Access Key ID: Your Qarnot account email address.
    • Secret Access Key: Your Qarnot API token (available at https://app.qarnot.com/settings/access-token).
  3. Internet Connection: Ensure a stable internet connection.

Configuration

  1. Open Cyberduck.
  2. Open Connection: Click "Open Connection" (or Ctrl+Shift+B).
  3. Connection Settings:
    • Protocol: Select "Amazon S3."
    • Server: Enter storage.qarnot.com
    • Port: Set to 443.
    • Access Key ID: Enter your Qarnot account email.
    • Secret Key: Enter your Qarnot API token.
  4. More Options:
    • Access Style: Select "Path Style."
    • HTTPS: Ensure HTTPS (SSL) is enabled.
  5. Connect: Click "Connect."
Win Cyberduck

After connecting, you can manage your buckets and files.

rclone (Web UI)

Prerequisites

Rclone is compatible with windows, macos and linux

  1. Download and Install: Download and install rclone (refer to the official rclone documentation).
  2. Qarnot Credentials: Prepare your Qarnot credentials:
    • Access Key ID: Your Qarnot account email address.
    • Secret Access Key: Your Qarnot API token (available at https://app.qarnot.com/settings/access-token).
  3. Internet Connection: Ensure a stable internet connection.

Configuration

  1. Launch Web UI: Open a terminal and run rclone rcd --rc-web-guiThis will open the rclone Web UI in your browser.
  2. Configure Access:
    • Go to "Config."
    • Create New Config: Click "New config."
    • Remote Name: Enter a name for your Qarnot storage (e.g., "qarnot-storage").
    • Storage Type: Select "S3."
  3. Drive Setup:
    • Provider: Select "Ceph."
    • Access Key ID: Enter your Qarnot account email.
    • Secret Access Key: Enter your Qarnot API token.
    • Endpoint: Enter https://storage.qarnot.com
  4. Next: Click "Next" to save the configuration.
  5. Manage Data: Go to "Explorer" to manage your data.
Screenshot From 2025 03 18 17 53 21
  1. Optional: Mount Folder:
    • Go to "Mount."
    • Create New Mount: Click "New mount."
    • FS: Select your Qarnot storage remote.
    • Mount Point: Select the local directory where you want to mount the storage.
    • Create: Click "Create."

You can now access your Qarnot storage through your file explorer.

‍