Synology Hyper Backup can backup to WebDAV servers. Stack has support for WebDAV but They don’t seem to like each other. If you follow a few Dutch forum threads  (1 2 ). Users mention that the use of Sparse files is the problem. Hyper Backup creates a Sparse file in WebDAV backups in nas_1.hbk/Pool/bucketID.counter.1

The filename tells us that it’s used as a counter. After creation of the backup task it seems to be empty (I tested this with another WebDAV server 😉 ). If we manually try to upload this file to Stack we receive an error. “Method not allowed”

So, let’s see what is actually in this file. Well it’s empty…

 

gijs@Carbonite:~$ hexdump -C bucketID.counter.1
 00000000 00 00 00 00 00 00 00 00 |........|
 00000008

After creating the backup task, this file is empty but as soon as the backup runs the file will be replaced with another one. When I check the contents of this new file it was not empty.

 

gijs@Carbonite:~$ hexdump -C bucketID.counter.3
 00000000 00 00 00 00 00 00 01 5e |.......^|
 00000008

Uploading this new file is accepted by Stack. Below I will guide you through the steps to get Hyper Backup use Stack as a backup destination.

Step 1: Have another WebDAV server

Before we can create a backup to Stack we need a separate WebDAV server that supports the use of Sparse files.
This can be remote or local with the WebDAV server package.
I choose to use the local package.

Step 2: create a WebDAV backup task to this server.

Create a new backup task and select the server from step 1 as the destination.

  • The server address should be the address of your WebDAV server (in my case the Synology itself)
  • The folder needs to be the folder you like to use on Stack (you may need to create a temporary folder on your WebDAV server.)

step-21

After clicking Next you can choose the folders you want to backup and all the options you like to use. It’s not important for now so I don’t cover it here.

Hyper Backup will ask if you like to create a backup now. Click NO.

step-22

Step 3: Copy files to Stack

Upload the complete nas_1.hbk directory to Stack in the folder with the same name as in step 2. Stack will not accept the file nas_1hbk/Pool/bucketID.counter.1 but you can skip it.

In my situation my folder in Stack was:  stack_backup > nas_1.hbk

Step 4: Edit the backup task

Go to your Stack settings page and copy the WebDAV url: https://YOUR-STACK.stackstorage.com/remote.php/webdav/

In Hyper Backup: Edit the backup task by clicking on the menu and then Edit.

step-41a

Open the Target tab and replace the current values with those from your Stack account.

step-42a

Click OK and Hyper Backup will recognize the backup task at your Stack storage 🙂

I have tested the following and they all work fine:

  • Initial backup (17GB)
  • Adding a file and doing an incremental backup
  • Recovering 1 file
  • Recovering the complete folder (17GB)

 

Note: Having a decent backup plan is important. Test your backups and have multiple destinations. Also Off-line.

29 thoughts on “Make Synology <3 TransIP Stack

    1. I had the same problem. It went wrong during copying the BACKUP.hbk to Stack. What I did is downloaded the hbk folder to from my NAS, deleted the bucketID.counter.1 file from the pool folder and uploaded the hbk folder to stack. After that, my backup came online again.
      Maybe it helps….

      Liked by 1 person

  1. It seems the local NAS username and the remote TransIP username password combination needs to be the same. Otherwise you cannot modify the Hyper backuptask I found.

    Like

  2. I cannot seem to get the connection to work. I can create a folder, but when I want to apply the task, I get the error: Insufficient privileges to access this destination shared folder

    Like

  3. Does not work for me, even not after having same user and password and deleting the mentioned counter file and even not after deleting all 0 byte files.

    Like

    1. Thanks for sharing @Gijs

      In my case even though the destination is online, the backup fails at start.
      I must say that apart from the mentioned file, I also have trouble copying the NAS_1.hbk/Control/@Writer/sequence_id file.
      It’s also that file I found an error message in the messages log file.

      Anybody solved that problem?

      Like

  4. I had trouble getting this to work. The file I downloaded from the temp webdav server was a zip file. It was not clear to me that I needed to extract it and place the extracted folder onto stack.
    After doing that it worked immediately.
    Thank you for the information.

    Like

  5. De afgelopen twee jaar kijk ik eens in de paar maanden of er een oplossing is. Teleurstellend dat TransIP niet hier actie op heeft ondernomen, maar geweldig dat jij het probleem hebt gehackt en deelt! Veel dank Gijs, ik ben hier erg blij mee

    Like

  6. Works perfectly. Thank you very much, Gijs!

    I missed some information about how to setup the temporary webdav server. So perhaps helpful for others:
    I just installed it from the package center and enabled the http server.
    Next, when you create the backup task you should login with an account which has administrative rights (perhaps not stricly needed, but it is only for the temporary webdav server. So doesn’t matter much).
    Remember that the last field called directory (in Dutch both fields are called folder. blehh) will be eventually be the target directory on your stack storage.
    I miss step 5 which is removing the webdav server. Go back into the package center and remove the webdav server as it is not needed anymore.

    Like

  7. Did anyone succeed in restoring files from their Windows workstation using the hyperbackup windows client? I was testing the scenario where my nas would be stolen or fried and I wanted to recover my stuff directly to my Windows pc. And unfortunately this does not seem to work. Don’t know whether or not this has to do with the stack storage or just a general bug in the hyperbackup Windows client.

    Like

  8. Thanks for sharing @Gijs

    Sorry for posting this twice, but i just noticed that my previous reply was on the wrong position within the thread ;(

    In my case even though the destination is online, the backup fails at start.
    I must say that apart from the mentioned file, I also have trouble copying the NAS_1.hbk/Control/@Writer/sequence_id file.
    It’s also that file I found an error message in the messages log file.

    Anybody solved that problem?

    Like

  9. Bedankt Gijs!!

    Heeft iemand dit in 2019 nog aan de praat gekregen?
    Samen met Trans-IP kom ik er niet uit.

    Het blijkt dan niet alleen de sparse bestanden een probleem zijn maar ook de lock files.
    Waren die lock file problemen er in 2018 ook?

    Foutmelding:
    failed to create lock keepalive: keepalive file: [lock/lock_keep_alive.@writer_version_0.f4f67b15-d29c-163e-7125-0240846ec14d]

    Trans-IP zegt:
    “De foutmelding waar je naar verwijst betreft het ‘locken’ van een bestand. Hiermee wordt het bestand in kwestie vergrendeld om te voorkomen dat deze bewerkt kan worden door een andere gebruiker of een ander proces. Omdat STACK geen file locking ondersteunt, lukt het niet om de lock aan te maken.
    Zoals aangegeven hebben we momenteel helaas geen andere oplossing als de stappen op gijs.io niet werken.”

    Like

    1. In reactie op mezelf:

      Na dagen lang foutmelding-mails van mijn NAS te hebben ontvangen dat de backup ‘FAILED’ is, krijg ik sinds de nacht van 6 maart ineens mails dat de backups geslaagd zijn!
      (Ik heb in die dagen niets gewijzigd.)
      Op een NAS van een kennis begon dezelfde nacht (bleek uit de logging) de backup ook ineens te lopen.
      Het probleem lijkt dus te zijn opgelost !

      Bij Trans-IP zeggen ze: “Ik heb dit voor de zekerheid voor je nagevraagd, maar aan onze kant is er ook niets gebeurd. Ik durf dus helaas ook niet te zeggen of dit stand houdt.”

      René

      Like

  10. Hi,

    Thank you for the guide, followed the steps and everything seems ok but once I start the backup I get the following error message:

    Exception occurred while backing up data. (No permission to access the backup destination [backup]. Please check you have the right permission to the backup destination

    I can see HyperBackup changes files on my stack but the backup fails.

    Tried the setup several times but it keeps failing, does anybody have suggestions on how to fix this ?

    Regards,

    Jeroen

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s