Backup size discrepancy between FTP destinations

Discuss any issues related to FTP here.

Backup size discrepancy between FTP destinations

Postby mirekmal » Mon Aug 29, 2016 3:54 pm

Hello there! I face some strange issue when backing up my VMware VMs to FTP destinations. I have 2 FTP servers setup, one being WD MyCloud and the other FreeNAS box. Both have FTP server enabled. I created for all my VM backup sets to backup them to these destinations. It is configured as individual jobs; one VM to one destination at the time; 3 VM to 2 targets 6 backup jobs. All jobs run fine, but target usage is something that is worrying me. On WD My Cloud, as expected I have initial jump ahen the first backup was made and then small increase in consumption when incremental backups are done. On FreeNAS, however all jobs seems to be full backups, as total space usage is growing linear with each backup. Below screenshot show reports for these 2 backup sets:
WD MyCloud:
Image

FreeNAS (ignore not increased size for purple - backup failed with error):
Image

These results seems to be in line wiyh what consumption reports on both destinations shows for target folders.

I tried to compare these backup set configuration item by item and all looks exactly the same. The only difference is how I need to reference to destination directory:
- For WD My Cloud it is: ~/CloudBacko/VMname
- For FreeNAS it is: CloudBacko/VMname - for some reason, despite forcing chroot I cannot refer patch from root folder, but only from current.

What might be wrong with this setup?
User avatar
mirekmal
 
Posts: 21
Joined: Sun May 22, 2016 11:38 pm

Re: Backup size discrepancy between FTP destinations

Postby jeff.tang » Tue Aug 30, 2016 2:11 pm

Hello,

May I ask which Cloudbacko version are you running? To help to get clearer picture of the restore issue, would you mind copying the backup & restore logs to Dropbox, OneDrive, Google drive etc and share the link on this thread?

Please refer to our FAQ "Where are the CloudBacko backup and restore logs located? viewtopic.php?f=58&t=233
Jeff Tang
CloudBacko Forum Support
The Most Secure Cloud & Local Backup Software
jeff.tang
 
Posts: 750
Joined: Mon Feb 02, 2015 9:50 am

Re: Backup size discrepancy between FTP destinations

Postby mirekmal » Tue Aug 30, 2016 3:36 pm

OK, so here is small update since yesterday; apparently something changed/stabilized, as I do not see increase in storage usage since yesterday :shock:
Reports show that all backups were completed successfully (including one failed job from yesterday), but usage increased insignificantly, as for expected for incremental backup:
Image

Anyhow, I compiled zip with all logs and it can be accessed from: https://1drv.ms/u/s!ApDVL8wuGiitg4VURp9kJSa0XZPEGw
Would be good to understand what happened with first backups. And obviously I'll monitor how it works now, if it is really stabilized or some other glitch...
User avatar
mirekmal
 
Posts: 21
Joined: Sun May 22, 2016 11:38 pm

Re: Backup size discrepancy between FTP destinations

Postby mirekmal » Wed Aug 31, 2016 2:26 pm

OK, another day and more observations... All backups on FreeNAS, but grey one on charts above, are stable and seems to be real incremental. This one was hard to spot, as is small in size comparing to others, but it continues to grow by ~3GB every day, which is roughly size of VM vmdk... On WD MyCloud no problems, all backups as expected are growing incrementally and this one in particular is growing by few MB only per day.
User avatar
mirekmal
 
Posts: 21
Joined: Sun May 22, 2016 11:38 pm

Re: Backup size discrepancy between FTP destinations

Postby jeff.tang » Thu Sep 01, 2016 2:36 pm

Hello,

Regarding the backup jog with grey line, may I ask what is the name of the backup set?
Jeff Tang
CloudBacko Forum Support
The Most Secure Cloud & Local Backup Software
jeff.tang
 
Posts: 750
Joined: Mon Feb 02, 2015 9:50 am

Re: Backup size discrepancy between FTP destinations

Postby mirekmal » Thu Sep 01, 2016 4:08 pm

It is OpsView to FreeNAS
User avatar
mirekmal
 
Posts: 21
Joined: Sun May 22, 2016 11:38 pm

Re: Backup size discrepancy between FTP destinations

Postby jeff.tang » Fri Sep 02, 2016 11:36 am

Hello,

May I ask what is the size of VM Opsview Atom? According to the backup logs, it is uploaded as full without generating incremental in each backup
Jeff Tang
CloudBacko Forum Support
The Most Secure Cloud & Local Backup Software
jeff.tang
 
Posts: 750
Joined: Mon Feb 02, 2015 9:50 am

Re: Backup size discrepancy between FTP destinations

Postby mirekmal » Fri Sep 02, 2016 3:04 pm

Here is listing of VM directory from ESXi concole:

[root@esxi:/vmfs/volumes/57371942-29a2da12-62d3-d0509993e4b7/Opsview Atom] ls -l -h
total 11907088
-rw------- 1 root root 4.0G Aug 22 09:49 Opsview Atom-471a38e1.vswp
-rw------- 1 root root 80.0G Sep 2 06:46 Opsview Atom-flat.vmdk
-rw------- 1 root root 8.5K Sep 2 06:45 Opsview Atom.nvram
-rw------- 1 root root 502 Sep 2 01:49 Opsview Atom.vmdk
-rw-r--r-- 1 root root 44 Sep 2 01:49 Opsview Atom.vmsd
-rwxr-xr-x 1 root root 2.7K Sep 2 01:49 Opsview Atom.vmx
-rw------- 1 root root 0 Aug 22 09:49 Opsview Atom.vmx.lck
-rw------- 1 root root 154 Aug 9 06:56 Opsview Atom.vmxf
-rwxr-xr-x 1 root root 2.7K Sep 2 01:49 Opsview Atom.vmx~
-rw-r--r-- 1 root root 186.6K Aug 11 10:09 vmware-2.log
-rw-r--r-- 1 root root 158.7K Aug 11 10:55 vmware-3.log
-rw-r--r-- 1 root root 195.4K Aug 12 10:08 vmware-4.log
-rw-r--r-- 1 root root 206.2K Aug 18 18:46 vmware-5.log
-rw-r--r-- 1 root root 191.4K Aug 21 15:57 vmware-6.log
-rw-r--r-- 1 root root 183.5K Aug 22 09:43 vmware-7.log
-rw-r--r-- 1 root root 522.1K Sep 2 01:51 vmware.log
-rw------- 1 root root 163.0M Aug 22 09:49 vmx-Opsview Atom-1192900833-1.vswp
[root@esxi:/vmfs/volumes/57371942-29a2da12-62d3-d0509993e4b7/Opsview Atom]

Details of VM, in web interface, shows that Opsview Atom.vmdk is 7.19GB (it is thin provisioned).
And here are current reports:
No change for backups to WD MyCLoud:
Image

For FreeNAS some variations, depending of VM...
Image

All backups completed successfully, no error or incomplete backups.
User avatar
mirekmal
 
Posts: 21
Joined: Sun May 22, 2016 11:38 pm

Re: Backup size discrepancy between FTP destinations [#14549]

Postby jeff.tang » Mon Sep 05, 2016 12:00 pm

Hi,

Thank you for the detail information. For this case, I have now escalated to our development for further investigation.

This is the case reference #14549 for this issue. When the resolution available we will provide you an update on this thread, or you can visit to our web site to check updates on product news or releases.
Jeff Tang
CloudBacko Forum Support
The Most Secure Cloud & Local Backup Software
jeff.tang
 
Posts: 750
Joined: Mon Feb 02, 2015 9:50 am

Re: Backup size discrepancy between FTP destinations

Postby mirekmal » Thu Sep 08, 2016 5:12 pm

Thanks for update, Jeff.
FYI; so far situation is similarly unstable, all backups to WD MyClud are gradually growing, but no jumps, backups to FreeNAS grows irregularly, sometimes by expected increment, sometime by huge jump...
I made another experiment trying to rule out FreeNAS (at least partially); I created FreeNAS iSCSI target, connected it to backup server and run another set of test backups on such drive. For couple of days all incremental backups behave properly, growing in size only slightly (expected increments). So this seems to be specific only to FTP on FreeNAS as destination...
User avatar
mirekmal
 
Posts: 21
Joined: Sun May 22, 2016 11:38 pm

Re: Backup size discrepancy between FTP destinations

Postby jeff.tang » Fri Sep 09, 2016 12:09 pm

Hello,

Thank you for your feedback. In this case, would you please provide us with the .cbp folder by PM?
Jeff Tang
CloudBacko Forum Support
The Most Secure Cloud & Local Backup Software
jeff.tang
 
Posts: 750
Joined: Mon Feb 02, 2015 9:50 am

Re: Backup size discrepancy between FTP destinations

Postby jeff.tang » Mon Sep 12, 2016 9:51 am

Hello,

For this case, our developer would like to have the remote access of your machine to do some testing on the backup set. Would you please provide us with the Teamviewer 10 access by PM?

For Teamviewer 10, you can download this from below link:
https://www.teamviewer.com/en/download/ ... #version10
Jeff Tang
CloudBacko Forum Support
The Most Secure Cloud & Local Backup Software
jeff.tang
 
Posts: 750
Joined: Mon Feb 02, 2015 9:50 am


Return to FTP

Who is online

Users browsing this forum: No registered users