Poor performance during copy/clone a VM disk

Hello

for several days, we try to find a solution to improve performance when the computer images virtual of one ESXi (free) to another.

Our situation is as follows:

We have 4 different servers ESXi running, must benefit from all the material according to the compatibility of the VMWares guide. Connected via gigabit, all virtual machines network has stopped, nothing else running on the network. All virtual machines are stored locally on SATA drives.

Now we wanted to spend a bunch of computer images virtual of one ESXi for others - but regardless of what technique, we used, we have reached a maximum. Speed about 10 MB/s (which would take several days to transfer everything).

We tried the following:

-Enable SSH and SCP allows you to copy the files directly between servers (using several different encryption algorithms)

-Use Veeam FastSCP for copy files directly

-Connect through SSH on both sides and has used a combination of tar and netcat to push raw on the network files

-Install ProFTPD and copy files via FTP

For all of these methods, the write speed was never over the ~10MByte/s (often it is still slower). So we thought that the networking might have a problem, that's why we tried a few transfers the.

But even a local "dd" to transfer data of 1 local disk to another was just as slow as the transfer of network... We tried this on all the different materials of ESXi we have, with the RAID on, off, etc.

After some googling, we discovered that this should be a problem with the VMFS that really does not support the use of "standard" file system tools That's why we tried to find a way to use the ESX-internal tools to copy/clone VM images.

We installed a NFS server 'between' 2 ESXi servers, i.e. both have the NFS share accessible. Copy of ESXi to NFS is incredibly fast (via vSphere client, operating at gigabit full speed) - but the copy of NFS to ESXi is slow again (as before ~10MByte/s). The last test we did was use the vmkfstools command line utility to clone from the NFS share on the local disk of VMFS. This seems to be a little faster (difficult to measure due to missing statistics, seems to be ~20MByte/s), but far from a quick fix.

What is the mechanism to move a virtual computer image on a server ESXi? Is there a way to improve the transfer speed?

Yes, he does. As I said, this problem (poor local disk IO performance observed in ESXi, but not in the virtual machine) can be eliminated only by 'mature' raid-controller with large onboard cache, usually 512 MB - 2 GB (or storage network, of course, but now we are talking about local drives).

It does not matter if you have a local drive attached to the controller chipset or raid - without performance cache controller is just as bad. In fact, it can be even worse on raid-controller (without cache) If you use raid5/6 to parity calculations...

Tags: VMware

Similar Questions

  • Poor performance during the iteration/update rows of a tree table

    Hello

    We have a tree table based on a VO and EO (with transitional attributes). One of the attributes is an indicator.
    The original Version is filled with a complex query with several thousand lines.

    Now, when the user clicks on a node, all children are updated (their flag is set to true) recursively.

    It's really really slow. It may take several minutes, while a similar update via PL/SQL on a real table would take a few seconds.

    Is it possible to improve the performance? We have already applied all the tunings on EO as VO mentioned in the Oracle Documentation, but they had almost no effect:
    -keep the viewlink iterators set line
    -indicators of query
    -Use the batch update

    The algorithm we use is the following:
        private void checkTreeNodes(JUCtrlHierNodeBinding node, Boolean check) {
            if (node == null) {
                return;
            }
    
           TreeVORowImpl nodeRow = (TreeVORowImpl)node.getRow();
            if (nodeRow != null) {
                    nodeRow.setFlag(check);
            }
    
            List<JUCtrlHierNodeBinding> children = null;
            if (!nodeRow.getLevel().equals("4"))  // no more than 4 levels
                children = node.getChildren();
    
            if (children != null) {
                for (JUCtrlHierNodeBinding _node : children) {
                    checkTreeNodes(_node, check);
                }
            }
        }

    Hello

    try to move the logic of the definition of the transitional indicator at the service of the company (method exposed on the client interface) and then refresh the tree instead of a record thousand on the client component analysis.

    Frank

  • VPN poor Performance - Cisco RV220W and routers WRVS4400N

    Hello

    To one of our customer IPSec VPN is established between Cisco RV 220W and routers of Cisco WRVS4400N.

    Router VPN /ISP details are as below

    Location was Location B

    Details of the Internet

    ----------------------

    DOWNLOAD: 6 to 10 Mbps
    Upload: 1 to 2 Mbps

    Details of router

    ----------------------

    Cisco RV220W

    Firmware: 1.0.3.5

    IKE policy

    Encryption: 3DES
    Authentication: MD5
    Group: Group 2
    Life key: 28800 sec

    VPN strategy

    Encryption: 3DES
    Authentication: SHA - 1
    Group: 1024 bits (Group 2)
    Life key: 3 600 s
    Perfect Forward Secrecy: enabled

    Details of the Internet

    -------------------------

    DOWNLOAD: 1.35 Mbps
    Upload: 1.24 Mbps

    Details of router

    ----------------------

    Cisco WRVS4400N

    Firmware version: V2.0.1.3

    Phase 1

    Encryption: 3DES
    Authentication: MD5
    Group: 1024 bits (Group 2)
    Life key: 28800 sec

    Phase 2

    Encryption: 3DES
    Authentication: SHA - 1
    Group: 1024 bits (Group 2)
    Life key: 3 600 s
    Perfect Forward Secrecy: enabled

    From the day that VPN has been implemented, the performance was poor. Frequent disconnections sessions live to the VPN nodes and very low transfer rate was alarming to users.

    The servers in A location and users to the site B gets authenticated at the server DC level in A location

    Applications of Terminal Server remote as Quickbooks, QQ Evolution, attendance RX serve also the location has by users to the location B

    The login is your time and all applications are extremely slow.

    I tried to copy files between share data between two locations and the results are as follows

    Location A to location B-> 130 Kbps 140 Kbps

    Location location B A-> 150 Kbps to 160 Kbps

    What can be the problem for these poor performance VPN?

    -Change the encryption for the least secure OF THE /MD5 would have a significant impact because it can reduce the overload on the routers?

    -Even if both routers are routers SMB, it has really good VPN flow according to the data sheets. I couldn't find VPN flow mentioned in the WRVS4400N data sheet. One of the sons of CSC, I also noticed the VPN of WRVS4400N flow seemed really low as only about 1.6Mbps. (https://supportforums.cisco.com/thread/2107881)  Whereas RV220W router has VPN 90Mbps flow, according to the datasheet.

    So, what can be the cause of the problem and what can be fixes possible?

    Help, please!

    ANUP sisi

    Beginner to router Cisco VPN, please help

    RVS4000 was designed to work in a small office. It supports 5 VPN tunnels with a maxium of 2 Mbps flow measured in a laboratory environment. It has a processor that has a motor integrated IPS, who would deliver 20 Mbps LAN - WAN throughput when IPS is enabled.

    RV220W has been designed to operate in a slightly larger office with 25 IPsec VPN tunnels. It has a processor that has a built-in cryptographic engine able to deliver throughput 90 Mbps of IPsec. RV220W also supports 5 SSL VPN tunnels that can be used by employees and business partners for remote access.

  • disc Flash of poor performance

    Hello
    When I run $cellcli EI list physical disk, some of the Flash drive is showing a poor performance.


    alprod1st09: FLASH_5_0 1116M08EUW poor performance
    alprod1st09: there is no such thing as FLASH_5_1 1116M08EV9
    alprod1st09: FLASH_5_2 1116M08EVA poor performance
    alprod1st09: FLASH_5_3 1116M08EVC poor performance

    is it requires to call oracle for the replacement of flash drive... it is very critical?
    Kind regards
    ANI

    One of your flash cards shows also absent I would suggest contact you oracle for a glance. You are on the last cell server software? There used to be a problem that caused problems with the pci riser cards. It is fixed in the latest software drivers.

  • Poor performance of Firefox after you apply the latest Microsoft Updates (Win 7 x 64); all solutions?

    Recently, I updated to Firefox 27 and noticed really horrible performance (Manager tasks indicates FF connecting a carrot, frequent "Firefox is not responding messages", even strikes in late development in the URL bar). It's on an Ideapad s205 (AMD E450 APU, Win 7 x 64, 8 GB RAM, SSD) who has always had pretty decent web browsing performance for a low end machine.

    At first, I blamed FF because poor performance coincided with the update to version 27, but now I think that the first cause to be a recent Microsoft Update. The reason is that my wife has a laptop with a same low-end APU (APU C60, hard drive 5400 RPM, 4 GB of RAM, Win 7 x 64), and she was getting much better performance with FF27 until I applied a backlog of some 90 + updates. Now she suffers from the same poor performance I am and she is pretty p * ssed at home.

    Interestingly, I have two WIn 7 x 64 Intel computers to office who have 27 FF and are fully patched, and performance are very good. Maybe this problem is specific to AMD APU.

    Any thoughts? I tried to turn off the backend Azure with some comments in this forum, but makes little or no difference.

    Thank you!

    Success! 32 FF seems to have solved my problems of performance. Thank you!

  • How to clone the hard disk on Mac

    I've done it before. Then I used Carbon Copy Cloner, but for some reason any CCC doesn't work anymore. My OS is said that only applications that have been purchased in the works of the appstore. Is this true? And how to make a bootable clone - I can't find a clone-app in the appstore? I get upgraded my OS and want to save a copy of my old BONES just one of nine cases security is not working properly.

    You need the CCC for the OSX version you have. It still works perfectly well.

    If you have MountainLion, Mavericks, Yosemite or ElCapitan: updating CCC4 should do the job.

    Earlier OSX to CCC3.

    AppStore has nothing to do with it.

    SystemPreferences-> Security & privacy-> general set "MacAppstore and identified developers."

    then you can install it.

  • Satellite L300-1BV you can file a copy of the recovery disks

    Hello
    Just out of curiosity.
    I have not tried, but I heréd you can make a copy of the recovery disks, using the toshiba disk creator.

    I just thought it would be faster posting this question, rarther than to try.
    I don't know it costs £30 for a copy of the recovery disks, which led me to think are for people who did not create recovery disks or people who lost it copy recovery disks.

    I myself only one copy

    No, you can do as much as you want. But it only works on the L300

  • Cannot remove security file Carbon Copy Cloner in El Capitan

    OS X on Macbook Pro 10.11.2.  I dragged Net Carbon Copy Cloner file to the trash and tried to empty the trash.  I get a series of error messages indicating that the various files may not be emptied because they are currently in use.  I tried to empty the Recycle Bin by using Terminal Server and freeware, Trash it! but receive the error messages that the action is not allowed.  I've never had such a problem before.  This represents nearly 5 GB of files that I can't remove.  Help, please.

    John

    Open Carbon Copy Cloner, disable the SafetyNet feature, then clone again.

    all files that are not on your original drive will be deleted on the clone.

  • copy of a recovery disk

    Hello

    I just created a recovery for my compaq presario cq40 disc.  I burned on a DVD + R DL RW verbatim.  Recovery manager allow me to create another disc of recovery and said recovery disk that only one per cell is allowed.

    is it possible to copy this disc? just to double back the reasons. It will work just the same as the original disk, I created with the Recovery Manager?

    In my view, that it won't let you create another one due to the violation of the copy right or something of this nature.

    I think you can copy them using image burning.

    http://download.CNET.com/ImgBurn/3000-2646_4-10847481.html

    I just tried this program and it allowed me to copy my HP factory recovery disks, so there is a good chance that it will work for you.

    Use the "create disc image files", it creates ISO files that you store on your disk hard that you can then burn to a DVD and create a copy of your recovery disks. I think that you may need to use double layer here.

    You say burn Image where to put ISO files. I would like to create a new folder on the "C" drive and put them in there.

    As for your other question, it should be an exact copy that will work. You can always try again later and stop at the place where it warns you that you are about to format your hard drive and it's the last chance to stop the recovery process.

    See also this post here where Cheryl has left some very useful links about startup creating backup discs.

    http://h30434.www3.HP.com/T5/operating-systems-and-software/creating-recovery-DVD-s-and-deleting-the-partition/m-p/245727

    A second from the top. I wouldn't bother even burn a second series. I just have a few new using the Cheryls links. That way if you don't have a catastrophic failure, it will put the hard drive back as you want it and not image of original HP.

    Please give a KUDOS to Cheryl and myself, if you found this post useful.  Thank you

    I ran an experience and actually tried this and it works fine. When you use Image burn make sure you check the box to 'check' your DVD. I think it may already be checked by default however.

    I had a spare hard drive to try it and I only allowed to go as far as the warning, then I cancelled the recovery process. Had let it go all the way I'm sure it would have worked.

  • I "dragged" a folder of a drive on the DESKTOP so I could copy on a new disk. When they are copied to a new disk, the file is empty. The file is recoverable?

    I "dragged" a folder of a drive on the DESKTOP so I could copy on a new disk.  When they are copied to a new disk, the file is empty.  The file is recoverable?

    Hello

    You can try this program for recover data:

    http://www.Piriform.com/Recuva

    See you soon.

  • Why can't copy information from a disk to a CD - RW

    My computer: Windows Vista SP2 32-bit (Home Premium) network, Internet explore 8 No.

    I want to copy programs from a disk to a CD - RW, so it can be loaded on a computer without a floppy drive.

    I copied the info on my machine and the programs do not run. HOWEVER, I can't get the info on a CD. It will NOT format, so I erased a disc on which I got info. Tried to copy info and he entered in FORMAT mode and Windows could not complete the format. Help! thanx

    My computer: Windows Vista SP2 32-bit (Home Premium) network, Internet explore 8 No.

    I want to copy programs from a disk to a CD - RW, so it can be loaded on a computer without a floppy drive.

    I copied the info on my machine and the programs do not run. HOWEVER, I can't get the info on a CD. It will NOT format, so I erased a disc on which I got info. Tried to copy info and he entered in FORMAT mode and Windows could not complete the format. Help! thanx

    Use a CD - R.  No need to "format".

    While I appreciate your response. It is a stop-gap measure, but does not know why I can not format a disk. THANX

    Assuming you have done this before - with success - must understand that he has changed.
     
    I do not think that the diskette data have nothing to do with the question (especially since the data is copied from disk to the machine already.)
     
    Can still burn you - successfully - anything else?  As a file text you create on your desktop?
     
    You might consider third-party software - better in most cases anyway.

  • Reinstall vista again HARD drive now PC don't can not boot from the DVD drive I can copy vista external hard disk drive, and then install on the laptop

    Duplicate info wire - running kill disk, vista disappeared and my laptop does not see my dvd/cd drive and I can't reinstall vista OS because of this problem

    Have to reinstall vista on a new HARD drive now PC can not boot from the DVD drive I can copy vista external hard disk drive, and then install on the laptop?

    The DVD player worked before HARD drive went bad now, it won't work.

    And I just replaced the HARD drive, but now cannot load an operating system that he...

    Help, please...

    Hi dynamitenews

     

    1. are you able to boot to the desktop?
    2. what happens when you try to start the computer?

     

    You must have the DVD drive to start the computer using the disk, you cannot use the external hard drive to do the same thing.

    Also I suggest you to make sure you have defined the start as CD/DVD-Rom as the first choice option in the BIOS. See below the help link-
    http://Windows.Microsoft.com/en-us/Windows7/BIOS-frequently-asked-questions

    If nothing is done, then you can contact the manufacturer support for assistance on setting up the correct boot sequence and check.

    BIOS WARNING-
    Change (CMOS) BIOS/complementary metal oxide semiconductor settings can cause serious problems that may prevent your computer from starting properly. Microsoft cannot guarantee that problems resulting from the configuration of the BIOS/CMOS settings can be solved. Changes to settings are at your own risk.

     

    I hope this helps.

  • HP Mini 110-3530NR extremely poor performance on the Internet

    My HP Mini 110-3530NR Netbook has very poor performance on the Internet.  I use Windows 7 Starter.

    Say hello to new coppens1.  I apologize for the delay in my responses.  I have not received the normal e-mail notifications.

    When I had to go to msconfig earlier in our interactions you make sure that the Synaptics driver load with Windows?  Follow these steps to check.

    1. Click Start, type "msconfig" and press ENTER.
    2. Go to the Services tab and search for "HP Software Framework".  This should load with Windows for a lot of the HP software to work properly.
    3. Then go to the Startup tab and make sure that anything it either by "Synaptic" is loaded with Windows.
    4. Save your changes and exit msconfig.
    5. Then go to your touchpad settings and, even once, make sure that the settings are correct.
    6. Finally, restart the machine and make sure it works properly.

    I totally understand if you want to open a new thread as this covered a few topics!  Just make sure to send me a private message with the link so that I can make sure to help you here.

    I wish you a beautiful day JC!

  • SG300 switches have poor performance in layer 3?

    We have several switches SG300 Serices. We use them to route traffic to VLAN remote offices, the Internet connections and wireless access Points.

    In a remote office, we have a SG300-10 facility to route the HQ network and the remote office subnet. The SG300 is connected to the seat through fiber and contains several VLAN Tag. If I speed, tests on the fiber of the entrants Netwotk tag link I get decent performance, 80Mbs. If I switch to a networtk who is not priginating of the central administration and road SG300-10 package, I get poor performance. 15 - 20Mbs.

    I have Fireded until a new FW SG300 - 28 p v1.2.7.76. Added a HQ VLAN 101 and VLAN new, 1025. Mapped some Tagged and not marked for each ports.  Switch has been connected to the network of HQ as untagged VLAN 101.  I put a laptop on a unmarked port VLAN 101. Ran some tests, cam is back with 750-850Mbs. great.  Put the same computer laptop on a Port of 101 tag, set the NETWORK card for tag VLAN 101, same test, same speed, 750-850Mbs.

    I configured then laptop for tag VLAN 1025. Connected to the port 1025 VLAN scored. Done speed tests, the results were 15-20Mbs!

    Then I configured laptop for Untagged VLAN 1025. Connected to unagged port 1025 VLAN. Done speed tests, the results were 15-20Mbs!

    It was only the laptop and connect to the net on the SG300 - 28 p P.C. Why this device's performance is so poor when he needs to route?

    Other switches have v1.0.0.27 FW or FW v1.1.2.0. They have similar speed problems. All configured for layer 3.

    Thank you!

    Scott<>

    How are customer gateways and server configured?

    The default gateway for connecting devices should probably be that of the IVS, they are directly connected to. So if you have a server connecting to a SVI 192.168.1.100 then the gateway server should be 192.168.1.100, not a router upstream. Who can create a loop of road if the return circulation.

    -Tom
    Please mark replied messages useful

  • Copy/clone DB for Oracle 11 g (need help)

    Hello guys,.

    I am a developer Oracle and prompt to convert the script to copy/clone oracle 9i and oracle 11g db. (without using RMAN)

    I spent using oracle9i db scripts and the steps are as follows

    (1) the control of the script file creation
    ALTER database backup controlfile to trace noresetlogs

    (2) creating the LINK for udump, cdump and bdump

    LN - sf/apps/oracle/diag/rdbms/SOURCEDB/SOURCEDB/bdump/apps/oracle/admin/SOURCEDB/bdump
    LN - sf/apps/oracle/diag/rdbms/SOURCEDB/SOURCEDB/cdump/apps/oracle/admin/SOURCEDB/cdump
    LN - sf/apps/oracle/diag/rdbms/SOURCEDB/SOURCEDB/udump/apps/oracle/admin/SOURCEDB/udump
    (2) take the info from the data path files in a file of source db
    Select file_name in sys.dba_data_files
    Union select sys.dba_temp_files file_name
    Union select name from v$ controlfile
    Union select Member from v$ logfile;
    (3) TURN OFF THE SOURCE DB
    (4) amending the control file

    CREATE CONTROLFILE
    ....
    LOGFILE
    DATA FILE
    RECOVER THE DATABASE
    -Database can now be opened normally.
    ALTER DATABASE OPEN;
    (5) changing the queue (STEP1) control replacing the SOURCE db DB TARGET
    Change the file data (from step2) 6) and copy of the DBfiles in the new location
    (7) COPY init.ora, init_batch.ora, init_tp.ora
    (8) run the file control (created from step 5)
    9) creating the LINK for (TARGETDB) bdump, cdump, udump
    LN - sf/apps/oracle/diag/rdbms/TARGETDB/TARGETDB/trace/apps/oracle/admin/TARGETDB/bdump
    LN - sf/apps/oracle/diag/rdbms/TARGETDB/TARGETDB/cdump/apps/oracle/admin/TARGETDB/cdump
    LN - sf/apps/oracle/diag/rdbms/TARGETDB/TARGETDB/trace/apps/oracle/admin/TARGETDB/udump
    (10) CREATE TARGETDB TO SPFILE
    (11) START UP targetDB

    Fortunately, I ran the same script for ORACLE11G it works and DB is also copied to 11G.

    Team,

    What worries me is... same scenario for 9i works very well in 11g means what's the features I can include for 11g (what I might have missed)

    NOTE: WITHOUT RMAN

    Please suggest.
    Oracle 11g backup/cloning is the same as 9i as steps above. ?  Please suggest I can include measures to which has the advantages of 11 g. (without RMAN)

    Please Guide

    S

    supersen wrote:

    It gave me 10 days to complete the script. I can't give the same script for the management team... I'm worried.

    I will include 11 g features in the script after that copy DB is finished.

    Please highlight from DB 11g features I can include

    Thank you

    S

    As mentioned earlier, all or the features to be added depends on many factors i.e. you have the use of this feature, are you allowed to use this etc etc. If you are a developer, someone see what features you used in any other 11g of your environment. Your script should do the part of cloning. Features added in the cloned part can happen later.

    Aman...

Maybe you are looking for