vmxnet3 adapter on windows server 2012 with problem of bottleneck for MSSQL Server

Hello!

We have a server windows 2012 R2 with MSSQL server 2014.

The client software uses the jdbc for database connection. If customers make a query which collects a massive amount of data the whole thing slowed down after a while.

Then, his need to wait 10-20 minutes to speed up again. I have tested and tried everything.

-measure the ethernet parameters

-replace the cables by cat7

-installed a virtual machine with the windows client and the real customer use the virtual environment via rdp

-activated the RSS in the vmxnet3 advanced settings and windows

-the mode SplitRx in vcenter vm settings and disabled ethernet Coalescent too

-set the VM to high latency

-tried to migrate the virtual machine to another host

Not for their help. If a massive sql query is run first its great, then the need for a second or more to check a single record.

checked the vm cpu stress but its less than 5% all the time. Checked the network with wireshark, there are a lot of small packets but nothing big. The bandwidth used is still low.

When its idle delay after two packets will increase from a few ms to 400-500 ms.

Our most powerful server is an HP DL380 G9 with two octa core Xeon processor 384 GB of ram, full SSD datastore. Its a lightning fast host.

The virtual machine have 8 core cpu and 64 GB of ram.

No matter where am I up the virtual machine or how many resources provide the custom aisle question.

The strange thing is when customers slowed down I can copy large files between the client and the server with fast speed, so the slow sql.

I can solved this question if I use the ethernet E1000 instead of the VMXNET3 adapter, but E1000 have much more load and the server need to transfer big files too, not only the sql service.

Vmxnet3 much faster and have less overhead, but this question of sql, I have a problem with that. So I go back to the E1000 for now. Its slower eat more cpu but the sql connections works very well without any problems.

Can someone tell me what I can try harder to identify the vmxnet3 problem? I really need it to improve network performance and lower overhead, but the rapid sql is the top priority.

Thank you!!!

We had exactly the same problem on our SQL servers once upgraded to Vsphere6.This is due to Receive Segment coalescence feature in new VMXNET3-nics on Win 2012.

More details here: http://nickmarshall.com.au/blog/2015/7/24/vsphere-6-hardware-version-11

The best way to solve this problem is to turn it off completely in the server operating system (in the admin command prompt):

netsh int tcp set global rsc = disabled


Check with:


netsh int tcp show global

It's fast and easy without downtime or disruptions and involves no change types of nic.

After doing this on all our SQL and application servers, everything was ok.



Tags: VMware

Similar Questions

  • Enabling Jumbo frames on VMXNET3 adapter in Windows Server 2012

    Hello everyone on the forums of wonderful Equallogic :)

    We have a PS4100X of the virtual computer running on vSphere 5.1 EQL. Everything works very well, and we are about to migrate a VM 2012 SQL our database. I did some research on the issue of whether we should allow the frames extended on the VMXNET3 adapter in the virtual machine.

    Reading this white paper, it seems there are large performance benefits to enable jumbo frames and a few other options in the NETWORK adapter settings:

    http://en.community.Dell.com/TechCenter/Extras/m/white_papers/20403565.aspx

    Just curious as to how other people and if they saw an improvement in performance. Someone at - he had experience with this?

    Thank you

    Lee

    Frames being good or bad, is highly dependent on the switching infrastructure.   If the switches do not manage flowcontrol and frames, then performance could be worse with frames enabled.

    If the switches are not on the list certified for EQL tables, I tend to start with the standard frames, get a baseline run, then try frames gradually and do things of course worsen.

    Extended frames may provide an advantage, he will never be a huge increase, but it improves the efficiency of the network and could reduce the overhead of the processor.    Which are not mandatory for EQL iSCSI environments.

    Please check best practices with document ESX.  That can really help to maximize your performance with storage EQL.

    http://en.community.Dell.com/TechCenter/Extras/m/white_papers/20434601.aspx

    Kind regards

  • EPM 11.1.2.4 - IIS on Windows R2 2012 configuration problem

    Hi all

    I'm done installing Hyperion 11.1.2.4 on 2012 R2 in Windows version, while the configuration, I get the error below.

    IIS Error.png

    Windows 2012 R2 comes with version 8.5 of IIS. I checked in IIS, there is 'Default Web site' and open the IIS to the Internet Explorer browser without any problem.

    I checked the matrix certification for Hyperion 11.1.2.4, that they have specified only IIS 6 and IIS 7.x for the Web and applications, server and Windows 2012 R2 for the OS but there is no exception "Server EPMA Dimension".

    Note: The configuration of IIS 7.x specify up to Windows 2008 R2.

    No someone came across the question above? Please suggest

    You have followed all the prereqs in the docs > Microsoft Internet Information Services (IIS)

    Maybe compatibility mode?

    I edited my original post because I have provided the link, but you just get people who say the same thing as the link so here's the info in the link (a single click if)

    Microsoft Internet Information Services (IIS)

    The following products require IIS must be installed with ASP.NET support is enabled before installing the EPM system product:

    • Performance Management architect Service (Server Dimension)
    • Strategic Finance
    • Data relationship management

    Notes on IIS:

    • In the Windows Server Manager, make sure that the following options are selected for the roles for the Web server (IIS):

      • ASP.NET Application developing
      • Compatibility with IIS 6 management under administrative tools (for IIS 7 and IIS 8 only)
    • If .NET is not detected, EPM System Installer installs the version required by your version of Windows.
    • On Windows 2008 and 2012 of Windows, if you configure the products requiring IIS, EPM System Configurator automatically configures the Windows Server roles required for IIS if they are not already installed.
    • If IIS is chosen as the web server during the configuration, you must allow all unknown ISAPI extensions through the Internet Information Services Manager.

    See you soon

    John

  • With problems of trial for the CS6 installer download Adobe Premiere is not configured

    When I want to start the track download for Adobe Premiere CS6 it is a pop-up window saying that the installer is not legitimately set up. Is it because of the download software with a technical problem, or is it my computer?

    I have a windows 7 aspire M5811, 64-bit edition and an Intel core i5 with 6.00 GB RAM.

    Can someone help me please?

    Thanks in advance!

    I think you are facing difficulties with Adobe Download Assistant.  Please remove the copy that is currently installed on your computer via the control panel of features to & programs.

    If you continue to experience difficulties, you can launch a direct download by following the process listed at http://forums.adobe.com/thread/981369.

  • Games for Windows works only with "games for windows - live» Can not understand.

    So the problem I encounter is that I can't get games purchased with the headliner "Games for Windows" to work with the software "Games for windows".  No drop-down list, no information other than a market place when I opened "Games for Windows - Live.  No ability to view videos downloaded from the software, just to go to my documents to view the downloaded content.  Installed games appear in the GAMES folder and they open and can be played.

    In particular, the game I'm playing is called "Monster Madness - battle of Suburbia".  I'd love to play and get achievements for my account xbox live and others, I love the ability to have that extends from PC to the Xbox, the other game I have is bioshock.

    All advice, instructions or ideas will be appreciated.

    Thank you

    -J' I reset my computer
    -J' uninstalled and re-installed the "games for windows - live.

    Hello

    Welcome to Microsoft Windows 7 answers Forum!

    The question you posted corresponds to the games and would be better suited to the games forum community. Please visit the link below to find a community that will provide the best support.

    http://www.Microsoft.com/games/en-us/community/pages/forums.aspx

     

    Hope this information is useful.

    Thank you, and in what concerns:

    Suresh Kumar-Microsoft Support.

    Visit our http://social.answers.microsoft.com/Forums/en-US/answersfeedback/threads/ Microsoft answers feedback Forum and let us know what you think.

  • Windows Server 2012 Foundation and SMB problems with older equipment

    Hello

    My problem would be resolved if I had Windows Server R2 2012 but I have Windows Server 2012 Foundation.

    This article describes the problem exactly: https://support.microsoft.com/en-us/kb/2896636

    But of course, the solution does work with my version of the server.

    Does anyone know if there is a similar fix available?  I got my hunting.

    This issue is beyond the scope of this site (for consumers) and to be sure, you get the best (and fastest) reply, we have to ask either on Technet (for IT Pro) or MSDN (for developers)

    If you give us a link to the new thread we can point to some resources it
  • ProLiant DL320e with Windows Server 2012 Bluescreen

    Hello

    I installed Windows Server R2 with smart supply a Proliant DL320e Server 2012 R2 and it bluescreens much. The blue screen message is a pretty no description "KERNEL_SECURITY_CHECK_FAILURE".

    I installed a second Proliant DL320e server and it shows the same behavior, so I conclude that this isn't a defective hardware.

    I found some knowledge which mentions screens blue and with the driver for Smart Array
    http://h20628.www2.HP.com/km-ext/content-webapp/document?docid=emr_na-c03793656 & DTD = default & local = d...
    But the update and version numbers do not match.

    Drivers, software and firmware for the HP DL320e Gen8 ProLinat Server Page did not all downloads for my OS-, but it displays a warning that it is experiencing problems.

    I tried to fill in the HP Support Assistant, but I got an email in response, telling me that they are currently unable to help with e-Mail support.

    The servers are offline on a clients site in a restricted environment so that they lack updates online.

    During this time, I downloaded the SPP Service Pack for Windows Server
    FTP://FTP.HP.com/pub/softlib2/software1/CD-generic/p652182553/v84427/SPPMDSLWIN2013090.2013_0830.7.i... and today, I'll try if it corrects the blue screens.

    Does anyone have pointers?

    Take care

    Martin

    Thank you, I have not found this forum. If an admin could move it which would be best.

    Just in case anyone else has this problem is this question:

    I contacted HP by telephone support and the solution is:

    Do not use smart supply when you configure your server, it is not supported and it will be randomly bluescreen with Windows Server R2 2012. You must install windows directly, so take your storage driver and copy it to a usb key and load the driver during the installation of windows. In my case I needed to use the mass storage drivers for Windows Server 2008 R2 from http://h20565.www2.hp.com/portal/site/hpsc/template.PAGE/public/psi/swdDetails/?sp4ts.oid=5293151 & spf_p.tpst = swdMain & spf_p.prp_swdMain=wsrp-navigationalState%3Didx%253D%257CswItem%253DMTX_9b5424c852a54e49b501e280e5%257CswEnvOID%253D4064%257CitemLocale%253D%257CswLang%253D%257Cmode%253D%257Caction%253DdriverDocument & javax.portlet.begCacheTok = com.vignette.cachetoken & javax.portlet.endCacheTok = com.vignette.cachetoken

    Take care

    Martin

  • HP Color LaserJet 4600 PS: Driver HP Color LaserJet 4600 PS printer Windows Server R2 2012 problem

    Hello team HP,

    We used the driver 32 bit printer "HP Color LaserJet 4600 PS" to write the PDF file using Acrobat Distiller in Windows server 2003 operating system.

    But now, we have migrated our production environment for Windows Server 2012 R2 64-bit operating system and using the 32-bit printer "HP Color LaserJet 4600 PS" driver in the operating system Windows Server 2012.

    Is the driver support 32 bit printer "HP Color LaserJet 4600 PS" Windows Server 2012 R2 64-bit operating system?

    If it is not supported then what printer driver will support the Windows Server 2012 R2 64-bit operating system?

    Help us to this problem as soon as POSSIBLE and its very high priority for us.

    Kind regards

    Gaudin. B

    Hello

    CLJ 4600 is not supported on Windows Server 2012. However, you can use HP Universal Print Driver (UPD) for print on CLJ 4600 of Win Server 2012.

    Here is a list of the printers supported with the UPD: http://h20564.www2.hp.com/hpsc/doc/public/display?docId=emr_na-c04324001#N106AD

    Specification of the UPD: http://h20564.www2.hp.com/hpsc/doc/public/display?docId=emr_na-c04380141

    Thank you

  • Remote access Windows Server 2012 through internet with desktop connection

    Summer messing about with it for days and don't get no love.

    Try to connect with Windows 7 Ultimate edition to Windows Server 2012 Data Center version from outside my home network, Starbucks or McDonald's or my server at home.

    Tried all these steps found in this promising and useful article:

    http://Windows.Microsoft.com/en-us/Windows7/allow-remote-desktop-connections-from-outside-your-home-network

    1. Allow connections to the computer you want to access remotely. DONE - ADDED to THE SERVER AND NON-ADMIN ACCOUNT to RDP GROUP of ROLES, using network level authentication. Connection of Win 7, so this method of authentication should not be a problem, I assume.
    2. Make sure that remote desktop is able to communicate through your firewall. DONE - FOR BOTH PUBLIC AND PRIVATE RULE.

    3. Find the IP address of the computer on your home network you want to connect. MADE - by using the ipconfig/all command

    4. Open your router configuration screen and worms forward port 3389 for TCP IP address of the destination computer. DONE - NOT TCP/UDP but TCP only, internal and external port goes. Note: The use of a booster signal wifi at the end of the House, it is a problem that requires additional configuration? I don't think he has an ip address or acts as a router. But in desperation I can try unplugging then again head the local Starbucks to try to connect.

    5. Find the IP address of the router so that the remote desktop can be found on the Internet. DONE - using "what is my ip", pretty easy.

    6. Open Remote Desktop connection, and connect. ACTUALLY, I think THAT, IN ENTERING [ip router]: 3389.

    But the result of the message is always the typical:

    (1) remote access to the server is not enabled.

    > But this is not true, that I am capable of the DRC at home on the server machine.

    (2) computer remote is not off.

    > But this is not true, as I just left home 30 minutes and sometimes it's rarely, only restarted.

    (3) the remote computer is not available on the network.

    > Don't know what that means. Of course the remote computer is not on the network, I am on right now. It's on my home network. But I can ping my router ip via cmd, then coming to the outside can be done; through my router, I should be able to access inside my home network port forwarding w. But no love.

    So... what to do, what to do...

    The wifi booster is a problem?

    Connects to the Data Center edition a problem?

    What happens if I uncheck the option ' use authentication NLA, is that the passage of the security risk?

    Any ideas about the configuration I could be missing before giving up and go for VPN or TeamViewer. I would really like to see materialized during all the time that I put in trying to run the DRC.

    Thanks for any input.

    / Markus

    Hello

    Post your question in the TechNet Server Forums, as your question kindly is beyond the scope of these Forums.

    http://social.technet.Microsoft.com/forums/WindowsServer/en-us/home?category=WindowsServer

    See you soon.

  • Unabl eto manage my mail server using Alt - N Mdeamon Mailing software with windows server 2012 R2...

    Original title:

    Mail server

    Guys, I'm having trouble managing my mail server using Alt - N Mdeamon Mailing software with windows server 2012 R2...

    Can anyone suggest Me an alternative to that.

    Waiting for the answer

    Problems to go to the post office software company.

    Google for other e-mail programs.

  • Color LaserJet 200 M251 and Windows Server 2012 R2 installation problem

    I have a problem installing with the M251 printer on a clean install of windows server 2012 R2.

    I want to connect the printer via USB only.

    I tried installing the driver package and with the complete package. I turned on the printer of the smart install feature.

    But every time the same problem occurs.

    The printer driver is correctly installed, but the printer HP (LEDM) driver failed.

    The debugging information:

    Installed the device.

    hpbuio25l.inf _amd64_85c42d890fc & dc10\hpbuio35l .inf for the device USB \VID_03F0&PID_132A&MI_01\6&3AB71850&6&0001 instance ended up with the following status: 0xE0000219

    If I want to reinstall the driver again, I received the message:

    Setup error

    An entry in the Inf file is missing, the file may be Windows 95...

    Could you please help me, how to solve this problem?

    I need to activate the visual experience of Windows Server 2013, then the USB works

  • L2TP/IPSec connection failed for Windows 7 Ultimate for Windows Server R2 2012 with error 789.

    For this preface, I use the server in a lab environment and trying to set up my own VPN L2TP/IPSec. I opened the UDP 500 and 1701 TCP ports on my router for the interface of the primary server where is the VPN. It is on a Comcast connection consumer where other applications such as Arma 3 servers dedicated and IIS have worked.
    The RRAS role to run based on this tutorial: http://www.thomasmaurer.ch/2014/01/how-to-install-vpn-on-windows-server-2012-r2/ I have only strayed from it using DHCP forwarding instead of a static pool of IP as my router is running a DHCP server, and if I understand correctly, the router must give IP addresses of the internal IP pool which I use for everything else. I also use the PSK authentication rather than be based certificate. For the authentication of users I have MS-CHAP-V2 and CHAP enabled; I connect from the remote device with an account on that I created on the server for the purpose of this VPN I know RRAS connections are allowed.

    When the connection I get error 789: L2TP connection attempt failed because the security layer detected a processing error during initial negotiations with the remote computer. From what I've seen, this can be fixed by checking that the two ends of the connection are not behind a NAT (not an option), verification of the PSK (already done) and certificates (not applicable). If there is a way to solve this problem that would be great, but my server will always be behind a NAT firewall because the router is one, and the modem becomes one if several devices are connected to him without a router between the two.


    This issue is beyond the scope of this site and must be placed on Technet or MSDN

    http://social.msdn.Microsoft.com/forums/en-us/home

  • Installation of Weblogic 10.3.6 with generic Setup on the SP2 of Windows Server 2012

    Hello Experts,

    I try to install WLS10.3.6 on MS Windows Server 2012 (64-bit) SP2 with generic Setup.

    1 installed jdk1.7 (jdk-7u80-windows - x 64)

    2. then ran wls1036_generic.jar

    C:\Program Files\Java\jdk1.7.0_80\bin > java-D64-jar D:\SW_Installers\06.Weblogic\wls1036_generic\wls1036_generic.jar

    Cannot create the temporary extraction directory in the default location.

    , I get the above error message. Attaching screenshot. http://www.use.com/FpC0P

    Can you please help?

    Thank you

    Benoit

    Just to update, finally ran wls1036_generic.jar. Problem was probably related to the virtual machine.

    We were in-

    C:\Java\jdk1.7.0_80\bin>Java-D64-jar D:\SW_Installers\06.Weblogic\wls1036_generic\wls1036_generic.jar

    Error - a

    Cannot create the temporary extraction directory in the default location.

    The temporary extraction directory is the Windows temporary folder. The location is-

    Folder - %USERPROFILE%\AppData\Local\Temp where %UserProfile% - c\:users\ [acctname]

    But when you run start > run > %Temp%, I see.

    C:\Users\ccbgso\AppData\Local\Temp\2--et error was a drive is not accessible.

    And \2 was the problem, because there is not C:\Users\ccbgso\AppData\Local\Temp\2.

    To correct this error, we did it-

    Start > run > Regedit > hkey_current_user > volatile environment

    And found 2 below.

    Chosen the 2, then the two TEMP & TMP sought in the right pane.

    the values were - C:\Users\ccbgso\AppData\Local\Temp\2

    Right-click each & click on modify, remove the \2

    Clicekd on ok.

    Disconnected and re connected.

    And then ran

    C:\Java\jdk1.7.0_80\bin>Java-D64-jar D:\SW_Installers\06.Weblogic\wls1036_generic\wls1036_generic.jar

    This time, he began the extraction and 'Install Oracle - Weblogic 10.3.6.0' Welcome screen appears.

    Thank you best regards &,.

    Benoit

  • Problems installing OBIEE11.1.1.9.0 on MS Windows Server 2012 SP2

    Hello Experts,

    We install OBIEE11.1.1.9.0 on MS Windows Server 2012 SP2. He was installing (install the business - create a new BI system) smoothly, but in the last configuration Page progression at 27%, he was stuck. In accordance with the recommendation of oracle.

    It is a problem with WebLogic Server installation on Windows 2012 R2. That is documented in the unpublished bug 16844206 WLST IMPOSSIBLE GET ENV ON WINDOWS SERVER 12 WITH ENV MINIMAL

    MDG action plan-

    Install Java 1.7.

    Installation of WebLogic Server 10.3.6.

    Patch WebLogic Server with Patch 16844206 .

    Perform a software installation of OBIEE 11.1.1.9.0.

    Configure OBIEE


    Following the same thing we did it-

    (a) installed weblogic 10.3.6

    (b) Dowbloaded the patch and ran GUI and command line.


    1. When was held from the GUI

    Downloaded Patch_16844206. copied the content of this file zip, except the file Readme in your cache directory SmartUpdate (MW_HOME/utils/bsu/default cache_dir). Ran the bsu.cmd file located in the folder WM_HOME/Middleware/utils/bsu to open the Smart Update utility Oracle - and then 'downloaded Patches' table ffound Patch Id SRSV Bug 16844206 and then clicked on apply.

    However after doing a "running Validation" popup appears and he is blocked for 90 minutes at this same position. (see screenshot)

    http://www.use.com/FonC8

    2. When ran from command line-


    D:\app\Oracle\Middleware\utils\bsu > bsu.cmd-prod_dir=D:\app\Oracle\Middleware\wlserver_10.3-patch_download_dir = D:\app\Oracle\Middleware\utils\bsu\cache_dir-statut = downloaded - discovers - verbose

    Exception in thread "Main Thread" means

    D:\app\Oracle\Middleware\utils\bsu > bsu.cmd-prod_dir=D:\app\Oracle\Middleware\wlserver_10.3 - patchlist = 23698-verbose - install

    Exception in thread "Main Thread" means


    Any solution?


    Thank you very much

    Benoit

    Hi all

    According to Oracle advises has resolved it as follows.

    It is a failure with OutOfMemory. Increase the memory allocated for the process of the bsu. Change the following line in bsu.cmd

    MEM_ARGS =-Xms256m-Xmx512m set

    TO

    Set MEM_ARGS =-Xms1024m-Xmx1024m

    Basically, you will need to open bsu.cmd in Notepad, and then change the setting above. And then again run. And it will work.

    Thank you very much

    Benoit

  • Windows Server 2012 stuck at startup when running on top of KVM with active regrouping of CPU

    Hi all

    We observe an interesting problem when running Windows Server 2012 on top of KVM to multiple processors.

    When the collection of the CPU is disabled, Windows starts and works very well.

    When the grouping of CPU is activated by:

    bcdedit /groupaware on
    bcdedit /groupsize 2

    Windows hangs at startup while displaying a black screen with logo and won round progress indicator.

    We have produced the crash dump by injection of interruption NMI via QEMU/KVM debugging facilities, the look of stacks of appeal as follows:

    0: kd > ~ 0
    0: kd > kv
    Child-SP RetAddr: Args to child: call Site
    ' fffff803 ' 95645 c 08 fffff803 ' 941828de: 00000000'00000080 00000000' 004f4454 00000000'00000000 00000000'00000000: nt! KeBugCheckEx
    ' fffff803 ' 95645 c 10 fffff803 ' 93b66c09: 00000001' fffff803 00000000 ' 94196030 00000000 00000000' fffffa80' 05654968: hal! HalBugCheckSystem + 0x9a
    ' fffff803 ' 95645 c 50 fffff803' 94183204: 00000000 ' 000006 c 0 fffff803 ' 95645e30 fffff803 93 d 03100 fffff803'94196030: nt! WheaReportHwError + 0 x 249
    fffff803 '95645cb0 fffff803' 93be17a7: fffff803 '95645e70 00000000'00000010 00000000'80000005 fffff803' 93a2227d: hal! HalHandleNMI + 0 x 150
    fffff803 '95645ce0 fffff803' 93a84d02: 00000000' 32f7fc10 fffff803'95645ef0 00000000 00000000' fffff803 93 d 03180: nt! : FNODOBFM: 'string' + 0x13d6d
    ' fffff803 ' 95645 30 fffff803 d ' 93a84b73: 00000000'00000000 00000000'00000000 00000000'00000000 00000000'00000000: nt! KxNmiInterrupt + 0 x 82
    ' fffff803 '95645e70 fffff803' 93abb0cb: 00000000 ' 00000000 fffff880 ' 0315efb8 00000000'00001000 00000000'00000000: nt! KiNmiInterrupt + 0 x 173 (TrapFrame @ fffff803'95645e70)
    fffff880 '0315eab0 fffff803' 93b0191b: 00000000'00000000 00000000'00000000 fffff880 '0315f200 fffff803' b 9417, 291: nt! KeFlushMultipleRangeTb + 0x3c0
    fffff880 '0315ecb0 fffff880' 01709b 45: fffffa80 '018a 7040 00000000' 0f0049ed fffff880' 0315f200 00000000' 00000000: nt! MmSetAddressRangeModified + 0x14b
    fffff880 '0315edb0 fffff880' 0170a 471: fffff8a0 '00ba0010 00000000' 0f004b81 00000000'00000001 00000000'00000500: Ntfs! LfsFlushLfcb + 0xa55
    fffff880 '0315efc0 fffff803' 93ac8df5: fffff880'0315f160 fffffa80 '0187a6a8 00000000 00000000' fffffa80' 05621b 80: Ntfs! LfsFlushLfcbCallout + 0 x 25
    fffff880 '0315eff0 fffff803' 93ac9d85: fffff880 '0170a44c fffff880' 0315f160 00000000 00000000' fffff803 93 d 03180: nt! KeExpandKernelStackAndCalloutInternal + 0xe5
    "fffff880 '0315f0f0 fffff880' 0170 has 434: 00000000'0000000 fffff803 ' 93 d d 03180 fffff803 93 d 03180 fffffa80 ' 018a 7040: nt! KeExpandKernelStackAndCalloutEx + 0 x 25
    "fffff880 '0315f130 fffff880' 017cbe9b: 00000000 ' fffff8a0 00000000 '00ba0010 fffff880' 0315f200 fffff8a0 ' 00b 18901: Ntfs! LfsFlushLfcbOnNewStack + 0 x 50
    fffff880 '0315f190 fffff880' 017c8f75: fffff8a0 '00ba0010 00000000' 0f004b81 fffff880 '0315f480 fffff8a0' 00b 18950: Ntfs! LfsFlushToLsnPriv + 0x13f
    fffff880 '0315f230 fffff880' 017c851f: fffff8a0 '00ba0010 fffff8a0' 00ba0010 fffffa80'057 c 2480 00000000'00000062: Ntfs! LfsWriteLfsRestart + 0 x 145
    fffff880'0315f290 fffff880'017 c 6083: fffff8a0'00b98c10 fffff880 '00000070 fffff880' 00002102 00000000 00000000': Ntfs! LfsWriteRestartArea + 0x15f
    "fffff880'0315f3d0 fffff880'017 c 9889: 00000000 ' 00000000 fffff880 ' 0315fa90 00000000'00000000 00000000'00000000: Ntfs! NtfsCheckpointVolume + 0x6f3
    fffff880 '0315f920 fffff880' 017c57eb: fffff880 '0315fa90 fffff880' 0315fa90 fffffa80'057 c 2188 00000000 00000000': Ntfs! NtfsCheckpointAllVolumesWorker + 0x61
    "fffff880 '0315f970 fffff880' 017c954c: fffff880'0315fa90 00000000 00000000' fffff880 ' 017 c 9828 fffff880 ' 0315fa40: Ntfs! NtfsForEachVcb + 0x1bb
    fffff880 '0315fa10 fffff803' 93ac0391: fffffa80 '018-7040 fffff880' 0175d6d8 fffff803 93 c 91080 fffff803 93 c 91000: Ntfs! NtfsCheckpointAllVolumes + 0x12c
    fffff880 '0315fcc0 fffff803' 93a2f521: 00000000'00000000 00000000'00000080 fffff803 '93ac0250 fffffa80' 018a 7040: nt! ExpWorkerThread + 0 x 142
    fffff880 '0315fd50 fffff803' 93a6ddd6: fffff803 93 d 03180 fffffa80 '018-7040 fffffa80' 018bd040 fffffa80'01897040: nt! PspSystemThreadStartup + 0 x 59
    "fffff880'0315fda0 00000000' 00000000: fffff880 ' 03160000 fffff880 ' 0315a 000 00000000'00000000 00000000'00000000: nt! KiStartSystemThread + 0x16
    0: kd > ~ 1
    1: kd > kv
    Child-SP RetAddr: Args to child: call Site
    fffff880 '031ce940 fffff803' 93a5319b: 00000000 00000000' fffff880'04171000 00000000 '80000002 00000000' 00000001: nt! KiIpiSendRequestEx + 0 x 166
    fffff880 '031ce990 fffff803' 93a4d364: 00000000'00000040 00000000'00000040 fffff880 '031cebb0 ffffffff' ffffffff: nt! KeFlushSingleTb + 0x11b
    "fffff880 '031ceab0 fffff803' 93a4e9fc: 00000000 fffffa80'20000000'd 250 0178 00000000' 0007d9b7 2aaaaaaa ' aaaaaaab: nt! MiStealPage + 0 x 914
    fffff880 '031cee60 fffff803' 93a4ff87: 00000000' ffffffff 00000000' 0007d9b8 00000000'00000103 20000000' fffff803: nt! MiClaimPhysicalRun + 0x1fc
    fffff880 '031ceee0 fffff803' 93e8ea59: fffff880 '031cf2e9 00000000 00000005' fffff880' 0198f000 fffff8a0'00015470: nt! MiFindContiguousPages + 0 x 337
    fffff880 '031cf030 fffff803' 93e8f0ec: 00000000' 7d9b8963 00000000' 0007d9b8 00000000 00000000' fffff8a0'00003000: nt! MiAllocateDriverPage + 0 x 49
    fffff880 '031cf0a0 fffff803' 93e9eafb: 00000000 00000000' fffff880 '031cf2e9 00000000 00000000' fffff6fc' 4000cc78: nt! MiLoadImageSection + 0x23c
    fffff880 '031cf230 fffff803' 93e9f43e: fffff880'031cf390 00000000'00000000 00000000'00000001 00000000'00000000: nt! MmLoadSystemImage + 0x1c3
    fffff880 '031cf340 fffff803' 93e9979c: fffff880 00000000'00000000 00000000'00000000 ' 031cf860 00000000'00000003: nt! IopLoadDriver + 0x2ca
    fffff880 '031cf610 fffff803' 93e97fb6: fffff8a0 '00d04e00 fffff880' 0097b 340 00000000'00000000 00000000'00000000: nt! PipCallDriverAddDeviceQueryRoutine + 0x22c
    fffff880 '031cf730 fffff803' 93e95bc0: 00000000 00000000' fffff880'00000002 00000000 '00000000 00000000' 000007ff: nt! PnpCallDriverQueryServiceHelper + 0x13e
    "fffff880 '031cf7b0 fffff803' 93e9611e: fffffa80 ' 01892010 fffff880 ' 031cfa40 fffffa80 ' 01887670 fffffa80'd 018 4700: nt! PipCallDriverAddDevice + 0x400
    fffff880 '031cf940 fffff803' 93f09c07: fffff803 '93a 91700 00000000'00000001 00000000'00000000 fffff803' 93d90a52: nt! PipProcessDevNodeTree + 0x1ca
    fffff880 '031cfbc0 fffff803' 93b1381f: fffff803 00000001'00000003 00000000'00000000 ' 93ce06e0 00000000' 00000000: nt! PiProcessStartSystemDevices + 0 x 87
    fffff880 '031cfc10 fffff803' 93ac0391: fffffa80 ' 01898040 fffff803 '93b134bc fffff803' 93ce06e0 fffffa80' 0189 c 600: nt! PnpDeviceActionWorker + 0 x 363
    fffff880 '031cfcc0 fffff803' 93a2f521: 00000000'00000000 00000000'00000080 fffff803'93ac0250 fffffa80'01898040: nt! ExpWorkerThread + 0 x 142
    fffff880 '031cfd50 fffff803' 93a6ddd6: fffff880 ' 02a 15180 fffffa80 ' 01898040 fffffa80'd 0188 040 fffffa80' 01897040: nt! PspSystemThreadStartup + 0 x 59
    "fffff880'031cfda0 00000000' 00000000: fffff880 ' 031 d 0000 fffff880 ' 031ca 000 00000000'00000000 00000000'00000000: nt! KiStartSystemThread + 0x16
    7: kd > ~ 2
    2: kd > kv
    Child-SP RetAddr: Args to child: call Site
    fffff880 '02aafa08 fffff803' 93b4e12a: fffff880 '00000006 fffff880' 00000003 fffff880 '02-92140 fffff803' 93b4e9e4: hal! HalProcessorIdle + 0xf
    fffff880 '02aafa10 fffff803' 93ab69a0: fffff880 '02a8b5c8 00000000' 05f5e100 00000000'00000000 00000000'00000000: nt! PpmIdleDefaultExecute + 0xa
    fffff880 '02aafa40 fffff803' 93ab53c0: 00000000 00000000' 0000040c 0000040'c fffff880 '02aafca8 fffff880' 02aafcb0: nt! PpmIdleExecuteTransition + 0x47f
    fffff880 '02aafc60 fffff803' 93ab354c: fffff880'02 has 86180 fffff880 '02a 86180 00000000 00000000' fffff880' 02a 92140: nt! PoIdle + 0x1e0
    fffff880'02aafda0 00000000' 00000000: fffff880 '02ab0000 fffff880' 02aaa000 00000000'00000000 00000000'00000000: nt! KiIdleLoop + 0x2c
    2: kd > ~ 3

    There are always two or more CPUs stuck in KeFlush...() functions dealing with IPIs. 
    
    The problem looks like interrupt loss during IPI-ALL-BUT-SELF dispatching, we tried to track possible problems in KVM code that may lead to an issue like this but found nothing so far.The issue looks even more interesting taking into consideration that as far as we know CPU grouping is SW-only feature that doesn't have real effect on hardware.We will be grateful for any idea that could help to resolve the problem.Thanks in advance!P.S. Kernel crash dump is available at https://www.dropbox.com/s/07qb6wz9nacwhxn/MEMORY.DMP.zip?dl=0
    

    KV

    This issue is beyond the scope of this site and must be placed on Technet or MSDN

    http://social.msdn.Microsoft.com/forums/en-us/home

    If you pt a link here I want a few resources for the thread on TN

Maybe you are looking for