GigE lost frames/buffers

I'm losing Gige Frames/pads in a system that acquires way synchronous analog readings and images over long periods.

Computer: Nuvo 1300af 620, (Quad i7 processor clocked at 2.66 GHz, 5 ports POE GigE x, 3 GB of RAM, 256 GB SSD), Windows XP embedded, Image Acquisition OR August 2012. NiDaqmx, Labview 2009 pro

Camera: Basler Linescan RL2048 - 10gm Runner

Data acquisition: cDaq chassis with analog or 32-chan, OR 9401 9905 dig IO.

The camera and data acquisition modules use separate GigE ports which have different group addresses. GigE ports are disabled.

The LabView program has 2 while loops that run simultaneously. The CGI camera rotates at a speed of 3250 lines per second and has an image of 2048 x 384 (8.46 frames per second). CDaq NI9905 data acquisition module acquires simultaneously 18 channels analog readings to 3250 samples/second

Loop 1: Contains a Grab vi and an element of the queue vi. The vi Grab awaits the next buffer, then place for use of Tin while loop 2. The loop delay is set by the expectation of the next buffer (118ms) this loop has no other screws

Loop 2: contains a dequeue VI, waiting for the next element of the queue, setting the time of the loop. This loop also contains a VI to read NiDaqmx, who reads all the analog readings that are available each time around the loop. Images and analog readings are treated and are posted and immediately written to disk Solid State 2 files (1 analog data file file and.one of several image files). Writing of image files is organized so that these files will not exceed 1 GB in size: when an image file is full, writing going on to the next file. All files are created and opened at the start of the program.

At run time, at random intervals, a group of buffers to image is lost.

Monitoring of the VI Grab loop 1, it shows that when you run correctly, the increment of 1 buffer numbers whenever it reads a buffer, when buffers are lost, jumps from number of buffer to a value of 2 to more than 10. No errors are displayed. There is no change in the treatment in loop 2 at the point where the buffers are lost. Increase in the number of buffers (up to 100!) does not help

Applaud the time that the VI dequeue in while loop2 waits for the element following the queue, shows that this waiting time on average to about 60% of the time loop and goes through a minimum of 40%, except when the buffers are lost, when the timeout is momentarily not zero.

Windows performance analyzers show that the CPU usage is less than 20%, and the use of the network is less than 1%

Hi Blake,

I found a solution that solves my problem.

I thought that the VI Grab when the value to acquire the next buffer, return all gains buffer in sequence, unless a buffer is overwritten. Instead, if the buffers are entered not fast enough, it does not return the following buffer, but the last of them acquired and no error. I had put the number of buffers at 25 or more, so that replacement buffers was not a possibility.

I changed the program, so that keeps an account number of buffer (incrementing the number of buffer on each bucket) and specifies the number of buffer to the VI Grab. It works well, even on the occasions when the loop of the acquisition is occasionally momentarily delayed by up to a second or more, i suspect, Windows to write the contents of the disk the disk buffer, or do some other household.

Kind regards

Peter Westwood

Tags: NI Hardware

Similar Questions

  • I want to uninstall adblock plus and it is not running in the box add the handler plug-in slot by following the instructions. I lost frames and I can't find user friendly at all. I want to not go my images on my website builder will return. Please notify

    Apparently, I got something to add a filter or soemthing please I want to just uninstall it. I tried to disable it and my frames are still missing.

    AdBlock Plus doesn't block the frames, it blocks most ads on web pages.

    AdBlock Plus is an Extension, not a Plugin

    If this answer solved your problem, please click 'Solved It' next to this response when connected to the forum.

    Not related to your question, but...

    You must update some plug-ins:

  • Let fall speed when starting to save the AVI with camera basler GigE

    Hi all

    I use 2 cameras GigE of Ace basler at 60 frames per second to capture of animal locomotion. I randomly experience this kind of problem. When I start to save in a start/stop button and save videos in the HDD sometimes lower at 20-14 fps frame rate and a framework to skip 2 or 3. After that, the pace has become stable at 60 frames per second.

    Here are the parameters and specifications of the overall program:

    -J' use a loop of producer/consumer (I've ever known a fill of the queue even when the rate of drop occur)

    -J' fixed bandwidth of the card Intel GigE from 100 to 500 for each camera

    -sent packet size = 8000

    -firewall disabled

    -execution of vi in higher mode

    I observed that the dropping of the pace occur when the vi run for a while without interaction with the operator (the operator configure other settings in another computer, so the vi only acquire the video without saving)

    I have attached the vi

    Thank you for your help

    Alex

    Hi Eric and Isaac

    Finally, the problem was similar to that indicated by Peter Westwood in his post 'lost GigE frames/buffers '. I discovered that the problem occur with the version of labview 2012. Indeed, I tried with the 2011 version and I have it all fall. So, I'm doing the same thing that Peter is "I changed the program, so that keeps an account number of buffer (incrementing the number of buffer on each bucket) and specifies the number of buffer to the VI Grab." "It works well, even on the occasions when the loop of the acquisition is sometimes momentarily delayed for up to a second or more, i suspect, Windows to write the contents of the disk the disk buffer, or do some other household.

    So even if the fps drop the program acquire the right frame and in the video I do not see any image ignored

    Best regards

    Alex

  • FCPX fall images during playback w/new HW

    Due to the increase in the performance issues of the PCF (lost frames during playback, FCPX gel) on my iMAC 2010 - I bought a new system, including storage in late 2015.  But I still have issues with FCPX, deletion of images during playback I would appreciate some advice on.

    The old system was an iMac w/8 GB RAM Core i5 connected to a DroboPro with FW800 drive Bay.

    The new iMAC is the high-end retina 5 K 27 "(core i7, 4 GHz, AMD Radeon R9 M395 2048 MB, 3 TB Fusion lecteur connecté à un 4 de ThunderBay, quatre disques HDD avec double Thunderbolt 20Gb/s ports configurés avec RAID 5)."

    I still have some dropped frames during playback.  The first image I play works well for a few seconds if he runs.  But the next clip down boxes.  The clip takes sometimes a few seconds to display in the browser.  The clips that I play back have no effects applied to them.

    My capture files are stored on love at first sight.  The library of FCPX files are stored on the Mac hard drive.

    My current library has about 12 events.  Media and cache are stored in the library.  Backups are stored on love at first sight.  The library file size is 247 GB.

    Any assistance to solve my problems of performance is greatly appreciated I'm starting a large project of edition with 700 clips to sort.

    Try to put libraries in the table of love at first sight.

    It seems to me that you are running almost everything on your internal drive - you say that the library and the media are here. This isn't what you want.

    I combed just Fcp x, drag from the library of the search of the home and try again.

    Edit: Make sure that you open the library in the RAID, TTAB everything works and you can remove the old one the internal drive.

  • New generation of PCs for the Assembly of 4 K - is it enough?

    I just set up a new PC based on recommendations from a friend, looking for what could be improved and more importantly how best manage the cache of media:

    X 99 deluxe Motherboard with slot M2 and is here with an extra PCI adapter for a second.

    1 x Samsung SSD 512 GB 840

    1 x ADATA 480 GB SSD

    2 x Samsung 512 GB 950 Pro NVME Drives

    64GB DDR4 RAM - can find times if needed

    Intel Xeon E5-2670 v3 12 Core CPU (bought on eBay, this thing is great)

    2 x 4 TB 7200 RPM internal drives - projects underway and data

    Several external HARD drive for backups, no editing is done from their

    1 x Galax Nvidia 960 Exoc 2 GB 1367 Mhz Boost clock (I'm sure maybe it's my weakest to date)

    Thermaltake suppressor F31 case

    I got this up and running of this weekend and made a few small 4K editing so far.  It handles quite well, it continues to lag a bit on easy mounting.

    So basically my setup is as follows: a Samsung 950 Pro as the disk OS - not sure if I see a lot of difference in time starting or loading from an ordinary SSD yet of applications. Speed tests show 2500 read and about 1500 writing.

    The other Pro 950 came today and would be used just to store files video raw for ongoing projects. After reading through this forum a bit I am now begins to question where my media cache files should go.  Other 480 GB and 512 GB SSD is currently set up for a film of current project, but it is empty and could possibly be used for a media cache, so I erase it when the projects are carried out and it gets closer to full.  That would prevent certain bottlenecking? Currently one of the big 4 TB HARD drive is configured for file cache. I never thought to those who are the bottleneck.

    Is there something else I could try or upgrade? Two Samsung 950 Pro cards are better suited to other uses?  My video card should be good enough. I'm not super heavy editing or effects.  I am open to any suggestions or criticism.  The friend who helped me build this wasn't super familiar with Premiere Pro, or video editing needs, but knows computers and games needs.

    Thank you!

    Ah, the copy cat the original fractal design case thermaltake. that was quite the scandal and involved many cases copied mfg business. I never heard tell if the guy at thermaltake was fired for it or not.

    Anyway, your building looks like its mainly on the right track, but may need some adjustments. the 960 gtx is a bit strong, but your version is the 2 GB model. 4 GB is recommended for 4 k frame buffering, and the gtx 970 for a little more money would have been a better choice. Some people who use very intensive gpu plug-ins or separate programs even go for the ti-980, but it depends on each persons projects and needs.

    the storage configuration may be the biggest variable. the OS/apps drive didn't need more of an ssd sata, not the pcie/m.2 samsung 950. the samsung 950 is fast enough to hold everything, os/apps/cache/media/projects/export as a single disc, but the limitation comes from the ability. many people need more than 512 GB. Here are some examples of what you may do so below.

    Disc 1: Samsung 512 GB Pro 950 - os/applications

    Disc 2: Samsung 512 GB 950 Pro - cache, media, projects, export

    or more commonly seen here

    Disc 1: Samsung 512GB SSD 840 - os/applications

    Disc 2: 2 x Samsung 512 GB Pro 950 - cache, media, projects, export

    (optional, if you just want to use the drive of a - Data or 1 TB of capacity is not sufficient for cache too, then use the ssd a - Data for cache.)

    or if you need more space than 1 TB for the media so something like that

    Disc 1: Samsung 512GB SSD 840 - os/applications

    Disc 2: ADATA 480 GB SSD - cache/export

    (the samsung 950 could also be used for os/apps/cache/project)

    Disc 3 2 x 4 TB 7200 RPM - media/projects (only media if you use the samsung 950 for project files)

    2xsamsung 950 for raid 0 should be done with windows disk management, or any other software raid. You can also choose to leave separate units and manually / projects of media across the two disks. motherboards next gen will supposedly supported raid with disks of m2, but currently mbd raid is limited to the sata drives. 2 4 tb hard drive could be done with raid 0 of the motherboard, and is generally better than the windows raid. some opt for raid windows, because his so-called if the BDM has failed, he could be transferred to another computer. where mbd raid usually isn't the transfer. However, any raid should have several backups, so it shouldn't be a big problem.

  • x 200-ethernet-adapter question

    on my x 200 - 7455-8 HG running w7 ultimate 64-bit, my adapter ethernet (Intel 82567LM Giga) lost its drivers after reboot of the system and is just considered as "ethernet controller".

    several drivers-updates via ms, lenovo or intel has failed with error code 10. adapter could not be started...

    What should do?

    Help, please!

    THX in advance

    Note of the moderator; email address removed to stop spammers robots do

    problem is solved!

    x 200 had problems with docking station.

    detach the x 200 and leave that it undocked overnight, then pluging cable ethernet to the native port on pc gave the success and the controller/port was idientified correctly.

    subsequently attached to docjing-station again and the correct setting are still alive.

    Thanks for thinking of everyone

    problem is over.

    concerning

    William

  • Camera GigE of NI VBAI lost packets

    We run VBAI on a fast PC with an Intel Pro/1000 card and a switch GigE of jumbo-frame to a large number of Basler Ace GigE cameras.

    It is understandable that multiple cameras cannot transfer complete images to the PC to the full flow of 1000 MHz because of the limited bandwidth between the PC and the Switch simultaneously.

    A way around this is to strangle the maximum for each camera down data flow so that the sum is not greater than 1,000 MHz.

    However, this means that transfers images always take more time, even if only a single camera to enter service, a large part of the time.

    What is a fundamental limitation of GigE Vision, or are smart enough work as soon as possible of the GigE Vision cameras... via returns package loses casual?

    Nelson

    We have found a solution.

    The problem is that the cameras, switch, network card and VisionBuiilder cannot treat all cases where more than one camera sends images to VisionBuilder where the total of the rates of data for these cameras is never more than 1 GB of band bandwidth network card.

    (It would be nice if someone did a network switch that has a little more package buffer memeory...) 100 MB?... so that the images of the garbage does not have the occasional collision while allowing most of the captures operate at maximum speed.)

    Solution:

    (1) we have added 3 ports on network 1 Gb additional to our pc of mink.

    (2) in order to redistribute traffic camera in more than one network port, we assigned to each network adapter and corresponding cameras, to a different subnet.

    (3) we have lowered the rate of data for less urgent cameras.

    Even after the lowering of the data rates for multiple cameras in NOR-MAX up to 200 Mb/s such as lost packets should no longer be possible, we stil seen.

    After a detailed examination, we found that the stages of acquisition image VisionBuilder are not careful the data rates that you assign to NOR-MAX and always default to 1000 MB/s maximum rate, so saturated flow and lost packets.

    The solution to this problem proves to be explicitly set to the flow desired in each stage of the acquisition of Image VisionBuilder, using the attributes tab.  While you're there, you should also check other critical parameters, such as the packet size, are also correct and update if not.

    After you explicitly fix rates given in every stage of image acquisition, we ran a stress test of capture image that ran all the process of vision (several programs running at the same time) about 10 times faster than necessary and observed no lost in all packets.

    Problem solved.

  • First Adobe - connection tool frame lost

    First Adobe - connection tool frame lost

    I added a photo on this problem. There is no seal between two images... And there is no auxiliary tool that cuts the image on the position of the cursor.

    What should I do? Other projects works well, but not that great...

    I got a lot of work, so can not redo a new project because of this tool...

    Help345.png

    Letter "S" - that is the problem solved.

  • Jumbo Frame on 1 Gig network

    Hello

    I'm using iSCSI based shared the storage configuration on the 1 Gig host connectivity, iSCSI, physical switch software and storage.

    Should I enable the jumbo frame on all devices of connection in order to have a higher flow rate?

    It will cause no problem as the connection to the store of data or something like that?

    Kind regards

    Sushil

    Allow executives to Jumbro for the IP storage is recommended, in any case may be a glance on the following link to see a few considerations and test results on the Jumbo Frames: Jumbo Frames comparison test with storage over IP and vMotion & raquo; boche.net & #8211; VMware vEvangelist

  • Frames lost in accelerated video

    I have a 25 frames dance video. I have the speed slightly up to 101,64%. Thus rendered (and thus exported) video I see little things 'jumps' and if I look at image by image, I see that systematically through all the video, an image lost and it looks like a jump. It is especially noticeable in times when a dance installs quickly and is almost not noticeable, where there was less movement. I tried to turn frame blanding - in this case, I get a dancer doubled, which looks like a ghost. I tried to do in After Effects with different types of frame blanding - tremors still remained.

    Why does this happen? As I realize now, if my shooting was 50 or 60 frames, after Speed-up, it would go a lot smoother, am I right? Is it possible to Speed - Up 25 video blanding frameless frames and get a smooth movement? Maybe there are a few plug-ins that do large?

    I have read a lot of discussions about this in the Adobe community, but has not found an answer to my question. I chated with Adobe but they also did not help me and redirected here. Please, help me!

    Can try Twixtor.

    RE: Vision Effects, Inc.: products: Twixtor

  • __Details: studying why 38% (11 007) events were lost during data collection. Settings for Windows event trace (ETW, Event Tracing for Windows) buffers, the buffer size and maximum is perhaps best not according to data sets are collected. __

    need to know how to enlarge events tracing buffers

    What is the size of your swap file? increase the size and place it in the root of your systemdrive!

    André "a programmer is just a tool that converts the caffeine in code" Deputy CLIP - http://www.winvistaside.de/

  • Button "frame" has lost

    All of a sudden I lost my button "reframe". How can I restore it?

    Your help is appreciated.

    It is nested with the recompose tool.

    Right-click to see the two options, or press the C key to tab between the two.

  • How to make a simultaneous wink of GigE cameras?

    I have 2 cameras of 780-54gm Basler Scout (monochrome GigE) I switch to 10 Hz. This pace is modest and the data rate that results is not particularly high. I would like to get images from two cameras of the same trigger pulse. I have an Intel Pro/1000 NIC and I use the driver NEITHER appears so as National Instruments GigE Vision adapter. When I use the Basler pylon Viewer (the software that comes with the camera), I see perfect images from two cameras at the same time at 10 Hz. This tells me that the network, map NETWORK and the drivers can handle the flow of data without problem. I have activated jumbo frames.

    When I try to acquire images in LabVIEW 8.6 with screws IMAQdx, however, that I meet problems. I can acquire every single camera, but I can't them both at the same time strictly. The images are taken through with horizontal black lines that appear and move erratically. I have attached a vi that shows the problem. I have set up and start the two acquisitions, then enter a while loop that reads images. If I do the sequential acquisition by starting and stop them inside the loop and ensuring that we stop before the other then I get quality images but they are not the same impulses to trigger, and start and stop of the acuisitions overload slows down things so that I can not get pictures of each trigger.

    My guess is that it is a problem with how LabVIEW is the memory management, resulting in corruption with simultaneous acquisition. Are there settings I can change to fix this problem? I've experimented with everything I knew (buffer numbers, etc.), but without success.

    Rich

    P.S. I posted this in the forum LabView a couple of days but got no response. Sorry if you see this twice.

    Richard,

    Looks like you just packet loss. You might associate a property node to request lost packages to confirm. The reason for that happening is that even if the way to two cameras data rate is less than the limit of the NETWORK card, each camera probably goes to the complete 1000Mbit bandwidth when it transfers each picture. When transfers of images overlap, sending you to 2000Mbit/s down a 1000Mbit pipe and lose packets.

    To resolve this issue, an easy way is to adjust the attributes of Acquisition-> Ethernet advanced-> attribute peak bandwidth used for both cameras 500Mbit. This should ensure that each camera never use more than half of the bandwidth. There are also other options such as sprawl of transfer times, but those who require more tuning you change other settings.

    I don't know why the Basler software shows this, although their lack of bandwidth might just be lower at the expense of additional latency to get the images.

    Hope this helps,
    Eric

  • Vision frames in the buffer

    It's more of a behind the scenes in question rather than coding.  Let me give an Installer before asking.  I use IMAQdx to a gige camera.  I use a capture card in a while loop and process the images, the details don't really matter.  Total time to do all the processing is about 200 MS, but I'm running the camera at 30 fps.  Here the question arises.  Clearly, my process is not running at 30 frames per second, but the camera is.  Is labview buffering caught executives and then treat all, or will it do its process and catch the most common once it passes to the next iteration.  I think the later is the case, and that's what I want, I just wanted to ask an expert to get what is happening behind the scenes.  THX.

    Matt

    Hi Matt!

    You belief is correct.  With the Acquisition of capture, a buffer is used and is crushed.  You can try an acquisition of the sequence, which uses the number of buffers defined by the user.  Take a look in the help file IMAQdx, too. (Start > programs > National Instruments > Vision > Documentation > IMAQdx).   There is a title page examples of programming low level function that has a very good overview of the functioning of Snap, Grab and Acquisition of the sequence.  (I just searched 'sequence').  I hope this helps!

    Kristen H.

  • the frame in the frameset is not the relative path correctly

    http://www.autogamma.com/FastSP/catindex.html

    Click on 'PUMP LAVACRISTALLI' > "Quick Codice" > "PL100.
    images do not work
    In IE and Chrome images work fine

    The frame with PL100,... link to "pompe\PL100.html",...
    Target is the frame named "MAIN".
    In this context, the relative address is lost: the frame does not take the correct relative path, with a new subdirectory "pump".
    Path of the images remain.

    These links have the backslashes instead of slahes forward:

    <body><center><font size=2>CODICI FAST</font><br>
    <a href='pompe\PL100.html' target='MAIN'><font size=2>PL 100</font></a><br>
    <a href='pompe\PL101.html' target='MAIN'><font size=2>PL 101</font></a><br>
    <a href='pompe\PL102.html' target='MAIN'><font size=2>PL 102</font></a><br>
    <a href='pompe\PL103.html' target='MAIN'><font size=2>PL 103</font></a><br>
    <a href='pompe\PL104.html' target='MAIN'><font size=2>PL 104</font></a><br>
    <a href='pompe\PL105.html' target='MAIN'><font size=2>PL 105</font></a><br>

Maybe you are looking for