What eats my memory?

I am trying to optimize a batch process I've run every night to reload the database of our Web site. He is running as an asynchronous process on CFMX7, and I'm on CF8 benchmarking and try to get some more performance out of it.

Base flow is that the initial request takes about 50,000 items, just get their unique digital ID, SKU, and another field. Then the program loops through the items one at a time, retrieves a bunch of data on each of them, creates a structure containing all of the data relevant to this point, adds this structure to another structure for a family of elements, then sends this structure to another asynchronous process that manages the family to write to the database. Once it does this, structures are all reset and reused (same names of variables) to the next family in the loop. This whole process takes 5-6 hours right now.

What is interesting to me is that it runs in CF8 and watch the server monitor, I see my use of memory just keep growing because the process is running, never really clean and eventually maxing out. But if I look at the details of the memory usage, I see a few variables in memory, who is recycled at each iteration. So what's eating the memory? I thought that if I reused variable and query names, they would be essentially destroyed and recreated with each iteration of the loop, but it's almost as if each iteration builds up junk in memory that never goes away.

Someone saw to that, and how can I optimize the process to better manage the memory?

Thank you all for the suggestions. It helped me to take a look nine on the process and really simplify things. I was trying to be too fancy with a lot of data and CFC structures from things around, and it turns out be much more effective as a linear process of "brute force" with a single set of scalar variables for each iteration of the loop.

But the biggest revelation was that it wasn't my process to all that was to consume all the memory - it was the new CF8 server followed! I used the monitor to monitor the memory of the JVM, but I got all the options under tension (profiling, monitoring memory), and apparently, who eats a ton of memory. Out of these options, and the process ran in 2.5 hours and never jumped over 300 MB memory JVM used. Good to know!

Tags: ColdFusion

Similar Questions

  • What is reasonable memory for Firefox use?

    Title says it all-

    What is reasonable memory for Firefox use?

    The normal use, I am an average of 1.2 G or about memory (of 16 G total); is this normal? Don't not maxing out at all but I was wondering.

    How to define and measure the use of memory for Firefox? Activity monitor? I use Firefox to write this. In the activity monitor, I see Firefox to 347 MB and Firefox Web Content to 259 MB.

  • Tabs in Safari for gmail eat much memory a lot. Why?

    After I installed 10.11.4 on my 2012 13 "MacBook Pro with 4 GB of RAM, I found a lot of to use it. Recently, when I have frustrated its use, I checked the activity monitor and found that Safari tablets ONLY for gmail eats a lot a lot of memory, which seems ridiculous to me.

    Gmail has been known to be a very light e-mail client. But I see that just by opening gmail inbox page, takes about 250 to 300 MB of RAM memory. And after a while (20-30 seconds) the consumption of memory goes up to 450 to 600 MB. I usually keep an eye gmail open in my safari browser all the time to check emails and not to close. (I do not use Mac Mail application, thinking that the Mail app will eat more memory than tabs in Safari). I also have emails with the normal text or advertising emails. No data high image or video files in my regular emails.

    Here are the data of the activity monitor. Look at the memory for the process "mail.google.com":-the largest is 692MB taken up by a tab.

    Answer please, if any of you are also facing this problem. Is this a bug of Mac OS or Gmail bug? Or if there is no solution to this.

    Hello...

    See if that makes a difference...

    In your Safari menu bar, click Safari > Preferences then select the Privacy tab, then click: delete all data of the website can leave and then restart Safari to test.

  • Satellite Pro M30: What type of memory I need?

    Hi all
    Anyone know what kind of memory I need to get for a Pro M30 model No. PSM35E-0042 X - EN satalite

    Thank you

    Hello

    The memory modules that you can use are PC2700 DDR - RAM.
    You can upgrade the memory on your laptop to 2048 MB max.

    Moreover, I found the compatible modules:
    PC2700 256 MB (PA3311U - 1 M 25)
    PC2700 512 MB (PA3312U - 1 M 51)
    1024MO PC2700 (PA3313U-1M1G)

    Hope this helps a little.
    Good bye

  • TosOBEX.exe eats my memory

    Hello
    I am currently using the Toshiba bluetooth stack, which came with the billionton Dongle BT to manage my BT connections. The BT manager works fine, but I have noticed that TosOBEX.exe eat my memory causing my PC to run slowly. I thought that this is the problem because when I finished TosOBEX.exe, my PC speed returns to normal.

    Is this normal? Or did I do something wrong?

    Thank you?

    Your bluetooth stack is up to date? If this is not the case, the update.
    http://APS2.toshiba-tro.de/Bluetooth/?page=download
    In your case, I would also check your COM ports. Maybe there's a conflict with another device.

  • Should what kind of memory card I buy for my iMac (mid 2011)?

    I would like to increase the memory on my computer that I fight to run the programs I need on the current 4 GB.  I believe I have four slots in the rear of my machine (I could be wrong), adding memory to, but have no idea what to buy.  I would like to know what kind of memory card should I buy (or how), in the best place to buy.

    Thank you for your comments!

    Data sheet:

    iMac: 27 inches, mid-2011

    Running: OSX version 10.10.5 Yosemite

    Processor: Intel Core i5 at 2.7 GHz

    Memory: 4 GB 1333 MHz DDR3

    Boot disk: Macintosh HD

    Graphics card: AMD Radeon HD 6770 M 512 MB

    This should help you understand what you need...

    http://www.EveryMac.com/systems/Apple/iMac/iMac-aluminum-FAQ/iMac-Intel-aluminum-21.5-inch-27-inch-how-to-upgrade-memory...

    OWC is a good source for memory and thus help.

  • What type of memory DDR3 can I use for AX3 - 710?

    I tried expanding with four different memories of DDR3 at time upper, lower and exactly 1600 MHz. It seems that I need a completely different memory because the computer does not start even with any of these used only memories. Updated bios as well without success. I read about the "memory model of office' short-circuited by 'L '. What is the memory that I need?

    Hello

    Yes, your desktop supports up to 32 GB - DDR3L (1.35v) - 1600 MHz (2x16Gb).

  • Satellite P25-s607: what speed of memory is possible?

    I'm trying in vain for a few days to find what is the max Michael for the record my p25-s607 motherboars suports, ddr 266,333,400.
    Some said that the chipset is 865 pe if it supports up to 400, some memory guaranteed compnies copatibility only up to 333.
    Were find official response to that?

    Hello

    Why do you start multiple views on the same issue?
    You asked him about it in your first assignment:
    http://forums.computers.Toshiba-Europe.com/forums/thread.jspa?threadID=13168

    The fact is that the chipset is 865PE and ICH5 most motherboards with this chipset can use DDR400/333/266 DIMM memory modules.
    With your first assignment you can find modules that you can use. (266 / 333 Mhz)
    I think you can also use the 400 MhZ modules.

  • Laptop HP Stream: what type of memory for my computer

    Hi, just bought a HP laptop, Stream 11th session of the Committee. 11d015na with intel Celeron processor N2840 (2.16 Ghz), 32 Gb MEM, 2048 MB DDR3 SDRAM, 8.1, 29.5 cm diagonal HD LED display Windows, with WLAN & bluetooth...

    What type of fact memory card take machine my daughter, it's SD, SDHC, MICRO, so a lot of different types and she can't find information in the spec.

    Many thanks simon

    Hello

    The following link shows its specifications:

    http://support.HP.com/ID-en/document/c04719506

    Very safe to use the SD (SDHC) card up to 64 GB.

    Kind regards.

  • AMD APU Kaveri (like E555) - what speed of memory?

    Anyone know the max memory possible for Thinkpad E555 speed in a more recent double module and with BIOS configuration?

    AMD lists in some documents of different possible speeds for single SO-DIMM and SO-DIMM and dual level as single or double rank. He claims that there could be a fall to 1333 MHz even. But what is the reality for the Lenovo Thinkpads? I found no official document on this.

    There are brands (such as Kingston HyperX Impact) which have DDR3 SO-DIMM available for 1600 MHz, 1866 MHz and 2133 MHz, so that this is not offered specifficaly as being compatible with the E555.

    Everyone with more memory RAM speeds than 1600 MHz DDR3 on the E555 or a similar Thinkpad?

    Since there was not any feedback I chose a kit of 1600 MHz (Kingston HyperX). He works at the set rate - slightly overclocked - Lenovo 2x810MHz and isn't clockin until 1333 MHz as suggested documentation AMD BKDG.
    If someone could share experiences of 1866 MHz or faster RAM kits, I would be happy to know...

  • What types of memory sd micro HP Split x 2 is not compatible with?

    Hello

    I got a Split of HP 13 x 2 PC.  I noticed that there is a micro sd under the shelf of the screen.

    I want to install a permanent big micro sd so I can still work with huge files so I don't have to worry about the 500 GB hard drive that is installed on the side of the keyboard.

    I want to get a micro SDHC or a micro SDXC which are the memories that support 64/128 GB capacity.

    However, I have read on various posts that the Tablet does not recognize these memory cards or it is not compatible with them which could end up with random crashes on the PC.  I am very uncertain as to what I should allow me the manual of HP does not exactly specify the maximum capacity, it reads and what technology does work with *.
    (* Once again, in my case, I am interested in HC or XC cards)

    Can you please advice?

    Thank you

    Hello Nicoman,

    TwoPointOh provided solid advice; In addition, I suggest that you select the media designated as "Class 10" which is the best speed rating currently available; who will ensure that your micro-SD card will still be usable for a long time. Currently, micro-SD 32 GB and 64 GB cards offer the most favourable cost-per-GB; You can be sure to get a compatible product if you buy your micro-SD card accessories | HP® official store.

    Enjoy!

  • What is shared memory?

    Hello, I was looking at my system information in windows 7 and he said: I have shared memory of 4 GB, could someone tell me what shared memory means?

    Means generally that you have 4 GB of memory which is used by the chip graphic and other materials of sys.

    Usually on a 32 bit version of win about 3 GB would be available for use

  • What type of memory is my S10-3s use?

    I just got a S10-3s, and so far I am pretty happy with it. I had a very bad experience though, and I try to avoid repetition. I wanted to update a block of 2GB memory and so I bought a block when I bought the netbook - the store clerk had a look at the specifications of the computer and gave me a 200 SODIMM block pole.

    After arriving at the House, I have then almost wrecked my new laptop because of the ridiculous case design (bag, the person in charge). To see the 200-pin SODIMM doesn't in any way fit into the laptop. From what I can tell, what is needed is a block of 204 pins.

    However, when I try Googling for the appropriate memory blocks while comparing the system information about the material, I can't fnd anything of use. Release of material that I'm using a SODIMM 667 MHz block. When I look at blocks 204 pins SODIMM 667 MHz, I get nothing - because 204 pins are for DDR3 and who comes to 1 066 MHz and above. So, who works for the S10-3s? I need to go get my new mem-block replaced by something good, and I really want to avoid having to open my netbook more than once that I need to (because it is Lenovo apparently seeks to top of page Apple in the poor case design).

    Pointers appreciated

    Use this one: elixir 2 GB DDR3 204 pins. It uses DDR3 RAMs. It works without bios update

  • Satellite A200-1AG - what modules of memory for the upgrade?

    Hello!

    I have a + * Satellite A200-1AG * +. I'm planing to upgrade the memory to 4 GB. Mine uses + (2x1GB) DDR2 - 667 Mhz + and I saw only 2 modules of 2 GB DDR2 - 667 Mhz + cost the same as + 2x2gb DDR2-800 +. I benefit in any way from this upgrade? Can I damage my laptop? I heard that my laptop will work anyway to 667 MHz, but I'd like to know your opinion about it before I buy it.

    Thanks in advance!

    Hello

    You can buy both types of module. The point is that the fastest modules (DDR2-800) downgrade always compatible system at low speed. This would mean that the modules will run at 667 MHz.

    So you n t destroy your laptop, it s just a feature. Everything will work correctly.

    As far as I know your laptop runs at 667 MHz can accelerate.

  • HP 15-ab150sa (ENERGY STAR): software HP eats CPU memory

    Hello HP support.

    As you can see in this screenshot that a particular frame HP Service makes my CPU going crazy. Sometimes this will well up to 95%, and I can hear fan running too. This is not the case all the time. I guess that, according to online activity.

    Can you tell me what is behind all this? Can you help me understand what is happening here?

    Thank you very much...

    Mark

    Hi @MarekUK,

    Welcome to the HP support community!

    I read your post on the HP software on your computer laptop 15-ab150sa HP causing slowness. HP software framework provides a common set of software that centralize and simplify access to the supported hardware, operating systems BIOS and HP windows drivers specific on supported laptops.

    If you are not happy with the software, you can remove it, this shows you how to do this.

    Please let me know if this is enough to identify the problem by marking this post as accept as a Solution.

    Thank you.

Maybe you are looking for

  • Window.Resize javascript does not work in same v7 if enabled

    Build identifier: Mozilla/5.0 (Windows NT 6.1; WOW64; RV:7.0.1) Gecko/20100101 Firefox/7.0.1 [script type = "text/javascript"][!--window.resizeTo (740, 735);//--] / script This function is no longer resizes jumped on windows even if the Options-> con

  • OfficeJet 6500 E709N: officejet 6500E709N does not scan to PDF

    My Officejet all-in-one a 6500 e709n left I scan a document in pdf format. Don't know what happened.

  • E4200 Bridge Mode

    Can someone please point out what I'm doing wrong here... I have my main router, an E4200v2 which I use as a router and it provides a signal wireless throughout my house, but reception is not as strong on the top floor and there is a slight dead spot

  • What is Cam avatar conection

    Please, I would like to know what is "Cam Avatar Creator '.

  • inspiron 530 gpu update

    So I originally the ati HD 3400 but its super outdated. so is it still possible (with a change of 600w power supply unit) to get a superclocked EVGA 650 TI 2 GB to work on my Inspiron 530. My CPU is intel core 2 quad q6600 idk 2.2 or 3.5 really. I kn