Collection of statistics takes forever after adding new index - why?

Hello everyone,

I'm on Oracle 11.2.0.2. Collection of statistics for one of my paintings takes extremely long (several hours), and I don't know why.

I'm inserting about 11,000 new records in a table with 5.3 million existing records using a INSERT INTO... SELECT...

This insert takes a little more than 3 minutes

Then I collect stats using:

DBMS_STATS.gather_table_stats ('SCOTT', 'S_RMP_EVALUATION_CSC_MESSAGE', estimate_percent = > DBMS_STATS.) AUTO_SAMPLE_SIZE);

It takes 2 hours.

If the number of records increases, the time it takes for the stats increases (8 hours after 70,000 newly inserted records)

I don't have this problem until recently, I created the I_S_RMP_EVAL_CSC_MSG_ACTIONSindex, but I do not understand why it would cause a radical change like that. Especially since the insertion of records to update the index takes only a few minutes.

I'm writing the create for the table and the index statements in the table below.

There are about 5.3 million records in the table. The table uses about 7.8 GB of space for the 'regular' table data and 37.6 GB for the LOB. Use the index:

Index Space used

I_S_EVALUATION_CSC_MSG_LMID:

152 MB

I_S_EVALUATION_CSC_MSG_IDLM:

144 MB

PK_S_RMP_EVALUATION_CSC_MESSAG:

118 MB
I_S_RMP_EVAL_CSC_MSG_ACTIONS:5 MB

CREATE TABLE "QQRCSBI0"."S_RMP_EVALUATION_CSC_MESSAGE" 
( "ID" NUMBER(22,0) NOT NULL ENABLE, 
  "XML_MESSAGE_TEXT" CLOB, 
  "CREATION_TIME" TIMESTAMP (6), 
  "LAST_UPDATE_TIME" TIMESTAMP (6), 
  "NEXT_UPDATE_SYNC_TS" TIMESTAMP (6), 
  "SW_VERSION_XML" VARCHAR2(100 BYTE), 
  "DWH_LM_TS_UTC" DATE DEFAULT NULL NOT NULL ENABLE, 
  CONSTRAINT "PK_S_RMP_EVALUATION_CSC_MESSAG" PRIMARY KEY ("ID")
  USING INDEX PCTFREE 10 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS NOLOGGING 
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)
  TABLESPACE "STAGING"  ENABLE
) SEGMENT CREATION IMMEDIATE 
PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)
TABLESPACE "STAGING" 
LOB ("XML_MESSAGE_TEXT") STORE AS BASICFILE (
  TABLESPACE "STAGING" ENABLE STORAGE IN ROW CHUNK 8192 RETENTION 
  NOCACHE LOGGING 
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)
) ;


CREATE INDEX "QQRCSBI0"."I_S_EVALUATION_CSC_MSG_IDLM" ON "QQRCSBI0"."S_RMP_EVALUATION_CSC_MESSAGE" ("ID", "DWH_LM_TS_UTC") 
  PCTFREE 10 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS 
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)
  TABLESPACE "STAGING" ;


CREATE INDEX "QQRCSBI0"."I_S_EVALUATION_CSC_MSG_LMID" ON "QQRCSBI0"."S_RMP_EVALUATION_CSC_MESSAGE" ("DWH_LM_TS_UTC", "ID") 
  PCTFREE 10 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS NOLOGGING 
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)
  TABLESPACE "STAGING" ;


CREATE BITMAP INDEX "QQRCSBI0"."I_S_RMP_EVAL_CSC_MSG_ACTIONS" ON "QQRCSBI0"."S_RMP_EVALUATION_CSC_MESSAGE" (DECODE(INSTR("XML_MESSAGE_TEXT",'<actions>'),0,0,1)) 
  PCTFREE 10 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS 
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)
  TABLESPACE "STAGING" ;

What causes this extreme long to collect statistics, and what I can do to fix that (apart from the removal of the index again)? Why collect stats lasts much longer than the update data and indexes?

Thank you...

It's a VIRTUAL column - Oracle does not store the value of the function in the table for each line, it simply records the description of the decisive function in the column definition in the data dictionary.  The index takes the calculated actual value (with the identifier of the line from each value), but Oracle does not have a mechanism to watch the index when collecting column statistics.  (In fact, such a mechanism could only be created for a single column still index).

Concerning

Jonathan Lewis

Tags: Database

Similar Questions

  • Collect table statistics take longer for large tables

    Version: 11.2

    I noticed brings his stats (via dbms_stats.gather_table_stats) takes more time for the large tables.

    As number of rows must be calculated, collection of statistics on the table a big would naturally be a little longer (running COUNT (*) SELECT internal).
    But for a table not partitioned with 3 million lines, it took 12 minutes to retrieve the stats? Outside the County info and the row index what other information is collected for the table stats gather?

    Size of the Table is actually important for the collection of statistics?

    USER_TABLES DESC

    and also

    USER_IND_STATISTICS
    USER_PART_COL_STATISTICS
    USER_SUBPART_COL_STATISTICS
    USER_TAB_COL_STATISTICS
    USER_TAB_STATISTICS
    USER_TAB_STATS_HISTORY
    USER_USTATS
    USER_TAB_HISTOGRAMS
    USER_PART_HISTOGRAMS
    USER_SUBPART_HISTOGRAMS

  • I/o Error: CreateProcess:... on the build after adding new classes

    Hello

    Im getting an "i/o error: CreateProcess: ' during the construction. It happens after the addition of new classes. These classes are "reproduced". I mean, same name, different packages.

    If I delete the, Eclipse builds very well.

    I tried with the other package name, same error.

    Any solution?

    Thanks in advance.

    Hello

    IM using 1.0. The classes have the same name, but I think that's not the problem.

    I solved finally pass these classes in a lib project, so I think the problem is that there is a limit to the amount of classes for a project.

    Thank you

  • Unable to connect to the virtual machine after adding new eSATA drive

    Hello.

    I'm trying to connect my new 2 TB drive in VMWare Workstation. It is connected via eSATA to the host computer, and it works. I added the drive to the desktop as a new "physical disk." But now I can not power the workstation the most.

    (1) when I start the VMWare Workstation it right ask admin (it didn't need before).

    (2) when I turn on the prompt does not charge even the bios. It shows a rear screen with the logo of VMWare for a while and then stop saying: "VMware Workstation cannot connect to the virtual machine. Make sure that you have the rights to run the program and access all directories that it uses and access rights to all directories for temporary files. »

    The host is running Windows 7 x 64. The workstation runs under the standard user account.

    Thank you.

    Hmmm - it's unexpected - works for me here - only difference: I tried with only 1 TB disks.

    You start Workstatiion as an administrator?

    _________________________

    VMX-settings- WS FAQ -[MOAcd | http://sanbarrow.com/moa241.html]- VMDK-manual

  • Class not found exception after adding a new image in the folder resources.

    The app works perfectly well on the Simulator and the device. After adding a new set of images, he began to show in every race, on the Simulator and the device, a class not found exception.

    When you try to delete some images to find the cause, I get different classes not found when executing. Compilation and packaging the application generate warning or error. They even get signed. Some of the classes are not exception I get:

    Java.lang.StringBuilder

    NET. RIM. Device.API.UI.UIApplication

    I'm guessing this has something to do with the size of the total image, since the size of each range image from 100 KB to 300 KB, and we talk about only 25 or 30 images in total. Adding image outside of the 'res' folder does not generate the error, but the image is not added to the final files.

    In addition, this application is not large, but when compiling and packaging of the app, it generates and signs 125 cod files. Is this normal?

    I use Eclipse 3.6 (Helios) and BB SDK 5.0.0.25 won win 7

    Any help will be appreciated. Thank you.

    Have you seen this?

    http://supportforums.BlackBerry.com/T5/testing-and-deployment/the-maximum-size-of-a-BlackBerry-smart...

    I would recommend that you download these kinds of resources and put them on the SD card if you take a storage capacity that users will want to keep available for email and others.

  • After that I went to El Capitan, my computer would be close and take forever to reboot.  I took it to the Genuis Bar and they said it was us who extinguished the FileVault.  I've updated the software on 1: 1 and now, I'm having the same problem

    After that I went to El Capitan, my computer would be close and take forever to reboot.  I took it to the Genuis Bar and they said it was us who extinguished the FileVault.  I've updated the software on 1: 1 and now, I'm having the same problem again.  The computer turns off and sometimes it takes me an hour or two to get started again.  Help, please!

    refer to this article and move forward with the NVRAM reset at the end.

    Reset the management system (SCM) controller on your Mac - Apple Support

    If the problem persists, how long have you made it Go?

    I would bring out there, but first call Apple.

  • Its takes forever for a page to load after that I clicked...

    My browser takes forever to respond. I never get tired to wait on a page after I click on it... It feels like im using the dial up when I have high speed internet
    What could be the problem and how to fix this. Help, please
    I use Windows Vista 32 bit and Firefox as my browser
    NB: Everything worked fine until a few days ago

    Hello

    The same problem occurs with Internet Explorer?

    Please make sure Internet Explorer has a default browser and test the question.

    See the link.

    http://Windows.Microsoft.com/en-GB/Windows-Vista/change-your-default-Web-browser

    See also the link.

    http://support.Mozilla.org/en-us/KB/Firefox-slow-how-make-it-faster

    If the problem is only with Firefox, I suggest you to contact Firefox support for assistance.

    http://support.Mozilla.org/en-us/questions

  • performance degrades after the collection of statistics

    Oracle 11 g 2 OEL 5

    We have several very large tables (40 million lines and more) and recently we gathered stats on tables and it degraded our performance. He began to do table scans complete rather than use the index. The same queries are very well in other environments. Only difference is the collection stats. Logically, the performance should be better after the collection of statistics. But it is rather poor.

    I ran track 10053 on request and I see that the cardinality and the cost is medium high in the inefficient environment. A test, I have restored the old stats in the environment and it put everything back to normal - the query runs quickly again. Note that the restored stats were collected for more than a year. Should not collect us statistics regularly on very large tables?

    Thank you.

    Hello

    the stats of the default collection behavior is to determine the number of cells (i.e. a histogram is necessary or not and if yes, how accurately must be) automatically, depending on distribution and usage of the column of data in different types of predicates. This means that, in many cases collection histogram is almost a random process - once you get a histogram, the next time that you don't have, even if there is almost no change. This is (unfortunately) the normal behavior.

    I could quite at the bottom of your question - the optimizer esteem seem to be all correct in the second case, it is not clear to me why the plan that is so bad (there are also some other problems, as lines of 40G supposed to be returned by one of the nested loops, or estimation of cardinality missing for another nested loop). But in any case, histograms and bind variables do not mix, so you can just solve your problem by specifying method_opt => "for columns size 1' to disable the histograms for this table.

    Best regards
    Nikolai

  • Firefox does not take after the new update homepage

    After the new update of firefox, it resets my setting of the home page that I made
    Randomly, it loads a search engine called search.conduit.comof interfalls.

    How can I stop this!

    You can check in "Windows Control Panel > programs ' recently installed programs see if something of conduct appears.

    • Control Panel > programs > programs and features > uninstall or change a program
    • Click the installed column to sort by this column

    You can open the topic: config page through the address bar and to search for the prefs that refer to led and reset associated user defined prefs ("BOLD") through the context menu on the default value.

  • Query took too much time when adding new column to the table and the index set on this

    I added a new column to the table that contains thousands of records. and created the composite index with three columns (those newly added + two existing column)

    for the specifics. TBL table there are two columns col1, col2

    I added the new column col3 to TBL and created composit index (col1, col2, col3).

    Now for all the records in col3 is NULL. When I choose on this table, it takes too long...

    Any idea what my I do bad., I have check the query plan, it is using the index

    It is solved using collection of statistics using the

    DBMS_STATS. GATHER_TABLE_STATS

    @Top.Gun thanks for your review...

  • NB305 10F takes forever to start

    Hi all

    I have a brand new (two days!) NB305 10F Netbook and even it is a very nice piece of kit to mount on a half hour or so to start!

    I didn't do anything to this thing of the hook aopart up to my wireless home network and since then stop after that it simply does not work correctly. I tried to power off and re-boot in safe mode, but it still takes forever!

    What's up (Toshiba help line will get ' phoned later this afternoon!) and how do I back out of the box settings? Can I start and enter the BIOS with F2 or F8 magic or similar to reset everything?

    Any ideas would be most appreciated.

    Thank you.

    On each new Toshiba notebook is preinstalled original Toshiba recovery image. This recovery image contains many tools and utilities as well as additional applications. Most of them start by operating system and slows down the startup time.

    Please note: when you get the new book of Microsoft updates are set to auto so when you start your laptop and there is LAN or WLAN connotation your laptop will start to automatically download the updates and it will slow down the performance of any computer laptop.

    What you need is the optimization of the OS.

  • HP Photosmart C4480 all-in-One takes forever to print

    HP Pavilion dv6-6061eo laptop

    Serial number [personal information deleted]

    Prod, number: LQ769EA #UUW

    Printer: HP Photosmart C4480 all-in-One connected USB

    Operating system: Windows 7 - all updates - updates of August incl. -ETH on

    Troubleshooting done - but all the reports in the order

    My Tech expertise is intermediate.

    No new software has been installed

    Laptop has worked without problem with a printer HP Photosmart C4580 in Scandinavia, but after my return to France where I use a HP Photosmart C4480 takes forever to print even a single page.

    Hello

    Curiously, the problem has now been resolved by changing the ink cartridges HP with a new set of HP ink cartridges.

  • takes forever to connect

    computer takes forever to turn (IE get in the office)... any ideas what may be the cause?...

    Hello

    What antivirus/antispyware/security products do you have on the machine? Be one you have NEVER
    on this machine, including those you have uninstalled (they leave leftovers behind which can cause
    strange problems).

    ----------------------------------------------------

    Follow these steps:

    Start - type this in the search box-> find COMMAND at the top and RIGHT CLICK – RUN AS ADMIN

    Enter this at the command prompt - sfc/scannow

    How to analyze the log file entries that the Microsoft Windows Resource Checker (SFC.exe) program
    generates in Windows Vista cbs.log
    http://support.Microsoft.com/kb/928228

    Also run CheckDisk, so we cannot exclude as much as possible of the corruption.

    How to run the check disk at startup in Vista
    http://www.Vistax64.com/tutorials/67612-check-disk-Chkdsk.html

    ==========================================

    After the foregoing:

    How to troubleshoot a problem by performing a clean boot in Windows Vista
    http://support.Microsoft.com/kb/929135
    How to troubleshoot performance issues in Windows Vista
    http://support.Microsoft.com/kb/950685

    Optimize the performance of Microsoft Windows Vista
    http://support.Microsoft.com/kb/959062
    To see everything that is in charge of startup - wait a few minutes with nothing to do - then right-click
    Taskbar - the Task Manager process - take a look at stored by - Services - this is a quick way
    reference (if you have a small box at the bottom left - show for all users, then check that).

    How to check and change Vista startup programs
    http://www.Vistax64.com/tutorials/79612-startup-programs-enable-disable.html

    A quick check to see that load method 2 is - using MSCONFIG then put a list of
    those here.
    --------------------------------------------------------------------

    Tools that should help you:

    Process Explorer - free - find out which files, key of registry and other objects processes have opened.
    What DLLs they have loaded and more. This exceptionally effective utility will show you even who has
    each process.
    http://TechNet.Microsoft.com/en-us/Sysinternals/bb896653.aspx

    Autoruns - free - see what programs are configured to start automatically when you start your system
    and you log in. Autoruns also shows you the full list of registry and file locations where applications can
    Configure auto-start settings.
    http://TechNet.Microsoft.com/en-us/sysinternals/bb963902.aspx
    Process Monitor - Free - monitor the system files, registry, process, thread and DLL real-time activity.
    http://TechNet.Microsoft.com/en-us/Sysinternals/bb896645.aspx

    There are many excellent free tools from Sysinternals
    http://TechNet.Microsoft.com/en-us/Sysinternals/default.aspx

    -Free - WhatsInStartUP this utility displays the list of all applications that are loaded automatically
    When Windows starts. For each request, the following information is displayed: Type of startup (registry/Startup folder), Command - Line String, the product name, Version of the file, the name of the company;
    Location in the registry or the file system and more. It allows you to easily disable or remove unwanted
    a program that runs in your Windows startup.
    http://www.NirSoft.NET/utils/what_run_in_startup.html

    There are many excellent free tools to NirSoft
    http://www.NirSoft.NET/utils/index.html

    Window Watcher - free - do you know what is running on your computer? Maybe not. The window
    Watcher says it all, reporting of any window created by running programs, if the window
    is visible or not.
    http://www.KarenWare.com/PowerTools/ptwinwatch.asp

    Many excellent free tools and an excellent newsletter at Karenware
    http://www.KarenWare.com/

    ===========================================

    Vista and Windows 7 updated drivers love then here's how update the most important.

    This is my generic how updates of appropriate driver:

    This utility, it is easy see which versions are loaded:

    -Free - DriverView utility displays the list of all device drivers currently loaded on your system.
    For each driver in the list, additional useful information is displayed: load address of the driver,
    Description, version, product name, company that created the driver and more.
    http://www.NirSoft.NET/utils/DriverView.html

    For drivers, visit manufacturer of emergency system and of the manufacturer of the device that are the most common.
    Control Panel - device - Graphics Manager - note the brand and complete model
    your video card - double - tab of the driver - write version information. Now, click on update
    Driver (this can do nothing as MS is far behind the certification of drivers) - then right-click.
    Uninstall - REBOOT it will refresh the driver stack.

    Repeat this for network - card (NIC), Wifi network, sound, mouse, and keyboard if 3rd party
    with their own software and drivers and all other main drivers that you have.

    Now in the system manufacturer (Dell, HP, Toshiba as examples) site (in a restaurant), peripheral
    Site of the manufacturer (Realtek, Intel, Nvidia, ATI, for example) and get their latest versions. (Look for
    BIOS, Chipset and software updates on the site of the manufacturer of the system here.)

    Download - SAVE - go to where you put them - right click - RUN AD ADMIN - REBOOT after
    each installation.

    Always check in the Device Manager - drivers tab to be sure the version you actually install
    presents itself. This is because some restore drivers before the most recent is installed (sound card drivers
    in particular that) so to install a driver - reboot - check that it is installed and repeat as
    necessary.

    Repeat to the manufacturers - BTW in the DO NOT RUN THEIR SCANNER device - check
    manually by model.

    Look at the sites of the manufacturer for drivers - and the manufacturer of the device manually.
    http://pcsupport.about.com/od/driverssupport/HT/driverdlmfgr.htm

    How to install a device driver in Vista Device Manager
    http://www.Vistax64.com/tutorials/193584-Device-Manager-install-driver.html

    If you update the drivers manually, then it's a good idea to disable the facilities of driver under Windows
    Updates, that leaves about Windows updates but it will not install the drivers that will be generally
    older and cause problems. If updates offers a new driver and then HIDE it (right click on it), then
    get new manually if you wish.

    How to disable automatic driver Installation in Windows Vista - drivers
    http://www.AddictiveTips.com/Windows-Tips/how-to-disable-automatic-driver-installation-in-Windows-Vista/
    http://TechNet.Microsoft.com/en-us/library/cc730606 (WS.10) .aspx

    ===========================================

    Refer to these discussions because many more excellent advice however don't forget to check your antivirus
    programs, the main drivers and BIOS update and also solve the problems with the cleanboot method
    first.

    Problems with the overall speed of the system and performance
    http://support.Microsoft.com/GP/slow_windows_performance/en-us

    Performance and Maintenance Tips
    http://social.answers.Microsoft.com/forums/en-us/w7performance/thread/19e5d6c3-BF07-49ac-a2fa-6718c988f125

    Explorer Windows stopped working
    http://social.answers.Microsoft.com/forums/en-us/w7performance/thread/6ab02526-5071-4DCC-895F-d90202bad8b3

    Hope these helps.

    Rob Brown - Microsoft MVP<- profile="" -="" windows="" expert="" -="" consumer="" :="" bicycle="" -="" mark="" twain="" said="" it="">

  • Remove the Configuration after adding to the models?

    Hello

    I wore as a result of the market-

    1. using the base OS say win2k3 model I've deployed a new configuration (full Clone)

    2. I installed my software and other things on the deployment configuration, and then I want to use this Configuration of my Gold, so I added this to the models.

    3. now after adding (2) for models can I delete above configuration? Which will cause no problem in my model that was created in step 2?

    Kind regards

    esxvmuser

    You can remove anything in LM without worrying from clones of this element.  On the backend, Lab Manager removes only the files that have no dependencies.  So the deletion of your configuration will remove LM but not ruin your model because the files of this model depends on are not removed until all dependencies are removed.

    Dependence of follow-up and asynchronous operation garbage collection nodes are important elements of the LM system.

  • How can I fix - there was a lot of recently updated on McAfee, virus protection takes forever to delete a message

    This happened once before after McAfee anti-virus has been installed. Someone suggested something unclicking, can't remember what it was now. He worked then. When I try to delete messages in Thunderbird, it takes forever and I get ' Mozilla does not. Can someone tell me how to solve this problem?
    Thank you
    Lorrelaine

    https://wiki.Mozilla.org/Thunderbird: test: Antivirus_Related_Performance_Issues #McAfee

Maybe you are looking for