Collection of statistics takes forever after adding new index - why?
Hello everyone,
I'm on Oracle 11.2.0.2. Collection of statistics for one of my paintings takes extremely long (several hours), and I don't know why.
I'm inserting about 11,000 new records in a table with 5.3 million existing records using a INSERT INTO... SELECT...
This insert takes a little more than 3 minutes
Then I collect stats using:
DBMS_STATS.gather_table_stats ('SCOTT', 'S_RMP_EVALUATION_CSC_MESSAGE', estimate_percent = > DBMS_STATS.) AUTO_SAMPLE_SIZE);
It takes 2 hours.
If the number of records increases, the time it takes for the stats increases (8 hours after 70,000 newly inserted records)
I don't have this problem until recently, I created the I_S_RMP_EVAL_CSC_MSG_ACTIONSindex, but I do not understand why it would cause a radical change like that. Especially since the insertion of records to update the index takes only a few minutes.
I'm writing the create for the table and the index statements in the table below.
There are about 5.3 million records in the table. The table uses about 7.8 GB of space for the 'regular' table data and 37.6 GB for the LOB. Use the index:
Index | Space used |
---|---|
I_S_EVALUATION_CSC_MSG_LMID: | 152 MB |
I_S_EVALUATION_CSC_MSG_IDLM: | 144 MB |
PK_S_RMP_EVALUATION_CSC_MESSAG: | 118 MB |
I_S_RMP_EVAL_CSC_MSG_ACTIONS: | 5 MB |
CREATE TABLE "QQRCSBI0"."S_RMP_EVALUATION_CSC_MESSAGE" ( "ID" NUMBER(22,0) NOT NULL ENABLE, "XML_MESSAGE_TEXT" CLOB, "CREATION_TIME" TIMESTAMP (6), "LAST_UPDATE_TIME" TIMESTAMP (6), "NEXT_UPDATE_SYNC_TS" TIMESTAMP (6), "SW_VERSION_XML" VARCHAR2(100 BYTE), "DWH_LM_TS_UTC" DATE DEFAULT NULL NOT NULL ENABLE, CONSTRAINT "PK_S_RMP_EVALUATION_CSC_MESSAG" PRIMARY KEY ("ID") USING INDEX PCTFREE 10 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS NOLOGGING STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "STAGING" ENABLE ) SEGMENT CREATION IMMEDIATE PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "STAGING" LOB ("XML_MESSAGE_TEXT") STORE AS BASICFILE ( TABLESPACE "STAGING" ENABLE STORAGE IN ROW CHUNK 8192 RETENTION NOCACHE LOGGING STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) ) ; CREATE INDEX "QQRCSBI0"."I_S_EVALUATION_CSC_MSG_IDLM" ON "QQRCSBI0"."S_RMP_EVALUATION_CSC_MESSAGE" ("ID", "DWH_LM_TS_UTC") PCTFREE 10 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "STAGING" ; CREATE INDEX "QQRCSBI0"."I_S_EVALUATION_CSC_MSG_LMID" ON "QQRCSBI0"."S_RMP_EVALUATION_CSC_MESSAGE" ("DWH_LM_TS_UTC", "ID") PCTFREE 10 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS NOLOGGING STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "STAGING" ; CREATE BITMAP INDEX "QQRCSBI0"."I_S_RMP_EVAL_CSC_MSG_ACTIONS" ON "QQRCSBI0"."S_RMP_EVALUATION_CSC_MESSAGE" (DECODE(INSTR("XML_MESSAGE_TEXT",'<actions>'),0,0,1)) PCTFREE 10 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "STAGING" ;
What causes this extreme long to collect statistics, and what I can do to fix that (apart from the removal of the index again)? Why collect stats lasts much longer than the update data and indexes?
Thank you...
It's a VIRTUAL column - Oracle does not store the value of the function in the table for each line, it simply records the description of the decisive function in the column definition in the data dictionary. The index takes the calculated actual value (with the identifier of the line from each value), but Oracle does not have a mechanism to watch the index when collecting column statistics. (In fact, such a mechanism could only be created for a single column still index).
Concerning
Jonathan Lewis
Tags: Database
Similar Questions
-
Collect table statistics take longer for large tables
Version: 11.2
I noticed brings his stats (via dbms_stats.gather_table_stats) takes more time for the large tables.
As number of rows must be calculated, collection of statistics on the table a big would naturally be a little longer (running COUNT (*) SELECT internal).
But for a table not partitioned with 3 million lines, it took 12 minutes to retrieve the stats? Outside the County info and the row index what other information is collected for the table stats gather?
Size of the Table is actually important for the collection of statistics?USER_TABLES DESC
and also
USER_IND_STATISTICS
USER_PART_COL_STATISTICS
USER_SUBPART_COL_STATISTICS
USER_TAB_COL_STATISTICS
USER_TAB_STATISTICS
USER_TAB_STATS_HISTORY
USER_USTATS
USER_TAB_HISTOGRAMS
USER_PART_HISTOGRAMS
USER_SUBPART_HISTOGRAMS -
Hello
Im getting an "i/o error: CreateProcess: ' during the construction. It happens after the addition of new classes. These classes are "reproduced". I mean, same name, different packages.
If I delete the, Eclipse builds very well.
I tried with the other package name, same error.
Any solution?
Thanks in advance.
Hello
IM using 1.0. The classes have the same name, but I think that's not the problem.
I solved finally pass these classes in a lib project, so I think the problem is that there is a limit to the amount of classes for a project.
Thank you
-
Unable to connect to the virtual machine after adding new eSATA drive
Hello.
I'm trying to connect my new 2 TB drive in VMWare Workstation. It is connected via eSATA to the host computer, and it works. I added the drive to the desktop as a new "physical disk." But now I can not power the workstation the most.
(1) when I start the VMWare Workstation it right ask admin (it didn't need before).
(2) when I turn on the prompt does not charge even the bios. It shows a rear screen with the logo of VMWare for a while and then stop saying: "VMware Workstation cannot connect to the virtual machine. Make sure that you have the rights to run the program and access all directories that it uses and access rights to all directories for temporary files. »
The host is running Windows 7 x 64. The workstation runs under the standard user account.
Thank you.
Hmmm - it's unexpected - works for me here - only difference: I tried with only 1 TB disks.
You start Workstatiion as an administrator?
_________________________
VMX-settings- WS FAQ -[MOAcd | http://sanbarrow.com/moa241.html]- VMDK-manual
-
Class not found exception after adding a new image in the folder resources.
The app works perfectly well on the Simulator and the device. After adding a new set of images, he began to show in every race, on the Simulator and the device, a class not found exception.
When you try to delete some images to find the cause, I get different classes not found when executing. Compilation and packaging the application generate warning or error. They even get signed. Some of the classes are not exception I get:
Java.lang.StringBuilder
NET. RIM. Device.API.UI.UIApplication
I'm guessing this has something to do with the size of the total image, since the size of each range image from 100 KB to 300 KB, and we talk about only 25 or 30 images in total. Adding image outside of the 'res' folder does not generate the error, but the image is not added to the final files.
In addition, this application is not large, but when compiling and packaging of the app, it generates and signs 125 cod files. Is this normal?
I use Eclipse 3.6 (Helios) and BB SDK 5.0.0.25 won win 7
Any help will be appreciated. Thank you.
Have you seen this?
I would recommend that you download these kinds of resources and put them on the SD card if you take a storage capacity that users will want to keep available for email and others.
-
After that I went to El Capitan, my computer would be close and take forever to reboot. I took it to the Genuis Bar and they said it was us who extinguished the FileVault. I've updated the software on 1: 1 and now, I'm having the same problem again. The computer turns off and sometimes it takes me an hour or two to get started again. Help, please!
refer to this article and move forward with the NVRAM reset at the end.
Reset the management system (SCM) controller on your Mac - Apple Support
If the problem persists, how long have you made it Go?
I would bring out there, but first call Apple.
-
Its takes forever for a page to load after that I clicked...
My browser takes forever to respond. I never get tired to wait on a page after I click on it... It feels like im using the dial up when I have high speed internet
What could be the problem and how to fix this. Help, please
I use Windows Vista 32 bit and Firefox as my browser
NB: Everything worked fine until a few days agoHello
The same problem occurs with Internet Explorer?
Please make sure Internet Explorer has a default browser and test the question.
See the link.
http://Windows.Microsoft.com/en-GB/Windows-Vista/change-your-default-Web-browser
See also the link.
http://support.Mozilla.org/en-us/KB/Firefox-slow-how-make-it-faster
If the problem is only with Firefox, I suggest you to contact Firefox support for assistance.
-
performance degrades after the collection of statistics
Oracle 11 g 2 OEL 5
We have several very large tables (40 million lines and more) and recently we gathered stats on tables and it degraded our performance. He began to do table scans complete rather than use the index. The same queries are very well in other environments. Only difference is the collection stats. Logically, the performance should be better after the collection of statistics. But it is rather poor.
I ran track 10053 on request and I see that the cardinality and the cost is medium high in the inefficient environment. A test, I have restored the old stats in the environment and it put everything back to normal - the query runs quickly again. Note that the restored stats were collected for more than a year. Should not collect us statistics regularly on very large tables?
Thank you.Hello
the stats of the default collection behavior is to determine the number of cells (i.e. a histogram is necessary or not and if yes, how accurately must be) automatically, depending on distribution and usage of the column of data in different types of predicates. This means that, in many cases collection histogram is almost a random process - once you get a histogram, the next time that you don't have, even if there is almost no change. This is (unfortunately) the normal behavior.
I could quite at the bottom of your question - the optimizer esteem seem to be all correct in the second case, it is not clear to me why the plan that is so bad (there are also some other problems, as lines of 40G supposed to be returned by one of the nested loops, or estimation of cardinality missing for another nested loop). But in any case, histograms and bind variables do not mix, so you can just solve your problem by specifying method_opt => "for columns
- size 1' to disable the histograms for this table.
Best regards
Nikolai -
Firefox does not take after the new update homepage
After the new update of firefox, it resets my setting of the home page that I made
Randomly, it loads a search engine called search.conduit.comof interfalls.How can I stop this!
You can check in "Windows Control Panel > programs ' recently installed programs see if something of conduct appears.
- Control Panel > programs > programs and features > uninstall or change a program
- Click the installed column to sort by this column
You can open the topic: config page through the address bar and to search for the prefs that refer to led and reset associated user defined prefs ("BOLD") through the context menu on the default value.
-
Query took too much time when adding new column to the table and the index set on this
I added a new column to the table that contains thousands of records. and created the composite index with three columns (those newly added + two existing column)
for the specifics. TBL table there are two columns col1, col2
I added the new column col3 to TBL and created composit index (col1, col2, col3).
Now for all the records in col3 is NULL. When I choose on this table, it takes too long...
Any idea what my I do bad., I have check the query plan, it is using the index
It is solved using collection of statistics using the
DBMS_STATS. GATHER_TABLE_STATS
@Top.Gun thanks for your review...
-
NB305 10F takes forever to start
Hi all
I have a brand new (two days!) NB305 10F Netbook and even it is a very nice piece of kit to mount on a half hour or so to start!
I didn't do anything to this thing of the hook aopart up to my wireless home network and since then stop after that it simply does not work correctly. I tried to power off and re-boot in safe mode, but it still takes forever!
What's up (Toshiba help line will get ' phoned later this afternoon!) and how do I back out of the box settings? Can I start and enter the BIOS with F2 or F8 magic or similar to reset everything?
Any ideas would be most appreciated.
Thank you.
On each new Toshiba notebook is preinstalled original Toshiba recovery image. This recovery image contains many tools and utilities as well as additional applications. Most of them start by operating system and slows down the startup time.
Please note: when you get the new book of Microsoft updates are set to auto so when you start your laptop and there is LAN or WLAN connotation your laptop will start to automatically download the updates and it will slow down the performance of any computer laptop.
What you need is the optimization of the OS.
-
HP Photosmart C4480 all-in-One takes forever to print
HP Pavilion dv6-6061eo laptop
Serial number [personal information deleted]
Prod, number: LQ769EA #UUW
Printer: HP Photosmart C4480 all-in-One connected USB
Operating system: Windows 7 - all updates - updates of August incl. -ETH on
Troubleshooting done - but all the reports in the order
My Tech expertise is intermediate.
No new software has been installed
Laptop has worked without problem with a printer HP Photosmart C4580 in Scandinavia, but after my return to France where I use a HP Photosmart C4480 takes forever to print even a single page.
Hello
Curiously, the problem has now been resolved by changing the ink cartridges HP with a new set of HP ink cartridges.
-
computer takes forever to turn (IE get in the office)... any ideas what may be the cause?...
Hello
What antivirus/antispyware/security products do you have on the machine? Be one you have NEVER
on this machine, including those you have uninstalled (they leave leftovers behind which can cause
strange problems).----------------------------------------------------
Follow these steps:
Start - type this in the search box-> find COMMAND at the top and RIGHT CLICK – RUN AS ADMIN
Enter this at the command prompt - sfc/scannow
How to analyze the log file entries that the Microsoft Windows Resource Checker (SFC.exe) program
generates in Windows Vista cbs.log
http://support.Microsoft.com/kb/928228Also run CheckDisk, so we cannot exclude as much as possible of the corruption.
How to run the check disk at startup in Vista
http://www.Vistax64.com/tutorials/67612-check-disk-Chkdsk.html==========================================
After the foregoing:
How to troubleshoot a problem by performing a clean boot in Windows Vista
http://support.Microsoft.com/kb/929135
How to troubleshoot performance issues in Windows Vista
http://support.Microsoft.com/kb/950685Optimize the performance of Microsoft Windows Vista
http://support.Microsoft.com/kb/959062
To see everything that is in charge of startup - wait a few minutes with nothing to do - then right-click
Taskbar - the Task Manager process - take a look at stored by - Services - this is a quick way
reference (if you have a small box at the bottom left - show for all users, then check that).How to check and change Vista startup programs
http://www.Vistax64.com/tutorials/79612-startup-programs-enable-disable.htmlA quick check to see that load method 2 is - using MSCONFIG then put a list of
those here.
--------------------------------------------------------------------Tools that should help you:
Process Explorer - free - find out which files, key of registry and other objects processes have opened.
What DLLs they have loaded and more. This exceptionally effective utility will show you even who has
each process.
http://TechNet.Microsoft.com/en-us/Sysinternals/bb896653.aspxAutoruns - free - see what programs are configured to start automatically when you start your system
and you log in. Autoruns also shows you the full list of registry and file locations where applications can
Configure auto-start settings.
http://TechNet.Microsoft.com/en-us/sysinternals/bb963902.aspx
Process Monitor - Free - monitor the system files, registry, process, thread and DLL real-time activity.
http://TechNet.Microsoft.com/en-us/Sysinternals/bb896645.aspxThere are many excellent free tools from Sysinternals
http://TechNet.Microsoft.com/en-us/Sysinternals/default.aspx-Free - WhatsInStartUP this utility displays the list of all applications that are loaded automatically
When Windows starts. For each request, the following information is displayed: Type of startup (registry/Startup folder), Command - Line String, the product name, Version of the file, the name of the company;
Location in the registry or the file system and more. It allows you to easily disable or remove unwanted
a program that runs in your Windows startup.
http://www.NirSoft.NET/utils/what_run_in_startup.htmlThere are many excellent free tools to NirSoft
http://www.NirSoft.NET/utils/index.htmlWindow Watcher - free - do you know what is running on your computer? Maybe not. The window
Watcher says it all, reporting of any window created by running programs, if the window
is visible or not.
http://www.KarenWare.com/PowerTools/ptwinwatch.aspMany excellent free tools and an excellent newsletter at Karenware
http://www.KarenWare.com/===========================================
Vista and Windows 7 updated drivers love then here's how update the most important.
This is my generic how updates of appropriate driver:
This utility, it is easy see which versions are loaded:
-Free - DriverView utility displays the list of all device drivers currently loaded on your system.
For each driver in the list, additional useful information is displayed: load address of the driver,
Description, version, product name, company that created the driver and more.
http://www.NirSoft.NET/utils/DriverView.htmlFor drivers, visit manufacturer of emergency system and of the manufacturer of the device that are the most common.
Control Panel - device - Graphics Manager - note the brand and complete model
your video card - double - tab of the driver - write version information. Now, click on update
Driver (this can do nothing as MS is far behind the certification of drivers) - then right-click.
Uninstall - REBOOT it will refresh the driver stack.Repeat this for network - card (NIC), Wifi network, sound, mouse, and keyboard if 3rd party
with their own software and drivers and all other main drivers that you have.Now in the system manufacturer (Dell, HP, Toshiba as examples) site (in a restaurant), peripheral
Site of the manufacturer (Realtek, Intel, Nvidia, ATI, for example) and get their latest versions. (Look for
BIOS, Chipset and software updates on the site of the manufacturer of the system here.)Download - SAVE - go to where you put them - right click - RUN AD ADMIN - REBOOT after
each installation.Always check in the Device Manager - drivers tab to be sure the version you actually install
presents itself. This is because some restore drivers before the most recent is installed (sound card drivers
in particular that) so to install a driver - reboot - check that it is installed and repeat as
necessary.Repeat to the manufacturers - BTW in the DO NOT RUN THEIR SCANNER device - check
manually by model.Look at the sites of the manufacturer for drivers - and the manufacturer of the device manually.
http://pcsupport.about.com/od/driverssupport/HT/driverdlmfgr.htmHow to install a device driver in Vista Device Manager
http://www.Vistax64.com/tutorials/193584-Device-Manager-install-driver.htmlIf you update the drivers manually, then it's a good idea to disable the facilities of driver under Windows
Updates, that leaves about Windows updates but it will not install the drivers that will be generally
older and cause problems. If updates offers a new driver and then HIDE it (right click on it), then
get new manually if you wish.How to disable automatic driver Installation in Windows Vista - drivers
http://www.AddictiveTips.com/Windows-Tips/how-to-disable-automatic-driver-installation-in-Windows-Vista/
http://TechNet.Microsoft.com/en-us/library/cc730606 (WS.10) .aspx===========================================
Refer to these discussions because many more excellent advice however don't forget to check your antivirus
programs, the main drivers and BIOS update and also solve the problems with the cleanboot method
first.Problems with the overall speed of the system and performance
http://support.Microsoft.com/GP/slow_windows_performance/en-usPerformance and Maintenance Tips
http://social.answers.Microsoft.com/forums/en-us/w7performance/thread/19e5d6c3-BF07-49ac-a2fa-6718c988f125Explorer Windows stopped working
http://social.answers.Microsoft.com/forums/en-us/w7performance/thread/6ab02526-5071-4DCC-895F-d90202bad8b3Hope these helps.
Rob Brown - Microsoft MVP<- profile="" -="" windows="" expert="" -="" consumer="" :="" bicycle="" -="" mark="" twain="" said="" it="">->
-
Remove the Configuration after adding to the models?
Hello
I wore as a result of the market-
1. using the base OS say win2k3 model I've deployed a new configuration (full Clone)
2. I installed my software and other things on the deployment configuration, and then I want to use this Configuration of my Gold, so I added this to the models.
3. now after adding (2) for models can I delete above configuration? Which will cause no problem in my model that was created in step 2?
Kind regards
esxvmuser
You can remove anything in LM without worrying from clones of this element. On the backend, Lab Manager removes only the files that have no dependencies. So the deletion of your configuration will remove LM but not ruin your model because the files of this model depends on are not removed until all dependencies are removed.
Dependence of follow-up and asynchronous operation garbage collection nodes are important elements of the LM system.
-
This happened once before after McAfee anti-virus has been installed. Someone suggested something unclicking, can't remember what it was now. He worked then. When I try to delete messages in Thunderbird, it takes forever and I get ' Mozilla does not. Can someone tell me how to solve this problem?
Thank you
Lorrelainehttps://wiki.Mozilla.org/Thunderbird: test: Antivirus_Related_Performance_Issues #McAfee
Maybe you are looking for
-
After the update my firefox crashes, does not open unless I handed to proxi not every time, other programs are also gel now.
-
EliteBook 2570p: cannot install Ethernet Controller 82579LM
Hello I have a 2570p with Win7 EliteBook and missing ethernet controller. The hardware id says I have an Intel 82579LM card so I downloaded the hp sp60775 file, unpacked (which proved that it is already there on my system), and run the installer. But
-
Someone knows a Satellite P200-1Kgs?
Hello Someone knows a 1kings P200, it is on sale in my local Costco store. But I can't find any on this spec. Can someone please? Thanx Dave
-
CD ROM hangs during audio cd playback
I installed a cd driver for a second on compact computer and put the cd in windows media player and almost times songs but freezes before playing
-
Issue of DellSmbios:\Bootsequence
Hello is it possible to make device as CDrom, peripheral storage Usb and Diskett idle car and off to the start option via the dell ps provider? I can change the order, but may not know how to disable the specific boot device. Thank you very much for