Suggestion of partitioning?

I'm working on Oracle 11 g 2 node RAC (OLAP database), Linux 2.

I have a huge table (estimated at about 300G) I need to partition. Always on design as well as the table does not exist.
Data reporting will consider queries for a specific day or a month, but the problem here is the database being global we are questioning from places(different timezones) different users and the data provided should take the time zone for the specific user account. We are looking at about 50 different times.
It will store data for 24 months in this table.

It would be an OLAP database and we are planning to return in real time, so I thought having two separate tables, a table (say TABLE1) to store data for a week (as this will include insertion and update activities of lourdes) and the other table (say TABLE2) that will contain the data for 24 months. At the end of week, can use Exchange partition to merge tables.
I was thinking of paritioning per week, but the problem is due to time zone differences, I have need to query would be not satisfied several partitions even to get a value of 1 day of data and a few queries that require recent data of the week by TABLE1 and I need to interview TABLE2 also.

To give an estimate of the size of the table that it could grow to 300M per day.

Any suggestions on what would be the best strategy of partitoning here?

Prabu M says:
Can you please eleborate a little on this point-

Have you worked on how you can write a query that accepts a zone entry and partitions elimination against a partitioned table on one of the data types timestamp (or even partitioned on a simple date data type).

The table would be to have a date column, so I thought the conversion of time that receipt of the request for the time zone of this specific user and by comparing the time with the date column. This will be ok or am I missing something here?

That sounds about right - you are guaranteeing that you provide predicates that do not cause an implicit conversion in the database. I've seen a few cases where people have run intor wrong with that because they started using zone types without checking for the side effects. (Tony Hasler wrote a note about this sort of thing a while ago: http://tonyhasler.wordpress.com/2010/09/04/tonys-tirade-against-timestamp-with-time-zone/)

As far as your condition will - two tables seems reasonable, and you could create a 'partition (i.e. UNION ALL) view' above them, so that you only contain the data once. The two tables could be indexed differently, as you suggest and partitioned differently - e.g. weekly for the history, daily - or even every hour - for recent data. When you move data from the recent history table table you may even sort the data for the most important queries, something like:

create holding _table as
select * from daily_table
where date_stamp >= ... and date_stamp < ...
order by locale_column;

create indexes on holding table

alter table history_table add partition XXX ...
alter table history_table exchange partition XXX with table holding_table ...

create or replace view ZZZ
as
select ... that makes the old data in the daily table invisible and the new data in the partition table visible

drop old partitions from daily table

By the way, about your comment about different indices for both tables - 11.2 allows you to do this kind of thing (with within the limits that I have not yet reviewed) on one partitioned table. You create all index definitions you want to, but make the 'old' unusable partitions on some indexes and the 'new' unusable partitions by others - the optimizer splits a single query in two plans, one for the old data, another for the new data. (See, for example:)
http://Antognini.ch/2009/11/zero-size-unusable-indexes-and-the-query-optimizer/)

Concerning
Jonathan Lewis
http://jonathanlewis.WordPress.com
http://www.jlcomp.demon.co.UK

Tags: Database

Similar Questions

  • Need help and suggestions for partitioned tables

    Hello

    We have a table and it is partitioned and partitioned with datetime column, IE... partition by range.

    I tried to run the query in the form below and it runs 1 HR and did not get the result and I kill the query.

    Select min (datetime) max (datetime) < big_table > maxdate, mindate; -2203M data in this table

    index also in place on these columns as a composite index (code, datetime, status, po_num)

    < big_table > - having columns like code, datetime, status, po_num, creation_date

    Here is the plan of the explain command:

    Hash value of plan: 228211001

    ------------------------------------------------------------------------------------------------------------

    | ID | Operation | Name | Lines | Bytes | Cost (% CPU). Time | Pstart. Pstop |

    ------------------------------------------------------------------------------------------------------------

    |   0 | SELECT STATEMENT |                   |     1.     8.  4009K (2) | 04:41:57 |       |       |

    |   1.  GLOBAL TRI |                   |     1.     8.            |          |       |       |

    |   2.   RANGE OF PARTITION ALL THE |                   |  2163M |    16G |  4009K (2) | 04:41:57 |     1. 1048575.

    |   3.    FULL RESTRICTED INDEX SCAN FAST | POSTATUSINDEX |  2163M |    16G |  4009K (2) | 04:41:57 |     1. 1048575.

    ------------------------------------------------------------------------------------------------------------

    Please give me any suggestions how to get the query faster.

    THX in advance

    You need to know which column mainly used in queries?

    If most of the request uses ID column, then partition of hash on ID will be beneficial.

  • MSINWINPC - FBW files and restore, backup Dec 2009 concerns, concerns given PC June 2011

    Dear Sir/Madam,

    I did a back up of my data in December 2009 and I was wondering what is happening during a restore because I read that FWB is an extension for the backup file that is created. It compresses all the saved data and it incorporates in a single file so that it develops the files when performing a restore.

    What happened to my computer from my backup, it's that I had to install the Windows Vista Service Pack 2, which has consistently failed. To cut to the Chase, I contacted HP and everything they suggested the partition of hard drive HP factory reset factory reset, does not work properly and therefore all erased my disk hard but does restore all apps doing so my computer a brick. But since then, I contact Microsoft who kindly helped me with my cmputer and it is now working very well. (Thanks a lot).

    In any case, since the restore will be expanded I have 3 fear and would like advice on how I should go about restoring:

    1. the data amounts to 35.8 GB is currently on my external hard drive and free space on my drive hard is only 38 GB. If the files are all developed the 35.8 GB of data will take over 38GB?

    2. If I wanted to restore only certain files (I have a master's thesis I want to find and restore), copy the data to a file on my C drive before using the backup and Restore Center on my computer to find the file and restore?

    3. I'm worried that the old files that are saved can conflict with existing files I have been restoring my computer (like copying and pasting a file with the same name). I have to worry about this at all if I had to restore my backup data?

    Thank you

    Hi Densebrains

    Yes, the files get expanded after a restore of the backup is performed and the free space, you mentioned not be enough to restore the backup. When restoring files is performed on the computer disk files with the same name are replaced and you will get a prompt notifying replace it taking place.

    See below the help links-

    http://Windows.Microsoft.com/en-us/Windows-Vista/back-up-and-restore-frequently-asked-questions

    http://Windows.Microsoft.com/en-us/Windows-Vista/restore-files-from-a-backup

    I hope this helps.

  • Merge not supported on table space

    Hi all

    I'm working on an existing table that has a unique id. It should be expanded with additional id, which we will call a group id.

    Assume there is a table
    create table t
    (
      object_id number not null,
      f1        varchar2(100) not null,
      f2        varchar2(100) not null,
      f3        varchar2(100) not null,
      f4        mdsys.sdo_geometry,
      group_id  number
    );
    The object_id is the PK and obviously unique. The group_id must be unique for each distinct f1, f2, f3 combination.

    I like the merge statement, also for the updates, because of its flexible syntax. I wanted to do:
    merge into t
    using ( select distinct 
                   f1
           ,       f2
           ,       f3
           ,       rownum group_id
           from    t ) g
    on    (        t.f1 = g.f1
            and    t.f2 = g.f2
            and    t.f3 = g.f3 )
    when matched then update
            set    t.group_id = g.group_id;
    but I get an ORA-29886: feature not supported for the field index. (I'm on Oracle Database 10 g Enterprise Edition Release 10.2.0.4.0)

    Of course, it is easy to write a pl/sql loop (and I did), but is there a way to do this in pure sql in a single update statement in an elegant way?

    Thank you!

    Boneist wrote:
    Assuming that object_id is a primary key, then I would do something like:

    update t
    set    t.group_id = (select t2.dr
    from   (select t1.*, dense_rank() over (partition by t1.f1, t1.f2 order by t1.f1, t1.f2) dr
    from   t t1) t2
    where  t2.object_id = t.object_id)
    

    Works better without the PARTITION BY clause ;)

    UPDATE t
    SET group_id = (
      SELECT dr
      FROM (
        SELECT object_id,
               dense_rank() over(order by f1, f2, f3) dr
        FROM t
      ) v
      WHERE v.object_id = t.object_id
    )
    ;
    

    Of course, it is easy to write a pl/sql loop (and I did), but is there a way to do this in pure sql in a single update statement in an elegant way?

    Boneist suggested (without partition), or somewhere in between with a FORALL statement.

    For example:

    DECLARE
    
     gid_tab sys.odcinumberlist;
     oid_tab sys.odcinumberlist;
    
    BEGIN
    
      select object_id,
             dense_rank() over(order by f1, f2, f3)
      bulk collect into oid_tab, gid_tab
      from t
      ;
    
      forall i in 1..oid_tab.count
       update t
       set group_id = gid_tab(i)
       where object_id = oid_tab(i)
      ;
    
    END;
    /
    

    According to the volume of data to process, you may need to test with a LIMIT of COLLECT clause in BULK as well.

    Edited by: odie_63 Feb 4. 2011 15:26

  • Partitioning or an index organized table. Suggestion required.

    Hi gurus,

    We decided to perfomance increase in customer table that has more than 100 million records

    {code}

    customer_id number,

    cust_name varchar,

    Date of Applied_date,

    City varchar (100)

    {code}

    This is the structure of the customer table.

    We decided to composite partition the table based on date (range) applied and customer_id (hash).

    I am confused to go with table index (where tables and indexes are stored together) for better performance.

    Please suggest what we I'm going?  for best performance.

    Please answer

    Supersen

    If the query predicate (WHERE clause) include the Partition key column, Oracle can make the size of Partition - that is to say identify the target Partition.  Otherwise, he would have to do a full Table Scan because he doesn't know what Partition the target Row (s) is in.

    For example, if you are partitioning by APPLIED_DATE but your request is on the table by CITY, Oracle cannot identify the target Partition and do a Scan of Table full - even if you subpartition by CUSTOMER_ID and integrate CUSTOMER_ID in your query, Oracle cannot identify the Subpartition because it cannot identify the Partition.

    Hemant K Collette

  • transfer the software mp3 sony = error-overdrive overdrive audiobook suggests deleting internet files in firefox partition does not work

    start down load an audio book on MP3 players from sony at the local library. They use overdrive and I followed the instructions and downloads of the book for the overdrive media console software. But when I try to transferred it to the player it comes up with an error = x8005400t-license does not exist. Overdrive suggest the updated media player which I did and then delete the files temporary Internet in firefox, not sure how and the library could not do that either. Thanks for any help

    Hi malcolm_henry,

    From what you describe, you receive an error message when you run OverDrive and attempt to transfer the music files on your SONY reader, are - this correct?

    If so, the issue is probably with OverDrive, and you should contact their support of clarification on what means the error message:

    Please let us know if this is not the case.

    -Ralph

  • Mid-2012, Macbook Pro 13 inch corrupt partition map

    I was connect my external hard drive that works 24 Fedora quite frequently beyond a few days. I use the option key during the startup key to choose the operating system. So now my OS X El Capitan only lights because of a partition error. I fixed that with the recovery of the internet, but I am 100% sure that this issue will come soon. Is there any solution for this? What is the cause of this problem?

    MacBook Pro 13 "to mid-2012 Specs:

    OS: El Capitan 10.11.6

    CPU: i5 2.5 GHz

    Storage: 500 GB HARD drive

    Memory: 16 GB (Max update for this model indicated by Apple's 8GB but 3rd third party provider what OWC makes a 16 GB customized for this particular model)

    Any suggestions or comments would be appreciated.

    Is there any solution for this?

    Yes, a replacement hard drive. They are not terribly expensive and replacement is simple.

    What is the cause of this problem?

    Contamination, mechanical damage, age... one of these factors.

  • Unable to overcome error - "the startup disk cannot be partitioned or restored to a single partition.

    Hello!

    I'm trying to install Windows on my iMac (late 2013, running 10.11.6) without success.  I created the ISO to a flash drive, but when I try to use the Assistant Boot camp, I am referred to the following screen:

    I did my best to study solutions. The cause, by apple support discussions, is that there is another partition of pre-empting (stop) the wizard boot camp partitioning the hard drive.  I studied the partitions on my HDD after unplugging all devices and found this:

    This shows the main partition: Macintosh HD, the bootcamp partition: BOOTCAMP; and 2 unknown partitions: "Apple HDD ST100DM003 Media" and the same * M004.  I was able to delete the first Apple ST100DM003 HARD disk partition and ran first aid on the fusion drive after that the second he would not remove.  Also, I can't delete the boot camp partition.  I keep getting the same message when I try to install windows on a partition of the fuser unit using Boot Camp Assistant - "Startup disk cannot be partitioned or restored to a single partition".

    Any suggestions?

    Please after the release of the following OSX Terminal commands.

    diskutil list

    Cs diskutil list

    A reader of merger should have underlying EFI, OSX, Recovery HD on each of the physical disks. If your previous Windows installation attempts have failed, the disks can leave in a State where BCA use/will not change them.

  • I can not format or partition my new drive HARD internal

    I have a MacBook Pro late 2011. The other day, I was unable to boot and got the flashing question mark folder. When I command + R, my old 500 GB of HARD drive was not appear. I decided it was time to upgrade. I bought a Seagate 2 TB drive and installed it. I am now ready to install OS X on it. I am able to see the drive when I go into Internet recovery, but failure of attempts at partitioning and formatting. The error for the formatting is "wipe data on the volume to avoid future to probe accidental is not" and the error for partitioning is the same. I looked for answers and I tried all the solutions I could find, but I am unable to do the single user mode that I can't boot into it successfully.

    Are there other options or ideas that guys maybe I can try?

    I suggest that you consider getting an external adapter or place the new drive in an external enclosure. Install Mac OS X on this subject here.  When you are satisfied with the way it works, and THEN do the transplant.

    This separates from the software install the registry numbers, reduced the problem by half and the two halves solvable.

  • rMBP 13 "3 - Way Partition

    What's up apple community...

    Just got my rMBP in the mail and it is fully loaded with 1 TB of SSD 16 GB of ram and an i7 3.1

    I want to break the SSD in three partitions, 500 GB for El Capitan, 400GO for Windows 10 and 100 GB for Ubuntu, but I can't understand what partition requires what format. I am currently for Ubuntu and Windows 10 bootable USB drive and they work very well, but the format is all simply won't let me install windows on ODM FAT format 400 GB partition. Any suggestions? I try to avoid using that 400 GB for a single file, while the speed using VMWare, because I can not ALL of my CPU/RAM allocated to the Virtual Machine, by having a three-way partition, I do and I will have no problem with the clock or a

    Do not worry about putting in form other that MacOS, just do the partitions.

    Install Mac OS first, then work on the other two operating systems
    Bootcamp for Windows - NTFS

    When you install Ubuntu - ext4

    In addition, you mentioned VMware, but I'm confused how it is used.

    You need not partition to run virtual machines VirtualBox/Vmware Fusion (for mac/windows/linux)

    The hypervisor (vmware) manages the translation between the hardware and the operating system.

  • clear Ext hard disk partitions in El Capitan to return to a single

    I have a disc of lightning (WDC) 2 TB ext.  I had it partitioned with 2 partitions - but now I want to use the entire disk as a single partition.

    I searched the web a solution (re El Capitan) and found this solution below

    BUT whenever I have to erase partitions and then as soon as the volume test to find the space by removing the partition - but the sign less is grayed out and only the sign is available.

    I did the operation to clear the partition and then tries to take over the space of the volume - as suggested - but I can't do it if it is grayed out!

    I lost hours tonight - can someone please help?

    Thank you!

    ------------------------------

    Step 1: Partition Erase

    To begin, open disk utility while searching for it using Spotlight or find in Applications > utilities.

    Then click on the partition that you want to remove in the left panel.

    Screenshot by Matt Elliott/CNET

    With your selected partition, click the clear button in the upper part of disk utility. This will bring up a window with a clear button. Click Remove , and then click done.

    Step 2: Delete Partition

    With your partition erased data, you should always delete the now empty partition in order to reallocate space for the rest of your hard drive.

    Screenshot by Matt Elliott/CNET

    To do this, select your hard drive in the left panel and then click on the button at the top of the disk utility Partition. In the graph of the pie on the left, click on the corner that represents the partition you just deleted. Click on the button "-" and then click apply.

    Are the partitions involved "OS X Journaled" format?

    C.

  • Rebuild the recovery partition

    Hi all

    Since my macbook pro in construction since a backup time machine, I have no recovery partition. Not sure if the recovery of time machine is the cause, or that the guy who has this laptop (work) in front of me he erased accidentally.

    I tried to use the script of "Recovery Partition creator" on several occasions, but it did not work. It becomes very urgent to get the recovery as soon as I'm running into several issues that require me to have the partition:

    • Disk errors on my internal drive that requires a correction
    • Need to encrypt my hard drive
    • Try to resize my disk internal, so I can install El Captain next to my current OS X I just need to test before you lose access to the work of the features (earlier version cannot be installed as he does not like our proxy for example).

    Happy to go all the way to 'clean up' and then to retrieve locks of tiem machine, but no idea how to do things right :-(

    Any ideas?

    I feel that you are not the first user or 'owner' of the MBP.  If this is the case, I suggest the following:

    Back up all your data.

    Erase the HARD drive and start in the recovery of the Internet (OPTION-COMMAND-R) which will connect you to the Apple servers.  Following the directions, you will be able to erase the HARD drive and install the original OSX the MBP came with.  The recovery partition must be created.  (I guess that the MBP is a 2011 late model or newer).

    Install a more recent OSX (as appropriate).

    Reinstall your user data.

    Ciao.

  • How to encrypt a USB, when I get the message "(GPT) GUID Partition Table partitioning scheme is required? '."

    I just tried to encrypt a USB drive with my Mac book (latest version) and got the message "A GUID Partition Table (GPT) partitioning schΘma required." What does this mean and suggestions on how to proceed?

    The drive must be formatted for Mac. Start in the Recvery mode. Erase the drive using disk utility (select the top icon which represents the entire disk and click clear. Partition scheme must be Mac OS (Extended) first partition GUID, which is the default value.

    If you want to install a system on it follow these steps:

    How to reinstall OS X on your Mac - Apple Support

  • question about a new external hard drive partitioning

    I just bought a TB G-Technology G 4 USB 3.0 drive to replace my old Lacie which is way to small.  It has served me well.

    I Google search on the net and research here in the discussions, I should create partitions, and if so, how, a few observations are in each article thread or by email.  A reason to partition (actually more than one partition) is so we can have a section for our time Machine backups, and for a section where we want to save our data backup and one for our user data?  I have not seen a clear statement on what might be the 'data', or what might be the 'user data '.  And if the time machine is backed up, is it NOT back up my data files?

    In order to unravel how the partitions I should create in my 4 TB Ex HD, can someone help me better understand what I should and should not save in time machine?  And if I choose to NOT include it in my Time Machine backup, why would I use a partition do it to, in order to save manually?  I do not pretend that it sounds stupid, I'm not clear on what 'it' is and what info I use to make the best decision for my use.

    Thanks a lot for any wisdom you could share with me.

    Michelle

    Have a Time Machine backup partition on the same drive as your data is a stupid backup plan. Since the main cause of data loss is disk failure to have the backup on the same disk as the means of data when the wrong road, you lose everything.

    At Time Machine backup. You never know what data you will lose.

    I suggest that you give up your plan to make the Time Machine backups on the same drive as the data. You need another player for that.

  • cannot start on Mac after resizing partition bootcamp, disk management.

    Hello guys.

    I have a 13-inch MacBook Pro (9.2) 2012 with OSX 10.9 running. CORE I5, 4 GB ram and a 500 GB hard drive.

    I used Bootcamp to install windows 8.1 which succeeded, but I wanted another partition to store data, so I cut 100 GB of the Bootcamp partition. and everything was fine (the recovery partition has become visible) until I rebooted and I could not start or from Mac or Windows when you press and hold alt on windows boot only show, but she always ends up with an error and restarts.

    I suspected that the problem is in the startup code. I used a Mac Osx bootable Installer to enter disk utility and you see Macintosh HD and under that
    Disk01
    Disk02

    Disk03

    and I can't do anything without verification or partitioning is available. I have reset NVRAM and I ran FSCK as suggested by some article. and nothing works.

    No recovery disk is available.

    Is there a possible way to correct the situation without losing any data. ??

    Search for this community. Your question has been asked and answered often here. Click on the search link located at the top right of this page.

Maybe you are looking for

  • External monitor does not work with Tecra M Series

    Hello I'm trying to connect to an external monitor, however it is not working properly. The monitor works fine with another laptop so I know that the monitor is ok. When I first start the lptop I get the screen then I XP Flash on the external monitor

  • A satellite starts no-Windows cannot start

    I had an update for windows internet explorer, but he has never started to download and I couldn't close the download window.Then my phone froze so I turned off and tried to restart. It comes up with all kinds of options but not work they freeze or a

  • Output meter, at the request

    I would like to have a counter to a single output pulse whenever an incident occurs in a loop. My current solution (in pseudocode; I'm using LabWindows CVI on an RT target) looks like this: DAQmxCreateTask (...); DAQmxCreateCOPulseChanTime (...); Whi

  • Save the text data and digital

    Hello It is two part question/need help: -. 1. I want to display the same number of decimal places on the table as in the attached picture.  In addition, include text on the last column of entry (as shown in the picture). 2. I also want to save the d

  • Why used solitare load for me

    When I want to play solitare on my start the screen menu is up but not cards. All the answers?