Old data refresh - problem of mapping - OWB has not been removed.

We use OWB 11.1.0.7 on Windows 2003. I created the dimensions and cubes and they are all worked well. The problem is when I tried to update the warehouse using new data, new data have been loaded into the dimension, but some old data were still there.

In the map, I used a materialized view to map to the dimension. I checked the old data was not in the materialized view, but was still in the dimension. The steps I took were:

-mv re-imported to OWB,
-synchronized to the source and the target in the mapping.
-related table redeployed + dimension and mapping,
-run the process flow.

And the target schema has update privileges and DBA role.

In mapping out bug mode, I saw some old data + new data has been loaded. In the details on the use of excution process flow, no data has been deleted. The mv database have been inserted, but old data merged too.

Could someone help me on this? Thanks in advance.

Georges Nicks

Hi Georges Nicks.

As far as I understand - you complain that some old data stood at dimensions? That is the data existing only no more on the source (view materialized in your case) always tables exist in the target (implementation of the dimension) table. I suppose also that you use ROLAP for cubes Dimensions (are you? Or you use OLAP?).

I also assume you are using the operator of dimension as target in your mapping? How OWB keeps changes in your target size depends on how you have designed your dimension and it's attributes. Is it configured type 1 (overwrite the former record on change), 2 (new record on change) or 3 (keep the old value in a separate change column)?

Anyway - I think that for all types of above dimension, the default behavior is not to delete the old dimension records. In general, it is reasonable since in Datawarehouse you typically add more data (you keep the history). When you say "Refresh" the datawarehouse - usually means adding new recent data (do not purge history).
Something interesting here, that is why you want to purge old dimension records: violent keep consistency in your data model, if it breaks some features? Or you keep more small dimension for query performance reasons?

It is true however that OWB lack such feature to automatically recognize this kind of change as "disappeared from source folder". And that change is sometimes important and must be reflected. In my practice, I used different approaches to deal with this - for example:
* Add all missing documents on the left side of the mapping with a gauge field EXISTS_IN_SOURCE = 'n' artificially. In this way - OWB processes the records and marks in the target size as «not active more»
* You can manually (we write some PL/SQL) to process the dimension after loading in OWB (by using step after mapping or some extra in your workflow). It's up to you how you process to remove lines here (you can mark them as EXISTS_IN_SOURCE = 'n', you can update their expiry timestamp, or you can serve them).

Situation with cubes is similar - if you really need a purge of the old data: you must especially take care to implement.

Kind regards
JAVOR

Tags: Business Intelligence

Similar Questions

  • Why can not solve this problem? This application has not been installed.

    something has happened and 8.1 of windows could not be installed. error code 0x80070005. This isn't as he tells me that the question or anything like that, its more like a big slap in the face. I've tried countless options troubleshooting even with the technical support of windows. They remote connected to my workstation and was like we are powerless. now I can not even use my key to reactivate my pc for some reason, and I doubt that I can get my money back. Little help would be nice if someone can provide. I get this error when checking for compatibility, but I don't know what could cause this meaning of the question I can't see what working or not

    This page describes the specific error code: http://support.microsoft.com/kb/968003

    With respect to assistance, it's a community forum of others like you. No one here works for Microsoft.  If you really want to talk about Microsoft, you can contact them here: http://microsoft.com/support

  • Still not get 2016 Outlook and Contacts calendar to synchronize with iCloud. iCloud data file has not been in Outlook but iCloud add-in is enabled.

    I use Windows 10 (v1511), 2016 Outlook Office 365 and iCloud 5.2. Mail is downloaded directly to Google mail Outlook. Calendar and Contacts live in iCloud and work properly in my iPhone, iPad and the app iCloud on the PC. Its just perspective that is not sync with iCloud to get these items.

    In outlook, the Setup program is not set up a data iCloud file ' * APLZOD.pst ' in the account tab data file settings. When you try to install a new data file in Outlook in account settings, the iCloud type available, but when you select what the error message says that this cannot be set in the iCloud Control Panel

    I tried several complete removal and then re - installs to iCloud for windows and have also done with the firewall and antivirus disabled active.

    I also deleted the Outlook data file * *.ost and allowed the installation program rebuild this application fee.

    The iCloud "add to" Outlook "add-ins" is active.

    The calendar, Contacts and tasks of the iCloud Panel section is checked when re-built, but after Outlook is running this section has not been verified and when you try to check it out and apply the change he UN-checks itself.

    Sorry for the long post, but I tried to solve this problem for some time.

    Thank you

    Chris

    The same problem.  I use iCloud for Windows 5.2 and Windows 10, 2016 office.   Everything worked well for several months until a few months ago, when sync calendar has stopped working.   I've updated iCloud of 5.1 to 5.2 but that just killed altogether.  Tried uninstalling icloud and relocation costs.  No luck.  When the iCloud settings appears, I check the box for the calendar and Contacts.  The driver then disappears.   I check again and it sticks.  But no messages on 'configure '.   When I close and reopen, the box is unchecked.   A few days ago I had the same problems the other another thread where he would show "set up" spinning forever (well, 30 minutes before giving up).   Not sure if it's an Apple problem or a problem of office.  But this is of course a problem.

  • The requested itinerary has not been mapped in Spark

    If I try to go to some Web sites, for example http://www.rtlnieuws.nl/ I get this message
    The requested itinerary has not been mapped in Spark.
    If I use Chrome I don't have this problem

    I solved the problem by cleaning the mind hidden CC cleaner

  • Error message comes up saying ' there is a problem resetting your PC has not changed. "

    Original title: reinstalling Windows

    My laptop (Dell Inspiron) comes preinstalled with Windows 8, but not working now - it runs very slowly and often takes multiple attempts to turn on. Often said 'Prepare auto repair' when I turn it on, it remains just on this message.

    It's less than 3 years old (out of warranty) so I think that it's a software problem and not material.

    I tried to do a factory reset to clear the laptop, but an error message comes up saying ' there is a problem resetting your PC has not changed. "

    I then tried to create an installation of windows on a USB media using my product key, but impossible to use my product key for retail sales.

    I am now at a loss of what to do that my laptop is pretty useless as it is.

    It's a hard drive to a failing hard drive error / failed.

    It's a DELL error code, not a Microsoft error code

    http://en.community.Dell.com/support-forums/desktop/f/3514/t/19533510

    Replace the hard drive or ask in the Dell Forums.

  • I followed the instructions for "Go Thunderbird data to a new computer," but the calendar data has not been transferred and the calendar program does not work.

    I manually moved my profile of Thunderbird in Ubuntu 12.04 LTS to 8.1 Windows. I followed the instructions and everything settled as expected except the calendar. Not only the calendar data has not been transferred, the calendar itself does not, for example no dates & everyday of the week, etc., all the menus associated with the calendar are "grey," etc. I'd appreciate any help. TIA KellyJMorris

    Calendar (aka Lightning) contains binary components, which are dependent on OS. Thus, you should not remove the add-on lightning in your add-ons Manager and install the Windows version of lightning.
    https://addons.Mozilla.org/en-us/Thunderbird/addon/lightning/

  • Pavilion dm4 2191us: restoring a backup made with HP Recovery Manager - data recovery manager has since been removed

    My system (portable Pavilion dm4, Win 7 Home Premium x 64)) is works well but I would like to restore a backup of data made with HP Recovery Manager. HP Recovery Manager has since been removed from the system and I don't have a recovery disk. I tried to install sp45415 that supposedly runs a silent installation for the Recovery Manager program, but it fails silently on my system. The notes say that it applies to Windows 7 computers and the Pavilion dm1 and dm3. There is no mention of the dm4.

    Y at - there a trick to getting sp45415 to work properly?

    Y at - it somewhere that I can download an installation package for HP Recovery Manager that works on the Pavilion dm4?

    Is there another tool that can restore the backup made by HP Recovery Manager?

    Thank you!

    If you have uninstalled Recovery Manager he probably removed the recovery of files in the recovery partition. When these files are not deleted download Recovery Manager will install. You will need a recovery media to boot from to restore the files and the recovery partition. If you do not have a recovery media you order from HP.

    As for the files you are trying to restore - if it's a backup of personal files, photos, etc. to the outside hard disk or DVD must be a file .exe inside these files, probably of Restore.exe or Recover.exe. Double click on the .exe will extract files to a folder on the hard drive of your laptop.

  • Problem with Outlook Express "Message has not been downloaded."

    I'm having a problem with emails and attachments removed once I open and view them.  More specifically, when I opened an e-mail message by using Microsoft Outlook Express 6 with an attachment, I am able to see the file and open the attachment.  However, when I go back to this same email one or two weeks later, I see the following is message "Message has not been downloaded" Outlook Express has not yet downloaded this message. »

    Please let me know what is the cause for this.  I have very important emails that have disappeared.

    In more of Bruce's response, if you lost messages (and it seems you if messages do not appear) and then check your Inbox for a bak file is a backup of the dbx file that you can restore.  See www.oehelp.com/OETips.aspx#2 and see point 4 on retrieving the messages.  I suspect the problem is due to having interference from antivirus software because it is probably what causes this loss, then see item 3 on this page also, as noted in Bruce.

    Steve

  • BlackBerry smartphones some of your data has not been saved

    Using BlackBerry Desktop Software 7.1.0.37 I get the following warning message after a return to the top of my BlackBerry Torch 9800 (version 6.0 of 2647 software bundle): 'some of your data has not been saved. Some data are not included in the file back. DataType: BlackBerry Messenger entered: 0/2 ".

    Hello and welcome to the community!

    Could the BBM Contacts... There are situations where those who are not properly saved with desktop software. Reference:

    • KB20554 How to back up and restore the BlackBerry Messenger contacts list

    If you moved to BBM 7, then your BBM contacts are saved "the cloud" as part of your association ID BB to BBM.

    Otherwise, you can compare the databases on your BB against what is contained in the backup file to determine exactly what is missing:

    • KB03974 List of database for the blackBerry smartphone

    You would need a 3rd party PC app to analyze and present you the backup file "readable" format to compare.

    FYI - for all recommendations and backup processes, see for more information:

    Good luck!

  • Hello.. Summer paid dues for that month has not been activated yet photoshop & lightroom, what is the problem?

    Hello..
    Summer paid dues for that month has not been activated yet photoshop & lightroom, what is the problem?

    Hello

    Please contact support by calling/chat for billing queries.

    Reference Support FAQ: how to contact Adobe for support?

    Hope that helps!

    Kind regards

    Sheena

  • I would like to export the data in an electronic form (which has not yet been created) in an excel database.

    I would like to export the data in an electronic form (which has not yet been created) in an excel database - is there any form on Central forms or how close this to start?

    I'm innovates and I have a desire to learn how to do this in PDF format

    Acrobat has a built-in method for manually export format delimited by tabs, which can be easily imported into a spreadsheet. The specific steps depending on which version you are using. For example:

    Acrobat 9: form > manage form data > merge data files into spreadsheet

    Acrobat 11: Tools > forms > MoreForm Options > merge data files into spreadsheet

    I do not remember this as the Acrobat DC procedure, but it's there.

    You can also use JavaScript to create a custom data file that contains the form data you want to export. This approach offers more flexibility, but it's also more complicated.

  • I have problem install photoshop5.5 and 6.0 software upgraded. The software, check error error message a future version of photoshop or ImageReady qualification has not been detected.   Please try again or cancel the installation if you have valid c

    I have problem install photoshop5.5 and 6.0 software upgraded. The software, future error message

    Error checking version of photoshop or ImageReady qualification has not been detected.   Please try again or cancel the installation if you have a valid copy of photoshop or ImReady that was detected.   Please call Adobe Customer Service.    . Someone help me please

    Phillip winter

    If I'm just remember, you need to enter your serial number of photoshop 5.5 when you install the upgrade photoshop version 6.

    The number that is on the upgrade to photoshop registration card 6 does not work for the installation of an update to photoshop version 6.

  • Microsoft Security Essentials Client Update Package - KB2754296 has not been installed due to a file epp.msi missing in the network directory, anyone have this problem?

    When automatic update trys to install a Security Essentials update, I get a message saying that the update has not been installed and that the epp.msi file cannot be found in the directory.  I tried to uninstall security essentials and start the uninstaller on but could not find the file epp.mis as well.  The file simply vaporize?

    In these forums, you will find some support for Microsoft Security Essentials (MSE): http://answers.microsoft.com/en-us/protect/forum/mse

    Additional references may include:

    Checklist for installation of Microsoft Security Essentials
    http://experts.Windows.com/w/experts_wiki/89.aspx

    Can I install Microsoft Security Essentials [or any other anti-virus/anti-spyware application] to clean my already infected computer?
    http://answers.Microsoft.com/thread/87058857-D181-4019-a723-efd9a49d9275

  • Make a backup of ASR, saved, but at the end of the record, I got this message: discovery of the ASR diskette has not been created.

    at the end of the recording, I got this message: discovery of the ASR diskette has not been created. You will not be able to restore an ASR backup without the system information stored on this disk. What does that mean? Should I save my data otherwise? I don't have a floppy drive (I'm surprised if someone does) but I have a dvd read/write cd drive... One last thing. When I looked at the content on the flash drive with program de-Frag it was lit, which means completely fragmented, the program recommended it de-fragment it... is this safe with a file of this size on a flash drive?

    Original title: Saving went well, but

    Windows XP is too old to do something other than a floppy drive.  If the automated system recovery disk is important to your backup and restore needs (HINT: YES it IS!) then get a USB floppy drive to create the ASR disk.  Or get a copy of most modern backup and restore program that works under XP and use modern media (USB, CD/DVD, keys etc.) to create a startup/recovery media.

  • None of my restore points will not work. He directed the restoration of the system and that it recharges, but says system has not been restored.

    None of my restore points will not work. He directed the restoration of the system and that it recharges, but says system has not been restored.

    What is your system brand and model?

    What is your Version of XP and the Service Pack?
    Describe your current antivirus and software anti malware situation: McAfee, Norton, Spybot, AVG, Avira!, Defender, ZoneAlarm, PC Tools, MSE, Comodo, etc..
    What is the issue that you are experiencing that you think that the system restore will be remedied (or you are just convenient)?  System Restore is not a time machine, but of course, this should work if you think you need.
    Some tools Anti Virus 'protect' your system so that they will not allow a restore of the system work properly.

    For example, if you use Norton/Symantec products, you will see a message like this:
    Restoration incomplete. Your computer cannot be restored...
    It is also a popular Symantec problem (well, I'll be polite and call an "undocumented feature"...), they wrote an article about it:
    According to what you use for malware protection, you may need to disable the product temporarily, do the system restore and then turn the products light up again when the system restore is complete.
    Sometimes you need start your system in Mode safe and so that your protection programs are not running, and then do the system restore.  Tips from Microsoft in some of their articles that if the system restore does not restore your computer, start in Safe Mode, and then run the system restore.  It works for some configurations.
    System Restore is sometimes so afflicted or Restore Points are suspicious, the best solution is to reinstall your system restore.  This will remove the old Restore Points, but sometimes it's the only way to fix a broken system restore.  You don't have to reinstall XP, only the part of system restore.
    That can leave you with your problem of unspecified origin that you hope the system restore will fix (using a system restore is usually not equivalent to fixing the problem though).
    Give these ideas some consideration if they apply to you.
    Sometimes malicious will afflict your system restore to prevent you to find and remove malware.  It would much rather you trick into thinking that you need to repair or reinstall your XP when it is not necessary.
    No matter what you use for protection against malware, I do so and then only begin to solve any problems:
    Download, install, update and do a full scan with these free malware detection programs can solve any problems:
    Malwarebytes (MMFA): http://malwarebytes.org/
    SUPERAntiSpyware: (SAS): http://www.superantispyware.com/
    It can be uninstalled later if you wish.

    The scans by operating clean, reboot, test and we can fix any other issues

Maybe you are looking for