Pump data and Manipulation of data (DML)

Hi all
I wonder if there is a way to manipulate the table column, the data in a Data Pump export? For example, is it possible make the following changes in the export of DP:

employee update
Set firstname = 'a new string ";

We are looking for a way where we can protect the sensitve data columns. We already have a script for updating the data in the column (ie the text scramble to protect privacy), but we want to automate changes that export us the database schema, rather than having to export, import, running DML and then export it again.

Any ideas or advice would be great!

Kind regards

Leigh.

Hi Leigh,

Take a look at this great book:

-[Transformations of data with Oracle Data Pump | http://www.oracle.com/technology/products/database/utilities/pdf/datapump11g2007_remapdata.pdf]

I hope this helps you,

See you soon,.

Francisco Munoz Alvarez
www.oraclenz.com

Tags: Database

Similar Questions

  • Data backup pump failed and find the reason

    OS - Windows server 2012

    version - 11.2.0.1.0

    Server: production server

    Every day we take the backup data pump expdp and yesterday he got failed with the following error

    Start "AWSCOMMONMASTER". "" FULLEXPJOB18JUN15_090003 ":

    Current estimate using STATISTICS...

    Treatment of DATABASE_EXPORT/SCHEMA/TABLE/TABLE_DATA object type

    ORA-39126: worker unexpected fatal worker error of $ MAIN. DO_STATISTICS_ESTIMATE [TABLE_DATA: "DAILYRAWMAH".] ["" S07130131 "]

    SELECT COL, rowcnt, avgrln OF SYS. KU$ _TABLE_EST_VIEW WHERE object_schema =: 1 AND object_name =: AND 2: 3 IS NULL AND: 4 IS NULL

    ORA-01403: no data found

    ORA-06512: at "SYS." DBMS_SYS_ERROR', line 105

    ORA-06512: at "SYS." "MAIN$ WORKER", line 8171

    -PL/SQL call stack-

    the line object

    serial number of handle

    00000002F8D46620 18990 SYS package body. MAIN$ WORKER

    00000002F8D46620 8192 SYS package body. MAIN$ WORKER

    00000002F8D46620 8599 SYS package body. MAIN$ WORKER

    00000002F8D46620 7734 SYS package body. MAIN$ WORKER

    00000002F8D46620 12616 SYS package body. MAIN$ WORKER

    00000002F8D46620 2434 SYS package body. MAIN$ WORKER

    00000002F8D46620 8847 SYS package body. MAIN$ WORKER

    00000002F8D46620 1649 SYS package body. MAIN$ WORKER

    00000002F114F380 anonymous block 2

    Current estimate using STATISTICS...

    Treatment of DATABASE_EXPORT/SCHEMA/TABLE/TABLE_DATA object type

    ORA-39126: worker unexpected fatal worker error of $ MAIN. DO_STATISTICS_ESTIMATE [TABLE_DATA: "DAILYRAWTN".] ["" S07130131 "]

    SELECT COL, rowcnt, avgrln OF SYS. KU$ _TABLE_EST_VIEW WHERE object_schema =: 1 AND object_name =: AND 2: 3 IS NULL AND: 4 IS NULL

    ORA-01403: no data found

    ORA-06512: at "SYS." DBMS_SYS_ERROR', line 105

    ORA-06512: at "SYS." "MAIN$ WORKER", line 8171

    -PL/SQL call stack-

    the line object

    serial number of handle

    00000002F8D46620 18990 SYS package body. MAIN$ WORKER

    00000002F8D46620 8192 SYS package body. MAIN$ WORKER

    00000002F8D46620 8599 SYS package body. MAIN$ WORKER

    00000002F8D46620 7734 SYS package body. MAIN$ WORKER

    00000002F8D46620 12616 SYS package body. MAIN$ WORKER

    00000002F8D46620 2434 SYS package body. MAIN$ WORKER

    00000002F8D46620 8847 SYS package body. MAIN$ WORKER

    00000002F8D46620 1649 SYS package body. MAIN$ WORKER

    00000002F114F380 anonymous block 2

    Work "AWSCOMMONMASTER". "' FULLEXPJOB18JUN15_090003 ' stopped because of the mistake 22:21:19

    According to the above error I doubt two,.

    (1) every day I used to take expdp successfully why he failed yesterday only when everything is correct, my doubt is that one manually stop or revoke any privilege that associated with exports from above mentioned user called AWSCOMMONMASTER.

    If Yes, how can I find which revoked the privileges and what privileges revoked and when, how I do this. I got Toad tool

    (2) if not above mentioned point of view then, what is the error how can I identify. Not my backp work will begin today and I need to make success. Thank you in advance for your golden time.

    Hello

    There is no content = option there.

    Thin in this topic you have logically - 100 tables to retrieve the say and the process works through the list, in another session that someone drops a table - when the export process gets what he says "he has no table" - and he raises an error - the other 99 will work ok just this one will be failure.

    In your case, with incredible timing, the table has been deleted while the process was the phase of metadata and you got the weird error thrown - but the general theory is the same.

    Kind regards

    Rich

  • Pump data and import, BLOB, CLOB and RAW columns

    Hi all
    Please can someone confirm if the issue where import from LONG, BLOB, CLOB and columns RAW via Data Pump fails has been resolved in later versions of the Oracle database server?

    I believe that when you try to import a Data Pump export with tables containing these types of columns, that you get an error like:

    ORA-31693: Data Table object 'OWNER '. "" TABLE "could not load/unload and being ignored because of the error:
    ORA-06502: PL/SQL: digital error or value: in bulk Bind: Bind truncated

    Thank you

    Leigh.

    I believe that this error is only associated to long data type I have been using data pump to the table to export/import with LOB type without any problem.

    Data pump had a problem with the LONG type to check this bug

    Bug 5598333 - EXPDP/IMPDP corrupts the data for a LONG column
    DOC - ID: Note: 5598333.8

    It is set in 11.1.0.6

  • Storage and manipulated data

    Hello

    I'm going to develop a new application which need the user create a new 'book' and in this book, the user can add data name, address Pentecost and more values.

    My man its what I have to use the OS 4.6.1, but I see that the support for SQLlite are up to 5.0.

    So that I can use for storage and allow that user to manipulate the information?

    There are several options, with permanent store the more commonly implemented a method. Check out these links:

    http://supportforums.BlackBerry.com/T5/Java-development/storing-persistent-data/Ta-p/442785

    http://supportforums.BlackBerry.com/T5/Java-development/introduction-to-persistence-models-on-BlackB...

  • UTF 8 Conversion and manipulation of data EXCEED_SIZE

    Currently, I am working on a UTF-8 conversion task.

    We ran the csscan on the database and identify the tables and columns that are data that can 'EXCEED_SIZE' and 'DATA_LOSS.

    Here are the details of my database:
    Database version: 9.2.0.8.0
    NLS_CHARACTERSET: WE8ISO8859P1

    My question is, how can we identify the number of characters to truncate data EXCEED_SIZE, so that the data resulting will be insert in the post column conversion?

    Any document available on the treatment of EXCEED_SIZE data and DATA_LOSS cases.

    Thank you
    Anil

    There is no function unique SQL or an expression that can allow you to find the maximum substring of the current value that is will insert in the column after the conversion. But you can write a PL/SQL function that returns the string on the right using probing approach.

    FUNCTION to CREATE or REPLACE max_substring (VARCHAR2, max_column_length NUMBER input_string) RETURN VARCHAR2 IS

    substring VARCHAR2 (4000 BYTE);
    BEGIN
    substring: = input_string;
    LOOP
    IF the substring IS NULL THEN
    RETURNS A NULL VALUE.
    END IF;
    IF LENGTHB (CONVERT (substring, 'UTF8', 'WE8ISO8859P1')) < = max_column_length THEN
    RETURNS the substring; -the substring is part of the column even after conversion
    END IF;
    substring: = SUBSTR (substring, 1, LENGTH (substring) - 1); -remove the last character
    END LOOP;
    END;

    Please, test and revise this function carefully before using it in production. It can be applied to:

    UPDATE table SET columnis max_substring(+column+,+column_length+);.

    Change the arguments to be CONVERTED if the character of the target or source of change.

    As it has already recommended:
    1. check if your database has WE8MSWIN1252 codes (bytes in the range 0 x 80-0x9F)
    2 consider using AL32UTF8 instead of the UTF8. UTF8 is needed only for databases that interface with clients 8.1 or older and databases.

    -Sergiusz

  • Get the latest date DML for all tables

    Hi gurus,

    Version - ORacle 11i

    I need to get a list of the tables that was not 'DML used' for a long time (updates/Inserts / (and selects too if available)). I searched for this in the forum and found 3 methods I used

    1 insert/update dtm
    ----------------------------------
      SELECT DISTINCT table_name, T.COLUMN_NAME
        FROM all_tab_cols t
       WHERE UPPER (T.COLUMN_NAME) LIKE 'UPD%'
             OR    UPPER (T.COLUMN_NAME) LIKE 'INSERT%'
               AND T.OWNER = 'STG'
               AND T.DATA_TYPE IN ('TIMESTAMP', 'DATE')
    ORDER BY column_name
    
    Issue- Not all the tables have inaert/upd dtm
    2 all_tab_modifications
    -------------------------------------
      SELECT table_Name, timestamp
        FROM all_tab_modifications t
       WHERE T.TABLE_OWNER = 'STG'
    ORDER BY timestamp ASC
    
    Issue - Not all tables are monitored
    3 ORA_ROWSCN
    ------------------------------------------
    select MAX(ORA_ROWSCN), SCN_TO_TIMESTAMP(MAX(ORA_ROWSCN)) from stg.XXXXXX
    
    Issue- This throws error MAX(ORA_ROWSCN) is not a valid input . ie for really old tables this throws error.
    How do I get there?

    Thank you
    S

    957793 wrote:
    Thank you peter.

    But one thing I noticed, sometimes at the time where I start an analysis table calculates statistics, the table disappears from the all_tab_modifications

    Thank you
    S

    Yes, makes the Act of analyzing a table disappears from the view of xxx_tab_modifications. It is because this view follows changes in the analyzed table have been modified in order to analyze the self employment can tell whether or not it must be analused "today."

    Assuming that you use more or less the default policy analysis that Oracle puts in place, it would be a pretty safe assumption that any which table not in xxx_tab_modifications had to be a substantial (as defined by the auto scan parameters) activity dml recently, or in other words did not have an important activity for a long time. You can make a difference based on the last_analyzed_date column in the xxx_tables view.

    John

  • With the help of expdp/impdp in pump data

    Hi all

    I am newbie in oracle database through the use of data import and export oracle data pump. I use Oracle 10 g 2 on Windows 7

    After you create the directory object 'test_dir' and the granting of read, write privilege to user scott, I connect like scott to the database and create the table 'test' with two rows.

    Then I run expdp command prompt as follows:

    C:\users\administrator > expdp scott/tiger@orcl tables = happy test = all = TEST_DIR dumpfile = test.dmp expdp_test.log = logfile directory

    Export: Release 10.2.0.3.0 - Production on Monday, June 13, 2011 20:20:54

    Copyright (c) 2003, 2005, Oracle. All rights reserved.

    Connected to: Oracle Database 10 g Enterprise Edition release 10.2.0.3.0 - production
    tion
    With partitioning, OLAP and Data Mining options
    Departure 'SCOTT '. "SYS_EXPORT_TABLE_01": scott/***@orcl tables = test content.
    = all = TEST_DIR dumpfile = test.dmp expdp_test.log = logfile directory
    Current estimation using BLOCKS method...
    Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
    Total estimation using BLOCKS method: 0 KB
    Object type TABLE_EXPORT/TABLE/TABLE processing
    . . "exported"SCOTT" TEST' 0Ko 0 rows
    Table main 'SCOTT '. "" SYS_EXPORT_TABLE_01 "properly load/unloaded
    ******************************************************************************
    Empty the files together for SCOTT. SYS_EXPORT_TABLE_01 is:
    D:\DAMP\TEST. DMP
    Job 'SCOTT '. "" SYS_EXPORT_TABLE_01 "conducted at 20:21:02

    My question is why data pump seem to export the table 'test' without lines (that is to say the line: exported 'SCOTT'.) ("' TEST ' 0Ko 0 lines)? How can I do it with the associated export lines?


    I dropped the table test, then I ran the command impdp as follows:

    C:\users\administrator > impdp scott/tiger tables = content test = all = TEST_DIR dumpfile = Test.dmp impdp_test.log = logfile directory

    Import: Release 10.2.0.3.0 - Production on Monday, June 13, 2011 20:23:18

    Copyright (c) 2003, 2005, Oracle. All rights reserved.

    Connected to: Oracle Database 10 g Enterprise Edition release 10.2.0.3.0 - production
    tion
    With partitioning, OLAP and Data Mining options
    Table main 'SCOTT '. "' SYS_IMPORT_TABLE_01 ' properly load/unloaded
    Departure 'SCOTT '. "" SYS_IMPORT_TABLE_01 ": scott / * tables = happy test = all
    Directory = TEST_DIR dumpfile = Test.dmp logfile = impdp_test.log
    Object type TABLE_EXPORT/TABLE/TABLE processing
    Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
    . . imported 'SCOTT '. "' TEST ' 0Ko 0 rows
    Job 'SCOTT '. "" SYS_IMPORT_TABLE_01 "carried out at 20:23:21


    Then, after selection * test. No rows returned

    Please someone with an idea to this topic... What I expected after operation data in table view pump it could export and import table with the data if I'm not mistaken.

    Concerning
    Sadik

    Sadik says:
    He had two rows

    Export is disagreeing with you.
    have you COMMITTED after INSERT & before export?

  • Pump data to the directory import

    Hello!!!

    I have a slight problem with datapump. I try to import a complete database of an export that I copied to a new server.

    Windows Server 2003 R2 SP2 64-bit and EE Oracle 10.2.0.4

    I run this:

    Impdp system/dacnai directory is dumpfile 'Z:\backup\Backup_Docark' = DOCARK_FULL. DMP logfile = IMP_FULL.log full = y

    But it does not work. It does not recognize the directory (I also tried without the '). What I am doing wrong? I can't do it!

    Thank you!

    Looks like you should use impdp NETWORK_LINK clause.

    In doing so, you import the network and don't need a dump of the file at all.

    ------------

    Sybrand Bakker

    Senior Oracle DBA

  • arithmetic and manipulation of table

    I currently have a VI that reads and stores the values of a 1 d array in a 2D array.  I'm stuck trying to save the initial values of the

    Table 1 d perform arithmetic functions.

    I downloaded the VI and added a few notes in there to provide clarification on what I currently have and what I'm trying to accomplish.

    Any help would be appreciated.

    Thank you!

  • How to add a new Protocol and manipulation program?

    I want to register a new Protocol (' news: ') and make Windows Mail (Yes, I got it working after playing a bit...) the default program to handle this Protocol.

    But the control panel => the associated file type or Protocol with a program only allows me to change the existing entries (and "news:" there's no here). How can I add a new entry to this list?

    Michael

    Hello Mmo17,

    (a) what program you are trying to set as the default program?

    With regard to the concern on the new entry. Your file association creates new files for your default program. Once you define the program by default.

    I suggest you to refer the below mentioned link which gives you all the info of the evolution of the default programs and set file association.

    http://Windows.Microsoft.com/en-us/Windows7/change-which-programs-Windows-uses-by-default

    I hope this information helps. Please get back to us if you have any other questions on this subject.

    Thank you
    Mir - Microsoft Support
    Visit our http://social.answers.microsoft.com/Forums/en-US/answersfeedback/threads

  • geometricBounds order and Manipulation

    I've been playing with the pathItems.geometricBounds a little and it will give me a list when I put it in an alert, but how do I know what number represent what limits?

    the result you give [left, top, right, bottom] coordinated

  • Selection and manipulation of children locked objects

    In CS5, when you have locked the objects within a group or layer, you can still select the whole group/layer at a time.  And with the selected group/layer, any transformation/Cup/etc. will affect everything in the Group/layer, including locked objects.

    But in CS6, it seems that you cannot select entire group/layer with locked objects - the 'circle of selection"in the layers panel will not display the double circle.  And if manipulate you the Group/layer now, only the unlocked objects it contains will be affected; locked objects remain the same.

    How can I revert to behavior of CS5?

    It still works, but you need to select, not their target (which is what you did). You have to click to the right of the target symbol.

  • Differences between Data Pump and always by inheritance, import and export

    Hi all

    I work as a junior in my organization dba and I saw that my organization still uses legacy import and export utility instead of Oracle Data Pump.

    I want to convence my manager to change the existing deal with Oracle Data Pump, I have a meeting with them to keep my points and convence them for Oracle utility pump data.

    I have a week very convencing power but I won't miss to discover myself, I can't work myself and really a need with differences of strength against import and export, it would be really appreciated if someone can put strong points against Oracle Data pump on legacy import and export.

    Thank you

    Cabbage

    Hello

    a other people have already said the main advantage of datapump is performance - it is not just a little more fast exp/imp it is massively faster (especially when combined with parallel).

    It is also more flexible (once much more) - it will even create users with exports level schema which imp can't do for you (and it is very annoying that he could never).

    It is reusable

    It has an api plsql

    It supports all types of objects and new features (exp is not - and that alone is probably reason to spend)

    There even a 'legacy' at 11.2 mode where most of your old exp parameter file will still work with him - just change exp expdp and impdp print.

    The main obstacle to the transition to datapump seems to be all "what do you mean I have to create a directory so that it works", well who and where is my dumpfile why can't it be on my local machine. These are minor things to go well beyond.

    I suggest do you some sort of demo with real data of one of your large databases - do a full exp and a full expdp with parallel and show them the runtimes for them to compare...

    See you soon,.

    Rich

  • Data pump and the users and developers of Apex_Admin

    Hello

    I use Data Pump to save the schema that I use. It works very well. Now I would like to use Data Pump export and import the users listed in the application of Apex_Admin under workspaces manage / managing the Deverlopers and users.
    Where are stored the users? How to build the EXPDP / statements IMPDP.

    Thanks for your help.

    Hello

    Schema APEX_xxxxxx or FLOWS_xxxxxx are stored users APEX is where all your application metadata and workspace. The scheme name depends on your version of the APEX.
    Maybe you're using APEXExport. Check out this blog of Johns.
    http://Jes.blogs.shellprompt.NET/2006/12/12/backing-up-your-applications/

    Kind regards
    Jari

    http://dbswh.webhop.NET/dbswh/f?p=blog:Home:0

  • Best practices for the data pump or import process?

    We are trying to copy the existing to another newly created schema schema. Pump data export to succeed the export schema.

    However, we met errors when you import dump again file schema. Remapped schema and storage areas, etc.
    Most of the errors occur in PL/SQL... For example, we have views as below in the original schema:
    "
    CREATE the VIEW * oldschema.myview * AS
    SELECT col1, col2, col3
    OF * oldschema.mytable *.
    WHERE coll1 = 10
    .....
    "
    Quite a few functions, procedures, packages and triggers contain "* oldschema.mytable *" in the DML (insert, select, update), for example.

    Get the following errors in the import log:
    ORA-39082: object ALTER_FUNCTION type: 'TEST '. "' MYFUNC ' created with compilation warnings
    ORA-39082: ALTER_PROCEDURE object type: 'TEST '. "" MYPROCEDURE "created with compilation warnings
    ORA-39082: the VIEW object type: 'TEST '. "' BIRD ' created with compilation warnings
    ORA-39082: object PACKAGE_BODY type: 'TEST '. "' MYPACKAGE ' created with compilation warnings
    ORA-39082: TRIGGER object type: 'TEST '. "' MON_TRIGGER ' created with compilation warnings

    Many actual errors/no valid in the new schema objects are due to:
    ORA-00942: table or view does not exist

    My question is:
    1. What can we do to correct these errors?
    2. is there a better way to do the import with such condition?
    3 update PL/SQL and recompile with the new scheme? Or update in the scheme of origin, firstly and export?

    Your help will be greatly appreciated!

    Thank you!

    @?/rdbms/admin/utlrp.sql

    Will compile the objects in the database through drawings. In your case, you re-mapping from one schema to another and utlrp objects will not be able to compile.

    SQLFILE impdp option allows to generate the DDL of the discharge of export and change the name of the schema on a global scale and run the script in sqlplus. This should solve most of your errors. If you still see errors, now proceed to utlrp.sql.

    -André

Maybe you are looking for

  • I want to search in the address bar

    I have the new firefox 43, when I type things in the bar recipient, my most used web sites pop up at the top and I press down arrow once and get the website, I want, but now article 1 is always the search option, I don't don't need or want it to be t

  • AUTOPLACE Edition education Ultiboard Version 11.0 (11.0.278)

    Hello from Germany! I can´t find the automatic agent in Ultiboard. I work with the edition Version 11.0 education (11.0.278). If I look in the Release Notes OR Circuit Design Suite I find "automatic alignment"... (= Autoplace!). Maybe someone can hel

  • Where can I get the installation CD for Windows XP Professional?

    Original title: thankGODalways have key for windows XP proffisional need to install the XP CD thankGODalways have allowed the key for the installation of windows XP Professional need XP professional CD Adnan

  • Reg: Menu items...

    Hello I want to create menu items... like save, display, close,... etc. I extend my screen to screen... So please suggest me how to create menuItems.

  • How to send multiple files in After Effects Premiere Pro

    Hello, can someone tell me how I can send several files with aftermath of first pro and have the changes appear in the cut sequence in first pro after the backup? I would like to have my changes remain the same, but also like to be able to change the