Reading files of multiple data individually

Similar Questions

• Read files based on date selection

  Hello

  I have requirement such that the server there are some files for example: text20101231, text20111231, text20121231 and text (Note: exercise file does not have any suffix in its name that is text is file of the current year).

  Now in the user INTERFACE may choose 2 dates: starting from Date and to date.

  According to the date selected files should read in my code.

  For ex: If the user selects the Date from: 13/06/2011 and to this day: 31/11/2012 in the calendar then my code should read only the text20111231 and the text20121231 two files.

  I will also check if the year to date is equal to the current year, it will read the file in which it doesn't have any suffix in its name.

  Please suggest how to read the affected files based on date selection.

  Thank you.

  So I'd start with a cfdirectory to all of the directory, to get all the files.  It returns a query object.  You can then use this to do a query of queries, for example according to your date criteria.

  SELECT *.

  OF getAllFiles

  WHERE 1 = 0

  OR a name like "text #i #%".

  ...

• Read file, reformat the data, write new file

  Oracle 11g PL/SQL.

  I have a need to read an existing file, reformat the drive and write to a new file format.

  My solution has been to read the file using utl_file and store it in an array of procedure1.  There is a column of data to hold 1000 bytes of data for each line of the file.

  Then in procedure2, read the data through a cursor column, with a certain logic and fill in the fields of a record type object by using the function substr on the data column.  The type of record object has about 80 columns, all TANK types.  The OUT of procedure2 parameter would be the type of record object.

  Then in procedure3, record object would be the parameter, and this recording would be used to write the new line of the file.  The problem I see now is that I can't convert the object record type a TANK in order to write the file.  So that would mean that I have to reference each of the 80 columns once again in procedure 3 and concatenate each for the parameter buffer utl_file.put_file.

  I don't want to assign values for columns of 80 exit more than once because that makes the code very long and detailed, so I thought that I assign values to the time in the record object, then pass the record object to the write file procedure.

  I'm looking for suggestions on a better design, or have I missed some very basic code design?

  Thank you.

  Thanks for all the great suggestions.

  The original file is from a COBOL program.  What I ended up doing was reference and readability, I have defined/filled all fields of provision of COBOL in my program and then concatenated fields during the construction of the output string.  It's a bit verbose, since the 80s fields appear twice, but the code is clear and easy to understand for support purposes.

  Thanks again for all the thoughtful suggestions.

• How can I request the same information in the fields of specific metadata across multiple files, i.e. date of reference, artist, genre, composer, technician

  How can I request the same information in the fields of specific metadata across multiple files, i.e. date of reference, artist, genre, composer, technician.  Most of the fields I want to fill/use will be the same for files of 50-100, then each file will have a few things specific to that individual file.

  Unfortunately, it cannot be done from within hearing. Adobe Bridge is probably the software you need to do this or there are a few applications available third-party metadata. I use metadata Touch.

  MetadataTouch - powerful multiformat metadata editor

• Reading several files / locate the data source during execution

  Hi all
  
  I have a requirement of the company in which I need to read files to different folders. This system is not hosting the ODI agent. There are two folders, the folder A and folder b. Two records may have any number of files. My intention is to read the files in a folder and write the data to a table in a database that resides in another system. This forms a flow for me. For the B folder, I have a similar flow. All files (in the folder A and folder B) have the same structure. The requirement is to read A book during the week and the B folder on the weekend. The system that has the database also runs the ODI agent.
  
  Here are my questions:
  
  1. How can I read several files one by one in a folder? Because the read files must be archived, they need to be written in a different folder, file C (for example). How do you archive part? Please note that this machine does not run ODI agent (network share could be an option, but we try to avoid it.
  
  2. can I have only an interface to read files in folder A and folder B? Everything else remains the same (the processing logic/transformations etc.). Indeed, is there a way to dynamically switch between two files (using a variable, perhaps).
  
  I've not worked with files and so any help is greatly appreciated.
  
  Edited by: Sankash 7 May 2009 08:24

  Hi Sankash,

  Hopefully I can help you achieve this task.

  Please go through this link

  Re: import files in a table

  1. you can update the status of the process of the files in a journal/temp table.
  Based on the State of the (transformed) file in the table, you can check the files that has completed its process correctly.

  machine does not run ODI agent:-J' have it is implemented the same type of scenario, in which I am downlading all the files in a common location and treat it from there.

  2. one of the solutions is that: -.

  create two interface with the same structure, but the source table must point to the folder A and B
  Create a variable (week/check) and based on the value, you can call the interfaces.

  second option: -.

  If you're downlaoding the files in a common location, you can reach the spot through a single interface (down load files from folder A or B according to in week/weelend)

  3. If all the files have the same structure, you need only a data store and it should be a variable data store.

  If something is not not clear please me ping / mail to my id (good that now I don't get enough time to go through the forum discussions)

  Also if you need I can send you a diagram wokflow for this loop (read multiple files one by one in a folder)

  Kind regards
  Pascale of M

• Cannot open the terminal failures of the file 'C\:HP\DATA\HP. DAT' to read.

  I've just updated my bios on my HP Pavilion g6-2102au Notebook PC.

  I had continuous multi color screens, thought it was overheating but not so much.

  I installed the latest version of the bios and it seems to have worked? having had a twinkle while writing

  This.

  My query is to start up when he started I get this message and I said OK

  Terminal Failute cannot open the file 'C\:HP\DATA\HPLB. DAT' to read.

  This is the message that someone help me get rid of it

  See you soon

  shiner2348

  Hi @shiner2348,

  Thank you for your inquiry.

  I understand that you receive the error message "Terminal failure cannot open the file"C\:HP\DATA\HPLB. " DAT' to read '.

  This is a reference to the launch of HP software box.    I suggest to uninstall and then restart your laptop.

  If you want to keep this app I suggest that you try to download it and install it using compatibility mode.

  Here are links to help you in this process:

  Compatibility mode

  HP launch box Windows 8

  Please let me know the results.

  
  

  Thank you for your participation in the Forums of HP! We want to help you as well as others who may encounter a similar problem as you. Please consider tagging the post in order to solve your problem as "accept as Solution" to help other members of the community!

  To show recognition for my efforts please click the Thumbs Up below.

• read and medium n data from text file

  I acquire [a waveform of reading] oscilloscope digital data that is stored in a column in a text file.

  I need to read selectable amount of data at average/parcel them points.

  So basically I want to have a text file with millions of data points, but I want to draw not to say that all 1000. data point. I tried a lot of things I found here on the forum, but as I'm new to LabView, none of them really worked.

  Does anyone have a suggestion.

  Thank you.

  
  

• Reading file and dump the data into the database using BPEL process

  I have to read the CSV file and insert data into the database... To do this, I created some asynchronous bpel process. Adapter filed added and associated with the receive activity... Adapter DB has added and associated with the Invoke activity. Receive two total activity are available in the process when trying to Test em, receive only the first activity is complete and awaits the second receive activity. Please suggest how to proceed with...

  Thanks, Maury.

  Hi Maury,

  There is no need in step 2 that u mentioned above. I donot find useless a webservice?

  The process will be launched by the CSV file, then using the processing activity, you can put it in the DB.

  There should be no way where you can manually test it by giving an entry. All you can do to test is to put the file in the folder you mentioned when configuring the file adapter.

  You just need to have the composite as below:

  ReadCSVFile---> BPEL--> DB adapter

  And in your BPEL process:

  Recieve--> Transformation activity--> call activity

  Try to work on some samples listed on the oracle site and go through the below URL:

  The playback of the file adapter feature using

  Thank you

  Deepak.

• Loading multiple data to an XML file?

  Hello

  I have a problem loading multiple data from the same XML file. In this XML file, I have a list of dishes, I want to add to a menu. So, how can I load more data from different branches of the XML file into my text fields?

  Thanks in advance,

  Rafael Carignato

  Found a way to do it. I created X text elements named "textbox1", "textbox2", etc. Here is the code:

  var i = 1;

  var message;

  $.ajax({)

  type: 'GET ',.

  URL: "books.xml"

  data type: "xml."

  success: function {(xml)

  ($xml).find('Book').each (function () {}

  var Work'stitle = $(this).find('Title').text ();

  var sAuthor = $(this).find('Author').text ();

  sGenre var = $(this).find('Genre').text ();

  message = Work'stitle + ',' + sAuthor + ', ' + sGenre;

  Console.log ("Message:" + message);

  Console.log ("i:" + i);

  SYM. $("textbox"_+_i).html (message);

  Console.log("");

  i ++ ;

  });

  },

  });

• Reading file Modification date

  In Flash 8, I know there is the FileReference class but it seems to be based around downloading files. Is there a way to read a date of modification of the existing local files only? I have build an executable that loads a .swf file and the .exe has just need to know if the file has been updated. It checks periodically change, ideally. Any help would be appreciated with this. Thank you, Rob

  Another thought... his was curious why you need this information...

  I can only assume that its because some external process to the projector exe file creates a new SWF every now and then... one with the same name as the one you have loaded.

  If so, could you not get this process (whatever that is) to also save a text file with the date and time at the time of the update the swf file?
  Flash load this value from the text file when it starts with loadVars and (if you want more persistence a sharedObject allows you to retrieve/store the old value).
  Regularly - check the text file and then compare with the old value each time. I know that this approach seems clumsy, but you are quite limited, unless you want to add some additional file systems api via a 3rd party etc. projector tool. Its also difficult to propose an option because I don't know why you need to do this... I'm just guessing.

• tablespace with multiple data files

  Hi all
  
  We have RHEL4 server with oracle 10 g 2 inside.
  
  can we create a tablespace with multiple data files? I mean while creating a tablespace itself, we should be able to create two or more data files (should not use ALTER tablespace command).
  
  If possible, please give me the SQL to do this (assume that I need to create a tablespace with two data files).
  
  Thanks in advance...

  Not so difficult isn't it?

  create tablespace datafile test
  '1.dbf' size 1 m REUSE AUTOEXTEND ON NEXT 32 M MAXSIZE 1500 M,
  '2.dbf' size 1 M REUSE AUTOEXTEND ON NEXT 32 M MAXSIZE 1500 M
  EXTENT MANAGEMENT SEGMENT LOCAL SPACE MANAGEMENT AUTO;

• SMU remote system do not read file .lvm

  I try to get my remote system (SMU remote system) to send a signal of analog voltage by reading a file .lvm.

  I have a project in real time implemented, and under my remote system, I have a VI that is supposed to give a signal of analog voltage.

  The implementation of VI begins by reading a file position (.lvm). After that, it is connected to a DAQ assistant.

  I'm already sure that everything is connected properly, and that it is the right channel. The reason why I'm sure is because in the DAQ assistant window, I can click on "run" in order to send a test signal. I am able to capture this signal to test with an oscilloscope. Therefore, I am sure that the system is all set up correctly.

  Finally, I don't know if it's important, but the measure file he was reading is located in my host. I don't know if I deploy when the VI to the target, if the measurement file is sent to the remote system with the VI.

  I was wondering if someone could help me please.

  Thank you

  Leon

  Hi Leon,

  If I understand correctly, you are trying to read a file .lvm waveform data and send this waveform through your SMU system. What devices are specifically using (chassis, modules...)? What exactly happens when you run the VI? You see errors? If so, what are the codes that come with these errors? Additional information on what the file .lvm would be also useful. What are the functions you use to play the .lvm file?

  Kind regards

• Read file without knowing the full name

  Dear all,

  I want to read data from a file, but without knowing the full name of the file.

  For example I have data files in a program that the first letters of the data files are the date and the rest of the numbers, I can't predict IE 20081027_5323621.

  Is it possible to read this file in the knowledge that the characters that correspond to the date?

  Thank you!

  OK, that worked well.

  Thank you very much!!!

• Unable to read the security descriptors data stream

  Whenever I start my computer runs CHKDSK - it says checking file system on E: and then he said that it should be checked for consistency. It works until stage 3 when he says 'impossible to read the security descriptors data stream' how to fix this?

  I tried chkdsk e:/r and it runs before step 3 when I get the "unable to read the security descriptors data stream" and it goes no further.

  I also tried fsutil dirty query e:- but it says something about a parameter incorrect and not if the volume is dirty or clean.

  Then I tried chkdsk e:/f/x - that always gives me the same mistake about it being an incorrect setting.

  As far as I know there is absolutely nothing on E:, I didn't even know that there was an additional drive. Right now I have it turned off so that I can use my computer. It seems to work fine without it. I read an article that said that if I can't fix e: with chkdsk which I have to do a low-level format of the reader? What's my next step? And I can do without the XP disc?

  The syntax

  fsutil dirty query e:

  is correct (except, of course, you try to use from the Recovery Console, where the fsutil command is not available).  Are you logged on as a user with administrative rights when you use fsutil?

  Similarly, the switches /f and/x are not available for chkdsk in the Recovery Console.

  See Recovery Console controls.

  Click on desktop then right-click on E: drive icon and select Properties.  What is indicated for:

  • File system
  • Space used
  • Free space
  • Capacity

  Now double click the icon for E: are shown files?  If not, click Tools > Folder Options > view and select the radio button "Show hidden files and folders" and uncheck "Hide protected files (recommended) operating system.  Now that you see all the files?

  Everything you read 'low level of shaped' is nonsense.  Any modern PC drive cannot be low level formatted by end users.  You can read this, but there is really no necessary even to "zero fill" your drive E: http://seagate.custkb.com/seagate/crm/selfservice/search.jsp?DocId=203931 (I have not checked to see if the WD tools rescuer has similar characteristics to SeaTools for DOS).

  If you are convinced that there is nothing of value on E (for example, installation of backup or restore), you can either format by right-clicking on the drive icon in my computer and selecting "format" or you can start disk management as described previously and use either in electronic format or delete the partition completely.  If you delete the partition, space becomes "unallocated".

  Because I guess C is your system drive (where Windows is), you may be able to use the diskpart tool to extend the partition F to use the unallocated space left if you decide to remove E well it's much easier (and safer) to do with disk management third-party tools such as Easeus Partition Manager free : http://www.partition-tool.com/personal.htm

• In CloverETL how to read file xlsx with a column of type "long".

  Hi all

  Let me know how to read an xlsx (Excel) file with columns of data type "long".

  I used XLSDataReader to read file xlsx. There are names of "Remarks" column, which exceeds the linits of 256 characters, so I can not use type 'string' to do this.

  IM using "long" datatype and graph below error crossings.

  Pointers on this will be greatly appreciated.

  INFO [main] - * graphic CloverETL framework/transformation, (c) 2002-2013 Javlin a.s., published under the GNU Lesser General Public License *.
  [Main] INFO - running with CloverETL library version 3.4.1 build #010 updated 07/01/2013 18:38:12
  INFO [main] - running on 4 CPUS, operating system Windows 7, architecture amd64, Java version 1.7.0_07, max memory available for JVM 913920 KB
  INFO [main] - loading properties by default: defaultProperties
  INFO [main] - graphic definition file: graph/SurveyResponses.grf
  INFO [main] - graphical revision: 1.16 modified by: 470707 update the: kill Jan 20 16:13:52 IST 2015
  INFO [main] - check the graphical configuration...
  INFO [main] - graphical configuration is valid.
  INFO [main] - graphical initialization (SurveyResponses)
  INFO [main] - initialization of the phase 0
  INFO [main] - Phase 0 initialized successfully.
  INFO [WatchDog_0] - starting all the nodes in the phase [0]
  INFO [WatchDog_0] - has successfully started all nodes in phase!
  INFO [XLSDATA_READER1_0] - reading data of 0 sheet (Sheet1).
  ERROR [WatchDog_0] - component [XLSDataReader:XLSDATA_READER1] finished with ERROR status.
  How (long) field cannot be set to the value "comment." does not match the specified format ' ' with good reason 'incomplete analysis. " in folder 1, 23 ("comment"), metadata field 'Survey_Responses_Sheet1 '; value: 'How' (note that for parallel processing ParallelReader or server, run the registration number may be incorrect)
  ERROR [WatchDog_0] - the error Details:
  org.jetel.exception.JetelRuntimeException: component [XLSDataReader:XLSDATA_READER1] finished with ERROR status.
  at org.jetel.graph.Node.createNodeException(Node.java:535)
  at org.jetel.graph.Node.run(Node.java:514)
  at java.lang.Thread.run(Thread.java:722)
  Caused by: org.jetel.exception.BadDataFormatException: how (long) field cannot be set to the value "comment." does not match the specified format ' ' with good reason 'incomplete analysis. " in folder 1, 23 ("comment"), metadata field 'Survey_Responses_Sheet1 '; value: 'How' (note that for parallel processing ParallelReader or server, run the registration number may be incorrect)
  at org.jetel.data.LongDataField.fromString(LongDataField.java:465)
  at org.jetel.data.parser.XLSXDataParser.parseNext(XLSXDataParser.java:492)
  at org.jetel.data.parser.XLSParser.getNext(XLSParser.java:136)
  at org.jetel.util.MultiFileReader.getNext(MultiFileReader.java:432)
  at org.jetel.component.XLSReader.execute(XLSReader.java:562)
  at org.jetel.graph.Node.run(Node.java:485)
  ... 1 more
  Caused by: java.lang.NumberFormatException: incomplete analysis
  at javolution.text.TypeFormat.parseLongString (unknown Source)
  at javolution.text.TypeFormat.parseLong (unknown Source)
  at javolution.text.TypeFormat.parseLong (unknown Source)
  at javolution.text.TypeFormat.parseLong (unknown Source)
  at org.jetel.util.formatter.JavolutionNumericFormatter.parseLong(JavolutionNumericFormatter.java:74)
  at org.jetel.data.LongDataField.fromString(LongDataField.java:462)
  ... 6 more

  INFO [WatchDog_0] - the implementation of phase [0] completed with error - elapsed time (sec): 4
  ERROR [WatchDog_0] -! Completed with error - graphic stop run!
  INFO [WatchDog_0]-* the summary execution of Phases * -.
  INFO [WatchDog_0] - Phase # finished status RunTime (sec) MemoryAllocation (KB)
  INFO [WatchDog_0] - 0 4 175279 ERROR
  INFO [WatchDog_0]-* end of summary * -.
  INFO [WatchDog_0] - finished the watchdog thread - total running time: 4 (s)
  INFO [main] - freeing graphics resources.
  ERROR [main]-
  --------------------------------------------------------------------------------------------------------------------------------------------------------- Error details ----------------------------------------------------------------------------------------------------------------------------------------------------------
  Component [XLSDataReader:XLSDATA_READER1] finished with ERROR status.
  How (long) field cannot be set to the value "comment." does not match the specified format ' ' with good reason 'incomplete analysis. " in folder 1, 23 ("comment"), metadata field 'Survey_Responses_Sheet1 '; value: 'How' (note that for parallel processing ParallelReader or server, run the registration number may be incorrect)
  ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  ERROR [main] - the graph failed!

  I think the 256 character limit is a red herring.  All data is there, the front-end integrator is truncating only for display purposes.

  Your data is a string, it should certainly be classified as a string in the metadata.  For a long time is for numeric values.

  I don't think there is a problem here, if you were to write this data to the trash or a text file (after reading it in), you will see that your data is not truncated.

  Kind regards

  Patrick Rafferty

  Branchbird