Cliff wrote on Jan 2^nd, 2007 at 5:29pm:


You can import multiple files but each import will create a new set of records. You cannot use import to "merge" the data in one CSV file with records created by importing a different file.

You can use the File I/O commands in SBasic to manually create records using the data from both files. You can also use SBasic File I/O to blend the two CSV files into a single import file, assuming there is a one-to-one match between the records in each file.

Not really a tutorial, but here is an example of doing something very similar:

http://www.lantica.com/Forum3/cgi-bin/yabb2/YaBB.pl?num=1165960584/

Cliff wrote on Jan 2^nd, 2007 at 9:08pm:


No, not at all.

Quote:


The example accesses 2 different csv fiiles and combines them into one. You will need to adapt it so that it accesses 5 csv files and combines them into one. Your best bet is to use a mass update on one record. Just write the program in any element, it doesn't matter which. Make sure you only have one record (Add mode will get you that).

Quote:


Adapt the example so that it combines all five of your csv files into one csv file. Import the resulting csv file, paying attention to the field order the csv file has.

Cliff wrote on Jan 2^nd, 2007 at 9:37pm:



Absolutely. I'd be happy to look at your code. I am working on an example that is closer to your case as we speak.

To use the code above, cut&paste the code into any element in a mass update for one record. Make sure that the mass update will only run on one record! If it runs more than once it will double up your data - not good. Replace the filenames in the code as needed. It will create a big file will one row for each of your records, comprising fields from each of the five input files concatenated in the order in which they appear in the input files. Each of the five input files must have the exact same number of lines. The program will stop when it hits a blank line or end of file in any of the five.

After the code runs, you will need to run an ASCII import on the big resulting file. Make sure that the elements in your import spec match the order that they appear in the file. If not, drag the elements in the spec (hint: use SHIFT-Up / Down keys) to get them in the needed order in the spec.

Hi Mark:

Tried but no cigar...

What I did:

1. manually parsed through each csv text file to ensure its one to one veracity with my Sesame form
2. saved each of the 3 files into my Sesame data directory
3. opened a backup copy of the form in Sesame plus
4. selected one record upon which to affect a mass update
5. copied and pasted the following code into a blank element within that record
6. ran mass update...poof...nothing happened...no errors...no grinding hard disc...
7. checked data directory for any evidence of any file of any size having been created...none...

I modified the code you sent me as I have only 3 text files to deal with...code follows...again...Thanks...!!

var fh1 as int
var fh2 as int
var fh3 as int
var fh_out as int

var done as int

var str1 as string
var str2 as string
var str3 as string
var str_out as string

     fh1 = fileOpen("book1.txt")
     fh2 = fileOpen("book2.txt")
     fh3 = fileOpen("book3.txt")

     fh_out = fileOpen("OutFile.txt")
     fileSeek(fh1, 0)
     fileSeek(fh2, 0)
     fileSeek(fh3, 0)
     fileSeek(fh_out, 0)

     done = 0
     while(done = 0)
     {
           fileReadln(fh1, str1)
           fileReadln(fh2, str2)
           fileReadln(fh3, str3)

           if((@Len(str1) > 0) and (@Len(str2) > 0) and (@Len(str3) > 0) and (@Len(str4) > 0) and (@Len(str5) > 0))
           {
                 str_out = str1 + ", " + str2 + ", " + str3 + ", " + str4 + ", " + str5
                 fileWriteln(fh_out, str_out)
           }
           else
           {
                 done = 1
           }
     }      
     fileClose(fh_out)
     fileClose(fh3)
     fileClose(fh2)
     fileClose(fh1)

Hi Mark:

It is I, your diligent, if not frustrated student...

Thanks for pointing me in the direction of where to begin to look in the user manual for assistance.

While it was helpful in shedding light on what it is I am trying to accomplish, and most importantly how, I am still not able to concatenate my data files together.

I have manually parsed through my three data files in Excel several times to ensure a one to one correlation between them and my Sesame form. As above, I have read and re-read the sections in the manual dealing with data sorting and mass update and have followed the instructions for mass update to a “T” at least half a dozen times.

I have also edited the code you so kindly provided me to behave as it should...however, when I run the mass update it parses through record one (of 3044) and freezes on record 2. 

Interestingly enough I do generate an “outfile.txt” file, however, if I let the process run after it appears to freeze the file continues to grow to over a gig and a quarter in size though my three (discrete) data files are 2.1MB, 1.2MB, and 1.2MB in size.

I am doing my best to accomplish due diligence and do not want to impose further...but...

Do you have any suggestions?  This project needs to be completed soon as I am a couple months behind schedule at present.

Any and all help is very much appreciated.

Thanks again...

Cliff

"My" code follows:

var fh1 as int
var fh2 as int
var fh3 as int
var fh_out as int

var done as int

var str1 as string
var str2 as string
var str3 as string
var str_out as string

     fh1 = fileOpen("book1.txt")
     fh2 = fileOpen("book2.txt")
     fh3 = fileOpen("book3.txt")

     fh_out = fileOpen("OutFile.txt")
     fileSeek(fh1, 0)
     fileSeek(fh2, 0)
     fileSeek(fh3, 0)
     fileSeek(fh_out, 0)

     done = 0
     while(done = 0)
     {
          fileReadln(fh1, str1)
          fileReadln(fh2, str2)
          fileReadln(fh3, str3)

          if((@Len(str1) > 0) and (@Len(str2) > 0) and (@Len(str3) > 0))
          {
                str_out = str1 + ", " + str2 + ", " + str3
                fileWriteln(fh_out, str_out)
     }
     else
     {
                done = 1
     }
     }
     fileClose(fh_out)
     fileClose(fh3)
     fileClose(fh2)
     fileClose(fh1)

Hello Cliff,

Give the following code a try.

var fh1 as int
var fh2 as int
var fh3 as int
var fh_out as int
var done as int
var str1 as string
var str2 as string
var str3 as string
var str_out as string

	fh1 = fileOpen("book1.txt")
	fh2 = fileOpen("book2.txt")
	fh3 = fileOpen("book3.txt")

	fh_out = fileOpen("OutFile.txt")
	fileSeek(fh1, 0)
	fileSeek(fh2, 0)
	fileSeek(fh3, 0)
	fileSeek(fh_out, 0)

	done = 0
	While(done = 0)
	{
		If FilePos(fh1) <> FileSize(fh1) Then
		{
			fileReadln(fh1, str1)
		}
		Else
		{
			str1 = ""
		}
		If FilePos(fh2) <> FileSize(fh2) Then
		{
			fileReadln(fh2, str2)
		}
		Else
		{
			str2 = ""
		}
		If FilePos(fh3) <> FileSize(fh3) Then
		{
			fileReadln(fh3, str3)
		}
		Else
		{
			str3 = ""
		}

		If((@Len(str1) > 0) and (@Len(str2) > 0) and (@Len(str3) > 0))
		{
			str_out = str1 + ", " + str2 + ", " + str3
			fileWriteln(fh_out, str_out)
		}
		Else
		{
			done = 1
		}
	}
	fileClose(fh_out)
	fileClose(fh3)
	fileClose(fh2)
	fileClose(fh1) 

-Ray