file too large

Brian K. White brian at aljex.com
Thu Feb 3 14:11:46 PST 2011


Why export to csv? Just copy to a new qualifier in the same file, the 
processing becomes a single copy command for the entire record you want 
to preserve.

You can do the same thing for archiving, make a new qualifier for a 
given date range.

Assuming you have a selection set or separate selection processing to 
find old records, the actual report processing to archive is just

lookup alias = self at qual r=free -e
copy alias
delete
end

You probably don't want to use "-" for self, use the name of the filepro 
file even though you're already in it. Lookup - means to look up a 
record in the current file and jump/move the current focus TO it, but 
since the lookup is to some other qualifier I don't know what it would do.

To go the other way and create a new qualifier that has only the records 
you want to keep, point being to make a new raw key file that is 
smaller, just take away the delete from above, then rename the key files 
so the original 2G file is named key20110203 and the new smaller 
keysomething is named key.

dxmaint -ra -e
to rebuild all indexes after the musical chairs and you're done.

In the future, allow the file to grow to almost 2G but not all the way 
to 2G, have something that periodically archives old records to new 
qualifiers using the code at the top, and don't worry about physically 
shrinking the key any more. It's fine to let it grow to almost 2G and 
just keep copying and deleting records as they get old. The musical 
chairs is just a one time to get the key down under 2G because several 
things choke when the file is exactly 2G even if you aren't trying to 
grow it any more. You don't need to do the dxmaint except the one time 
either.

-- 
bkw

On 2/3/2011 4:45 PM, scooter6 at gmail.com wrote:
>    Well, there are over 8 million records in this file - so I was looking for
> a bit quicker of a solution to get this resolved
>    I can't wait to get this system on a CentOS server - SCO is soooooo dang
> slow haha
>    I'm currently looking to export the records to a few csv files, then
> delete key&  data for this file and import only the most
>    recent 6 months or so and then resolve the rest when I get back next week
> from vacation....
>    Why do these things happen the day before I'm leaving town? haha
>
>    So, to clarify - is this a SCO OpenServer 5.0.5 issue, or is this a
> filePro error? Meaning, if I upgrade tonight to 5.6.10 would this
>    resolve the issue?
>
>
>
>
> On Thu, Feb 3, 2011 at 4:38 PM, Jeff Harrison<jeffaharrison at yahoo.com>wrote:
>
>>   ----- Original Message ----
>>
>>> From: "scooter6 at gmail.com"<scooter6 at gmail.com>
>>> To: filePro Mailing List<filepro-list at lists.celestial.com>
>>> Sent: Thu, February 3, 2011 4:13:05 PM
>>> Subject: file too large
>>>
>>> We have a note line file that has apparently surpassed the 2GB size on
>>   SCO
>>> OpenServer 5.0.5 running filePro 5.6.07R4
>>> A lot of users got stuck  recording new records to this file, so I got
>> them
>>> all off the system and  tried adding a record and I'm getting
>>>
>>> ..../appl/filepro/filename:   key  file too large
>>>
>>> We had previously run an archive on this file,  but I know filePro won't
>>> actually 'shrink' the file size reported on the file  system.
>>>
>>> Are there any utilties that will 'shrink' this file below the 2GB  size
>> limit
>>> by 'removing blank records' ?
>>>
>>> So much for my vacation that  was supposed to start tomorrow........
>>   uggghh
>>>
>>>
>>>
>>> Scott
>>
>> If your blank records are actually deleted records, then yes there are a
>> number
>> of utilities that can shrink your file.  You can also do this yourself -
>> just
>> archive all the remaining records to another (new) file (or qualifier in
>> the
>> same file), and then from the OS just copy the key file back on top of the
>> original key.  Do the same for any other data segments that may exist.
>>   Then
>> rebuild all of your indexes in the original file and you should be all set.
>>
>> One possible "gotcha" - sometimes people actually use the record numbers as
>> pointers - I assume you are not doing that?
>>
>> Going forward you may want to set up a periodic archive so this does not
>> happen
>> again.
>>
>> Good Luck.
>>
>> Jeff Harrison
>> Author of JHExport and JHImport.
>>
>>
>>
>>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://mailman.celestial.com/pipermail/filepro-list/attachments/20110203/24535382/attachment.html
> _______________________________________________
> Filepro-list mailing list
> Filepro-list at lists.celestial.com
> Subscribe/Unsubscribe/Subscription Changes
> http://mailman.celestial.com/mailman/listinfo/filepro-list
>



More information about the Filepro-list mailing list