Not enough memory to create a database
- Eugene Lutsenko
- Posts: 1649
- Joined: Sat Feb 04, 2012 2:23 am
- Location: Russia, Southern federal district, city of Krasnodar
- Contact:
Not enough memory to create a database
Not enough memory to create a database.
When you open a small database CSV, then you can create a DBF file for conversion. But when the CSV file is large, assigning the structure of the database to be created in the array is obtained an empty array. Is there any command in order to free up the memory within the program? For example for arrays
When you open a small database CSV, then you can create a DBF file for conversion. But when the CSV file is large, assigning the structure of the database to be created in the array is obtained an empty array. Is there any command in order to free up the memory within the program? For example for arrays
Last edited by Eugene Lutsenko on Sun Oct 22, 2017 10:31 am, edited 1 time in total.
Re: Not enough memory to create a database
Hi, Eugene,
How size is CSV file ?
I also converting txt files to database, but when TXT file is larger than about 1 - 1.5GB, then it is problem.
Because I break file to smaller parts (about 100Mbytes) and read it separately.
Read one part, save to dbf, close this txt part and read other.
This works for me fine, without risk of memory exhaust.
How size is CSV file ?
I also converting txt files to database, but when TXT file is larger than about 1 - 1.5GB, then it is problem.
Because I break file to smaller parts (about 100Mbytes) and read it separately.
Read one part, save to dbf, close this txt part and read other.
This works for me fine, without risk of memory exhaust.
- Eugene Lutsenko
- Posts: 1649
- Joined: Sat Feb 04, 2012 2:23 am
- Location: Russia, Southern federal district, city of Krasnodar
- Contact:
Re: Not enough memory to create a database
The size of the CSV file is just 670 MB. I was hoping that it will be possible to introduce it into dbf file all at once. In parts it seems to work, but I do not like
Re: Not enough memory to create a database
create the database from a portion of the file.
then you can "append from delimited"
then you can "append from delimited"
Brian Wolfsohn
Retired and traveling around the country to music festivals in my RV.
OOPS.. Corona Virus, so NOT traveling right now...
http://www.breadmanrises.com
FB travel group: The Breadman Rises
Retired and traveling around the country to music festivals in my RV.
OOPS.. Corona Virus, so NOT traveling right now...
http://www.breadmanrises.com
FB travel group: The Breadman Rises
- Eugene Lutsenko
- Posts: 1649
- Joined: Sat Feb 04, 2012 2:23 am
- Location: Russia, Southern federal district, city of Krasnodar
- Contact:
Re: Not enough memory to create a database
From the small part I made when I was debugging. I usually am debugging on small amounts of data and faster to check. And then, when I took a real base, it turned out that it's not working. In Total Commander you can cut the file into parts, but not more than 1000 parts. But portions were too big. Now it turns out it is necessary to cut the part into pieces... and so until until you earn
- Eugene Lutsenko
- Posts: 1649
- Joined: Sat Feb 04, 2012 2:23 am
- Location: Russia, Southern federal district, city of Krasnodar
- Contact:
Re: Not enough memory to create a database
And Roger not have a program that converts a very large (giant) CSV files to DBF?
Re: Not enough memory to create a database
append from "csvfilename.csv" delimited will work with any size .csv, subject to the size limitations on .dbf files.
Brian Wolfsohn
Retired and traveling around the country to music festivals in my RV.
OOPS.. Corona Virus, so NOT traveling right now...
http://www.breadmanrises.com
FB travel group: The Breadman Rises
Retired and traveling around the country to music festivals in my RV.
OOPS.. Corona Virus, so NOT traveling right now...
http://www.breadmanrises.com
FB travel group: The Breadman Rises
- Eugene Lutsenko
- Posts: 1649
- Joined: Sat Feb 04, 2012 2:23 am
- Location: Russia, Southern federal district, city of Krasnodar
- Contact:
Re: Not enough memory to create a database
It is clear that the dbf file is < 2 GB. And could You explain to me more detail how to do this?bwolfsohn wrote:append from delimited will work with any size .csv, subject to the size limitations on .dbf files.
May be somebody knows where can I download CSV->DBF converter, which can do that?
- Eugene Lutsenko
- Posts: 1649
- Joined: Sat Feb 04, 2012 2:23 am
- Location: Russia, Southern federal district, city of Krasnodar
- Contact:
Re: Not enough memory to create a database
what is your Problem ?Eugene Lutsenko wrote:May be somebody knows where can I download CSV->DBF converter, which can do that?
Code: Select all
USE MyDBF EXCLUSIVE
APPEND FROM XYZ.TXT DELIMITED WITH ";"
greetings by OHR
Jimmy
Jimmy