Re: keep hitting mysql memory limit, even in Cake Shell when exporting large xml file

Same thing was happening with me before a couple of days...

The problem was.... i have set the cron to run every 5 mins.

but the script was not completing within 5 mins... so there were multiple instances running.. which caused mysql down.

.........

sometimes, the problem is always different then we think of.

Jaydeep Dave

On Sun, Jul 26, 2009 at 7:09 AM, JamesF <usaexportexperts@gmail.com> wrote:

i took the drastic step of increasing my php memory limit to avoid
dealing with this right now but i dont think its a long term solution
by any means.

On Jul 26, 1:55 am, JamesF <usaexportexpe...@gmail.com> wrote:

> MY PROBLEM:
> i am running into a wall with this one. basically i have a large xml
> file that i am rendering using XmlHelper. We are talking about a
> 25-50mb file. This is basically a product data feed. I have tried
> quite a few methods to overcome the memory limit but no luck.
>
> MY ERROR:
> Fatal error: Allowed memory size of 83886080 bytes exhausted (tried to
> allocate 53 bytes) in /home/username/usr/cakedev/cake/libs/model/
> datasources/dbo/dbo_mysqli.php on line 402
>
> WHAT I HAVE DONE TO TRY AND FIX IT:
>
> 1) Initially i set this up to render through the web in one
> shot....this cause execution limit timeouts and memory errors.
>
> 2)I broke up the data requests in seperate chunks of 500 records using
> internal method calls, like $listings = $this->getListings($start_id,
> $limit); This caused the same problem
>
> 3) I set the whole thing up via the cake shell interface. It works
> great except for the fact that i keep running up against the same
> limit, even with staggered chunks of records in different method
> calls.
>
> MY GUESS:
> is that Cake is keeping an open connection with the database for the
> life of the script.
>
> MY SPECIFIC QUESTIONS:
> can i disconnect and reconnect from the database inside of the script?
> specifically can i do this in a cake shell script? will this solve my
> memory problem? am i going about this the wrong way entirely?
>
> thanks again anyone who has some advice!

--
Regards,

Jaydeep Dave
Mobile: +919898456445
Email: jaydipdave@yahoo.com

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "CakePHP" group.
To post to this group, send email to cake-php@googlegroups.com
To unsubscribe from this group, send email to cake-php+unsubscribe@googlegroups.com
For more options, visit this group at http://groups.google.com/group/cake-php?hl=en
-~----------~----~----~----~------~----~------~--~---