Geek Answers Handbook

How to fix maximum runtime errors in PHP?

I have a PHP page that I launch every minute through a CRON job.

I run it for quite some time, but suddenly it started throwing these errors:

Maximum execution time of 30 seconds exceeded in /home2/sharingi/public_html/scrape/functions.php on line 84

The line number will differ with each error, starting from line 70 to 90 seconds.

Here is the code from lines 0-95

 function crawl_page( $base_url, $target_url, $userAgent, $links) { $ch = curl_init(); curl_setopt($ch, CURLOPT_USERAGENT, $userAgent); curl_setopt($ch, CURLOPT_URL,$target_url); curl_setopt($ch, CURLOPT_FAILONERROR, false); curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true); curl_setopt($ch, CURLOPT_AUTOREFERER, true); curl_setopt($ch, CURLOPT_RETURNTRANSFER,true); curl_setopt($ch, CURLOPT_TIMEOUT, 100); curl_setopt($ch, CURLOPT_MAXREDIRS, 10); //follow up to 10 redirections - avoids loops $html = curl_exec($ch); if (!$html) { echo "<br />cURL error number:" .curl_errno($ch); echo "<br />cURL error:" . curl_error($ch); //exit; } // // load scrapped data into the DOM // $dom = new DOMDocument(); @$dom->loadHTML($html); // // get only LINKS from the DOM with XPath // $xpath = new DOMXPath($dom); $hrefs = $xpath->evaluate("/html/body//a"); // // go through all the links and store to db or whatever // for ($i = 0; $i < $hrefs->length; $i++) { $href = $hrefs->item($i); $url = $href->getAttribute('href'); //if the $url does not contain the web site base address: http://www.thesite.com/ then add it onto the front $clean_link = clean_url( $base_url, $url, $target_url); $clean_link = str_replace( "http://" , "" , $clean_link); $clean_link = str_replace( "//" , "/" , $clean_link); $links[] = $clean_link; //removes empty array values foreach($links as $key => $value) { if($value == "") { unset($links[$key]); } } $links = array_values($links); //removes javascript lines foreach ($links as $key => $value) { if ( strpos( $value , "javascript:") !== FALSE ) { unset($links[$key]); } } $links = array_values($links); // removes @ lines (email) foreach ($links as $key => $value) { if ( strpos( $value , "@") !== FALSE || strpos( $value, 'mailto:') !== FALSE) { unset($links[$key]); } } $links = array_values($links); } return $links; }

What causes these errors and how can I prevent them?

+3
source share
2 answers

You must set the maximum execution time using the set_time_limit function. If you want endless time (most likely your business), use:

 set_time_limit(0);
+5
source

Reason . Some of the functions take more than 30 seconds to complete. Decision. Increase the maximum runtime ( max_execution_time ) in the php configuration file.
1. If you have access to your global php.ini file (usually in / web / conf else you can get the location from the configuration file (php.ini) in phpinfo), change max_execution_time = 30 to max_execution_time = 300.
2. If you have access only to the local php.ini file (you can get the location from the Loaded configuration file in phpinfo), change max_execution_time = 30 to max_execution_time = 300. Note. This file is named php5.ini for php 5.x + and php.ini for 4.x.

0
source

More articles:


All Articles