411 Commits

Author	SHA1	Message	Date
Miroslav Stampar	39ab3b9149	Minor fix for meta refresh	2014-03-20 13:13:47 +01:00
Miroslav Stampar	56d76e6bfd	Updating list of extensions to exclude from crawling	2014-03-14 21:34:16 +01:00
Miroslav Stampar	490d51258e	Raising number of minimum time responses (15 is statistically too low)	2014-03-03 20:49:58 +01:00
Miroslav Stampar	6369a38ebc	Adding support for JSON-like data with single quote	2014-02-26 08:56:17 +01:00
Miroslav Stampar	465f968be6	Minor cosmetic update	2014-02-26 08:41:23 +01:00
Miroslav Stampar	8521265526	Minor fix	2014-02-07 14:40:43 +01:00
Bernardo Damele	43a4e85749	updated copyright	2014-01-13 17:24:49 +00:00
Miroslav Stampar	7718edac9b	Fix for an Issue #570	2013-12-27 09:40:33 +01:00
Miroslav Stampar	bf3fbb0ae0	Ignore Google analytics cookies	2013-12-04 09:56:37 +01:00
Miroslav Stampar	7054586e8a	Update for an Issue #565 (more work TBD - DuckDuckGo has some kind of IP blocking mechanism)	2013-11-25 20:57:07 +01:00
Miroslav Stampar	0a4512e9ae	Implementation for an Issue #557	2013-11-08 09:23:38 +01:00
Miroslav Stampar	e197720def	Fix for an Issue #546	2013-10-19 20:54:52 +02:00
Miroslav Stampar	777d999e71	Minor update	2013-10-18 15:39:46 +02:00
Miroslav Stampar	6ff2b931ff	Another patch for an Issue #545	2013-10-17 23:42:51 +02:00
Miroslav Stampar	304c9822bd	Patch for an Issue #545	2013-10-17 16:38:07 +02:00
Miroslav Stampar	5b8d631dc0	Minor update	2013-10-16 11:48:00 +02:00
Miroslav Stampar	04dbee3bec	Update for a more generic JSON recognition regex	2013-10-16 11:39:04 +02:00
Miroslav Stampar	bc19f40d09	Minor update	2013-08-22 10:44:21 +02:00
Miroslav Stampar	6cc0cf3702	Minor comment update	2013-08-20 18:36:31 +02:00
Miroslav Stampar	1088011bf0	Adding new binary file formats for excluding in crawling	2013-08-02 23:07:13 +02:00
stamparm	be5ce760b6	Fix for an Issue #485 (failing back to single-thread mode if over some bisection length)	2013-07-09 10:24:48 +02:00
stamparm	f7d15cb465	Official naming is HSQLDB (and/or HyperSQL)	2013-07-01 11:57:47 +02:00
Meatballs	7b6cc3d183	Add hsql settings	2013-06-24 14:38:44 +01:00
Miroslav Stampar	cdb434805a	Using alpha character as a boundary in union/error techniques (instead of ':') to support wider range of (output filtering) cases	2013-06-10 22:14:45 +02:00
Miroslav Stampar	351c70b390	Locale module screws string.letters, etc. in some cases (e.g. IDLE run)	2013-06-01 14:06:58 +02:00
stamparm	fc57b7565d	Implementation for an Issue #432	2013-05-09 14:26:29 +02:00
stamparm	46557198a5	Minor update of doc root names	2013-04-29 11:29:59 +02:00
stamparm	10fbeaed7b	Code refactoring	2013-04-15 11:49:11 +02:00
Miroslav Stampar	0b449bb1d9	Fix for an Issue #433	2013-04-10 19:33:31 +02:00
stamparm	8c9da95343	Style and consistency update (url -> URL)	2013-04-09 11:48:42 +02:00
stamparm	e1ffdde532	Little cleaning a mess with url encoding and post hint types	2013-03-27 13:39:27 +01:00
Miroslav Stampar	8acf033715	Code refactoring	2013-03-19 19:24:14 +01:00
Miroslav Stampar	2ada9e9b84	Patch for an Issue Issue #416	2013-03-04 18:05:40 +01:00
Miroslav Stampar	0e89cc62a2	Adding a hidden switch --dummy used for dummy runs (getPage() returns random data) - usefull for testing purposes for skipping connections	2013-02-28 20:20:08 +01:00
stamparm	be50192d8d	Refactoring WAF scripts	2013-02-26 15:54:50 +01:00
stamparm	e5e39bc682	Fix for an Issue #410	2013-02-25 11:07:30 +01:00
stamparm	8e49872d7c	Finalizing implementation for an Issue #290	2013-02-21 14:33:12 +01:00
Miroslav Stampar	368a2fd297	Fix for an Issue #393	2013-02-14 16:18:16 +01:00
Bernardo Damele	4b9d8ed673	reverted a previous commit as not all distributions create a link file /usr/bin/python2 to the Python interpreter	2013-02-14 11:32:17 +00:00
Bernardo Damele	a67ef4117f	make sure to use Python 2 interpreter when default system Python is version 3	2013-02-14 11:25:04 +00:00
Miroslav Stampar	6629233de5	Minor update	2013-02-14 10:18:40 +01:00
Miroslav Stampar	d78a3e977b	Update (allowing regular char * to be inside SOAP/JSON/XML)	2013-02-13 12:24:42 +01:00
Miroslav Stampar	72984a578d	Update for --load-cookies	2013-02-12 12:42:12 +01:00
Miroslav Stampar	c0e59d94a9	Better naming	2013-02-08 16:28:58 +01:00
Miroslav Stampar	cdfe43560b	Update for an Issue #207 (and a potential patch for regression tests)	2013-02-08 16:20:48 +01:00
Miroslav Stampar	f4b8a3c1d8	Bug fix for boolean (multithreaded Ctrl+C) resumed values	2013-02-04 15:49:29 +01:00
Miroslav Stampar	e7b93b5b66	Implementation for an Issue #363	2013-02-01 17:24:04 +01:00
Miroslav Stampar	bd08ede117	Minor fine tuning	2013-01-29 21:06:02 +01:00
Miroslav Stampar	c06f94e2c8	Fix for an Issue #378	2013-01-25 16:38:41 +01:00
Miroslav Stampar	8c84a16cb7	Minor style update for an Issue #377	2013-01-25 12:52:31 +01:00