increased num in ddg, google and bing - Commit 2b408646 - STRLCPY/Maryam

increased num in ddg, google and bing
Kaushik Sivashankar committed 3 years ago

2b408646

1 parent ef36c2d4

Revision indexing in progress... (symbol navigation in revisions will be accurate after indexed)

Total 3 files Show one by one

■ ■ ■ ■ ■ ■

maryam/core/util/engines/bing.py

		skipped 39 lines
40	40
41	41		def run_crawl(self):
42	42		page = 1
43		-	num = 11
	43	+	num = 50
44	44		set_page = lambda x: x*num
45	45		payload = {'count': num, 'first': set_page(page), 'form': 'QBLH', 'pq': self.q.lower(), 'q': self.q}
46	46		for _ in range(self.count//num+1):
		skipped 101 lines

■ ■ ■ ■ ■ ■

maryam/core/util/engines/duckduckgo.py

		skipped 44 lines
45	45		}
46	46
47	47		def run_crawl(self):
48		-	num = 30
	48	+	num = 50
49	49		page = 1
50	50		set_page = lambda x: x * num
51	51		payload = {'s': set_page(page), 'q': self.q, 'dc': num, 'v': 'l', 'o': 'json'}
		skipped 88 lines

■ ■ ■ ■ ■ ■

maryam/core/util/engines/google.py

		skipped 44 lines
45	45
46	46		def run_crawl(self):
47	47		page = 1
48		-	num = 10
	48	+	num = 50
49	49		set_page = lambda x: (x - 1) * num
50	50		payload = {'num': num, 'start': set_page(page), 'ie': 'utf-8', 'oe': 'utf-8', 'q': self.q, 'filter': '0'}
51	51		max_attempt = 0
		skipped 150 lines

Please wait...

Page is in error, reload to recover