STRLCPY/maigret

Fixed the rest of false positives for now (#371)

* Fixed the rest of false positives for now

* Fixed tag

* Updated site list and statistics

Soxoj committed with GitHub 3 years ago

8a53a385

1 parent bc787cdf

Revision indexing in progress... (symbol navigation in revisions will be accurate after indexed)

Total 4 files Show one by one

■ ■ ■ ■ ■ ■

maigret/maigret.py

		skipped 47 lines
48	48		for e in errs:
49	49		if not errors.is_important(e):
50	50		continue
51		-	text = f'Too many errors of type "{e["err"]}" ({e["perc"]}%)'
	51	+	text = f'Too many errors of type "{e["err"]}" ({round(e["perc"],2)}%)'
52	52		solution = errors.solution_of(e['err'])
53	53		if solution:
54	54		text = '. '.join([text, solution.capitalize()])
		skipped 677 lines

■ ■ ■ ■ ■ ■

maigret/resources/data.json

		skipped 1461 lines
1462	1462		"forum",
1463	1463		"ru"
1464	1464		],
	1465	+	"disabled": true,
1465	1466		"checkType": "message",
1466	1467		"absenceStrs": [
1467	1468		"\u041f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u0442\u0435\u043b\u044c \u043d\u0435 \u043d\u0430\u0439\u0434\u0435\u043d"
		skipped 16677 lines
18145	18146		"tags": [
18146	18147		"ru"
18147	18148		],
	18149	+	"disabled": true,
18148	18150		"checkType": "status_code",
18149	18151		"alexaRank": 6054365,
18150	18152		"urlMain": "http://linuxmint.info",
		skipped 6336 lines
24487	24489		},
24488	24490		"thoughts.com": {
24489	24491		"tags": [
24490		-	"in"
	24492	+	"blog"
	24493	+	],
	24494	+	"checkType": "message",
	24495	+	"absenceStrs": [
	24496	+	"<title>Start a Blog"
24491	24497		],
24492		-	"engine": "engine404get",
	24498	+	"presenseStrs": [
	24499	+	"– Thoughts.com</title>"
	24500	+	],
24493	24501		"urlMain": "http://thoughts.com",
24494		-	"url": "http://thoughts.com/profile/{username}",
	24502	+	"url": "http://thoughts.com/members/{username}",
24495	24503		"usernameUnclaimed": "noonewouldeverusethis7",
24496		-	"usernameClaimed": "red"
	24504	+	"usernameClaimed": "alicia12"
24497	24505		},
24498	24506		"hackernoon.com": {
24499	24507		"tags": [
24500		-	"in",
24501		-	"us"
	24508	+	"us",
	24509	+	"news"
24502	24510		],
24503		-	"engine": "engine404message",
	24511	+	"checkType": "message",
	24512	+	"absenceStrs": [
	24513	+	"<title>HackerNoon"
	24514	+	],
	24515	+	"presenseStrs": [
	24516	+	" \| HackerNoon</title>"
	24517	+	],
24504	24518		"urlMain": "https://hackernoon.com",
24505	24519		"url": "https://hackernoon.com/u/{username}",
24506		-	"usernameUnclaimed": "noonewouldeverusethis7",
	24520	+	"usernameUnclaimed": "noonewouldeverusethis71",
24507	24521		"usernameClaimed": "god"
24508	24522		},
24509	24523		"Intigriti": {
		skipped 3969 lines
28479	28493		},
28480	28494		"photoshop-kopona.com": {
28481	28495		"absenceStrs": [
28482		-	"<title>noonewouldeverusethis7 » \u0420\u0435\u0441\u0443\u0440\u0441\u044b \u0434\u043b\u044f \u0424\u043e\u0442\u043e\u0448\u043e\u043f\u0430</title>"
	28496	+	"<div id='dle-content'></div></div></main></div></div><footer class=\"footer\">"
28483	28497		],
28484	28498		"presenseStrs": [
28485		-	"offline",
28486	28499		"uspusertitle"
28487	28500		],
28488	28501		"url": "https://photoshop-kopona.com/ru/user/{username}/",
		skipped 156 lines
28645	28658		},
28646	28659		"coder.social": {
28647	28660		"absenceStrs": [
28648		-	"Not Found in Githubhelp"
	28661	+	"<title>Coder Social Home</title>"
28649	28662		],
28650	28663		"presenseStrs": [
28651	28664		"nofollow"
		skipped 461 lines

■ ■ ■ ■ ■ ■

sites.md

		skipped 1441 lines
1442	1442		1. ![](https://www.google.com/s2/favicons?domain=http://rodobozhie.ru) [rodobozhie.ru (http://rodobozhie.ru)](http://rodobozhie.ru): top 10M, ru
1443	1443		1. ![](https://www.google.com/s2/favicons?domain=http://satwarez.ru) [satwarez.ru (http://satwarez.ru)](http://satwarez.ru): top 10M
1444	1444		1. ![](https://www.google.com/s2/favicons?domain=http://nf-club.ru) [nf-club.ru (http://nf-club.ru)](http://nf-club.ru): top 10M
1445		-	1. ![](https://www.google.com/s2/favicons?domain=http://linuxmint.info) [linuxmint.info (http://linuxmint.info)](http://linuxmint.info): top 10M, ru
	1445	+	1. ![](https://www.google.com/s2/favicons?domain=http://linuxmint.info) [linuxmint.info (http://linuxmint.info)](http://linuxmint.info): top 10M, ru, search is disabled
1446	1446		1. ![](https://www.google.com/s2/favicons?domain=http://kiabongo.info) [kiabongo.info (http://kiabongo.info)](http://kiabongo.info): top 10M
1447	1447		1. ![](https://www.google.com/s2/favicons?domain=http://koshtoris.at.ua) [koshtoris.at.ua (http://koshtoris.at.ua)](http://koshtoris.at.ua): top 10M
1448	1448		1. ![](https://www.google.com/s2/favicons?domain=http://xn--90anbhklk.xn--p1ai) [xn--90anbhklk.xn--p1ai (http://xn--90anbhklk.xn--p1ai)](http://xn--90anbhklk.xn--p1ai): top 10M
		skipped 20 lines
1469	1469		1. ![](https://www.google.com/s2/favicons?domain=http://wolga24.at.ua) [wolga24.at.ua (http://wolga24.at.ua)](http://wolga24.at.ua): top 10M
1470	1470		1. ![](https://www.google.com/s2/favicons?domain=http://millerovo161.ru) [millerovo161.ru (http://millerovo161.ru)](http://millerovo161.ru): top 10M
1471	1471		1. ![](https://www.google.com/s2/favicons?domain=http://videomuzon.ucoz.ru) [videomuzon.ucoz.ru (http://videomuzon.ucoz.ru)](http://videomuzon.ucoz.ru): top 10M
1472		-	1. ![](https://www.google.com/s2/favicons?domain=https://community.autolenta.ru) [Autolenta (https://community.autolenta.ru)](https://community.autolenta.ru): top 10M, auto, forum, ru
	1472	+	1. ![](https://www.google.com/s2/favicons?domain=https://community.autolenta.ru) [Autolenta (https://community.autolenta.ru)](https://community.autolenta.ru): top 10M, auto, forum, ru, search is disabled
1473	1473		1. ![](https://www.google.com/s2/favicons?domain=http://amax-sb.ru) [amax-sb.ru (http://amax-sb.ru)](http://amax-sb.ru): top 10M
1474	1474		1. ![](https://www.google.com/s2/favicons?domain=http://angelgothics.ru) [Angelgothics (http://angelgothics.ru)](http://angelgothics.ru): top 10M, ru
1475	1475		1. ![](https://www.google.com/s2/favicons?domain=http://help-baby.org) [help-baby.org (http://help-baby.org)](http://help-baby.org): top 10M
		skipped 807 lines
2283	2283		1. ![](https://www.google.com/s2/favicons?domain=https://freelance.ru) [freelance.ru (https://freelance.ru)](https://freelance.ru): top 100M, ru
2284	2284		1. ![](https://www.google.com/s2/favicons?domain=https://freelansim.ru) [freelansim.ru (https://freelansim.ru)](https://freelansim.ru): top 100M
2285	2285		1. ![](https://www.google.com/s2/favicons?domain=http://fotolog.com) [fotolog.com (http://fotolog.com)](http://fotolog.com): top 100M, in
2286		-	1. ![](https://www.google.com/s2/favicons?domain=http://thoughts.com) [thoughts.com (http://thoughts.com)](http://thoughts.com): top 100M, in
2287		-	1. ![](https://www.google.com/s2/favicons?domain=https://hackernoon.com) [hackernoon.com (https://hackernoon.com)](https://hackernoon.com): top 100M, in, us
	2286	+	1. ![](https://www.google.com/s2/favicons?domain=http://thoughts.com) [thoughts.com (http://thoughts.com)](http://thoughts.com): top 100M, blog
	2287	+	1. ![](https://www.google.com/s2/favicons?domain=https://hackernoon.com) [hackernoon.com (https://hackernoon.com)](https://hackernoon.com): top 100M, news, us
2288	2288		1. ![](https://www.google.com/s2/favicons?domain=https://intigriti.com) [Intigriti (https://intigriti.com)](https://intigriti.com): top 100M, hacking, in
2289	2289		1. ![](https://www.google.com/s2/favicons?domain=https://yamaya.ru) [yamaya.ru (https://yamaya.ru)](https://yamaya.ru): top 100M, ru
2290	2290		1. ![](https://www.google.com/s2/favicons?domain=https://www.tinkoff.ru/invest/) [Tinkoff Invest (https://www.tinkoff.ru/invest/)](https://www.tinkoff.ru/invest/): top 100M, ru
		skipped 308 lines
2599	2599		1. ![](https://www.google.com/s2/favicons?domain=https://www.hozpitality.com) [hozpitality (https://www.hozpitality.com)](https://www.hozpitality.com): top 100M
2600	2600		1. ![](https://www.google.com/s2/favicons?domain=https://kazanlashkigalab.com) [kazanlashkigalab.com (https://kazanlashkigalab.com)](https://kazanlashkigalab.com): top 100M, kz
2601	2601
2602		-	Alexa.com rank data fetched at (2022-02-26 12:55:54.605333 UTC)
	2602	+	The list was updated at (2022-02-26 13:41:10.351473 UTC)
2603	2603		## Statistics
2604	2604
2605		-	Enabled/total sites: 2443/2595 = 94.14%
	2605	+	Enabled/total sites: 2441/2595 = 94.07%
2606	2606
2607		-	Incomplete checks: 525/1853 = 28.33% (false positive risks)
	2607	+	Incomplete checks: 523/1853 = 28.22% (false positive risks)
2608	2608
2609	2609		Top 20 profile URLs:
2610	2610		- (796) `{urlMain}/index/8-0-{username} (uCoz)`
		skipped 1 lines
2612	2612		- (221) `/{username}`
2613	2613		- (138) `/user/{username}`
2614	2614		- (134) `{urlMain}{urlSubpath}/member.php?username={username} (vBulletin)`
2615		-	- (97) `/profile/{username}`
	2615	+	- (96) `/profile/{username}`
2616	2616		- (87) `{urlMain}/u/{username}/summary (Discourse)`
2617	2617		- (74) `/users/{username}`
2618	2618		- (44) `{urlMain}{urlSubpath}/search.php?author={username} (phpBB/Search)`
		skipped 2 lines
2621	2621		- (36) `/@{username}`
2622	2622		- (28) `/u/{username}`
2623	2623		- (27) `{urlMain}{urlSubpath}/memberlist.php?username={username} (phpBB)`
2624		-	- (24) `/members/{username}`
	2624	+	- (25) `/members/{username}`
2625	2625		- (18) `/forum/members/?username={username}`
2626	2626		- (18) `/forum/search.php?keywords=&terms=all&author={username}`
2627	2627		- (17) `/search.php?keywords=&terms=all&author={username}`
		skipped 25 lines

■ ■ ■ ■ ■ ■

utils/update_site_data.py

		skipped 136 lines
137	137		site_file.write(f'1. {favicon} [{site}]({url_main}): top {valid_rank}{tags}{note}\n')
138	138		db.update_site(site)
139	139
140		-	site_file.write(f'\nAlexa.com rank data fetched at ({datetime.utcnow()} UTC)\n')
	140	+	site_file.write(f'\nThe list was updated at ({datetime.utcnow()} UTC)\n')
141	141		db.save_to_file(args.base_file)
142	142
143	143		statistics_text = db.get_db_stats(is_markdown=True)
		skipped 5 lines