crash.software
Projects
Pull Requests
Issues
Builds
snscrape
Code
Files
Commits
Branches
Tags
Pull Requests
Code Comments
Code Compare
Issues
List
Boards
Milestones
Builds
Statistics
Contributions
Source Lines
Child Projects
Projects
STRLCPY
snscrape
Commits
b6cc3180
🤬
Sign In
Force TwitterThreadScraper and TwitterListMembersScraper to fetch the old design
JustAnotherArchivist
committed
4 years ago
b6cc3180
1 parent
613395d1
Revision indexing in progress... (symbol navigation in revisions will be accurate after indexed)
Total 1 files
■ ■
■ ■
■ ■
snscrape/modules/twitter.py
skipped 246 lines
247
247
self._tweetID = tweetID
248
248
249
249
def get_items(self):
250
-
headers = {'User-Agent': f'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.{random.randint(1, 3500)}.{random.randint(1, 160)} Safari/537.36'}
250
+
headers = {'User-Agent': f'Opera/9.80 (Windows NT 6.1; WOW64) Presto/2.12.388 Version/12.18'}
251
251
252
252
# Fetch the page of the last tweet in the thread
253
253
r = self._get(f'https://twitter.com/user/status/{self._tweetID}', headers = headers)
skipped 71 lines
325
325
self._user, self._list = listName.split('/')
326
326
327
327
def get_items(self):
328
-
headers = {'User-Agent': f'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.{random.randint(1, 3500)}.{random.randint(1, 160)} Safari/537.36'}
328
+
headers = {'User-Agent': f'Opera/9.80 (Windows NT 6.1; WOW64) Presto/2.12.388 Version/12.18'}
329
329
330
330
baseUrl = f'https://twitter.com/{self._user}/lists/{self._list}/members'
331
331
r = self._get(baseUrl, headers = headers)
skipped 40 lines
All occurrences
Please wait...
Page is in error, reload to recover