Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 6 years ago.
Improve this question
I am kind of a rookie using Scrapy, just starting to use it.
I've just found myself stuck on a part because I can't seem to find anything online on it nor anything similar asked on stackoverflow!
I am basically reading a few lines from a .csv file and I wanna use the search function on this website 'http://collectorsfrenzy.com/'
How should I go around this?
First, try to identify the search endpoint used within the website (i.e. collectorsfrenzy.com/search?q={query} in this scenario). Once you figured that out, append your search term to that and use it as starting point for crawling and scrape the resulting content.
Related
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 4 years ago.
Improve this question
The API search only provides previous 100 tweets. Is there a way to get all the tweets? I want to write a code in Python using AFINN library. Is there a place where I can get the code?
Look at https://developer.twitter.com/en/docs/tweets/search/api-reference/get-search-tweets.html
You can write a recursive search method. If there is a "search_metadata.next_results" in the json, then get the "max_id" and use it for the next search.
So you can get a lot of tweets, but within the last 7 days with the public API.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 6 years ago.
Improve this question
I am quite fluent in Python, but have only really used it for data analysis.
I would like to learn how I can interact with webpages. For instance, I want to start by writing a code that will press a button on a webpage for me.
I just don't know where to start or what to google to find resources about this.
Could anyone point me out in the right directions, or suggest some key words that I could search for?
Thanks.
Have you tried to use the pyautogui module, which allows you to programmatically control the mouse and the keyboard?
An example of an automatic form filler on a webpage is available in chapter 18 of the Automate the Boring Stuff with Python book.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 6 years ago.
Improve this question
my school has given me the task of creating a tkinter program of a dictionary program. I could use the webbrowser module to open up a site with a definition, but I would prefer one that does not require internet. I just need it to be in a .txt file (for example), then when I enter a word it could convert it to a string then search the .txt for that word followed by the definition.
Anyone have a way to do this?
I need a dictionary to use, and I cannot find one at the moment.
You can use this link to download the mysql database
Link - Mysql Engilsh Dictionary
You can use this with python. It has around 176023 words and their definitions.
Source : https://sourceforge.net/projects/mysqlenglishdictionary/
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 7 years ago.
Improve this question
I am teaching art students the basics of Python and it would be very convenient to add some graphics (drawings, pictures, etc.) in the comments within the code instead of "just" code and text comments.
I have seen some friends using Mathematica and exchanging beautiful files that include graphics, comments, pictures, etc.
Does such a thing exists for Python?
Have you looked at the iPython-Notebook? It allows you to write/run code and use html for notes. If you know html it will be easy to add graphics in too. Not sure if that exactly answers your problem, but it is definitely a nice tool
Link: http://ipython.org/notebook.html
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 5 years ago.
Improve this question
I am using Python to do automated tests for IE. Currently I use PAMIE. It can click links and find words very well if a web page has no iframes. However, some of my tested pages include several iframes, and PAMIE seems can't handle it correctly. It can't find the text strings in the iframes.
Does anyone recommend some Python libraries instead of PAMIE? Or is there a way to access iframes in a web page with PAMIE？ It's better if there is an example.
Thanks!
Use Selenium with it's Python client binding. Selenium can let you record your own workflow or write your own script in one of its supported languages. The tests are conducted on an actual browser as opposed to a simulated one. There's no system can top it at the moment.