I'm accessing Twitter's API v2 and have Academic Research access.
I am interested in pulling as much data as possible, but am getting rate limited.
I am using tweepy in Python to extract the data, and the call "search_all_tweets"
I am looping the extraction for each day and limiting tweets extracted per day. By using time.sleep() I can modify how many tweets I can extract per 15 minutes.
Twitter has published this to answer my question, however I am still in doubt which category and thereby limit I am under:
https://developer.twitter.com/en/docs/twitter-api/rate-limits#v2-limits
Can anybody help to clarify how many tweets I can extract per 15 minutes before getting rate limited?
Thanks in advance
Go to the Twitter developper portal, select your app in your project and, at the bottom of the Settings tab, check if you have activated the Read and Write permissions in the OAuth 1.0a authentication. If not, activate them and regenerate your tokens.
Related
This question has nothing to do with technical help, however i need to understand what is a search query under google custom search api. If I am not mistaken, a search query is what i query in google search box isn't it ?.
If so, under google custom search api, it was said, that i can make 100 queries a day. Keeping that in mind, i was being cautious in making queries and the total queries were 54.
After 54 queries, i received the below error. The error says This API requires billing to be enabled on the project. Visit https://console.developers.google.com/billing?project=236852110619 to enable billing. Why is it so ?
Does that mean after billing, can i utilize 46 queries that belong to free quota ?
Quota for this API seems to be pro-rated if you start in the middle of a day. Are you able to get the full 100 queries the next day?
I need a program for retrieving the list of transactions on my PayPal account. I tried some Python scripts, e.g. using the requests module for simply logging into PayPal with GET/POST and downloading the HTML from https://www.paypal.com/activities (shows newest transactions), but unfortunately PayPal prevents web scraping (captcha), so I didn't find a solution. There is a "TransactionSearch" API (https://api.paypal.com/v1/reporting/transactions), but the transactions show up with a delay of at least 3 hours (up to 48h) there... Is there a possibility to get a live version (as shown on their website) of my PayPal transactions using the PayPal API?
Unfortunately according to their documentation there isn't a way to get 'live' transactions: https://developer.paypal.com/docs/api/sync/v1/
However it does say up to 3 hours so you may be able to retrieve transactions sooner.
They don't state a reason for why it takes up to 3 hours for executed transactions to appear in the callable request list, however I'd assume PayPal perform security checks before even processing a transaction, let alone making the transaction accessible through an open API.
I am trying to build a script that will take a Twitter handle and calculate its engagement rate based on the last 10 tweets or so. If I understand Twitter's API correctly I would have to make a q request for each calculation. If I understand Twitter's pricing correctly, I would be paying between $0.75 and $1 per request depending on my package. That seems very expensive for me to build such a simple tool. Am I missing something, is there a cheaper way of doing it?
I need to build an app which will download hundreds of images, or get the URL of hundreds of images in each request. Based on search by hashtags.
My problem is, there's no info on what the limit is for images on the Instagram developer site. Any other info I could find is at least 3 years old. I could test it and see for myself, but this wonderful API needs to be in production mode before I can test it.
Does anyone know what the current limit is?
Also if you know of a third party API which can bypass the limit, please let me know what it is.
Instagram API Documentation for Rate Limits:
All rate limits on the Instagram Platform are controlled separately for each access token and on a sliding 1-hour window. Live apps have higher rate limits than apps in Sandbox Mode.
Does anyone know what the current limit is?
The rate limit is 500/hour if you're using Sandbox and 5000/hour if you go Live.
From documentation:
Global rate limits are applied inclusive of all API calls made by an app per access token over the 1-hour sliding window, regardless of the particular endpoint. Rate limits also apply to invalid or malformed requests.
You can check how many request calls are remaining by checking API response header:
Note: AFAIK, This method works only for GET requests; POST requests do not return accurate x-ratelimit-remaining values.
# It's inexplicably omitted from the current documentation.
x-ratelimit-limit:5000
x-ratelimit-remaining:4898
I hope this will help you.
Without having a twitter-account I can search tweets, e.g. with the URL https://twitter.com/search?q=stackoverflow or https://twitter.com/StackOverflow or https://twitter.com/hashtag/stackoverflow.
To access twitter using Python, there are several API wrappers, maybe the most famous ones being tweepy and twitter.
It does not seem to be possible to access tweets without authentication.
How can I access tweets from Python without logging in to twitter?
ps. I know that I can download the page and parse the html, but this looks like a last resort rather than an elegant solution.
From the docs
Authentication on all endpoints
We require applications to
authenticate all of their requests with OAuth 1.0a or Application-only
authentication. This visibility allows us to prevent abusive behavior,
and it also helps us to further understand how categories of
applications are using the API. We apply this understanding to better
meet the needs of developers as we continue to evolve the platform.
They need to apply rate limiting (and may be other security precautions) to minimize abuse, so, they do not allow public access to APIs.
Searching tweets using Twitter's website is manual. So there are less chances of abuse. Moreover, even if you try to parse it from web, most probably they will ban your IP address as soon as you start sending more requests than they think are not abusive.
Why not to create an account? Keep in mind different circumstances.
accounts are occassionally very hard to create. For instance, it has been reported that Twitter doesn't support phone numbers from certain locations. What would you do if you cannot authenticate with your personal mobile?
account features are heavily limited. For instance, under the standard dev account you will not retrieve past data for your educational project (e.g. a sentiment analysis of celebrities tweets).
accounts will not be free Twitter has just decided to discontinue supporting free accounts