Develop Reference

Issues getting nginx to serve my flask app

The bounty expires in 4 days. Answers to this question are eligible for a +350 reputation bounty.
dms_quant wants to draw more attention to this question.
I have a flask app that I would like to serve via a DO Droplet.
I have followed How To Serve Flask Applications with Gunicorn and Nginx on Ubuntu 22.04
This is my folder structure
root/
└── baseweb/
├── venv
├── app.py
└── app/
├── routes.py
└── templates/
└── index.html
app.py looks like this
from app import app
if __name__ == "__main__":
app.run(host='0.0.0.0', debug=True)
I have created a baseweb service
[Unit]
Description=Gunicorn instance to serve myproject
After=network.target
[Service]
User=root
Group=www-data
WorkingDirectory=/root/baseweb
Environment="PATH=/root/baseweb/venv/bin"
ExecStart=/root/baseweb/venv/bin/gunicorn --workers 1 --bind unix:baseweb.sock app:app
[Install]
WantedBy=multi-user.target
and my nginx configuration (/etc/nginx/sites-available/baseweb) - edited per arthur simas comment below
server {
listen 80;
server_name baserank.net www.baserank.net;
location / {
proxy_pass http://unix:/root/baseweb/baseweb.sock;
}
}
When i simply run app.py using my venv, i can access my flask app via http://68.183.68.148:5000/
if I run gunicorn --bind 0.0.0.0:5000 app:app i can also access my app via the same IP.
But when i try to access via nginx (via http://68.183.68.148 without running the app in console), i get
502 Bad Gateway
nginx/1.22.0 (Ubuntu)
I have spent hours trying to adjust settings, but i have no idea where this is going wrong - so any help is very much appreciated.
Edit 2023-02-17: Ngnix access.log
185.16.141.5 - - [17/Feb/2023:14:14:17 +0000] "GET / HTTP/1.1" 502 568 "http://baserank.net/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
185.16.141.5 - - [17/Feb/2023:14:14:17 +0000] "GET / HTTP/1.1" 502 568 "http://baserank.net/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
185.16.141.5 - - [17/Feb/2023:14:14:20 +0000] "GET / HTTP/1.1" 502 568 "http://baserank.net/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
185.16.141.5 - - [17/Feb/2023:14:14:20 +0000] "GET / HTTP/1.1" 502 568 "http://baserank.net/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
143.110.222.166 - - [17/Feb/2023:14:22:21 +0000] "GET / HTTP/1.1" 502 166 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 16_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.1 Mobile/15E148 Safari/604.1"

your ngnix config is wrong. you don't use root directive for reverse proxying with nginx, but instead proxy_pass. the tutorial you've posted is right. the changes you should do:
server {
listen 80;
server_name your_domain www.your_domain; # place here your website domain (optional directive)
location / {
proxy_pass http://unix:/root/baseweb/baseweb.sock;
}
}
listen tells were the nginx server should listen to requests. it could be only the port (80), ip:port (68.183.68.148:80), an unix socket (unix:/var/run/nginx.sock), etc...
the proxy_pass directive acts as a reverse proxy, forwarding traffic to the provided URL.
root is for serving static files.
read more at:
NGINX Module ngx_http_core_module - listen
NGINX Reverse Proxy
NGINX Module ngx_http_proxy_module - proxy_pass
Serving Static Content
also, be sure to create the service in systemd, at the correct path location and check if its running sudo systemctl status myproject (or nginx would not be able to forward traffic to it)

One potential issue could be with the ownership and permission of the socket file /root/baseweb/baseweb.sock. Make sure the user running the Gunicorn service (in your case, root) has ownership of the file, and the permissions are set correctly. You can try changing the group to root in the baseweb.service file:
[Service]
User=root
Group=root
WorkingDirectory=/root/baseweb
Environment="PATH=/root/baseweb/venv/bin"
ExecStart=/root/baseweb/venv/bin/gunicorn --workers 1 --bind unix:baseweb.sock app:app
After modifying the service file, make sure to reload the daemon and restart the service:
sudo systemctl daemon-reload
sudo systemctl restart baseweb
You can also check the error log of Gunicorn by adding --log-level debug --error-logfile /path/to/error.log to the Gunicorn command in the baseweb.service file. Then, check the content of /path/to/error.log for more details about the error.
Another thing to try is to update the Nginx configuration to proxy pass to http://127.0.0.1:5000 instead of the socket file. You can try modifying the configuration file as follows:
server {
listen 80;
server_name baserank.net www.baserank.net;
location / {
proxy_pass http://127.0.0.1:5000;
proxy_set_header Host $host;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
}
}
After modifying the configuration file, restart the Nginx service:
sudo systemctl restart nginx

Static files not loading using nginx and docker

I'm having approximately the same error as in this question, as concerning Django, all my pages are loaded correctly but not my static files. I guess it has something to do with an error in my configuration files, however even though I've been searching for quite some time, I couldn't find anything to solve my problem.
Here is my Django Dockerfile :
FROM python:3.10.5-alpine
RUN pip install --upgrade pip
RUN wget https://upload.wikimedia.org/wikipedia/commons/b/b9/First-google-logo.gif -O media/media.gif
COPY ./requirements.txt .
RUN pip install -r requirements.txt
COPY ./src /app
WORKDIR /app
COPY ./entrypoint.sh /
ENTRYPOINT ["sh", "/entrypoint.sh"]
nginx.conf
upstream django {
server django_gunicorn:8000;
}
server {
listen 80;
server_name 127.0.0.1;
location / {
proxy_pass http://django;
}
location /static/ {
alias /static/;
}
location /media/ {
alias /media/;
}
}
nginx Dockerfile
FROM nginx:1.19.0-alpine
COPY ./nginx.conf /etc/nginx/conf.d/nginx.conf
docker-compose.yml
version: '3.7'
services:
django_gunicorn:
volumes:
- static:/static
- media:/media
env_file:
- env
build:
context: .
ports:
- "8000:8000"
nginx:
build: ./nginx
volumes:
- static:/static
- media:/media
ports:
- "80:80"
depends_on:
- django_gunicorn
volumes:
static:
media:
And I get errors like that :
testapp-django_gunicorn-1 |
testapp-django_gunicorn-1 | 9771 static files copied to '/app/static'.
testapp-django_gunicorn-1 | [2022-07-21 12:27:36 +0000] [9] [INFO] Starting gunicorn 20.1.0
testapp-django_gunicorn-1 | [2022-07-21 12:27:36 +0000] [9] [INFO] Listening at: http://0.0.0.0:8000 (9)
testapp-django_gunicorn-1 | [2022-07-21 12:27:36 +0000] [9] [INFO] Using worker: sync
testapp-django_gunicorn-1 | [2022-07-21 12:27:36 +0000] [10] [INFO] Booting worker with pid: 10
testapp-nginx-1 | 172.20.0.1 - - [21/Jul/2022:12:30:45 +0000] "GET /scripts/ HTTP/1.1" 200 17460 "http://127.0.0.1/scripts/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "-"
testapp-nginx-1 | 172.20.0.1 - - [21/Jul/2022:12:30:45 +0000] "GET /static/scripts/bootstrap/css/bootstrap.css HTTP/1.1" 404 555 "http://127.0.0.1/scripts/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "-"
testapp-nginx-1 | 2022/07/21 12:30:45 [error] 30#30: *1 open() "/static/scripts/bootstrap/css/bootstrap.css" failed (2: No such file or directory), client: 172.20.0.1, server: 127.0.0.1, request: "GET /static/scripts/bootstrap/css/bootstrap.css HTTP/1.1", host: "127.0.0.1", referrer: "http://127.0.0.1/scripts/"
EDIT : entrypoint.sh
#!/bin/sh
python manage.py migrate
python manage.py collectstatic
gunicorn main.wsgi:application --bind 0.0.0.0:8000

Your nginx container is looking for static in /static/ but the logs show you're collecting static in /app/static/ in the gunicorn container. In docker-compose, did you try - static:/app/static on the gunicorn side and - static:/static on the nginx side?

Access Denied while scraping seekingAlpha transcript with beautifulSoup

I am trying to scrape earning calls transcript using beautifulSoup. I was able to extract first time but later it is giving me access denied error. I have tried randomizing the user agents but it is not working
**Code to randomize user agents **
import random
user_agent_list = [
#Chrome
'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.113 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.90 Safari/537.36',
'Mozilla/5.0 (Windows NT 5.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.90 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.90 Safari/537.36',
'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.113 Safari/537.36',
'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36',
'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36',
#Firefox
'Mozilla/4.0 (compatible; MSIE 9.0; Windows NT 6.1)',
'Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko',
'Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)',
'Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko',
'Mozilla/5.0 (Windows NT 6.2; WOW64; Trident/7.0; rv:11.0) like Gecko',
'Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko',
'Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.0; Trident/5.0)',
'Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko',
'Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0)',
'Mozilla/5.0 (Windows NT 6.1; Win64; x64; Trident/7.0; rv:11.0) like Gecko',
'Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; WOW64; Trident/6.0)',
'Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; Trident/6.0)',
'Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)'
]
user_agent = random.choice(user_agent_list)
Code used to extract transcript
from bs4 import BeautifulSoup
import requests
import re
parse_site = 'https://seekingalpha.com/article/4333315-swiss-re-ag-ssref-2019-annual-report-conference-call-transcript?part=single'
html_content = requests.get(parse_site, headers={'User-Agent': user_agent}).text
print (BeautifulSoup(html_content, 'lxml'))
Error: Access to this page has been denied.

AWS/EB - getting hit with internal dummy connection

I've just deployed a simple django app to Elastic Beanstalk. The landing page(which has a login form) loads without issue.
When I submit the login form nothing happens, I just see Waiting for awsapp.sdfkjldsf.elasticbeanstalk.com which eventually times out.
When I look at the error logs I see the following repeated over and over
::1 (-) - - [28/Mar/2016:14:22:50 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
Being new to Django/AWS/EB I'm not sure how to debug this.
I've attached the logs below:
Retrieving logs...
============= i-e9245931 ==============
-------------------------------------
/var/log/eb-version-deployment.log
-------------------------------------
2016-03-28 14:11:31,444 [INFO] Found the latest version manifest file <Key: elasticbeanstalk-us-west-2-226428845556,resources/environments/e-te3pnfnm7y/_runtime/versions/manifest_1459174126708> from bucket elasticbeanstalk-us-west-2-226428845556 and prefix resources/environments/e-te3pnfnm7y/_runtime/versions/
2016-03-28 14:11:31,496 [INFO] Downloaded the manifest file to /tmp/version_file_manifest
2016-03-28 14:11:31,592 [INFO] Downloaded version label app-160328_070839 from s3 key <Key: elasticbeanstalk-us-west-2-226428845556,resources/environments/e-te3pnfnm7y/_runtime/_versions/MY_APP/app-160328_070839>
2016-03-28 14:17:05,827 [INFO] Version manifest file name already known. The latest version manifest file key is resources/environments/e-te3pnfnm7y/_runtime/versions/manifest_1459174584476
2016-03-28 14:17:05,881 [INFO] Downloaded the manifest file to /tmp/version_file_manifest
2016-03-28 14:17:05,951 [INFO] Downloaded version label app-160328_071617 from s3 key <Key: elasticbeanstalk-us-west-2-226428845556,resources/environments/e-te3pnfnm7y/_runtime/_versions/MY_APP/app-160328_071617>
2016-03-28 14:24:03,188 [INFO] Version manifest file name already known. The latest version manifest file key is resources/environments/e-te3pnfnm7y/_runtime/versions/manifest_1459175039089
2016-03-28 14:24:03,243 [INFO] Downloaded the manifest file to /tmp/version_file_manifest
2016-03-28 14:24:03,319 [INFO] Downloaded version label app-160328_072353 from s3 key <Key: elasticbeanstalk-us-west-2-226428845556,resources/environments/e-te3pnfnm7y/_runtime/_versions/MY_APP/app-160328_072353>
-------------------------------------
/opt/python/log/supervisord.log
-------------------------------------
2016-03-28 14:11:37,813 CRIT Supervisor running as root (no user in config file)
2016-03-28 14:11:37,829 INFO RPC interface 'supervisor' initialized
2016-03-28 14:11:37,829 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2016-03-28 14:11:37,829 INFO supervisord started with pid 2625
2016-03-28 14:11:38,831 INFO spawned: 'httpd' with pid 2708
2016-03-28 14:11:40,565 INFO success: httpd entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2016-03-28 14:17:11,556 INFO stopped: httpd (exit status 0)
2016-03-28 14:17:12,560 INFO spawned: 'httpd' with pid 3238
2016-03-28 14:17:13,594 INFO success: httpd entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2016-03-28 14:24:11,683 INFO stopped: httpd (exit status 0)
2016-03-28 14:24:12,688 INFO spawned: 'httpd' with pid 3630
2016-03-28 14:24:13,732 INFO success: httpd entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
-------------------------------------
/var/log/httpd/error_log
-------------------------------------
[Mon Mar 28 14:24:08.666295 2016] [mpm_prefork:notice] [pid 3238] AH00169: caught SIGTERM, shutting down
[Mon Mar 28 14:24:12.732219 2016] [suexec:notice] [pid 3630] AH01232: suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Mon Mar 28 14:24:12.741309 2016] [so:warn] [pid 3630] AH01574: module wsgi_module is already loaded, skipping
[Mon Mar 28 14:24:12.743477 2016] [auth_digest:notice] [pid 3630] AH01757: generating secret for digest authentication ...
[Mon Mar 28 14:24:12.744008 2016] [lbmethod_heartbeat:notice] [pid 3630] AH02282: No slotmem from mod_heartmonitor
[Mon Mar 28 14:24:12.744042 2016] [:warn] [pid 3630] mod_wsgi: Compiled for Python/2.7.9.
[Mon Mar 28 14:24:12.744045 2016] [:warn] [pid 3630] mod_wsgi: Runtime using Python/2.7.10.
[Mon Mar 28 14:24:12.745762 2016] [mpm_prefork:notice] [pid 3630] AH00163: Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 configured -- resuming normal operations
[Mon Mar 28 14:24:12.745775 2016] [core:notice] [pid 3630] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'
-------------------------------------
/var/log/httpd/access_log
-------------------------------------
172.31.40.173 (75.164.143.24) - - [28/Mar/2016:14:29:01 +0000] "GET /static/sub_app/css/bootstrap.min.css HTTP/1.1" 200 122541 "http://MY_APP.menmjmyimv.us-west-2.elasticbeanstalk.com/login?next=/verify" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.40.173 (75.164.143.24) - - [28/Mar/2016:14:29:01 +0000] "GET /static/sub_app/css/bootstrap-theme.min.css HTTP/1.1" 200 23358 "http://MY_APP.menmjmyimv.us-west-2.elasticbeanstalk.com/login?next=/verify" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.40.173 (75.164.143.24) - - [28/Mar/2016:14:29:01 +0000] "GET /static/sub_app/css/MY_APP.css HTTP/1.1" 200 2385 "http://MY_APP.menmjmyimv.us-west-2.elasticbeanstalk.com/login?next=/verify" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.40.173 (75.164.143.24) - - [28/Mar/2016:14:29:01 +0000] "GET /static/sub_app/js/jquery-2.1.4.js HTTP/1.1" 200 247598 "http://MY_APP.menmjmyimv.us-west-2.elasticbeanstalk.com/login?next=/verify" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.40.173 (75.164.143.24) - - [28/Mar/2016:14:29:01 +0000] "GET /static/sub_app/js/bootstrap.min.js HTTP/1.1" 200 36817 "http://MY_APP.menmjmyimv.us-west-2.elasticbeanstalk.com/login?next=/verify" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.40.173 (75.164.143.24) - - [28/Mar/2016:14:29:01 +0000] "GET /static/sub_app/js/MY_APP.js HTTP/1.1" 200 999 "http://MY_APP.menmjmyimv.us-west-2.elasticbeanstalk.com/login?next=/verify" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
::1 (-) - - [28/Mar/2016:14:29:11 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:12 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:13 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:14 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:15 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:16 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:17 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:18 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:19 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:20 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:21 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:29:27 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:30:15 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:30:20 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:31:04 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
172.31.23.38 (75.164.143.24) - - [28/Mar/2016:14:35:09 +0000] "GET / HTTP/1.1" 302 - "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.23.38 (75.164.143.24) - - [28/Mar/2016:14:35:09 +0000] "GET /login?next=/ HTTP/1.1" 200 1694 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.23.38 (75.164.143.24) - - [28/Mar/2016:14:35:15 +0000] "GET / HTTP/1.1" 302 - "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.23.38 (75.164.143.24) - - [28/Mar/2016:14:35:15 +0000] "GET /login?next=/ HTTP/1.1" 200 1694 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
::1 (-) - - [28/Mar/2016:14:36:09 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:36:14 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:36:16 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:36:17 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:36:18 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:36:19 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:36:21 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
172.31.23.38 (75.164.143.24) - - [28/Mar/2016:14:36:25 +0000] "GET /verify HTTP/1.1" 302 - "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
172.31.23.38 (75.164.143.24) - - [28/Mar/2016:14:36:25 +0000] "GET /login?next=/verify HTTP/1.1" 200 1694 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36"
::1 (-) - - [28/Mar/2016:14:37:25 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:37:30 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:37:34 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
::1 (-) - - [28/Mar/2016:14:38:03 +0000] "OPTIONS * HTTP/1.0" 200 - "-" "Apache/2.4.16 (Amazon) mod_wsgi/3.5 Python/2.7.10 (internal dummy connection)"
-------------------------------------
/var/log/eb-activity.log
-------------------------------------
Copying '/opt/python/run/venv/local/lib/python2.7/site-packages/django/contrib/admin/static/admin/img/selector-icons.svg'
Copying '/opt/python/run/venv/local/lib/python2.7/site-packages/django/contrib/admin/static/admin/img/calendar-icons.svg'
Copying '/opt/python/run/venv/local/lib/python2.7/site-packages/django/contrib/admin/static/admin/img/icon-yes.svg'
Copying '/opt/python/run/venv/local/lib/python2.7/site-packages/django/contrib/admin/static/admin/img/LICENSE'
Copying '/opt/python/run/venv/local/lib/python2.7/site-packages/django/contrib/admin/static/admin/img/icon-addlink.svg'
Copying '/opt/python/run/venv/local/lib/python2.7/site-packages/django/contrib/admin/static/admin/img/gis/move_vertex_on.svg'
Copying '/opt/python/run/venv/local/lib/python2.7/site-packages/django/contrib/admin/static/admin/img/gis/move_vertex_off.svg'
63 static files copied to '/opt/python/bundle/3/sub_app/static'.
[2016-03-28T14:35:56.967Z] INFO [3918] - [CMD-TailLogs - stage ] : Starting activity...
[2016-03-28T14:35:57.218Z] INFO [3918] - [CMD-TailLogs - stage /AddonsBefore] : Starting activity...
[2016-03-28T14:35:57.218Z] INFO [3918] - [CMD-TailLogs - stage /AddonsBefore] : Completed activity.
[2016-03-28T14:35:57.219Z] INFO [3918] - [CMD-TailLogs - stage /TailLogs] : Starting activity...
[2016-03-28T14:35:57.219Z] INFO [3918] - [CMD-TailLogs - stage /TailLogs/TailLogs] : Starting activity...
[2016-03-28T14:35:57.440Z] INFO [3918] - [CMD-TailLogs - stage /TailLogs/TailLogs] : Completed activity.
[2016-03-28T14:35:57.440Z] INFO [3918] - [CMD-TailLogs - stage /TailLogs] : Completed activity. Result:
CMD-TailLogs - stage 0 - Command CMD-TailLogs stage 0 completed
[2016-03-28T14:35:57.440Z] INFO [3918] - [CMD-TailLogs - stage /AddonsAfter] : Starting activity...
[2016-03-28T14:35:57.440Z] INFO [3918] - [CMD-TailLogs - stage /AddonsAfter] : Completed activity.
[2016-03-28T14:35:57.441Z] INFO [3918] - [CMD-TailLogs - stage ] : Completed activity. Result:
CMD-TailLogs - stage - Command CMD-TailLogs succeeded
[2016-03-28T14:38:26.135Z] INFO [3972] - [CMD-TailLogs - stage ] : Starting activity...
[2016-03-28T14:38:26.382Z] INFO [3972] - [CMD-TailLogs - stage /AddonsBefore] : Starting activity...
[2016-03-28T14:38:26.382Z] INFO [3972] - [CMD-TailLogs - stage /AddonsBefore] : Completed activity.
[2016-03-28T14:38:26.382Z] INFO [3972] - [CMD-TailLogs - stage /TailLogs] : Starting activity...
[2016-03-28T14:38:26.382Z] INFO [3972] - [CMD-TailLogs - stage /TailLogs/TailLogs] : Starting activity...
-------------------------------------
/var/log/eb-commandprocessor.log
-------------------------------------
[2016-03-28T14:35:56.965Z] DEBUG [3918] : Reading config file: /etc/elasticbeanstalk/.aws-eb-stack.properties
[2016-03-28T14:35:56.965Z] DEBUG [3918] : Checking if the command processor should execute...
[2016-03-28T14:35:56.967Z] DEBUG [3918] : Checking whether the command is applicable to instance (i-e9245931)..
[2016-03-28T14:35:56.967Z] INFO [3918] : Command is applicable to this instance (i-e9245931)..
[2016-03-28T14:35:56.967Z] DEBUG [3918] : Checking if the received command stage is valid..
[2016-03-28T14:35:56.967Z] INFO [3918] : No stage_num in command. Valid stage..
[2016-03-28T14:35:56.967Z] INFO [3918] : Received command CMD-TailLogs:
[2016-03-28T14:35:56.967Z] INFO [3918] : Command processor should execute command.
[2016-03-28T14:35:56.967Z] DEBUG [3918] : Storing current stage..
[2016-03-28T14:35:56.967Z] DEBUG [3918] : Stage_num does not exist. Not saving null stage. Returning..
[2016-03-28T14:35:56.967Z] INFO [3918] : Executing CMD-TailLogs - stage
[2016-03-28T14:35:56.967Z] INFO [3918] : Executing command: CMD-TailLogs...
[2016-03-28T14:35:56.967Z] DEBUG [3918] : Reading config file: /etc/elasticbeanstalk/.aws-eb-stack.properties
[2016-03-28T14:35:56.968Z] DEBUG [3918] : Refreshing metadata..
[2016-03-28T14:35:57.216Z] DEBUG [3918] : Refreshed environment metadata.
[2016-03-28T14:35:57.216Z] DEBUG [3918] : Retrieving metadata for key: AWS::ElasticBeanstalk::Ext||_ContainerConfigFileContent||commands..
[2016-03-28T14:35:57.217Z] DEBUG [3918] : Retrieving metadata for key: AWS::ElasticBeanstalk::Ext||_API||_Commands..
[2016-03-28T14:35:57.217Z] INFO [3918] : Found enabled addons: ["logpublish"].
[2016-03-28T14:35:57.218Z] INFO [3918] : Updating Command definition of addon logpublish.
[2016-03-28T14:35:57.218Z] DEBUG [3918] : Loaded definition of Command CMD-TailLogs.
[2016-03-28T14:35:57.218Z] INFO [3918] : Executing command CMD-TailLogs activities...
[2016-03-28T14:35:57.218Z] DEBUG [3918] : Setting environment variables..
[2016-03-28T14:35:57.218Z] INFO [3918] : Running AddonsBefore for command CMD-TailLogs...
[2016-03-28T14:35:57.219Z] DEBUG [3918] : Running stages of Command CMD-TailLogs from stage 0 to stage 0...
[2016-03-28T14:35:57.219Z] INFO [3918] : Running stage 0 of command CMD-TailLogs...
[2016-03-28T14:35:57.219Z] DEBUG [3918] : Loaded 1 actions for stage 0.
[2016-03-28T14:35:57.219Z] INFO [3918] : Running 1 of 1 actions: TailLogs...
[2016-03-28T14:35:57.440Z] INFO [3918] : Running AddonsAfter for command CMD-TailLogs...
[2016-03-28T14:35:57.440Z] INFO [3918] : Command CMD-TailLogs succeeded!
[2016-03-28T14:35:57.441Z] INFO [3918] : Command processor returning results:
{"status":"SUCCESS","api_version":"1.0","results":[{"status":"SUCCESS","msg":"","returncode":0,"events":[{"msg":"[Instance: i-e9245931] Successfully finished tailing 6 log(s)","severity":"INFO","timestamp":1459175757441}]}]}
[2016-03-28T14:38:26.133Z] DEBUG [3972] : Reading config file: /etc/elasticbeanstalk/.aws-eb-stack.properties
[2016-03-28T14:38:26.133Z] DEBUG [3972] : Checking if the command processor should execute...
[2016-03-28T14:38:26.135Z] DEBUG [3972] : Checking whether the command is applicable to instance (i-e9245931)..
[2016-03-28T14:38:26.135Z] INFO [3972] : Command is applicable to this instance (i-e9245931)..
[2016-03-28T14:38:26.135Z] DEBUG [3972] : Checking if the received command stage is valid..
[2016-03-28T14:38:26.135Z] INFO [3972] : No stage_num in command. Valid stage..
[2016-03-28T14:38:26.135Z] INFO [3972] : Received command CMD-TailLogs:
[2016-03-28T14:38:26.135Z] INFO [3972] : Command processor should execute command.
[2016-03-28T14:38:26.135Z] DEBUG [3972] : Storing current stage..
[2016-03-28T14:38:26.135Z] DEBUG [3972] : Stage_num does not exist. Not saving null stage. Returning..
[2016-03-28T14:38:26.135Z] INFO [3972] : Executing CMD-TailLogs - stage
[2016-03-28T14:38:26.135Z] INFO [3972] : Executing command: CMD-TailLogs...
[2016-03-28T14:38:26.135Z] DEBUG [3972] : Reading config file: /etc/elasticbeanstalk/.aws-eb-stack.properties
[2016-03-28T14:38:26.135Z] DEBUG [3972] : Refreshing metadata..
[2016-03-28T14:38:26.380Z] DEBUG [3972] : Refreshed environment metadata.
[2016-03-28T14:38:26.380Z] DEBUG [3972] : Retrieving metadata for key: AWS::ElasticBeanstalk::Ext||_ContainerConfigFileContent||commands..
[2016-03-28T14:38:26.380Z] DEBUG [3972] : Retrieving metadata for key: AWS::ElasticBeanstalk::Ext||_API||_Commands..
[2016-03-28T14:38:26.381Z] INFO [3972] : Found enabled addons: ["logpublish"].
[2016-03-28T14:38:26.382Z] INFO [3972] : Updating Command definition of addon logpublish.
[2016-03-28T14:38:26.382Z] DEBUG [3972] : Loaded definition of Command CMD-TailLogs.
[2016-03-28T14:38:26.382Z] INFO [3972] : Executing command CMD-TailLogs activities...
[2016-03-28T14:38:26.382Z] DEBUG [3972] : Setting environment variables..
[2016-03-28T14:38:26.382Z] INFO [3972] : Running AddonsBefore for command CMD-TailLogs...
[2016-03-28T14:38:26.382Z] DEBUG [3972] : Running stages of Command CMD-TailLogs from stage 0 to stage 0...
[2016-03-28T14:38:26.382Z] INFO [3972] : Running stage 0 of command CMD-TailLogs...
[2016-03-28T14:38:26.382Z] DEBUG [3972] : Loaded 1 actions for stage 0.
[2016-03-28T14:38:26.382Z] INFO [3972] : Running 1 of 1 actions: TailLogs...

I found the answer. It ended up that my app didn't have access to the database.

flask app won't run on ubuntu 12.04 (digital ocean)

I am having difficulties deploying a basic flask app on a digital ocean server running ubuntu 12.04, apache2, and mod-wsgi. I have tried a number of different modifications of both the myapp.conf file and the myapp.wsgi file. I suspected that these were the culprits, but now I'm not so sure.
At all times, visiting my url just displays the apache 'It works' dialogue. Each attempt made to successfully restart the apache service (after trying to fix the problem), and access the website sees this same activity in the error.log:
[Wed Aug 27 00:49:14 2014] [notice] caught SIGTERM, shutting down
[Wed Aug 27 00:49:15 2014] [notice] Apache/2.2.22 (Ubuntu) mod_wsgi/3.3 Python/2.7.3 configured -- resuming normal operations
And this activity in the access.log:
11.22.33.44 - - [27/Aug/2014:00:49:19 -0400] "GET / HTTP/1.1" 304 209 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
11.22.33.44 - - [27/Aug/2014:00:49:21 -0400] "GET / HTTP/1.1" 304 208 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
11.22.33.44 - - [27/Aug/2014:00:49:24 -0400] "GET / HTTP/1.1" 304 208 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
By 'basic' flask app, I mean: no sql database (as in none, not as in non-relational), no site users, no factory, no blueprint, etc.
The relevant directory /var/www/myapp/ looks like this (using virtualenv to run the app):
myapp/
+ myapp/
| + static/
| + templates/
| + venv/
| | __init__.py
| myapp.wsgi
Although I have tried several versions of the myapp.conf file, these two are representative:
<VirtualHost *:80>
ServerName myapp.com
WSGIDaemonProcess myapp user=flask group=www-data home=/var/www/myapp/
WSGIScriptAlias / /var/www/myapp/myapp.wsgi
<Directory /var/www/myapp/myapp/>
WSGIProcessGroup myapp
WSGIApplicationGroup % {GLOBAL}
WSGIScriptReloading On
Order allow,deny
Allow from all
</Directory>
ErrorLog ${APACHE_LOG_DIR}/error.log
LogLevel warn
CustomLog ${APACHE_LOG_DIR}/access.log combined
</VirtualHost>
And:
<VirtualHost *:80>
ServerName myapp.com
WSGIScriptAlias / /var/www/myapp/myapp.wsgi
<Directory /var/www/myapp/myapp/>
Order allow,deny
Allow from all
</Directory>
Alias /static /var/www/myapp/myapp/static
<Directory /var/www/myapp/myapp/static/>
Order allow,deny
Allow from all
</Directory>
ErrorLog ${APACHE_LOG_DIR}/error.log
LogLevel warn
CustomLog ${APACHE_LOG_DIR}/access.log combined
</VirtualHost>
The two general types of myapp.wsgi files I have tried are:
#!/usr/bin/python
import sys
import logging
logging.basicConfig(stream=sys.stderr)
sys.path.insert(0,"/var/www/myapp/")
from myapp import app as application
And:
activate_this = '/var/www/myapp/myapp/venv/bin/activate_this.py'
execfile(activate_this, dict(__file__=activate_this))
import os
import sys
import logging
logging.basicConfig(stream=sys.stderr)
sys.path.insert(0, '/var/www/myapp/')
from myapp import app as application
#commenting out same in __init__.py
if __name__ == '__main__':
application.run()
The app does run successfully on my local machine, and I always chowned the /var/www/ directory for each user identified in the .conf file.
Any thoughts, tips, pointers, etc are extraordinarily welcome. Thanks very kindly.