学习 | Odoo Connects Everything

odoo.py auto-reload dev自动重启服务ENOSPC系统错误解决

Odoo8：
正常环境下直接–auto-reload参数运行缺库错误

ImportError: No module named pyinotify

1	ImportError: No module named pyinotify

pyinotify是一个Python模块，用来监测文件系统的变化
pyinotify依赖于Linux内核的inotify功能，是一个事件驱动的通知器，其通知接口通过三个系统调用从内核空间到用户空间
pyinotify结合这些系统调用，并提供一个顶级的抽象和一个通用的方式来处理这些功能

安装
pip install pyinotify

运行时错误：

pyinotify.py", line 1943, in add_watch
    self._inotify_wrapper.str_errno()))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe8 in position 6: ordinal not in range(128)

pyinotify.py", line 1943, in add_watch

self._inotify_wrapper.str_errno()))

UnicodeDecodeError: 'ascii' codec can't decode byte 0xe8 in position 6: ordinal not in range(128)

Odoo9：
正常环境下直接–dev参数运行日志警告

WARNING ? openerp.service.server: 'watchdog' module not installed. Code autoreload feature is disabled

1	WARNING ? openerp.service.server: 'watchdog' module not installed. Code autoreload feature is disabled

Watchdog是一个跨平台的Python库和shell工具，可以监视文件系统事件。超级好用，并且容易上手

安装
pip install watchdog

运行时错误：

watchdog/observers/inotify_c.py", line 402, in _raise_error
    raise OSError("inotify watch limit reached")
OSError: inotify watch limit reached

watchdog/observers/inotify_c.py", line 402, in _raise_error

raise OSError("inotify watch limit reached")

OSError: inotify watch limit reached

Node：
想起来当初刚玩node时也时常会遇到这个错误
不过大多直接sudo运行就可解决，简单理解权限问题也没有深究
但是odoo不能这么搞，源码限制：

Running as user 'root' is a security risk, aborting.

1	Running as user 'root' is a security risk, aborting.

还好从odoo9的报错信息里显而易见问题出自底层inotify对一般用户的限制
简单学习了下，得知其有个max_user_watches的内核参数限制普通用户一次最多关联监控个数。一般默认值8192，对于odoo这种大工程或稍大一点的node项目来说明显是不够用的

先通过如下方式验证：

[srj@x1c /]$ cat /proc/sys/fs/inotify/max_user_watches
8192

1 2	[srj@x1c /]$ cat /proc/sys/fs/inotify/max_user_watches 8192

然后通过su切换root身份动态更新配置值放大64倍

[srj@x1c /]$ su -c 'echo 524288 > /proc/sys/fs/inotify/max_user_watches'

1	[srj@x1c /]$ su -c 'echo 524288 > /proc/sys/fs/inotify/max_user_watches'

接着用不同版本的启动参数运行即可看到AutoReload watcher running成功了

INFO ? openerp.service.server: Watching addons folder /home/srj/.local/share/Odoo/addons/8.0
INFO ? openerp.service.server: AutoReload watcher running

1 2	INFO ? openerp.service.server: Watching addons folder /home/srj/.local/share/Odoo/addons/8.0 INFO ? openerp.service.server: AutoReload watcher running

最后还需要将动态修改的参数通过静态配置方式固化下来，否则每次重启还需要重复修改
Centos7下我不建议直接修改/etc/sysctl.conf文件配置，而是通过sysctl.d目录新建独立配置

[root@x1c sysctl.d]# pwd
/etc/sysctl.d
[root@x1c sysctl.d]# echo fs.inotify.max_user_watches = 524288 > 91-inotify.conf 
[root@x1c sysctl.d]# cat 91-inotify.conf 
fs.inotify.max_user_watches = 524288

[root@x1c sysctl.d]# pwd

/etc/sysctl.d

[root@x1c sysctl.d]# echo fs.inotify.max_user_watches = 524288 > 91-inotify.conf

[root@x1c sysctl.d]# cat 91-inotify.conf

fs.inotify.max_user_watches = 524288

然后重新启动或者使用

[root@x1c sysctl.d]# sysctl --system
* Applying /etc/sysctl.d/91-inotify.conf ...
fs.inotify.max_user_watches = 524288
* Applying /etc/sysctl.conf ...

[root@x1c sysctl.d]# sysctl --system

* Applying /etc/sysctl.d/91-inotify.conf ...

fs.inotify.max_user_watches = 524288

* Applying /etc/sysctl.conf ...

sysctl命令system参数立刻生效

tornado http basic and digest auth handler

from tornado.web import RequestHandler
from tornado.escape import utf8
from hashlib import md5

class BasicAuthHandler(RequestHandler):
    def get(self):
        realm = 'renjie'
        username = 'foo'
        password = 'bar'
        # Authorization: Basic base64("user:passwd")
        auth_header = self.request.headers.get('Authorization', None)
        if auth_header is not None:
            # Basic Zm9vOmJhcg==
            auth_mode, auth_base64 = auth_header.split(' ', 1)
            assert auth_mode == 'Basic'
            # 'Zm9vOmJhcg==' == base64("foo:bar")
            auth_username, auth_password = auth_base64.decode('base64').split(':', 1)
            if auth_username == username or auth_password == password:
                self.write('ok')
            else:
                self.write('fail')
        else:
            '''
            HTTP/1.1 401 Unauthorized
            WWW-Authenticate: Basic realm="renjie"
            '''
            self.set_status(401)
            self.set_header('WWW-Authenticate', 'Basic realm="%s"' % realm)

class DigestAuthHandler(RequestHandler):
    def get(self):
        realm = 'test'
        opaque = 'asdf'
        # Real implementations would use a random nonce.
        nonce = "1234"
        username = 'foo'
        password = 'bar'
        '''
        Authorization: Digest username="foo", 
                              realm="test", 
                              nonce="1234", 
                              uri="/auth/digest", 
                              response="e839337ef079c93238a4bf4f1ae712b3", 
                              opaque="asdf"
        '''
        auth_header = self.request.headers.get('Authorization', None)
        if auth_header is not None:
            auth_mode, params = auth_header.split(' ', 1)
            assert auth_mode == 'Digest'
            param_dict = {}
            for pair in params.split(','):
                k, v = pair.strip().split('=', 1)
                if v[0] == '"' and v[-1] == '"':
                    v = v[1:-1]
                param_dict[k] = v
            assert param_dict['realm'] == realm
            assert param_dict['opaque'] == opaque
            assert param_dict['nonce'] == nonce
            assert param_dict['username'] == username
            assert param_dict['uri'] == self.request.path
            h1 = md5(utf8('%s:%s:%s' % (username, realm, password))).hexdigest()
            h2 = md5(utf8('%s:%s' % (self.request.method,
                                     self.request.path))).hexdigest()
            digest = md5(utf8('%s:%s:%s' % (h1, nonce, h2))).hexdigest()
            if digest == param_dict['response']:
                self.write('ok')
            else:
                self.write('fail')
        else:
            self.set_status(401)
            # WWW-Authenticate: Digest realm="test", nonce="1234", opaque="asdf"
            self.set_header('WWW-Authenticate',
                            'Digest realm="%s", nonce="%s", opaque="%s"' %
                            (realm, nonce, opaque))

from tornado.web import RequestHandler

from tornado.escape import utf8

from hashlib import md5

class BasicAuthHandler(RequestHandler):

def get(self):

realm = 'renjie'

username = 'foo'

password = 'bar'

# Authorization: Basic base64("user:passwd")

auth_header = self.request.headers.get('Authorization', None)

if auth_header is not None:

# Basic Zm9vOmJhcg==

auth_mode, auth_base64 = auth_header.split(' ', 1)

assert auth_mode == 'Basic'

# 'Zm9vOmJhcg==' == base64("foo:bar")

auth_username, auth_password = auth_base64.decode('base64').split(':', 1)

if auth_username == username or auth_password == password:

self.write('ok')

else:

self.write('fail')

else:

'''

HTTP/1.1 401 Unauthorized

WWW-Authenticate: Basic realm="renjie"

'''

self.set_status(401)

self.set_header('WWW-Authenticate', 'Basic realm="%s"' % realm)

class DigestAuthHandler(RequestHandler):

def get(self):

realm = 'test'

opaque = 'asdf'

# Real implementations would use a random nonce.

nonce = "1234"

username = 'foo'

password = 'bar'

'''

Authorization: Digest username="foo",

realm="test",

nonce="1234",

uri="/auth/digest",

response="e839337ef079c93238a4bf4f1ae712b3",

opaque="asdf"

'''

auth_header = self.request.headers.get('Authorization', None)

if auth_header is not None:

auth_mode, params = auth_header.split(' ', 1)

assert auth_mode == 'Digest'

param_dict = {}

for pair in params.split(','):

k, v = pair.strip().split('=', 1)

if v[0] == '"' and v[-1] == '"':

v = v[1:-1]

param_dict[k] = v

assert param_dict['realm'] == realm

assert param_dict['opaque'] == opaque

assert param_dict['nonce'] == nonce

assert param_dict['username'] == username

assert param_dict['uri'] == self.request.path

h1 = md5(utf8('%s:%s:%s' % (username, realm, password))).hexdigest()

h2 = md5(utf8('%s:%s' % (self.request.method,

self.request.path))).hexdigest()

digest = md5(utf8('%s:%s:%s' % (h1, nonce, h2))).hexdigest()

if digest == param_dict['response']:

self.write('ok')

else:

self.write('fail')

else:

self.set_status(401)

# WWW-Authenticate: Digest realm="test", nonce="1234", opaque="asdf"

self.set_header('WWW-Authenticate',

'Digest realm="%s", nonce="%s", opaque="%s"' %

(realm, nonce, opaque))

python tornado微信公众号开发者认证示例代码

import tornado.web
import hashlib

class WechatHandler(tornado.web.RequestHandler):
    def check(self):
        #微信公众平台设置
        token = "renjie"
        #微信加密签名，signature结合了开发者填写的token参数和请求中的timestamp参数、nonce参数。
        signature = self.get_argument("signature", None)
        #时间戳
        timestamp = self.get_argument("timestamp", None)
        #随机数
        nonce = self.get_argument("nonce", None)
        #随机字符串
        echostr = self.get_argument("echostr", None)
        if signature and timestamp and nonce:
            #将token、timestamp、nonce三个参数进行字典序排序
            param = [token, timestamp, nonce]
            param.sort()
            #将三个参数字符串拼接成一个字符串进行sha1加密
            sha = hashlib.sha1("%s%s%s" % tuple(param)).hexdigest()
            #开发者获得加密后的字符串可与signature对比，标识该请求来源于微信
            if sha == signature:
                if echostr:
                    #请原样返回echostr参数内容，则接入生效，成为开发者成功，否则接入失败。
                    return echostr
                else:
                    return True
        return False

    def get(self):
        self.write(str(self.check()))

import tornado.web

import hashlib

class WechatHandler(tornado.web.RequestHandler):

def check(self):

#微信公众平台设置

token = "renjie"

#微信加密签名，signature结合了开发者填写的token参数和请求中的timestamp参数、nonce参数。

signature = self.get_argument("signature", None)

#时间戳

timestamp = self.get_argument("timestamp", None)

#随机数

nonce = self.get_argument("nonce", None)

#随机字符串

echostr = self.get_argument("echostr", None)

if signature and timestamp and nonce:

#将token、timestamp、nonce三个参数进行字典序排序

param = [token, timestamp, nonce]

param.sort()

#将三个参数字符串拼接成一个字符串进行sha1加密

sha = hashlib.sha1("%s%s%s" % tuple(param)).hexdigest()

#开发者获得加密后的字符串可与signature对比，标识该请求来源于微信

if sha == signature:

if echostr:

#请原样返回echostr参数内容，则接入生效，成为开发者成功，否则接入失败。

return echostr

else:

return True

return False

def get(self):

self.write(str(self.check()))

svn: E200015 error proxy servers config

SVN E200015错误代理服务器配置文件位置
WIN：%APPDATA%Subversionservers
其它：~/.subversion/servers

#例外不走代理
http-proxy-exceptions = *.exception.com, www.internal-site.org
#代理服务器
http-proxy-host = defaultproxy.whatever.com
#代理端口号
http-proxy-port = 7000
#代理用户名
http-proxy-username = defaultusername
#代理密码
http-proxy-password = defaultpassword

#例外不走代理

http-proxy-exceptions = *.exception.com, www.internal-site.org

#代理服务器

http-proxy-host = defaultproxy.whatever.com

#代理端口号

http-proxy-port = 7000

#代理用户名

http-proxy-username = defaultusername

#代理密码

http-proxy-password = defaultpassword

如果是用TortoiseSVN，还有更直观的GUI设置

urllib2 vs tornado.httpclient and proxy vs auth

import urllib2

# set up authentication info
authinfo = urllib2.HTTPBasicAuthHandler()
authinfo.add_password(realm='PDQ Application',
                      uri='https://mahler:8092/site-updates.py',
                      user='klem',
                      passwd='geheim$parole')

proxy_support = urllib2.ProxyHandler({"http" : "http://ahad-haam:3128"})

# build a new opener that adds authentication and caching FTP handlers
opener = urllib2.build_opener(proxy_support, authinfo, urllib2.CacheFTPHandler)

# install it
urllib2.install_opener(opener)

f = urllib2.urlopen('http://www.python.org/')

import urllib2

# set up authentication info

authinfo = urllib2.HTTPBasicAuthHandler()

authinfo.add_password(realm='PDQ Application',

uri='https://mahler:8092/site-updates.py',

user='klem',

passwd='geheim$parole')

proxy_support = urllib2.ProxyHandler({"http" : "http://ahad-haam:3128"})

# build a new opener that adds authentication and caching FTP handlers

opener = urllib2.build_opener(proxy_support, authinfo, urllib2.CacheFTPHandler)

# install it

urllib2.install_opener(opener)

f = urllib2.urlopen('http://www.python.org/')

import tornado.httpclient

param = {
    "url" : "http://www.renjie.me/example",
    "proxy_host" : "proxy.renjie.me",
    "proxy_port" : 8080,
    "proxy_username" : "test",
    "proxy_password" : "welcome",
    "auth_mode" : "basic",
    "auth_username" : "renjie",
    "auth_password" : "CASwW8iJ"
}

http_request = tornado.httpclient.HTTPRequest(**param)
http_client = tornado.httpclient.HTTPClient()
try:
    response = http_client.fetch(http_request)
    print response.body
except tornado.httpclient.HTTPError as e:
    print "Error:", e
http_client.close()

import tornado.httpclient

param = {

"url" : "http://www.renjie.me/example",

"proxy_host" : "proxy.renjie.me",

"proxy_port" : 8080,

"proxy_username" : "test",

"proxy_password" : "welcome",

"auth_mode" : "basic",

"auth_username" : "renjie",

"auth_password" : "CASwW8iJ"

}

http_request = tornado.httpclient.HTTPRequest(**param)

http_client = tornado.httpclient.HTTPClient()

try:

response = http_client.fetch(http_request)

print response.body

except tornado.httpclient.HTTPError as e:

print "Error:", e

http_client.close()