Does anyone use BI? Does BI work correctly?

MFliorko · **Posted:** Mon Jul 13, 2009 10:57 am

Hello everyone,

I've found Business Intelligence (BI) module very powerful to build dynamic reports/statistics. But unfortunately I cannot run it properly.

I'm running trunk version with last updates.
I've created a new database with samples and installed some modules including BI (profile_BI, olap) and olap_sale, olap_crm.
Now I can partially use olap cube Sales in olap schema OpenERPSales (and OpenERPCRM's cubes as well).
For example, I've built summarized reports:

Code:

|       | Unit Sold
--------------------
| Users |    11

But I cannot drill-down olap hierarchy "Users". The application shows "Loading..." and nothing happens.

After short investigation I've found that after dragging-and-dropping olap hierarchy "Users" to the droppable place (at the right) the application server shows the error:

[2009-07-13 11:33:35,312] ERROR:web-services:[01]: Traceback (most recent call last):
[2009-07-13 11:33:35,312] ERROR:web-services:[02]: File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 59, in wrapper
[2009-07-13 11:33:35,312] ERROR:web-services:[03]: return f(self, dbname, *args, **kwargs)
[2009-07-13 11:33:35,312] ERROR:web-services:[04]: File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 119, in execute
[2009-07-13 11:33:35,312] ERROR:web-services:[05]: res = pool.execute_cr(cr, uid, obj, method, *args, **kw)
[2009-07-13 11:33:35,312] ERROR:web-services:[06]: File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 111, in execute_cr
[2009-07-13 11:33:35,312] ERROR:web-services:[07]: return getattr(object, method)(cr, uid, *args, **kw)
[2009-07-13 11:33:35,312] ERROR:web-services:[08]: File "D:\Projects\Workspace\OpenERP-Server\bin\addons\olap\olap.py", line 278, in request
[2009-07-13 11:33:35,312] ERROR:web-services:[09]: find_table = warehouse.match_table(cr, uid, request, context)
[2009-07-13 11:33:35,312] ERROR:web-services:[10]: File "D:\Projects\Workspace\OpenERP-Server\bin\addons\olap\cube\warehouse.py", line 148, in match_table
[2009-07-13 11:33:35,312] ERROR:web-services:[11]: result = self.parse_query(request)
[2009-07-13 11:33:35,312] ERROR:web-services:[12]: File "D:\Projects\Workspace\OpenERP-Server\bin\addons\olap\cube\warehouse.py", line 220, in parse_query
[2009-07-13 11:33:35,312] ERROR:web-services:[13]: qr = query_parser.parseString(query)
[2009-07-13 11:33:35,312] ERROR:web-services:[14]: File "C:\Programs\Python25\lib\site-packages\pyparsing-1.5.2-py2.5-win32.egg\pyparsing.py", line 1078, in parseString
[2009-07-13 11:33:35,312] ERROR:web-services:[15]: raise exc
[2009-07-13 11:33:35,312] ERROR:web-services:[16]: ParseException: Expected "}" (at char 15), (line:1, col:16)

The same error is with OpenERPCRM module samples.

I've traced the application. The error occurs while parsing the string:
"select {[Users].children} on rows from Sales" in module pyparsing.py.

Does anybody use the BI module without any troubles?
Does the module work properly at the moment?
Could you provide me with working samples?

I've registered a bug in Launchpad:
https://bugs.launchpad.net/openobject-bi/+bug/398711

If you need more information from me, just drop a word to this topic.

Ragards,

asb · **Joined:** Tue Aug 05, 2008 1:29 pm **Posts:** 37

Hello

I tried the way you said but am able to make the query with drills no such error in mine case.

. I tired in the way u said. I took updated webclient and trunk-extra-addons and created a new database.
But am not able to generate such error. Are you able to open the tree under the user on the tree view on the left side of browser?

asb · **Joined:** Tue Aug 05, 2008 1:29 pm **Posts:** 37

The bug too replied and fixed now,

MFliorko · **Posted:** Tue Jul 14, 2009 12:20 pm

Hello asb,

Thanks for the reply and bugfixing.

I've just updated my local sources from launchpad and recreated a new database.

Unfortunately the defect is still reproducible.
The same effects.

In the left panel of BI browser after selecting Olap schema and cube I can open Olap dimension and see Olap hierarchy, but I cannot expand any Olap hierarchy - at this moment the application server shows the mentioned error.

Could the issue be caused by incorrect python package version?
All other modules work well.
My environment configuration:
Windows XP SP 3
PostgreSQL 8.3.4
python 2.5
SQLAlchemy-0.5.3
pyparsing-1.5.2
(I've installed the latest versions of all required python packages)

Thanks for your help in advance.

asb · **Joined:** Tue Aug 05, 2008 1:29 pm **Posts:** 37

Sorry.
I tried again with the version of packages you mentioned. Still it works

Can u pls send the trace again. It wld be now different.

Just for information i am using
1. Server : trunk
2. web-client : trunk (bi specific)
3. addons : trunk (tunk-extra-addons)
4. GTK client : trunk

MFliorko · **Posted:** Tue Jul 14, 2009 1:30 pm

I've updated all sources at 12:22 (UK time) from branches:

Quote:

Server: bzr clone lp:~openerp/openobject-server/trunk sources/server-trunk
Server addons: bzr clone lp:~openerp/openobject-addons/trunk sources/addons-trunk
Server addons extra: bzr clone lp:~openerp-commiter/openobject-addons/trunk-extra-addons sources/addons-extra-trunk
Web Client New: bzr clone lp:~openerp/openobject-bi/client-new-trunk sources/openobject-bi-client-new-trunk

Web Browser: Mozilla Firefox 3.0.11.

App Server Trace Log:

Code:

[2009-07-14 14:26:20,986] INFO:web-service:successful login from 'admin' using database 'openerp_bi'
Parsing MDX...
        select {[Users].children} on rows from Sales
PyParsing parse string: select {[Users].children} on rows from Sales
[2009-07-14 14:26:36,986] ERROR:web-services:[01]: Traceback (most recent call last):
[2009-07-14 14:26:36,986] ERROR:web-services:[02]:   File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 59, in wrapper
[2009-07-14 14:26:36,986] ERROR:web-services:[03]:     return f(self, dbname, *args, **kwargs)
[2009-07-14 14:26:36,986] ERROR:web-services:[04]:   File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 119, in execute
[2009-07-14 14:26:36,986] ERROR:web-services:[05]:     res = pool.execute_cr(cr, uid, obj, method, *args, **kw)
[2009-07-14 14:26:36,986] ERROR:web-services:[06]:   File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 111, in execute_cr
[2009-07-14 14:26:36,986] ERROR:web-services:[07]:     return getattr(object, method)(cr, uid, *args, **kw)
[2009-07-14 14:26:36,986] ERROR:web-services:[08]:   File "D:\Projects\Workspace\OpenERP-Server\bin\addons\olap\olap.py", line 282, in request
[2009-07-14 14:26:36,986] ERROR:web-services:[09]:     mdx = mdx_parser.parse(request)
[2009-07-14 14:26:36,986] ERROR:web-services:[10]:   File "D:\Projects\Workspace\OpenERP-Server\bin\addons\olap\cube\mdx_parser.py", line 163, in parse
[2009-07-14 14:26:36,986] ERROR:web-services:[11]:     return self.mdx_query().parseString(query)[0]
[2009-07-14 14:26:36,986] ERROR:web-services:[12]:   File "C:\Programs\Python25\lib\site-packages\pyparsing-1.5.2-py2.5-win32.egg\pyparsing.py", line 1078, in parseString
[2009-07-14 14:26:36,986] ERROR:web-services:[13]:     raise exc
[2009-07-14 14:26:36,986] ERROR:web-services:[14]: [b]ParseException: Expected "}" (at char 15), (line:1, col:16)[/b]

I've added logging to pyparsing module. You can see my string:

Code:

PyParsing parse string: select {[Users].children} on rows from Sales

Regards,

MFliorko · **Posted:** Tue Jul 14, 2009 1:41 pm

Then I built a report:

Code:

         | Unit Sold
----------------------
  Users  |    11

and tries to expand "Users" hierarchy.

App Server Trace Log (continued):

Code:

Parsing MDX...
        select  {[Users].[all]} on rows from Sales
PyParsing parse string: select  {[Users].[all]} on rows from Sales
Validating MDX...
Running MDX...
 Default Currency EUR
Connected to database... postgres://openpg:openpgpwd@localhost:5432/openerp_bi
****************************************
[]
This is the value >>>> [_BindParamClause(u'%(59377328 param)s', 'all', type_=VARCHAR(length=None, convert_unicode=False, assert_unicode=None))] :param_1
Running Done...
Formatting Output...
DATA ([[(['Users'], 'Users')]], [[False]])
Parsing MDX...
        select  {[Users].[all]} on rows, {[measures].[Units Sold]} on columns from Sales
PyParsing parse string: select  {[Users].[all]} on rows, {[measures].[Units Sold]} on columns from Sales
Validating MDX...
Running MDX...
 Default Currency EUR
Connected to database... postgres://openpg:openpgpwd@localhost:5432/openerp_bi
PyParsing parse string: count(sale_order.id)
D:\Projects\Workspace\OpenERP-Server\bin\addons\olap\cube\common.py:7: SADeprecationWarning: Deprecated. Use ``metadata.sorted_tables``
  table_name =  filter(lambda x: x.name==temp[0],metadata.table_iterator(reverse=False))
****************************************
[]
This is the value >>>> [_BindParamClause(u'%(59349552 param)s', 'all', type_=VARCHAR(length=None, convert_unicode=False, assert_unicode=None))] :param_1
This is the value >>>> [<sqlalchemy>] count(sale_order.id)
 This the the r[0]
Running Done...
Formatting Output...
DATA ([[(['Users'], 'Users')], [(['measures', u'Units Sold'], u'Units Sold')]], [[['11']]])
Parsing MDX...
        select {[Users].children} on rows from Sales
PyParsing parse string: select {[Users].children} on rows from Sales
[2009-07-14 14:39:31,703] ERROR:web-services:[01]: Traceback (most recent call last):
[2009-07-14 14:39:31,703] ERROR:web-services:[02]:   File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 59, in wrapper
[2009-07-14 14:39:31,703] ERROR:web-services:[03]:     return f(self, dbname, *args, **kwargs)
[2009-07-14 14:39:31,703] ERROR:web-services:[04]:   File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 119, in execute
[2009-07-14 14:39:31,720] ERROR:web-services:[05]:     res = pool.execute_cr(cr, uid, obj, method, *args, **kw)
[2009-07-14 14:39:31,720] ERROR:web-services:[06]:   File "D:\Projects\Workspace\OpenERP-Server\bin\osv\osv.py", line 111, in execute_cr
[2009-07-14 14:39:31,720] ERROR:web-services:[07]:     return getattr(object, method)(cr, uid, *args, **kw)
[2009-07-14 14:39:31,720] ERROR:web-services:[08]:   File "D:\Projects\Workspace\OpenERP-Server\bin\addons\olap\olap.py", line 282, in request
[2009-07-14 14:39:31,720] ERROR:web-services:[09]:     mdx = mdx_parser.parse(request)
[2009-07-14 14:39:31,720] ERROR:web-services:[10]:   File "D:\Projects\Workspace\OpenERP-Server\bin\addons\olap\cube\mdx_parser.py", line 163, in parse
[2009-07-14 14:39:31,720] ERROR:web-services:[11]:     return self.mdx_query().parseString(query)[0]
[2009-07-14 14:39:31,720] ERROR:web-services:[12]:   File "C:\Programs\Python25\lib\site-packages\pyparsing-1.5.2-py2.5-win32.egg\pyparsing.py", line 1078, in parseString
[2009-07-14 14:39:31,720] ERROR:web-services:[13]:     raise exc
[2009-07-14 14:39:31,720] ERROR:web-services:[14]: ParseException: Expected "}" (at char 15), (line:1, col:16)

asb · **Joined:** Tue Aug 05, 2008 1:29 pm **Posts:** 37

Hello,

Sorry, I tried in different PCs with windows and linux os. But its working fine here without any error. Your error seems to be in parsing. But the query so formed is correct.

MFliorko · **Posted:** Fri Jul 17, 2009 10:55 am

Hello asb,

Thank you very much for your time and assistance.
Unfortunately, BI does not work in my environment.

Could we together check version of Python modules?
I think resolving this issue will be interesting for your experience as real case.
I installed OpenERP environments several times from scratch. But this didn't help me.
Other users could be in the same situation.

Which version of Python do you use?
I use Python 2.5.4 (http://www.python.org/download/releases/2.5.4/).

Thanks in advance,

asb · **Joined:** Tue Aug 05, 2008 1:29 pm **Posts:** 37

Hello,

Instead of communicating on forum and launchpad , I propose we talk at one place only

.
I did some minor changes to solve the problem.

Pls. Take the update on
olap module (trunk-extra-addons)
bi specific web client ( client-new-trunk)

Let us know if it helped or you can again change the status of this bugs.

Thanks for reporting and passions.

MFliorko · **Posted:** Mon Jul 20, 2009 10:50 am

Hello asb,

Thanks for your update.

After downloading recent changes and recreating database, the app server is now showing another error.

See details in launchpad bug tracker: https://bugs.launchpad.net/openobject-bi/+bug/398711

Thanks,

asb · **Joined:** Tue Aug 05, 2008 1:29 pm **Posts:** 37

Hello

Its very strange that its still not working. I want to know that your db is using UTF-8 encoding or some other encoding. Pls let us know.

MFliorko · **Posted:** Wed Jul 22, 2009 12:27 pm

Hello asb,

Of course, yes. My database uses encoding UTF8.
All databases are created by OpenERP clients.

I've checked this in pgAdmin.
The database definition is

Code:

-- Database: openerp_bi

-- DROP DATABASE openerp_bi;

CREATE DATABASE openerp_bi
  WITH OWNER = openpg
       ENCODING = 'UTF8';

I don't know if the forum allows schreenshot pictures to be attached.

The database server is of version 8.3.4 build 1400.
It was installed in scope of "OpenERP AllInOne v5.0.0.3".
Now all services of v5.0.0.3 are stopped and I use trunk version from launchpad.

I'm going to double check the issue on a clean environment on VMware virtual machine. I'll publish my results in a few minutes (as I already have such PC configured).

Thanks,

asb · **Joined:** Tue Aug 05, 2008 1:29 pm **Posts:** 37

Hello

I am waiting for the results. As m to eager to know where thngs are wrong

MFliorko · **Posted:** Wed Jul 22, 2009 3:58 pm

Test results:

All programs including python-2.5.4, python modules, PostgreSQL-8.3.7 (build 1400) were installed manually (mostly using easy_install.exe).

Python modules (list of C:\Python25\lib\site-packages):

Quote:

adodbapi
axscript
Babel-0.9.4-py2.5.egg
Beaker-1.3.1-py2.5.egg
cairo
Cheetah-2.0.1-py2.5-win32.egg
cherrypy-2.3.0-py2.5.egg
CherryPy-3.1.2-py2.5-win32.egg
configobj-4.6.0-py2.5.egg
dateutil
DecoratorTools-1.7-py2.5.egg
drv_libxml2.py
easy-install.pth
easy_install.py
egenix_mx_base-3.1.2-py2.5.egg-info
extremes-1.1.1-py2.5.egg
FormEncode-1.2.2-py2.5.egg
gtk-2.0
isapi
kid-0.9.6-py2.5.egg
libxml2.py
libxml2.pyc
libxml2_python-2.7.3-py2.5.egg-info
libxmlmods
libxslt.py
libxslt.pyc
lxml
lxml-2.2.2-py2.5.egg-info
Mako-0.2.4-py2.5.egg
matplotlib
matplotlib-0.98.5.2-py2.5.egg-info
mpl_toolkits
mx
numpy-1.3.0-py2.5-win32.egg
paste-1.7.2-py2.5.egg
pastedeploy-1.3.3-py2.5.egg
pastescript-1.7.3-py2.5.egg
PIL
PIL.pth
pkg_resources.py
pkg_resources.pyc
psycopg2
psycopg2-2.0.10-py2.5.egg-info
py2exe
py2exe-0.6.9-py2.5.egg-info
pycairo-1.4.12-py2.5.egg-info
pychart
PyChart-1.39-py2.5.egg-info
pydot-1.0.2-py2.5.egg
pygtk.pth
pygtk.py
pygtk.pyc
pyHnj.pyd
pylab.py
pylab.pyc
pyparsing-1.5.2-py2.5.egg-info
pyparsing.py
pyparsing.pyc
pyparsing_py3.py
PyProtocols-1.0a0-py2.5-win32.egg
pythoncom.py
pythonwin
pytz
pytz-2009j-py2.5.egg
pywin32-214-py2.6.egg-info
PyWin32.chm
pywin32.pth
pywin32.version.txt
pywin32_system32
PyXML-0.8.4-py2.5.egg-info
README.txt
reportlab
reportlab-2.3-py2.5.egg-info
RuleDispatch-0.5a1.dev_r2506-py2.5-win32.egg
setuptools
setuptools-0.6c9-py2.5.egg-info
setuptools.pth
sgmlop.pyd
simplejson-2.0.9-py2.5-win32.egg
site.py
sqlalchemy-0.5.5-py2.5.egg
TurboCheetah-1.0-py2.5.egg
TurboGears-1.0.8-py2.5.egg
TurboJson-1.1.4-py2.5.egg
TurboKid-1.0.4-py2.5.egg
win32
win32com
win32comext
zipextimporter.py
_memimporter.pyd
_renderPM.pyd
_rl_accel.pyd
_xmlplus

I've updated sources from launchpad trunk at 12:30am (UK time).
While creating a database I've chosen all default options (demo data, suggested modules etc).
Also I've installed the following modules:

Quote:

- olap
- olap_crm
- olap_sale

Then I started BI browser (I've tried IE8 and Firefox 3.5.1).
And I've got the same error:

Code:

...
[2009-07-22 16:53:30,272] ERROR:web-services:[22]: UnicodeDecodeError: 'ascii' codec can't decode byte 0x83 in position
26: ordinal not in range(128)

So, I've configured a new environment from scratch, but it didn't help me.

If you can launch BI properly in your environment, it means that either our environements are different or we do something differently.

But other users can have the same issue while installing BI module as I did nothing special, only default options.