New features

• Tests can now be run concurrently across multiple processes. You can use pytest-xdist for that. For tests using PostgresApptestConfiguration you should be aware that startpgcluster() can't run concurrently. Workaround is to call pytest with --dist=loadfile to use a single test process per test module or use an existing database cluster and set db-host and db-port of devtools.DEFAULT_PSQL_SOURCES['system'] accordingly.

• on cubicweb-ctl create and cubicweb-ctl pyramid, if it doesn't already exist in the instance directory, the pyramid.ini file will be generated with the needed secrets.
• add a --pdb flag to all cubicweb-ctl command to launch (i)pdb if an exception occurs during a command execution.
• the --loglevel and --dbglevel flags are available for all cubicweb-ctl instance commands (and not only the pyramid one)
• following "only in foreground" behavior all commands logs to stdout by default from now on. To still log to a file pass log_to_file=True to CubicWebConfiguration.config_for
• add a new migration function update_bfss_path(old_path, new_path) to update the path in Bytes File-System Storage (bfss).
• on every request display request path and selected controller in CLI
• migration interactive mode improvements:
  • when an exception occurs, display the full traceback instead of only the exception
  • on migration p(db) choice, launch ipdb if it's installed
  • on migration p(db) choice, give the traceback to pdb if it's available, this mean that the (i)pdb interactive session will be on the stack of the exception instead of being on the stack where pdb is launched which will allow the user to access all the relevant context of the exception which otherwise is lost
• on DBG_SQL and/or DBG_RQL, if pygments is installed, syntax highlight sql/rql debug output
• allow to specify the instance id for any instance command using the CW_INSTANCE global variable instead of or giving it as a cli argument
• when debugmode is activated ('-D/--debug' on the pyramid command for example), the HTML generated by CW will contains new tags that will indicate by which object in the code it has been generated and in which line of which source code. For example:

<div
  cubicweb-generated-by="cubicweb.web.views.basetemplates.TheMainTemplate"
  cubicweb-from-source="/home/user/code/logilab/cubicweb/cubicweb/web/views/basetemplates.py:161"
  id="contentmain">
    <h1
      cubicweb-generated-by="cubicweb.web.views.basetemplates.TheMainTemplate"
      cubicweb-from-source="/home/user/code/logilab/cubicweb/cubicweb/view.py:136">
        unset title
    </h1>
    [...]
</div>

While this hasn't been done yet, this feature is an open path for building dynamic tools that can help inspect the page.

• a new debug channels mechanism has been added, you can subscribe to one of those channels in your python code to build debug tools for example (the pyramid custom panels are built using that) and you will receive a datastructure (a dict) containing related information. The available channels are: controller, rql, sql, vreg, registry_decisions
• add a new '-t/--toolbar' option the pyramid command to activate the pyramid debugtoolbar
• a series of pyramid debugtoolbar panels specifically made for CW, see bellow

Pyramid debugtoolbar and custom panel

The pyramid debugtoolbar is now integrated into CubicWeb during the development phase when you use the 'pyramid' command. To activate it you need to pass the '-t/--toolbar' argument to the 'pyramid' command.

In addition, a series of custom panels specifically done for CW are now available, they display useful information for the development and the debugging of each page. The available panels are:

• a general panel which contains the selected controller, the current settings and useful links screenshot1
• a panel listing all decisions taken in registry for building this page screenshot2
• a panel listing the content of the vreg registries screenshot3
• a panel listing all the RQL queries made during a request screenshot4
• a panel listing all the SQL queries made during a request screenshot5

Furthermore, in all those panels, next to each object/class/function/method a link to display its source code is available (shown as '[source]' screenshot6) and also every file path shown is a traceback is also a link to display the corresponding file (screenshot7). For example: screenshot8.

Backwards incompatible changes

• Standardization on the way to launch a cubicweb instance, from now on the only way to do that will be the used the pyramid command. Therefore:

  • cubicweb-ctl commands "start", "stop", "restart", "reload" and "status" have been removed because they relied on the Twisted web server backend that is no longer maintained nor working with Python 3.
  • Twisted web server support has been removed.
  • cubicweb-ctl wsgi has also been removed.

• Support for legacy cubes (in the 'cubes' python namespace) has been dropped. Use of environment variables CW_CUBES_PATH and CUBES_DIR is removed.

• Python 2 support has been dropped.

• Exceptions in notification hooks aren't catched-all anymore during tests so one can expect tests that seem to pass (but were actually silently failing) to fail now.

• All "cubicweb-ctl" command only accept one instance argument from now one (instead of 0 to n)

• 'pyramid' command will always run in the foreground now, by consequence the option --no-daemon has been removed.

• DBG_MS flag has been removed since it is not used anymore

• transactions db logs where displayed using the logging (debug/info/warning...) mechanism, now it is only displayed if the corresponding DBG_OPS flag is used

Deprecated code drops

Most code deprecated by version 3.25 or older versions has been dropped.

Versions

Cubes

• apycot 3.2.0
• cubicweb-brainomics 0.11.5
• cubicweb-card 0.5.4
• cubicweb-container 2.7.0
• cubicweb-elections 0.2.0, 0.2.1
• cubicweb-fastimport 0.2.1
• cubicweb-forgotpwd 0.6.1
• cubicweb-inlinedit 1.2.1
• cubicweb-mercurial-server 0.6.0
• cubicweb-nazcaui 0.3.1
• cubicweb-registration 0.6.0
• cubicweb-signedrequest 0.1.3
• cubicweb-subprocess 0.2.1
• cubicweb-timeseries 1.4.0
• cubicweb-timesheet 0.12.0
• cubicweb-trackervcs 1.2.0
• cubicweb-transactionlog 0.3.0
• cubicweb-treeview 0.1.1
• cubicweb-vcreview 2.0.0
• cubicweb-vcsfile 1.17.0, 2.0.0
• cubicweb-vcwiki 0.3.0
• cubicweb-worker 3.1.0
• cubicweb-wsme 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5
• narval 4.1.1
• cwclientlib 0.2.1
• pyramid-cubicweb 0.1.2, 0.1.3
• rqlquery 0.2.0, 0.2.1

Agenda

Next roadmap meeting will be held at the beginning of march 2015 at Logilab. Interested parties are invited to get in touch.

Open Discussions

Versions

Cubes

CWEPs

Here is the status of open CubicWeb Evolution Proposals:

CWEP-0002 full-featured implementation, to be merged in 3.20

CWEP-0003 patches sent to the review. . Champion will be adim.

Work in progress

Agenda

Logilab's next roadmap meeting will be held at the beginning of november 2014 and Christophe and Dimitri were invited.

Versions

Cubes

Here is a list of cubes that had versions published over the past two months: accidents, awstats, book, bootstrap, brainomics, cmt, collaboration, condor, container, dataio, expense, faq, file, forge, forum, genomics, geocoding, inlineedit, inventory, keyword, link, mailinglist, mediaplayer, medicalexp, nazcaui, ner, neuroimaging, newsaggregator, processing, questionnaire, rqlcontroller, semnews, signedrequest, squareui, task, testcard, timesheet, tracker, treeview, vcsfile, workorder.

Here are a the new cubes we are pleased to announce:

rqlcontroller receives via a POST a list of RQL queries and executes them. This is a way to build web services.

wsme is helping build a web service API on top of a CubicWeb database.

signedrequest is a simple token based authentication system. This is a way for scripts or callback urls to access an instance without login/pwd information.

relationwidget is a widget usable in forms to edit relationships between objects. It depends on CubicWeb 3.19.

searchui is an experiment on adding blocks to the list of facets that allow building complex RQL queries step by step by clicking with the mouse instead of directly writing the RQL with the keyboard.

ckan is using the REST API of a CKAN data portal to mirror its content.

CWEPs

Here is the status of open CubicWeb Evolution Proposals:

CWEP-0002 is now in good shape and the goal is to have it merged into 3.20. It lacks some documentation and a migration script.

CWEP-0003 has made good progress during the latest sprint, but will need a thorough review before being merged. It will probably not be ready for 3.20 and have to wait for 3.21.

New CWEPs are expected to be written for clarifying the API of the _cw object, supporting persistent sessions and improving the performance of massive imports.

Visual identity

CubicWeb has a new logo that will appear before the end of may on its revamped homepage at http://www.cubicweb.org

Last but not least

As already said on the mailing list, other developers and contributors are more than welcome to share their own goals in order to define a roadmap that best fits everyone's needs.

Logilab's next roadmap meeting will be held at the beginning of july 2014.