YATA issueshttps://gitlab.ethz.ch/vermeul/YATA/-/issues2021-11-25T16:38:13Zhttps://gitlab.ethz.ch/vermeul/YATA/-/issues/21Mispar: Upgrade to a newer version of MediaWiki2021-11-25T16:38:13Zvermeulswen@ethz.chMispar: Upgrade to a newer version of MediaWikiCurrently, we are running on [Mediawiki 1.28](http://mispar.ethz.ch/wiki/Special:Version)
* we use the [onPageContentSave](https://www.mediawiki.org/wiki/Manual:Hooks/PageContentSave) hook, which is **deprecated** as of version 1.35
* w...Currently, we are running on [Mediawiki 1.28](http://mispar.ethz.ch/wiki/Special:Version)
* we use the [onPageContentSave](https://www.mediawiki.org/wiki/Manual:Hooks/PageContentSave) hook, which is **deprecated** as of version 1.35
* we use this hook to get hand of the source code being saved
* we then extract the annotations, assign them unique labels and anchors (for links) and change the content before saving
* instead of the [onPageContentSave](https://www.mediawiki.org/wiki/Manual:Hooks/PageContentSave) hook, from 1.35 onwards, the [onMultiContentSave](https://www.mediawiki.org/wiki/Manual:Hooks/MultiContentSave) hook should be used
* similarly, the [onPageContentSaveComplete](https://www.mediawiki.org/wiki/Manual:Hooks/PageContentSaveComplete) hook is **deprecated** from 1.35 onwards, which we also use (the actual saving of the annotations happens there)
* [List of all hooks](https://www.mediawiki.org/wiki/Category:MediaWiki_hooks)
https://jira-bsse.ethz.ch/browse/SSDM-10749Infrastructure improvementsvermeulswen@ethz.chvermeulswen@ethz.ch2022-12-31https://gitlab.ethz.ch/vermeul/YATA/-/issues/34Text for D-GESS financing board2022-05-05T15:44:29Zvermeulswen@ethz.chText for D-GESS financing board<h2>Mispar – a digital edition for the study of medieval Hebrew arithmetic</h2>
**Introduction**
Mispar is a [MediaWiki](https://www.mediawiki.org/wiki/MediaWiki) based database which hosts annotated transcripts of almost all surviving...<h2>Mispar – a digital edition for the study of medieval Hebrew arithmetic</h2>
**Introduction**
Mispar is a [MediaWiki](https://www.mediawiki.org/wiki/MediaWiki) based database which hosts annotated transcripts of almost all surviving Hebrew medieval arithmetic and algebraic treatises, as well as a few Hebrew geometric, Arabic and Judeo-Arabic treatises. It is open to the public via https://mispar.ethz.ch
Mispar is cooperating with the [Peshat project](https://www.peshat.org/) hosted at University of Hamburg.
The Mispar database and the website itself is hosted by Informatikdienste ETH Zurich. Mispar is online since 2017 and has been gradually developed and improved since.
In order to make the information more accessible, a custom-made annotation system [YATA](https://gitlab.ethz.ch/vermeul/YATA) was developed in PHP language by Scientific IT Services at ETH Zurich. It allows to annotate text passages, mathematical formulas as well as whole pages. All annotations can be categorised in a hierarchical way, while multiple categorisations per annotation are possible. A query language has been developed to retrieve the data and present the results in a nicely rendered table, containing the annotated text and the deep-link to the annotated passage. The annotation system works as a plug-in for MediaWiki.
**Further Developments**
While the system currently runs stable, a number of improvements are planned to make the system fit for the future. To name a few:
* **Upgrade to the latest MediaWiki version**. Since the first version of Mispar, the underlying MediaWiki has not been updated. We currently use version `1.28.0`, however the latest version is `1.37.2`. While the currently used version is working flawlessly, is not officially supported anymore. A few important breaking changes have been introduced since `1.28.0`, so this upgrade means also work on the code and the API we are using.
* **Migrate to SIS infrastructure**. The current Mispar website is hosted on a webserver by Basisdienste. We would like to be more flexible where to host the Mispar website, use Docker containers instead of classical webservers. The database (a PostGres database) will remain hosted at Basisdienste.
* **Search and categories improvements**. A number of smaller improvements have been identified, especially certain categories edge-cases and UI improvements (ambiguous categories, unintentional deletions, auto-expand sections of search results, etc.). All of them focus on increasing the user experience.
* **Improved rendering of math formulas**. The mathematical terms are currently rendered as PNG graphics in a quite low resolution. We would like to switch to modern, scalable SVG vector graphics instead.Infrastructure improvementsvermeulswen@ethz.chvermeulswen@ethz.chhttps://gitlab.ethz.ch/vermeul/YATA/-/issues/29category path uniqueness problem2021-12-10T13:12:47Zvermeulswen@ethz.chcategory path uniqueness problemIt seems that the ambiguous category problem has some other manifestations.
1. One situation I have in mind is a primary category node X, child A, grandchild B and another primary category Y with child A and grand child B. Since the sys...It seems that the ambiguous category problem has some other manifestations.
1. One situation I have in mind is a primary category node X, child A, grandchild B and another primary category Y with child A and grand child B. Since the system assumes that this is not possible, when I create a new category, this kind of ambiguity should be checked, and a dedicated error message produced if there is an ambiguity.
2. What happens if I create the same category twice? I assume that repeating twice a command of the form
```
{{#annotcat: add | name=X}} or {{#annotcat: add | name='B', parent='A' }}
```
will not create two categories of the same name, right? In other words, the repeated command will simply do nothing?
--> No, it will fail the second time. This means it will fail all the way and do nothing.
But what about:
```
{{#annotcat: add | name='X', hashtag='#1'}} and {{#annotcat: add | name='X', hashtag='#2'}}
```
?
What will happen in such a case? Perhaps the best thing is that if I create again a category that already exists (whether with the same hashtag or not), a dedicated error message should occur.
--> This will not create an error, since the hashtag, if present, must be unique. In other words, when the hashtag is not present, the name of the category must be unique, otherwise it is the hashtag.Category improvementshttps://gitlab.ethz.ch/vermeul/YATA/-/issues/26Automatically expand section when part of URL2021-12-10T13:13:06Zvermeulswen@ethz.chAutomatically expand section when part of URLWhen looking up the [Terms Page](https://mispar.ethz.ch/wiki/Terms) we see a very long page.
The terms currently are all expanded, as the Peshar team does a lookup on them. Because the terms list can get very long too, we need to collap...When looking up the [Terms Page](https://mispar.ethz.ch/wiki/Terms) we see a very long page.
The terms currently are all expanded, as the Peshar team does a lookup on them. Because the terms list can get very long too, we need to collapse them by default and only expand the ones we would like to look at.
For example, https://mispar.ethz.ch/wiki/Terms#.D7.90..D7.95..D7.AA. should leave all terms collapsed and only the term א.ו.ת. is expanded.
Investigation on how to use your own JavaScript is needed in addition to the implementation itself.
See https://jira-bsse.ethz.ch/browse/SSDM-11142User Experience improvementshttps://gitlab.ethz.ch/vermeul/YATA/-/issues/25Auto-expand the term specified in the URL2021-12-10T13:13:16Zvermeulswen@ethz.chAuto-expand the term specified in the URLThe list of terms (https://mispar.ethz.ch/wiki/Terms) should hide all instances of each term by default (see Naomi's mail of March 30th 2021), as it can be very extensive.
However, with a link including an anchor (e.g. https://mispar.et...The list of terms (https://mispar.ethz.ch/wiki/Terms) should hide all instances of each term by default (see Naomi's mail of March 30th 2021), as it can be very extensive.
However, with a link including an anchor (e.g. https://mispar.ethz.ch/wiki/Terms#peshat_definition_00057284) the output of that term should automatically be expanded.
To implement this, a Javascript should evaluate the value in the URL and expand the affected `<div>` node accordingly.
It is estimated 2 working days, as it is not yet clear yet how to achieve JavaScript within MediaWiki.
https://jira-bsse.ethz.ch/browse/SSDM-11014User Experience improvementshttps://gitlab.ethz.ch/vermeul/YATA/-/issues/23Mispar: Migrate to our own OPS infrastructure2022-02-09T10:49:07Zvermeulswen@ethz.chMispar: Migrate to our own OPS infrastructureAt some point in 2021 we need to update the Webserver from RHEL6 to RHEL8.
We should take the opportunity and also migrate to our OPS infrastructure (ANSIBLE script, etc.)
https://jira-bsse.ethz.ch/browse/SSDM-10757At some point in 2021 we need to update the Webserver from RHEL6 to RHEL8.
We should take the opportunity and also migrate to our OPS infrastructure (ANSIBLE script, etc.)
https://jira-bsse.ethz.ch/browse/SSDM-10757Infrastructure improvementsvermeulswen@ethz.chvermeulswen@ethz.chhttps://gitlab.ethz.ch/vermeul/YATA/-/issues/22improvement of category handling2021-12-10T13:09:36Zvermeulswen@ethz.chimprovement of category handling* The categories might need improvement (readibility, handling) with this level of deepness
* create a version of http://mispar.ethz.ch/wiki/Category_Page which shows:
* the number of found annotations in the text corpus
* a link ...* The categories might need improvement (readibility, handling) with this level of deepness
* create a version of http://mispar.ethz.ch/wiki/Category_Page which shows:
* the number of found annotations in the text corpus
* a link which would lead to the actual results.
https://jira-bsse.ethz.ch/browse/SSDM-10755Category improvementshttps://gitlab.ethz.ch/vermeul/YATA/-/issues/16Mispar: Error message when someone tries to delete a category that has a query2021-11-25T16:42:10Zvermeulswen@ethz.chMispar: Error message when someone tries to delete a category that has a query(from 2021-01-19)
The content of pages (including the queries) in MediaWiki are dumped in a format into the database where they are not directly searchable. Possible solution:
* store the queries of a page into the database as well, or...(from 2021-01-19)
The content of pages (including the queries) in MediaWiki are dumped in a format into the database where they are not directly searchable. Possible solution:
* store the queries of a page into the database as well, or at least some fragments of it
* create a new table for this
* present error message when category is being deleted but still has a reference to at least one page
* this linking may be used for other purposes, e.g. show all queries that seek for a certain category
https://jira-bsse.ethz.ch/browse/SSDM-10753Category improvementshttps://gitlab.ethz.ch/vermeul/YATA/-/issues/9improve search result with ambiguous category name2021-12-10T13:16:06Zvermeulswen@ethz.chimprove search result with ambiguous category name* Concerning non-unique categories: we discussed it in the past. Right now, what happens is that the search results display the results of only one of the categories with the same name. So I see two options:
1. Change it so that it pr...* Concerning non-unique categories: we discussed it in the past. Right now, what happens is that the search results display the results of only one of the categories with the same name. So I see two options:
1. Change it so that it presents results of all categories with the same name
2. Keep the result as they are, but issue a suitable clarification ("results for parent/non-unique-name")
https://jira-bsse.ethz.ch/browse/SSDM-10754Search improvementshttps://gitlab.ethz.ch/vermeul/YATA/-/issues/2Mispar: Math Extension: use svg instead of png2021-11-25T16:37:56Zvermeulswen@ethz.chMispar: Math Extension: use svg instead of pngfind out whether Latex rendering engine supports svg...
https://jira-bsse.ethz.ch/browse/SSDM-10751find out whether Latex rendering engine supports svg...
https://jira-bsse.ethz.ch/browse/SSDM-10751Infrastructure improvementsvermeulswen@ethz.chvermeulswen@ethz.ch