Localization/Tools/Pology - Revision history

AnneW at 18:40, 15 July 2012

2012-07-15T18:40:37Z

Ilic: Links to other Pology-related articles.

2011-11-26T12:31:26Z

Links to other Pology-related articles.

Ilic: The content of this page is no longer actual. Instead, brief overview is given and links to Pology home page.

2011-11-26T12:24:23Z

The content of this page is no longer actual. Instead, brief overview is given and links to Pology home page.

Neverendingo: Text replace - "" to ""

2011-06-29T20:57:23Z

Text replace - "</code>" to "</syntaxhighlight>"

Neverendingo: Text replace - "`" to ""`


2011-06-29T20:41:59Z
Text replace - "<code bash>" to "<syntaxhighlight lang="bash">"

				
				
				
				
			
			← Older revision
			Revision as of 20:41, 29 June 2011
			
Line 13:
Line 13:
  At the moment, Pology still has not reached release state. But it can already be used effectively for day-to-day work, especially through end-user scripts. Obtaining and preparing Pology for use is simple: fetch its code repository, set <tt>PATH</tt> to use the scripts that come with it, and possibly set <tt>PYTHONPATH</tt> to be able to write own code based on Pology. The following commands should suffice:   At the moment, Pology still has not reached release state. But it can already be used effectively for day-to-day work, especially through end-user scripts. Obtaining and preparing Pology for use is simple: fetch its code repository, set <tt>PATH</tt> to use the scripts that come with it, and possibly set <tt>PYTHONPATH</tt> to be able to write own code based on Pology. The following commands should suffice:
    
− <code bash> + <syntaxhighlight lang="bash">
  $ svn co svn://anonsvn.kde.org/home/kde/trunk/l10n-support/pology   $ svn co svn://anonsvn.kde.org/home/kde/trunk/l10n-support/pology
  $ export PATH=$PWD/pology/bin:$PATH   $ export PATH=$PWD/pology/bin:$PATH
Line 87:
Line 87:
  Of course, the previous snippet is just an illustration of iterating through catalogs and examining messages, in practice superfluous next to the functionality already provided by <tt>find-messages</tt> sieve:   Of course, the previous snippet is just an illustration of iterating through catalogs and examining messages, in practice superfluous next to the functionality already provided by <tt>find-messages</tt> sieve:
    
− <code bash> + <syntaxhighlight lang="bash">
  $ posieve find-messages -smsgid:'hello' -snmsgstr:'zdravo' greets.po   $ posieve find-messages -smsgid:'hello' -snmsgstr:'zdravo' greets.po
  </code>   </code>



Neverendingo: Text replace - "" to ""

2011-06-29T20:34:45Z
Text replace - "<code python>" to "<syntaxhighlight lang="python">"

				
				
				
				
			
			← Older revision
			Revision as of 20:34, 29 June 2011
			
Line 52:
Line 52:
  For an obligatory hello-world demonstration, let us create a PO template named <tt>hello.pot</tt> with a single message of this greet:   For an obligatory hello-world demonstration, let us create a PO template named <tt>hello.pot</tt> with a single message of this greet:
    
− <code python> + <syntaxhighlight lang="python">
  from pology.catalog import Catalog   from pology.catalog import Catalog
  from pology.message import Message   from pology.message import Message
Line 67:
Line 67:
  Practically, however, it is usually Gettext tools that will be used to create templates and catalogs, while a much more common use of Pology is to iterate over existing catalogs. The following code will open a catalog with various greetings, look for all messages that contain "hello" in the original text but do ''not'' contain "zdravo" in the translation, and report their content to standard output:   Practically, however, it is usually Gettext tools that will be used to create templates and catalogs, while a much more common use of Pology is to iterate over existing catalogs. The following code will open a catalog with various greetings, look for all messages that contain "hello" in the original text but do ''not'' contain "zdravo" in the translation, and report their content to standard output:
    
− <code python> + <syntaxhighlight lang="python">
  from pology.catalog import Catalog   from pology.catalog import Catalog
  from pology.msgreport import report_msg_content   from pology.msgreport import report_msg_content





Ilic: Adaptations to changes in Pology directory structure.
2010-08-01T16:46:49Z
Adaptations to changes in Pology directory structure.

				
				
				
				
			
			← Older revision
			Revision as of 16:46, 1 August 2010
			
Line 16:
Line 16:
  $ svn co svn://anonsvn.kde.org/home/kde/trunk/l10n-support/pology   $ svn co svn://anonsvn.kde.org/home/kde/trunk/l10n-support/pology
  $ export PATH=$PWD/pology/bin:$PATH   $ export PATH=$PWD/pology/bin:$PATH
− $ export PYTHONPATH=$PWD:$PYTHONPATH + $ export PYTHONPATH=$PWD/pology:$PYTHONPATH
  $ . $PWD/pology/completion/bash/pology   $ . $PWD/pology/completion/bash/pology
  </code>   </code>
Line 53:
Line 53:
    
  <code python>   <code python>
− from pology.file.catalog import Catalog + from pology.catalog import Catalog
− from pology.file.message import Message + from pology.message import Message
    
  cat = Catalog("hello.pot", create=True, truncate=True)   cat = Catalog("hello.pot", create=True, truncate=True)
Line 68:
Line 68:
    
  <code python>   <code python>
− from pology.file.catalog import Catalog + from pology.catalog import Catalog
− from pology.misc.msgreport import report_msg_content + from pology.msgreport import report_msg_content
    
  cat = Catalog("greets.po")   cat = Catalog("greets.po")





Ilic: Mentioned Pology's internal documentation.
2009-11-05T13:30:13Z
Mentioned Pology's internal documentation.

				
				
				
				
			
			← Older revision
			Revision as of 13:30, 5 November 2009
			
Line 24:
Line 24:
  == Ready-Made Tools ==   == Ready-Made Tools ==
    
− Pology provides a number of tools for end use, with varying degrees of specificity, embodied as several scripts within <tt>scripts/</tt> subfolder of Pology's source. Details of operation of each script are provided within Pology documentation, and the following sections give overview and some examples of their functionality. + Pology provides a number of tools for end use, with varying degrees of specificity, embodied as several scripts within <tt>scripts/</tt> subfolder of Pology's source. Details of operation of each script are provided within Pology documentation (<tt>doc/html/index.html</tt>, node <tt>pology.scripts</tt>), and the following sections give overview and some examples of their functionality.
    
  === Sieving ===   === Sieving ===





Ilic: Pointed path to .../bin instead of .../scripts.
2009-09-20T11:12:14Z
Pointed path to .../bin instead of .../scripts.

				
				
				
				
			
			← Older revision
			Revision as of 11:12, 20 September 2009
			
Line 15:
Line 15:
  <code bash>   <code bash>
  $ svn co svn://anonsvn.kde.org/home/kde/trunk/l10n-support/pology   $ svn co svn://anonsvn.kde.org/home/kde/trunk/l10n-support/pology
− $ export PATH=$PWD/pology/scripts:$PATH + $ export PATH=$PWD/pology/bin:$PATH
  $ export PYTHONPATH=$PWD:$PYTHONPATH   $ export PYTHONPATH=$PWD:$PYTHONPATH
  $ . $PWD/pology/completion/bash/pology   $ . $PWD/pology/completion/bash/pology





Ilic: Added shell completion to setup steps.
2009-09-20T11:11:26Z
Added shell completion to setup steps.

				
				
				
				
			
			← Older revision
			Revision as of 11:11, 20 September 2009
			
Line 17:
Line 17:
  $ export PATH=$PWD/pology/scripts:$PATH   $ export PATH=$PWD/pology/scripts:$PATH
  $ export PYTHONPATH=$PWD:$PYTHONPATH   $ export PYTHONPATH=$PWD:$PYTHONPATH
  + $ . $PWD/pology/completion/bash/pology
  </code>   </code>
    
− (Of course, for continuous use, environment variables should rather be set in <tt>~/.bashrc</tt>, or the configuration file of whatever the shell you are using.) After these steps are successfully performed, Pology is fully prepared for use and scripting. + Of course, for continuous use, environment variables should rather be set in <tt>~/.bashrc</tt> (or another shell configuration file). The last line sources programmable shell completion for some of Pology's commands. After these steps are successfully performed, Pology is fully prepared for use and scripting.
    
  == Ready-Made Tools ==   == Ready-Made Tools ==

← Older revision		Revision as of 18:40, 15 July 2012
Line 1:		Line 1:
−	~~{{Template:I18n/Language Navigation Bar\|Localization/Tools/Pology}}~~

	{{LocalizationBrowser\|		{{LocalizationBrowser\|

@@ Line 5: / Line 5: @@
 name=Pology|
 prereqs=[[Localization/Tools/Gettext_Tools|Gettext Tools]]|
 }}

@@ Line 18: / Line 18: @@
 $ export PYTHONPATH=$PWD/pology:$PYTHONPATH
 $ . $PWD/pology/completion/bash/pology
-</code>
+</syntaxhighlight>
 Of course, for continuous use, environment variables should rather be set in <tt>~/.bashrc</tt> (or another shell configuration file). The last line sources programmable shell completion for some of Pology's commands. After these steps are successfully performed, Pology is fully prepared for use and scripting.
@@ Line 61: / Line 61: @@
 cat.add(msg)
 cat.sync()
-</code>
+</syntaxhighlight>
 Most of these few lines are self-explanatory, except the last one: modifications to catalogs in Pology are never automatically written to disk, instead the <tt>sync()</tt> method must be called to initiate writes. Catalog is not gone after this, but you can continue to use it normally, including further syncings. In this example, after syncing the file <tt>hello.pot</tt> will be created in current working directory.
@@ Line 81: / Line 81: @@
          if not matched:
              report_msg_content(msg, cat)
-</code>
+</syntaxhighlight>
 Note how <tt>msgstr</tt> is represented as a list regardless of whether the message is plural or not, the difference being only in the number of elements. This removes the special case of singular/plural translations, and makes programmer always think of plural messages (though plural of original text is accessed through <tt>msgid_plural</tt> instance variable). Function <tt>report_msg_content</tt> will output the message to standard output, nicely formatted and preceded with a line stating the originating catalog and message's referent line and entry number in it. But <tt>report_msg_content</tt> can do much more, e.g. highlight parts of the message in the shell, add notes and delimiters, and so on (its API documentation provides all the details). Since no changes were done to the catalog, it is perfectly fine, even appropriate, not to call <tt>sync()</tt> at the end.
@@ Line 89: / Line 89: @@
 <syntaxhighlight lang="bash">
 $ posieve find-messages -smsgid:'hello' -snmsgstr:'zdravo' greets.po
-</code>
+</syntaxhighlight>
 ((To be continued...))

@@ Line 9: / Line 9: @@
 == About ==
-Pology is a Python framework for custom processing of PO files. It aims to facilitate easy, fast and robust creation of scripts for tackling problems encountered in the "field", everyday translation work, and to collect all sorts of specific, narrow purpose tools written in this direction. It does not aim to be a collection of several feature-rounded, monolithic, and general purpose tools (though it may contain some which could qualify). In particular, it does not attempt to handle any other translation formats but PO. All of Pology's end-user tools and programming interfaces are geared towards the PO format and conventions. The name itself should be parsed as PO-logy, "the study of POs".
+Pology is a Python library and a set of command-line tools for processing PO files. The library aims to enable easy, fast and robust creation of scripts for tackling problems encountered in the "field", in everyday translation work. The tools perform various specialized operations, beyond that of other PO-handling software. Some of the tools are designed to (or have provisions to) treat a collection of PO files as an entity unto itself.
-At the moment, Pology still has not reached release state. But it can already be used effectively for day-to-day work, especially through end-user scripts. Obtaining and preparing Pology for use is simple: fetch its code repository, set <tt>PATH</tt> to use the scripts that come with it, and possibly set <tt>PYTHONPATH</tt> to be able to write own code based on Pology. The following commands should suffice:
+In Pology, no attempt is made to handle any other translation file format but PO. All of the end-user tools and library programming interfaces are geared towards the technical aspects, conventions and workflows around the PO format. For example, some tools explicitly take into account that PO files are frequently kept under version control, providing the functionality to support that workflow.
-<syntaxhighlight lang="bash">
+Language- and project-specific support is present throughout Pology, and it is designed to be easily expanded in the future. In the context of KDE, for example, there is a tool for validating PO files within the KDE Translation Project: it will recognize the "role" of the particular PO file (e.g. a native KDE code PO file, a .desktop PO file, Docbook PO file...) and then apply checks appropriate for that role. (This tool is run weekly on KDE servers, on PO files of all languages, and results announced to <tt>kde-i18n-doc</tt> mailing list.)
-$ svn co svn://anonsvn.kde.org/home/kde/trunk/l10n-support/pology
-$ export PATH=$PWD/pology/bin:$PATH
-$ export PYTHONPATH=$PWD/pology:$PYTHONPATH
-$ . $PWD/pology/completion/bash/pology
-</syntaxhighlight>
-Of course, for continuous use, environment variables should rather be set in <tt>~/.bashrc</tt> (or another shell configuration file). The last line sources programmable shell completion for some of Pology's commands. After these steps are successfully performed, Pology is fully prepared for use and scripting.
+Pology source distribution can be fetched from its home page at:
-== Ready-Made Tools ==
+ http://pology.nedohodnik.net
-Pology provides a number of tools for end use, with varying degrees of specificity, embodied as several scripts within <tt>scripts/</tt> subfolder of Pology's source. Details of operation of each script are provided within Pology documentation (<tt>doc/html/index.html</tt>, node <tt>pology.scripts</tt>), and the following sections give overview and some examples of their functionality.
+The home page also links to on-line documentation (user manual and library API), and provides instructions for browsing or fetching the current development code.
-−
-=== Sieving ===
-−
-((To be done.))
-−
-=== Diffing and Patching ===
-−
-Line-oriented diffing and patching, as conducted by <tt>diff(1)</tt> and <tt>patch(1)</tt> commands, is not quite appropriate for PO files. Due to PO content being composed of variably-formatted multiline entries, which combine translator, programmer, and automatically controlled elements, line-oriented diff may indicate difference where semantically there is none, or not show real difference in a useful form. One could even claim line diffing of PO files to be almost useless, especially for the purpose of sending patches for translation.
-−
-For this reason, Pology contains two scripts, <tt>poediff</tt> and <tt>poepatch</tt>, which create message-oriented, ''embedded'' diffs of PO files. These diffs can be used both for reviewing changes and applying patches to PO files. Concept of embedded diffing and details on operation of the mentioned scripts are described in a [[Localization/Tools/Pology/PO_Embedded_Diffing|separate article]].
-−
-=== Reformatting ===
-−
-((To be done.))
-−
-=== Heavy Artillery ===
-−
-((To be done.))
-−
-== Writing Own Tools ==
-−
-Pology comes with detailed API documentation, but for a quick start into writing custom tools based on Pology, the following sections will describe and illustrate some of its more salient elements.
-−
-=== Catalogs and Messages ===
-−
-For an obligatory hello-world demonstration, let us create a PO template named <tt>hello.pot</tt> with a single message of this greet:
-−
-<syntaxhighlight lang="python">
-from pology.catalog import Catalog
-from pology.message import Message
-−
-cat = Catalog("hello.pot", create=True, truncate=True)
-msg = Message()
-msg.msgid = u"Hello, world!"
-cat.add(msg)
-cat.sync()
-</syntaxhighlight>
-−
-Most of these few lines are self-explanatory, except the last one: modifications to catalogs in Pology are never automatically written to disk, instead the <tt>sync()</tt> method must be called to initiate writes. Catalog is not gone after this, but you can continue to use it normally, including further syncings. In this example, after syncing the file <tt>hello.pot</tt> will be created in current working directory.
-−
-Practically, however, it is usually Gettext tools that will be used to create templates and catalogs, while a much more common use of Pology is to iterate over existing catalogs. The following code will open a catalog with various greetings, look for all messages that contain "hello" in the original text but do ''not'' contain "zdravo" in the translation, and report their content to standard output:
-−
-<syntaxhighlight lang="python">
-from pology.catalog import Catalog
-from pology.msgreport import report_msg_content
-−
-cat = Catalog("greets.po")
-for msg in cat:
-    if "hello" in msg.msgid.lower():
-        matched = False
-        for text in msg.msgstr:
-            if "zdravo" in text.lower():
-                matched = True
-                break
-        if not matched:
-            report_msg_content(msg, cat)
-</syntaxhighlight>
-−
-Note how <tt>msgstr</tt> is represented as a list regardless of whether the message is plural or not, the difference being only in the number of elements. This removes the special case of singular/plural translations, and makes programmer always think of plural messages (though plural of original text is accessed through <tt>msgid_plural</tt> instance variable). Function <tt>report_msg_content</tt> will output the message to standard output, nicely formatted and preceded with a line stating the originating catalog and message's referent line and entry number in it. But <tt>report_msg_content</tt> can do much more, e.g. highlight parts of the message in the shell, add notes and delimiters, and so on (its API documentation provides all the details). Since no changes were done to the catalog, it is perfectly fine, even appropriate, not to call <tt>sync()</tt> at the end.
-−
-Of course, the previous snippet is just an illustration of iterating through catalogs and examining messages, in practice superfluous next to the functionality already provided by <tt>find-messages</tt> sieve:
-−
-<syntaxhighlight lang="bash">
-$ posieve find-messages -smsgid:'hello' -snmsgstr:'zdravo' greets.po
-</syntaxhighlight>
-−
-((To be continued...))
-−
-=== Sieves ===
-−
-((To be done.))
-−
-=== Hooks ===
-−
-((To be done.))
-−
-=== Language Support ===
-−
-((To be done.))