🌐 Mailman 3 May 2023 - Python-list - python.org

What do these '=?utf-8?' sequences mean in python?
by Chris Green May 9, 2023

May 9, 2023

I'm having a real hard time trying to do anything to a string (?) returned by mailbox.MaildirMessage.get(). I'm extracting the Subject: header from a message and, if I write what it returns to a log file using the python logging module what I see in the log file (when the Subject: has non-ASCII characters in it) is:- =?utf-8?Q?aka_Marne_=C3=A0_la_Sa=C3=B4ne_(Waterways_Continental_Europe)?= Whatever I try I am unable to change the underscore characters in the above string back to spaces. So, what do those =?utf-8? and ?= sequences mean? Are they part of the string or are they wrapped around the string on output as a way to show that it's utf-8 encoded? If I have the string in a variable how do I replace the underscores with spaces? Simply doing "subject.replace('_', ' ')" doesn't work, nothing happens at all. All I really want to do is throw the non-ASCII characters away as the string I'm trying to match in the subject is guaranteed to be ASCII. -- Chris Green ·

6 8

Problem with accented characters in mailbox.Maildir()
by Chris Green May 8, 2023

May 8, 2023

I have a custom mail filter in python that uses the mailbox package to open a mail message and give me access to the headers. So I have the following code to open each mail message:- # # # Read the message from standard input and make a message object from it # msg = mailbox.MaildirMessage(sys.stdin.buffer.read()) and then later I have (among many other bits and pieces):- # # # test for string in Subject: # if searchTxt in str(msg.get("subject", "unknown")): do various things This works exactly as intended most of the time but occasionally a message whose subject should match the test is missed. I have just realised when this happens, it's when the Subject: has accented characters in it (this is from a mailing list about canals in France). So, for example, the latest case of this happening has:- Subject: aka Marne à la Saône (Waterways Continental Europe) where the searchTxt in the code above is "Waterways Continental Europe". Is there any way I can work round this issue? E.g. is there a way to strip out all extended characters from a string? Or maybe it's msg.get() that isn't managing to handle the accented string correctly? Yes, I know that accented characters probably aren't allowed in Subject: but I'm not going to get that changed! :-) -- Chris Green ·

3 5

Re: [pygettext] --package-name and --package-version unknown
by aapost May 5, 2023

May 5, 2023

On 5/5/23 04:39, c.buhtz(a)posteo.jp wrote: > That being said, the git repo linked earlier has accepted commits to that file earlier this year. So read in to that what you will *shrugs*

1 0

Re: [pygettext] --package-name and --package-version unknown
by aapost May 5, 2023

May 5, 2023

On 5/5/23 04:39, c.buhtz(a)posteo.jp wrote: > Thanks for the answer. > > Am 05.05.2023 03:24 schrieb aapost: >> pygettext is deprecated since xgettext supports python now, so using >> xgettext is recommended. > > If this is the official case then it should be mentioned in the python > docs. The 3.11 docs still tell about pygettext and xgettext and don't > recommend one of it. Yep, no disagreement. A lot of things 'should' be though, and technically it is (which docs being the key, lol): $man pygettext PYGETTEXT(1) General Commands Manual PYGETTEXT(1) NAME pygettext - Python equivalent of xgettext(1) SYNOPSIS pygettext [OPTIONS] INPUTFILE ... DESCRIPTION pygettext is deprecated. The current version of xgettext supports many languages, including Python. pygettext uses Python's standard tokenize module to scan Python source code, generating .pot files identical to what GNU xgettext generates for C and C++ code. From there, the standard GNU tools can be used. pygettext searches only for _() by default, even though GNU xgettext recognizes the following keywords: gettext, dgettext, dcgettext, and gettext_noop. See the -k/--keyword flag below for how to augment this. (I have never used either, I just spent a few minutes trying to be helpful =P)

1 0

Re: [pygettext] --package-name and --package-version unknown
by aapost May 5, 2023

May 5, 2023

On 5/4/23 17:38, c.buhtz(a)posteo.jp wrote: > am I right to assume that "pygettext" is part of the official Python3 > "package"? So it is OK to aks here? > > How can I set the "Project-Id-Version"? With "xgettext" I would use the > arguments "--package-name" and "--package-version" for this but they are > unknown for "pygettext". pygettext is deprecated since xgettext supports python now, so using xgettext is recommended. That being said, pygettext does not support the options, but it could be modified pretty easily. Untested but if you wanted to add that functionality in just create a modified pygettext.py with something like: link PACKAGE and VERSION to variables: pot_header = _('''\ # SOME DESCRIPTIVE TITLE. # Copyright (C) YEAR ORGANIZATION # FIRST AUTHOR <EMAIL@ADDRESS>, YEAR. # msgid "" msgstr "" "Project-Id-Version: %(packagename)s %(packageversion)s\\n" "POT-Creation-Date: %(time)s\\n" "PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE\\n" "Last-Translator: FULL NAME <EMAIL@ADDRESS>\\n" "Language-Team: LANGUAGE <LL(a)li.org>\\n" "MIME-Version: 1.0\\n" "Content-Type: text/plain; charset=%(charset)s\\n" "Content-Transfer-Encoding: %(encoding)s\\n" "Generated-By: pygettext.py %(version)s\\n" ''') add attributes to Options class: class Options: # constants GNU = 1 SOLARIS = 2 # defaults extractall = 0 # FIXME: currently this option has no effect at all. escape = 0 keywords = [] outpath = '' outfile = 'messages.pot' writelocations = 1 locationstyle = GNU verbose = 0 width = 78 excludefilename = '' docstrings = 0 nodocstrings = {} packagename = "PACKAGE" packageversion = "VERSION" modify option parsing for loop to look for new options: for opt, arg in opts: elif opt in ('--package-name',): options.packagename = arg elif opt in ('--package-version',): options.packageversion = arg grab those options when generating file output: def write(self, fp): options = self.__options packagename = options.packagename packageversion = options.packageversion timestamp = time.strftime('%Y-%m-%d %H:%M%z') encoding = fp.encoding if fp.encoding else 'UTF-8' print(pot_header % {'packagename': packagename, 'packageversion': packageversion, 'time': timestamp, 'version': __version__, 'charset': encoding, 'encoding': '8bit'}, file=fp) (did not test, so might be a bug or two)

2 1

Three (3) >>> in the debug screen of PyCharm... Que Es over?!!
by Kevin M. Wilson May 5, 2023

May 5, 2023

"When you pass through the waters, I will be with you: and when you pass through the rivers, they will not sweep over you. When you walk through the fire, you will not be burned: the flames will not set you ablaze." Isaiah 43:2 | | Virus-free.www.avg.com |

1 0

[pygettext] --package-name and --package-version unknown
by c.buhtz＠posteo.jp May 4, 2023

May 4, 2023

Hello, am I right to assume that "pygettext" is part of the official Python3 "package"? So it is OK to aks here? I do use pygettext to handle po and pot files. In the manpage I'm not able to find help about this. I would like to modify the header that pygettext does create in each po-file. How can I set the "Project-Id-Version"? With "xgettext" I would use the arguments "--package-name" and "--package-version" for this but they are unknown for "pygettext". Kind Christian

2 1

Disable 'style PEP' messages
by Kevin M. Wilson May 4, 2023

May 4, 2023

Hi... How do I set Pycharm to find only syntax errors?!! "When you pass through the waters, I will be with you: and when you pass through the rivers, they will not sweep over you. When you walk through the fire, you will not be burned: the flames will not set you ablaze." Isaiah 43:2 | | Virus-free.www.avg.com |

3 2

double bracket integer index in pandas; Is this a legal syntax
by Artie Ziff May 4, 2023

May 4, 2023

Hello, I am hope that pandas questions are OK here. In a panda lecture, I did not get the expected result. I tried this on two different platforms (old macOS distro and up-to-date Ubuntu Linux distro, 22.04) The Linux distro has: python 3.10.11 pandas 1.5.2 conda 23.3.1 Is this double bracket form, df[[1]], deprecated... maybe? There is data in a dataframe, df. >>> subset = df[[1]] Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/dks/anaconda3/lib/python3.10/site-packages/pandas/core/frame.py", line 3811, in __getitem__ indexer = self.columns._get_indexer_strict(key, "columns")[1] File "/home/dks/anaconda3/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6113, in _get_indexer_strict self._raise_if_missing(keyarr, indexer, axis_name) File "/home/dks/anaconda3/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 6173, in _raise_if_missing raise KeyError(f"None of [{key}] are in the [{axis_name}]") KeyError: "None of [Int64Index([1], dtype='int64')] are in the [columns]" What could be making this fail? Thank you! az

2 3

Re: An "adapter", superset of an iterator
by Greg Ewing May 4, 2023

May 4, 2023

On 4/05/23 9:29 am, Chris Angelico wrote: > So > you're asking for map to be able to return an iterator if given an > iterator, or an adapter if given an adapter. That makes it quite > complicated to use and reason about. Also a bit slower, since it would need to inspect its argument and decide what to do with it. Currently it can just get on with its job and rely on duck typing to do the right thing. Maybe there could be a parallel set of functions "enumerated", "mapped", etc. that take sequences and return sequence views. Although that naming convention would suggest that reversed() itself should return a sequence view rather than an iterator. That would require restricting it to working on sequences, which would be an incompatible change. -- Greg

1 0