🌐 Mailman 3 September 2016 - Python-list - python.org

Multiprocessing interactive processes with connections
by Charles Hixson Sept. 6, 2016

Sept. 6, 2016

I want to process a bunch of processes that all talk to each other. I've figured out how to do this using queues with the main process as the mail handler, but I'd rather have them talk directly. If I use connections, then I can pass the pipes to the processes, but there doesn't seem to be anything analogous to queue, so it looks like I need to divide each process into two threads, one of which does nothing but mail handling. Is this correct? FWIW, a small, unoptimized, test of the working "mailhandler" approach is: ## Multiprocessing: main thread as post office. # This is a bit clumsy, but it works. from multiprocessing import Process, Queue from queue import Empty def f(i, lim, q_rcv, q_snd): for j in range(lim): if i != j: q_snd.put([i, "message from process {0} to proess {1}".format(i, j), j]) if not q_rcv.empty(): val = q_rcv.get() print (val) q_snd.put([i, "done"]) while (not q_recv.empty()): val = q_rcv.get() print (val, " :: ", i) if val == "done": return if __name__ == '__main__': ps = [] qs = [] q_recv = Queue() for i in range(3): q = Queue() qs.append (q) ps.append (Process(target=f, args=(i, 3, q, q_recv)) ) for p in ps: p.start() dones = 0 try: v = q_recv.get(True, 1) while (v): print ("v = ", v) if v[1] == "done": dones = dones + 1 else: if len(v) == 3: assert v[2] < len(qs), "unexpected value" qs[v[2]].put(v[1]) else: print ("error: ", v, " was an unexpected value.") v = q_recv.get(True, 1) except Empty: print ("1: Timeout of maine receive queue") for q in qs: q.put("done") try: v = q_recv.get(True, 1) while (v): print ("2: v = ", v) if v[1] == "done": dones = dones + 1 else: if len(v) == 3: assert v[3] < len(qs), "2: unexpected value" qs[v[3]].put(v[2]) else: print ("2: error: ", v, " was an unexpected value.") v = q_recv.get(True, 1) except Empty: print ("2: Timeout of maine receive queue") for i in range(len(qs)): qs[i].close(); qs[i] = None

1 0

Re: Class - error return
by Smith＠f38.n261.z1 Sept. 6, 2016

Sept. 6, 2016

From: Smith <smith(a)smith.it> On 06/09/2016 11:23, Peter Otten wrote: > If so look at > >> > ...: def __str__(self): >> > ...: return "Visitor: %i, Contacts: %i % >> > (self.visits,self.contacts)" > once more. Where are the quotes? Where should the be? > > > I solved the problem. thank you Peter

1 0

Python 3.5.0 python --version command reports 2.5.4
by Yang, Gang CTR (US) Sept. 6, 2016

Sept. 6, 2016

Hi, I just installed Python 3.5.0 (since 3.5.2 would not installed on Windows 2008 R2) and tried the python --version command. Surprisingly, the command reported 2.5.4. What's going on? Gang Yang Shonborn-Becker Systems Inc. (SBSI) Contractor Engineering Supporting SEC Office: 732-982-8561, x427 Cell: 732-788-7501<tel:732-740-4656> Email: gang.yang.ctr(a)mail.mil<mailto:gang.yang.ctr@mail.mil>

1 0

Re: Extend unicodedata with a name/pattern/regex search for character entity references?
by Steve D'Aprano Sept. 6, 2016

Sept. 6, 2016

On Sun, 4 Sep 2016 12:19 pm, Chris Angelico wrote: [...] >> Please either comply, or give up your stupid and pointless obsession with >> trying to be the Internet Police for something that isn't even a real >> rule. > > His posts aren't making it across the news->list gateway any more. > Killfile him and move on... But but but... I couldn't do that. https://www.xkcd.com/386/ -- Steve “Cheer up,” they said, “things could be worse.” So I cheered up, and sure enough, things got worse.

3 2

Re: Class - error return
by Smith Sept. 6, 2016

Sept. 6, 2016

On 06/09/2016 11:23, Peter Otten wrote: > If so look at > >> > ...: def __str__(self): >> > ...: return "Visitor: %i, Contacts: %i % >> > (self.visits,self.contacts)" > once more. Where are the quotes? Where should the be? > > > I solved the problem. thank you Peter

1 0

Re: Python 3 curiosity.
by Wildman Sept. 6, 2016

Sept. 6, 2016

On Wed, 07 Sep 2016 02:27:40 +1000, Chris Angelico wrote: > On Wed, Sep 7, 2016 at 2:13 AM, Wildman via Python-list > <python-list(a)python.org> wrote: >> On Tue, 06 Sep 2016 02:51:39 -0700, wxjmfauth wrote: >> >>> It's curious to see all these apps, that were >>> more of less working correctly up to Python 3.2 >>> (included) and are now no more working at all. >>> >>> Probably something wrong somewhere... >> >> http://sebastianraschka.com/Articles/2014_python_2_3_key_diff.html > > That's jmf, and he never actually posts proof, but keeps on asserting > that Unicode handling in Python 3.3+ is "broken". Actually, it's not. > The worst criticism you can level at it is that it may be slower in > certain microbenchmarks... but only if you're comparing against a > *narrow build* of Python 3.2, which is *buggy*. In other words, Python > eliminated an endemic bug, and actually improved performance overall, > but worsened it on a very VERY few cases. > > Most of us have either killfiled him, or are reading this via the > mailing list, which doesn't carry his traffic. I suggest you do the > same. He's a crank. > > ChrisA Thanks for the heads-up. -- <Wildman> GNU/Linux user #557453 "Be at war with your vices, at peace with your neighbors, and let every new year find you a better man." -Benjamin Franklin

1 0

Re: Python 3 curiosity.
by Wildman Sept. 6, 2016

Sept. 6, 2016

On Tue, 06 Sep 2016 02:51:39 -0700, wxjmfauth wrote: > It's curious to see all these apps, that were > more of less working correctly up to Python 3.2 > (included) and are now no more working at all. > > Probably something wrong somewhere... http://sebastianraschka.com/Articles/2014_python_2_3_key_diff.html -- <Wildman> GNU/Linux user #557453 The cow died so I don't need your bull!

2 1

Multiprocessing interactive processes with connections
by Charles_Hixson＠f38.n261.z1 Sept. 6, 2016

Sept. 6, 2016

From: Charles Hixson <charleshixsn(a)earthlink.net> I want to process a bunch of processes that all talk to each other. I've figured out how to do this using queues with the main process as the mail handler, but I'd rather have them talk directly. If I use connections, then I can pass the pipes to the processes, but there doesn't seem to be anything analogous to queue, so it looks like I need to divide each process into two threads, one of which does nothing but mail handling. Is this correct? FWIW, a small, unoptimized, test of the working "mailhandler" approach is: ## Multiprocessing: main thread as post office. # This is a bit clumsy, but it works. from multiprocessing import Process, Queue from queue import Empty def f(i, lim, q_rcv, q_snd): for j in range(lim): if i != j: q_snd.put([i, "message from process {0} to proess {1}".format(i, j), j]) if not q_rcv.empty(): val = q_rcv.get() print (val) q_snd.put([i, "done"]) while (not q_recv.empty()): val = q_rcv.get() print (val, " :: ", i) if val == "done": return if __name__ == '__main__': ps = [] qs = [] q_recv = Queue() for i in range(3): q = Queue() qs.append (q) ps.append (Process(target=f, args=(i, 3, q, q_recv)) ) for p in ps: p.start() dones = 0 try: v = q_recv.get(True, 1) while (v): print ("v = ", v) if v[1] == "done": dones = dones + 1 else: if len(v) == 3: assert v[2] < len(qs), "unexpected value" qs[v[2]].put(v[1]) else: print ("error: ", v, " was an unexpected value.") v = q_recv.get(True, 1) except Empty: print ("1: Timeout of maine receive queue") for q in qs: q.put("done") try: v = q_recv.get(True, 1) while (v): print ("2: v = ", v) if v[1] == "done": dones = dones + 1 else: if len(v) == 3: assert v[3] < len(qs), "2: unexpected value" qs[v[3]].put(v[2]) else: print ("2: error: ", v, " was an unexpected value.") v = q_recv.get(True, 1) except Empty: print ("2: Timeout of maine receive queue") for i in range(len(qs)): qs[i].close(); qs[i] = None

1 0

Re: Extend unicodedata with a name/pattern/regex search for character
by jladasky＠f38.n261.z1 Sept. 6, 2016

Sept. 6, 2016

From: jladasky(a)itu.edu On Saturday, September 3, 2016 at 7:49:14 PM UTC-7, Steve D'Aprano wrote: > On Sun, 4 Sep 2016 12:19 pm, Chris Angelico wrote: > > Killfile him and move on... > > But but but... I couldn't do that. > > https://www.xkcd.com/386/ I strongly suspected it would be that particular XKCD. :^)

1 0

Re: Class - error return
by nospam.Smith Sept. 6, 2016

Sept. 6, 2016

On 06/09/2016 11:23, Peter Otten wrote: > If so look at > >> > ...: def __str__(self): >> > ...: return "Visitor: %i, Contacts: %i % >> > (self.visits,self.contacts)" > once more. Where are the quotes? Where should the be? > > > I solved the problem. thank you Peter

1 0