🌐 Mailman 3 August 2020 - Python-list - python.org

Re: Video file to subtitles file
by Muskan Sanghai Aug. 30, 2020

Aug. 30, 2020

On Sunday, August 30, 2020 at 11:46:15 AM UTC+5:30, Chris Angelico wrote: > On Sun, Aug 30, 2020 at 4:11 PM Muskan Sanghai <muskan...(a)gmail.com> wrote: > > > > On Sunday, August 30, 2020 at 10:57:00 AM UTC+5:30, Christian Gollwitzer wrote: > > > Am 29.08.20 um 13:51 schrieb Muskan Sanghai: > > > > I want to extract subtitles from a MPEG video (which does not have any previous subtitles) > > > I'm still not sure I get it. "Extract" subtitles, when they are NOT > > > there? Can it be, by any chance, that you are talking about speech > > > recognition? I.e., you want a software which understands the spoken word > > > in the movie sound and turns that into text, which can be shown as > > > subtitles? Like the "auto-generated" subtitles which youtube offers for > > > some videos. > > > > > > If so, it is a complex task and will not work overly well. I defer to > > > the experts if there are any usable speech recognitino engines for this > > > task. > > > > > > Christian > > Yes, this is what I exactly want to do. I want to create a software which understands the spoken word in the movie sound and turns that into text. > > > I recommend looking into CMU Sphinx then. I've used that from Python. > > The results are highly entertaining. > > ChrisA Okay I will try it, thank you.

2 1

How do I left-justify the information in the labels?
by Steve Aug. 30, 2020

Aug. 30, 2020

for lineItem in range(len(ThisList)): SpecLine, Spec = GetLineByItem(ThisList[y]) OldSpec = Spec NewSpec = " " SVRlabel = ttk.Label(window, text = SpecLine + " "*5) SVRlabel.grid(column = 1, row = x) NewSpec = tk.StringVar() New_Specs.append(NewSpec) SVRCodeEntered = ttk.Entry(window, width = 15, textvariable = NewSpec) SVRCodeEntered.grid(column = 2, row = x, pady = 15) SVRCodeEntered.insert(0, OldSpec) x += 1 y += 1 Steve ============================================================ Footnote: Some mornings it just isn't worth chewing through the leather straps. -

2 2

Re: Threading plus multiprocessing plus cv2 error
by Stephane Tougard Aug. 30, 2020

Aug. 30, 2020

On 2020-08-30, Chris Angelico <rosuav(a)gmail.com> wrote: >> I'm not even that makes sense, how 2 processes can share a thread ? >> > They can't. However, they can share a Thread object, which is the > Python representation of a thread. That can lead to confusion, and > possibly the OP's error (I don't know for sure, I'm just positing). A fork() is a copy of a process in a new process. If this process has a thread (or several), they are part of the copy and the new process has those threads as well. Unless there is a memory sharing between those processes, what happens on one thread in the first process is totally independant of what happens in the copy of this thread in the other process. I'm not specialist on multi-threading in Python, but it should not change anything. Both processes (father and child) don't share the same thread, each one has its own copy of the thread.

2 1

Re: Where read() is documented
by Chris Green Aug. 30, 2020

Aug. 30, 2020

Stefan Ram <ram(a)zedat.fu-berlin.de> wrote: > Chris Green <cl(a)isbd.net> writes: > >I went to sys.stdin but it didn't really lead me easily to the read() > >method. All I actually wanted to know was what was the type of the > >return value of the read() method which is different in Python 2 and 3. > > |>>> import sys > |>>> >>> sys.stdin.read > <built-in method read of _io.TextIOWrapper object at 0x000000000015EBA0> > |>>> help(sys.stdin.read) > |Help on built-in function read: > | > |read(size=-1, /) method of _io.TextIOWrapper instance > | Read at most n characters from stream. > | > | Read from underlying buffer until we have n characters or we hit EOF. > | If n is negative or omitted, read until EOF. > | > |>>> type(sys.stdin.read()) > |^Z > |<class 'str'> > > Note that above it's called a "method" twice and once > a "function". > > (If I would have written the body of the documentation, > I'd use "size" instead of "n" and clearly separate > effects and results, e.g., > > |EFFECTS > | > |If <size> is not negative, read from underlying buffer until > |<size> characters are read or until EOF was read. If <size> > |is negative or omitted, read until EOF. > | > |RESULT > | > |The string read, type str, excluding a possible EOF read. > Yes, I must admit I tend to forget about the 'built-in' documentation that Python has. Coming from assembler, C and C++ one doesn't expect it, so I'm afraid I tend to search the on-line Python documentation. Usually I find what I want but in this particular case I didn't. I must remember the interactive prompt! Thanks. -- Chris Green ·

1 0

Problem running a FOR loop
by Steve Aug. 30, 2020

Aug. 30, 2020

Compiles, no syntax errors however, line 82 seems to run only once when the FOR loop has completed. Why is that? All fields are to contain the specifications, not just the last one. Steve ---------------------------------------------------------------------------- ------------------------------ ThisList = ["start"] #=============================================================== def FillTheList(): x=0 ThisList = [] with open("Specifications.txt", 'r') as infile: for lineEQN in infile: # loop to find each line in the file for that dose if lineEQN[0:1] == "-": ListItem = lineEQN[1:6].strip() ThisList.append(ListItem) return(ThisList) #==================================================================== def EditDataByForm(): import tkinter as tk from tkinter import ttk import sys window = tk.Tk() window.title("Python Tkinter Text Box") window.minsize(700,700) #height, width #=============================================================== def GetLineByItem(DataType): #get line by item in column 3 - 5 #print("DataType = " + DataType) DataLetter = DataType[0:1] if DataLetter.isupper(): # == "Specs": FileToBeEdited = "Specifications.txt" else: FileToBeEdited = "DataSpecifications.txt" with open(FileToBeEdited, 'r') as infile: for lineEQN in infile: # loop to find each line in the file for that dose if ((lineEQN[1:2]== DataLetter)): A = lineEQN[1:46] # Whole Line a = lineEQN[34:46].strip() # Just the Data # print("A = " + A ) # print("a = " + a) return(A, a) #=============================================================== def ClickSubmit(): window.destroy() #=============================================================== label = ttk.Label(window, text = "Enter the new readings") label.grid(column = 1, row = 1) ThisList = FillTheList() x = 3 # Allows for two rows at the top of the form used for headers y = 0 # Scans the datafile to fill the list for lineItem in range(len(ThisList)): SpecLine, Spec = GetLineByItem(ThisList[y]) OldSpec = Spec #print("OldSpec = " + OldSpec) NewSpec = " " SVRlabel = ttk.Label(window, text = SpecLine + " "*5) SVRlabel.grid(column = 1, row = x) NewSpec = tk.StringVar() SVRCodeEntered = ttk.Entry(window, width = 15, textvariable = NewSpec) SVRCodeEntered.grid(column = 2, row = x, pady = 15) print("x , y = " + str(x) + ", " + str(y)) print("OldSpec2 = <" + OldSpec + "> ") #Use of <> show spaces if any #81 The next line seems to run only once at the end of the FOR loop <<<<<<<<<<<<<< SVRCodeEntered.insert(0, OldSpec) SVRCodeEntered.focus_set() x += 1 y += 1 #=============================================================== button = ttk.Button(window, text = "Submit", command = ClickSubmit) button.grid(column= 2, row = 15) window.mainloop() ------------------------------------------------------ Specifications.txt. This will align when using Notepad++. A LTD Last Time Date 2020-08-29 00:55:18.610102 ## B LDL Last Dose Line 2020-08-29 00:55:18.610102 ## C LLL Last LTD line 2020-08-29 00:55:18.610102 ## D LTD Last Time Date 2020-08-29 00:55:18.610102 ## - -E MSN Monitor Serial Number JNGY263-T4464 ## - -F TSL TestStrip Lot Number 45001 82990 ## -G SED Strip Expire Date 2021-05-31 ## - -H SSC Sensor Sequence Code 71 ## -I SCN Sensor Code Number G03 ## -J SSN Sensor Serial Number 2021-01-31 ## -K SDE Sensor Date to Expire 2021-01-31 ## -L SDN Sensor Day Number 12 ## -M FDS First Date for Sensor Fri Aug 17, 2020 09:34 ## - -N IDT Insulin Dose Total 450 ## O DTD Data Time Date Fri Aug 07, 2020 21:30 ## P PTD Previous Time Date Thu Nov 27, 1952 14:30 ## - Q HL1 Half Life 1 1 ## R HL2 Half LIfe 2 2 ## S HL3 Half Life 3 3 ## T TIL Total Insulin Layer 25 ## ---------------------------------------------------------------------------- ------------------- Footnote: The power company in Utah has built the Sisyphus train. When there is a surplus of available energy from their massive collection of solar cells, they use it to drive a train up a hill. At night when the need power, they ease the train down to generate energy to fill the gap. -

2 2

Re: Threading plus multiprocessing plus cv2 error
by John O'Hagan Aug. 30, 2020

Aug. 30, 2020

On Sat, 29 Aug 2020 13:01:12 -0400 Dennis Lee Bieber <wlfraed(a)ix.netcom.com> wrote: > On Sat, 29 Aug 2020 18:24:10 +1000, John O'Hagan > <research(a)johnohagan.com> declaimed the following: > > >There's no error without the sleep(1), nor if the Process is started > >before the Thread, nor if two Processes are used instead, nor if two > >Threads are used instead. IOW the error only occurs if a Thread is > >started first, and a Process is started a little later. > > > >Any ideas what might be causing the error? > > > > Under Linux, multiprocessing creates processes using fork(). > That means that, for some fraction of time, you have TWO processes > sharing the same thread and all that entails (if it doesn't overlay > the forked process with a new executable, they are sharing the thread > until the thread exits). > > https://stackoverflow.com/questions/54466572/how-to-properly-multithread-in… > (which points to) > https://answers.opencv.org/question/32415/thread-safe/?answer=32452#post-id… > """ > The library itself is thread safe in that you can have multiple calls > into the library at the same time, however the data is not always > thread safe. """ > > The sleep(1), when compounded with the overhead of starting > the thread, and then starting the process, likely means the thread > had exited before the process actually is started. Try replacing the > sleep(2) in the work code with something like sleep(30) -- I > hypothesize that you'll get the same error condition even with the > sleep(1) in place. > > Thanks for the reply. You're right, the error also happens with a longer sleep, or no sleep at all, inside the function. That sleep is only there in the example to keep the windows open long enough to see the images if they are successfully displayed. I could well be wrong as I'm not fully across multiprocessing, but I think the Stackoverflow question and answer you linked above relate to a different situation, with multithreaded cv2 operations on shared image data. In my example, AFAIK (which is not very far) it shouldn't matter whether the new process is sharing the thread, or whether the thread has exited, because the thread and the process aren't using the same data. Or (as is quite likely) am I misunderstanding your point? Cheers John

1 0

Re: Silly question, where is read() documented?
by Chris Green Aug. 30, 2020

Aug. 30, 2020

Terry Reedy <tjreedy(a)udel.edu> wrote: > On 8/29/2020 12:18 PM, Chris Green wrote: > > Well it sounds a silly question but I can't find the documentation for > > read(). It's not a built-in function and it's not documented with > > (for example) the file type object sys.stdin. > > sys.stdin is of no particular type, but must at least have a .read method. > > > So where is it documented? :-) > > >>> import sys; sys.stdin > should give a hint. In the standard REPL, > > <_io.TextIOWrapper name='<stdin>' mode='r' encoding='utf-8'> > > As others said, actually look in the io module doc. You might spend > some time reading the doc to get an idea of what is going on. If you > run from IDLE, you currently get > > <idlelib.run.StdInputFile object at 0x00000243F6D6FBB0> > (I should make that more like the REPL answer.) > Yes, quite! :-) All I actually wanted to find out was the difference between what is returned by sys.stdin.read() in Python 2 and Python 3 as that turned out to be the fundamental cause of the mail handling problem I have been airing in other threads here. -- Chris Green ·

1 0

Re: Where read() is documented
by Chris Green Aug. 30, 2020

Aug. 30, 2020

MRAB <python(a)mrabarnett.plus.com> wrote: > On 2020-08-29 17:48, Chris Green wrote: > > Stefan Ram <ram(a)zedat.fu-berlin.de> wrote: > >> Chris Green <cl(a)isbd.net> writes: I can't find the documentation for > >> >read(). It's not a built-in function and it's not documented with > >> >(for example) the file type object sys.stdin. > >> > >> |read() (asyncio.StreamReader method), 894 > >> |read() (chunk.Chunk method), 1385 > >> |read() (codecs.StreamReader method), 164 > >> |read() (configparser.ConfigParser method), 537 > >> |read() (http.client.HTTPResponse method), 1276 > >> |read() (imaplib.IMAP4 method), 1291 > >> |read() (in module os), 578 > >> |read() (io.BufferedIOBase method), 622 > >> |read() (io.BufferedReader method), 625 > >> |read() (io.RawIOBase method), 621 > >> |read() (io.TextIOBase method), 626 > >> |read() (mimetypes.MimeTypes method), 1146 > >> |read() (mmap.mmap method), 1053 > >> |read() (ossaudiodev.oss_audio_device method), 1388 > >> |read() (ssl.MemoryBIO method), 1024 > >> |read() (ssl.SSLSocket method), 1005 > >> |read() (urllib.robotparser.RobotFileParser method), 1268 > >> |read() (zipfile.ZipFile method), 499 > >> Index of "The Python Library Reference, Release 3.9.0a3" > >> > >> > > But none of those is the documentation for read(), they're just places > > that refer to read(). > > > There's no read() function. What you're referring to are the 'read' > methods of various classes. > Yes, OK, method rather than function. > If you open a file in text mode, you'll get an instance of > TextIOWrapper, which inherits .read from TextIOBase. > > If you open a file in binary mode, you'll get an instance of > BufferedReader, which has a .read method. > > Multiple classes, each with its own 'read' method. > > sys.stdin is an instance of TextIOWrapper, so for that you should look > at the methods of TextIOWrapper. I went to sys.stdin but it didn't really lead me easily to the read() method. All I actually wanted to know was what was the type of the return value of the read() method which is different in Python 2 and 3. -- Chris Green ·

1 0

Re: Python 3 how to convert a list of bytes objects to a list of strings?
by Chris Green Aug. 30, 2020

Aug. 30, 2020

Cameron Simpson <cs(a)cskk.id.au> wrote: > On 29Aug2020 16:50, Chris Green <cl(a)isbd.net> wrote: > >However the problem appears to be that internally in Python 3 mailbox > >class there is an assumption that it's being given 'ascii'. Here's > >the error (and I'm doing no processing of the message at all):- > > > > Traceback (most recent call last): > > File "/home/chris/.mutt/bin/filter.py", line 102, in <module> > > mailLib.deliverMboxMsg(dest, msg, log) > > File "/home/chris/.mutt/bin/mailLib.py", line 52, in deliverMboxMsg > > mbx.add(msg) > [...] > > Here is the entire save-to-mbox code form my own mailfiler: > > text = M.as_string(True).replace('\nFrom ', '\n>From ') > with open(folderpath, "a") as mboxfp: > mboxfp.write(text) > > where M is the current message, a Message object. > > Note that this does _not_ assume ASCII output. The process here is: > > - transcribe the message to a Python 3 str (so Unicode code points) > - replace embedded "From " to protect the mbox format > - open the mbox for append - the _default_ encoding is utf-8 > - write the message in utf-8 because of the open mode > > This sidesteps the library you're using which may well do something > ASCII based. And it has _never_ failed for me. > Thanks Caneron, but I have now finally fixed my problem, see the new thread. -- Chris Green ·

1 0

Re: Python 3 how to convert a list of bytes objects to a list of strings?
by Chris Green Aug. 30, 2020

Aug. 30, 2020

Karsten Hilbert <Karsten.Hilbert(a)gmx.net> wrote: > > However the problem appears to be that internally in Python 3 mailbox > > class there is an assumption that it's being given 'ascii'. > > Do you really _need_ the mailbox class ? From what you've > written so far my understanding was that you receive data > (bytes) and want to append that to a file (which happens > to be an mbox). > > Can't you "just do that" ? > > IOW, read the bytes, open the file, dump the bytes, close the file ? > This would have been my next approach but see the new thread I've started about this. The fis was to change the read from stdin so that it produced bytes instead of a string. The bytes are fed into the mailbox class and it no longer tries to decode them. -- Chris Green ·

1 0