🌐 Mailman 3 September 2006 - Python-list - python.org

$HOSTNAME not in os.environ?
by slinkp＠gmail.com Sept. 1, 2006

Sept. 1, 2006

Can anybody explain this one? pw@kermit ~ $ python Python 2.4.3 (#1, Jul 27 2006, 13:07:44) [GCC 3.4.6 (Gentoo 3.4.6-r1, ssp-3.4.5-1.0, pie-8.7.9)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import os >>> os.environ['HOSTNAME'] Traceback (most recent call last): File "<stdin>", line 1, in ? File "/usr/lib64/python2.4/UserDict.py", line 17, in __getitem__ def __getitem__(self, key): return self.data[key] KeyError: 'HOSTNAME' >>> print os.getenv('HOSTNAME') None >>> pw@kermit ~ $ echo $HOSTNAME kermit pw@kermit ~ $ uname -a Linux kermit 2.6.17-gentoo-r4amd64-preempt-noapic #1 PREEMPT Thu Jul 27 12:56:53 EDT 2006 x86_64 AMD Athlon(tm) 64 Processor 3500+ GNU/Linux i-swear-it-used-to-be-there-ly-y'rs, Paul Winkler

3 2

Re: Threads and Progress Bar
by Ritesh Raj Sarraf Sept. 1, 2006

Sept. 1, 2006

Dennis Lee Bieber on Friday 01 Sep 2006 23:04 wrote: > Well... first off -- some minimal code would be of use... > I was scared that people might feel that I'm asking for a ready-made solution. :-) Here's the code. The is the progress bar code. progressbar.py class progressBar: def __init__(self, minValue = 0, maxValue = 10, totalWidth=12): self.progBar = "[]" # This holds the progress bar string self.min = minValue self.max = maxValue self.span = maxValue - minValue self.width = totalWidth self.amount = 0 # When amount == max, we are 100% done self.updateAmount(0) # Build progress bar string def updateAmount(self, newAmount = 0): if newAmount < self.min: newAmount = self.min if newAmount > self.max: newAmount = self.max self.amount = newAmount # Figure out the new percent done, round to an integer diffFromMin = float(self.amount - self.min) percentDone = (diffFromMin / float(self.span)) * 100.0 percentDone = round(percentDone) percentDone = int(percentDone) # Figure out how many hash bars the percentage should be allFull = self.width - 2 numHashes = (percentDone / 100.0) * allFull numHashes = int(round(numHashes)) # build a progress bar with hashes and spaces self.progBar = "[" + '#'*numHashes + ' '*(allFull-numHashes) + "]" # figure out where to put the percentage, roughly centered percentPlace = (len(self.progBar) / 2) - len(str(percentDone)) percentString = str(percentDone) + "%" # slice the percentage into the bar self.progBar = self.progBar[0:percentPlace] + percentString + self.progBar[percentPlace+len(percentString):] \ + " " + str(newAmount/1024) + "KB of " + str(self.max/1024) + "KB" def __str__(self): return str(self.progBar) def myReportHook(count, blockSize, totalSize): import sys global prog prog = "" if prog == "": prog = progressBar(0,totalSize,50) prog.updateAmount(count*blockSize) sys.stdout.write (str(prog)) sys.stdout.write ("\r") #print count * (blockSize/1024) , "kb of " , (totalSize/1024) , "kb downloaded.\n" Here's the function, download_from_web() which calls the progress bar: main.py def download_from_web(sUrl, sFile, sSourceDir, checksum): try: block_size = 4096 i = 0 counter = 0 os.chdir(sSourceDir) temp = urllib2.urlopen(sUrl) headers = temp.info() size = int(headers['Content-Length']) data = open(sFile,'wb') log.msg("Downloading %s\n" % (sFile)) while i < size: data.write (temp.read(block_size)) i += block_size counter += 1 progressbar.myReportHook(counter, block_size, size) print "\n" data.close() temp.close() And since I later implemented threads, multiple threads call download_from_web() concurrently, which in effect calls progress bar, thus I get a progress bar which continuously keeps getting overwritten. :-) Here's the code where multiple threads execute: try: lRawData = open(uri, 'r').readlines() except IOError, (errno, strerror): log.err("%s %s\n" % (errno, strerror)) errfunc(errno, '') #INFO: Mac OS is having issues with Python Threading. # Use the conventional model for Mac OS if sys.platform == 'darwin': log.verbose("Running on Mac OS. Python doesn't have proper support for Threads on Mac OS X.\n") log.verbose("Running in the conventional non-threaded way.\n") for each_single_item in lRawData: (sUrl, sFile, download_size, checksum) = stripper(each_single_item) if download_from_web(sUrl, sFile, sSourceDir, None) != True: #sys.stderr.write("%s not downloaded from %s\n" % (sFile, sUrl)) #sys.stderr.write("%s failed\n\n" % (sFile)) variables.errlist.append(sFile) pass else: if zip_bool: compress_the_file(zip_type_file, sFile, sSourceDir) os.remove(sFile) # Remove it because we don't need the file once it is zipped. else: #INFO: Thread Support if variables.options.num_of_threads > 1: log.msg("WARNING: Threads is still in alpha stage. It's better to use just a single thread at the moment.\n") log.warn("Threads is still in alpha stage. It's better to use just a single thread at the moment.\n") NUMTHREADS = variables.options.num_of_threads name = threading.currentThread().getName() ziplock = threading.Lock() def run(request, response, func=download_from_web): '''Get items from the request Queue, process them with func(), put the results along with the Thread's name into the response Queue. Stop running once an item is None.''' while 1: item = request.get() if item is None: break (sUrl, sFile, download_size, checksum) = stripper(item) response.put((name, sUrl, sFile, func(sUrl, sFile, sSourceDir, None))) # This will take care of making sure that if downloaded, they are zipped (thread_name, Url, File, exit_status) = responseQueue.get() if exit_status == True: if zip_bool: ziplock.acquire() try: compress_the_file(zip_type_file, File, sSourceDir) os.remove(File) # Remove it because we don't need the file once it is zipped. finally: ziplock.release() else: variables.errlist.append(File) pass # Create two Queues for the requests and responses requestQueue = Queue.Queue() responseQueue = Queue.Queue() # Pool of NUMTHREADS Threads that run run(). thread_pool = [ threading.Thread( target=run, args=(requestQueue, responseQueue) ) for i in range(NUMTHREADS) ] # Start the threads. for t in thread_pool: t.start() # Queue up the requests. for item in lRawData: requestQueue.put(item) # Shut down the threads after all requests end. # (Put one None "sentinel" for each thread.) for t in thread_pool: requestQueue.put(None) # Don't end the program prematurely. # # (Note that because Queue.get() is blocking by # defualt this isn't strictly necessary. But if # you were, say, handling responses in another # thread, you'd want something like this in your # main thread.) for t in thread_pool: t.join() > Second... It sounds like you only created one progress bar, and each > thread is referencing that single bar. I'd suspect you need to create a > bar for EACH thread you create, and tell the thread which bar to update. Yes, you're correct. That's what I'm also suspecting. I tried to do some minor changes but couldn't succeed. Request you to, if you reply with code, give a little explanation so that I can understand and learn from it. Thanks, Ritesh -- Ritesh Raj Sarraf RESEARCHUT - http://www.researchut.com "Necessity is the mother of invention." "Stealing logic from one person is plagiarism, stealing from many is research." "The great are those who achieve the impossible, the petty are those who cannot - rrs"

1 0

RE: Newbie question involving buffered input
by Caolan Sept. 1, 2006

Sept. 1, 2006

That makes sense I suppose - why is there a stdin.flush() method then? ________________________________ From: python-list-bounces+caolan=ldmf.net(a)python.org on behalf of Jean-Paul Calderone Sent: Fri 9/1/2006 9:53 AM To: python-list(a)python.org Subject: Re: Newbie question involving buffered input On Fri, 1 Sep 2006 09:31:11 -0700, Caolan <caolan(a)ldmf.net> wrote: >I am executing the code below on a Windows XP system and if I enter > 2 characters it buffers the input and the call to sys.stdin.flush does not flush the input, it remains buffered. You cannot flush input. The flush method only relates to output. The *other* side of the file has to flush *its* output in order for you to see it as input. On Linux, the termios module provides a way to tell the system not to do any buffering on a file descriptor. pywin32 may expose equivalent functionality for Windows. Jean-Paul -- http://mail.python.org/mailman/listinfo/python-list

1 0

Re: disgrating a list
by Hardcoded Software Sept. 1, 2006

Sept. 1, 2006

Tim Chase wrote: > >>> def flatten(x): > ... q = [] > ... for v in x: > ... if hasattr(v, '__iter__'): > ... q.extend(flatten(v)) > ... else: > ... q.append(v) > ... return q > ... Let's do some nitpicking on "pythonic" style. A more pythonic way to do it would be: try: q.extend(v) except TypeError: q.append(v)

1 0

Re: a question about ftplib
by Gabriel G Sept. 1, 2006

Sept. 1, 2006

At Friday 1/9/2006 06:32, alper soyler wrote: >Thank you very much for your help. The program works however, after >downloading 121 '.pep' files, it gave me time out error: > >Traceback (most recent call last): > File "ftp1.0.py", line 18, in ? > for filename in ftp.nlst(): > ... > File "/usr/lib/python2.4/ftplib.py", line 324, in ntransfercmd > conn.connect(sa) > File "<string>", line 1, in connect >socket.error: (110, 'Connection timed out') > >How can I continue from the last download or is there any way to >arrange the time? Thank you very much. You can change the default timeout for sockets with socket.setdefaulttimeout(secs) (this is a module function; call it at the beginning of your script). To continue from the last download, you could skip downloading files when they already exist on your disk: before opening it for write, use os.path.exists(full_filename) to detect it, and skip the download part. If you want to continue even after an exception happens, use the try/except syntax. I don't have your code at hand to show the details, but it was something like: for directory in dirlist: cwd(directory) for filename in directory: download file You may want to change it to: for directory in dirlist: try: cwd(directory) for filename in directory: if (filename already exists): continue try: download file except: print '%s: %s' % sys.exc_info()[:2] except: print '%s: %s' % sys.exc_info()[:2] This way, if an error happens within downloading a file, goes on the next; and if an error happens procesing a directory, goes on the next too. As a general guide, bare except clauses (that is, without a matching exception class) are not good, but for an utility script like yours I think it's fine. Gabriel Genellina Softlab SRL __________________________________________________ Pregunt�. Respond�. Descubr�. Todo lo que quer�as saber, y lo que ni imaginabas, est� en Yahoo! Respuestas (Beta). �Probalo ya! http://www.yahoo.com.ar/respuestas

1 0

Strange import behavior
by unexpected Sept. 1, 2006

Sept. 1, 2006

Hey guys, I'm having problems importing a file into my python app. Everytime I try to define the object specified by this file, i.e, test = Test(), It raises an ImportError exception: ImportError: cannot import name Test. I've declared it as: from test import Test (and I've also tried from test import *) As luck would have it, if I try creating a newfile (say test2) and then declare the same class as: from test2 import Test() It works fine! I tried doing this with the first couple of files, but then another error crops up for another file giving me this ImportError...so I'd end up having to re-copy a bunch of files over again. I feel like there may be some sort of dependency screw up or whatever..Is there a command that's like "Python, chill, let's start from scratch and build this thing"?

3 2

Re: OO on python real life tutorial?
by filippo Sept. 1, 2006

Sept. 1, 2006

Fredrik Lundh ha scritto: > How many do you need ? ;-) (snip) thanks Fredrik, I know there are plenty of tutorials and manuals. I know what classes, inheritance and polymorphism are. My problem is that I cannot figure out how they can help me in my practical problem (my software). The only things I can imagine is to create some objects like "customer" but all I can do is to try to force the object to act like my "structured way of thinking" the problems. I will read your links, however. Thanks, Filippo

1 0

raw audio in windows
by Putty Sept. 1, 2006

Sept. 1, 2006

Hi. I've written a small python script that was primarily meant for use in a unix-compatible environment. It writes a bunch of raw audio to a file and then sends the file to /dev/audio and the system plays the audio. Very simple. Is there a simple way I could edit the script (which just uses the system call to do this) to run under windows? This is the code that would have to change: os.system("cat audioBuf > /dev/audio")

5 4

used to work at ungerer lab?
by lind Sept. 1, 2006

Sept. 1, 2006

1 1

Newbie question involving buffered input
by Caolan Sept. 1, 2006

Sept. 1, 2006

I am executing the code below on a Windows XP system and if I enter > 2 characters it buffers the input and the call to sys.stdin.flush does not flush the input, it remains buffered. What am I doing wrong here? Thanks, Caolan try: gooberselectX = sys.stdin.read(2) except IOError, e: print 'error reading from stdin device' except KeyboardInterrupt, e: print 'you cannot break. please use the \'q\' key to exit' else: try: sys.stdin.flush() except IOError, e: print 'error flushing buffered input'

2 1