🌐 Mailman 3 July 2007 - Python-list - python.org

Removing certain tags from html files
by sebzzz＠gmail.com July 28, 2007

July 28, 2007

Hi, I'm doing a little script with the help of the BeautifulSoup HTML parser and uTidyLib (HTML Tidy warper for python). Essentially what it does is fetch all the html files in a given directory (and it's subdirectories) clean the code with Tidy (removes deprecated tags, change the output to be xhtml) and than BeautifulSoup removes a couple of things that I don't want in the files (Because I'm stripping the files to bare bone, just keeping layout information). Finally, I want to remove all trace of layout tables (because the new layout will be in css for positioning). Now, there is tables to layout things on the page and tables to represent tabular data, but I think it would be too hard to make a script that finds out the difference. My question, since I'm quite new to python, is about what tool I should use to remove the table, tr and td tags, but not what's enclosed in it. I think BeautifulSoup isn't good for that because it removes what's enclosed as well. Is re the good module for that? Basically, if I make an iteration that scans the text and tries to match every occurrence of a given regular expression, would it be a good idea? Now, I'm quite new to the concept of regular expressions, but would it ressemble something like this: re.compile("<table.*>")? Thanks for the help.

3 3

Re: Imported globals?
by star.public＠gmail.com July 28, 2007

July 28, 2007

On Jul 27, 1:30 pm, Valentina Vaneeva <fat...(a)tpu.ru> wrote: > Thank you, Gary, but I still have one question. What happens in the > second case? If I add a call to change_value() to module_a, the value > in module_b is imported changed. Why? What exactly does the import > statement import in my example? Because then by the time you import the thing, that action has been carried out. Consider: from module_a import change_value change_value() from module a import value print value It's not significantly different from this: ----- class NotaModule(object): pass nota = NotaModule() nota.a = 1 def change_it(): global nota # not even sure you need this nota.a = 2 a = nota.a change_it() print a, nota.a ------ Modules and (singleton) objects are rather similar from the outside, afaik. Also consider that this is yet another case where if value or A was a list and you appended to it, both prints would show the change, mutable objects, etc. -- Tired Weaver

3 2

Re: Packages
by Kevin T. Ryan July 28, 2007

July 28, 2007

On Jul 27, 7:21 pm, Alex Popescu <nospam.themindst...(a)gmail.com> wrote: > "Kevin T. Ryan" <kevin.t.r...(a)gmail.com> wrote innews:1185576929.136179.174440@b79g2000hse.googlegroups.com: > > > > > Hi All - > > > I'm having a problem and I hope you can help. I can't seem to import > > packages from within the package substructure as I think I should be > > able to. For example, I create a directory structure as follows: > > > testpkg > > __init__.py [empty] > > testsub1/ > > __init__.py [empty] > > bad.py [import testpkg.testsub2.good; print "hello from bad"] <- > > error > > testsub2/ > > __init__.py [empty] > > good.py [print "hello from good"] > > > Whenever I try to run bad.py (just python bad.py from within the > > testsub2 subdirectory or from above the testpkg directory) I get an > > error. For example: > > > $ python testpkg/testsub1/bad.py > > Traceback (most recent call last): > > File "testpkg/testsub1/bad.py", line 1, in <modul > > import testpkg.testsub2.good > > ImportError: No module named testpkg.testsub2.good > > > How can I get my subpackages to recognize other subpackages in the > > same top-level package? Thanks in advance!! > > > Kevin > > When executing bad.py python will be looking for imported module (in the > standard path) and then in your current directory (so to find it you > should have testsub1/testpkg/testsub2). You can solve this by adding > your toplevel director (the parent of testpkg) to the PYTHONPATH. > > bests, > ./alex > -- > .w( the_mindstorm )p. Ok, thanks. I was under the impression that this wouldn't be necessary (eg, see http://docs.python.org/tut/node8.html#SECTION008420000000000000000), but perhaps I was wrong. Thanks again for the advice :)

1 0

Re: Factory pattern again
by cunheise＠yahoo.com.cn July 28, 2007

July 28, 2007

first you need find the bottleneck of your script db or function if the bottleneck is db 1. which db do you use do you optimize the db from read 2. the sql you write do not use any index "maybe select code, type from products where type = 'I' or type = 'S' will help" and you need create index on type field maybe you need set limit 2000 to sql depend on your requirement On Jul 27, 11:26 pm, Mike Howarth <h...(a)mikehowarth.co.uk> wrote: > Having overcome my first hurdle with the factory pattern, I've now hit > another stumbling block > > At the moment I'm trying to return around 2000 records from a db and load up > the relevant product object, what I've found is this is running extremely > slowly (> 20mins), the db is normalized and indexes exist. > > Can anyone advise on how best I could speed this up? > > def getWebRangeProducts(self): > > if self.c.connected: > > cu = self.c.cursor #create the cursor > > sql = "SELECT type, code FROM products" > > cu.execute(sql) > > if cu.rowcount > 0: > > rows = cu.fetchall() > > for row in rows: > > self.loadProduct(row[0].strip(),row[1].strip()) > > return self.products > > def loadProduct(self,type,product_code): > > print type + ":" + product_code > > if type == 'I': > > try: > product = factory('Item', product_code) > self.products.append(product) > except: > print 'problem occured:' + type + ':' + product_code > > elif type == 'S': > > try: > item_set = factory('Set', product_code) > item_set.getItems() > self.products.extend(item_set.getItems()) > except: > print 'problem occured:' + type + ':' + product_code > > else: > pass > > > > Bruno Desthuilliers-5 wrote: > > > Mike Howarth a �crit : > >> Hi > > >> I was wondering whether anyone could help me, I'm pretty new to python > >> coming from a PHP background and I'm having a few products in getting my > >> head round how to write the factory pattern within python. > > >> I'm currently looking to try to return values from a db and load up the > >> relevant objects, values returned are product type (I,S) and product code > >> (123). > > >> At the moment I've adapted some code I've found illustrating the factory > >> method but ideally I would like to use the type to load up the relevant > >> object. > > >> Another issue I've found is that I don't seem to be able to access to the > >> price attribute of each of the object. I'm sure these are very > >> straightforward issues however I seem to have tied myself in knots over > >> this > >> and could do with a fresh set of 'pythonic' eyes to help me out. > > >> registry = {} > > >> class MetaBase(type): > >> def __init__(cls, name, bases, dict): > >> registry[name] = cls > > >> class Product(object): > >> __metaclass__ = MetaBase > > >> class Item(Product): > >> def __init__(self, *args, **kw): > >> self.price = 1 > > >> class Set(Product): > >> def __init__(self, *args, **kw): > >> self.price = 2 > > >> def factory(kind, *args, **kw): > >> return registry[kind](*args, **kw) > > >> item = registry['Item'] > > > This returns the Item *class*, not an instance of... So the following: > > >> print item.price > > > cannot work, since price is an instance attribute, not a class attribute. > > > What you want is: > > > item = factory('Item') > > print item.price > > > HTH > > -- > >http://mail.python.org/mailman/listinfo/python-list > > -- > View this message in context:http://www.nabble.com/Factory-pattern-again-tf4156186.html#a11831500 > Sent from the Python - python-list mailing list archive at Nabble.com.

2 1

Re: adding a docstring to an instancemethod
by Steven D'Aprano July 28, 2007

July 28, 2007

On Fri, 27 Jul 2007 06:24:48 -0300, Gabriel Genellina wrote: > En Thu, 26 Jul 2007 14:48:12 -0300, jelle <jelleferinga(a)gmail.com> > escribió: > >> Hi Gabriella, >> thanks for pointing me in the right direction: > > Twice in a week... I'll have to revise my own masculinity... You need to spit and fart a lot in your posts, and talk about sport. Either that, or change your name to Sylar and eat people's brains. -- Steven.

1 0

Re: Comparing Dictionaries
by Steven D'Aprano July 28, 2007

July 28, 2007

On Fri, 27 Jul 2007 14:11:02 -0500, Kenneth Love wrote: > The published recipe (based on ConfigParser) did not handle my INI > files. I have periods in both the section names and the key names. > The INI files contents were developed according to an internally > defined process that other non-Python programs rely on. The published > recipe *did not work* with this scenario. I think you have made a mistake. ConfigParser as published certainly DOES accept periods in section and option names. It just *works*. Here's my INI file: [SECTION.FRED] option.wilma = 45 And here's how I read it: >>> import ConfigParser >>> D = ConfigParser.ConfigParser() >>> D.read('Desktop/data.ini') ['Desktop/data.ini'] >>> D.sections() ['SECTION.FRED'] >>> D.options('SECTION.FRED') ['option.wilma'] >>> D.getint('SECTION.FRED', 'option.wilma') 45 Even if the existing ConfigParser doesn't do what you want, the right way to fix the problem is not to recreate the entire module from scratch, but to subclass it: import ConfigParser class MyConfigParser(ConfigParser.ConfigParser): # Warning: untested. I haven't even looked at the source code # of the original. def getint(self, section, option): value = super(MyConfigParser, self).getint(section, option) return value + 1 (Although, it has to be said... if somebody can subclass ConfigParser so that writing a modified file doesn't remove comments, I'll be mightily impressed.) -- Steven.

1 0

Re: curses/urwid simple menu
by Lee Harr July 28, 2007

July 28, 2007

> SGVsbG8uIENvdWxkIHlvdSBoZWxwIG1lLi4uSSBuZWVkIHRvIGNyZWF0ZSBhcHBsaWNhdGlvbiB3 > aXRoIHVyd2lkIG9yIGN1cnNlcwpzdXBwb3J0LiBIYXZlIHlvdSBnb3QgYSBwcmV0dHkgc2ltcGxl > IGV4YW1wbGUgd2l0aCBpdD8KCgotLSAKUG96ZHJhd2lhbSBMZXN6ZWsgTWm2Ck5vdGhpbmcgaXMg > c2VjdXJlLCBwYXJhbm9pYSBpcyB5b3VyIGZyaWVuZC4K >>> s = '''SGVsbG8uIENvdWxkIHlvdSBoZWxwIG1lLi4uSSBuZWVkIHRvIGNyZWF0ZSBhcHBsaWNhdGlvbiB3 ... aXRoIHVyd2lkIG9yIGN1cnNlcwpzdXBwb3J0LiBIYXZlIHlvdSBnb3QgYSBwcmV0dHkgc2ltcGxl ... IGV4YW1wbGUgd2l0aCBpdD8KCgotLSAKUG96ZHJhd2lhbSBMZXN6ZWsgTWm2Ck5vdGhpbmcgaXMg ... c2VjdXJlLCBwYXJhbm9pYSBpcyB5b3VyIGZyaWVuZC4K''' >>> print s.decode('base64') Hello. Could you help me...I need to create application with urwid or curses support. Have you got a pretty simple example with it? I recommend that you post in plain text, since your message comes through like the above in my reader, and probably to other people also. Here is the first hit googling for python curses: http://www.amk.ca/python/howto/curses/ Here is an urwid tutorial: http://excess.org/urwid/tutorial.html

1 0

Re: problem with change to exceptions
by Paul Rubin July 27, 2007

July 27, 2007

Neal Becker <ndbecker2(a)gmail.com> writes: > should set self.args to None. Nothing wrong there, and what has this got to > do with NoneType being iterable? Probably the traceback constructor tried to iterate through the args. You should initialize the args to an empty tuple, not None. Also note that there's an arbitrary number of them. So you should probably write: class nothing (exceptions.Exception): def __init__ (self, *args): self.args = args You might also want to call Exception.__init__(*args) in the init func.

1 0

C++ Modules for python: How to?
by Robert Dailey July 27, 2007

July 27, 2007

Hi, I'm interested in making a C++ library of mine usable through python. Python does a similar thing with Expat (the non-validating XML parser). I notice that with Expat, python is importing a C++ header file into a PY file and the interface is available to python. I've read through the python documentation as well as done a little bit of google research and I've not been able to find a tutorial of some sort on how to do this. Perhaps I just don't know the right words to search for. If anyone could lead me in the right direction (possibly an article, tutorial, etc) I would greatly appreciate it.

3 6

OOP in Python book?
by Bill July 27, 2007

July 27, 2007

Does anyone out there have any information about this book. It's listed on Amazon to be published in November of this year. A simple Google search (1st page only) doesn't show anything useful, and I can't find a reference on the web sites of the authors. Neither of the authors appears to be heavily into OOP theory, just some CS areas that I don't understand. I'm particularly interested in why this book is worth the $100 tag that Amazon shows. TIA, Bill

2 1