[Reality] Python question--parsing

[Michael Dartt]

I'd really like to be able to use parse.py's Tokenizer to parse a given
text string.  The problem, of course, is that it calls tokenize(), which
wants a readline()-type argument.  Is there any function I can use that
will allow me to do this?

Right now, this is the code I have for __init__() in parse.py:

	def __init__(self, string):
		self.tokens=[]
		self._neg=None
		#self.fn=string #not sure why this is here...
		try: fd=open(string) # if it's a file, this will work 
		except IOError: # must just be a string
			import time
			x=time.time()
###Problem line--->	tokenize(string, self.eat)
			x=time.time()-x
			print 'Tokenization took %d seconds.' % x
			self.reset()
		else: # is a file
			import time
			x=time.time()
			tokenize(fd.readline,self.eat)
			x=time.time()-x
			print 'Tokenization took %d seconds.' % x	
			fd.close()
			self.reset()


I suppose I could use re for this, but I'd really rather not: this is much
more convenient for my purposes.

Thanks in advance for your help.  :-)


--Mike/Jedin