RE: Python Newbie with a Python/MYSQL Question

Posted on 2012-03-19
Medium Priority
Last Modified: 2012-03-20
   I'm a Python newbie.  I have a pretty basic script that does a "select * from tablename" and returns two list of tuples.  The format of my TEST database looks like this:

mysql> select * from employee;
| id  | name   | dept       |
| 100 | Thomas | Sales      |   
| 200 | Jason  | Technology |  
| 300 | Mayla  | Technology |  

Open in new window

I want to have the column match the first record in the row.  For example, my first line would look like
id: 100 name: Thomas Dept: Sales
id:200 name: Jason  Dept: Techology
id: 300 name: Mayla Dept: Technology

Here's the last bock of my code with output:
         cursor.execute("SELECT * FROM" + ' ' + table)


         cfields=[i[0] for i in cursor.description]

         return cfields,data1


         print "Error: unable to fetch data"


def ColumnFields():

    return cfields

def main():


    print test1
    print test2

Open in new window

     Can someone please give me ideas on how to do this.  Also, for some reason, when I print this out, I get an extra letter in my output for the second tuple.  Why is this (the L shouldn't be there with the numbers)?  Also, why is my first output a list and not a tuple? Thanks in advance!!

['id', 'name', 'dept', ]
((100L, 'Thomas', 'Sales'), (200L, 'Jason', 'Technology'), (300L, 'Mayla', 'Technology',), (400L, 'Nisha', 'Marketing'), (500L, 'Randy', 'Technology'))
Question by:unix_admin777
  • 2
LVL 12

Assisted Solution

larsrohr earned 400 total points
ID: 37740894
Still learning python myself, but maybe I can help somewhat.

The L says that these are long integers; you could convert them to plain integers before printing by using int(x).

I think the first output is a list because it's defined that way via the brackets here:  cfields=[i[0] for i in cursor.description]

The other output is tuples as expected.

Looking forward to follow-up comments by you and other experts...
LVL 29

Expert Comment

ID: 37741058
Yes, larsrohr deserves his points :)

In 100L the L simply means that the long integer type is used by Python.  You should not care about it.  The long integer and the "normal" integer were merged in newer versions of Python.  Think about it as about implementation detail.

He is right also with the list/tuple answer.  The cfields = [i[0] for i in cursor.description] means that you are assigning the result of so called list comprehension to the cfields.

The equivalent code without using the list comprehension is:

    cfields = []    # init -- empty list
    for i in cursor.description:

Open in new window

To dig deeper, the i[0] for i in cursor.description is a generator expression that returns iterator.  The iterator goes through all values of i[0] where i goes through all values from another iterator returned by the cursor.description.

Try cfields = tuple([i[0] for i in cursor.description) instead (i.e. feed the tuple constructor with the results of the same generator expression instead of enclosing in the square brackets).  In other words, the square brackets in the list comprehension could be viewed as a syntactic sugar for the cfields = list([i[0] for i in cursor.description)

A side note, the cursor.execute("SELECT * FROM" + ' ' + table) can be a bit simplified as cursor.execute('SELECT * FROM ' + table).  Single quotes and double quotes have exactly the same meaning -- you can choose.  There is no char type in Python 'x' is not a character like in the C language.  It is only a single-letter string.
LVL 29

Accepted Solution

pepr earned 1600 total points
ID: 37741307
I did not noticed... Here is the code that shows how to format your extracted data:

def formatRecord(names, values):

    # There should be the same number of the elements in the input sequences.
    assert len(names) == len(values)

    # The built-in zip() function is capable to merge two or more sequences.
    # Here we get the mixture of field names and of its values.  Generally,
    # we may not know, how many of the elements are processed.  Let's do it
    # in the loop.  Let's form the list of 'name: value' strings.
    lst = []                                 # init
    for name, value in zip(names, values):   # could be   for t in zip(...)
        s = '%s: %s' % (name, value)         # could be     s = '%s: %s' % t
    # Now get the result via joining the list of substrints into one 
    # string.  (The lst intermediary step makes it usually more efficient
    # because strings in Python are immutable and each "modification of a string"
    # actually means "construction of a new string and throwing away the old one".
    return '\t'.join(lst)
if __name__ == '__main__':

    # Let's pretend we extracted the following.
    cfields = ('id', 'name', 'dept')
    data = ((100L, 'Thomas', 'Sales'),
            (200L, 'Jason', 'Technology'),
            (300L, 'Mayla', 'Technology',),
            (400L, 'Nisha', 'Marketing'),
            (500L, 'Randy', 'Technology')

    # Now loop through the data, form and print the output.
    for row in data:
        print formatRecord(cfields, row)

Open in new window

It prints on my console (fields separated by tabulator):

c:\tmp\___python\unix_admin777\Q27639533>python a.py
id: 100 name: Thomas    dept: Sales
id: 200 name: Jason     dept: Technology
id: 300 name: Mayla     dept: Technology
id: 400 name: Nisha     dept: Marketing
id: 500 name: Randy     dept: Technology

Open in new window


Author Closing Comment

ID: 37745299
Thanks for all of the help.  The explanations were excellent as well.

Featured Post

Free Tool: Port Scanner

Check which ports are open to the outside world. Helps make sure that your firewall rules are working as intended.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When you see single cell contains number and text, and you have to get any date out of it seems like cracking our heads.
Originally, this post was published on Monitis Blog, you can check it here . In business circles, we sometimes hear that today is the “age of the customer.” And so it is. Thanks to the enormous advances over the past few years in consumer techno…
The viewer will learn how to count occurrences of each item in an array.
Screencast - Getting to Know the Pipeline
Suggested Courses

621 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question