RE: Python Newbie with a Python/MYSQL Question

Posted on 2012-03-19
Last Modified: 2012-03-20
   I'm a Python newbie.  I have a pretty basic script that does a "select * from tablename" and returns two list of tuples.  The format of my TEST database looks like this:

mysql> select * from employee;
| id  | name   | dept       |
| 100 | Thomas | Sales      |   
| 200 | Jason  | Technology |  
| 300 | Mayla  | Technology |  

Open in new window

I want to have the column match the first record in the row.  For example, my first line would look like
id: 100 name: Thomas Dept: Sales
id:200 name: Jason  Dept: Techology
id: 300 name: Mayla Dept: Technology

Here's the last bock of my code with output:
         cursor.execute("SELECT * FROM" + ' ' + table)


         cfields=[i[0] for i in cursor.description]

         return cfields,data1


         print "Error: unable to fetch data"


def ColumnFields():

    return cfields

def main():


    print test1
    print test2

Open in new window

     Can someone please give me ideas on how to do this.  Also, for some reason, when I print this out, I get an extra letter in my output for the second tuple.  Why is this (the L shouldn't be there with the numbers)?  Also, why is my first output a list and not a tuple? Thanks in advance!!

['id', 'name', 'dept', ]
((100L, 'Thomas', 'Sales'), (200L, 'Jason', 'Technology'), (300L, 'Mayla', 'Technology',), (400L, 'Nisha', 'Marketing'), (500L, 'Randy', 'Technology'))
Question by:unix_admin777
  • 2
LVL 12

Assisted Solution

larsrohr earned 100 total points
ID: 37740894
Still learning python myself, but maybe I can help somewhat.

The L says that these are long integers; you could convert them to plain integers before printing by using int(x).

I think the first output is a list because it's defined that way via the brackets here:  cfields=[i[0] for i in cursor.description]

The other output is tuples as expected.

Looking forward to follow-up comments by you and other experts...
LVL 28

Expert Comment

ID: 37741058
Yes, larsrohr deserves his points :)

In 100L the L simply means that the long integer type is used by Python.  You should not care about it.  The long integer and the "normal" integer were merged in newer versions of Python.  Think about it as about implementation detail.

He is right also with the list/tuple answer.  The cfields = [i[0] for i in cursor.description] means that you are assigning the result of so called list comprehension to the cfields.

The equivalent code without using the list comprehension is:

    cfields = []    # init -- empty list
    for i in cursor.description:

Open in new window

To dig deeper, the i[0] for i in cursor.description is a generator expression that returns iterator.  The iterator goes through all values of i[0] where i goes through all values from another iterator returned by the cursor.description.

Try cfields = tuple([i[0] for i in cursor.description) instead (i.e. feed the tuple constructor with the results of the same generator expression instead of enclosing in the square brackets).  In other words, the square brackets in the list comprehension could be viewed as a syntactic sugar for the cfields = list([i[0] for i in cursor.description)

A side note, the cursor.execute("SELECT * FROM" + ' ' + table) can be a bit simplified as cursor.execute('SELECT * FROM ' + table).  Single quotes and double quotes have exactly the same meaning -- you can choose.  There is no char type in Python 'x' is not a character like in the C language.  It is only a single-letter string.
LVL 28

Accepted Solution

pepr earned 400 total points
ID: 37741307
I did not noticed... Here is the code that shows how to format your extracted data:
def formatRecord(names, values):

    # There should be the same number of the elements in the input sequences.
    assert len(names) == len(values)

    # The built-in zip() function is capable to merge two or more sequences.
    # Here we get the mixture of field names and of its values.  Generally,
    # we may not know, how many of the elements are processed.  Let's do it
    # in the loop.  Let's form the list of 'name: value' strings.
    lst = []                                 # init
    for name, value in zip(names, values):   # could be   for t in zip(...)
        s = '%s: %s' % (name, value)         # could be     s = '%s: %s' % t
    # Now get the result via joining the list of substrints into one 
    # string.  (The lst intermediary step makes it usually more efficient
    # because strings in Python are immutable and each "modification of a string"
    # actually means "construction of a new string and throwing away the old one".
    return '\t'.join(lst)
if __name__ == '__main__':

    # Let's pretend we extracted the following.
    cfields = ('id', 'name', 'dept')
    data = ((100L, 'Thomas', 'Sales'),
            (200L, 'Jason', 'Technology'),
            (300L, 'Mayla', 'Technology',),
            (400L, 'Nisha', 'Marketing'),
            (500L, 'Randy', 'Technology')

    # Now loop through the data, form and print the output.
    for row in data:
        print formatRecord(cfields, row)

Open in new window

It prints on my console (fields separated by tabulator):

id: 100 name: Thomas    dept: Sales
id: 200 name: Jason     dept: Technology
id: 300 name: Mayla     dept: Technology
id: 400 name: Nisha     dept: Marketing
id: 500 name: Randy     dept: Technology

Open in new window


Author Closing Comment

ID: 37745299
Thanks for all of the help.  The explanations were excellent as well.

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

Suggested Solutions

Displaying an arrayList in a listView using the default adapter is rarely the best solution. To get full control of your display data, and to be able to refresh it after editing, requires the use of a custom adapter.
Entering a date in Microsoft Access can be tricky. A typo can cause month and day to be shuffled, entering the day only causes an error, as does entering, say, day 31 in June. This article shows how an inputmask supported by code can help the user a…
This tutorial will teach you the core code needed to finalize the addition of a watermark to your image. The viewer will use a small PHP class to learn and create a watermark.
In this seventh video of the Xpdf series, we discuss and demonstrate the PDFfonts utility, which lists all the fonts used in a PDF file. It does this via a command line interface, making it suitable for use in programs, scripts, batch files — any pl…

760 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now