Question

Need help intigrating IDX data from real estate MLS. Total n00b needs help.

Asked by: loral

I create web pages for a real estate company; most pages are just following a template filling in information for properties for sale, or properties for rent.

The MLS system has been pushing all companies to sign up for their IDX (Internet Data Exchange).  Each night it dumps about 12 files into the root folder of their website via FTP.

Most files are just text files with the extensions .txt or .dic.

In the txt files, the info is not unlike if you are creating a form mail area in a page.  Mostly fields matching data in the dic files.   On of the files is a zip file that contains images of the properties for sale.

What is needed from their web host to make a page work by having a searchable area on their web site?  I'm assuming some sort of database is in order?

And what would be my next step as the page designer to merge this data into the page?

I'm sure anyone that has worked on real estate web pages knows what I'm asking.

Thanks
Loral

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2007-07-05 at 07:11:15ID22676819
Tags

idx

,

data

,

mls

Topics

Web Servers

,

Adobe Dreamweaver

,

Miscellaneous Web Development

Participating Experts
1
Points
500
Comments
10

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. MLS integration in real estate web site
    Hello: I have a friend who is a real estate agent. She want to create a web page with an integrated MLS search. I am willing to help her, but need to know what steps I need to take to access a MLS database. I would prefer to do all pages in PHP. Some questions I can think of...
  2. IDX website
    Does anyone know anything about coding real estate websites? It looks like my client wants to download an idx file, delete files and add files based on that idx file. Is the idx file like an xml file? How do you parse it? Is it possible to parse in php?

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: jason1178Posted on 2007-07-05 at 09:03:08ID: 19425114

Hi Loral,

You lost me with repeated use of "their" in reference to two different entities.  

1) What do you want to be able to do with the data dump?

2) Can you post a sample of the data files you are manipulating?

I can tell you that you are going to need to use some form of scripting to accomplish anything, which leads to:

3) What is your server environment?

 

by: loralPosted on 2007-07-05 at 09:46:33ID: 19425413

Sorry....

Their, being my customer, the real estate company. Except the "their" referring to the host that houses the web pages.

There are a LOT of ways of displaying the data.  You can place a search engine type and have it display the results of the search based on the users input.  Some companies put a rotating display of homes like a "featured home" slideshow.  I'm sure it just randomly pulls data from that .dic file and matches it to the photos in the zip file.

I'm not sure if I'm responsible to extract the pictures daily or if a script can be written to perfrom that task.

I've called the IDX distributor and they more or less just say "you are supposed to know how to use the data or hire someone who does.  We supply the data, and you have to use it within the boundaries set by your local board of realtors".

Here is a sample page i found randomly showing an example of how this info is displayed:

http://tomrich.realtorpro5.com/

Here is the contents of the first file; most are all the same except in how they are used and the amount of data:

Database Name      Field Name      Data Type      Length
LM_MST_MLS_NO      MLS Number      Number      9
LM_MST_LIST_PRC      Price Listing      Number      11
LM_MST_ZONE      Area / Zone Code      Char      30
LM_MST_ACT_ST_A      Status Actual (alpha)      Char      2
LM_MST_SEC      Section      Char      30
LM_MST_STR_NAM      Address Street Name      Char      37
LM_MST_CITY      Address City      Char      30
LM_MST_UNITNUM      Address Unit Number      Char      6
LM_MST_STATE      Address State      Char      2
LM_MST_BDRMS      #Bedrooms      Number      2
LM_MST_ZIP      Address Zip Code      Number      9
LM_MST_BATHS      #Baths      Number      2
LM_MST_COUNTY      Address County      Char      30
LM_MST_HBATH      #Half-Baths      Number      2
LM_MST_SUBDIV      Address Subdivision      Char      30
LM_RES_UNTFLRS      Floors Per Unit      Number      3
LM_RES_CONDO_NM      Condo Name      Char      30
LM_RES_DGAR      Garage Size      Number      2
LM_MST_PROP_TYP      Property Type (alpha)      Char      30
LM_MST_PROP_CD      Property Code      Number      2
LM_RES_FNS_STAY      Furnishings to Stay      Char      30
LM_MST_REMARK      Remarks      Char      600
LM_RES_FND_TYPE      Foundation Type      Char      30
LM_RES_ATTIC      Attic      Char      30
LM_RES_GAR      GARAGE      Char      30
LM_RES_N_FPL      Fireplace      Char      30
LM_RES_POOL      Pool       Char      30
LM_MST_EXCLUS      Exclusions      Char      1
LM_RES_UNTFLRNO      Unit Floor Number      Number      3
LM_RES_ELEV_YN      Elevator YN      Char      1
LM_RES_TSHR_NUM      Timeshare Weeks      Number      2
LM_RES_SHARE      Shared      Char      1
LM_RES_EXP_MNT      Maintenance Expenses      Number      4
LM_RES_EXCH_YN      Exchange Y/N      Char      4
LM_RES_TIMEWK      Timeshare Week      Char      7
LM_RES_LIV_L1      Living Rm Level 1      Char      30
LM_RES_DLIV      Living Rm Size      Char      9
LM_RES_BD1_L      BR1 Level      Char      30
LM_RES_BR1_SIZE      BR 1 Size      Char      9
LM_RES_DIN_L      Dining Rm Level      Char      30
LM_RES_DDIN      Dining Rm Size      Char      9
LM_RES_BD2_L      BR2 Level      Char      30
LM_RES_BR2_SIZE      BR 2 Size      Char      9
LM_RES_KIT_L      Kitchen Level      Char      30
LM_RES_DKIT      Kitchen Size      Char      9
LM_RES_BD3_L      BR3 Level      Char      30
LM_RES_BR3_SIZE      BR 3 Size      Char      9
LM_RES_FAM_L      Family Room Level      Char      30
LM_RES_DFAM      Family Room Size      Char      9
LM_RES_BD4_L      BR4 Level      Char      30
LM_RES_BR4_SIZE      BR 4 Size      Char      9
LM_RES_OT1_L      Other 1 Level      Char      30
LM_RES_DOTH1      Other Room 1 Size      Char      9
LM_MST_TXDST      Tax - City/Village      Number      7
LM_MST_INC_RENT      Rental Income      Number      9
LM_MST_YR_BLT      Year Built      Number      4
LM_MST_WTR_FT      Waterfront      Char      30
LM_MST_TXCOM      Tax - Town/County      Number      7
LM_RES_SIMP_YN      Fee Simple YN      Char      1
LM_MST_NEW_YN      New Construction YN      Char      1
LM_MST_WTR_FDTG      Water Frontage      Char      30
LM_MST_EXP_WTR      Water Expenses      Number      7
LM_MST_EXP_GRD      Ground Expenses      Number      7
LM_MST_SQFT_N      #SQFT Total (numeric)      Number      9
LM_MST_DOCK      Dock Type      Char      30
LM_MST_EXP_SWR      Sewer Expenses      Number      7
LM_MST_YRS_OWN      Years Owned      Number      3
LM_MST_PUBRDYN      Public Road Y/N      Char      1
LM_MST_SCH_DIST      SCHOOL DIST      Char      30
LM_MST_TR_EX      Trash Expenses      Number      7
LM_MST_INS_YN      Insured Y/N      Char      1
LM_MST_DLOT      Lot Size      Char      20
LM_MST_N_ASSF      Association Fee (#)      Char      7
LM_MST_BLOCK      Block      Char      2
LM_MST_ACRES      #Acres - Total      Decimal      9,2
LM_MST_IN_CITY      Inside City Limits      Char      1
LM_RES_CONDO_FS      Condo Assoc Fees      Number      7
LM_MST_HIS_DIS      Historical District Y/N      Char      1
LM_MST_LOFSF      Lot Size sqft      Number      9
LM_MST_ZONING      Zoning      Char      30
MM_OFF_NAME      Office Name      Char      40
LM_MST_VIRT_URL      Virtual Tour URL      Char      90
LM_MST_SELL_DT      Date Closed / Sold      Char      10
LM_MST_SELL_PRC      Price Selling      Number      11
LM_MST_PEND_DT      DTC      Number      5
LM_MST_CONT_DT      DTC2      Number      5
LM_MST_SELL_DT      DTS      Number      5
LM_MST_LIST_DT      Date Listed      Char      10
LM_MST_LIST_TM      List Time      Char      8
LM_MST_LIST_BRD      List Brd      Char      4
LM_MST_LIST_FRM      List Firm      Char      6
LM_MST_LIST_OFF      List Off      Char      3
LM_MST_LIST_AGT      List Agent      Char      9
LM_MST_CFF      STYLE      Vchar      62
LM_MST_CFF      CONSTRUCTION TYPE      Vchar      62
LM_MST_CFF      EXTERIOR TYPE      Vchar      93
LM_MST_CFF      EXTERIOR FEATURES      Vchar      124
LM_MST_CFF      ROOFING      Vchar      62
LM_MST_CFF      BASEMENT      Vchar      93
LM_MST_CFF      PARKING      Vchar      62
LM_MST_CFF      PORCH/PATIO/DECK      Vchar      93
LM_MST_CFF      SECURITY      Vchar      62
LM_MST_CFF      INTERIOR FEATURES      Vchar      465
LM_MST_CFF      OTHER ROOMS      Vchar      186
LM_MST_CFF      KITCHEN      Vchar      124
LM_MST_CFF      APPLIANCES      Vchar      465
LM_MST_CFF      PRIMARY FLOORING      Vchar      124
LM_MST_CFF      EXTRA UNIT DESCRIPTION      Vchar      93
LM_MST_CFF      LOT DESCRIPTION      Vchar      93
LM_MST_CFF      COOLING SYSTEM      Vchar      93
LM_MST_CFF      HEATING SYSTEM      Vchar      93
LM_MST_CFF      WATER      Vchar      62
LM_MST_CFF      SEWER      Vchar      62
LM_MST_CFF      FINANCING      Vchar      124
LM_MST_CFF      DISCLOSURES      Vchar      124
LM_MST_CFF      SHOWING INSTRUCTIONS      Vchar      93
LM_MST_CFF      CONTRACT INFORMATION      Vchar      93
LM_MST_CFF      CONDO/HOA AMENITIES      Vchar      372
LM_MST_CFF      DOCS ON FILE      Vchar      124




 

by: jason1178Posted on 2007-07-05 at 11:30:53ID: 19426159

>> Here is the contents of the first file; most are all the same except in how they are used and the amount of data:

This looks like a SQL table structure to me.   If so, I'm sure one of the other files is the data dump and all you would need to do is use a cron job to launch a script to import the results of the nightly data dump into a database.  From there, you have to build a site that pulls in dynamically.

Now, if you have no experience creating database driven sites, then my professional opinion is that you are in over your head at the moment.  Depending on how fast you need to integrate this data, you should probably look into buying or downloading a premade script or hiring a developer with experience in IDX/MLS integration.  Googling for "mls idx integration" produced a couple of links, I will leave it to you to evaluate them.

 

by: loralPosted on 2007-07-05 at 13:42:07ID: 19427165

I've done some research and found the answers I needed to know.

Basically, the web server needs to be running PHP, MySQL, SQL or similar to parse the info into the database for distribution.

 

by: jason1178Posted on 2007-07-05 at 20:38:22ID: 19429365

Right...

 

by: loralPosted on 2007-08-21 at 08:20:21ID: 19738654

Jason,

I'm getting little help from my ISP, as they say the are running MySQL, but they keep saying "we'll get back to you" on questions.

Do you know anymore on how to build the database, or what needs to be done to get this in motion?

I think I have enough info for me to create my pages on my end, but unless the database is setup on their end, the queries won't work.

Loral

 

by: jason1178Posted on 2007-08-21 at 10:18:57ID: 19739687

You probably want to see if you can install phpmyadmin on your site and use it to control your MySQL installation.  Then you could create your own database and tables.  I'm not sure what help you are asking for...I know a lot about PHP and MySQL but that doesn't help you...

If your ISP says "we'll get back to you" more than twice, it's time for a new ISP.

 

by: loralPosted on 2007-08-22 at 15:58:30ID: 19750299

Jason,

You were the only one that hung in there with me.  Although this isn't resolved, I think you know what I'm after and have pointed me in the right direction more than once.

Do you have any 1st hand knowledge with real estate IDX?  If so, I'd like to contact you for future questions.

Loral

 

by: jason1178Posted on 2007-08-22 at 16:50:38ID: 19750522

>> Do you have any 1st hand knowledge with real estate IDX?

Nope, and happy to not be in that field.  It sounds nightmarish.

 

by: jason1178Posted on 2007-08-22 at 16:52:43ID: 19750532

Did you ever get phpmyadmin installed and running?

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...