Solved

Need an advice for 3D Table matris

Posted on 2010-09-22
11
483 Views
Last Modified: 2012-05-10
I have 1000+ device and each device recording daily 24 or 3 value how do you advice me to store all this value on mysql
0
Comment
Question by:3XLcom
  • 4
  • 3
  • 3
  • +1
11 Comments
 
LVL 65

Expert Comment

by:rockiroads
ID: 33740901
so one device may store either 24 values or 3 values? is that what you are saying?

what are these values? are they fixed data or random?

eg   a one to many

Table DEVICE
DeviceID
DeviceName

Table RECORDING
RecordingID
RecordedValue


if recordedvalue is fixed then many to many = one to many to one

Table DEVICE
DeviceID
DeviceName

Table RECORD_VALUES
RecordID
RecordValue

Table RECORDING
DeviceID
RecordID
and anything else associated to a device/recording value

0
 

Author Comment

by:3XLcom
ID: 33741002
in reality some devices send 3 value in one day some of them sends 24 but if i make one table it nearly makes 720.000 line on one table so it makes a huge problem in a few months
0
 
LVL 65

Expert Comment

by:rockiroads
ID: 33741038
so what values are you recording? if its just numbers then it should be fine. One to many is flexible, will allow other variations other than 3 or 24.

Mysql is scalable so cant see the issue
0
3 Use Cases for Connected Systems

Our Dev teams are like yours. They’re continually cranking out code for new features/bugs fixes, testing, deploying, testing some more, responding to production monitoring events and more. It’s complex. So, we thought you’d like to see what’s working for us.

 

Author Comment

by:3XLcom
ID: 33741064
numbers like 1,5343434 0,3423423 sth. like this
0
 
LVL 19

Expert Comment

by:NerdsOfTech
ID: 33744465
you said the old way would create 720.000 slots so I assume if we divide by 24 you are dealing with roughly 30.000 devices (30 thousand)

if the devices have an id you can actually create a 2d relationship:

machineID| number|timestamp
1| 2,3859480|2010-09-23 07:12:10
1| 7,2589237|2010-09-23 04:12:10
1| 3,4523522|2010-09-23 17:12:10

2|#|date 01:00
2|#|date 02:00
2|#|date 03:00
2|#|date 04:00
2|#|date 05:00
2|#|date 06:00
2|#|date 07:00
2|#|date 08:00
2|#|date 09:00
etc


Then you are recording JUST the data required without issues and have the scalability for man, many, more devices in the future.

0
 
LVL 19

Accepted Solution

by:
NerdsOfTech earned 500 total points
ID: 33744508
you can then query the table for data easily as well:


SELECT number from Machine_Table
WHERE machineID = 1
AND timestamp BETWEEN #2010-09-23 02:00# AND #2010-09-23 10:00#


results:
7,2589237
2,3859480

0
 

Author Comment

by:3XLcom
ID: 33745260
my time stamp values a little bit different then how mysql understand sth like :
2010-08-10T00:00Z
0
 
LVL 65

Expert Comment

by:rockiroads
ID: 33745722
I cant see how you are going to get around this

the one to many approach as I described earlier is probably the best

Table DEVICE
DeviceID
DeviceName

Table RECORDING
RecordingID
RecordedValue
DeviceID

As long as you set your indexes correctly (primary on DEVICE.DeviceID and RECORDING.RecordingID, secondary on RECORDING.DeviceID and duplicate index on DeviceName)
then you should be fine in terms of searching records

You are just storing time stamps against a particular device. You will not recreate device names so no duplication involved there. Storing numbers instead of text is better (as the id's would be autoincrementing anyways)


How long do you want to keep the data for? maybe introduce some sort of archiving process.
0
 
LVL 11

Expert Comment

by:mattibutt
ID: 33761579
hi NerdsOfTech

i need to talk to you about some dilemma i have how do i contact you buddy?
0
 
LVL 19

Expert Comment

by:NerdsOfTech
ID: 33779981
Sure, what did you need.
0
 

Author Closing Comment

by:3XLcom
ID: 33873743
I already use this way but i think this is the only way
0

Featured Post

Microsoft Certification Exam 74-409

Veeam® is happy to provide the Microsoft community with a study guide prepared by MVP and MCT, Orin Thomas. This guide will take you through each of the exam objectives, helping you to prepare for and pass the examination.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Does the idea of dealing with bits scare or confuse you? Does it seem like a waste of time in an age where we all have terabytes of storage? If so, you're missing out on one of the core tools in every professional programmer's toolbox. Learn how to …
Introduction This article is intended for those who are new to PHP error handling (https://www.experts-exchange.com/articles/11769/And-by-the-way-I-am-New-to-PHP.html).  It addresses one of the most common problems that plague beginning PHP develop…
This Micro Tutorial will give you a basic overview how to record your screen with Microsoft Expression Encoder. This program is still free and open for the public to download. This will be demonstrated using Microsoft Expression Encoder 4.
This video shows how to quickly and easily add an email signature for all users on Exchange 2016. The resulting signature is applied on a server level by Exchange Online. The email signature template has been downloaded from: www.mail-signatures…

773 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question