Data Source ?

General questions and discussions focused around the EKM Metering System. Discuss your meters, installations, and meter communications here.
Post Reply
Nevland
Posts: 65
Joined: Tue Jul 31, 2012 2:56 pm
Location: Nevada City CA

Data Source ?

Post by Nevland » Tue Sep 30, 2014 5:21 pm

:?: Where does Dash store the data that I get when I export data from Dash for my v4? I assume it is stored on my hard drive, but where ? and how much of the data is stored ?

Bill

JayDee
Posts: 20
Joined: Mon Aug 11, 2014 4:24 pm

Re: Data Source ?

Post by JayDee » Tue Sep 30, 2014 8:53 pm

If you are using Windows, it can / could be found it here

C:\Users\your name\AppData\Roaming\EKM Dash\

This is where the Sqlite EKM Metering Database is,

If you need an application that opens this file you can get it from here http://sqliteexpert.com/ it is the best tool for opening any sqlite database, it is even worth upgrading to the professional version just for the option of being able to export to Excell but it has many other features that you would find useful.

Be WARNED that opening the database with this tool alows you to change anything so it is best used for analysis of the data stored, do not make any changes to the data OR table's that exist.

If you do not know much about SQL then I recommend that you do not go there.

To get to AppData you will need to allow access to this folder but be warned, it comes with some risk, so be careful of what you do there.

Jameson
Posts: 774
Joined: Fri Nov 04, 2011 7:42 pm
Location: Santa Cruz, CA
Contact:

Re: Data Source ?

Post by Jameson » Tue Sep 30, 2014 9:54 pm

Thanks JayDee,

I think you are correct that when opening the EKM Dash database it is better to "Read Only", I would make a backup of your database before messing around with it to be safe.

Here is the location of the Dash database file for various operating systems:

Windows 7 and Vista: C:\Users\USER\AppData\Roaming\EKM Dash
Windows XP: C:\Documents and Settings\User\Application Data\EKM Dash
Mac OS X: User/Library/Application Support/EKM Dash/EKM Metering Database.db

In Mac OS X if you cannot find it this way just hold down the Option key when you click to open the Dash and you will see where these files are.
Jameson
EKM METERING
http://www.ekmmetering.com
831.425.7371

Nevland
Posts: 65
Joined: Tue Jul 31, 2012 2:56 pm
Location: Nevada City CA

Re: Data Source ?

Post by Nevland » Thu Oct 02, 2014 7:16 pm

Thanks. I made a copy of Dash file so I could muck arroung in it. The link to a viewer was appreciated. Thanks again.
Dash Questions ?
How big is the file allowed to to grow?
Does exporting data, like a special period, delete that data from the file ?

Bill

JayDee
Posts: 20
Joined: Mon Aug 11, 2014 4:24 pm

Re: Data Source ?

Post by JayDee » Fri Oct 03, 2014 2:06 am

Nevland wrote:How big is the file allowed to to grow?
In theory SqLite databases can grow to be in the Giga Byte range holding millions of records.
Nevland wrote:Does exporting data, like a special period, delete that data from the file ?
If you are talking about the SqLite database, the answer is no, you can export the same data as many times as you like but if you have made a copy of the database and want to explore the potential of SqliteExpert, then you can drill down to get the data that you want for example, total KWH's between two dates goes something like this

Code: Select all

SELECT SUM(KilowattHour) FROM MeterData WHERE MeterData.[Date] >=  '2014-06-16' AND MeterData.[Date] <= '2014-06-30'

or if you want the cost, try this

SELECT SUM(KilowattHour), (SUM(KilowattHour)/100 * .25) AS VALUE FROM MeterData WHERE MeterData.[Date] >=  '2014-06-16' AND MeterData.[Date] <= '2014-06-30'

Copy and paste into the SQL Tab, then execute.

Make sure you are working on the copy not the real database.

Cheers

Jameson
Posts: 774
Joined: Fri Nov 04, 2011 7:42 pm
Location: Santa Cruz, CA
Contact:

Re: Data Source ?

Post by Jameson » Fri Oct 03, 2014 9:47 am

SQLite's limits (http://www.sqlite.org/limits.html) are very high. For example it allows for 2^64 number of rows and 14 terabytes of data.
Before you reach those limits you will run into limits of the operating system file sizes. For example Fat32 which is an older file system only allows for 4GB max file size.
NTFS which is a newer file system mostly used on Windows computers has a file size limit of 16 EB (Exabytes). source: http://en.wikipedia.org/wiki/Comparison ... ems#Limits
Mac file systems have a file size limit ranging in the multiple of TB source: http://support.apple.com/kb/HT2422?view ... cale=en_US


For example: if you have 20,000 meter data entries stored, the file size is 5mb. (roughly, this is old info)


((20,000readings/5MB)*86,000reading) = 21.5MB of data per day (roughly)
21.5*365 = 7,847.5MB of data per year
7,847.5*10 = 78,475MB of data per 10 years
78,475MB = 78GB
78GB of data will be fine for all Mac computers and most Windows computers running NTFS file systems. Older windows systems running Fat32 can only handle 4GB max file sizes so this amount of data could be a problem for them.
Jameson
EKM METERING
http://www.ekmmetering.com
831.425.7371

marc
Posts: 4
Joined: Wed Oct 22, 2014 4:59 pm

Re: Data Source ?

Post by marc » Sun Oct 26, 2014 1:39 pm

Is there a way to change where the SQL data source is stored on a Windows 8.1 system?

Thanks,

- marc

Jameson
Posts: 774
Joined: Fri Nov 04, 2011 7:42 pm
Location: Santa Cruz, CA
Contact:

Re: Data Source ?

Post by Jameson » Sun Oct 26, 2014 7:40 pm

Hello Marc,

There is no way to change the EKM Dash to live update the EKM Dash database to a different folder location. The EKM Dash depends on using the EKM Dash Database from its hardcoded location (locations for various operating systems were mentioned earlier in this thread) I would imagine there would be some way to make a copy of the database on the fly and then save this copy to any location on your computer that you choose.

Thanks,
Jameson
EKM METERING
http://www.ekmmetering.com
831.425.7371

Post Reply