mt5 import data issue

[tickwaiting]

MT5 shows you some status information after you do your Request. The status message is shown just below the Symbols combo box in the Symbols->Bars window. If the data is filtered in any way, it will show a message like "<Symbol Name>,M1: x bars. Limited by chart settings". The "Limited by chart settings" means that it has filtered out some data and you need to either set the "Max Bars In Chart" correctly again or that you have not re-started MT5. As far as we know, there are no other reasons for this message.
When you are shown data from your request, it is shown in reverse chronological order, so the earlier timestamps will be at the bottom.

on this note should i click request after import data or before import data?

[tickstory]

The "Request" button is used to query/view the data that has already been imported, so you would use it after you have successfully done so. You might want to close the entire "Symbols" window and reopen it after your import as well. In our testing, we did come across a glitch in MT5 where it didn't return any data until this was done.

Hope this helps.

[tickwaiting]

hi tickstory

exported and import last month data

after import and request this what happened:

bars: 70%+ of data

ticks: only last 2 days.

see creenshots, if there is no other solution i guess it's time to post this on mql5 forum

[tickstory]

Hi Tickwaiting,

Do you note on your screenshot how MT5 is saying "5427301 ticks from xx to yy received (1884683 ticks shown below)" after your Request query? I believe this is trying to say that it cannot display all ~5.4m ticks and has therefore shown a subset. Typically UIs cannot display huge amounts of data as it will cause the interface to become slow/unresponsive.

You might want to confirm on MQL Forums but I am thinking that all the data exists. If you really wanted to prove that the data exists, you could use an EA to count ticks or trigger a message when certain dates you think are missing are encountered. Otherwise, I think the user-interface is only really meant for spot checks of the data. If your imported tick data file is around 5.4m rows (open it in Notepad++), I think this is a good indicator that everything is fine.

Hope this helps.

[tickwaiting]

Hi Tickstory

so you mean the data is there but this is only display issue so i can run this the test without any issue?

i will do backtest and let you know if it test all the downloaded data then i will export and import larger amount of data, currently my vps has 600 gb you think it's enough for 20 years of tick data?

[tickstory]

Hi Tickwaiting,

It looks like it's simply a display issue. As mentioned, you should limit your query to the specific days you want to check. If you think a day is missing, specify that as the begin/end date. Any more than a few days, it will likely not display the entire dataset. Keep noting the status message after your query as it appears to note how many rows are in the database versus displayed.

600gb is plenty for a single symbol of data. Just check the size of each symbol as you export (*.CSV) and import (*.HCC/*.TKC in the MT5 Data Folder) it and you will get a feel of how much space you should need for all your data. Of course, once you have successfully imported data into MT5, you can delete your exported CSV files.

Hope this helps.

[tickwaiting]

Hi Tickstory

i found the issue and the solution i hope this will help if anyone face similar issue.

the issue:
the issue is on step 3 import data specifically when create new custom symbol based on existing symbol, what happened was my mt5 didn't automatically copy the symbol info, so it was creating custom symbol based on default info.

the solution:
I found an option to manually copy mt5 symbol info to create new symbol. see screenshot 1.

then importing the files become more realistic it was slow due to its size but in the past was fast but not all of it there. see screenshot 2-3

I run test and shows 100% quality of data. however, I noticed the files don't have volume is this normal you can see screenshots.

last thing how to delete created custom symbols?

[tickstory]

Hi Tickwaiting,

Thanks for letting us know how you resolved your issue.
In regards to the volume not showing, all we can say is that volume shows correctly on the pre-import and post-import (Request) screen. I'm not sure why it's not showing for you but looking on MQL Forums, it seems that other users are having various issues with the import screen for some months now. Unfortunately our ability to help here is limited.

You can delete a custom symbol by going to View->Symbols->Specification tab and then right clicking on the Symbol you want to delete and selecting "Delete Custom Symbol".

Thanks.

[tickwaiting]

In regards to the volume not showing, all we can say is that volume shows correctly on the pre-import and post-import (Request) screen. I'm not sure why it's not showing for you but looking on MQL Forums, it seems that other users are having various issues with the import screen for some months now. Unfortunately our ability to help here is limited.

so you mean test results not valid due to this volume problem? because my test results on broker data every tick and tickstory real ticks absolutely 100% the opposite, is this due to volume issue?

[tickstory]

Hi Tickwaiting, you're stretching our knowledge of MT5 here and I wouldn't want to give you incorrect information. First up, there was no suggestion that it was affecting your test results. If I were to guess, the volume should not make any difference unless your EA is using it. The main point here is that we can't really say why the volume is not appearing on the import. When we try it, it shows correctly. Why it doesn't show for you is not something we can tell you but Metaquotes/MQL Forums are in a better position to help.

Hope this helps.