Report ignoring old records

Web based, multi-user, Telephone Management System with budget management and barring control

Moderators: Leon van Heerden, Luanda_Junzi, Belinda Frick, Lee Hendricks

Report ignoring old records

Postby aragon » Tue Dec 03, 2013 7:35 am

Hi,

My TNG database has call records from before Oct 29, as seen in its call list. However, if I try generate a report, nothing before Oct 29 is seen. Screenshots attached. Does TNG have some kind of time limit builtin? Please help.


Thanks,
Aragon

tng1.png

tng2.png

tng3.png
You do not have the required permissions to view the files attached to this post.
aragon
 
Posts: 28
Joined: Tue Jul 23, 2013 1:35 pm

Re: Report ignoring old records

Postby John Richard Procter » Tue Dec 03, 2013 10:02 am

Dear Aragon

Would it be possible to pull a report without additional criteria selected?
Can the report be a extension detailed report.
Once done please provide your findings.

Kind Regards
John-Ri Procter
John Richard Procter
 
Posts: 552
Joined: Tue May 03, 2011 2:02 pm

Re: Report ignoring old records

Postby aragon » Tue Dec 03, 2013 1:51 pm

John Richard Procter wrote:Would it be possible to pull a report without additional criteria selected?
Can the report be a extension detailed report.

Done. It makes no difference - still nothing before Oct 29 shows. Also notice the date range in the report says Oct 29, even despite me requesting a range of Oct 28.
aragon
 
Posts: 28
Joined: Tue Jul 23, 2013 1:35 pm

Re: Report ignoring old records

Postby aragon » Tue Dec 03, 2013 2:12 pm

You know, today it doesn't show records older than 30 Oct in the reports. This really seems like a software time limit.
aragon
 
Posts: 28
Joined: Tue Jul 23, 2013 1:35 pm

Re: Report ignoring old records

Postby Belinda Frick » Tue Dec 03, 2013 2:16 pm

TNG call capacity is memory based.

By default 30% of available memory on startup of TNG is allocated to store call details. This value can be configured.

For more details see forum post: How many calls can my TNG handle?
Belinda Frick
 
Posts: 3808
Joined: Fri Nov 12, 2010 4:25 pm

Re: Report ignoring old records

Postby aragon » Tue Dec 03, 2013 2:49 pm

In my case...

Storage capacity: 2575599
Total records: 101713
aragon
 
Posts: 28
Joined: Tue Jul 23, 2013 1:35 pm

Re: Report ignoring old records

Postby Belinda Frick » Tue Dec 03, 2013 3:08 pm

  1. The best report to use to see if you have call details in a range of data, is the Transaction Detail report. Only select the date range and ensure the from and to time is 00:00:00 - 23:59:29. This report will not exclude anything, for example a user that is not configured, etc.

    For a user not configured, it will show PLEASE ADD USER, etc.

    If you still have no calls, try next step:

  2. Every call that TNG imports gets exported to a file in the Export folder. The file name is the date on which the call was loaded into TNG. File path for export folder:
    Code: Select all
    /opt/datatex/tng/export/

    If the file is present you should have call details for that date, provided it has not been auto purged.

    I assume it is a TNG for Asterisk.

    If you imported the 'master.csv' file, it will be moved to the 'processed' folder at 01h00 the next morning. This file can be re-imported - refer to forum post: How do I re-import Asterisk CSV files?

    NOTE: The re-import will only be successful if the file is in the standard master.csv format.
Belinda Frick
 
Posts: 3808
Joined: Fri Nov 12, 2010 4:25 pm

Re: Report ignoring old records

Postby aragon » Tue Dec 03, 2013 5:15 pm

Belinda Frick wrote:The best report to use to see if you have call details in a range of data, is the Transaction Detail report. Only select the date range and ensure the from and to time is 00:00:00 - 23:59:29. This report will not exclude anything, for example a user that is not configured, etc.

I set the end time manually to 23:59:29, and start time 00:00:00 for Oct 28. The report gets generated for the same time frame, but for Oct 30 (yesterday it was doing the same, except using Oct 29).

Belinda Frick wrote:Every call that TNG imports gets exported to a file in the Export folder. The file name is the date on which the call was loaded into TNG. File path for export folder:
Code: Select all
/opt/datatex/tng/export/

If the file is present you should have call details for that date, provided it has not been auto purged.

This doesn't seem to be working. The export directory has not been modified since 24 July, and the last text file in it is dated 24 July.

Belinda Frick wrote:I assume it is a TNG for Asterisk.

Yes.
aragon
 
Posts: 28
Joined: Tue Jul 23, 2013 1:35 pm

Re: Report ignoring old records

Postby Belinda Frick » Wed Dec 04, 2013 10:42 am

  1. Export files:

    There are no configuration to set TNG to write out the files in the export folder, it does it by default and cannot be disabled. If you have call details for Oktober in TNG, then the same entries should be in a file in the export folder also. TNG does not auto delete these files or have an option to delete it.

    The calls in the database is auto purged when 99% call capacity has been reached and it only purges down to 80% in use. You can check these figures on the Call List page. I do not think an auto purge took place.

    If the Oktober files are not present in the export folder, either access changed and it could not write it out or the files was manually deleted or something happened on the server. You did not perhaps have space issues on the server?

    If TNG was installed as root, you should not have any access issues - unless it was changed thereafter.

    If TNG is showing calls updating live on the Call List page, you must have a export file for today also. If not, please check the access for TNG to create a file and write to it.

  2. Call details before 29 October 2013:

    If you have the master.csv files in the processed folder for the days before 29 October 2013, you can re-import it as per link in previous post. I would suggest to do only one or two days, check if you can pull the reports. If not, it might be that the data file is damaged and it must be blanked and all the call details re-imported.

    Please check and let me know. I will then give further steps if needed.
Belinda Frick
 
Posts: 3808
Joined: Fri Nov 12, 2010 4:25 pm

Re: Report ignoring old records

Postby aragon » Wed Dec 04, 2013 12:20 pm

Belinda Frick wrote:Export files:

There are no configuration to set TNG to write out the files in the export folder, it does it by default and cannot be disabled. If you have call details for Oktober in TNG, then the same entries should be in a file in the export folder also. TNG does not auto delete these files or have an option to delete it.

Well, it's not working.

Belinda Frick wrote:The calls in the database is auto purged when 99% call capacity has been reached and it only purges down to 80% in use. You can check these figures on the Call List page. I do not think an auto purge took place.

Yep, that's not the problem.

Belinda Frick wrote:If the Oktober files are not present in the export folder, either access changed and it could not write it out or the files was manually deleted or something happened on the server. You did not perhaps have space issues on the server?

No space issues, disk has 58 GB free space.

Belinda Frick wrote:If TNG was installed as root, you should not have any access issues - unless it was changed thereafter.

It was, and is still running as root.

Belinda Frick wrote:If TNG is showing calls updating live on the Call List page, you must have a export file for today also. If not, please check the access for TNG to create a file and write to it.

Live calls are updating, but no export files.


Belinda Frick wrote:Call details before 29 October 2013:

If you have the master.csv files in the processed folder for the days before 29 October 2013, you can re-import it as per link in previous post. I would suggest to do only one or two days, check if you can pull the reports. If not, it might be that the data file is damaged and it must be blanked and all the call details re-imported.

I have tried re-importing to a blank database. The re-import showed calls before Oct 29 in the Live Call list, but reports were still time limited to after Oct 29.

And surprise surprise, today the time limit is Oct 31. Every passing day the time limit shifts by one day. This must be a time limit restriction in TNG's report generator. Please could you have proper look at this on your side?

Thanks.
aragon
 
Posts: 28
Joined: Tue Jul 23, 2013 1:35 pm

Next

Return to TNG

Who is online

Users browsing this forum: No registered users and 1 guest