TNG Importing Master.csv error

[NickHil]

Hi

Currently running Asterisk 1.8.7.0 on a Linux box. We installed TNG 1.0.7.0 and have updated the exe to 1.0.7.7. Having a problem with the Asterisk output. Seems to be picking up the "Lastdata" and using it as the date.

System log:

2013-05-03 12:46:43:506 [1.0.7.7] - AMI Exception:ParseCDRRecordToTNGFormat (SIP/51,15,trM(auto-blkvm)- ["","","51","from-internal-xfer","","DAHDI/6-1","SIP/51-00002017","Dial","SIP/51,15,trM(auto-blkvm)","2013-05-03 10:46:03","2013-05-03 10:46:07","2013-05-03 10:46:26",23,19,"ANSWERED","DOCUMENTATION","1367577950.15933",""[10]]): 'SIP/51,15,trM(auto-blkvm)' is not a valid date and time
2013-05-03 12:46:43:504 [1.0.7.7] - AMI Exception:ParseCDRRecordToTNGFormat (SIP/14,15,trI- ["","35","14","from-internal","""Tracy Moore"" <35>","SIP/35-0000200c","SIP/14-0000200d","Dial","SIP/14,15,trI","2013-05-03 10:44:31","2013-05-03 10:44:34","2013-05-03 10:46:08",97,94,"ANSWERED","DOCUMENTATION","1367577871.15921",""[10]]): 'SIP/14,15,trI' is not a valid date and time
2013-05-03 12:46:43:503 [1.0.7.7] - AMI Exception:ParseCDRRecordToTNGFormat (SIP/11,120,trM(auto-blkvm)- ["","","11","from-did-direct","","DAHDI/6-1","SIP/11-00002016","Dial","SIP/11,120,trM(auto-blkvm)","2013-05-03 10:45:50","2013-05-03 10:45:57","2013-05-03 10:46:03",13,6,"ANSWERED","DOCUMENTATION","1367577950.15933",""[10]]): 'SIP/11,120,trM(auto-blkvm)' is not a valid date and time
2013-05-03 12:46:43:501 [1.0.7.7] - AMI Exception:ParseCDRRecordToTNGFormat (DAHDI/9,15,trI- ["","27","25","from-internal","""Darren Young"" <27>","SIP/27-00002015","DAHDI/9-1","Dial","DAHDI/9,15,trI","2013-05-03 10:45:25","2013-05-03 10:45:32","2013-05-03 10:45:41",16,9,"ANSWERED","DOCUMENTATION","1367577925.15931",""[10]]): 'DAHDI/9,15,trI' is not a valid date and time
2013-05-03 12:46:43:500 [1.0.7.7] - AMI Exception:ParseCDRRecordToTNGFormat (30@default,u- ["","27","30","from-internal","""Darren Young"" <27>","SIP/27-00002012","DAHDI/14-1","VoiceMail","30@default,u""""","2013-05-03 10:45:04","2013-05-03 10:45:19","2013-05-03 10:45:22",18,3,"ANSWERED","DOCUMENTATION","1367577904.15927",""[10]]): '30@default,u' is not a valid date and time
2013-05-03 12:46:43:498 [1.0.7.7] - AMI Exception:ParseCDRRecordToTNGFormat (SIP/Cot-Cap-001/0214257328,300,- ["","25","0214257328","from-internal","""Kate Carolusen"" <25>","DAHDI/9-1","SIP/Cot-Cap-001-00002001","Dial","SIP/Cot-Cap-001/0214257328,300,","2013-05-03 10:42:05","2013-05-03 10:42:08","2013-05-03 10:45:14",189,186,"ANSWERED","DOCUMENTATION","1367577708.15908",""[10]]): 'SIP/Cot-Cap-001/0214257328,300,' is not a valid date and time

cdr_custom.conf:

[mappings]
Master.csv => "${CDR(clid)}","${CDR(src)}","${CDR(dst)}","${CDR(dcontext)}","${CDR(channel)}",
"${CDR(dstchannel)}","${CDR(lastapp)}","${CDR(lastdata)}","${CDR(start)}","${CDR(answer)}",
"${CDR(end)}","${CDR(duration)}","${CDR(billsec)}","${CDR(disposition)}","${CDR(amaflags)}",
"${CDR(accountcode)}","${CDR(uniqueid)}","${CDR(userfield)}"

Thanks
Nick

[NickHil]

Did the install following the guide on viewtopic.php?f=24&t=34&p=34&

Manager.conf

[tng]
secret=test
deny=0.0.0.0/0.0.0.0
permit=127.0.0.1/255.255.255.0
read=system,call,log,verbose,command,agent,user
write=system,call,log,verbose,command,agent,user
writetimeout=20000

Call then running TNG without demon:

TimeStamp: 13:34:10.391
Event: Bridge
Privilege: call,all
Bridgestate: Link
Bridgetype: core
Channel1: SIP/51-00002082
Channel2: SIP/12-00002083
Uniqueid1: 1367580845.16126
Uniqueid2: 1367580845.16127
CallerID1: 51
CallerID2: 12

[Leon van Heerden]

Hi,
I checked the fields on your examples, the fields before the first date, contains a single double quote in some cases or multiple double quotes.
Check in your custom configure if the they all have a single set of open and closing double quotes. The 3 or 4 sets of quotes may be the other issue. Can you manually remove the quotes on the usernames field and test if it then processes the record.

This parser will use try and interpret it is the start of a long field and ready everything until it finds the corresponding ending double quote or end of line as one field.
Leon

[Belinda Frick]

I have requested assistance from our more technical support for TNG and Asterisk. I will update you as soon as I receive feedback.

[NickHil]

Thanks for the feedback. We have got it working with the imports however theres a few funnys still in the log.


2013-05-06 13:09:59:882 [1.0.7.7] - [AMI LOG] - Dialplan Processed.
2013-05-06 13:10:00:995 [1.0.7.7] - AMI Exception:ProcessAMIEvent: ProcessDial 3: Access violation at address 08142D16, accessing address 000000A9
2013-05-06 13:10:00:995 [1.0.7.7] - AMI Exception:Event: Dial[10]Privilege: call,all[10]SubEvent: End[10]Channel: SIP/51-000026c4[10]UniqueID: 1367838513.19980[10]DialStatus: ANSWER[10]
2013-05-06 13:10:07:734 [1.0.7.7] - [AMI LOG] - Peerlist Processed.
2013-05-06 13:10:08:468 [1.0.7.7] - User admin disconnected
2013-05-06 13:10:08:471 [1.0.7.7] - Owner from IP : 192.168.20.1 got timed out.
2013-05-06 13:10:14:766 [1.0.7.7] - AMI Exception:ProcessAMIEvent: ProcessDial 3: Access violation at address 08142D16, accessing address 000000A9
2013-05-06 13:10:14:766 [1.0.7.7] - AMI Exception:Event: Dial[10]Privilege: call,all[10]SubEvent: End[10]Channel: DAHDI/6-1[10]UniqueID: 1367838475.19964[10]DialStatus: ANSWER[10]
2013-05-06 13:10:37:373 [1.0.7.7] - AMI Exception:ProcessAMIEvent: ProcessDial 3: Access violation at address 08142D16, accessing address 000000A9
2013-05-06 13:10:37:373 [1.0.7.7] - AMI Exception:Event: Dial[10]Privilege: call,all[10]SubEvent: End[10]Channel: DAHDI/4-1[10]UniqueID: 1367838618.19985[10]DialStatus: ANSWER[10]
2013-05-06 13:10:38:124 [1.0.7.7] - AMI Exception:ProcessAMIEvent: ProcessDial 3: Access violation at address 08142D16, accessing address 000000A9
2013-05-06 13:10:38:124 [1.0.7.7] - AMI Exception:Event: Dial[10]Privilege: call,all[10]SubEvent: End[10]Channel: Local/42@from-queue-d484;2[10]UniqueID: 1367838634.19995[10]DialStatus: CANCEL[10]
2013-05-06 13:10:38:130 [1.0.7.7] - AMI Exception:ProcessAMIEvent: ProcessDial 3: Access violation at address 08142D16, accessing address 000000A9
2013-05-06 13:10:38:130 [1.0.7.7] - AMI Exception:Event: Dial[10]Privilege: call,all[10]SubEvent: End[10]Channel: Local/40@from-queue-a2e8;2[10]UniqueID: 1367838634.19991[10]DialStatus: CANCEL[10]

[Belinda Frick]

Refer to topic

Re: TNG4* Custom CSV is correct format but not logging calls