OTRS 4; Duplicate Emails and Crons not starting.

[dtoom]

We are using a few Gmail accounts on POP3S. The queues are now backed up because I keep getting duplicate emails imported.

I am also having an issue with the cron jobs. No matter how I set them, the emails are only coming in hourly as opposed to once every 10, 5, or whatever minutes.

This system is an upgrade from OTRS 3 to OTRS 4. I'm not sure if this detail helps, but I'd like to put that out there.

[jojo]

have a look in the logfile

[dtoom]

I pulled the logs out of /var/cron/[cron, maillog, messages]

I also edited things down to remove redundancy and personal emails. The cron file logs once per hour. The maillog and messages logs each minute.

Just to clarify, the emails only show the queue in once per hour in the message log, despite the crons running once per hour. The only items that come in are the same handful of duplicate emails.

;;; cron

Code: Select all

Mar  4 11:54:01 CS CROND[15718]: (otrs) CMD ($HOME/bin/otrs.PostMasterMailbox.pl >> /dev/null)
Mar  4 11:54:01 CS CROND[15719]: (otrs) CMD ($HOME/bin/otrs.GenericAgent.pl >> /dev/null)

;;; maillog

Code: Select all

Mar  4 10:24:11 CS postfix/pickup[13212]: 6857B402FB: uid=501 from=<root>
Mar  4 10:24:11 CS postfix/cleanup[14615]: 6857B402FB: message-id=<20150304182411.6857B402FB@CS.localdomain>
Mar  4 10:24:11 CS postfix/qmgr[1160]: 6857B402FB: from=<root@CS.localdomain>, size=1711, nrcpt=1 (queue active)
Mar  4 10:24:11 CS postfix/local[14617]: 6857B402FB: to=<root@localhost.localdomain>, orig_to=<root@localhost>, relay=local, delay=5.7, delays=5.7/0.01/0/0.03, dsn=5.2.2, status=bounced (cannot update mailbox /var/mail/root for user root. error writing message: File too large)
Mar  4 10:24:11 CS postfix/cleanup[14615]: 7468140BFD: message-id=<20150304182411.7468140BFD@CS.localdomain>
Mar  4 10:24:11 CS postfix/bounce[14618]: 6857B402FB: sender non-delivery notification: 7468140BFD
Mar  4 10:24:11 CS postfix/qmgr[1160]: 7468140BFD: from=<>, size=3571, nrcpt=1 (queue active)
Mar  4 10:24:11 CS postfix/qmgr[1160]: 6857B402FB: removed
Mar  4 10:24:11 CS postfix/local[14617]: 7468140BFD: to=<root@CS.localdomain>, relay=local, delay=0, delays=0/0/0/0, dsn=5.2.2, status=bounced (cannot update mailbox /var/mail/root for user root. error writing message: File too large)
Mar  4 10:24:11 CS postfix/qmgr[1160]: 7468140BFD: removed
Mar  4 11:25:11 CS postfix/pickup[14693]: A57A0402FB: uid=501 from=<root>
Mar  4 11:25:11 CS postfix/cleanup[15360]: A57A0402FB: message-id=<20150304192511.A57A0402FB@CS.localdomain>
Mar  4 11:25:11 CS postfix/qmgr[1160]: A57A0402FB: from=<root@CS.localdomain>, size=1711, nrcpt=1 (queue active)
Mar  4 11:25:11 CS postfix/local[15362]: A57A0402FB: to=<root@localhost.localdomain>, orig_to=<root@localhost>, relay=local, delay=5.9, delays=5.9/0.01/0/0.03, dsn=5.2.2, status=bounced (cannot update mailbox /var/mail/root for user root. error writing message: File too large)
Mar  4 11:25:11 CS postfix/cleanup[15360]: B177D40BFD: message-id=<20150304192511.B177D40BFD@CS.localdomain>
Mar  4 11:25:11 CS postfix/bounce[15363]: A57A0402FB: sender non-delivery notification: B177D40BFD
Mar  4 11:25:11 CS postfix/qmgr[1160]: B177D40BFD: from=<>, size=3571, nrcpt=1 (queue active)
Mar  4 11:25:11 CS postfix/qmgr[1160]: A57A0402FB: removed
Mar  4 11:25:11 CS postfix/local[15362]: B177D40BFD: to=<root@CS.localdomain>, relay=local, delay=0, delays=0/0/0/0, dsn=5.2.2, status=bounced (cannot update mailbox /var/mail/root for user root. error writing message: File too large)
Mar  4 11:25:11 CS postfix/qmgr[1160]: B177D40BFD: removed

;; messages

Code: Select all

Mar  4 11:24:01 CS OTRS-otrs.PostMasterMailbox.pl-10[15316]: [Notice][Kernel::System::PID::PIDCreate] Can't create PID PostMasterMailbox, because it's already running (yourhost.example.com/14586)!
Mar  4 11:24:01 CS OTRS-otrs.GenericAgent.pl-10[15317]: [Notice][Kernel::System::GenericAgent::JobRun] Run GenericAgent Job 'send escalation notifications' from config file.
Mar  4 11:24:01 CS OTRS-otrs.GenericAgent.pl-10[15317]: [Notice][Kernel::System::GenericAgent::JobRun] Run GenericAgent Job 'trigger escalation events' from config file.
Mar  4 11:25:01 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Notice][Kernel::System::PID::PIDCreate] Removed PID (PostMasterMailbox/yourhost.example.com/14586, because 1 hour old!
Mar  4 11:25:01 CS OTRS-otrs.GenericAgent.pl-10[15329]: [Notice][Kernel::System::GenericAgent::JobRun] Run GenericAgent Job 'send escalation notifications' from config file.
Mar  4 11:25:02 CS OTRS-otrs.GenericAgent.pl-10[15329]: [Notice][Kernel::System::GenericAgent::JobRun] Run GenericAgent Job 'trigger escalation events' from config file.
Mar  4 11:25:05 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Error][Kernel::System::MailAccount::POP3::Fetch][Line:145]: POP3S: Auth for user [email]@[gmail.com]/pop.gmail.com failed! ;; << email is redacted
Mar  4 11:25:07 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Notice][Kernel::System::PostMaster::Filter::MatchDBSource::Run] Filter: 'Amazon Inquiry' Set param 'X-OTRS-Queue' to 'Amazon' (Message-Id: email-redacted) 
Mar  4 11:25:07 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Info][Kernel::System::Ticket::TicketCreate] New Ticket [2015030410000781/Order delivery ] created (TicketID=10602,Queue=Amazon,Priority=3 normal,State=new)
Mar  4 11:25:07 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Info][Kernel::System::Ticket::TicketCreate] New Ticket [2015030410000799/An inquiry from] created (TicketID=10603,Queue=Amazon,Priority=3 normal,State=new)
Mar  4 11:25:08 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Notice][Kernel::System::PostMaster::Filter::MatchDBSource::Run] Filter: 'Amazon to Junk by Subject - Your e-mail to.*' Set param 'X-OTRS-Queue' to 'Junk' (Message-Id: email-redacted) 
Mar  4 11:25:08 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Info][Kernel::System::Ticket::TicketCreate] New Ticket [2015030410000806/Your e-mail to ] created (TicketID=10604,Queue=Junk,Priority=3 normal,State=new)
Mar  4 11:25:08 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Notice][Kernel::System::PostMaster::Filter::MatchDBSource::Run] Filter: 'Amazon to Junk by Subject - Your e-mail to.*' Set param 'X-OTRS-Queue' to 'Junk' (Message-Id: email-redacted) 
Mar  4 11:25:08 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Info][Kernel::System::Ticket::TicketCreate] New Ticket [2015030410000815/Your e-mail to ] created (TicketID=10605,Queue=Junk,Priority=3 normal,State=new)
Mar  4 11:25:08 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Notice][Kernel::System::PostMaster::Filter::MatchDBSource::Run] Filter: 'Amazon Inquiry' Set param 'X-OTRS-Queue' to 'Amazon' (Message-Id: email-redacted) 
Mar  4 11:25:09 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Info][Kernel::System::Ticket::TicketCreate] New Ticket [2015030410000824/Shipping inquir] created (TicketID=10606,Queue=Amazon,Priority=3 normal,State=new)
Mar  4 11:25:09 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Info][Kernel::System::Ticket::TicketCreate] New Ticket [2015030410000833/Order cancellat] created (TicketID=10607,Queue=Amazon,Priority=3 normal,State=new)
Mar  4 11:25:09 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Notice][Kernel::System::PostMaster::Filter::MatchDBSource::Run] Filter: 'Amazon Inquiry' Set param 'X-OTRS-Queue' to 'Amazon' (Message-Id: email-redacted) 
Mar  4 11:25:09 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Info][Kernel::System::Ticket::TicketCreate] New Ticket [2015030410000842/Return policy i] created (TicketID=10608,Queue=Amazon,Priority=3 normal,State=new)
Mar  4 11:25:11 CS OTRS-otrs.PostMasterMailbox.pl-10[15328]: [Notice][Kernel::System::PostMaster::Filter::MatchDBSource::Run] Filter: 'Amazon Inquiry' Set param 'X-OTRS-Queue' to 'Amazon' (Message-Id: email-redacted) 
Mar  4 11:26:01 CS OTRS-otrs.PostMasterMailbox.pl-10[15370]: [Notice][Kernel::System::PID::PIDCreate] Can't create PID PostMasterMailbox, because it's already running (yourhost.example.com/15328)!
Mar  4 11:26:01 CS OTRS-otrs.GenericAgent.pl-10[15371]: [Notice][Kernel::System::GenericAgent::JobRun] Run GenericAgent Job 'send escalation notifications' from config file.
Mar  4 11:26:02 CS OTRS-otrs.GenericAgent.pl-10[15371]: [Notice][Kernel::System::GenericAgent::JobRun] Run GenericAgent Job 'trigger escalation events' from config file.
Mar  4 11:27:01 CS OTRS-otrs.PostMasterMailbox.pl-10[15380]: [Notice][Kernel::System::PID::PIDCreate] Can't create PID PostMasterMailbox, because it's already running (yourhost.example.com/15328)!
Mar  4 11:27:01 CS OTRS-otrs.GenericAgent.pl-10[15381]: [Notice][Kernel::System::GenericAgent::JobRun] Run GenericAgent Job 'send escalation notifications' from config file.
Mar  4 11:27:01 CS OTRS-otrs.GenericAgent.pl-10[15381]: [Notice][Kernel::System::GenericAgent::JobRun] Run GenericAgent Job 'trigger escalation events' from config file.
Mar  4 11:28:01 CS OTRS-otrs.PostMasterMailbox.pl-10[15390]: [Notice][Kernel::System::PID::PIDCreate] Can't create PID PostMasterMailbox, because it's already running (yourhost.example.com/15328)!

[dtoom]

Eh, I'll just uninstall and reinstall OTRS and see if that will change anything. I guess something in the upgrade was corrupted?

[dtoom]

I did a clean reinstall of OTRS v4. I still have the same issue as before, where I keep getting duplicate emails, even with a brand new database. I haven't tested cron jobs yet.

I'm not sure if this is an issue with the gmail account or if this is an issue with OTRS itself. I've now changed the settings in gmail and I'll see what will happen.

[crythias]

The only way you're getting duplicate emails are duplicate simultaneous fetching and/or not deleting mail on server.

[JeremyB3ntham]

Clear your crontab file and stop cron, just to make sure no emails are being fetched by it. If they continue to be fetched afterwards you know something else is running causing the problem.

[dtoom]

We were originally importing all emails from gmail. I changed the POP settings to only fetch from today, and now I don't have duplicate emails. Of course, a few emails never imported into OTRS, but that is okay for now.