Skip to content

Content not getting pulled in due to timing issues #10

Description

@evoltech

On my sweeper installation content from channels is not getting pulled in. I keep getting messages like:

Jan 19 23:35:30     [debug] Core::Modules::SiSPS::Parsers::TwitterParser::GetForTwitterSearch [Skipped feed item as date 2011-01-19T23:12:35-08:00 less than last sucessful run (2011-01-19T23:34:29-08:00)]

and

Jan 19 23:35:39     [debug] Core::Modules::SiSPS::Parsers::GoogleNewsParser::GetAndParse [Skipped feed item as date 2011-01-19T10:47:00-08:00 less than last sucessful run (2011-01-19T23:34:39-08:00)]

The problem I think is due to lag of the internet compared with the frequency that each channel is getting updated. Each channel will be checked about once a minute and will have its lastSucecess time updated. The next time content items are looked for they will be skipped if they are older then the channels lastSuccess value.

I am not sure what the solution is here, but this is preventing any content from getting pulled.

Activity

  1. jgosier commented on Jan 20, 2011

    @jgosier

    Thanks for posting this. It's definitely in our short term roadmap to move over to PubSubHubBub in the near feature which will improve the way content is pulled in. We also want to put some options in place for controlling just how frequently each channel updates.

    However skipping any sort of content is certainly a bug, so we'll work on a shorter term solution for the next release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions