mpbot-github: Incomplete log files uploaded to paste.macports.org

[raimue (Rainer Müller)]

Some log files seem to miss the beginning of the log and it starts somewhere in the middle, for example:

​https://travis-ci.org/macports/macports-ports/builds/369592559

• ​https://paste.macports.org/9186db2a95c4

I have also seen others like that before, but did not save the URLs.

[raimue (Rainer Müller)]

How could we test whether this is caused by the runner on Travis or by paste.macports.org?

[l2dy (Zero King)]

Replying to raimue:

How could we test whether this is caused by the runner on Travis or by paste.macports.org?

If the file size is exactly 8 MiB (Content-Length: 8388608), then the runner trimmed it. You can test it with curl -I https://paste.macports.org/9186db2a95c4.txt.

[raimue (Rainer Müller)]

Could we prepend a line indicating that the runner trimmed the log file? That would make it clear what is going on. Something like:

(log has been trimmed to last 8 MB)
oc/boost/doc/html/boost/units/divid_1_3_44_10_2_30_3_2_4.html
DEBUG: activating file: /opt/local/share/doc/boost/doc/html/boost/units/divide_typeof_helper.html
DEBUG: activating directory: /opt/local/share/doc/boost/doc/html/boost/units/fahrenheit
...

Of course you would have to subtract this line from the number of available bytes, so it does not to exceed the intended size.

[l2dy (Zero King)]

Replying to raimue:

Could we prepend a line indicating that the runner trimmed the log file? That would make it clear what is going on.

​https://github.com/macports/mpbot-github/pull/5

[l2dy (Zero King)]

We need a size limit to prevent abuse. If we raised the limit on paste.macports.org, I can update the bot accordingly.