Hi everyone, In order to sanitize historical BGP data I would like to use historical Bogon lists. The CIDR report generates those lists on a daily basis (e.g. https://www.cidr-report.org/bogons/freespace-dec.txt for prefixes) but, as far as I know, it does not keep a history of those files - it only holds the most up-to-date file. Does anybody know of a repository that contains such bogon lists for historical data, or, did anybody continiously fecthed and saved CIDR report's bogon lists? Best regards, Lars
Lars, Archive.org has snapshots going back several year. Just feed in the URL you posted, ad you’ll get a history that lets you download each version of the list that archive.org noticed changed. In my experience, that is pretty comprehensive. -mel beckman
On Dec 15, 2018, at 12:31 AM, Lars Prehn <lprehn@inet.tu-berlin.de> wrote:
Hi everyone,
In order to sanitize historical BGP data I would like to use historical Bogon lists. The CIDR report generates those lists on a daily basis (e.g. https://www.cidr-report.org/bogons/freespace-dec.txt for prefixes) but, as far as I know, it does not keep a history of those files - it only holds the most up-to-date file. Does anybody know of a repository that contains such bogon lists for historical data, or, did anybody continiously fecthed and saved CIDR report's bogon lists?
Best regards,
Lars
Hi Mel, I already checked Archive.org - it holds two previous copies.
lets you download each version of the list that archive.org noticed changed
According to Archive.org's own Note this seems to be inaccurate: This calendar view maps the number of times https://www.cidr-report.org/bogons/freespace-dec.txt was crawled by the Wayback Machine, not how many times the site was actually updated. , or am I missing something? Best regards, Lars Am 15.12.18 um 09:47 schrieb Mel Beckman:
Lars,
Archive.org has snapshots going back several year. Just feed in the URL you posted, ad you’ll get a history that lets you download each version of the list that archive.org noticed changed. In my experience, that is pretty comprehensive.
-mel beckman
On Dec 15, 2018, at 12:31 AM, Lars Prehn <lprehn@inet.tu-berlin.de> wrote:
Hi everyone,
In order to sanitize historical BGP data I would like to use historical Bogon lists. The CIDR report generates those lists on a daily basis (e.g. https://www.cidr-report.org/bogons/freespace-dec.txt for prefixes) but, as far as I know, it does not keep a history of those files - it only holds the most up-to-date file. Does anybody know of a repository that contains such bogon lists for historical data, or, did anybody continiously fecthed and saved CIDR report's bogon lists?
Best regards,
Lars
My understanding is that the calendar, which in this case showed a dozen or so copies, lists only crawled instances that had changed since The previous crawl. Well it certainly true that time elapses between each crawl, so it's possible that some changes could be missed, my understanding is that the Internet the scroll frequently enough that changes would be detected at least every month or so. I think it's possible that the bogin list just doesn't change that frequently. -mel via cell
On Dec 15, 2018, at 1:30 AM, Lars Prehn <lprehn@inet.tu-berlin.de> wrote:
Hi Mel,
I already checked Archive.org - it holds two previous copies.
lets you download each version of the list that archive.org noticed changed
According to Archive.org's own Note this seems to be inaccurate: This calendar view maps the number of times https://www.cidr-report.org/bogons/freespace-dec.txt was crawled by the Wayback Machine, not how many times the site was actually updated.
, or am I missing something?
Best regards, Lars
Am 15.12.18 um 09:47 schrieb Mel Beckman: Lars,
Archive.org has snapshots going back several year. Just feed in the URL you posted, ad you’ll get a history that lets you download each version of the list that archive.org noticed changed. In my experience, that is pretty comprehensive.
-mel beckman
On Dec 15, 2018, at 12:31 AM, Lars Prehn <lprehn@inet.tu-berlin.de> wrote:
Hi everyone,
In order to sanitize historical BGP data I would like to use historical Bogon lists. The CIDR report generates those lists on a daily basis (e.g. https://www.cidr-report.org/bogons/freespace-dec.txt for prefixes) but, as far as I know, it does not keep a history of those files - it only holds the most up-to-date file. Does anybody know of a repository that contains such bogon lists for historical data, or, did anybody continiously fecthed and saved CIDR report's bogon lists?
Best regards,
Lars
which in this case showed a dozen or so copies
Yeah sorry, I should have said that I was only looking into the time frame 2017 till now.
I think it's possible that the bogin list just doesn't change that frequently.
I think I aggree that it is unlikely to change frequently, however, there is not a single snapshot in archive.org for 2018. Best regards, Lars Am 15.12.18 um 17:38 schrieb Mel Beckman:
My understanding is that the calendar, which in this case showed a dozen or so copies, lists only crawled instances that had changed since The previous crawl. Well it certainly true that time elapses between each crawl, so it's possible that some changes could be missed, my understanding is that the Internet the scroll frequently enough that changes would be detected at least every month or so.
I think it's possible that the bogin list just doesn't change that frequently.
-mel via cell
On Dec 15, 2018, at 1:30 AM, Lars Prehn <lprehn@inet.tu-berlin.de> wrote:
Hi Mel,
I already checked Archive.org - it holds two previous copies.
lets you download each version of the list that archive.org noticed changed According to Archive.org's own Note this seems to be inaccurate: This calendar view maps the number of times https://www.cidr-report.org/bogons/freespace-dec.txt was crawled by the Wayback Machine, not how many times the site was actually updated.
, or am I missing something?
Best regards, Lars
Am 15.12.18 um 09:47 schrieb Mel Beckman: Lars,
Archive.org has snapshots going back several year. Just feed in the URL you posted, ad you’ll get a history that lets you download each version of the list that archive.org noticed changed. In my experience, that is pretty comprehensive.
-mel beckman
On Dec 15, 2018, at 12:31 AM, Lars Prehn <lprehn@inet.tu-berlin.de> wrote:
Hi everyone,
In order to sanitize historical BGP data I would like to use historical Bogon lists. The CIDR report generates those lists on a daily basis (e.g. https://www.cidr-report.org/bogons/freespace-dec.txt for prefixes) but, as far as I know, it does not keep a history of those files - it only holds the most up-to-date file. Does anybody know of a repository that contains such bogon lists for historical data, or, did anybody continiously fecthed and saved CIDR report's bogon lists?
Best regards,
Lars
On 12/15/18 1:31 AM, Lars Prehn wrote:
Hi everyone,
Hi,
In order to sanitize historical BGP data I would like to use historical Bogon lists. The CIDR report generates those lists on a daily basis (e.g. https://www.cidr-report.org/bogons/freespace-dec.txt for prefixes) but, as far as I know, it does not keep a history of those files - it only holds the most up-to-date file. Does anybody know of a repository that contains such bogon lists for historical data, or, did anybody continiously fecthed and saved CIDR report's bogon lists?
Have you tried reaching out to Team Cymru? They provide bogon feeds in a number of different formats. I would be surprised if they don't have the ability to provide historical versions of the bogon list. - It's probably worth asking. I have found them to be very responsive and quite helpful.
Best regards,
Good luck. -- Grant. . . . unix || die
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Dear team,
Have you tried reaching out to Team Cymru? They provide bogon feeds in a number of different formats. I would be surprised if they don't have the ability to provide historical versions of the bogon list. - It's probably worth asking. I have found them to be very responsive and quite helpful.
Thank you for the kind words, Grant! Sadly, we don't keep an archive of prior bogon lists, so we can't help here. Sorry! Be well, Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwYBwEACgkQQ+hhYvqF 8o1yFw/+LqPEPlkhwvKc+W/ewZesdM1ubCNmFZcqtTqUqgNLPK6d9b/G2g1sLrSf 7VNenl2YdZc3qjWfPN7fBKc5onlwNI4lOomJ4bCiqVaGLU46fUVWB5HShiUTZhT9 a0WT+kuqHxUFVM2ILffBusWnuSST7vFONJae122ktcnODIdLfU9P1SmNaz2RzXo8 GBRXgqvP3OD6oDE5GWG4jN1AoSJze8d+GzF1fLPr4Ln4+9YBJKaE3CgH7Qfp5lN/ t6+6gdiqRbGcX0UnOi9JXpI7n6IsJeczkRISdzakiKFoznfVnUH3n7rOv/pDSi+H EBa31e2klCViKCxf+eBuQNWVMTLxzL93CtSlHMoJqOYqlPv4T1KlyovUPuGFA+FX fkkQN+bBh/4ihxdPs62e71XOkq1lOE77OwpDROPl+nQQgoe2e5AIo1V+4ls3Qz2N FJ9s01SLH6f3cTLbom3Rj2VaO6BvmjWjcj03yZ4MtnR1wNrcrZ+VBgJayNRba6yi dRtX2KilryR+nLoVpTMcnCpP8lVxiePtfjQFh21C0jj8Dodp4YvzTWI2PZ+Zf8N8 pdOeO3XyjFD0FnJl+dvGOo5ErAqzgzDKMpD1euy/w/jXZQtmoaPasMDBF+TvXKFx Ql4JoXQpE4V8ZAyu2cTh0NN/4ce1GpHhny8pjSC9hAs+pYCvkqo= =OAK0 -----END PGP SIGNATURE-----
I wonder if there's value in having the lists that Team Cymru generates auto pushed to a public Git repo. Covers historical changes for folks who want that, and also provides a more modern ingestion method for automation around that info. (Not that I'm hating on wget / curl ... :) ) On Mon, Dec 17, 2018 at 3:31 PM Rabbi Rob Thomas <robt@cymru.com> wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
Dear team,
Have you tried reaching out to Team Cymru? They provide bogon feeds in a number of different formats. I would be surprised if they don't have the ability to provide historical versions of the bogon list. - It's probably worth asking. I have found them to be very responsive and quite helpful.
Thank you for the kind words, Grant! Sadly, we don't keep an archive of prior bogon lists, so we can't help here. Sorry!
Be well, Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwYBwEACgkQQ+hhYvqF 8o1yFw/+LqPEPlkhwvKc+W/ewZesdM1ubCNmFZcqtTqUqgNLPK6d9b/G2g1sLrSf 7VNenl2YdZc3qjWfPN7fBKc5onlwNI4lOomJ4bCiqVaGLU46fUVWB5HShiUTZhT9 a0WT+kuqHxUFVM2ILffBusWnuSST7vFONJae122ktcnODIdLfU9P1SmNaz2RzXo8 GBRXgqvP3OD6oDE5GWG4jN1AoSJze8d+GzF1fLPr4Ln4+9YBJKaE3CgH7Qfp5lN/ t6+6gdiqRbGcX0UnOi9JXpI7n6IsJeczkRISdzakiKFoznfVnUH3n7rOv/pDSi+H EBa31e2klCViKCxf+eBuQNWVMTLxzL93CtSlHMoJqOYqlPv4T1KlyovUPuGFA+FX fkkQN+bBh/4ihxdPs62e71XOkq1lOE77OwpDROPl+nQQgoe2e5AIo1V+4ls3Qz2N FJ9s01SLH6f3cTLbom3Rj2VaO6BvmjWjcj03yZ4MtnR1wNrcrZ+VBgJayNRba6yi dRtX2KilryR+nLoVpTMcnCpP8lVxiePtfjQFh21C0jj8Dodp4YvzTWI2PZ+Zf8N8 pdOeO3XyjFD0FnJl+dvGOo5ErAqzgzDKMpD1euy/w/jXZQtmoaPasMDBF+TvXKFx Ql4JoXQpE4V8ZAyu2cTh0NN/4ce1GpHhny8pjSC9hAs+pYCvkqo= =OAK0 -----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Dear Tom,
I wonder if there's value in having the lists that Team Cymru generates auto pushed to a public Git repo. Covers historical changes for folks who want that, and also provides a more modern ingestion method for automation around that info. (Not that I'm hating on wget / curl ... :) )
We'd be happy to make that happen, if folks are keen. We're fine with Git, as we use it regularly. Be well! Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwZJ5wACgkQQ+hhYvqF 8o2ULQ/+N++KAtZkfuYvzjnAwFQZGWvfTmFcmEwQKtbS+O53ymn2tGfMf/NjZKrS AyJdiNby1PFjDd4X/4bKsm1k4pOcqIvWHrNuQfSCMnsAAVlWWZr1SWjkV+rD2o80 XSrpz1nXYFH/Et3TMedc6fKLt6UgKlfua1t7xm4pBypjSHTBari601cvGMqa++4k wqAB5KUoIC1Ni5GVff1i+NCQ+6kfuVvXvnTHBjq6q6O+rLC5KpQwI/9pY3J5LODm 3nfqPYEo/otNRn/vX4lENMI/3lrMIXC4NO8fjYDgStVZ/1CZVWzxNFc4MgplpwKJ k/VLYnkuai7o4yT5Ao4xhKIctGOO79v8Gmgv9NJUXkfcqrL+EVI6FGQoWB8PiHxI ZWppA3kdiB7csG+zHG/+hliB5xI3SzlvNH/ywPzym06FLK5/1yKSI788qjyXBgZ4 h/Vs14DSrtqw/VlgBAV0f25PPJllmZeJwrtgqGzgwakLKqrk9ByCHBA77Xhk3XN8 Y5klq2uE8n2tYq5RHlUg1/+jdj6kQo2APHN7Q3H7FWv0CrW8JluHQdb7dLCnqFR8 Obo4H/G1DtjR60ECXvnS7X/6Fzs0KZFhd0E+jAbb2ErKQ2ZL+6+XuzaCXkDJ3oEp M+RftjLnwywE1MNf7q3Hmrpt3ku7HKjDQjvLZv2h8/f92rwy/1M= =i27M -----END PGP SIGNATURE-----
On 12/18/2018 10:00 AM, Rabbi Rob Thomas wrote:
We'd be happy to make that happen, if folks are keen.
I'm keen.
We're fine with Git, as we use it regularly.
How big is the bogon list? (I can't look at the moment.) Is it something that you can store the entire list periodically, or as it changes? I'm wondering about long term space consumption. Particularly if I'd like to have a local copy. }:-) -- Grant. . . . unix || die
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Dear team, The fine folks at CAIDA have maintained a repository of the bogon lists we've produced, going back to 18 SEP 2013. http://data.caida.org/datasets/bogon/ They are integrating the 2018 data provided by Alessandro Improta, and will have that in place after the new year. Will that work for folks, or would a git repository be useful in different ways? My thanks to Paul Hick, CAIDA, and Alessandro Improta for the assistance here! Thank you! Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwcBZEACgkQQ+hhYvqF 8o0gRA/7BbZt05/FEMXyTXXDhjB5pbgZVX33EbP+s2M/8EwcriKhHg9vLTqiILS+ 3Gq+6N3GboarEqgDBNamEm150H34e536+7+jknAu229P0xe44Wku57WlYYA0GOn+ oCfn0tOjjJzIA4pzf4IXWt7n4I99Er6SD5+LhkSOqBQADqnELDRsb/43dhKtIZvL eCqkYvPBxHmuuOvrQfASBK9jRYqmuaDeMeemrgeKPsPC26gfG+hmNPWRH6nbZxof o3OTCE/XQABioHj6XXJwoUVMguYVFwi9XaKa1+wvc3JxbQL5WiS/LZATgnp0PSci EgklBefGWOyWK+TCWK4Uz72828+wfPdduQx3EHhtxcau+JlmwVaBXSyDxcWb1NpK dhYdz9y2xkNo/2Mu0A/mVdnn/cayHu1PpOyQIUxltx24xDGjOfmGWwTWaHrYmmX4 LTsy5L0HMJInr0SsPpQVyiysJQlBDB9BWMk/Yi18HZWPMor0q8lvJXu7rroU1rZL qD86py+CaiJ/T9fhuIPWrQN4mjFhDvZg/jLbb5z4FVwLxmKQP/QuHVwCPhpLNOIe wVggDQ8XIAEA16NzvP5GOzTlsWekfrqAacHQ9k8z1zvfPShFvK8AlEW18+sQdskO BsQz+NR0sngTeZh/4re2SUdin2dQrTvcDyPjs+BFnwYGdXFAfrg= =MOKS -----END PGP SIGNATURE-----
Hello Rob, IMHO another option is to set up a local BGP daemon (e.g. Quagga, ICE) peering with your bogon route server project and dump bogon information regularly in MRT like route collectors are doing. So folks can select the RIB snapshot they prefer in time and (in case) study the evolution of bogons via update collections in MRT files. The result is something like this http://data.ris.ripe.net/rrc00/ but containing only bogon information. We did it for our studies last months, so I'd be more than happy to help if you decide to follow this path! Alessandro Improta IIT-CNR, Isolario project Il 2018-12-18 18:00 Rabbi Rob Thomas ha scritto:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
Dear Tom,
I wonder if there's value in having the lists that Team Cymru generates auto pushed to a public Git repo. Covers historical changes for folks who want that, and also provides a more modern ingestion method for automation around that info. (Not that I'm hating on wget / curl ... :) )
We'd be happy to make that happen, if folks are keen. We're fine with Git, as we use it regularly.
Be well! Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwZJ5wACgkQQ+hhYvqF 8o2ULQ/+N++KAtZkfuYvzjnAwFQZGWvfTmFcmEwQKtbS+O53ymn2tGfMf/NjZKrS AyJdiNby1PFjDd4X/4bKsm1k4pOcqIvWHrNuQfSCMnsAAVlWWZr1SWjkV+rD2o80 XSrpz1nXYFH/Et3TMedc6fKLt6UgKlfua1t7xm4pBypjSHTBari601cvGMqa++4k wqAB5KUoIC1Ni5GVff1i+NCQ+6kfuVvXvnTHBjq6q6O+rLC5KpQwI/9pY3J5LODm 3nfqPYEo/otNRn/vX4lENMI/3lrMIXC4NO8fjYDgStVZ/1CZVWzxNFc4MgplpwKJ k/VLYnkuai7o4yT5Ao4xhKIctGOO79v8Gmgv9NJUXkfcqrL+EVI6FGQoWB8PiHxI ZWppA3kdiB7csG+zHG/+hliB5xI3SzlvNH/ywPzym06FLK5/1yKSI788qjyXBgZ4 h/Vs14DSrtqw/VlgBAV0f25PPJllmZeJwrtgqGzgwakLKqrk9ByCHBA77Xhk3XN8 Y5klq2uE8n2tYq5RHlUg1/+jdj6kQo2APHN7Q3H7FWv0CrW8JluHQdb7dLCnqFR8 Obo4H/G1DtjR60ECXvnS7X/6Fzs0KZFhd0E+jAbb2ErKQ2ZL+6+XuzaCXkDJ3oEp M+RftjLnwywE1MNf7q3Hmrpt3ku7HKjDQjvLZv2h8/f92rwy/1M= =i27M -----END PGP SIGNATURE-----
Hi all, CAIDA has been collecting Team Cymru’s bogon list from 2013-09-18 to 2018-03-23. Unfortunately we just noticed the script hasn’t been working since then but we just fixed it and restarted it. We’re happy to share the data as long as Team Cymru’s is ok with it. Cheers, Alberto PS I think Rabbi+Randy also helped us in the past by recovering diffs for 2010-2013 data. Looking for the files. Stay tuned.
On Dec 18, 2018, at 9:00 AM, Rabbi Rob Thomas <robt@cymru.com> wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
Dear Tom,
I wonder if there's value in having the lists that Team Cymru generates auto pushed to a public Git repo. Covers historical changes for folks who want that, and also provides a more modern ingestion method for automation around that info. (Not that I'm hating on wget / curl ... :) )
We'd be happy to make that happen, if folks are keen. We're fine with Git, as we use it regularly.
Be well! Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwZJ5wACgkQQ+hhYvqF 8o2ULQ/+N++KAtZkfuYvzjnAwFQZGWvfTmFcmEwQKtbS+O53ymn2tGfMf/NjZKrS AyJdiNby1PFjDd4X/4bKsm1k4pOcqIvWHrNuQfSCMnsAAVlWWZr1SWjkV+rD2o80 XSrpz1nXYFH/Et3TMedc6fKLt6UgKlfua1t7xm4pBypjSHTBari601cvGMqa++4k wqAB5KUoIC1Ni5GVff1i+NCQ+6kfuVvXvnTHBjq6q6O+rLC5KpQwI/9pY3J5LODm 3nfqPYEo/otNRn/vX4lENMI/3lrMIXC4NO8fjYDgStVZ/1CZVWzxNFc4MgplpwKJ k/VLYnkuai7o4yT5Ao4xhKIctGOO79v8Gmgv9NJUXkfcqrL+EVI6FGQoWB8PiHxI ZWppA3kdiB7csG+zHG/+hliB5xI3SzlvNH/ywPzym06FLK5/1yKSI788qjyXBgZ4 h/Vs14DSrtqw/VlgBAV0f25PPJllmZeJwrtgqGzgwakLKqrk9ByCHBA77Xhk3XN8 Y5klq2uE8n2tYq5RHlUg1/+jdj6kQo2APHN7Q3H7FWv0CrW8JluHQdb7dLCnqFR8 Obo4H/G1DtjR60ECXvnS7X/6Fzs0KZFhd0E+jAbb2ErKQ2ZL+6+XuzaCXkDJ3oEp M+RftjLnwywE1MNf7q3Hmrpt3ku7HKjDQjvLZv2h8/f92rwy/1M= =i27M -----END PGP SIGNATURE-----
I think Alessandro Isolario Project may be of help completing the missing data where you fell short. M. --- On 2018-12-19 18:07, Alberto Dainotti wrote:
Hi all,
CAIDA has been collecting Team Cymru’s bogon list from 2013-09-18 to 2018-03-23. Unfortunately we just noticed the script hasn’t been working since then but we just fixed it and restarted it. We’re happy to share the data as long as Team Cymru’s is ok with it.
Cheers, Alberto
PS I think Rabbi+Randy also helped us in the past by recovering diffs for 2010-2013 data. Looking for the files. Stay tuned.
On Dec 18, 2018, at 9:00 AM, Rabbi Rob Thomas <robt@cymru.com> wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
Dear Tom,
I wonder if there's value in having the lists that Team Cymru generates auto pushed to a public Git repo. Covers historical changes for folks who want that, and also provides a more modern ingestion method for automation around that info. (Not that I'm hating on wget / curl ... :) )
We'd be happy to make that happen, if folks are keen. We're fine with Git, as we use it regularly.
Be well! Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwZJ5wACgkQQ+hhYvqF 8o2ULQ/+N++KAtZkfuYvzjnAwFQZGWvfTmFcmEwQKtbS+O53ymn2tGfMf/NjZKrS AyJdiNby1PFjDd4X/4bKsm1k4pOcqIvWHrNuQfSCMnsAAVlWWZr1SWjkV+rD2o80 XSrpz1nXYFH/Et3TMedc6fKLt6UgKlfua1t7xm4pBypjSHTBari601cvGMqa++4k wqAB5KUoIC1Ni5GVff1i+NCQ+6kfuVvXvnTHBjq6q6O+rLC5KpQwI/9pY3J5LODm 3nfqPYEo/otNRn/vX4lENMI/3lrMIXC4NO8fjYDgStVZ/1CZVWzxNFc4MgplpwKJ k/VLYnkuai7o4yT5Ao4xhKIctGOO79v8Gmgv9NJUXkfcqrL+EVI6FGQoWB8PiHxI ZWppA3kdiB7csG+zHG/+hliB5xI3SzlvNH/ywPzym06FLK5/1yKSI788qjyXBgZ4 h/Vs14DSrtqw/VlgBAV0f25PPJllmZeJwrtgqGzgwakLKqrk9ByCHBA77Xhk3XN8 Y5klq2uE8n2tYq5RHlUg1/+jdj6kQo2APHN7Q3H7FWv0CrW8JluHQdb7dLCnqFR8 Obo4H/G1DtjR60ECXvnS7X/6Fzs0KZFhd0E+jAbb2ErKQ2ZL+6+XuzaCXkDJ3oEp M+RftjLnwywE1MNf7q3Hmrpt3ku7HKjDQjvLZv2h8/f92rwy/1M= =i27M -----END PGP SIGNATURE-----
Yes, we got data from Jan 1st, 2018 to Oct 10th, 2018. Happy to share as long as Team Cymru’s is ok with it too! Ale Il 2018-12-19 16:35 M. Omer GOLGELI ha scritto:
I think Alessandro Isolario Project may be of help completing the missing data where you fell short.
M. ---
On 2018-12-19 18:07, Alberto Dainotti wrote:
Hi all,
CAIDA has been collecting Team Cymru’s bogon list from 2013-09-18 to 2018-03-23. Unfortunately we just noticed the script hasn’t been working since then but we just fixed it and restarted it. We’re happy to share the data as long as Team Cymru’s is ok with it.
Cheers, Alberto
PS I think Rabbi+Randy also helped us in the past by recovering diffs for 2010-2013 data. Looking for the files. Stay tuned.
On Dec 18, 2018, at 9:00 AM, Rabbi Rob Thomas <robt@cymru.com> wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
Dear Tom,
I wonder if there's value in having the lists that Team Cymru generates auto pushed to a public Git repo. Covers historical changes for folks who want that, and also provides a more modern ingestion method for automation around that info. (Not that I'm hating on wget / curl ... :) )
We'd be happy to make that happen, if folks are keen. We're fine with Git, as we use it regularly.
Be well! Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwZJ5wACgkQQ+hhYvqF 8o2ULQ/+N++KAtZkfuYvzjnAwFQZGWvfTmFcmEwQKtbS+O53ymn2tGfMf/NjZKrS AyJdiNby1PFjDd4X/4bKsm1k4pOcqIvWHrNuQfSCMnsAAVlWWZr1SWjkV+rD2o80 XSrpz1nXYFH/Et3TMedc6fKLt6UgKlfua1t7xm4pBypjSHTBari601cvGMqa++4k wqAB5KUoIC1Ni5GVff1i+NCQ+6kfuVvXvnTHBjq6q6O+rLC5KpQwI/9pY3J5LODm 3nfqPYEo/otNRn/vX4lENMI/3lrMIXC4NO8fjYDgStVZ/1CZVWzxNFc4MgplpwKJ k/VLYnkuai7o4yT5Ao4xhKIctGOO79v8Gmgv9NJUXkfcqrL+EVI6FGQoWB8PiHxI ZWppA3kdiB7csG+zHG/+hliB5xI3SzlvNH/ywPzym06FLK5/1yKSI788qjyXBgZ4 h/Vs14DSrtqw/VlgBAV0f25PPJllmZeJwrtgqGzgwakLKqrk9ByCHBA77Xhk3XN8 Y5klq2uE8n2tYq5RHlUg1/+jdj6kQo2APHN7Q3H7FWv0CrW8JluHQdb7dLCnqFR8 Obo4H/G1DtjR60ECXvnS7X/6Fzs0KZFhd0E+jAbb2ErKQ2ZL+6+XuzaCXkDJ3oEp M+RftjLnwywE1MNf7q3Hmrpt3ku7HKjDQjvLZv2h8/f92rwy/1M= =i27M -----END PGP SIGNATURE-----
I think Git would be the perfect solution...would definitely appreciate it. On Tue, Dec 18, 2018 at 12:01 PM Rabbi Rob Thomas <robt@cymru.com> wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
Dear Tom,
I wonder if there's value in having the lists that Team Cymru generates auto pushed to a public Git repo. Covers historical changes for folks who want that, and also provides a more modern ingestion method for automation around that info. (Not that I'm hating on wget / curl ... :) )
We'd be happy to make that happen, if folks are keen. We're fine with Git, as we use it regularly.
Be well! Rob. - -- Rabbi Rob Thomas Team Cymru "It is easy to believe in freedom of speech for those with whom we agree." - Leo McKern -----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEDcVjavXj08cL/QwdQ+hhYvqF8o0FAlwZJ5wACgkQQ+hhYvqF 8o2ULQ/+N++KAtZkfuYvzjnAwFQZGWvfTmFcmEwQKtbS+O53ymn2tGfMf/NjZKrS AyJdiNby1PFjDd4X/4bKsm1k4pOcqIvWHrNuQfSCMnsAAVlWWZr1SWjkV+rD2o80 XSrpz1nXYFH/Et3TMedc6fKLt6UgKlfua1t7xm4pBypjSHTBari601cvGMqa++4k wqAB5KUoIC1Ni5GVff1i+NCQ+6kfuVvXvnTHBjq6q6O+rLC5KpQwI/9pY3J5LODm 3nfqPYEo/otNRn/vX4lENMI/3lrMIXC4NO8fjYDgStVZ/1CZVWzxNFc4MgplpwKJ k/VLYnkuai7o4yT5Ao4xhKIctGOO79v8Gmgv9NJUXkfcqrL+EVI6FGQoWB8PiHxI ZWppA3kdiB7csG+zHG/+hliB5xI3SzlvNH/ywPzym06FLK5/1yKSI788qjyXBgZ4 h/Vs14DSrtqw/VlgBAV0f25PPJllmZeJwrtgqGzgwakLKqrk9ByCHBA77Xhk3XN8 Y5klq2uE8n2tYq5RHlUg1/+jdj6kQo2APHN7Q3H7FWv0CrW8JluHQdb7dLCnqFR8 Obo4H/G1DtjR60ECXvnS7X/6Fzs0KZFhd0E+jAbb2ErKQ2ZL+6+XuzaCXkDJ3oEp M+RftjLnwywE1MNf7q3Hmrpt3ku7HKjDQjvLZv2h8/f92rwy/1M= =i27M -----END PGP SIGNATURE-----
On 15/12/2018 08:31, Lars Prehn wrote:
Hi everyone,
In order to sanitize historical BGP data I would like to use historical Bogon lists. The CIDR report generates those lists on a daily basis (e.g. https://www.cidr-report.org/bogons/freespace-dec.txt for prefixes) but, as far as I know, it does not keep a history of those files - it only holds the most up-to-date file. Does anybody know of a repository that contains such bogon lists for historical data, or, did anybody continiously fecthed and saved CIDR report's bogon lists?
There does seem to be some historical data from the CIDR report here: http://thyme.rand.apnic.net/ Might have a few historical freespace-dec.txt files around from building periodic IP/country maps of all gTLD websites. Regards...jmcc
participants (10)
-
Alberto Dainotti -
alessandro.improta＠iit.cnr.it -
David Bass -
Grant Taylor -
John McCormac -
Lars Prehn -
M. Omer GOLGELI -
Mel Beckman -
Rabbi Rob Thomas -
Tom Beecher