← @ben_pettis_ Twitter archive

Ben Pettis is @bpettis@mastodon.benpettis.ninja

@ben_pettis_

Does anyone know of a way to access historic @birdwatch data? Or if anyone has an archive/mirror?

The files on public data download page seem to only have data from the last ~24 hours, though the documentation implies that *all* of it will be published

https://twitter.com/i/birdwatch/download-data

11/9/2022, 5:53:00 PM

Favs: 0

Retweets: 0

Ben Pettis is @bpettis@mastodon.benpettis.ninja

@ben_pettis_

I'm thinking of examining this community-based quasi-factchecker moderation-adjacent tool as part of my dissertation, and want to make sure that I have copies of this data before Musk possibly renames it "community notes" and/or axes it completely

11/9/2022, 5:53:01 PM

Favs: 0

Retweets: 0

Ben Pettis is @bpettis@mastodon.benpettis.ninja

@ben_pettis_

Ah shoot, I should have read the docs more carefully....

I'll amend my previous question: does anyone know of an archive or mirror of historic @birdwatch data?

11/9/2022, 5:55:44 PM

Favs: 0

Retweets: 0

Ben Pettis is @bpettis@mastodon.benpettis.ninja

@ben_pettis_

A bit of shoddy python later, and I'll be saving daily copies of all public data moving forward.

Includes notes contributed by @birdwatch users, metadata about tweets they're responding to, and (anonymized) info about who is adding and rating notes.

https://github.com/bpettis/birdwatch-scraper

11/9/2022, 6:34:44 PM

Favs: 0

Retweets: 0

Ben Pettis is @bpettis@mastodon.benpettis.ninja

@ben_pettis_

Personally, I'm very interested in how many people are contributing and ranking these context notes as well as discussion in notes about how Users perceive the goal of @birdwatch notes and what types of content "needs" extra context

11/9/2022, 6:34:45 PM

Favs: 0

Retweets: 0

Ben Pettis is @bpettis@mastodon.benpettis.ninja

@ben_pettis_

But there's also lots of other potentially useful information in these files - IDs of tweets a note is associated with, user-entered responses to "Why do you believe this tweet may be misleading?" and so on

More info here:
https://twitter.github.io/birdwatch/download-data/

11/9/2022, 6:34:46 PM

Favs: 0

Retweets: 0