Skip to content

Implement new compliance Streams #694

@igorbrigadir

Description

@igorbrigadir

We have the batch compliance implemented, but the newer Stream compliance is still not implemented:

https://developer.twitter.com/en/docs/twitter-api/compliance/streams/introduction

It should work with Academic Access but i haven't tried yet. It has 2 streams: tweet and user compliance: https://developer.twitter.com/en/docs/twitter-api/compliance/streams/integrate/integrating-compliance-streams and each stream is partitioned (requires multiple connections) this is similar to the older covid 19 compliance stream: https://github.com/igorbrigadir/covid19-twitter-stream-tool/blob/master/src/stream/stream.py (just for reference, this was implemented by running 4 different instances in docker, but i think for twarc here it would be better to run multiple threads instead)

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions