Missing logs_by_topic table about ethereum-etl-airflow

[medvedev1088]

It's done in this repo https://github.com/blockchain-etl/blockchain-etl-dataflow/blob/master/partitioned_tables.md

[johnayoung]

Thanks a ton @medvedev1088 for the quick response.

So am I correct in assuming:

• live will stream entities (blocks, transactions, etc.) to Pub/Sub using https://github.com/blockchain-etl/blockchain-etl-streaming
• then uses https://github.com/blockchain-etl/blockchain-etl-dataflow to connect pub/sub to BigQuery

Are both of these repos setup enough where we can plug and play our own implementation? We plan on contributing to the dataset ecosystem, but need a custom implementation for some edge cases.

[medvedev1088]

@johnayoung yes those assumptions are correct. The code in the repos is sufficient to set the system up.

On your last point, what datasets are you planning on contributing?