<aside> 💡 Now see docs page here: https://docs.neynar.com/docs/indexer-service-pipe-farcaster-data

</aside>

Archive

A service that reads real-time data from hubs and indexes it into your Postgres database.

Benefits

• Full control over a Farcaster dataset that is synced in real-time
  • custom indexes, derivative tables, and custom APIs
• No need to maintain a hub
• No need to maintain an indexer with new protocol updates
  • Neynar handles all protocol changes for newly available data

Requirements

Requirements

Important FYIs for managing your own disk

• Disk size: Start with a big enough disk! Changing disk sizes on Amazon EBS (which RDS uses) is limited by a 6 hour cooldown timer. This timer also applies to their “auto scaling” of drives. Whenever changing your disk type or size or iops, be sure to take this cooldown into consideration! Beware that this timer is shared by all three of those settings. So even if you change just the iops, you have to wait 6 hours to change the size or type!
• Read queries: If you need long running queries (especially ones that join multiple tables), know that they will block some syncing. This will manifest as spikes in your “buffered emits” graph. Fix this blocking by adding a replica and moving all of your reading to there. You will also probably need to enable hot_standby_feedback if your queries are taking too long with a replica.

Steps