Outsourced Blockchain and Crypto Data Types
Part II of the blockchain and Crypto Data series delves into data service providers. Nodes, RPCs, and indexers offer developers and blockchain users reliable data streams, but outsourcing data to a provider has its own trade-offs. Discover the dynamics of the data service layer in crypto.
Node-as-a-Service
Node-as-a-Service (NaaS) providers are essential because they run optimized node infrastructures and allow users to request data. They help startups cut the costs associated with running nodes. NaaS service providers run distributed node clients in the background and usually provide an API for blockchain interaction. This may involve dedicated or shared nodes that manage request traffic. Although NaaS doesn’t index data, it may offer optimization features and deliver raw or decoded data streams on demand.
Such service providers include Alchemy, Akr, Infura, Helius, Tenderly, and Quicknode. They provide all data forms from raw to more exotic on-chain data.
Raw Streaming Blockchain and Crypto Data
Raw Stream services provide standardized schemas for commonly requested data and deliver it through multiple interfaces and sinks. This service is essential because customers often need large quantities of data regularly to keep pace with the chain tip.
Raw Stream services work like NaaS but also store and serve large data volumes. Their infrastructure manages constant data streams, ensuring users can seamlessly access real-time or near-real-time data.
Most NaaS service providers named above offer Raw Streaming services.
Decoded Stream
Decoded streaming converts raw data into human-readable logs, traces, and view function tables. This relatively new service simplifies working with complex blockchain data by transforming it into formats that are easier to interpret and analyze.
Decoded data streaming services fetch raw data and run decoding systems. They also maintain a comprehensive Application Binary Interface (ABI) database from off-chain providers like Etherscan.
Indexed Data API
Indexed Data APIs provide metrics or transformed data via an API, often with an SDK for smoother integration. These metrics cover a broad spectrum of data, with providers consistently expanding their offerings to include new and specialized metrics, each aiming to explore new niches.
They use a more streamlined stack that focuses on extracting, transforming, loading, and delivering specific metrics rather than handling decoded, raw, or data requests from clients. Indexed Data Providers are optimized to deliver targeted, pre-processed metrics.
Some notable indexed data providers are Artemis, Arkham, Bitquery, Blockworks, Defillama, Glassnode, Messari, Nansen, and Token Terminal.
Shadow Logs of Blockchain and Crypto Data
Shadow logs are similar to regular logs. However, they do not come from contracts deployed on the blockchain like the latter. Instead, they are emitted by modifications to the contract’s source code. They are more flexible and can be used to create metrics and logs that were not necessarily part of the original contract deployment information.
Shadow logs can access many blockchain and crypto data types, including parts of the state that would otherwise be difficult to read, such as internal functions and variables. This makes shadow logs a powerful tool for in-depth data analysis.
Conclusion
Understanding which services can be outsourced is crucial for navigating the complex world of crypto data. From running nodes to delivering raw, decoded, and indexed data, these services enable developers and businesses to access the blockchain efficiently without maintaining their own infrastructure. Each outsourced data type comes with unique trade-offs to meet different needs. By utilizing these services, users can focus on developing and scaling their applications while specialized providers handle the heavy lifting of data infrastructure. As the ecosystem evolves, the demand for accessible outsourced solutions will only increase, making them a cornerstone of the crypto data landscape.
If you enjoyed reading this piece and would like to read more on Ethereum, visit the 2077 Research website.