Xatu - Libp2p events
libp2p_ #
Events from the consensus layer p2p network
Availability #
- EthPandaOps Clickhouse
- Public Parquet Files
Tables #
libp2p_gossipsub_beacon_attestation #
Table for libp2p gossipsub beacon attestation data.
Availability #
Data is partitioned hourly on slot_start_date_time for the following networks:
- mainnet:
2024-05-01to2024-10-03 - holesky:
2024-05-01to2024-10-03 - sepolia:
2024-05-01to2024-10-03
Example - Parquet file #
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query \
"SELECT * \
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/libp2p_gossipsub_beacon_attestation/2024/9/28/0.parquet', 'Parquet') \
LIMIT 10"
Example - Your Clickhouse #
Note:
FINALshould be used when querying this table
docker run --rm -it --net host \
clickhouse/clickhouse-server clickhouse client -q \
"SELECT \
* \
FROM default.libp2p_gossipsub_beacon_attestation FINAL \
WHERE \
slot_start_date_time >= NOW() - INTERVAL '1 HOUR' \
LIMIT 10"
Example - EthPandaOps Clickhouse #
Note:
FINALshould be used when querying this table
curl -G "https://clickhouse.analytics.production.platform.ethpandaops.io" \
-u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" \
--data-urlencode "query= \
SELECT \
* \
FROM default.libp2p_gossipsub_beacon_attestation FINAL \
WHERE \
slot_start_date_time >= NOW() - INTERVAL '1 HOUR' \
LIMIT 3 \
FORMAT Pretty \
"
Columns #
| Name | Type | Description |
|---|---|---|
| updated_date_time | DateTime |
Timestamp when the record was last updated |
| version | UInt32 |
Version of this row, to help with de-duplication we want the latest updated_date_time but lowest propagation_slot_start_diff time |
| event_date_time | DateTime64(3) |
Timestamp of the event with millisecond precision |
| slot | UInt32 |
Slot number associated with the event |
| slot_start_date_time | DateTime |
Start date and time of the slot |
| epoch | UInt32 |
The epoch number in the attestation |
| epoch_start_date_time | DateTime |
The wall clock time when the epoch started |
| committee_index | LowCardinality(String) |
The committee index in the attestation |
| attesting_validator_index | Nullable(UInt32) |
The index of the validator attesting to the event |
| attesting_validator_committee_index | LowCardinality(String) |
The committee index of the attesting validator |
| wallclock_slot | UInt32 |
Slot number of the wall clock when the event was received |
| wallclock_slot_start_date_time | DateTime |
Start date and time of the wall clock slot when the event was received |
| wallclock_epoch | UInt32 |
Epoch number of the wall clock when the event was received |
| wallclock_epoch_start_date_time | DateTime |
Start date and time of the wall clock epoch when the event was received |
| propagation_slot_start_diff | UInt32 |
Difference in slot start time for propagation |
| peer_id_unique_key | Int64 |
Unique key associated with the identifier of the peer |
| message_id | String |
Identifier of the message |
| message_size | UInt32 |
Size of the message in bytes |
| topic_layer | LowCardinality(String) |
Layer of the topic in the gossipsub protocol |
| topic_fork_digest_value | LowCardinality(String) |
Fork digest value of the topic |
| topic_name | LowCardinality(String) |
Name of the topic |
| topic_encoding | LowCardinality(String) |
Encoding used for the topic |
| aggregation_bits | String |
The aggregation bits of the event in the attestation |
| beacon_block_root | FixedString(66) |
The beacon block root hash in the attestation |
| source_epoch | UInt32 |
The source epoch number in the attestation |
| source_epoch_start_date_time | DateTime |
The wall clock time when the source epoch started |
| source_root | FixedString(66) |
The source beacon block root hash in the attestation |
| target_epoch | UInt32 |
The target epoch number in the attestation |
| target_epoch_start_date_time | DateTime |
The wall clock time when the target epoch started |
| target_root | FixedString(66) |
The target beacon block root hash in the attestation |
| meta_client_name | LowCardinality(String) |
Name of the client that generated the event |
| meta_client_id | String |
Unique Session ID of the client that generated the event. This changes every time the client is restarted. |
| meta_client_version | LowCardinality(String) |
Version of the client that generated the event |
| meta_client_implementation | LowCardinality(String) |
Implementation of the client that generated the event |
| meta_client_os | LowCardinality(String) |
Operating system of the client that generated the event |
| meta_client_ip | Nullable(IPv6) |
IP address of the client that generated the event |
| meta_client_geo_city | LowCardinality(String) |
City of the client that generated the event |
| meta_client_geo_country | LowCardinality(String) |
Country of the client that generated the event |
| meta_client_geo_country_code | LowCardinality(String) |
Country code of the client that generated the event |
| meta_client_geo_continent_code | LowCardinality(String) |
Continent code of the client that generated the event |
| meta_client_geo_longitude | Nullable(Float64) |
Longitude of the client that generated the event |
| meta_client_geo_latitude | Nullable(Float64) |
Latitude of the client that generated the event |
| meta_client_geo_autonomous_system_number | Nullable(UInt32) |
Autonomous system number of the client that generated the event |
| meta_client_geo_autonomous_system_organization | Nullable(String) |
Autonomous system organization of the client that generated the event |
| meta_network_id | Int32 |
Network ID associated with the client |
| meta_network_name | LowCardinality(String) |
Name of the network associated with the client |
libp2p_gossipsub_beacon_block #
Table for libp2p gossipsub beacon block data.
Availability #
Data is partitioned daily on slot_start_date_time for the following networks:
- mainnet:
2024-04-26to2024-10-03 - holesky:
2024-04-26to2024-10-03 - sepolia:
2024-04-26to2024-10-03
Example - Parquet file #
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query \
"SELECT * \
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/libp2p_gossipsub_beacon_block/2024/9/28.parquet', 'Parquet') \
LIMIT 10"
Example - Your Clickhouse #
Note:
FINALshould be used when querying this table
docker run --rm -it --net host \
clickhouse/clickhouse-server clickhouse client -q \
"SELECT \
* \
FROM default.libp2p_gossipsub_beacon_block FINAL \
WHERE \
slot_start_date_time >= NOW() - INTERVAL '1 HOUR' \
LIMIT 10"
Example - EthPandaOps Clickhouse #
Note:
FINALshould be used when querying this table
curl -G "https://clickhouse.analytics.production.platform.ethpandaops.io" \
-u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" \
--data-urlencode "query= \
SELECT \
* \
FROM default.libp2p_gossipsub_beacon_block FINAL \
WHERE \
slot_start_date_time >= NOW() - INTERVAL '1 HOUR' \
LIMIT 3 \
FORMAT Pretty \
"
Columns #
| Name | Type | Description |
|---|---|---|
| updated_date_time | DateTime |
Timestamp when the record was last updated |
| version | UInt32 |
Version of this row, to help with de-duplication we want the latest updated_date_time but lowest propagation_slot_start_diff time |
| event_date_time | DateTime64(3) |
Timestamp of the event with millisecond precision |
| slot | UInt32 |
Slot number associated with the event |
| slot_start_date_time | DateTime |
Start date and time of the slot |
| epoch | UInt32 |
Epoch number associated with the event |
| epoch_start_date_time | DateTime |
Start date and time of the epoch |
| wallclock_slot | UInt32 |
Slot number of the wall clock when the event was received |
| wallclock_slot_start_date_time | DateTime |
Start date and time of the wall clock slot when the event was received |
| wallclock_epoch | UInt32 |
Epoch number of the wall clock when the event was received |
| wallclock_epoch_start_date_time | DateTime |
Start date and time of the wall clock epoch when the event was received |
| propagation_slot_start_diff | UInt32 |
Difference in slot start time for propagation |
| block | FixedString(66) |
The beacon block root hash |
| proposer_index | UInt32 |
The proposer index of the beacon block |
| peer_id_unique_key | Int64 |
Unique key associated with the identifier of the peer |
| message_id | String |
Identifier of the message |
| message_size | UInt32 |
Size of the message in bytes |
| topic_layer | LowCardinality(String) |
Layer of the topic in the gossipsub protocol |
| topic_fork_digest_value | LowCardinality(String) |
Fork digest value of the topic |
| topic_name | LowCardinality(String) |
Name of the topic |
| topic_encoding | LowCardinality(String) |
Encoding used for the topic |
| meta_client_name | LowCardinality(String) |
Name of the client that generated the event |
| meta_client_id | String |
Unique Session ID of the client that generated the event. This changes every time the client is restarted. |
| meta_client_version | LowCardinality(String) |
Version of the client that generated the event |
| meta_client_implementation | LowCardinality(String) |
Implementation of the client that generated the event |
| meta_client_os | LowCardinality(String) |
Operating system of the client that generated the event |
| meta_client_ip | Nullable(IPv6) |
IP address of the client that generated the event |
| meta_client_geo_city | LowCardinality(String) |
City of the client that generated the event |
| meta_client_geo_country | LowCardinality(String) |
Country of the client that generated the event |
| meta_client_geo_country_code | LowCardinality(String) |
Country code of the client that generated the event |
| meta_client_geo_continent_code | LowCardinality(String) |
Continent code of the client that generated the event |
| meta_client_geo_longitude | Nullable(Float64) |
Longitude of the client that generated the event |
| meta_client_geo_latitude | Nullable(Float64) |
Latitude of the client that generated the event |
| meta_client_geo_autonomous_system_number | Nullable(UInt32) |
Autonomous system number of the client that generated the event |
| meta_client_geo_autonomous_system_organization | Nullable(String) |
Autonomous system organization of the client that generated the event |
| meta_network_id | Int32 |
Network ID associated with the client |
| meta_network_name | LowCardinality(String) |
Name of the network associated with the client |
libp2p_gossipsub_blob_sidecar #
Table for libp2p gossipsub blob sidecar data
Availability #
Data is partitioned daily on slot_start_date_time for the following networks:
- mainnet:
2024-06-04to2024-10-03 - holesky:
2024-06-04to2024-10-03 - sepolia:
2024-06-04to2024-10-03
Example - Parquet file #
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query \
"SELECT * \
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/libp2p_gossipsub_blob_sidecar/2024/9/28.parquet', 'Parquet') \
LIMIT 10"
Example - Your Clickhouse #
Note:
FINALshould be used when querying this table
docker run --rm -it --net host \
clickhouse/clickhouse-server clickhouse client -q \
"SELECT \
* \
FROM default.libp2p_gossipsub_blob_sidecar FINAL \
WHERE \
slot_start_date_time >= NOW() - INTERVAL '1 HOUR' \
LIMIT 10"
Example - EthPandaOps Clickhouse #
Note:
FINALshould be used when querying this table
curl -G "https://clickhouse.analytics.production.platform.ethpandaops.io" \
-u "$CLICKHOUSE_USER:$CLICKHOUSE_PASSWORD" \
--data-urlencode "query= \
SELECT \
* \
FROM default.libp2p_gossipsub_blob_sidecar FINAL \
WHERE \
slot_start_date_time >= NOW() - INTERVAL '1 HOUR' \
LIMIT 3 \
FORMAT Pretty \
"
Columns #
| Name | Type | Description |
|---|---|---|
| updated_date_time | DateTime |
Timestamp when the record was last updated |
| version | UInt32 |
Version of this row, to help with de-duplication we want the latest updated_date_time but lowest propagation_slot_start_diff time |
| event_date_time | DateTime64(3) |
Timestamp of the event with millisecond precision |
| slot | UInt32 |
Slot number associated with the event |
| slot_start_date_time | DateTime |
Start date and time of the slot |
| epoch | UInt32 |
Epoch number associated with the event |
| epoch_start_date_time | DateTime |
Start date and time of the epoch |
| wallclock_slot | UInt32 |
Slot number of the wall clock when the event was received |
| wallclock_slot_start_date_time | DateTime |
Start date and time of the wall clock slot when the event was received |
| wallclock_epoch | UInt32 |
Epoch number of the wall clock when the event was received |
| wallclock_epoch_start_date_time | DateTime |
Start date and time of the wall clock epoch when the event was received |
| propagation_slot_start_diff | UInt32 |
Difference in slot start time for propagation |
| proposer_index | UInt32 |
The proposer index of the beacon block |
| blob_index | UInt32 |
Blob index associated with the record |
| parent_root | FixedString(66) |
Parent root of the beacon block |
| state_root | FixedString(66) |
State root of the beacon block |
| peer_id_unique_key | Int64 |
Unique key associated with the identifier of the peer |
| message_id | String |
Identifier of the message |
| message_size | UInt32 |
Size of the message in bytes |
| topic_layer | LowCardinality(String) |
Layer of the topic in the gossipsub protocol |
| topic_fork_digest_value | LowCardinality(String) |
Fork digest value of the topic |
| topic_name | LowCardinality(String) |
Name of the topic |
| topic_encoding | LowCardinality(String) |
Encoding used for the topic |
| meta_client_name | LowCardinality(String) |
Name of the client that generated the event |
| meta_client_id | String |
Unique Session ID of the client that generated the event. This changes every time the client is restarted. |
| meta_client_version | LowCardinality(String) |
Version of the client that generated the event |
| meta_client_implementation | LowCardinality(String) |
Implementation of the client that generated the event |
| meta_client_os | LowCardinality(String) |
Operating system of the client that generated the event |
| meta_client_ip | Nullable(IPv6) |
IP address of the client that generated the event |
| meta_client_geo_city | LowCardinality(String) |
City of the client that generated the event |
| meta_client_geo_country | LowCardinality(String) |
Country of the client that generated the event |
| meta_client_geo_country_code | LowCardinality(String) |
Country code of the client that generated the event |
| meta_client_geo_continent_code | LowCardinality(String) |
Continent code of the client that generated the event |
| meta_client_geo_longitude | Nullable(Float64) |
Longitude of the client that generated the event |
| meta_client_geo_latitude | Nullable(Float64) |
Latitude of the client that generated the event |
| meta_client_geo_autonomous_system_number | Nullable(UInt32) |
Autonomous system number of the client that generated the event |
| meta_client_geo_autonomous_system_organization | Nullable(String) |
Autonomous system organization of the client that generated the event |
| meta_network_id | Int32 |
Network ID associated with the client |
| meta_network_name | LowCardinality(String) |
Name of the network associated with the client |