9/ Across 8 cores we measured 1.217M signatures/s, short of 8× the single-core rate because all-core AVX-512 drops the clocks.
1
0
7
8/ For recurring keys it goes further, caching the decoded public key and then promoting hot ones to a precomputed table. With 64 promoted keys on the same Zen 5 host, n=64 measured 3.776 µs/sig, 7.3× stdlib. How much you get depends on key population and locality.
1
0
6
2/ Narya is a no-cgo Go library using AVX-512 IFMA assembly.
The numbers below are cold strict verification on 1232-byte messages, with no per-key state cached between calls. Most of the gain shows up once you have eight signatures, since that's what fills the lanes.
The numbers below are cold strict verification on 1232-byte messages, with no per-key state cached between calls. Most of the gain shows up once you have eight signatures, since that's what fills the lanes.
1
0
8
1/ Ed25519 verification is a major cost in Solana block replay. Mithril is written in Go, and the standard Go library wasn't enough for the throughput we wanted.
Today we're releasing narya-ed25519. 5.8× faster than crypto/ed25519 at 4.7 µs/sig (Zen5).
github.com/Overclock-Vali…
Today we're releasing narya-ed25519. 5.8× faster than crypto/ed25519 at 4.7 µs/sig (Zen5).
github.com/Overclock-Vali…
8
22
99
3/ Mithril’s performance has improved substantially. Mainnet block execution latency is roughly half what it was in the alpha release.
On a relatively small server, Mithril can execute full-CU blocks in under 400ms, helped by wins like better-parallelized account loading.
On a relatively small server, Mithril can execute full-CU blocks in under 400ms, helped by wins like better-parallelized account loading.
1
0
3
7/ Here’s a video of the tail end of this catch up process. In this run we fetched blocks from a @heliuslabs RPC endpoint to execute and get as close to the network tip as possible.
Any mismatches versus mainnet execution result in internal errors that halt a Mithril node.
Any mismatches versus mainnet execution result in internal errors that halt a Mithril node.
2
1
43
6/ Once a node reaches the chain tip (most recent confirmed slot in our current setup), it enters a steady state where replay settles closer to slot speed (~400 ms/slot or ~2.5 slots/s ).
Even less bandwidth is needed at this stage, roughly 10 to 30 Mbit/s download currently.
Even less bandwidth is needed at this stage, roughly 10 to 30 Mbit/s download currently.
1
0
49
5/ Here are some stats from the initial catchup period when Mithril needs to quickly execute blocks to reach the tip of the chain. Slots are replayed during this stage at ~3 to 10 slots/s depending on block sizes.
Download bandwidth is typically ~40 Mbit/s.
Download bandwidth is typically ~40 Mbit/s.
1
0
49
4/ With good but affordable hardware (16 GB RAM, newer Zen 4 Ryzen CPUs with 6+ cores, and a 1 TB+ PCIe 4.0 NVMe drive), Mithril can catch up quickly.
We expect requirements to drop as performance improves. Currently, mini pc's like the one below are excellent for Mithril.
We expect requirements to drop as performance improves. Currently, mini pc's like the one below are excellent for Mithril.
4
1
77
2/ To sync Mainnet, Mithril downloads a snapshot (~100 GB). This is bandwidth-demanding, but home internet is sufficient to do so (though slower).
AccountsDB build takes as little as 10 minutes, and snapshot download + extraction are pipelined to overlap network and disk I/O.
AccountsDB build takes as little as 10 minutes, and snapshot download + extraction are pipelined to overlap network and disk I/O.
1
0
63
1/ Two years ago, we set out to build a full node that could verify Solana Mainnet on modest hardware and home internet, making decentralization accessible.
Today we're releasing the Alpha version of Mithril, our Solana full node client in @golang, and it can do exactly that.
Today we're releasing the Alpha version of Mithril, our Solana full node client in @golang, and it can do exactly that.
122
144
775
11/ Lastly, we couldn’t have done it without our amazing team and great collaborators. Special shout-outs go to Shaun (smcio on GitHub), our lead Mithril developer, and newer Overclock team member Palmer, whose performance tweaks this past week were outstanding.
1
0
23
10/ Ultimately, we expect to see Mithril verifying blocks very close to the tip of chain with commodity hardware.
If you want to follow our progress more closely, check out the Mithril Development channel in our discord or head to the Mithril github repo
github.com/Overclock-Vali…
If you want to follow our progress more closely, check out the Mithril Development channel in our discord or head to the Mithril github repo
github.com/Overclock-Vali…
1
1
15
7/ Below you can see Mithril running on a small server from @latitudesh, verifying blocks from Epoch 781.
- ~450 ms/block
- Peak ~8 GB RAM usage during the snapshot to AccountsDB building process
- Steady state RAM usage of ~3 GB during block replay
- ~450 ms/block
- Peak ~8 GB RAM usage during the snapshot to AccountsDB building process
- Steady state RAM usage of ~3 GB during block replay
1
2
35
Do you have a sense of how much turbine retransmit, repair servicing, and gossip impact replay speed? At one Sol stake our replay times were a bit atrocious. We added a little bit of stake and are currently running Frankendancer (not sure if possible to see replay metrics now).
2
0
1
We were surprised to see that Overclock Diablo has a solid TVC rank given that it is only running with an EPYC 7443p cpu in Colombia at the moment.
EPYC 7443p's are a lower end CPU for MB these days and we are excited to see where things go when we receive our new hardware.
EPYC 7443p's are a lower end CPU for MB these days and we are excited to see where things go when we receive our new hardware.
8
4
34
Furthermore, we aim to support geographical decentralization, particularly in Latin America, which has seen a recent increase in validators through the efforts of @JagPool_xyz and the @SolanaFndn .
Overclock Diablo is now the first validator in Colombia, situated in Bogotá.
Overclock Diablo is now the first validator in Colombia, situated in Bogotá.
5
0
2
To support recent efforts to battle test Frankendancer and eventually Firedancer on Solana Mainnet Beta, we have launched a second validator that will be running Frankendancer, named Overclock Diablo 👹
stakewiz.com/validator/64ng…
stakewiz.com/validator/64ng…
8
1
28
Overclock is currently in the lead for the TVC day 1 validator competition 😎
("PERFECT RECORD" is not actually a validator, just an ideal benchmark). Follow the race from @jstrry's site here: app.vx.tools
("PERFECT RECORD" is not actually a validator, just an ideal benchmark). Follow the race from @jstrry's site here: app.vx.tools
6
2
33
We have reached a major goal: Mithril's first matching BankHash with Mainnet-beta ✨
In Milestone 1 we worked on SVM conformance at the transaction level. With matching BankHashes, we're starting to see client conformance between Mithril and Mainnet-beta at the level of blocks.
In Milestone 1 we worked on SVM conformance at the transaction level. With matching BankHashes, we're starting to see client conformance between Mithril and Mainnet-beta at the level of blocks.
5
20
80
3/7) Contrary to popular belief, more accessible verification of Solana is attainable.
Solana's validator & RPC nodes were designed for intensive, low-latency tasks, but certain sources of overhead can be minimized to achieve a more streamlined "verifying full node" design.
Solana's validator & RPC nodes were designed for intensive, low-latency tasks, but certain sources of overhead can be minimized to achieve a more streamlined "verifying full node" design.
5
1
24
2/7) A nagging criticism of Solana has been the difficulty to verify it with a full node, a weak point in its decentralization.
A Solana full node typically requires a pricy datacenter server and sophisticated technical experience — a heavy ask for most blockchain users.
A Solana full node typically requires a pricy datacenter server and sophisticated technical experience — a heavy ask for most blockchain users.
4
0
31
1/7) Today we're excited to shed light on Mithril, a Solana full node client in the Go programming language, being developed to make verification of the chain easy and affordable enough to do so from your home 🛖 or cloud ☁️
github.com/Overclock-Vali…
github.com/Overclock-Vali…
44
91
355
3/7) Contrary to popular belief, more accessible verification of Solana is attainable.
Solana's validator & RPC nodes were designed for intensive, low-latency tasks, but certain sources of overhead can be minimized to achieve a more streamlined "verifying full node" design.
Solana's validator & RPC nodes were designed for intensive, low-latency tasks, but certain sources of overhead can be minimized to achieve a more streamlined "verifying full node" design.
1
0
0
2/7) A nagging criticism of Solana has been the difficulty to verify it with a full node, a weak point in its decentralization.
A Solana full node typically requires a pricy datacenter server and sophisticated technical experience — a heavy ask for most blockchain users.
A Solana full node typically requires a pricy datacenter server and sophisticated technical experience — a heavy ask for most blockchain users.
1
0
0
This morning we migrated our validator to its new home in the Zag1 @digitalrealty datacenter in Zagreb, Croatia.
We wanted to help further geographical distribution and it is currently the only validator located in the beautiful country of Croatia.
validators.app/data-centers/6…
We wanted to help further geographical distribution and it is currently the only validator located in the beautiful country of Croatia.
validators.app/data-centers/6…
4
2
15
in a clob you can market make with much less money, so you can support higher volumes with significantly lesser capital. tvl doesn't count how much capital they're using for that - it's explicitly meant for swaps
3
0
0
1.16 is based and it'll get even better.
core devs are goated when it comes to optimizing hardware usage
core devs are goated when it comes to optimizing hardware usage
2
0
2
> You come to me with a full node which the average person can run for <$500 while maintaining a high TPS, I will support Solana.
you can run a performant node that stays at tip for 337$ @latitudesh
If you don't need to stay at the tip, you can do it for *much* cheaper
you can run a performant node that stays at tip for 337$ @latitudesh
If you don't need to stay at the tip, you can do it for *much* cheaper
1
0
1
additionally, solana HAS considered other cryptographic primitives as well, such as KZG commitments in turbine, but guess what -> the constant proof size is not worth the performance against just using merkle trees
1
1
10
this is completely wrong. solana has the same features eth does, but they're feature gated because
1) demand for the feature (eth NEEDS L2s to function, so doesn't)
2) currently, it would hurt performance
everything eth gets from "zk" is because of 3 precompiled alt_bn128 calls
1) demand for the feature (eth NEEDS L2s to function, so doesn't)
2) currently, it would hurt performance
everything eth gets from "zk" is because of 3 precompiled alt_bn128 calls
2
1
24
me getting validator rewards at 1 billion tps.
also sol becomes stupidly deflationary several orders of magnitude tps below that
also sol becomes stupidly deflationary several orders of magnitude tps below that
1
0
2
the lagavulin 16 is classic islay. hope you enjoy it! 🥂
goes well paired with brisket if you're a fan
goes well paired with brisket if you're a fan
2
0
1
life is fun when you're ignorant of how liquidity works and forget that you need all that TVL to prevent slippage. phoenix does higher volume with less capital locked because they're not a constant product AMM- which is basically all there is on those l2 chains
1
4
10
We gave 1.16.9 a shot for the past 2 days and the RAM decrease is quite amazing (see below) but there seems to be an issue for some validators where servers are crashing at times. After experiencing 2 of these ourselves we have downgraded to 1.14 for the time being.
1
1
15
Lastly, if you have any questions or concerns, please reach us in our discord discord.gg/M8KZh4Waz6
You can also monitor our commission and performance with @laine_sa_'s Stakewiz.com alerts: stakewiz.com/validator/AS3n…
Thanks again Solano friends and onward we march🫡
You can also monitor our commission and performance with @laine_sa_'s Stakewiz.com alerts: stakewiz.com/validator/AS3n…
Thanks again Solano friends and onward we march🫡
0
0
7
Greetings fellow Solano comrades who have made it to Solana Summer '23.
About one year ago, we (@7LayerMagik and @dubbel06) started Overclock validator on Solana and decided to go with the oh so loved, but oh so hated 0% commission.
About one year ago, we (@7LayerMagik and @dubbel06) started Overclock validator on Solana and decided to go with the oh so loved, but oh so hated 0% commission.
6
4
28
Today we jumped our Solana validator overseas to Tokyo and are now running the @jito_labs validator client. Here's to geographic decentralization, MEV rewards, and a fast new server with @latitudesh🥂
4
11
52
What's up with these weird rhythmic bank errors? It has been happening for a few months now afaik and seems to be tied to votes. @toly
1
0
10
@dubbel06 has enabled our MB Grafana metrics. Replay times are looking fast on an Epyc 74F3... Execution times appear faster than all Lido nodes that I've thus thus far compared against, along with some other stats. metrics.solana.com:3000/d/KCLhfAbMz/re…
1
1
2