Flashbots Transparency Report — Sept-Dec 2021

This post was originally posted on 2022-01-16
Author: Xinyuan Sun, @sxysun

Flashbots Transparency Report — Sept-Dec 2021

Hi everyone, it’s been a while! Here is a double-edition of our latest transparency report. As you can imagine, we’ve been busy.

Overview

In the last 4 months of 2021, the Flashbots team has grown to a size of 20 members, welcoming new teammates like myself (hi :person_raising_hand:‍).

We released v0.4 of Flashbots Auction, which introduces megabundles, released Flashbots Protect, which provides an easy way to use Flashbots for frontrunning protection, and improved the performance and reliability of our infrastructure on many fronts.

The research that was started in the previous months on Ethereum 2.0 was productized, culminating in the release of our design of the Flashbots Auction for Ethereum 2.0, MEV-Boost, and in the creation of the Flashbots Eth2.0 Working Group.

In addition, some of the research we had been working on internally saw the light of day, such as our work on MEV formalization and on cross-domain MEV.

Flashbots Auction

In the last 4 months, miners made 65,961.98 ETH (258,976,454.42 USD) using Flashbots, the Flashbots network sustained a hashrate of around 83%, and our inclusion rate has oscillated at around 55%. You can find all of these numbers and more at https://dashboard.flashbots.net

v0.4 Megabundle release

On September 27th, we published v0.4 of MEV-Geth which introduces megabundles. This allows trusted relayers to submit larger, pre-merged, and ordered bundles of transactions to miners. While those bundles are initially scored and sorted against the existing bundle-merging algorithm introduced in v0.3, the fact bundle-merging now lives at the relayer level means it can be improved without impacting the performance of mev-geth for all mining pools and miners.

This update is a prequel to the proposer-builder separation on Ethereum, where megabundles would become full blocks. For the detailed specification of this update, please see our docs. We expect mega bundles to continue to be a focus going forward.

Infrastructure improvements

In the last four months, we’ve been working on making the Flashbots auction more efficient by developing better bundle pricing and merging techniques, and working on specialized infrastructure.

With these improvements, we started the journey of delivering the most profitable searcher bundles to miners faster than ever before.

Searcher tooling

Shout out to community members libevm for adding a new simulation call estimateGasBundle method to the MEV-Geth repo, and shekirin for adding new RPC method flashbots_getWork which adds a new block reward including MEV to the eth_getWork RPC result.

To better help our searchers land bundles, we’ve published a guide to troubleshoot bundle inclusion problems. In addition, two articles were published by Robert Miller that should help the MEV community understand MEV better. The first is Anatomy of an MEV Strategy: Synthetix, published alongside a repo where the searcher written about was open sourced. The second is a glimpse into some of the MEV bots targeting tail-end opportunities out there, preying on obscure cryptographic inefficiencies

Preparing for Proof of Stake Ethereum

Ethereum will soon transition to a proof of stake consensus protocol in an event called ‘The Merge’. Anticipating this important change, we released on November 4th MEV-Boost: Merge-ready Flashbots Architecture, where we outline a design for a marketplace for block construction (or block proposer/builder separation, PBS) compatible with the upcoming Ethereum merge fork.

We implemented this prototype on the latest Kintsugi testnet, and walked through it during an Ethereum Core Developer call which you can watch here.

We also launched the Flashbots Eth2 Working Group, a working group for flashbots and teams building, staking, and validating in proof of stake Ethereum to come together to ensure that we can continue developing and promoting the adoption of an effective MEV solution on Ethereum post-merge. The working group will be operating in an open and credibly neutral manner, just like Flashbots, and will not be exclusive to a small group of insiders or favor certain groups over others.

Since the announcement, the working group has grown to more than 28 members from the validating, staking, client, and infrastructure provider communities.

Flashbots Protect

On October 6th, we released Flashbots Protect. Protect allows everyday Ethereum users and developers to enjoy frontrunning protection. Specifically, it abstracts away the complexity of submitting bundles to the Flashbots Auction and makes integrating it as simple as adding an RPC URL to your Metamask.

Since the release, we’ve gradually added more features to it, like cancellation of private transactions and an API to get pending transaction status. The UX has also been improved because Etherscan integrated our pending status API, and are working with rollup providers to help settle large transactions.

In the coming months, we’ll be integrating Protect with various dApps and wallets, and will offer offer new features, improve inclusion rates, and make Flashbots Protect onboarding/integration easier.

Flashbots Data

The Data team has been focused on rewriting mev-inspect from Rust to Python to make it easier for others to contribute to the codebase.

mev-inspect-py comes with many improvements, including several orders of magnitude faster analysis of blocks and a much smoother contributor flow.

In order to encourage others to collaborate, resources have also been pubished such as a step-by-step walkthrough by Robert Miller of how to add a new MEV inspector using as an example a cryptopunk snipers MEV inspector, and a walkthrough of the mev-inspect-py codebase you can watch here.

Thanks to the many awesome community contributors to Inspect for PRs such as this one by tmilukin and that one by mazzafish, and to the users trying it out and giving us feedback on what isn’t work for them!

In the coming months, we will be updating mev-explore by replacing its backend with mev-inspect-py, revamp other Flashbots dashboards and aim to make mev-inspect data be more accessible to the public.

Flashbots Research

As we continued research on Proof of Stake Ethereum (FRP-15), we also turned our attention to MEV on Layer 2s and other chains (FRP-16). Out of this work, we released the first paper out of Flashbots Research on December 2nd called Unity is Strength: A Formalization of Cross-Domain Maximal Extractable Value. The paper formalizes a definition of cross-domain MEV in a multi-chain future, as well as possible negative externalities that could arise from cross-domain MEV extraction.

As a companion post to the paper, Flashbots researcher Alejo Salles published On the Formalization of MEV. The post presents formal definitions of MEV that improve on issues encountered in previous works and community misconceptions. It also paves the way for a more systematic approach in studying MEV by highlighting many of the subtleties involved in giving a robust MEV formalization.

We ran a research workshop on the paper which you can watch here, and were happy to see Vitalik Buterin use the paper in Endgame to reason about block builder centralization in a ‘many rollups’ world.

In the coming months, we will be working on EVM parallelization (and many other useful relay simulation optimizations), MEV taxonomy, and follow-up works on cross-domain MEV, as well as supporting research on the Proposer-Builder Separation. We are also expanding and hiring talented researchers! If you are interested, please reach out!

Community

Whitehat

The Flashbots Whitehat community has executed 100 successful rescues in the last 6 months. Activities are ramping up to more than 200 rescue requests a month, and more people have joined the effort to support it.

Shout out to the amazing Scott Bigelow, 0xdeadf4ce, amanusk, zeroXbrock, sipox11, mov and Riposte for pulling off these rescues!

Some highlights:

  • On Dec 21st in the wake of a $27m whitehat rescue by samczsun and others, the Gelato team, and Flashbots community members (whitehat searchers) 0x911, imagine, Robert Miller helped rescue user funds that were at risk from an attacker.
  • Kane Wallmann used Flashbots Auction to recover $13k worth of ENS tokens from a hacked account and return them to their rightful owner.
  • Steve Pikelny shared about their Flashbots recovery experience saving contract ownership the hacker did not know about until it was too late!

Public appearances

After several months without one, we hosted a Roast entitled “PBS on Ethereum Roadmap” on Dec 3rd, covering several Proposer-Builder Separation-related research proposals/WIPs. Watch the recording here.

Flashbots was covered in Bloomberg’s article Robot Crypto Traders Are the New Flash Boys.

Resources

We released a blog website where we’ve aggregated all our written content. This should make it easier for our community to find things we’ve written.

We also aggregated all our videos on a Youtube channel which includes playlists for all the Roasts, research workshops, tutorials and community events we participated in.

Shoutout to awesome community resources we’ve seen shared around Twitter and Github such as Moebius’ 0 to 1 Guide To MEV .

Get involved

At Flashbots, we research and build systems around MEV, and we would love to collaborate with you. We are a distributed organization with the principles of a pirate hacker collective, and have several open positions. We also issue grants to external researchers doing work aligned with ours, please find out more in our Research repository, or join our Discord!