UnknownBlockSync: cannot find peer with needed columns=[]

[twoeths]

Describe the bug

641242:May-01 15:53:24.801[sync]            debug: Ignoring unknown payload root after failed download slot=unknown, root=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, pendingPayloads=2 - Error fetching payload by root slot=867 root=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be after 14: cannot find peer with needed columns=[]
641243:Error: Error fetching payload by root slot=867 root=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be after 14: cannot find peer with needed columns=[]

grep -e "cannot find peer with needed columns=\[\]" -rn beacon-2026-05-01.log | wc -l
2394

Expected behavior

needed columns are empty, it means data is available

Steps to reproduce

No response

Additional context

No response

Operating system

Linux

Lodestar version or commit hash

glamsterdam-devnet-2

[twoeths]

641148:May-01 15:53:24.784[sync]          verbose: BlockInputSync.downloadPayload() slot=unknown, root=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, pendingPayloads=2
641150:May-01 15:53:24.799[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=1, peer=16Uiu2HAkwwZSj5cenwn74nzFHjA3iVZ3zS2Cay4bXKm5c8NC39CW, peerClient=Teku, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641158:May-01 15:53:24.799[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=2, peer=16Uiu2HAmL2tgmMDLoYVrydquKzJEnkSJL7z6Y8vMhQZVCq9MjUXq, peerClient=Teku, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641165:May-01 15:53:24.799[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=3, peer=16Uiu2HAm7CDzxW5G7UWLG7DRDNViVYppq6rJenUM5wsRX61P7pTL, peerClient=Teku, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641172:May-01 15:53:24.799[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=4, peer=16Uiu2HAkvUViDYpV4xzQHTaKjkFSVz4b5Tj95a9HUK4FACpJ6b2K, peerClient=Nimbus, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641179:May-01 15:53:24.800[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=5, peer=16Uiu2HAmEUakUBrFwykwncBPRvXitCn2dvp9CsnAti1itbsTdaVo, peerClient=Lodestar, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641186:May-01 15:53:24.800[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=6, peer=16Uiu2HAmMRoAFz8msFuT3q653Lc72YMjhXfSor5NiGSFqvAJZE5g, peerClient=Lodestar, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641193:May-01 15:53:24.800[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=7, peer=16Uiu2HAmPHEPpgCeS54Wp5zqiFcQV52DnVbMn6VwdVY29Q7H9FFT, peerClient=Teku, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641200:May-01 15:53:24.800[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=8, peer=16Uiu2HAmC4tFdY5TRuHtaVKemC1bkFMZDiKmpa5ovNbyx6YPnp7J, peerClient=Teku, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641207:May-01 15:53:24.800[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=9, peer=16Uiu2HAm6QdmAn7m6eQgQd2USAbVrUebu3VZDZtqCPrMRgRvm9J1, peerClient=Teku, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641214:May-01 15:53:24.800[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=10, peer=16Uiu2HAm8YCEJEeJe7wUodYhdsyxj5FAu5WpnYg2Xt44GKjyAQsm, peerClient=Lodestar, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641221:May-01 15:53:24.800[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=11, peer=16Uiu2HAkv1d3At4NAkvikLwHuFuSzt2c25QMfQAPEMcY61B6CHHm, peerClient=Lodestar, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641228:May-01 15:53:24.801[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=12, peer=16Uiu2HAmNSJwd26EqSzFsmNHG2uAdjhVxZfaGRaMJN2sXaKZkKKK, peerClient=Teku, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641235:May-01 15:53:24.801[sync]            debug: Error downloading payload in BlockInputSync.fetchPayloadInput slot=867, rootHex=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, attempt=13, peer=16Uiu2HAm5TbTadUSboG1Ue5xGJc2V5i82BgLMpWUT6aSuyYTQ2Pf, peerClient=Lodestar, code=EXECUTION_PAYLOAD_ENVELOPE_ERROR_BLOCK_ROOT_UNKNOWN, blockRoot=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be
641242:May-01 15:53:24.801[sync]            debug: Ignoring unknown payload root after failed download slot=unknown, root=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be, pendingPayloads=2 - Error fetching payload by root slot=867 root=0xaad6d8da598a96c8675797f4a3266f98731826ef72e19233345dd30a378937be after 14: cannot find peer with needed columns=[]

[wemeetagain]

May-01 15:53:12.190[chain]           ^[[34mdebug^[[39m: Block error slot=865, code=BLOCK_ERROR_BEACON_CHAIN_ERROR, error=PayloadEnvelopeInput not seeded for block 0xab52e1c6751d0701c940d6d854c0c6d69814bccdbc0d773585cb08b3a4cdbd3e before importBlock
Error: PayloadEnvelopeInput not seeded for block 0xab52e1c6751d0701c940d6d854c0c6d69814bccdbc0d773585cb08b3a4cdbd3e before importBlock
    at BeaconChain.importBlock (file:///usr/app/packages/beacon-node/src/chain/blocks/importBlock.ts:138:13)
    at BeaconChain.processBlocks (file:///usr/app/packages/beacon-node/src/chain/blocks/index.ts:140:9)
    at JobItemQueue.runJob (file:///usr/app/packages/beacon-node/src/util/queue/itemQueue.ts:149:22)

[twoeths]

could be fixed by #9317 too