please parse this into a tablestripedattentionstripedFalseqcs512kcs512mwsNonebidirFalse:…
- User
please parse this into a tablestriped_attention_stripedFalse_qcs512_kcs512_mwsNone_bidirFalse: Duration: 237.58msstriped_attention_stripedFalse_qcs64_kcs512_mwsNone_bidirFalse: Duration: 510.67msstriped_attention_stripedTrue_qcs512_kcs512_mwsNone_bidirFalse: Duration: 169.20msstriped_attention_stripedTrue_qcs64_kcs512_mwsNone_bidirFalse: Duration: 398.93msdot_product_attention: Duration: 12.08msrptattention_tpu_sharded_sidFalse_qcs512_kcs512_mwsNone: Duration: 99.98msrptattention_tpu_sharded_sidFalse_qcs64_kcs512_mwsNone: Duration: 253.74msrptattention_tpu_sharded_sidFalse_qcs512_kcs512_mws2048: Duration: 55.53msrptattention_tpu_sharded_sidFalse_qcs64_kcs512_mws2048: Duration: 97.67msstriped_attention_stripedFalse_qcs512_kcs512_mws2048_bidirFalse: Duration: 72.56msstriped_attention_stripedTrue_qcs512_kcs512_mws2048_bidirFalse: Duration: 102.25msstriped_attention_stripedFalse_qcs64_kcs512_mws2048_bidirFalse: Duration: 244.89msstriped_attention_stripedTrue_qcs64_kcs512_mws2048_bidirFalse: Duration: 321.52ms
- Assistant
Here’s a table parsing the given data:
Attention Type Striped qcs kcs mws Bidir Duration (ms)
striped_attention_stripedFalse_qcs512_kcs512_mwsNone_bidirFalse False 512 512 None False 237.58
striped_attention_stripedFalse_qcs64_kcs512_mwsNone_bidirFalse False 64 ▌
- User
please parse this into a tablestriped_attention_stripedFalse_qcs512_kcs512_mwsNone_bidirFalse: Duration: 237.58msstriped_attention_stripedFalse_qcs64_kcs512_mwsNone_bidirFalse: Duration: 510.67msstriped_attention_stripedTrue_qcs512_kcs512_mwsNone_bidirFalse: Duration: 169.20msstriped_attention_stripedTrue_qcs64_kcs512_mwsNone_bidirFalse: Duration: 398.93msdot_product_attention: Duration: 12.08msrptattention_tpu_sharded_sidFalse_qcs512_kcs512_mwsNone: Duration: 99.98msrptattention_tpu_sharded_sidFalse_qcs64_kcs512_mwsNone: Duration: 253.74msrptattention_tpu_sharded_sidFalse_qcs512_kcs512_mws2048: Duration: 55.53msrptattention_tpu_sharded_sidFalse_qcs64_kcs512_mws2048: Duration: 97.67msstriped_attention_stripedFalse_qcs512_kcs512_mws2048_bidirFalse: Duration: 72.56msstriped_attention_stripedTrue_qcs512_kcs512_mws2048_bidirFalse: Duration: 102.25msstriped_attention_stripedFalse_qcs64_kcs512_mws2048_bidirFalse: Duration: 244.89msstriped_attention_stripedTrue_qcs64_kcs512_mws2048_bidirFalse: Duration: 321.52ms
- Assistant
Here is the parsed information organized into a table:
Attention Type Striped qcs kcs mws Bidir Duration (ms)
striped_attention_stripedFalse_qcs512_kcs512_mwsNone_bidirFalse False 512 512 None False 237.58
striped_attention_stripedFalse_qcs64_kcs512_mwsNone_bidirFalse False 64▌
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.