From 0d579391715b802e5e50221854e2759d3ae7a4eb Mon Sep 17 00:00:00 2001 From: Luca Barbato Date: Tue, 20 Oct 2026 17:07:48 +0200 Subject: [PATCH 1/2] fix(MODEL-TEXT-kolibri-1-kolibri1-for-causal-lm): primary top-k rows were one position behind the generated chain MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit scripts/gen-kolibri1-primary-topk-rows.py scored the teacher-forced chain at pos = len(p_ids) - 1 + k, but vLLM's prompt_logprobs[i] is the predictive distribution over full[i], so the distribution that predicts gen[k] sits at len(p_ids) + k. Every emitted row carried the previous position's distribution and the membership skip tested the wrong window, which silently dropped 54 of 256 positions. A peer measured generated[k] == rows[k+1].top1 at 195/195 on the landed fixture. The writer now uses pos = len(p_ids) + k and replaces the silent skip with two loud failures (missing distribution, top-1 CHECK) — under greedy decode gen[k] must be the argmax of its own predictive distribution, so a skip can only mean a diverged chain. The rows were re-emitted from the primary oracle (the /tmp/opencode/aaiv + /tmp/opencode/vllmsrc vLLM 0.31.0+cpu environment, tensor_parallel_size=4 mp): 256/256 positions, zero skips, top-1 CHECK green on every position, and a second run reproduced the file byte-for-byte. Impact: the threeway absolute magnitudes collapse from ~5.8 nats of phantom gap to hundredths of a nat (prod gap mean 5.806 -> -0.028, cos 0.9814 -> 0.9991, KL 7.070 -> 0.017) while every rank percentage is unchanged, so the #3469 mode ordering and the #3482 bf16-dot red line (97.0% -> 98.0%) stand. Margin instruments shift to the corrected 256-row file (top1_top2 median 3.8913 -> 3.7989; top6_top7 < 0.1-nat rows 58/202 -> 69/256). No test reads the rows file's content, so no recorded anchor changes. The llama.cpp per-position top-20 goldens (commit 62318cd57, GGUF sha256 76ddb05e458cce1a, BF16, greedy, 256/256 self-consistent) land alongside as kolibri1_llamacpp_topk_rows.json. Numbers and analysis: docs/bench-evidence/kolibri1-primary-rows-offbyone-20261020/report.md. FOLLOWING_AGENTS_PROTOCOL Following-Agents-Protocol: true AI-Assisted: true Assisted-by: AGENT:zai/glm-5.3-flash [maki] --- .../ISSUE-LOCAL-01M5CQ4GMFF9ZAYYMFYDV6WZ3Q.md | 19 + .../report.md | 106 + scripts/gen-kolibri1-primary-topk-rows.py | 24 +- .../models/kolibri1_llamacpp_topk_rows.json | 23197 ++++++++++++++++ .../models/kolibri1_primary_topk_rows.json | 2 +- 5 files changed, 23340 insertions(+), 8 deletions(-) create mode 100644 .agents/issues/MODEL-TEXT-kolibri-1-kolibri1-for-causal-lm/ISSUE-LOCAL-01M5CQ4GMFF9ZAYYMFYDV6WZ3Q.md create mode 100644 docs/bench-evidence/kolibri1-primary-rows-offbyone-20261020/report.md create mode 100644 tests/vllm/models/kolibri1_llamacpp_topk_rows.json diff --git a/.agents/issues/MODEL-TEXT-kolibri-1-kolibri1-for-causal-lm/ISSUE-LOCAL-01M5CQ4GMFF9ZAYYMFYDV6WZ3Q.md b/.agents/issues/MODEL-TEXT-kolibri-1-kolibri1-for-causal-lm/ISSUE-LOCAL-01M5CQ4GMFF9ZAYYMFYDV6WZ3Q.md new file mode 100644 index 000000000..4f0a5e219 --- /dev/null +++ b/.agents/issues/MODEL-TEXT-kolibri-1-kolibri1-for-causal-lm/ISSUE-LOCAL-01M5CQ4GMFF9ZAYYMFYDV6WZ3Q.md @@ -0,0 +1,19 @@ +ID: ISSUE-LOCAL-01M5CQ4GMFF9ZAYYMFYDV6WZ3Q +Title: primary top-100 rows are stored one position behind the generated chain (off-by-one in the writer) +Row: MODEL-TEXT-kolibri-1-kolibri1-for-causal-lm +State: CLOSED +Kind: bug +GitHub: - +Mirror: PENDING +Availability: FULL +Created: 2026-10-20 +Updated: 2026-10-20 +Closed: 2026-10-20 + +## Problem + +scripts/gen-kolibri1-primary-topk-rows.py:66 computes pos = len(p_ids) - 1 + k, but vLLM prompt_logprobs[i] is the predictive distribution over full[i], so the distribution predicting gen[k] lives at pos = len(p_ids) + k. Every emitted row (gen_index k) therefore holds the previous position's distribution. The skip 'if not any(tid == gid)' also tests membership in the wrong distribution. A peer measured generated[k] == rows[k+1].top1 at 195/195 positions, confirming the one-step lag. Affected consumers: tests/vllm/models/kolibri1_primary_topk_rows.json (landed via #3463) and the margin instruments that consumed it (kolibri1-threeway-analysis.py outputs, near-tie/hard-flip margins for the W3 prompts). #3482's red line used a consistent-but-lagged alignment, so ordering survives but the absolute label does not. Fix: pos = len(p_ids) + k; after the fix gen[k] is by construction the argmax of that distribution under greedy, so the silent skip becomes a loud CHECK that gen[k] is top-1. + +## Resolution + +2026-10-20: writer fixed (pos = len(p_ids) + k, skip replaced by a top-1 CHECK) in row/PRIMARY-ROWS-OFFBYONE; rows re-emitted from the primary oracle at 256/256 positions with zero skips and generated[k] == rows[k].top1 at 256/256; corrected three-way and margin numbers recorded in docs/bench-evidence/kolibri1-primary-rows-offbyone-20261020/report.md. diff --git a/docs/bench-evidence/kolibri1-primary-rows-offbyone-20261020/report.md b/docs/bench-evidence/kolibri1-primary-rows-offbyone-20261020/report.md new file mode 100644 index 000000000..6c81a7a68 --- /dev/null +++ b/docs/bench-evidence/kolibri1-primary-rows-offbyone-20261020/report.md @@ -0,0 +1,106 @@ +# Kolibri-1 primary top-k rows off-by-one: writer fix, re-emission, impact (2026-10-20) + +Issue: ISSUE-LOCAL-01M5CQ4GMFF9ZAYYMFYDV6WZ3Q +(row MODEL-TEXT-kolibri-1-kolibri1-for-causal-lm). Branch +`row/PRIMARY-ROWS-OFFBYONE` (fresh from `origin/main` `61d333e52`). + +## Bug + +`scripts/gen-kolibri1-primary-topk-rows.py` scored the teacher-forced chain at +`pos = len(p_ids) - 1 + k`. vLLM's `prompt_logprobs[i]` is the predictive +distribution OVER `full[i]`, so the distribution that PREDICTS `gen[k]` sits at +`len(p_ids) + k`. Every emitted row held the previous position's distribution, +and the skip (`if not any(tid == gid)`) tested membership in that wrong +distribution. The peer measured `generated[k] == rows[k+1].top1` at 195/195, +which is the one-step lag read directly off the file. + +## Fix + +`pos = len(p_ids) + k`, the stale index comment corrected, and the silent skip +replaced by two loud failures: a missing distribution and a top-1 CHECK — under +greedy decode `gen[k]` must be the argmax of the distribution that predicted it, +so the old skip path can only now mean a diverged chain, and the generator +aborts instead of emitting a shifted row. + +## Re-emission + +Environment: the same primary-oracle environment as the original run — +`/tmp/opencode/aaiv` venv with the source build `/tmp/opencode/vllmsrc` +(vLLM 0.31.0, `VLLM_TARGET_DEVICE=cpu`, `aleph_alpha_inference` plugin), +`tensor_parallel_size=4` mp on this host, model +`/mnt/models/Aleph-Alpha/Kolibri-1-bf16-clean`, greedy, `max_tokens=32`, +`prompt_logprobs=100`. Output overwrote +`tests/vllm/models/kolibri1_primary_topk_rows.json`. + +Validation: 256/256 generated positions emitted, zero skips, and the top-1 +CHECK passed on every position (`generated[k] == rows[k].top1` at 256/256). A +second independent run reproduced the file byte-for-byte. The old file scored +202/256 with only 63/202 rows whose top-1 was the emitted token. + +## Old vs new (the lagged numbers were cross-position comparisons) + +`scripts/kolibri1-threeway-analysis.py` over the four captured dump dirs +(`/tmp/threeway/{prod,draft,before_f32,after_bf16dot}`), same 202 aligned dump +positions (the dumps pre-date the fix; the corrected fixture covers all 256 +positions): + +| mode | top-1 | gap mean (OLD) | gap mean (NEW) | cos (OLD) | cos (NEW) | KL (OLD) | KL (NEW) | +|---|---|---|---|---|---|---|---| +| prod | 98.0% | 5.806 | **-0.028** | 0.9814 | **0.9991** | 7.070 | **0.017** | +| draft | 97.0% | 5.836 | **0.002** | 0.9812 | **0.9989** | 6.971 | **0.020** | +| before_f32 | 97.0% | 5.842 | **0.008** | 0.9812 | **0.9989** | 6.994 | **0.021** | +| after_bf16dot | 98.0% | 5.854 | **0.020** | 0.9804 | **0.9981** | 7.018 | **0.051** | + +Rank percentages (top-1/top-5/top-100) are unchanged in every mode: the lagged +alignment was consistent-but-shifted, so ordering conclusions survive, while +every absolute magnitude collapses from ~6 nats of phantom gap to hundredths of +a nat. Our production bf16-dot default's real top-1 agreement with the primary +over aligned positions is 98.0% (196/202 dump positions), and its real logprob +gap to the primary is -0.03 nats (ours marginally ABOVE the primary on mean). + +Margin instruments (top1_top2 / top6_top7, all 8 prompts): + +| metric | OLD (202 rows) | NEW (256 rows) | +|---|---|---| +| top1_top2 median | 3.8913 | 3.7989 | +| top1_top2 p10 | 1.0849 | 0.4812 | +| top1_top2 min | 0.0022 | 0.0022 | +| top6_top7 median | 0.1855 | 0.1901 | +| top6_top7 min | 0.0028 | 0.0018 | +| top6_top7 rows < 0.1 nats | 58/202 | 69/256 | + +Every same-index margin changed (0/202 identical): each old row carried the +previous position's distribution, so no old margin label is trustworthy. The +NEW file has 54 more scored positions, and the knife-edge tail is larger than +the lagged file showed (69 positions with top6_top7 < 0.1 nats vs 58). + +## Impact on prior analyses + +- `kolibri1-threeway-20261018` (#3469): the mode ORDERING stands (prod + closest, bf16-dot default next, f32 tiers behind — and the corrected table + keeps prod and after_bf16dot at the top with the same 98%/97% split). The + absolute gap/cos/KL numbers in that report are superseded by the table above; + they measured our position k against the primary's position k-1. +- The bf16-dot adoption gate (`kolibri1-bf16dot-adoption-20261019`, #3482 red + line): STANDS. The red line was top-1 agreement not dropping, computed on a + consistent-but-lagged alignment; the corrected alignment gives the same + 97.0% -> 98.0% BEFORE -> AFTER move. The absolute gap/KL columns in that + report should be re-read as the NEW values above (after_bf16dot real gap is + +0.020 nats, KL 0.051 — still the loosest mode, same conclusion). +- Band margins for the W3 prompts: the near-tie/hard-flip classification in + `tests/vllm/models/test_kolibri1_w3.cpp` uses OUR logit gaps, not this file, + so that gate is untouched. Instruments that quoted primary margins (the + knife-edge census above) shift to the NEW column. + +No test reads the rows file's content (`grep -rl primary_topk_rows tests/`: +only the path macro and manifest provenance in +`test_kolibri1_threeway_capture.cpp`), so no recorded anchor changes in this +change. + +## llama.cpp goldens + +`tests/vllm/models/kolibri1_llamacpp_topk_rows.json` landed with this change: +8 prompts x 32 positions of per-position token-ids + top-20 logprobs from +llama.cpp commit `62318cd57` (Kolibri-1 support), GGUF sha256 +`76ddb05e458cce1a023d42cd4f13dc8e8152fbb6501c1f680918fc7d2a0fcefd`, BF16, +greedy. Validated 256/256 rows with top-1 == emitted token. diff --git a/scripts/gen-kolibri1-primary-topk-rows.py b/scripts/gen-kolibri1-primary-topk-rows.py index a3d9d563d..18bb4cdca 100644 --- a/scripts/gen-kolibri1-primary-topk-rows.py +++ b/scripts/gen-kolibri1-primary-topk-rows.py @@ -48,9 +48,9 @@ def main() -> int: ) greedy = SamplingParams(temperature=0.0, max_tokens=MAX_NEW) - # prompt_logprobs returns the distribution at every prompt position; index i of that list - # is the distribution that PREDICTED token i, so position len(prompt)-1 is the first - # generated token. + # prompt_logprobs returns the distribution at every prompt position; index i of that + # list is the predictive distribution OVER token i, so the distribution predicting the + # first generated token sits at index len(prompt). score = SamplingParams(temperature=0.0, max_tokens=1, prompt_logprobs=TOPK) out = {"model": MODEL, "topk": TOPK, "max_new_tokens": MAX_NEW, "prompts": []} @@ -63,15 +63,25 @@ def main() -> int: rows = [] for k, gid in enumerate(gen): - pos = len(p_ids) - 1 + k # position whose distribution predicted gen[k] + # prompt_logprobs[i] is the predictive distribution over full[i], so the + # distribution that PREDICTED gen[k] sits at index len(p_ids) + k. (The + # original len(p_ids) - 1 + k stored each position one step behind; see + # ISSUE-LOCAL-01M5CQ4GMFF9ZAYYMFYDV6WZ3Q.) + pos = len(p_ids) + k pl = res.prompt_logprobs[pos] if pl is None: - continue + raise RuntimeError( + f"prompt {i!r}: no logprob distribution at pos {pos} for gen_index {k}") # pl is dict[int, Logprob] for that position (flat_logprobs defaults False). items = [(tid, lp.logprob) for tid, lp in pl.items() if lp is not None] - if not any(tid == gid for tid, _ in items): - continue items.sort(key=lambda t: -t[1]) + # Under greedy decode gen[k] must be the argmax of the distribution that + # predicted it. The old code silently skipped positions where it was not + # in the (wrong) window; make that a loud failure instead. + if items[0][0] != gid: + raise RuntimeError( + f"prompt {i!r} gen_index {k}: token {gid} is not the top-1 " + f"(top-1 is {items[0][0]}); greedy chain and scored chain diverged") top = items[:TOPK] lp_of = dict(items) vals = [lp for _, lp in top] diff --git a/tests/vllm/models/kolibri1_llamacpp_topk_rows.json b/tests/vllm/models/kolibri1_llamacpp_topk_rows.json new file mode 100644 index 000000000..9b2014cc0 --- /dev/null +++ b/tests/vllm/models/kolibri1_llamacpp_topk_rows.json @@ -0,0 +1,23197 @@ +{ + "model": "/tmp/kolibri1-llamacpp-auto.gguf", + "topk": 20, + "max_new_tokens": 32, + "provenance": "llama.cpp commit 62318cd57 (Kolibri-1 support), CPU aarch64, bf16 GGUF", + "prompts": [ + { + "prompt": "alpha beta gamma delta epsilon zeta", + "input_ids": [ + 5249, + 25079, + 74493, + 15774, + 121598, + 116026 + ], + "generated_ids": [ + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598, + 121598 + ], + "rows": [ + { + "gen_index": 0, + "token": 121598, + "top": [ + [ + 121598, + -0.9066957235336304 + ], + [ + 116026, + -1.2543233633041382 + ], + [ + 125787, + -2.9280388355255127 + ], + [ + 15930, + -3.728800058364868 + ], + [ + 15774, + -4.18923807144165 + ], + [ + 34774, + -4.218563556671143 + ], + [ + 16581, + -4.435128211975098 + ], + [ + 115060, + -5.680186748504639 + ], + [ + 25079, + -5.9819793701171875 + ], + [ + 40301, + -6.009907245635986 + ], + [ + 42046, + -6.123187065124512 + ], + [ + 63530, + -6.1639556884765625 + ], + [ + 116908, + -6.194214344024658 + ], + [ + 32, + -6.202668190002441 + ], + [ + 95373, + -6.204024314880371 + ], + [ + 74493, + -6.593545913696289 + ], + [ + 101051, + -6.729794502258301 + ], + [ + 121249, + -6.7448039054870605 + ], + [ + 949, + -6.76313591003418 + ], + [ + 44, + -6.803893566131592 + ] + ], + "logprob_of_token": -0.9066957235336304, + "top1_top2_margin": 0.3476276397705078, + "top6_top7_margin": 0.21656465530395508 + }, + { + "gen_index": 1, + "token": 121598, + "top": [ + [ + 121598, + -0.5424153804779053 + ], + [ + 116026, + -1.3144586086273193 + ], + [ + 125787, + -3.9804179668426514 + ], + [ + 15930, + -5.431480884552002 + ], + [ + 14620, + -5.6681437492370605 + ], + [ + 32, + -5.946413516998291 + ], + [ + 95373, + -6.094405651092529 + ], + [ + 34774, + -6.115811347961426 + ], + [ + 116908, + -6.205628395080566 + ], + [ + 42046, + -6.308049201965332 + ], + [ + 949, + -6.354640483856201 + ], + [ + 115060, + -6.428678512573242 + ], + [ + 101051, + -6.480465888977051 + ], + [ + 33343, + -6.70323371887207 + ], + [ + 121249, + -6.723061561584473 + ], + [ + 15774, + -6.782638072967529 + ], + [ + 68158, + -7.058652877807617 + ], + [ + 34, + -7.094133377075195 + ], + [ + 14541, + -7.101013660430908 + ], + [ + 120719, + -7.101105213165283 + ] + ], + "logprob_of_token": -0.5424153804779053, + "top1_top2_margin": 0.7720432281494141, + "top6_top7_margin": 0.14799213409423828 + }, + { + "gen_index": 2, + "token": 121598, + "top": [ + [ + 121598, + -0.24061360955238342 + ], + [ + 116026, + -2.694976329803467 + ], + [ + 15930, + -4.472311019897461 + ], + [ + 95373, + -5.2167558670043945 + ], + [ + 14620, + -5.905852317810059 + ], + [ + 42046, + -5.968467712402344 + ], + [ + 125787, + -6.056209564208984 + ], + [ + 34, + -6.146498680114746 + ], + [ + 33343, + -6.172913074493408 + ], + [ + 32, + -6.259979248046875 + ], + [ + 101051, + -6.612438201904297 + ], + [ + 68158, + -6.8212809562683105 + ], + [ + 11292, + -6.891591548919678 + ], + [ + 949, + -6.896447658538818 + ], + [ + 15774, + -6.913260459899902 + ], + [ + 115060, + -6.9197916984558105 + ], + [ + 946, + -7.297478199005127 + ], + [ + 34774, + -7.355107307434082 + ], + [ + 26530, + -7.373760223388672 + ], + [ + 19193, + -7.379565715789795 + ] + ], + "logprob_of_token": -0.24061360955238342, + "top1_top2_margin": 2.4543627202510834, + "top6_top7_margin": 0.08774185180664062 + }, + { + "gen_index": 3, + "token": 121598, + "top": [ + [ + 121598, + -0.3848620653152466 + ], + [ + 116026, + -3.2465667724609375 + ], + [ + 15930, + -3.9574005603790283 + ], + [ + 95373, + -4.668992042541504 + ], + [ + 14620, + -5.349410533905029 + ], + [ + 34, + -5.363956928253174 + ], + [ + 33343, + -5.4558796882629395 + ], + [ + 42046, + -5.592406272888184 + ], + [ + 32, + -6.1090474128723145 + ], + [ + 125787, + -6.115328788757324 + ], + [ + 44, + -6.314781188964844 + ], + [ + 115060, + -6.385819911956787 + ], + [ + 15774, + -6.397586822509766 + ], + [ + 36209, + -6.50445032119751 + ], + [ + 946, + -6.504636764526367 + ], + [ + 949, + -6.566532135009766 + ], + [ + 19193, + -6.679009914398193 + ], + [ + 68158, + -6.7451934814453125 + ], + [ + 101051, + -6.881208896636963 + ], + [ + 11292, + -6.890618801116943 + ] + ], + "logprob_of_token": -0.3848620653152466, + "top1_top2_margin": 2.861704707145691, + "top6_top7_margin": 0.09192276000976562 + }, + { + "gen_index": 4, + "token": 121598, + "top": [ + [ + 121598, + -0.5277417898178101 + ], + [ + 116026, + -3.1225526332855225 + ], + [ + 15930, + -4.078001976013184 + ], + [ + 34, + -4.638462066650391 + ], + [ + 95373, + -4.756873607635498 + ], + [ + 33343, + -4.927042007446289 + ], + [ + 44, + -5.070333480834961 + ], + [ + 14620, + -5.510806083679199 + ], + [ + 36209, + -5.559110164642334 + ], + [ + 42046, + -5.610135078430176 + ], + [ + 115060, + -5.778178691864014 + ], + [ + 32, + -5.827549457550049 + ], + [ + 286, + -5.916162014007568 + ], + [ + 15774, + -5.960482120513916 + ], + [ + 949, + -6.076683044433594 + ], + [ + 946, + -6.172686576843262 + ], + [ + 46, + -6.181035041809082 + ], + [ + 19193, + -6.400630474090576 + ], + [ + 11292, + -6.461658000946045 + ], + [ + 125787, + -6.468410491943359 + ] + ], + "logprob_of_token": -0.5277417898178101, + "top1_top2_margin": 2.5948108434677124, + "top6_top7_margin": 0.14329147338867188 + }, + { + "gen_index": 5, + "token": 121598, + "top": [ + [ + 121598, + -0.6101536750793457 + ], + [ + 116026, + -3.1991353034973145 + ], + [ + 15930, + -4.206569671630859 + ], + [ + 33343, + -4.695300579071045 + ], + [ + 34, + -4.976659297943115 + ], + [ + 95373, + -4.998056411743164 + ], + [ + 42046, + -5.004690647125244 + ], + [ + 44, + -5.204768180847168 + ], + [ + 32, + -5.264952182769775 + ], + [ + 14620, + -5.315440654754639 + ], + [ + 11292, + -5.600276470184326 + ], + [ + 946, + -5.883174896240234 + ], + [ + 115060, + -5.887156963348389 + ], + [ + 286, + -5.976953506469727 + ], + [ + 36209, + -6.208703517913818 + ], + [ + 1427, + -6.355225086212158 + ], + [ + 735, + -6.432877063751221 + ], + [ + 15774, + -6.447239398956299 + ], + [ + 19193, + -6.47987699508667 + ], + [ + 46, + -6.5092034339904785 + ] + ], + "logprob_of_token": -0.6101536750793457, + "top1_top2_margin": 2.5889816284179688, + "top6_top7_margin": 0.006634235382080078 + }, + { + "gen_index": 6, + "token": 121598, + "top": [ + [ + 121598, + -0.6169787049293518 + ], + [ + 116026, + -3.609907627105713 + ], + [ + 15930, + -4.290432929992676 + ], + [ + 33343, + -4.301526069641113 + ], + [ + 95373, + -4.997804164886475 + ], + [ + 32, + -5.15791130065918 + ], + [ + 14620, + -5.443418979644775 + ], + [ + 44, + -5.5215582847595215 + ], + [ + 34, + -5.528802871704102 + ], + [ + 42046, + -5.562872409820557 + ], + [ + 11292, + -5.684879302978516 + ], + [ + 946, + -5.760059356689453 + ], + [ + 115060, + -5.843722343444824 + ], + [ + 67223, + -6.169869422912598 + ], + [ + 36209, + -6.286292552947998 + ], + [ + 286, + -6.3416852951049805 + ], + [ + 15774, + -6.488711357116699 + ], + [ + 125787, + -6.584729194641113 + ], + [ + 19193, + -6.650034427642822 + ], + [ + 46, + -6.787672996520996 + ] + ], + "logprob_of_token": -0.6169787049293518, + "top1_top2_margin": 2.992928922176361, + "top6_top7_margin": 0.2855076789855957 + }, + { + "gen_index": 7, + "token": 121598, + "top": [ + [ + 121598, + -0.5140975713729858 + ], + [ + 116026, + -3.308570623397827 + ], + [ + 15930, + -4.521457672119141 + ], + [ + 33343, + -4.552429676055908 + ], + [ + 95373, + -4.948268890380859 + ], + [ + 32, + -4.991648197174072 + ], + [ + 115060, + -5.66545295715332 + ], + [ + 42046, + -5.762031078338623 + ], + [ + 14620, + -5.798798084259033 + ], + [ + 44, + -5.99289608001709 + ], + [ + 946, + -6.133766174316406 + ], + [ + 125787, + -6.137738227844238 + ], + [ + 67223, + -6.163517951965332 + ], + [ + 19193, + -6.319021224975586 + ], + [ + 11292, + -6.409238815307617 + ], + [ + 286, + -6.500439643859863 + ], + [ + 34, + -6.533290386199951 + ], + [ + 15774, + -6.628933906555176 + ], + [ + 68158, + -6.634839057922363 + ], + [ + 82618, + -6.792777061462402 + ] + ], + "logprob_of_token": -0.5140975713729858, + "top1_top2_margin": 2.7944730520248413, + "top6_top7_margin": 0.673804759979248 + }, + { + "gen_index": 8, + "token": 121598, + "top": [ + [ + 121598, + -0.4921492338180542 + ], + [ + 116026, + -2.847111463546753 + ], + [ + 15930, + -4.562166690826416 + ], + [ + 95373, + -4.822744369506836 + ], + [ + 33343, + -4.867896556854248 + ], + [ + 14620, + -5.3860650062561035 + ], + [ + 42046, + -5.4110894203186035 + ], + [ + 34, + -5.446943283081055 + ], + [ + 32, + -5.486447811126709 + ], + [ + 125787, + -5.637682914733887 + ], + [ + 115060, + -5.81403112411499 + ], + [ + 44, + -6.038838863372803 + ], + [ + 36209, + -6.073430061340332 + ], + [ + 946, + -6.293394565582275 + ], + [ + 19193, + -6.4680562019348145 + ], + [ + 15774, + -6.564828395843506 + ], + [ + 82618, + -6.5967698097229 + ], + [ + 67223, + -6.690474510192871 + ], + [ + 101051, + -6.696115970611572 + ], + [ + 286, + -6.729005813598633 + ] + ], + "logprob_of_token": -0.4921492338180542, + "top1_top2_margin": 2.3549622297286987, + "top6_top7_margin": 0.0250244140625 + }, + { + "gen_index": 9, + "token": 121598, + "top": [ + [ + 121598, + -0.4362730085849762 + ], + [ + 116026, + -3.5165882110595703 + ], + [ + 15930, + -4.228647708892822 + ], + [ + 95373, + -4.636106967926025 + ], + [ + 33343, + -4.882875919342041 + ], + [ + 34, + -5.213201999664307 + ], + [ + 44, + -5.436751842498779 + ], + [ + 42046, + -5.454625606536865 + ], + [ + 36209, + -5.541012287139893 + ], + [ + 32, + -5.581970691680908 + ], + [ + 14620, + -5.853465557098389 + ], + [ + 115060, + -5.858273029327393 + ], + [ + 946, + -6.268439769744873 + ], + [ + 125787, + -6.397519588470459 + ], + [ + 67223, + -6.450832843780518 + ], + [ + 19193, + -6.53642463684082 + ], + [ + 46, + -6.563662052154541 + ], + [ + 286, + -6.576313495635986 + ], + [ + 68158, + -6.586926460266113 + ], + [ + 26530, + -6.587222099304199 + ] + ], + "logprob_of_token": -0.4362730085849762, + "top1_top2_margin": 3.080315202474594, + "top6_top7_margin": 0.22354984283447266 + }, + { + "gen_index": 10, + "token": 121598, + "top": [ + [ + 121598, + -0.38265904784202576 + ], + [ + 116026, + -3.9392895698547363 + ], + [ + 15930, + -4.29707670211792 + ], + [ + 95373, + -4.714249610900879 + ], + [ + 33343, + -4.869524002075195 + ], + [ + 34, + -5.153324127197266 + ], + [ + 42046, + -5.217617988586426 + ], + [ + 44, + -5.2737321853637695 + ], + [ + 32, + -5.30448055267334 + ], + [ + 36209, + -5.560080051422119 + ], + [ + 115060, + -5.853299617767334 + ], + [ + 946, + -6.243122100830078 + ], + [ + 67223, + -6.309511661529541 + ], + [ + 120410, + -6.315507411956787 + ], + [ + 11292, + -6.3359375 + ], + [ + 46, + -6.426501274108887 + ], + [ + 26530, + -6.495787143707275 + ], + [ + 14620, + -6.562931537628174 + ], + [ + 286, + -6.650471210479736 + ], + [ + 2051, + -6.65757942199707 + ] + ], + "logprob_of_token": -0.38265904784202576, + "top1_top2_margin": 3.5566305220127106, + "top6_top7_margin": 0.06429386138916016 + }, + { + "gen_index": 11, + "token": 121598, + "top": [ + [ + 121598, + -0.3663385510444641 + ], + [ + 15930, + -4.095375061035156 + ], + [ + 116026, + -4.485931873321533 + ], + [ + 95373, + -4.541525363922119 + ], + [ + 33343, + -4.5635576248168945 + ], + [ + 44, + -5.163010597229004 + ], + [ + 32, + -5.44231653213501 + ], + [ + 115060, + -5.454692840576172 + ], + [ + 34, + -5.736588954925537 + ], + [ + 67223, + -5.885706901550293 + ], + [ + 36209, + -6.039929389953613 + ], + [ + 42046, + -6.263638019561768 + ], + [ + 946, + -6.436331748962402 + ], + [ + 2051, + -6.472233772277832 + ], + [ + 19193, + -6.589352607727051 + ], + [ + 26530, + -6.603079319000244 + ], + [ + 46, + -6.63088846206665 + ], + [ + 120410, + -6.722174167633057 + ], + [ + 68158, + -6.873135566711426 + ], + [ + 286, + -6.885288238525391 + ] + ], + "logprob_of_token": -0.3663385510444641, + "top1_top2_margin": 3.729036509990692, + "top6_top7_margin": 0.27930593490600586 + }, + { + "gen_index": 12, + "token": 121598, + "top": [ + [ + 121598, + -0.5106653571128845 + ], + [ + 15930, + -4.226126670837402 + ], + [ + 116026, + -4.2909088134765625 + ], + [ + 33343, + -4.357203483581543 + ], + [ + 95373, + -4.49143123626709 + ], + [ + 44, + -5.007687568664551 + ], + [ + 32, + -5.077655792236328 + ], + [ + 34, + -5.171695709228516 + ], + [ + 115060, + -5.484086036682129 + ], + [ + 36209, + -5.566019058227539 + ], + [ + 67223, + -5.856316089630127 + ], + [ + 946, + -5.9526872634887695 + ], + [ + 120410, + -6.092178821563721 + ], + [ + 26530, + -6.213040828704834 + ], + [ + 19193, + -6.3660688400268555 + ], + [ + 46, + -6.37807559967041 + ], + [ + 42046, + -6.431851387023926 + ], + [ + 2051, + -6.474668025970459 + ], + [ + 286, + -6.701776027679443 + ], + [ + 14168, + -6.711154937744141 + ] + ], + "logprob_of_token": -0.5106653571128845, + "top1_top2_margin": 3.715461313724518, + "top6_top7_margin": 0.06996822357177734 + }, + { + "gen_index": 13, + "token": 121598, + "top": [ + [ + 121598, + -0.49706560373306274 + ], + [ + 15930, + -4.039999961853027 + ], + [ + 33343, + -4.07175874710083 + ], + [ + 95373, + -4.252191066741943 + ], + [ + 116026, + -4.452905178070068 + ], + [ + 44, + -5.3906049728393555 + ], + [ + 32, + -5.426702976226807 + ], + [ + 115060, + -5.5343241691589355 + ], + [ + 34, + -5.707318305969238 + ], + [ + 67223, + -5.89337158203125 + ], + [ + 946, + -5.907328128814697 + ], + [ + 26530, + -5.9721808433532715 + ], + [ + 36209, + -6.053283214569092 + ], + [ + 120410, + -6.5753254890441895 + ], + [ + 19193, + -6.66099739074707 + ], + [ + 68158, + -6.693451881408691 + ], + [ + 2051, + -6.77051305770874 + ], + [ + 42046, + -6.813990592956543 + ], + [ + 16013, + -6.908469200134277 + ], + [ + 7625, + -6.944106101989746 + ] + ], + "logprob_of_token": -0.49706560373306274, + "top1_top2_margin": 3.5429343581199646, + "top6_top7_margin": 0.03609800338745117 + }, + { + "gen_index": 14, + "token": 121598, + "top": [ + [ + 121598, + -0.4054151773452759 + ], + [ + 15930, + -4.110056400299072 + ], + [ + 33343, + -4.275378704071045 + ], + [ + 95373, + -4.434045314788818 + ], + [ + 116026, + -4.663727760314941 + ], + [ + 44, + -5.527242660522461 + ], + [ + 115060, + -5.5273566246032715 + ], + [ + 32, + -5.851620197296143 + ], + [ + 34, + -5.975693225860596 + ], + [ + 67223, + -6.000830173492432 + ], + [ + 26530, + -6.181822776794434 + ], + [ + 946, + -6.251319408416748 + ], + [ + 36209, + -6.257933616638184 + ], + [ + 19193, + -6.470821380615234 + ], + [ + 68158, + -6.587650775909424 + ], + [ + 42046, + -6.691492080688477 + ], + [ + 120410, + -6.924253940582275 + ], + [ + 125787, + -7.090840816497803 + ], + [ + 28623, + -7.1046319007873535 + ], + [ + 2051, + -7.106550693511963 + ] + ], + "logprob_of_token": -0.4054151773452759, + "top1_top2_margin": 3.7046412229537964, + "top6_top7_margin": 0.00011396408081054688 + }, + { + "gen_index": 15, + "token": 121598, + "top": [ + [ + 121598, + -0.41485103964805603 + ], + [ + 15930, + -4.039346694946289 + ], + [ + 33343, + -4.18782901763916 + ], + [ + 95373, + -4.3407697677612305 + ], + [ + 116026, + -4.74889612197876 + ], + [ + 32, + -5.514825820922852 + ], + [ + 44, + -5.5728840827941895 + ], + [ + 115060, + -5.737606048583984 + ], + [ + 34, + -5.955227851867676 + ], + [ + 946, + -6.173804759979248 + ], + [ + 67223, + -6.178417205810547 + ], + [ + 26530, + -6.250165939331055 + ], + [ + 36209, + -6.264708042144775 + ], + [ + 42046, + -6.551609992980957 + ], + [ + 68158, + -6.663499355316162 + ], + [ + 19193, + -6.744338035583496 + ], + [ + 735, + -6.855792045593262 + ], + [ + 286, + -6.859808921813965 + ], + [ + 120410, + -6.9446916580200195 + ], + [ + 125787, + -6.999232292175293 + ] + ], + "logprob_of_token": -0.41485103964805603, + "top1_top2_margin": 3.624495655298233, + "top6_top7_margin": 0.05805826187133789 + }, + { + "gen_index": 16, + "token": 121598, + "top": [ + [ + 121598, + -0.3678261935710907 + ], + [ + 15930, + -3.993406057357788 + ], + [ + 33343, + -4.2812299728393555 + ], + [ + 95373, + -4.413078784942627 + ], + [ + 116026, + -4.73822546005249 + ], + [ + 32, + -5.629340648651123 + ], + [ + 115060, + -5.681501865386963 + ], + [ + 44, + -5.930612087249756 + ], + [ + 34, + -5.954838752746582 + ], + [ + 67223, + -6.2086005210876465 + ], + [ + 946, + -6.229920864105225 + ], + [ + 36209, + -6.286429405212402 + ], + [ + 42046, + -6.481393337249756 + ], + [ + 26530, + -6.562073230743408 + ], + [ + 19193, + -6.706037521362305 + ], + [ + 68158, + -6.726517200469971 + ], + [ + 125787, + -6.807519435882568 + ], + [ + 2051, + -6.872539043426514 + ], + [ + 120410, + -6.902817726135254 + ], + [ + 735, + -6.970287799835205 + ] + ], + "logprob_of_token": -0.3678261935710907, + "top1_top2_margin": 3.6255798637866974, + "top6_top7_margin": 0.052161216735839844 + }, + { + "gen_index": 17, + "token": 121598, + "top": [ + [ + 121598, + -0.4964478015899658 + ], + [ + 15930, + -4.002740383148193 + ], + [ + 33343, + -4.190515041351318 + ], + [ + 95373, + -4.433293342590332 + ], + [ + 116026, + -4.5176849365234375 + ], + [ + 44, + -5.308983325958252 + ], + [ + 32, + -5.433262348175049 + ], + [ + 115060, + -5.667741775512695 + ], + [ + 34, + -5.674870014190674 + ], + [ + 946, + -6.015562057495117 + ], + [ + 36209, + -6.093971252441406 + ], + [ + 67223, + -6.094735622406006 + ], + [ + 26530, + -6.154134750366211 + ], + [ + 42046, + -6.438817024230957 + ], + [ + 120410, + -6.484867572784424 + ], + [ + 68158, + -6.7207231521606445 + ], + [ + 125787, + -6.782657623291016 + ], + [ + 19193, + -6.806511878967285 + ], + [ + 46, + -6.830312252044678 + ], + [ + 286, + -6.891154766082764 + ] + ], + "logprob_of_token": -0.4964478015899658, + "top1_top2_margin": 3.5062925815582275, + "top6_top7_margin": 0.12427902221679688 + }, + { + "gen_index": 18, + "token": 121598, + "top": [ + [ + 121598, + -0.5771897435188293 + ], + [ + 116026, + -3.8111379146575928 + ], + [ + 15930, + -4.052491188049316 + ], + [ + 33343, + -4.279002666473389 + ], + [ + 95373, + -4.432762622833252 + ], + [ + 44, + -4.989864826202393 + ], + [ + 32, + -5.321999549865723 + ], + [ + 115060, + -5.733684062957764 + ], + [ + 34, + -5.748021602630615 + ], + [ + 946, + -5.802785396575928 + ], + [ + 67223, + -6.009417533874512 + ], + [ + 26530, + -6.014556407928467 + ], + [ + 36209, + -6.107963562011719 + ], + [ + 42046, + -6.261506080627441 + ], + [ + 68158, + -6.427529811859131 + ], + [ + 286, + -6.635112285614014 + ], + [ + 735, + -6.643876552581787 + ], + [ + 125787, + -6.656505107879639 + ], + [ + 2051, + -6.6852707862854 + ], + [ + 120410, + -6.6903252601623535 + ] + ], + "logprob_of_token": -0.5771897435188293, + "top1_top2_margin": 3.2339481711387634, + "top6_top7_margin": 0.3321347236633301 + }, + { + "gen_index": 19, + "token": 121598, + "top": [ + [ + 121598, + -0.5372915863990784 + ], + [ + 116026, + -3.7692205905914307 + ], + [ + 15930, + -4.112200736999512 + ], + [ + 33343, + -4.293496131896973 + ], + [ + 95373, + -4.339961051940918 + ], + [ + 44, + -5.254036903381348 + ], + [ + 32, + -5.268538951873779 + ], + [ + 115060, + -5.703561782836914 + ], + [ + 26530, + -5.759862899780273 + ], + [ + 34, + -5.829326152801514 + ], + [ + 946, + -6.003702640533447 + ], + [ + 36209, + -6.037235736846924 + ], + [ + 67223, + -6.150757789611816 + ], + [ + 42046, + -6.359450340270996 + ], + [ + 735, + -6.607366561889648 + ], + [ + 120410, + -6.616096496582031 + ], + [ + 125787, + -6.634712219238281 + ], + [ + 19193, + -6.6456804275512695 + ], + [ + 68158, + -6.65938138961792 + ], + [ + 2051, + -6.684377193450928 + ] + ], + "logprob_of_token": -0.5372915863990784, + "top1_top2_margin": 3.2319290041923523, + "top6_top7_margin": 0.01450204849243164 + }, + { + "gen_index": 20, + "token": 121598, + "top": [ + [ + 121598, + -0.4630178213119507 + ], + [ + 15930, + -3.955061435699463 + ], + [ + 116026, + -4.04246187210083 + ], + [ + 95373, + -4.252969264984131 + ], + [ + 33343, + -4.306936740875244 + ], + [ + 32, + -5.528867721557617 + ], + [ + 115060, + -5.7916693687438965 + ], + [ + 34, + -6.008522987365723 + ], + [ + 44, + -6.033441543579102 + ], + [ + 946, + -6.217668056488037 + ], + [ + 67223, + -6.218321323394775 + ], + [ + 36209, + -6.249031066894531 + ], + [ + 42046, + -6.3464765548706055 + ], + [ + 26530, + -6.368627071380615 + ], + [ + 125787, + -6.703840732574463 + ], + [ + 735, + -6.770102024078369 + ], + [ + 2051, + -6.787166118621826 + ], + [ + 14620, + -6.828528881072998 + ], + [ + 19193, + -6.860080242156982 + ], + [ + 68158, + -6.8790154457092285 + ] + ], + "logprob_of_token": -0.4630178213119507, + "top1_top2_margin": 3.492043614387512, + "top6_top7_margin": 0.2628016471862793 + }, + { + "gen_index": 21, + "token": 121598, + "top": [ + [ + 121598, + -0.45000356435775757 + ], + [ + 116026, + -4.036062717437744 + ], + [ + 15930, + -4.144567966461182 + ], + [ + 95373, + -4.251768589019775 + ], + [ + 33343, + -4.317600727081299 + ], + [ + 32, + -5.5655951499938965 + ], + [ + 115060, + -5.69988489151001 + ], + [ + 44, + -5.879225730895996 + ], + [ + 34, + -6.114182472229004 + ], + [ + 67223, + -6.147953987121582 + ], + [ + 946, + -6.209129810333252 + ], + [ + 42046, + -6.244112968444824 + ], + [ + 26530, + -6.302307605743408 + ], + [ + 36209, + -6.31574821472168 + ], + [ + 125787, + -6.745370864868164 + ], + [ + 120410, + -6.756794452667236 + ], + [ + 68158, + -6.777294158935547 + ], + [ + 2051, + -6.804417133331299 + ], + [ + 19193, + -6.815497398376465 + ], + [ + 735, + -6.821287155151367 + ] + ], + "logprob_of_token": -0.45000356435775757, + "top1_top2_margin": 3.5860591530799866, + "top6_top7_margin": 0.13428974151611328 + }, + { + "gen_index": 22, + "token": 121598, + "top": [ + [ + 121598, + -0.3935886025428772 + ], + [ + 15930, + -4.052150726318359 + ], + [ + 95373, + -4.19052791595459 + ], + [ + 33343, + -4.204342842102051 + ], + [ + 116026, + -4.564116954803467 + ], + [ + 44, + -5.295660495758057 + ], + [ + 32, + -5.376885414123535 + ], + [ + 115060, + -5.571230411529541 + ], + [ + 67223, + -6.036630630493164 + ], + [ + 34, + -6.049976825714111 + ], + [ + 36209, + -6.154138088226318 + ], + [ + 946, + -6.2900471687316895 + ], + [ + 26530, + -6.322503566741943 + ], + [ + 42046, + -6.534322738647461 + ], + [ + 120410, + -6.541802883148193 + ], + [ + 2051, + -6.626564025878906 + ], + [ + 68158, + -6.697524070739746 + ], + [ + 19193, + -6.730741024017334 + ], + [ + 735, + -6.794578552246094 + ], + [ + 93847, + -7.009711265563965 + ] + ], + "logprob_of_token": -0.3935886025428772, + "top1_top2_margin": 3.658562123775482, + "top6_top7_margin": 0.08122491836547852 + }, + { + "gen_index": 23, + "token": 121598, + "top": [ + [ + 121598, + -0.2769741415977478 + ], + [ + 15930, + -4.0550384521484375 + ], + [ + 33343, + -4.298738479614258 + ], + [ + 95373, + -4.324764728546143 + ], + [ + 116026, + -4.773985862731934 + ], + [ + 115060, + -5.831665992736816 + ], + [ + 32, + -6.121298789978027 + ], + [ + 67223, + -6.24898099899292 + ], + [ + 44, + -6.350325584411621 + ], + [ + 34, + -6.600985527038574 + ], + [ + 36209, + -6.6134514808654785 + ], + [ + 19193, + -6.904470920562744 + ], + [ + 946, + -6.930233001708984 + ], + [ + 42046, + -6.936750411987305 + ], + [ + 26530, + -7.042907238006592 + ], + [ + 68158, + -7.097648620605469 + ], + [ + 120410, + -7.155495643615723 + ], + [ + 125787, + -7.195486068725586 + ], + [ + 101051, + -7.259903430938721 + ], + [ + 2051, + -7.264030933380127 + ] + ], + "logprob_of_token": -0.2769741415977478, + "top1_top2_margin": 3.7780643105506897, + "top6_top7_margin": 0.28963279724121094 + }, + { + "gen_index": 24, + "token": 121598, + "top": [ + [ + 121598, + -0.43447718024253845 + ], + [ + 15930, + -4.046286106109619 + ], + [ + 33343, + -4.072081565856934 + ], + [ + 95373, + -4.183069229125977 + ], + [ + 116026, + -4.353566646575928 + ], + [ + 115060, + -5.505063533782959 + ], + [ + 44, + -5.587666034698486 + ], + [ + 32, + -5.74973201751709 + ], + [ + 67223, + -5.761818885803223 + ], + [ + 34, + -5.953829765319824 + ], + [ + 36209, + -6.289422512054443 + ], + [ + 946, + -6.387340068817139 + ], + [ + 19193, + -6.4686665534973145 + ], + [ + 120410, + -6.519439220428467 + ], + [ + 68158, + -6.7731146812438965 + ], + [ + 26530, + -6.918847560882568 + ], + [ + 7625, + -6.97265100479126 + ], + [ + 735, + -7.020666122436523 + ], + [ + 11292, + -7.087268352508545 + ], + [ + 125787, + -7.110292911529541 + ] + ], + "logprob_of_token": -0.43447718024253845, + "top1_top2_margin": 3.6118089258670807, + "top6_top7_margin": 0.08260250091552734 + }, + { + "gen_index": 25, + "token": 121598, + "top": [ + [ + 121598, + -0.6153738498687744 + ], + [ + 33343, + -3.954617738723755 + ], + [ + 116026, + -3.9955170154571533 + ], + [ + 15930, + -4.367012977600098 + ], + [ + 95373, + -4.386129856109619 + ], + [ + 32, + -5.325812816619873 + ], + [ + 115060, + -5.509690284729004 + ], + [ + 44, + -5.61158561706543 + ], + [ + 67223, + -5.757028579711914 + ], + [ + 946, + -5.939323425292969 + ], + [ + 26530, + -6.275331020355225 + ], + [ + 34, + -6.4508891105651855 + ], + [ + 120007, + -6.521505355834961 + ], + [ + 286, + -6.5342020988464355 + ], + [ + 42046, + -6.568441390991211 + ], + [ + 2051, + -6.6716389656066895 + ], + [ + 11292, + -6.716052532196045 + ], + [ + 19193, + -6.750185966491699 + ], + [ + 101051, + -6.761441230773926 + ], + [ + 14168, + -6.771313667297363 + ] + ], + "logprob_of_token": -0.6153738498687744, + "top1_top2_margin": 3.3392438888549805, + "top6_top7_margin": 0.18387746810913086 + }, + { + "gen_index": 26, + "token": 121598, + "top": [ + [ + 121598, + -0.4654272198677063 + ], + [ + 116026, + -3.8134148120880127 + ], + [ + 33343, + -4.091773986816406 + ], + [ + 95373, + -4.195571422576904 + ], + [ + 15930, + -4.20541524887085 + ], + [ + 32, + -5.652459144592285 + ], + [ + 115060, + -5.7233381271362305 + ], + [ + 67223, + -6.017237663269043 + ], + [ + 44, + -6.01785945892334 + ], + [ + 946, + -6.393594741821289 + ], + [ + 26530, + -6.51937198638916 + ], + [ + 2051, + -6.595697402954102 + ], + [ + 34, + -6.655498504638672 + ], + [ + 68158, + -6.7206268310546875 + ], + [ + 42046, + -6.736660003662109 + ], + [ + 14620, + -6.7847981452941895 + ], + [ + 125787, + -6.807592391967773 + ], + [ + 735, + -6.845189571380615 + ], + [ + 19193, + -6.920851707458496 + ], + [ + 11292, + -6.971877098083496 + ] + ], + "logprob_of_token": -0.4654272198677063, + "top1_top2_margin": 3.3479875922203064, + "top6_top7_margin": 0.07087898254394531 + }, + { + "gen_index": 27, + "token": 121598, + "top": [ + [ + 121598, + -0.5463860034942627 + ], + [ + 33343, + -3.984300374984741 + ], + [ + 116026, + -4.041981220245361 + ], + [ + 95373, + -4.102862358093262 + ], + [ + 15930, + -4.1043572425842285 + ], + [ + 32, + -5.706820487976074 + ], + [ + 115060, + -5.741179466247559 + ], + [ + 44, + -5.8658833503723145 + ], + [ + 67223, + -5.967320442199707 + ], + [ + 34, + -6.042548656463623 + ], + [ + 946, + -6.219987869262695 + ], + [ + 26530, + -6.32373571395874 + ], + [ + 36209, + -6.469912528991699 + ], + [ + 2051, + -6.471474647521973 + ], + [ + 68158, + -6.497777938842773 + ], + [ + 19193, + -6.701630592346191 + ], + [ + 735, + -6.716213226318359 + ], + [ + 11292, + -6.7867021560668945 + ], + [ + 42046, + -6.821446418762207 + ], + [ + 14620, + -6.863461971282959 + ] + ], + "logprob_of_token": -0.5463860034942627, + "top1_top2_margin": 3.4379143714904785, + "top6_top7_margin": 0.034358978271484375 + }, + { + "gen_index": 28, + "token": 121598, + "top": [ + [ + 121598, + -0.49404004216194153 + ], + [ + 33343, + -3.822812080383301 + ], + [ + 15930, + -4.05527925491333 + ], + [ + 95373, + -4.128085613250732 + ], + [ + 116026, + -4.207427024841309 + ], + [ + 44, + -5.619171619415283 + ], + [ + 115060, + -5.6453351974487305 + ], + [ + 32, + -5.7690324783325195 + ], + [ + 67223, + -6.062614440917969 + ], + [ + 34, + -6.153972148895264 + ], + [ + 946, + -6.238382816314697 + ], + [ + 26530, + -6.334799766540527 + ], + [ + 2051, + -6.505002975463867 + ], + [ + 36209, + -6.519507884979248 + ], + [ + 68158, + -6.6691718101501465 + ], + [ + 11292, + -6.672082424163818 + ], + [ + 42046, + -6.706603527069092 + ], + [ + 19193, + -6.759191036224365 + ], + [ + 7625, + -6.769554615020752 + ], + [ + 120410, + -6.783868789672852 + ] + ], + "logprob_of_token": -0.49404004216194153, + "top1_top2_margin": 3.3287720382213593, + "top6_top7_margin": 0.026163578033447266 + }, + { + "gen_index": 29, + "token": 121598, + "top": [ + [ + 121598, + -0.4535539448261261 + ], + [ + 33343, + -3.857802152633667 + ], + [ + 15930, + -4.190814971923828 + ], + [ + 95373, + -4.273159027099609 + ], + [ + 116026, + -4.363236427307129 + ], + [ + 115060, + -5.455128192901611 + ], + [ + 44, + -5.698170185089111 + ], + [ + 32, + -5.731372833251953 + ], + [ + 67223, + -6.059261322021484 + ], + [ + 26530, + -6.387612819671631 + ], + [ + 19193, + -6.457363128662109 + ], + [ + 68158, + -6.575995445251465 + ], + [ + 2051, + -6.576723575592041 + ], + [ + 946, + -6.579665184020996 + ], + [ + 42046, + -6.718505859375 + ], + [ + 14168, + -6.740793228149414 + ], + [ + 7625, + -6.870806694030762 + ], + [ + 11292, + -6.951560020446777 + ], + [ + 125787, + -7.075149059295654 + ], + [ + 16013, + -7.121783256530762 + ] + ], + "logprob_of_token": -0.4535539448261261, + "top1_top2_margin": 3.404248207807541, + "top6_top7_margin": 0.2430419921875 + }, + { + "gen_index": 30, + "token": 121598, + "top": [ + [ + 121598, + -0.4751700460910797 + ], + [ + 33343, + -4.10026741027832 + ], + [ + 15930, + -4.2540106773376465 + ], + [ + 95373, + -4.347020626068115 + ], + [ + 116026, + -4.426957607269287 + ], + [ + 115060, + -5.407783508300781 + ], + [ + 32, + -5.453408718109131 + ], + [ + 44, + -5.469369888305664 + ], + [ + 67223, + -6.054527759552002 + ], + [ + 26530, + -6.1339545249938965 + ], + [ + 946, + -6.383668899536133 + ], + [ + 19193, + -6.390096664428711 + ], + [ + 68158, + -6.430665969848633 + ], + [ + 2051, + -6.465654373168945 + ], + [ + 14168, + -6.606450080871582 + ], + [ + 42046, + -6.618677616119385 + ], + [ + 34, + -6.958340644836426 + ], + [ + 125787, + -7.001497268676758 + ], + [ + 93847, + -7.0409650802612305 + ], + [ + 11292, + -7.05424165725708 + ] + ], + "logprob_of_token": -0.4751700460910797, + "top1_top2_margin": 3.6250973641872406, + "top6_top7_margin": 0.04562520980834961 + }, + { + "gen_index": 31, + "token": 121598, + "top": [ + [ + 121598, + -0.43481317162513733 + ], + [ + 15930, + -4.132809638977051 + ], + [ + 33343, + -4.190994739532471 + ], + [ + 95373, + -4.339730262756348 + ], + [ + 116026, + -4.584716796875 + ], + [ + 44, + -5.4446120262146 + ], + [ + 32, + -5.455791473388672 + ], + [ + 115060, + -5.506629943847656 + ], + [ + 67223, + -6.03035306930542 + ], + [ + 34, + -6.092266082763672 + ], + [ + 946, + -6.112296104431152 + ], + [ + 26530, + -6.240921497344971 + ], + [ + 36209, + -6.464365482330322 + ], + [ + 42046, + -6.4721269607543945 + ], + [ + 68158, + -6.529815196990967 + ], + [ + 19193, + -6.584495544433594 + ], + [ + 2051, + -6.593481540679932 + ], + [ + 120410, + -6.599058628082275 + ], + [ + 125787, + -6.8685994148254395 + ], + [ + 735, + -7.018748760223389 + ] + ], + "logprob_of_token": -0.43481317162513733, + "top1_top2_margin": 3.6979964673519135, + "top6_top7_margin": 0.011179447174072266 + } + ] + }, + { + "prompt": "der Mond scheint hell \u00fcber den Bergen", + "input_ids": [ + 339, + 39046, + 19373, + 19573, + 1489, + 1178, + 35423 + ], + "generated_ids": [ + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252, + 948, + 46252 + ], + "rows": [ + { + "gen_index": 0, + "token": 948, + "top": [ + [ + 948, + -1.2942841053009033 + ], + [ + 420, + -1.7354339361190796 + ], + [ + 46, + -2.0241262912750244 + ], + [ + 1178, + -2.4483368396759033 + ], + [ + 44, + -3.0282304286956787 + ], + [ + 275, + -3.3776888847351074 + ], + [ + 346, + -3.748830556869507 + ], + [ + 1829, + -3.832529306411743 + ], + [ + 831, + -4.881103992462158 + ], + [ + 826, + -5.205702304840088 + ], + [ + 1200, + -5.311013698577881 + ], + [ + 913, + -5.409036159515381 + ], + [ + 518, + -5.522242546081543 + ], + [ + 2625, + -5.819686412811279 + ], + [ + 127906, + -5.972790718078613 + ], + [ + 513, + -5.997044086456299 + ], + [ + 2125, + -6.003654479980469 + ], + [ + 1489, + -6.056337356567383 + ], + [ + 622, + -6.080297946929932 + ], + [ + 262, + -6.167563438415527 + ] + ], + "logprob_of_token": -1.2942841053009033, + "top1_top2_margin": 0.44114983081817627, + "top6_top7_margin": 0.3711416721343994 + }, + { + "gen_index": 1, + "token": 46252, + "top": [ + [ + 46252, + -1.1028212308883667 + ], + [ + 35423, + -1.3906229734420776 + ], + [ + 948, + -1.8406037092208862 + ], + [ + 7616, + -4.213179588317871 + ], + [ + 11397, + -4.251907825469971 + ], + [ + 29394, + -5.684813499450684 + ], + [ + 43492, + -5.727287292480469 + ], + [ + 1178, + -5.758774280548096 + ], + [ + 420, + -6.016659259796143 + ], + [ + 34654, + -6.141726970672607 + ], + [ + 2297, + -6.240628242492676 + ], + [ + 346, + -6.574230670928955 + ], + [ + 66396, + -6.690945625305176 + ], + [ + 55950, + -6.71990442276001 + ], + [ + 66863, + -6.728503227233887 + ], + [ + 52657, + -6.798004627227783 + ], + [ + 22211, + -6.831472873687744 + ], + [ + 127906, + -6.941344738006592 + ], + [ + 103140, + -6.9943318367004395 + ], + [ + 80325, + -7.121044158935547 + ] + ], + "logprob_of_token": -1.1028212308883667, + "top1_top2_margin": 0.28780174255371094, + "top6_top7_margin": 0.042473793029785156 + }, + { + "gen_index": 2, + "token": 948, + "top": [ + [ + 948, + -0.00812310166656971 + ], + [ + 831, + -6.31874418258667 + ], + [ + 420, + -6.799724102020264 + ], + [ + 46, + -7.60221004486084 + ], + [ + 46252, + -7.767492771148682 + ], + [ + 44, + -7.782439231872559 + ], + [ + 346, + -7.96420431137085 + ], + [ + 279, + -8.372552871704102 + ], + [ + 339, + -8.373576164245605 + ], + [ + 1178, + -8.819843292236328 + ], + [ + 1829, + -8.955757141113281 + ], + [ + 493, + -8.994403839111328 + ], + [ + 1200, + -9.263640403747559 + ], + [ + 518, + -9.399162292480469 + ], + [ + 262, + -9.783928871154785 + ], + [ + 275, + -9.88821792602539 + ], + [ + 122693, + -9.892487525939941 + ], + [ + 127906, + -9.96656608581543 + ], + [ + 826, + -10.004453659057617 + ], + [ + 845, + -10.06658935546875 + ] + ], + "logprob_of_token": -0.00812310166656971, + "top1_top2_margin": 6.3106210809201, + "top6_top7_margin": 0.18176507949829102 + }, + { + "gen_index": 3, + "token": 46252, + "top": [ + [ + 46252, + -0.015587426722049713 + ], + [ + 53753, + -7.266880989074707 + ], + [ + 22211, + -7.47953987121582 + ], + [ + 948, + -7.615694522857666 + ], + [ + 43492, + -7.654803276062012 + ], + [ + 11397, + -7.689845085144043 + ], + [ + 80325, + -8.614851951599121 + ], + [ + 35423, + -8.67678165435791 + ], + [ + 42616, + -8.857285499572754 + ], + [ + 73620, + -8.899192810058594 + ], + [ + 24771, + -9.018561363220215 + ], + [ + 7616, + -9.2216215133667 + ], + [ + 116371, + -9.302258491516113 + ], + [ + 420, + -9.361924171447754 + ], + [ + 46644, + -9.365782737731934 + ], + [ + 19089, + -9.415213584899902 + ], + [ + 34748, + -9.416044235229492 + ], + [ + 346, + -9.425546646118164 + ], + [ + 6715, + -9.516844749450684 + ], + [ + 79493, + -9.530121803283691 + ] + ], + "logprob_of_token": -0.015587426722049713, + "top1_top2_margin": 7.251293562352657, + "top6_top7_margin": 0.9250068664550781 + }, + { + "gen_index": 4, + "token": 948, + "top": [ + [ + 948, + -0.0056877052411437035 + ], + [ + 420, + -6.882640838623047 + ], + [ + 346, + -6.968628883361816 + ], + [ + 831, + -7.065840721130371 + ], + [ + 44, + -8.187944412231445 + ], + [ + 46, + -8.191183090209961 + ], + [ + 279, + -8.749105453491211 + ], + [ + 518, + -8.950203895568848 + ], + [ + 339, + -9.092840194702148 + ], + [ + 262, + -9.180337905883789 + ], + [ + 493, + -9.48007583618164 + ], + [ + 1178, + -9.542570114135742 + ], + [ + 46252, + -9.985252380371094 + ], + [ + 1829, + -9.987451553344727 + ], + [ + 922, + -10.03402328491211 + ], + [ + 127906, + -10.308680534362793 + ], + [ + 2297, + -10.331510543823242 + ], + [ + 275, + -10.428590774536133 + ], + [ + 122693, + -10.647359848022461 + ], + [ + 58, + -10.648776054382324 + ] + ], + "logprob_of_token": -0.0056877052411437035, + "top1_top2_margin": 6.876953133381903, + "top6_top7_margin": 0.55792236328125 + }, + { + "gen_index": 5, + "token": 46252, + "top": [ + [ + 46252, + -0.01730087213218212 + ], + [ + 53753, + -7.0719895362854 + ], + [ + 22211, + -7.318609237670898 + ], + [ + 11397, + -8.027680397033691 + ], + [ + 43492, + -8.145773887634277 + ], + [ + 948, + -8.206072807312012 + ], + [ + 24771, + -8.502130508422852 + ], + [ + 34748, + -8.723273277282715 + ], + [ + 6715, + -8.742091178894043 + ], + [ + 19089, + -8.86000919342041 + ], + [ + 73620, + -8.871739387512207 + ], + [ + 46644, + -8.922514915466309 + ], + [ + 23553, + -8.95374870300293 + ], + [ + 9979, + -9.035992622375488 + ], + [ + 116371, + -9.039350509643555 + ], + [ + 80325, + -9.062552452087402 + ], + [ + 44370, + -9.102911949157715 + ], + [ + 1511, + -9.274360656738281 + ], + [ + 420, + -9.342162132263184 + ], + [ + 23743, + -9.374251365661621 + ] + ], + "logprob_of_token": -0.01730087213218212, + "top1_top2_margin": 7.054688664153218, + "top6_top7_margin": 0.29605770111083984 + }, + { + "gen_index": 6, + "token": 948, + "top": [ + [ + 948, + -0.004639942664653063 + ], + [ + 420, + -6.708393573760986 + ], + [ + 346, + -7.358968257904053 + ], + [ + 831, + -7.59367036819458 + ], + [ + 44, + -8.28134822845459 + ], + [ + 279, + -8.486893653869629 + ], + [ + 46, + -8.664231300354004 + ], + [ + 262, + -8.67061996459961 + ], + [ + 518, + -9.221095085144043 + ], + [ + 339, + -9.3727388381958 + ], + [ + 493, + -9.943821907043457 + ], + [ + 1178, + -10.230040550231934 + ], + [ + 127906, + -10.251603126525879 + ], + [ + 1829, + -10.422367095947266 + ], + [ + 2459, + -10.431414604187012 + ], + [ + 922, + -10.443652153015137 + ], + [ + 275, + -10.5943603515625 + ], + [ + 34, + -10.60659122467041 + ], + [ + 2297, + -10.706572532653809 + ], + [ + 122693, + -10.824323654174805 + ] + ], + "logprob_of_token": -0.004639942664653063, + "top1_top2_margin": 6.703753631096333, + "top6_top7_margin": 0.177337646484375 + }, + { + "gen_index": 7, + "token": 46252, + "top": [ + [ + 46252, + -0.011813890188932419 + ], + [ + 22211, + -7.127027988433838 + ], + [ + 53753, + -7.128714084625244 + ], + [ + 11397, + -8.601081848144531 + ], + [ + 43492, + -8.610925674438477 + ], + [ + 24771, + -8.696976661682129 + ], + [ + 948, + -8.83027458190918 + ], + [ + 19089, + -9.038658142089844 + ], + [ + 420, + -9.19021987915039 + ], + [ + 46644, + -9.196775436401367 + ], + [ + 23553, + -9.203266143798828 + ], + [ + 44370, + -9.289789199829102 + ], + [ + 80325, + -9.294418334960938 + ], + [ + 116371, + -9.29482364654541 + ], + [ + 73620, + -9.340131759643555 + ], + [ + 35423, + -9.376123428344727 + ], + [ + 34748, + -9.394940376281738 + ], + [ + 103473, + -9.40163803100586 + ], + [ + 6715, + -9.506753921508789 + ], + [ + 79493, + -9.69007396697998 + ] + ], + "logprob_of_token": -0.011813890188932419, + "top1_top2_margin": 7.1152140982449055, + "top6_top7_margin": 0.13329792022705078 + }, + { + "gen_index": 8, + "token": 948, + "top": [ + [ + 948, + -0.004346564412117004 + ], + [ + 420, + -6.349551677703857 + ], + [ + 346, + -7.734121322631836 + ], + [ + 831, + -8.023757934570312 + ], + [ + 44, + -8.342355728149414 + ], + [ + 279, + -8.445862770080566 + ], + [ + 262, + -9.183960914611816 + ], + [ + 46, + -9.444833755493164 + ], + [ + 339, + -9.656160354614258 + ], + [ + 518, + -9.727554321289062 + ], + [ + 493, + -9.944307327270508 + ], + [ + 1178, + -10.163911819458008 + ], + [ + 922, + -10.197782516479492 + ], + [ + 127906, + -10.57121753692627 + ], + [ + 122693, + -10.743000030517578 + ], + [ + 286, + -10.788830757141113 + ], + [ + 1409, + -10.815258026123047 + ], + [ + 826, + -10.974676132202148 + ], + [ + 34, + -10.978076934814453 + ], + [ + 845, + -11.048103332519531 + ] + ], + "logprob_of_token": -0.004346564412117004, + "top1_top2_margin": 6.34520511329174, + "top6_top7_margin": 0.73809814453125 + }, + { + "gen_index": 9, + "token": 46252, + "top": [ + [ + 46252, + -0.008592881262302399 + ], + [ + 53753, + -7.828023910522461 + ], + [ + 22211, + -7.8484883308410645 + ], + [ + 11397, + -8.57630443572998 + ], + [ + 43492, + -8.77647590637207 + ], + [ + 24771, + -9.310497283935547 + ], + [ + 19089, + -9.342232704162598 + ], + [ + 35423, + -9.357725143432617 + ], + [ + 73620, + -9.394779205322266 + ], + [ + 48716, + -9.40743350982666 + ], + [ + 80325, + -9.46729850769043 + ], + [ + 948, + -9.526001930236816 + ], + [ + 103473, + -9.606729507446289 + ], + [ + 44370, + -9.631576538085938 + ], + [ + 34748, + -9.632942199707031 + ], + [ + 116371, + -9.661117553710938 + ], + [ + 38826, + -9.684523582458496 + ], + [ + 420, + -9.68635368347168 + ], + [ + 46644, + -9.745391845703125 + ], + [ + 32, + -9.865511894226074 + ] + ], + "logprob_of_token": -0.008592881262302399, + "top1_top2_margin": 7.8194310292601585, + "top6_top7_margin": 0.03173542022705078 + }, + { + "gen_index": 10, + "token": 948, + "top": [ + [ + 948, + -0.0031370799988508224 + ], + [ + 420, + -6.8181939125061035 + ], + [ + 346, + -7.6388421058654785 + ], + [ + 831, + -8.537545204162598 + ], + [ + 279, + -8.588693618774414 + ], + [ + 44, + -8.79343318939209 + ], + [ + 262, + -9.625045776367188 + ], + [ + 518, + -9.94625186920166 + ], + [ + 339, + -10.102299690246582 + ], + [ + 46, + -10.121004104614258 + ], + [ + 493, + -10.146830558776855 + ], + [ + 1178, + -10.166345596313477 + ], + [ + 922, + -10.496020317077637 + ], + [ + 127906, + -10.810450553894043 + ], + [ + 122693, + -10.975701332092285 + ], + [ + 1200, + -11.024041175842285 + ], + [ + 845, + -11.108107566833496 + ], + [ + 286, + -11.14029598236084 + ], + [ + 1409, + -11.230270385742188 + ], + [ + 1829, + -11.245598793029785 + ] + ], + "logprob_of_token": -0.0031370799988508224, + "top1_top2_margin": 6.815056832507253, + "top6_top7_margin": 0.8316125869750977 + }, + { + "gen_index": 11, + "token": 46252, + "top": [ + [ + 46252, + -0.011022957041859627 + ], + [ + 22211, + -7.954601287841797 + ], + [ + 53753, + -7.964017391204834 + ], + [ + 11397, + -8.108217239379883 + ], + [ + 43492, + -8.77042007446289 + ], + [ + 35423, + -8.808464050292969 + ], + [ + 34748, + -8.927778244018555 + ], + [ + 24771, + -9.02116584777832 + ], + [ + 80325, + -9.099372863769531 + ], + [ + 48716, + -9.15374755859375 + ], + [ + 116371, + -9.16855239868164 + ], + [ + 948, + -9.221101760864258 + ], + [ + 420, + -9.42020320892334 + ], + [ + 73620, + -9.4329252243042 + ], + [ + 46644, + -9.43964958190918 + ], + [ + 52657, + -9.44676399230957 + ], + [ + 103473, + -9.511610984802246 + ], + [ + 19089, + -9.575950622558594 + ], + [ + 6715, + -9.636974334716797 + ], + [ + 5274, + -9.665823936462402 + ] + ], + "logprob_of_token": -0.011022957041859627, + "top1_top2_margin": 7.943578330799937, + "top6_top7_margin": 0.11931419372558594 + }, + { + "gen_index": 12, + "token": 948, + "top": [ + [ + 948, + -0.002824476920068264 + ], + [ + 420, + -7.251257419586182 + ], + [ + 346, + -7.785077095031738 + ], + [ + 831, + -8.1885986328125 + ], + [ + 279, + -8.928606986999512 + ], + [ + 44, + -8.993165016174316 + ], + [ + 262, + -9.479608535766602 + ], + [ + 518, + -9.575875282287598 + ], + [ + 339, + -9.762884140014648 + ], + [ + 46, + -9.934826850891113 + ], + [ + 1178, + -10.052225112915039 + ], + [ + 493, + -10.451872825622559 + ], + [ + 1200, + -10.54336166381836 + ], + [ + 127906, + -10.549668312072754 + ], + [ + 922, + -10.642258644104004 + ], + [ + 1829, + -10.872867584228516 + ], + [ + 622, + -10.962322235107422 + ], + [ + 845, + -10.980454444885254 + ], + [ + 826, + -10.987180709838867 + ], + [ + 122693, + -11.046460151672363 + ] + ], + "logprob_of_token": -0.002824476920068264, + "top1_top2_margin": 7.248432942666113, + "top6_top7_margin": 0.48644351959228516 + }, + { + "gen_index": 13, + "token": 46252, + "top": [ + [ + 46252, + -0.010219883173704147 + ], + [ + 22211, + -7.995258331298828 + ], + [ + 53753, + -8.027402877807617 + ], + [ + 11397, + -8.184081077575684 + ], + [ + 35423, + -8.364813804626465 + ], + [ + 43492, + -8.689290046691895 + ], + [ + 948, + -8.908382415771484 + ], + [ + 48716, + -9.012325286865234 + ], + [ + 116371, + -9.03697395324707 + ], + [ + 24771, + -9.16821575164795 + ], + [ + 34748, + -9.186735153198242 + ], + [ + 19089, + -9.192991256713867 + ], + [ + 23553, + -9.207525253295898 + ], + [ + 46644, + -9.22243595123291 + ], + [ + 73620, + -9.314525604248047 + ], + [ + 103473, + -9.367992401123047 + ], + [ + 87539, + -9.465592384338379 + ], + [ + 80325, + -9.475561141967773 + ], + [ + 6715, + -9.497151374816895 + ], + [ + 52657, + -9.541498184204102 + ] + ], + "logprob_of_token": -0.010219883173704147, + "top1_top2_margin": 7.985038448125124, + "top6_top7_margin": 0.21909236907958984 + }, + { + "gen_index": 14, + "token": 948, + "top": [ + [ + 948, + -0.002709061373025179 + ], + [ + 420, + -6.809096813201904 + ], + [ + 831, + -8.293614387512207 + ], + [ + 346, + -8.3292875289917 + ], + [ + 44, + -8.987053871154785 + ], + [ + 279, + -9.356524467468262 + ], + [ + 518, + -9.788214683532715 + ], + [ + 262, + -9.941332817077637 + ], + [ + 1178, + -10.124700546264648 + ], + [ + 493, + -10.188776969909668 + ], + [ + 339, + -10.363760948181152 + ], + [ + 46, + -10.3801851272583 + ], + [ + 826, + -10.672453880310059 + ], + [ + 127906, + -10.905791282653809 + ], + [ + 922, + -10.992779731750488 + ], + [ + 1829, + -11.10933780670166 + ], + [ + 622, + -11.226910591125488 + ], + [ + 122693, + -11.259238243103027 + ], + [ + 2297, + -11.261544227600098 + ], + [ + 46252, + -11.293095588684082 + ] + ], + "logprob_of_token": -0.002709061373025179, + "top1_top2_margin": 6.806387751828879, + "top6_top7_margin": 0.4316902160644531 + }, + { + "gen_index": 15, + "token": 46252, + "top": [ + [ + 46252, + -0.007957925088703632 + ], + [ + 53753, + -7.918365001678467 + ], + [ + 22211, + -7.956271171569824 + ], + [ + 11397, + -8.664090156555176 + ], + [ + 35423, + -8.970465660095215 + ], + [ + 43492, + -9.0150785446167 + ], + [ + 34748, + -9.100385665893555 + ], + [ + 19089, + -9.10908031463623 + ], + [ + 116371, + -9.113107681274414 + ], + [ + 46644, + -9.124759674072266 + ], + [ + 48716, + -9.23136043548584 + ], + [ + 24771, + -9.264005661010742 + ], + [ + 23553, + -9.301180839538574 + ], + [ + 948, + -9.450379371643066 + ], + [ + 73620, + -9.553028106689453 + ], + [ + 87539, + -9.688968658447266 + ], + [ + 44370, + -9.69806957244873 + ], + [ + 103473, + -9.785224914550781 + ], + [ + 6715, + -9.808094024658203 + ], + [ + 80325, + -9.866413116455078 + ] + ], + "logprob_of_token": -0.007957925088703632, + "top1_top2_margin": 7.910407076589763, + "top6_top7_margin": 0.08530712127685547 + }, + { + "gen_index": 16, + "token": 948, + "top": [ + [ + 948, + -0.004242346156388521 + ], + [ + 420, + -6.272642612457275 + ], + [ + 346, + -7.980849266052246 + ], + [ + 831, + -8.02146053314209 + ], + [ + 44, + -8.40281867980957 + ], + [ + 279, + -8.739778518676758 + ], + [ + 262, + -9.435214042663574 + ], + [ + 46, + -9.582727432250977 + ], + [ + 518, + -9.665536880493164 + ], + [ + 493, + -9.762328147888184 + ], + [ + 1178, + -10.07055377960205 + ], + [ + 339, + -10.179754257202148 + ], + [ + 127906, + -10.37032699584961 + ], + [ + 826, + -10.56978702545166 + ], + [ + 1200, + -10.648751258850098 + ], + [ + 1829, + -10.707015037536621 + ], + [ + 14188, + -10.720455169677734 + ], + [ + 922, + -10.730623245239258 + ], + [ + 122693, + -10.762977600097656 + ], + [ + 286, + -10.87325668334961 + ] + ], + "logprob_of_token": -0.004242346156388521, + "top1_top2_margin": 6.268400266300887, + "top6_top7_margin": 0.6954355239868164 + }, + { + "gen_index": 17, + "token": 46252, + "top": [ + [ + 46252, + -0.007935455068945885 + ], + [ + 22211, + -7.8408613204956055 + ], + [ + 53753, + -8.207194328308105 + ], + [ + 48716, + -9.017535209655762 + ], + [ + 116371, + -9.040987968444824 + ], + [ + 43492, + -9.133450508117676 + ], + [ + 11397, + -9.157980918884277 + ], + [ + 35423, + -9.207725524902344 + ], + [ + 46644, + -9.236330032348633 + ], + [ + 948, + -9.346978187561035 + ], + [ + 34748, + -9.366808891296387 + ], + [ + 23553, + -9.386948585510254 + ], + [ + 19089, + -9.451090812683105 + ], + [ + 24771, + -9.476271629333496 + ], + [ + 73620, + -9.54175090789795 + ], + [ + 103473, + -9.626996994018555 + ], + [ + 87539, + -9.654202461242676 + ], + [ + 9979, + -9.73828411102295 + ], + [ + 44370, + -9.801549911499023 + ], + [ + 420, + -9.985875129699707 + ] + ], + "logprob_of_token": -0.007935455068945885, + "top1_top2_margin": 7.83292586542666, + "top6_top7_margin": 0.024530410766601562 + }, + { + "gen_index": 18, + "token": 948, + "top": [ + [ + 948, + -0.003733443096280098 + ], + [ + 420, + -6.858512878417969 + ], + [ + 831, + -7.706398963928223 + ], + [ + 346, + -7.777468204498291 + ], + [ + 279, + -8.320638656616211 + ], + [ + 44, + -8.666685104370117 + ], + [ + 262, + -9.225239753723145 + ], + [ + 46, + -9.403885841369629 + ], + [ + 518, + -9.58492660522461 + ], + [ + 1178, + -9.834698677062988 + ], + [ + 339, + -10.01200008392334 + ], + [ + 493, + -10.040639877319336 + ], + [ + 922, + -10.228926658630371 + ], + [ + 127906, + -10.2904634475708 + ], + [ + 826, + -10.34348201751709 + ], + [ + 14188, + -10.638420104980469 + ], + [ + 122693, + -10.659684181213379 + ], + [ + 1829, + -10.730912208557129 + ], + [ + 1200, + -10.758553504943848 + ], + [ + 286, + -10.813578605651855 + ] + ], + "logprob_of_token": -0.003733443096280098, + "top1_top2_margin": 6.854779435321689, + "top6_top7_margin": 0.5585546493530273 + }, + { + "gen_index": 19, + "token": 46252, + "top": [ + [ + 46252, + -0.011609510518610477 + ], + [ + 22211, + -7.719491958618164 + ], + [ + 53753, + -7.90797758102417 + ], + [ + 48716, + -8.689425468444824 + ], + [ + 35423, + -8.82684326171875 + ], + [ + 948, + -8.831572532653809 + ], + [ + 43492, + -8.883824348449707 + ], + [ + 116371, + -8.908106803894043 + ], + [ + 46644, + -8.956887245178223 + ], + [ + 24771, + -8.982617378234863 + ], + [ + 11397, + -9.0485258102417 + ], + [ + 19089, + -9.09760570526123 + ], + [ + 73620, + -9.218653678894043 + ], + [ + 34748, + -9.306517601013184 + ], + [ + 32, + -9.436739921569824 + ], + [ + 9979, + -9.440306663513184 + ], + [ + 44370, + -9.467046737670898 + ], + [ + 420, + -9.493206977844238 + ], + [ + 23553, + -9.564586639404297 + ], + [ + 103473, + -9.600221633911133 + ] + ], + "logprob_of_token": -0.011609510518610477, + "top1_top2_margin": 7.707882448099554, + "top6_top7_margin": 0.05225181579589844 + }, + { + "gen_index": 20, + "token": 948, + "top": [ + [ + 948, + -0.0034754399675875902 + ], + [ + 420, + -7.069921970367432 + ], + [ + 346, + -7.29308557510376 + ], + [ + 831, + -8.195557594299316 + ], + [ + 44, + -8.497693061828613 + ], + [ + 279, + -8.823014259338379 + ], + [ + 518, + -9.33732795715332 + ], + [ + 262, + -9.394865036010742 + ], + [ + 922, + -9.828298568725586 + ], + [ + 46, + -9.91025161743164 + ], + [ + 1178, + -9.914369583129883 + ], + [ + 339, + -10.072521209716797 + ], + [ + 493, + -10.200735092163086 + ], + [ + 127906, + -10.367663383483887 + ], + [ + 826, + -10.564255714416504 + ], + [ + 14188, + -10.614444732666016 + ], + [ + 1829, + -10.631903648376465 + ], + [ + 1200, + -11.000715255737305 + ], + [ + 122693, + -11.041486740112305 + ], + [ + 46252, + -11.078168869018555 + ] + ], + "logprob_of_token": -0.0034754399675875902, + "top1_top2_margin": 7.066446530399844, + "top6_top7_margin": 0.5143136978149414 + }, + { + "gen_index": 21, + "token": 46252, + "top": [ + [ + 46252, + -0.007305840030312538 + ], + [ + 22211, + -8.235447883605957 + ], + [ + 53753, + -8.354071617126465 + ], + [ + 48716, + -8.815165519714355 + ], + [ + 948, + -9.001387596130371 + ], + [ + 35423, + -9.147536277770996 + ], + [ + 24771, + -9.157712936401367 + ], + [ + 11397, + -9.196538925170898 + ], + [ + 116371, + -9.29778003692627 + ], + [ + 43492, + -9.342641830444336 + ], + [ + 19089, + -9.350255966186523 + ], + [ + 44370, + -9.435723304748535 + ], + [ + 34748, + -9.457925796508789 + ], + [ + 23553, + -9.61756420135498 + ], + [ + 38826, + -9.625092506408691 + ], + [ + 32, + -9.696518898010254 + ], + [ + 420, + -9.719584465026855 + ], + [ + 46644, + -9.756949424743652 + ], + [ + 103473, + -9.953083992004395 + ], + [ + 73620, + -9.993199348449707 + ] + ], + "logprob_of_token": -0.007305840030312538, + "top1_top2_margin": 8.228142043575644, + "top6_top7_margin": 0.010176658630371094 + }, + { + "gen_index": 22, + "token": 948, + "top": [ + [ + 948, + -0.004512222949415445 + ], + [ + 346, + -6.635460376739502 + ], + [ + 420, + -6.806921482086182 + ], + [ + 44, + -8.165533065795898 + ], + [ + 831, + -8.556540489196777 + ], + [ + 279, + -8.724205017089844 + ], + [ + 262, + -8.957154273986816 + ], + [ + 518, + -9.618480682373047 + ], + [ + 1178, + -9.781901359558105 + ], + [ + 46, + -9.918036460876465 + ], + [ + 922, + -9.991753578186035 + ], + [ + 493, + -10.092816352844238 + ], + [ + 339, + -10.344731330871582 + ], + [ + 46252, + -10.34879207611084 + ], + [ + 127906, + -10.428610801696777 + ], + [ + 14188, + -10.529693603515625 + ], + [ + 1829, + -10.592841148376465 + ], + [ + 826, + -10.777207374572754 + ], + [ + 286, + -10.924997329711914 + ], + [ + 622, + -10.940654754638672 + ] + ], + "logprob_of_token": -0.004512222949415445, + "top1_top2_margin": 6.6309481537900865, + "top6_top7_margin": 0.23294925689697266 + }, + { + "gen_index": 23, + "token": 46252, + "top": [ + [ + 46252, + -0.006856108549982309 + ], + [ + 22211, + -8.306923866271973 + ], + [ + 53753, + -8.31474781036377 + ], + [ + 48716, + -8.518511772155762 + ], + [ + 11397, + -8.9629545211792 + ], + [ + 948, + -9.136431694030762 + ], + [ + 44370, + -9.204049110412598 + ], + [ + 116371, + -9.226448059082031 + ], + [ + 24771, + -9.260838508605957 + ], + [ + 35423, + -9.319504737854004 + ], + [ + 19089, + -9.387794494628906 + ], + [ + 23553, + -9.392911911010742 + ], + [ + 34748, + -9.530945777893066 + ], + [ + 43492, + -9.572148323059082 + ], + [ + 38826, + -9.652575492858887 + ], + [ + 46644, + -9.65931224822998 + ], + [ + 420, + -9.666651725769043 + ], + [ + 32, + -9.837862968444824 + ], + [ + 87539, + -10.053059577941895 + ], + [ + 5274, + -10.082808494567871 + ] + ], + "logprob_of_token": -0.006856108549982309, + "top1_top2_margin": 8.30006775772199, + "top6_top7_margin": 0.06761741638183594 + }, + { + "gen_index": 24, + "token": 948, + "top": [ + [ + 948, + -0.004534077364951372 + ], + [ + 420, + -6.548036098480225 + ], + [ + 346, + -6.993072986602783 + ], + [ + 831, + -7.893949031829834 + ], + [ + 44, + -8.321596145629883 + ], + [ + 279, + -8.80076789855957 + ], + [ + 262, + -9.116632461547852 + ], + [ + 46, + -9.430376052856445 + ], + [ + 518, + -9.826217651367188 + ], + [ + 1178, + -9.944833755493164 + ], + [ + 493, + -10.200164794921875 + ], + [ + 922, + -10.31605052947998 + ], + [ + 339, + -10.332111358642578 + ], + [ + 127906, + -10.422942161560059 + ], + [ + 14188, + -10.509988784790039 + ], + [ + 1829, + -10.639780044555664 + ], + [ + 286, + -10.767300605773926 + ], + [ + 826, + -10.779373168945312 + ], + [ + 46252, + -10.78986644744873 + ], + [ + 1409, + -10.86661148071289 + ] + ], + "logprob_of_token": -0.004534077364951372, + "top1_top2_margin": 6.543502021115273, + "top6_top7_margin": 0.31586456298828125 + }, + { + "gen_index": 25, + "token": 46252, + "top": [ + [ + 46252, + -0.00662549864500761 + ], + [ + 22211, + -8.158782005310059 + ], + [ + 53753, + -8.45922565460205 + ], + [ + 48716, + -8.726641654968262 + ], + [ + 11397, + -8.91199779510498 + ], + [ + 948, + -9.06664752960205 + ], + [ + 34748, + -9.301217079162598 + ], + [ + 46644, + -9.325739860534668 + ], + [ + 116371, + -9.394558906555176 + ], + [ + 44370, + -9.41635799407959 + ], + [ + 35423, + -9.514415740966797 + ], + [ + 23553, + -9.634743690490723 + ], + [ + 43492, + -9.65611743927002 + ], + [ + 24771, + -9.79234790802002 + ], + [ + 420, + -9.946459770202637 + ], + [ + 73620, + -9.976632118225098 + ], + [ + 19089, + -9.995879173278809 + ], + [ + 9979, + -9.99714183807373 + ], + [ + 5274, + -10.062674522399902 + ], + [ + 80325, + -10.103385925292969 + ] + ], + "logprob_of_token": -0.00662549864500761, + "top1_top2_margin": 8.152156506665051, + "top6_top7_margin": 0.23456954956054688 + }, + { + "gen_index": 26, + "token": 948, + "top": [ + [ + 948, + -0.005480138584971428 + ], + [ + 420, + -6.61422872543335 + ], + [ + 831, + -6.910644054412842 + ], + [ + 346, + -7.168549060821533 + ], + [ + 44, + -8.090473175048828 + ], + [ + 279, + -8.66604995727539 + ], + [ + 262, + -8.776552200317383 + ], + [ + 518, + -9.200469970703125 + ], + [ + 46, + -9.231213569641113 + ], + [ + 1178, + -9.702203750610352 + ], + [ + 493, + -9.831501007080078 + ], + [ + 922, + -10.04672622680664 + ], + [ + 339, + -10.058116912841797 + ], + [ + 46252, + -10.094404220581055 + ], + [ + 127906, + -10.22055435180664 + ], + [ + 826, + -10.260505676269531 + ], + [ + 122693, + -10.307100296020508 + ], + [ + 14188, + -10.320756912231445 + ], + [ + 1921, + -10.478534698486328 + ], + [ + 1829, + -10.565252304077148 + ] + ], + "logprob_of_token": -0.005480138584971428, + "top1_top2_margin": 6.608748586848378, + "top6_top7_margin": 0.11050224304199219 + }, + { + "gen_index": 27, + "token": 46252, + "top": [ + [ + 46252, + -0.006795975845307112 + ], + [ + 22211, + -7.717989444732666 + ], + [ + 53753, + -8.497011184692383 + ], + [ + 11397, + -8.99424934387207 + ], + [ + 48716, + -9.087957382202148 + ], + [ + 46644, + -9.148609161376953 + ], + [ + 948, + -9.211275100708008 + ], + [ + 116371, + -9.211606979370117 + ], + [ + 43492, + -9.462484359741211 + ], + [ + 34748, + -9.546672821044922 + ], + [ + 87539, + -9.703838348388672 + ], + [ + 44370, + -9.84864330291748 + ], + [ + 1511, + -9.875589370727539 + ], + [ + 73620, + -9.904448509216309 + ], + [ + 19089, + -9.905799865722656 + ], + [ + 35423, + -9.909099578857422 + ], + [ + 24771, + -9.91313362121582 + ], + [ + 23553, + -9.920717239379883 + ], + [ + 32, + -9.970800399780273 + ], + [ + 6715, + -10.041482925415039 + ] + ], + "logprob_of_token": -0.006795975845307112, + "top1_top2_margin": 7.711193468887359, + "top6_top7_margin": 0.06266593933105469 + }, + { + "gen_index": 28, + "token": 948, + "top": [ + [ + 948, + -0.007202513515949249 + ], + [ + 420, + -6.188995838165283 + ], + [ + 831, + -6.556076526641846 + ], + [ + 346, + -7.278916358947754 + ], + [ + 44, + -7.797427177429199 + ], + [ + 279, + -8.198884963989258 + ], + [ + 46, + -8.581743240356445 + ], + [ + 262, + -8.732004165649414 + ], + [ + 518, + -9.155715942382812 + ], + [ + 1178, + -9.426483154296875 + ], + [ + 922, + -9.490346908569336 + ], + [ + 493, + -9.634588241577148 + ], + [ + 127906, + -9.76872730255127 + ], + [ + 14188, + -9.918956756591797 + ], + [ + 339, + -9.96237850189209 + ], + [ + 1829, + -10.09979248046875 + ], + [ + 286, + -10.121109962463379 + ], + [ + 826, + -10.163369178771973 + ], + [ + 122693, + -10.302647590637207 + ], + [ + 46252, + -10.314321517944336 + ] + ], + "logprob_of_token": -0.007202513515949249, + "top1_top2_margin": 6.181793324649334, + "top6_top7_margin": 0.3828582763671875 + }, + { + "gen_index": 29, + "token": 46252, + "top": [ + [ + 46252, + -0.008104533888399601 + ], + [ + 22211, + -7.244958877563477 + ], + [ + 53753, + -8.494653701782227 + ], + [ + 948, + -9.035584449768066 + ], + [ + 48716, + -9.049067497253418 + ], + [ + 43492, + -9.08212947845459 + ], + [ + 46644, + -9.17425537109375 + ], + [ + 11397, + -9.296154022216797 + ], + [ + 35423, + -9.568355560302734 + ], + [ + 116371, + -9.650251388549805 + ], + [ + 73620, + -9.653593063354492 + ], + [ + 34748, + -9.65625 + ], + [ + 32, + -9.725590705871582 + ], + [ + 420, + -9.769817352294922 + ], + [ + 9979, + -9.80421257019043 + ], + [ + 6715, + -9.929952621459961 + ], + [ + 42616, + -9.972600936889648 + ], + [ + 5274, + -9.990619659423828 + ], + [ + 65518, + -9.991089820861816 + ], + [ + 44370, + -10.032535552978516 + ] + ], + "logprob_of_token": -0.008104533888399601, + "top1_top2_margin": 7.236854343675077, + "top6_top7_margin": 0.09212589263916016 + }, + { + "gen_index": 30, + "token": 948, + "top": [ + [ + 948, + -0.005533839110285044 + ], + [ + 420, + -6.445913791656494 + ], + [ + 831, + -6.76676607131958 + ], + [ + 346, + -7.494697093963623 + ], + [ + 279, + -8.158052444458008 + ], + [ + 44, + -8.779430389404297 + ], + [ + 518, + -9.313875198364258 + ], + [ + 262, + -9.318530082702637 + ], + [ + 46, + -9.363901138305664 + ], + [ + 922, + -9.47602653503418 + ], + [ + 1178, + -9.747397422790527 + ], + [ + 493, + -9.798066139221191 + ], + [ + 339, + -9.926531791687012 + ], + [ + 826, + -10.151106834411621 + ], + [ + 127906, + -10.156620979309082 + ], + [ + 122693, + -10.171879768371582 + ], + [ + 46252, + -10.284785270690918 + ], + [ + 14188, + -10.350565910339355 + ], + [ + 1921, + -10.51380729675293 + ], + [ + 2459, + -10.561250686645508 + ] + ], + "logprob_of_token": -0.005533839110285044, + "top1_top2_margin": 6.440379952546209, + "top6_top7_margin": 0.5344448089599609 + }, + { + "gen_index": 31, + "token": 46252, + "top": [ + [ + 46252, + -0.011426815763115883 + ], + [ + 22211, + -7.311507225036621 + ], + [ + 53753, + -8.104774475097656 + ], + [ + 43492, + -8.499479293823242 + ], + [ + 48716, + -8.749040603637695 + ], + [ + 35423, + -8.85064697265625 + ], + [ + 948, + -9.022180557250977 + ], + [ + 11397, + -9.073286056518555 + ], + [ + 420, + -9.147211074829102 + ], + [ + 32, + -9.214555740356445 + ], + [ + 46644, + -9.250295639038086 + ], + [ + 34748, + -9.30141830444336 + ], + [ + 42616, + -9.42602825164795 + ], + [ + 73620, + -9.461069107055664 + ], + [ + 5274, + -9.483360290527344 + ], + [ + 34991, + -9.487672805786133 + ], + [ + 9979, + -9.49565315246582 + ], + [ + 127906, + -9.532516479492188 + ], + [ + 7616, + -9.554466247558594 + ], + [ + 116371, + -9.721601486206055 + ] + ], + "logprob_of_token": -0.011426815763115883, + "top1_top2_margin": 7.300080409273505, + "top6_top7_margin": 0.17153358459472656 + } + ] + }, + { + "prompt": "The capital of Australia is", + "input_ids": [ + 325, + 9255, + 279, + 5240, + 735 + ], + "generated_ids": [ + 75361, + 46, + 75361, + 735, + 262, + 9255, + 279, + 5240, + 46, + 75361, + 735, + 7789, + 622, + 262, + 7252, + 13919, + 37112, + 46, + 75361, + 735, + 262, + 6980, + 6547, + 622, + 262, + 7252, + 13919, + 37112, + 46, + 75361, + 735, + 262 + ], + "rows": [ + { + "gen_index": 0, + "token": 75361, + "top": [ + [ + 75361, + -0.12662169337272644 + ], + [ + 20733, + -2.318451404571533 + ], + [ + 120007, + -5.966843128204346 + ], + [ + 262, + -6.036325454711914 + ], + [ + 23441, + -6.124563217163086 + ], + [ + 5274, + -7.232546329498291 + ], + [ + 32, + -7.495774745941162 + ], + [ + 5240, + -7.530710220336914 + ], + [ + 502, + -7.779898643493652 + ], + [ + 120022, + -7.9021382331848145 + ], + [ + 91515, + -7.9131951332092285 + ], + [ + 3960, + -7.959465503692627 + ], + [ + 941, + -8.02033519744873 + ], + [ + 34122, + -8.06692886352539 + ], + [ + 476, + -8.340516090393066 + ], + [ + 9255, + -8.388566017150879 + ], + [ + 64119, + -8.584506034851074 + ], + [ + 13919, + -8.651474952697754 + ], + [ + 762, + -8.892900466918945 + ], + [ + 49123, + -8.924077033996582 + ] + ], + "logprob_of_token": -0.12662169337272644, + "top1_top2_margin": 2.1918297111988068, + "top6_top7_margin": 0.2632284164428711 + }, + { + "gen_index": 1, + "token": 46, + "top": [ + [ + 46, + -0.6492207050323486 + ], + [ + 275, + -1.1240227222442627 + ], + [ + 314, + -2.6012556552886963 + ], + [ + 44, + -3.700343370437622 + ], + [ + 766, + -3.7406504154205322 + ], + [ + 59, + -4.971329212188721 + ], + [ + 63, + -5.439292907714844 + ], + [ + 14188, + -6.156974792480469 + ], + [ + 1043, + -6.17968225479126 + ], + [ + 120007, + -6.208618640899658 + ], + [ + 120399, + -7.2403998374938965 + ], + [ + 735, + -7.268710613250732 + ], + [ + 1829, + -7.450533390045166 + ], + [ + 120016, + -7.457005977630615 + ], + [ + 263, + -7.744316577911377 + ], + [ + 460, + -7.788402080535889 + ], + [ + 10, + -7.949960708618164 + ], + [ + 405, + -8.138642311096191 + ], + [ + 4137, + -8.265993118286133 + ], + [ + 120230, + -8.331986427307129 + ] + ], + "logprob_of_token": -0.6492207050323486, + "top1_top2_margin": 0.47480201721191406, + "top6_top7_margin": 0.46796369552612305 + }, + { + "gen_index": 2, + "token": 75361, + "top": [ + [ + 75361, + -1.10282301902771 + ], + [ + 543, + -1.3414744138717651 + ], + [ + 1914, + -3.285822629928589 + ], + [ + 3960, + -3.4908883571624756 + ], + [ + 14147, + -3.7982089519500732 + ], + [ + 669, + -3.9249255657196045 + ], + [ + 1231, + -3.951279401779175 + ], + [ + 120014, + -4.159611225128174 + ], + [ + 766, + -4.184267997741699 + ], + [ + 120004, + -4.235620498657227 + ], + [ + 1336, + -4.427208423614502 + ], + [ + 1905, + -4.701686859130859 + ], + [ + 611, + -4.770522594451904 + ], + [ + 1692, + -4.920647144317627 + ], + [ + 14161, + -4.938723087310791 + ], + [ + 6372, + -4.994624614715576 + ], + [ + 5775, + -5.130528926849365 + ], + [ + 5240, + -5.211400508880615 + ], + [ + 1194, + -5.310577392578125 + ], + [ + 1741, + -5.310678482055664 + ] + ], + "logprob_of_token": -1.10282301902771, + "top1_top2_margin": 0.23865139484405518, + "top6_top7_margin": 0.026353836059570312 + }, + { + "gen_index": 3, + "token": 735, + "top": [ + [ + 735, + -0.30294904112815857 + ], + [ + 378, + -1.9577752351760864 + ], + [ + 4278, + -2.936216354370117 + ], + [ + 919, + -3.9215002059936523 + ], + [ + 44, + -4.430645942687988 + ], + [ + 589, + -4.7484846115112305 + ], + [ + 11201, + -5.751497268676758 + ], + [ + 46, + -5.800843715667725 + ], + [ + 766, + -6.061862945556641 + ], + [ + 52776, + -6.690804481506348 + ], + [ + 21925, + -6.906884670257568 + ], + [ + 14439, + -6.9537434577941895 + ], + [ + 1410, + -7.072086811065674 + ], + [ + 58, + -7.482772350311279 + ], + [ + 476, + -7.727734565734863 + ], + [ + 7789, + -7.891982555389404 + ], + [ + 622, + -8.02388858795166 + ], + [ + 13032, + -8.057384490966797 + ], + [ + 10757, + -8.213915824890137 + ], + [ + 262, + -8.290655136108398 + ] + ], + "logprob_of_token": -0.30294904112815857, + "top1_top2_margin": 1.6548261940479279, + "top6_top7_margin": 1.0030126571655273 + }, + { + "gen_index": 4, + "token": 262, + "top": [ + [ + 262, + -0.6741154193878174 + ], + [ + 7789, + -1.5761950016021729 + ], + [ + 941, + -1.7226297855377197 + ], + [ + 502, + -3.5797712802886963 + ], + [ + 1410, + -4.174253463745117 + ], + [ + 5240, + -4.395539283752441 + ], + [ + 622, + -4.894196510314941 + ], + [ + 15132, + -4.936070442199707 + ], + [ + 13438, + -5.344074249267578 + ], + [ + 5407, + -5.349344253540039 + ], + [ + 2602, + -5.88490104675293 + ], + [ + 834, + -5.90726375579834 + ], + [ + 2150, + -5.913477897644043 + ], + [ + 6030, + -6.849878311157227 + ], + [ + 14386, + -7.061873912811279 + ], + [ + 14052, + -7.406075954437256 + ], + [ + 799, + -7.440911293029785 + ], + [ + 5639, + -7.760894298553467 + ], + [ + 9255, + -7.799892425537109 + ], + [ + 2403, + -7.902227878570557 + ] + ], + "logprob_of_token": -0.6741154193878174, + "top1_top2_margin": 0.9020795822143555, + "top6_top7_margin": 0.4986572265625 + }, + { + "gen_index": 5, + "token": 9255, + "top": [ + [ + 9255, + -0.33467787504196167 + ], + [ + 6980, + -2.0034916400909424 + ], + [ + 14390, + -3.6666440963745117 + ], + [ + 6662, + -3.7652313709259033 + ], + [ + 5397, + -3.993561029434204 + ], + [ + 11818, + -4.5928239822387695 + ], + [ + 15967, + -4.6639404296875 + ], + [ + 14232, + -4.949546813964844 + ], + [ + 5763, + -5.496504783630371 + ], + [ + 2322, + -5.508876800537109 + ], + [ + 1444, + -5.598689079284668 + ], + [ + 7252, + -5.682338714599609 + ], + [ + 5516, + -5.944289207458496 + ], + [ + 6547, + -5.975956916809082 + ], + [ + 15038, + -6.471737384796143 + ], + [ + 2929, + -6.507526397705078 + ], + [ + 5432, + -6.623363494873047 + ], + [ + 7771, + -6.656505584716797 + ], + [ + 9669, + -6.952110290527344 + ], + [ + 17295, + -6.983110427856445 + ] + ], + "logprob_of_token": -0.33467787504196167, + "top1_top2_margin": 1.6688137650489807, + "top6_top7_margin": 0.07111644744873047 + }, + { + "gen_index": 6, + "token": 279, + "top": [ + [ + 279, + -0.6461908221244812 + ], + [ + 6547, + -0.8331796526908875 + ], + [ + 46, + -4.309258460998535 + ], + [ + 44, + -4.851380348205566 + ], + [ + 286, + -4.90213680267334 + ], + [ + 779, + -5.593636512756348 + ], + [ + 275, + -6.441590309143066 + ], + [ + 22130, + -6.633668422698975 + ], + [ + 59, + -6.650158882141113 + ], + [ + 3756, + -7.6514763832092285 + ], + [ + 936, + -8.091341972351074 + ], + [ + 314, + -8.489742279052734 + ], + [ + 9255, + -8.626193046569824 + ], + [ + 474, + -8.996289253234863 + ], + [ + 327, + -9.01857852935791 + ], + [ + 5216, + -9.154790878295898 + ], + [ + 124214, + -9.161537170410156 + ], + [ + 622, + -9.251079559326172 + ], + [ + 14205, + -9.312519073486328 + ], + [ + 5763, + -9.337969779968262 + ] + ], + "logprob_of_token": -0.6461908221244812, + "top1_top2_margin": 0.18698883056640625, + "top6_top7_margin": 0.8479537963867188 + }, + { + "gen_index": 7, + "token": 5240, + "top": [ + [ + 5240, + -0.10424318164587021 + ], + [ + 262, + -2.4570140838623047 + ], + [ + 75361, + -5.196162223815918 + ], + [ + 1739, + -6.672972679138184 + ], + [ + 7252, + -6.796293258666992 + ], + [ + 67370, + -7.908011436462402 + ], + [ + 1283, + -7.983058452606201 + ], + [ + 28872, + -8.270951271057129 + ], + [ + 6131, + -8.278979301452637 + ], + [ + 41875, + -8.40781307220459 + ], + [ + 941, + -8.629899024963379 + ], + [ + 99932, + -8.834172248840332 + ], + [ + 900, + -9.041516304016113 + ], + [ + 16424, + -9.096434593200684 + ], + [ + 6622, + -9.154458045959473 + ], + [ + 26103, + -9.28950023651123 + ], + [ + 4955, + -9.303257942199707 + ], + [ + 3465, + -9.465068817138672 + ], + [ + 43425, + -9.468297004699707 + ], + [ + 6619, + -9.4684419631958 + ] + ], + "logprob_of_token": -0.10424318164587021, + "top1_top2_margin": 2.3527709022164345, + "top6_top7_margin": 0.07504701614379883 + }, + { + "gen_index": 8, + "token": 46, + "top": [ + [ + 46, + -0.5788041353225708 + ], + [ + 286, + -1.6928273439407349 + ], + [ + 44, + -2.2033655643463135 + ], + [ + 275, + -2.3292770385742188 + ], + [ + 314, + -3.9630022048950195 + ], + [ + 59, + -4.531243324279785 + ], + [ + 779, + -4.9434051513671875 + ], + [ + 936, + -6.493306636810303 + ], + [ + 589, + -6.500856876373291 + ], + [ + 7789, + -6.674529075622559 + ], + [ + 3756, + -7.3730387687683105 + ], + [ + 327, + -7.674618721008301 + ], + [ + 766, + -7.930011749267578 + ], + [ + 63, + -8.018097877502441 + ], + [ + 799, + -8.611495971679688 + ], + [ + 834, + -8.687057495117188 + ], + [ + 622, + -8.688301086425781 + ], + [ + 120007, + -8.703330993652344 + ], + [ + 393, + -8.709005355834961 + ], + [ + 1275, + -8.916349411010742 + ] + ], + "logprob_of_token": -0.5788041353225708, + "top1_top2_margin": 1.114023208618164, + "top6_top7_margin": 0.41216182708740234 + }, + { + "gen_index": 9, + "token": 75361, + "top": [ + [ + 75361, + -0.3066267967224121 + ], + [ + 543, + -2.468745708465576 + ], + [ + 1231, + -2.883185863494873 + ], + [ + 5240, + -3.7165074348449707 + ], + [ + 1914, + -3.753526210784912 + ], + [ + 120014, + -4.355344295501709 + ], + [ + 3960, + -5.116015911102295 + ], + [ + 9980, + -5.824162006378174 + ], + [ + 669, + -6.0586676597595215 + ], + [ + 120004, + -6.301538467407227 + ], + [ + 6693, + -6.3868727684021 + ], + [ + 1336, + -6.437449932098389 + ], + [ + 7252, + -6.444204330444336 + ], + [ + 14896, + -6.64420747756958 + ], + [ + 6372, + -6.865688800811768 + ], + [ + 611, + -6.932394981384277 + ], + [ + 14161, + -7.077273368835449 + ], + [ + 4759, + -7.081470489501953 + ], + [ + 1692, + -7.153158664703369 + ], + [ + 2560, + -7.19075345993042 + ] + ], + "logprob_of_token": -0.3066267967224121, + "top1_top2_margin": 2.162118911743164, + "top6_top7_margin": 0.7606716156005859 + }, + { + "gen_index": 10, + "token": 735, + "top": [ + [ + 735, + -0.22674739360809326 + ], + [ + 378, + -1.9863356351852417 + ], + [ + 919, + -4.018332481384277 + ], + [ + 44, + -4.331337928771973 + ], + [ + 4278, + -4.73231315612793 + ], + [ + 589, + -4.79489803314209 + ], + [ + 14439, + -6.232182502746582 + ], + [ + 11201, + -6.378473281860352 + ], + [ + 7789, + -6.512820243835449 + ], + [ + 52776, + -6.669107913970947 + ], + [ + 46, + -7.210415363311768 + ], + [ + 1410, + -7.481258392333984 + ], + [ + 286, + -7.767317295074463 + ], + [ + 13032, + -7.83797025680542 + ], + [ + 10471, + -7.924838066101074 + ], + [ + 476, + -7.953964710235596 + ], + [ + 21925, + -8.017027854919434 + ], + [ + 58, + -8.235851287841797 + ], + [ + 766, + -8.245925903320312 + ], + [ + 262, + -8.470661163330078 + ] + ], + "logprob_of_token": -0.22674739360809326, + "top1_top2_margin": 1.7595882415771484, + "top6_top7_margin": 1.4372844696044922 + }, + { + "gen_index": 11, + "token": 7789, + "top": [ + [ + 7789, + -0.771648645401001 + ], + [ + 941, + -1.5104877948760986 + ], + [ + 262, + -1.7661049365997314 + ], + [ + 1410, + -2.6301462650299072 + ], + [ + 622, + -3.3460237979888916 + ], + [ + 5407, + -4.881065368652344 + ], + [ + 502, + -4.970428466796875 + ], + [ + 15132, + -5.563694000244141 + ], + [ + 2150, + -5.928289413452148 + ], + [ + 13438, + -6.233413219451904 + ], + [ + 5639, + -6.539361476898193 + ], + [ + 834, + -6.545440673828125 + ], + [ + 799, + -6.879805564880371 + ], + [ + 5240, + -7.085399627685547 + ], + [ + 75361, + -7.388896465301514 + ], + [ + 2602, + -7.724722385406494 + ], + [ + 14052, + -8.00999927520752 + ], + [ + 1075, + -8.103291511535645 + ], + [ + 9255, + -8.129875183105469 + ], + [ + 6030, + -8.177704811096191 + ] + ], + "logprob_of_token": -0.771648645401001, + "top1_top2_margin": 0.7388391494750977, + "top6_top7_margin": 0.08936309814453125 + }, + { + "gen_index": 12, + "token": 622, + "top": [ + [ + 622, + -0.08878859132528305 + ], + [ + 834, + -2.569124937057495 + ], + [ + 2457, + -5.222449779510498 + ], + [ + 2288, + -6.963734149932861 + ], + [ + 121222, + -7.838261127471924 + ], + [ + 2769, + -8.27656078338623 + ], + [ + 3660, + -9.026679992675781 + ], + [ + 120007, + -9.03940200805664 + ], + [ + 6791, + -9.545979499816895 + ], + [ + 14667, + -9.546953201293945 + ], + [ + 16330, + -9.779801368713379 + ], + [ + 318, + -9.911529541015625 + ], + [ + 8255, + -9.947066307067871 + ], + [ + 467, + -10.044666290283203 + ], + [ + 799, + -10.07496452331543 + ], + [ + 923, + -10.350458145141602 + ], + [ + 4529, + -10.354475975036621 + ], + [ + 21393, + -10.360815048217773 + ], + [ + 4518, + -10.810482025146484 + ], + [ + 120022, + -10.87220287322998 + ] + ], + "logprob_of_token": -0.08878859132528305, + "top1_top2_margin": 2.480336345732212, + "top6_top7_margin": 0.7501192092895508 + }, + { + "gen_index": 13, + "token": 262, + "top": [ + [ + 262, + -0.042583394795656204 + ], + [ + 7252, + -3.6859490871429443 + ], + [ + 1283, + -5.145936965942383 + ], + [ + 5240, + -5.410064697265625 + ], + [ + 75361, + -5.808411598205566 + ], + [ + 54482, + -6.779390335083008 + ], + [ + 16424, + -8.611698150634766 + ], + [ + 14856, + -8.639970779418945 + ], + [ + 834, + -8.765928268432617 + ], + [ + 67370, + -8.830710411071777 + ], + [ + 941, + -9.0780029296875 + ], + [ + 3465, + -9.577523231506348 + ], + [ + 27992, + -9.697439193725586 + ], + [ + 120007, + -9.773433685302734 + ], + [ + 43425, + -9.793213844299316 + ], + [ + 762, + -9.8751802444458 + ], + [ + 41875, + -10.160594940185547 + ], + [ + 393, + -10.482381820678711 + ], + [ + 28872, + -10.520198822021484 + ], + [ + 14871, + -10.63417911529541 + ] + ], + "logprob_of_token": -0.042583394795656204, + "top1_top2_margin": 3.643365692347288, + "top6_top7_margin": 1.8323078155517578 + }, + { + "gen_index": 14, + "token": 7252, + "top": [ + [ + 7252, + -0.006866671610623598 + ], + [ + 75361, + -6.012415885925293 + ], + [ + 54482, + -7.561313629150391 + ], + [ + 28872, + -7.75478458404541 + ], + [ + 13919, + -7.842663764953613 + ], + [ + 50394, + -8.225166320800781 + ], + [ + 9255, + -8.263500213623047 + ], + [ + 9593, + -8.588641166687012 + ], + [ + 14856, + -8.67926025390625 + ], + [ + 22130, + -8.742544174194336 + ], + [ + 6187, + -9.113930702209473 + ], + [ + 5240, + -9.151211738586426 + ], + [ + 2420, + -9.247490882873535 + ], + [ + 37112, + -9.263760566711426 + ], + [ + 14871, + -9.544819831848145 + ], + [ + 29250, + -9.58214282989502 + ], + [ + 8615, + -9.625541687011719 + ], + [ + 4338, + -9.65827465057373 + ], + [ + 3465, + -9.663084030151367 + ], + [ + 27992, + -9.770792961120605 + ] + ], + "logprob_of_token": -0.006866671610623598, + "top1_top2_margin": 6.005549214314669, + "top6_top7_margin": 0.038333892822265625 + }, + { + "gen_index": 15, + "token": 13919, + "top": [ + [ + 13919, + -0.0007248762995004654 + ], + [ + 9255, + -7.329220771789551 + ], + [ + 52684, + -10.437185287475586 + ], + [ + 35330, + -11.825777053833008 + ], + [ + 69505, + -12.2830228805542 + ], + [ + 75361, + -12.386321067810059 + ], + [ + 57501, + -12.565713882446289 + ], + [ + 9593, + -12.926801681518555 + ], + [ + 37112, + -13.060219764709473 + ], + [ + 16399, + -13.116168022155762 + ], + [ + 54901, + -13.24824333190918 + ], + [ + 21690, + -13.329605102539062 + ], + [ + 22130, + -13.491464614868164 + ], + [ + 7252, + -13.841872215270996 + ], + [ + 3336, + -14.375279426574707 + ], + [ + 2420, + -14.495254516601562 + ], + [ + 25001, + -14.7349214553833 + ], + [ + 125920, + -14.752440452575684 + ], + [ + 26114, + -14.781067848205566 + ], + [ + 36758, + -15.0309419631958 + ] + ], + "logprob_of_token": -0.0007248762995004654, + "top1_top2_margin": 7.32849589549005, + "top6_top7_margin": 0.17939281463623047 + }, + { + "gen_index": 16, + "token": 37112, + "top": [ + [ + 37112, + -3.552499765646644e-05 + ], + [ + 59342, + -11.944229125976562 + ], + [ + 22130, + -12.180272102355957 + ], + [ + 6187, + -12.448841094970703 + ], + [ + 63091, + -12.556209564208984 + ], + [ + 72805, + -13.010188102722168 + ], + [ + 55898, + -13.3974027633667 + ], + [ + 72755, + -13.470401763916016 + ], + [ + 50037, + -13.593391418457031 + ], + [ + 109249, + -13.852837562561035 + ], + [ + 18463, + -14.328534126281738 + ], + [ + 60878, + -14.385342597961426 + ], + [ + 13096, + -14.610279083251953 + ], + [ + 3095, + -14.624151229858398 + ], + [ + 41205, + -14.671671867370605 + ], + [ + 53035, + -14.727425575256348 + ], + [ + 39889, + -14.894585609436035 + ], + [ + 34919, + -14.956019401550293 + ], + [ + 36758, + -15.05150318145752 + ], + [ + 114051, + -15.240822792053223 + ] + ], + "logprob_of_token": -3.552499765646644e-05, + "top1_top2_margin": 11.944193600978906, + "top6_top7_margin": 0.38721466064453125 + }, + { + "gen_index": 17, + "token": 46, + "top": [ + [ + 46, + -0.4578782320022583 + ], + [ + 766, + -1.2505093812942505 + ], + [ + 275, + -3.272541046142578 + ], + [ + 44, + -3.779534339904785 + ], + [ + 314, + -4.436542510986328 + ], + [ + 834, + -5.09814453125 + ], + [ + 622, + -7.5079851150512695 + ], + [ + 393, + -8.369926452636719 + ], + [ + 279, + -8.952848434448242 + ], + [ + 286, + -9.026561737060547 + ], + [ + 63, + -9.372661590576172 + ], + [ + 28872, + -9.48654842376709 + ], + [ + 120007, + -9.514480590820312 + ], + [ + 59, + -9.586559295654297 + ], + [ + 2457, + -9.613092422485352 + ], + [ + 120399, + -9.824268341064453 + ], + [ + 7252, + -9.846927642822266 + ], + [ + 523, + -10.378948211669922 + ], + [ + 4610, + -10.463764190673828 + ], + [ + 120016, + -10.599902153015137 + ] + ], + "logprob_of_token": -0.4578782320022583, + "top1_top2_margin": 0.7926311492919922, + "top6_top7_margin": 2.4098405838012695 + }, + { + "gen_index": 18, + "token": 75361, + "top": [ + [ + 75361, + -0.3466915488243103 + ], + [ + 543, + -1.3495067358016968 + ], + [ + 7252, + -4.958312511444092 + ], + [ + 5240, + -5.498033046722412 + ], + [ + 1231, + -6.0922980308532715 + ], + [ + 3960, + -6.208564281463623 + ], + [ + 120014, + -6.67799186706543 + ], + [ + 1914, + -7.038036346435547 + ], + [ + 6693, + -7.836993217468262 + ], + [ + 28872, + -7.849117279052734 + ], + [ + 1336, + -8.022785186767578 + ], + [ + 717, + -8.216200828552246 + ], + [ + 11533, + -8.434381484985352 + ], + [ + 4759, + -8.46426010131836 + ], + [ + 20733, + -8.49134349822998 + ], + [ + 120004, + -8.519562721252441 + ], + [ + 106198, + -8.546357154846191 + ], + [ + 1194, + -8.549483299255371 + ], + [ + 1689, + -8.839832305908203 + ], + [ + 34122, + -8.885880470275879 + ] + ], + "logprob_of_token": -0.3466915488243103, + "top1_top2_margin": 1.0028151869773865, + "top6_top7_margin": 0.46942758560180664 + }, + { + "gen_index": 19, + "token": 735, + "top": [ + [ + 735, + -0.29877498745918274 + ], + [ + 378, + -1.4902442693710327 + ], + [ + 919, + -3.7214112281799316 + ], + [ + 589, + -6.318641185760498 + ], + [ + 4278, + -6.323583126068115 + ], + [ + 11201, + -6.607734203338623 + ], + [ + 44, + -7.468545436859131 + ], + [ + 52776, + -8.366944313049316 + ], + [ + 14439, + -8.392936706542969 + ], + [ + 14598, + -8.597990036010742 + ], + [ + 976, + -9.241469383239746 + ], + [ + 37296, + -9.473255157470703 + ], + [ + 11319, + -9.625911712646484 + ], + [ + 1958, + -9.668811798095703 + ], + [ + 476, + -9.738790512084961 + ], + [ + 21925, + -9.758089065551758 + ], + [ + 4617, + -9.815963745117188 + ], + [ + 286, + -9.946161270141602 + ], + [ + 830, + -10.003637313842773 + ], + [ + 10471, + -10.103026390075684 + ] + ], + "logprob_of_token": -0.29877498745918274, + "top1_top2_margin": 1.19146928191185, + "top6_top7_margin": 0.8608112335205078 + }, + { + "gen_index": 20, + "token": 262, + "top": [ + [ + 262, + -0.9547498226165771 + ], + [ + 941, + -1.0885417461395264 + ], + [ + 5407, + -1.9641474485397339 + ], + [ + 15132, + -3.104525327682495 + ], + [ + 502, + -3.8475844860076904 + ], + [ + 622, + -4.455236911773682 + ], + [ + 1410, + -5.002796649932861 + ], + [ + 13438, + -5.1584882736206055 + ], + [ + 7789, + -5.158669948577881 + ], + [ + 2602, + -5.188002109527588 + ], + [ + 2769, + -5.551923751831055 + ], + [ + 5240, + -5.6601152420043945 + ], + [ + 834, + -5.944709777832031 + ], + [ + 8255, + -5.960984230041504 + ], + [ + 923, + -5.981502056121826 + ], + [ + 1075, + -6.220769882202148 + ], + [ + 2457, + -6.302664279937744 + ], + [ + 10301, + -6.488159656524658 + ], + [ + 2403, + -6.517405986785889 + ], + [ + 23132, + -6.879813194274902 + ] + ], + "logprob_of_token": -0.9547498226165771, + "top1_top2_margin": 0.13379192352294922, + "top6_top7_margin": 0.5475597381591797 + }, + { + "gen_index": 21, + "token": 6980, + "top": [ + [ + 6980, + -0.40114426612854004 + ], + [ + 9255, + -1.7539217472076416 + ], + [ + 14390, + -2.490126848220825 + ], + [ + 11818, + -4.308434963226318 + ], + [ + 6662, + -5.011828422546387 + ], + [ + 1444, + -5.0568671226501465 + ], + [ + 2991, + -5.121824741363525 + ], + [ + 1840, + -5.463184833526611 + ], + [ + 5397, + -5.58010721206665 + ], + [ + 15967, + -5.644364833831787 + ], + [ + 2322, + -6.109399318695068 + ], + [ + 26458, + -6.281705379486084 + ], + [ + 9322, + -6.4337687492370605 + ], + [ + 29350, + -6.53461217880249 + ], + [ + 7771, + -6.561977386474609 + ], + [ + 7278, + -6.652181148529053 + ], + [ + 14232, + -6.806879043579102 + ], + [ + 7252, + -6.837554931640625 + ], + [ + 6547, + -7.0345683097839355 + ], + [ + 5763, + -7.152676105499268 + ] + ], + "logprob_of_token": -0.40114426612854004, + "top1_top2_margin": 1.3527774810791016, + "top6_top7_margin": 0.0649576187133789 + }, + { + "gen_index": 22, + "token": 6547, + "top": [ + [ + 6547, + -0.0020382897928357124 + ], + [ + 121222, + -6.805488109588623 + ], + [ + 9255, + -9.02052116394043 + ], + [ + 9598, + -9.210001945495605 + ], + [ + 14205, + -9.490389823913574 + ], + [ + 286, + -9.587820053100586 + ], + [ + 14346, + -9.92339038848877 + ], + [ + 7252, + -10.224732398986816 + ], + [ + 124214, + -10.347365379333496 + ], + [ + 14476, + -10.485526084899902 + ], + [ + 33029, + -10.596423149108887 + ], + [ + 1819, + -10.620929718017578 + ], + [ + 3395, + -11.408753395080566 + ], + [ + 13085, + -11.411175727844238 + ], + [ + 3547, + -11.44798755645752 + ], + [ + 9431, + -11.459295272827148 + ], + [ + 75361, + -11.501537322998047 + ], + [ + 2322, + -11.521958351135254 + ], + [ + 622, + -11.526700019836426 + ], + [ + 5216, + -11.742209434509277 + ] + ], + "logprob_of_token": -0.0020382897928357124, + "top1_top2_margin": 6.803449819795787, + "top6_top7_margin": 0.3355703353881836 + }, + { + "gen_index": 23, + "token": 622, + "top": [ + [ + 622, + -0.0018436608370393515 + ], + [ + 2457, + -6.848751544952393 + ], + [ + 279, + -8.151519775390625 + ], + [ + 286, + -8.772668838500977 + ], + [ + 2288, + -9.51627254486084 + ], + [ + 6791, + -10.388354301452637 + ], + [ + 834, + -10.478022575378418 + ], + [ + 7789, + -10.509111404418945 + ], + [ + 120007, + -10.812928199768066 + ], + [ + 327, + -10.82366943359375 + ], + [ + 63, + -11.269539833068848 + ], + [ + 502, + -11.274502754211426 + ], + [ + 766, + -11.923263549804688 + ], + [ + 44, + -11.92904281616211 + ], + [ + 47, + -12.047694206237793 + ], + [ + 735, + -12.396550178527832 + ], + [ + 467, + -12.441579818725586 + ], + [ + 10406, + -12.468550682067871 + ], + [ + 46, + -12.57616138458252 + ], + [ + 4518, + -12.617753028869629 + ] + ], + "logprob_of_token": -0.0018436608370393515, + "top1_top2_margin": 6.846907884115353, + "top6_top7_margin": 0.08966827392578125 + }, + { + "gen_index": 24, + "token": 262, + "top": [ + [ + 262, + -0.022225573658943176 + ], + [ + 5240, + -3.8933403491973877 + ], + [ + 28872, + -7.57034158706665 + ], + [ + 7252, + -8.285253524780273 + ], + [ + 67370, + -8.741758346557617 + ], + [ + 327, + -8.784975051879883 + ], + [ + 75361, + -8.982397079467773 + ], + [ + 565, + -10.203640937805176 + ], + [ + 938, + -10.93323040008545 + ], + [ + 37270, + -10.977958679199219 + ], + [ + 22130, + -11.122635841369629 + ], + [ + 3327, + -11.14710521697998 + ], + [ + 1283, + -11.191372871398926 + ], + [ + 16424, + -11.302251815795898 + ], + [ + 18462, + -11.585055351257324 + ], + [ + 3465, + -11.747407913208008 + ], + [ + 41875, + -11.779446601867676 + ], + [ + 8615, + -11.811376571655273 + ], + [ + 523, + -11.937344551086426 + ], + [ + 6131, + -11.960841178894043 + ] + ], + "logprob_of_token": -0.022225573658943176, + "top1_top2_margin": 3.8711147755384445, + "top6_top7_margin": 0.19742202758789062 + }, + { + "gen_index": 25, + "token": 7252, + "top": [ + [ + 7252, + -0.17464524507522583 + ], + [ + 28872, + -1.8945034742355347 + ], + [ + 22130, + -5.632017135620117 + ], + [ + 523, + -7.053643226623535 + ], + [ + 37112, + -7.596902370452881 + ], + [ + 5240, + -7.781632423400879 + ], + [ + 25997, + -8.20324420928955 + ], + [ + 36758, + -8.206414222717285 + ], + [ + 8615, + -8.574902534484863 + ], + [ + 22225, + -8.72623062133789 + ], + [ + 2107, + -8.791642189025879 + ], + [ + 75361, + -8.84975528717041 + ], + [ + 8382, + -8.859328269958496 + ], + [ + 1920, + -8.997357368469238 + ], + [ + 10829, + -9.267361640930176 + ], + [ + 13919, + -9.335816383361816 + ], + [ + 9255, + -9.343954086303711 + ], + [ + 50394, + -9.491920471191406 + ], + [ + 8207, + -9.666449546813965 + ], + [ + 2420, + -9.797833442687988 + ] + ], + "logprob_of_token": -0.17464524507522583, + "top1_top2_margin": 1.7198582291603088, + "top6_top7_margin": 0.4216117858886719 + }, + { + "gen_index": 26, + "token": 13919, + "top": [ + [ + 13919, + -0.00033324549440294504 + ], + [ + 9255, + -8.487837791442871 + ], + [ + 28872, + -10.431679725646973 + ], + [ + 35330, + -10.688709259033203 + ], + [ + 52684, + -10.94007682800293 + ], + [ + 57501, + -11.796037673950195 + ], + [ + 2807, + -12.062217712402344 + ], + [ + 9728, + -12.06732177734375 + ], + [ + 16399, + -12.378829002380371 + ], + [ + 37112, + -12.404190063476562 + ], + [ + 7252, + -13.483197212219238 + ], + [ + 10259, + -13.640233039855957 + ], + [ + 32019, + -13.668375015258789 + ], + [ + 5002, + -13.791821479797363 + ], + [ + 89128, + -13.832507133483887 + ], + [ + 22130, + -13.840764999389648 + ], + [ + 25997, + -13.91672420501709 + ], + [ + 21690, + -13.94998550415039 + ], + [ + 41669, + -13.990060806274414 + ], + [ + 12924, + -14.002028465270996 + ] + ], + "logprob_of_token": -0.00033324549440294504, + "top1_top2_margin": 8.487504545948468, + "top6_top7_margin": 0.26618003845214844 + }, + { + "gen_index": 27, + "token": 37112, + "top": [ + [ + 37112, + -1.0490472959645558e-05 + ], + [ + 72805, + -12.364424705505371 + ], + [ + 22130, + -12.95709228515625 + ], + [ + 109249, + -13.589842796325684 + ], + [ + 72755, + -13.695286750793457 + ], + [ + 59342, + -14.182229042053223 + ], + [ + 11408, + -15.423121452331543 + ], + [ + 54413, + -15.686444282531738 + ], + [ + 53035, + -15.92673397064209 + ], + [ + 23787, + -16.027366638183594 + ], + [ + 34919, + -16.403165817260742 + ], + [ + 13205, + -16.6356201171875 + ], + [ + 27460, + -16.80959129333496 + ], + [ + 50037, + -16.942405700683594 + ], + [ + 17667, + -16.963340759277344 + ], + [ + 6187, + -16.98472785949707 + ], + [ + 63091, + -17.108348846435547 + ], + [ + 55898, + -17.4394588470459 + ], + [ + 43035, + -17.508115768432617 + ], + [ + 97600, + -17.576589584350586 + ] + ], + "logprob_of_token": -1.0490472959645558e-05, + "top1_top2_margin": 12.364414215032411, + "top6_top7_margin": 1.2408924102783203 + }, + { + "gen_index": 28, + "token": 46, + "top": [ + [ + 46, + -0.0816025510430336 + ], + [ + 275, + -3.453705310821533 + ], + [ + 63, + -3.670729160308838 + ], + [ + 314, + -4.306522846221924 + ], + [ + 766, + -6.151284694671631 + ], + [ + 286, + -6.579003810882568 + ], + [ + 44, + -6.615978717803955 + ], + [ + 120007, + -6.905117511749268 + ], + [ + 936, + -7.854689121246338 + ], + [ + 1043, + -8.180563926696777 + ], + [ + 460, + -8.779487609863281 + ], + [ + 467, + -9.24968147277832 + ], + [ + 120016, + -9.459972381591797 + ], + [ + 59, + -9.563373565673828 + ], + [ + 523, + -9.724596977233887 + ], + [ + 120399, + -9.818768501281738 + ], + [ + 120022, + -10.11500072479248 + ], + [ + 622, + -10.501542091369629 + ], + [ + 120021, + -10.718145370483398 + ], + [ + 28872, + -10.920902252197266 + ] + ], + "logprob_of_token": -0.0816025510430336, + "top1_top2_margin": 3.3721027597784996, + "top6_top7_margin": 0.03697490692138672 + }, + { + "gen_index": 29, + "token": 75361, + "top": [ + [ + 75361, + -0.029763152822852135 + ], + [ + 543, + -4.357460021972656 + ], + [ + 3960, + -5.947847366333008 + ], + [ + 120014, + -6.920628547668457 + ], + [ + 14896, + -6.961575508117676 + ], + [ + 1231, + -7.3784918785095215 + ], + [ + 1689, + -7.50943660736084 + ], + [ + 1905, + -7.519084930419922 + ], + [ + 20733, + -7.592504978179932 + ], + [ + 6693, + -7.8822922706604 + ], + [ + 1914, + -7.984736919403076 + ], + [ + 717, + -8.11398983001709 + ], + [ + 669, + -8.371796607971191 + ], + [ + 76115, + -8.526884078979492 + ], + [ + 5240, + -8.708361625671387 + ], + [ + 5775, + -8.718222618103027 + ], + [ + 8067, + -8.751725196838379 + ], + [ + 63585, + -8.845008850097656 + ], + [ + 34122, + -8.884692192077637 + ], + [ + 58209, + -8.935507774353027 + ] + ], + "logprob_of_token": -0.029763152822852135, + "top1_top2_margin": 4.327696869149804, + "top6_top7_margin": 0.13094472885131836 + }, + { + "gen_index": 30, + "token": 735, + "top": [ + [ + 735, + -0.13182379305362701 + ], + [ + 378, + -2.781446695327759 + ], + [ + 919, + -2.859720468521118 + ], + [ + 589, + -6.317060947418213 + ], + [ + 4278, + -7.535382270812988 + ], + [ + 11201, + -7.761831283569336 + ], + [ + 976, + -8.755522727966309 + ], + [ + 44, + -9.408082008361816 + ], + [ + 1819, + -9.442410469055176 + ], + [ + 37296, + -9.82410717010498 + ], + [ + 14598, + -9.899423599243164 + ], + [ + 11319, + -10.13047981262207 + ], + [ + 476, + -10.373623847961426 + ], + [ + 52776, + -10.447006225585938 + ], + [ + 1270, + -10.497049331665039 + ], + [ + 286, + -10.504647254943848 + ], + [ + 10471, + -10.506537437438965 + ], + [ + 14380, + -10.758273124694824 + ], + [ + 617, + -10.869611740112305 + ], + [ + 120007, + -10.908313751220703 + ] + ], + "logprob_of_token": -0.13182379305362701, + "top1_top2_margin": 2.6496229022741318, + "top6_top7_margin": 0.9936914443969727 + }, + { + "gen_index": 31, + "token": 262, + "top": [ + [ + 262, + -0.6133660078048706 + ], + [ + 5407, + -1.952383041381836 + ], + [ + 941, + -1.9628639221191406 + ], + [ + 1410, + -3.168060302734375 + ], + [ + 1075, + -3.461732864379883 + ], + [ + 502, + -3.7442941665649414 + ], + [ + 15132, + -3.7671871185302734 + ], + [ + 7789, + -4.047459602355957 + ], + [ + 923, + -4.674698829650879 + ], + [ + 8255, + -4.7004899978637695 + ], + [ + 2602, + -6.04345703125 + ], + [ + 10301, + -6.075115203857422 + ], + [ + 622, + -6.186918258666992 + ], + [ + 2769, + -6.660128593444824 + ], + [ + 23132, + -6.885526657104492 + ], + [ + 2403, + -7.091333389282227 + ], + [ + 13438, + -7.154691696166992 + ], + [ + 5240, + -7.560610294342041 + ], + [ + 3145, + -7.5826520919799805 + ], + [ + 6846, + -8.211400985717773 + ] + ], + "logprob_of_token": -0.6133660078048706, + "top1_top2_margin": 1.3390170335769653, + "top6_top7_margin": 0.02289295196533203 + } + ] + }, + { + "prompt": "Wissen ist Macht, aber Zeit ist Geld", + "input_ids": [ + 81623, + 2459, + 18680, + 44, + 3504, + 2042, + 2459, + 4771 + ], + "generated_ids": [ + 44, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936, + 936 + ], + "rows": [ + { + "gen_index": 0, + "token": 44, + "top": [ + [ + 44, + -0.5864138603210449 + ], + [ + 46, + -1.2763152122497559 + ], + [ + 275, + -1.9928555488586426 + ], + [ + 936, + -4.479682445526123 + ], + [ + 4137, + -5.478795051574707 + ], + [ + 314, + -6.3693156242370605 + ], + [ + 286, + -6.39406156539917 + ], + [ + 420, + -7.234477519989014 + ], + [ + 36209, + -7.333564758300781 + ], + [ + 63, + -7.415323257446289 + ], + [ + 120007, + -7.447092056274414 + ], + [ + 59, + -7.473825454711914 + ], + [ + 779, + -7.500814914703369 + ], + [ + 26951, + -7.632636070251465 + ], + [ + 1409, + -8.141968727111816 + ], + [ + 7510, + -8.394606590270996 + ], + [ + 33, + -8.497267723083496 + ], + [ + 120347, + -8.520108222961426 + ], + [ + 120016, + -8.687085151672363 + ], + [ + 263, + -8.87364387512207 + ] + ], + "logprob_of_token": -0.5864138603210449, + "top1_top2_margin": 0.6899013519287109, + "top6_top7_margin": 0.024745941162109375 + }, + { + "gen_index": 1, + "token": 936, + "top": [ + [ + 936, + -0.6752276420593262 + ], + [ + 286, + -1.9825061559677124 + ], + [ + 3504, + -2.387683391571045 + ], + [ + 1409, + -3.132294178009033 + ], + [ + 1410, + -4.23239803314209 + ], + [ + 779, + -5.138435363769531 + ], + [ + 420, + -5.21622371673584 + ], + [ + 11158, + -5.309032917022705 + ], + [ + 1584, + -5.491316795349121 + ], + [ + 7510, + -5.770754814147949 + ], + [ + 6220, + -5.9386067390441895 + ], + [ + 32, + -6.422061920166016 + ], + [ + 14276, + -6.45412015914917 + ], + [ + 7060, + -6.580655574798584 + ], + [ + 17117, + -6.597081661224365 + ], + [ + 20277, + -6.691457271575928 + ], + [ + 7162, + -6.835180282592773 + ], + [ + 425, + -6.906015872955322 + ], + [ + 6835, + -6.950845241546631 + ], + [ + 4619, + -7.002239227294922 + ] + ], + "logprob_of_token": -0.6752276420593262, + "top1_top2_margin": 1.3072785139083862, + "top6_top7_margin": 0.0777883529663086 + }, + { + "gen_index": 2, + "token": 936, + "top": [ + [ + 936, + -1.095323085784912 + ], + [ + 1584, + -1.5568920373916626 + ], + [ + 2973, + -1.6137871742248535 + ], + [ + 527, + -2.8096728324890137 + ], + [ + 453, + -3.3211607933044434 + ], + [ + 3117, + -3.4675793647766113 + ], + [ + 622, + -3.630558490753174 + ], + [ + 3737, + -5.048856258392334 + ], + [ + 262, + -5.196465015411377 + ], + [ + 1333, + -5.282817363739014 + ], + [ + 502, + -5.745064735412598 + ], + [ + 669, + -5.75016975402832 + ], + [ + 1324, + -5.809076309204102 + ], + [ + 2468, + -5.809351444244385 + ], + [ + 900, + -5.85171365737915 + ], + [ + 1744, + -5.901957988739014 + ], + [ + 3326, + -5.964758396148682 + ], + [ + 938, + -6.016071319580078 + ], + [ + 1806, + -6.340348720550537 + ], + [ + 1840, + -6.359192848205566 + ] + ], + "logprob_of_token": -1.095323085784912, + "top1_top2_margin": 0.4615689516067505, + "top6_top7_margin": 0.1629791259765625 + }, + { + "gen_index": 3, + "token": 936, + "top": [ + [ + 936, + -0.2871510982513428 + ], + [ + 46, + -2.328625440597534 + ], + [ + 275, + -2.5495946407318115 + ], + [ + 44, + -4.382570743560791 + ], + [ + 120007, + -4.756467819213867 + ], + [ + 314, + -5.319439888000488 + ], + [ + 7510, + -5.697136402130127 + ], + [ + 262, + -5.940833568572998 + ], + [ + 120016, + -6.101202011108398 + ], + [ + 286, + -6.127996444702148 + ], + [ + 263, + -6.14714241027832 + ], + [ + 1333, + -6.157982349395752 + ], + [ + 120022, + -6.584986686706543 + ], + [ + 120001, + -6.791909217834473 + ], + [ + 1584, + -7.079071521759033 + ], + [ + 8545, + -7.274995803833008 + ], + [ + 3368, + -7.347077369689941 + ], + [ + 565, + -7.472953796386719 + ], + [ + 527, + -7.4847412109375 + ], + [ + 502, + -7.498330593109131 + ] + ], + "logprob_of_token": -0.2871510982513428, + "top1_top2_margin": 2.0414743423461914, + "top6_top7_margin": 0.37769651412963867 + }, + { + "gen_index": 4, + "token": 936, + "top": [ + [ + 936, + -0.9007425308227539 + ], + [ + 275, + -1.3166475296020508 + ], + [ + 46, + -1.7679939270019531 + ], + [ + 314, + -3.5679702758789062 + ], + [ + 263, + -4.076152324676514 + ], + [ + 120007, + -4.181999206542969 + ], + [ + 120016, + -4.34312105178833 + ], + [ + 7510, + -4.913559436798096 + ], + [ + 120001, + -5.095006942749023 + ], + [ + 120022, + -5.314023971557617 + ], + [ + 120173, + -5.350800037384033 + ], + [ + 44, + -5.563052654266357 + ], + [ + 33, + -5.937763690948486 + ], + [ + 2519, + -5.951216220855713 + ], + [ + 10, + -6.169953346252441 + ], + [ + 4137, + -6.32803201675415 + ], + [ + 120101, + -6.3564839363098145 + ], + [ + 120014, + -6.421239376068115 + ], + [ + 120021, + -6.481911659240723 + ], + [ + 120103, + -6.567079067230225 + ] + ], + "logprob_of_token": -0.9007425308227539, + "top1_top2_margin": 0.4159049987792969, + "top6_top7_margin": 0.16112184524536133 + }, + { + "gen_index": 5, + "token": 936, + "top": [ + [ + 936, + -0.10985761135816574 + ], + [ + 46, + -3.467618942260742 + ], + [ + 275, + -3.5815181732177734 + ], + [ + 314, + -5.508742809295654 + ], + [ + 263, + -5.755917549133301 + ], + [ + 7510, + -5.998274803161621 + ], + [ + 262, + -6.085916519165039 + ], + [ + 286, + -6.297700881958008 + ], + [ + 120007, + -6.646982192993164 + ], + [ + 120022, + -6.719270706176758 + ], + [ + 120001, + -6.833736419677734 + ], + [ + 44, + -6.9947943687438965 + ], + [ + 33, + -7.017793655395508 + ], + [ + 1409, + -7.051043510437012 + ], + [ + 1333, + -7.166097164154053 + ], + [ + 502, + -7.227151393890381 + ], + [ + 120173, + -7.332639694213867 + ], + [ + 10, + -7.37050199508667 + ], + [ + 120016, + -7.4084625244140625 + ], + [ + 2519, + -7.591153144836426 + ] + ], + "logprob_of_token": -0.10985761135816574, + "top1_top2_margin": 3.3577613309025764, + "top6_top7_margin": 0.08764171600341797 + }, + { + "gen_index": 6, + "token": 936, + "top": [ + [ + 936, + -0.07951587438583374 + ], + [ + 275, + -3.8410942554473877 + ], + [ + 46, + -4.007779598236084 + ], + [ + 7510, + -5.559261798858643 + ], + [ + 314, + -5.705582141876221 + ], + [ + 263, + -5.803535461425781 + ], + [ + 286, + -6.490405559539795 + ], + [ + 33, + -6.860054969787598 + ], + [ + 120007, + -6.878075122833252 + ], + [ + 120022, + -6.953906059265137 + ], + [ + 262, + -6.992856025695801 + ], + [ + 120001, + -7.01645040512085 + ], + [ + 44, + -7.071986675262451 + ], + [ + 10, + -7.231271266937256 + ], + [ + 120173, + -7.4846649169921875 + ], + [ + 1409, + -7.53219747543335 + ], + [ + 502, + -7.642772674560547 + ], + [ + 120008, + -7.66077184677124 + ], + [ + 120016, + -7.678470611572266 + ], + [ + 2519, + -7.713591575622559 + ] + ], + "logprob_of_token": -0.07951587438583374, + "top1_top2_margin": 3.761578381061554, + "top6_top7_margin": 0.6868700981140137 + }, + { + "gen_index": 7, + "token": 936, + "top": [ + [ + 936, + -0.02589522860944271 + ], + [ + 46, + -5.588042736053467 + ], + [ + 275, + -5.76354455947876 + ], + [ + 7510, + -6.757726192474365 + ], + [ + 263, + -6.861560821533203 + ], + [ + 286, + -6.995097637176514 + ], + [ + 262, + -7.0868682861328125 + ], + [ + 314, + -7.38701057434082 + ], + [ + 120001, + -7.619866847991943 + ], + [ + 120022, + -7.645834922790527 + ], + [ + 1333, + -7.740658760070801 + ], + [ + 467, + -7.760801792144775 + ], + [ + 120007, + -7.801327228546143 + ], + [ + 10, + -8.010735511779785 + ], + [ + 739, + -8.023405075073242 + ], + [ + 44, + -8.034372329711914 + ], + [ + 1409, + -8.061450004577637 + ], + [ + 1064, + -8.243109703063965 + ], + [ + 766, + -8.296896934509277 + ], + [ + 120008, + -8.39955997467041 + ] + ], + "logprob_of_token": -0.02589522860944271, + "top1_top2_margin": 5.562147507444024, + "top6_top7_margin": 0.09177064895629883 + }, + { + "gen_index": 8, + "token": 936, + "top": [ + [ + 936, + -0.034078869968652725 + ], + [ + 46, + -5.224981784820557 + ], + [ + 275, + -5.417816638946533 + ], + [ + 7510, + -5.996940612792969 + ], + [ + 286, + -6.562746524810791 + ], + [ + 263, + -6.7315826416015625 + ], + [ + 314, + -7.027005195617676 + ], + [ + 120001, + -7.129934310913086 + ], + [ + 120022, + -7.1518940925598145 + ], + [ + 262, + -7.372371196746826 + ], + [ + 467, + -7.54612922668457 + ], + [ + 120007, + -7.5574140548706055 + ], + [ + 44, + -7.745964527130127 + ], + [ + 33, + -7.795023441314697 + ], + [ + 120008, + -7.882277011871338 + ], + [ + 10, + -7.903556823730469 + ], + [ + 766, + -8.022210121154785 + ], + [ + 59, + -8.178096771240234 + ], + [ + 1064, + -8.252372741699219 + ], + [ + 1409, + -8.27931022644043 + ] + ], + "logprob_of_token": -0.034078869968652725, + "top1_top2_margin": 5.190902914851904, + "top6_top7_margin": 0.2954225540161133 + }, + { + "gen_index": 9, + "token": 936, + "top": [ + [ + 936, + -0.06141877546906471 + ], + [ + 275, + -4.407088279724121 + ], + [ + 46, + -4.67940092086792 + ], + [ + 7510, + -5.200109004974365 + ], + [ + 263, + -5.673858165740967 + ], + [ + 120001, + -6.151261329650879 + ], + [ + 314, + -6.160203456878662 + ], + [ + 286, + -6.746254920959473 + ], + [ + 120022, + -6.868318557739258 + ], + [ + 120173, + -6.999378681182861 + ], + [ + 262, + -7.158254623413086 + ], + [ + 33, + -7.280500411987305 + ], + [ + 120007, + -7.31123161315918 + ], + [ + 10, + -7.367339611053467 + ], + [ + 120008, + -7.384459018707275 + ], + [ + 766, + -7.517798900604248 + ], + [ + 467, + -7.651207447052002 + ], + [ + 1064, + -7.828742027282715 + ], + [ + 120042, + -7.8474860191345215 + ], + [ + 44, + -7.87034797668457 + ] + ], + "logprob_of_token": -0.06141877546906471, + "top1_top2_margin": 4.345669504255056, + "top6_top7_margin": 0.008942127227783203 + }, + { + "gen_index": 10, + "token": 936, + "top": [ + [ + 936, + -0.11444937437772751 + ], + [ + 275, + -3.441852331161499 + ], + [ + 46, + -3.958047866821289 + ], + [ + 7510, + -5.0078253746032715 + ], + [ + 263, + -5.050947666168213 + ], + [ + 314, + -5.341536045074463 + ], + [ + 120001, + -5.591095924377441 + ], + [ + 120173, + -5.930877208709717 + ], + [ + 286, + -6.624141693115234 + ], + [ + 10, + -6.689393043518066 + ], + [ + 120008, + -6.825714111328125 + ], + [ + 120022, + -6.846815586090088 + ], + [ + 59, + -6.916263580322266 + ], + [ + 262, + -6.922634601593018 + ], + [ + 120042, + -7.199606895446777 + ], + [ + 120007, + -7.409163475036621 + ], + [ + 766, + -7.413378715515137 + ], + [ + 1064, + -7.463871955871582 + ], + [ + 33, + -7.57526159286499 + ], + [ + 44, + -7.60337495803833 + ] + ], + "logprob_of_token": -0.11444937437772751, + "top1_top2_margin": 3.3274029567837715, + "top6_top7_margin": 0.24955987930297852 + }, + { + "gen_index": 11, + "token": 936, + "top": [ + [ + 936, + -0.09050367027521133 + ], + [ + 275, + -3.6952152252197266 + ], + [ + 46, + -4.113327980041504 + ], + [ + 263, + -5.177497863769531 + ], + [ + 7510, + -5.342116355895996 + ], + [ + 314, + -5.96807336807251 + ], + [ + 120001, + -6.465950965881348 + ], + [ + 120173, + -6.677576541900635 + ], + [ + 286, + -6.7576727867126465 + ], + [ + 262, + -6.7749176025390625 + ], + [ + 120022, + -6.920558452606201 + ], + [ + 10, + -6.934101104736328 + ], + [ + 1333, + -7.240618705749512 + ], + [ + 502, + -7.274309158325195 + ], + [ + 59, + -7.282552242279053 + ], + [ + 766, + -7.323361396789551 + ], + [ + 14147, + -7.3749799728393555 + ], + [ + 120042, + -7.404440402984619 + ], + [ + 1064, + -7.478837966918945 + ], + [ + 120008, + -7.544486999511719 + ] + ], + "logprob_of_token": -0.09050367027521133, + "top1_top2_margin": 3.6047115549445152, + "top6_top7_margin": 0.4978775978088379 + }, + { + "gen_index": 12, + "token": 936, + "top": [ + [ + 936, + -0.05912039801478386 + ], + [ + 46, + -4.602655410766602 + ], + [ + 275, + -4.771354675292969 + ], + [ + 7510, + -5.5171403884887695 + ], + [ + 263, + -6.0201239585876465 + ], + [ + 120022, + -6.379246711730957 + ], + [ + 120007, + -6.617691516876221 + ], + [ + 946, + -6.715256214141846 + ], + [ + 262, + -6.766047954559326 + ], + [ + 286, + -6.816465377807617 + ], + [ + 314, + -6.818191051483154 + ], + [ + 120001, + -6.955338001251221 + ], + [ + 502, + -6.993017673492432 + ], + [ + 1333, + -7.079870223999023 + ], + [ + 59, + -7.147932529449463 + ], + [ + 10, + -7.2239227294921875 + ], + [ + 766, + -7.242626190185547 + ], + [ + 1064, + -7.380153656005859 + ], + [ + 565, + -7.737245082855225 + ], + [ + 120016, + -7.766156196594238 + ] + ], + "logprob_of_token": -0.05912039801478386, + "top1_top2_margin": 4.543535012751818, + "top6_top7_margin": 0.23844480514526367 + }, + { + "gen_index": 13, + "token": 936, + "top": [ + [ + 936, + -0.025247300043702126 + ], + [ + 46, + -5.541228771209717 + ], + [ + 275, + -6.10507345199585 + ], + [ + 7510, + -6.306384563446045 + ], + [ + 286, + -6.893215179443359 + ], + [ + 263, + -6.904724597930908 + ], + [ + 120022, + -6.911866664886475 + ], + [ + 314, + -7.551098346710205 + ], + [ + 1064, + -7.598026275634766 + ], + [ + 59, + -7.623018741607666 + ], + [ + 120001, + -7.665921211242676 + ], + [ + 502, + -7.705357074737549 + ], + [ + 120007, + -7.719053268432617 + ], + [ + 262, + -7.7675580978393555 + ], + [ + 10, + -7.846878528594971 + ], + [ + 120042, + -8.068191528320312 + ], + [ + 120008, + -8.119913101196289 + ], + [ + 766, + -8.135247230529785 + ], + [ + 467, + -8.145453453063965 + ], + [ + 44, + -8.327774047851562 + ] + ], + "logprob_of_token": -0.025247300043702126, + "top1_top2_margin": 5.515981471166015, + "top6_top7_margin": 0.007142066955566406 + }, + { + "gen_index": 14, + "token": 936, + "top": [ + [ + 936, + -0.02424553595483303 + ], + [ + 46, + -5.50720739364624 + ], + [ + 275, + -6.22197961807251 + ], + [ + 7510, + -6.386630058288574 + ], + [ + 286, + -6.686795711517334 + ], + [ + 120022, + -6.708873748779297 + ], + [ + 263, + -7.125016212463379 + ], + [ + 262, + -7.576517105102539 + ], + [ + 314, + -7.581449508666992 + ], + [ + 120007, + -7.582287311553955 + ], + [ + 1064, + -7.587199687957764 + ], + [ + 120001, + -7.715988636016846 + ], + [ + 59, + -7.868934154510498 + ], + [ + 10, + -7.914186954498291 + ], + [ + 766, + -7.985986232757568 + ], + [ + 467, + -8.032771110534668 + ], + [ + 120042, + -8.157898902893066 + ], + [ + 120008, + -8.17520523071289 + ], + [ + 1333, + -8.305800437927246 + ], + [ + 502, + -8.317927360534668 + ] + ], + "logprob_of_token": -0.02424553595483303, + "top1_top2_margin": 5.482961857691407, + "top6_top7_margin": 0.41614246368408203 + }, + { + "gen_index": 15, + "token": 936, + "top": [ + [ + 936, + -0.031613100320100784 + ], + [ + 46, + -5.1109232902526855 + ], + [ + 275, + -5.874633312225342 + ], + [ + 7510, + -6.320451259613037 + ], + [ + 120022, + -6.645010471343994 + ], + [ + 263, + -6.717396259307861 + ], + [ + 286, + -6.871072769165039 + ], + [ + 314, + -7.118617057800293 + ], + [ + 1064, + -7.300698280334473 + ], + [ + 120007, + -7.398795127868652 + ], + [ + 262, + -7.426712512969971 + ], + [ + 120001, + -7.46112060546875 + ], + [ + 10, + -7.478255748748779 + ], + [ + 59, + -7.606895923614502 + ], + [ + 946, + -7.66828727722168 + ], + [ + 467, + -7.82867431640625 + ], + [ + 120042, + -7.881129264831543 + ], + [ + 34, + -8.045403480529785 + ], + [ + 502, + -8.079257011413574 + ], + [ + 766, + -8.122947692871094 + ] + ], + "logprob_of_token": -0.031613100320100784, + "top1_top2_margin": 5.079310189932585, + "top6_top7_margin": 0.15367650985717773 + }, + { + "gen_index": 16, + "token": 936, + "top": [ + [ + 936, + -0.05650375410914421 + ], + [ + 46, + -4.4900288581848145 + ], + [ + 275, + -5.021629333496094 + ], + [ + 7510, + -5.552892208099365 + ], + [ + 263, + -5.828291893005371 + ], + [ + 120022, + -6.2401580810546875 + ], + [ + 314, + -6.394809246063232 + ], + [ + 120001, + -6.790593147277832 + ], + [ + 286, + -6.799469470977783 + ], + [ + 59, + -6.81661319732666 + ], + [ + 120007, + -7.056816577911377 + ], + [ + 10, + -7.071378707885742 + ], + [ + 33, + -7.204315185546875 + ], + [ + 120042, + -7.275147438049316 + ], + [ + 34, + -7.4280853271484375 + ], + [ + 1064, + -7.432802200317383 + ], + [ + 262, + -7.5252556800842285 + ], + [ + 946, + -7.605254173278809 + ], + [ + 120008, + -7.727771282196045 + ], + [ + 502, + -7.771731853485107 + ] + ], + "logprob_of_token": -0.05650375410914421, + "top1_top2_margin": 4.43352510407567, + "top6_top7_margin": 0.15465116500854492 + }, + { + "gen_index": 17, + "token": 936, + "top": [ + [ + 936, + -0.04679463058710098 + ], + [ + 46, + -4.678595066070557 + ], + [ + 275, + -5.048404693603516 + ], + [ + 7510, + -5.649739742279053 + ], + [ + 263, + -5.749336242675781 + ], + [ + 314, + -6.750612735748291 + ], + [ + 286, + -6.939876079559326 + ], + [ + 120022, + -6.95347785949707 + ], + [ + 59, + -7.072610378265381 + ], + [ + 10, + -7.158407211303711 + ], + [ + 262, + -7.158436298370361 + ], + [ + 120001, + -7.162600994110107 + ], + [ + 1064, + -7.285435199737549 + ], + [ + 120042, + -7.373821258544922 + ], + [ + 14147, + -7.54783296585083 + ], + [ + 502, + -7.596141338348389 + ], + [ + 120007, + -7.750170707702637 + ], + [ + 120008, + -7.927364826202393 + ], + [ + 467, + -7.967276096343994 + ], + [ + 120173, + -8.075349807739258 + ] + ], + "logprob_of_token": -0.04679463058710098, + "top1_top2_margin": 4.631800435483456, + "top6_top7_margin": 0.18926334381103516 + }, + { + "gen_index": 18, + "token": 936, + "top": [ + [ + 936, + -0.03692947328090668 + ], + [ + 46, + -4.943675518035889 + ], + [ + 275, + -5.526597499847412 + ], + [ + 263, + -6.23771333694458 + ], + [ + 7510, + -6.412832260131836 + ], + [ + 314, + -6.953926086425781 + ], + [ + 286, + -6.9561285972595215 + ], + [ + 120022, + -7.012279510498047 + ], + [ + 10, + -7.111901760101318 + ], + [ + 502, + -7.186953067779541 + ], + [ + 1064, + -7.189024925231934 + ], + [ + 59, + -7.248406887054443 + ], + [ + 262, + -7.279641151428223 + ], + [ + 120001, + -7.3331990242004395 + ], + [ + 120042, + -7.749464988708496 + ], + [ + 120007, + -7.805822849273682 + ], + [ + 467, + -7.838030815124512 + ], + [ + 120008, + -7.9958086013793945 + ], + [ + 766, + -8.12181568145752 + ], + [ + 1333, + -8.141499519348145 + ] + ], + "logprob_of_token": -0.03692947328090668, + "top1_top2_margin": 4.906746044754982, + "top6_top7_margin": 0.0022025108337402344 + }, + { + "gen_index": 19, + "token": 936, + "top": [ + [ + 936, + -0.024398399516940117 + ], + [ + 46, + -5.657924175262451 + ], + [ + 275, + -6.462453842163086 + ], + [ + 120022, + -6.463630199432373 + ], + [ + 7510, + -6.562971115112305 + ], + [ + 263, + -7.010315418243408 + ], + [ + 59, + -7.307928562164307 + ], + [ + 120007, + -7.370889186859131 + ], + [ + 502, + -7.431554794311523 + ], + [ + 286, + -7.525426387786865 + ], + [ + 1064, + -7.560081481933594 + ], + [ + 262, + -7.592638969421387 + ], + [ + 120001, + -7.627814769744873 + ], + [ + 314, + -7.777886867523193 + ], + [ + 10, + -7.814438819885254 + ], + [ + 766, + -7.948349475860596 + ], + [ + 120042, + -8.136503219604492 + ], + [ + 120008, + -8.221429824829102 + ], + [ + 467, + -8.313568115234375 + ], + [ + 946, + -8.495445251464844 + ] + ], + "logprob_of_token": -0.024398399516940117, + "top1_top2_margin": 5.633525775745511, + "top6_top7_margin": 0.29761314392089844 + }, + { + "gen_index": 20, + "token": 936, + "top": [ + [ + 936, + -0.019298505038022995 + ], + [ + 46, + -5.948375701904297 + ], + [ + 120022, + -6.533189296722412 + ], + [ + 275, + -6.644291400909424 + ], + [ + 7510, + -6.723109245300293 + ], + [ + 263, + -7.065649032592773 + ], + [ + 120007, + -7.2425537109375 + ], + [ + 286, + -7.563403606414795 + ], + [ + 262, + -7.729203224182129 + ], + [ + 120001, + -7.822049617767334 + ], + [ + 1064, + -7.828949451446533 + ], + [ + 59, + -7.841185092926025 + ], + [ + 314, + -7.972577095031738 + ], + [ + 10, + -8.019940376281738 + ], + [ + 766, + -8.111724853515625 + ], + [ + 120042, + -8.267496109008789 + ], + [ + 467, + -8.325775146484375 + ], + [ + 502, + -8.553245544433594 + ], + [ + 120008, + -8.692075729370117 + ], + [ + 5274, + -8.722633361816406 + ] + ], + "logprob_of_token": -0.019298505038022995, + "top1_top2_margin": 5.929077196866274, + "top6_top7_margin": 0.17690467834472656 + }, + { + "gen_index": 21, + "token": 936, + "top": [ + [ + 936, + -0.041387490928173065 + ], + [ + 46, + -4.881545066833496 + ], + [ + 275, + -5.4057230949401855 + ], + [ + 7510, + -5.837874889373779 + ], + [ + 263, + -5.964192867279053 + ], + [ + 120022, + -6.413433074951172 + ], + [ + 120007, + -6.766240119934082 + ], + [ + 314, + -6.941586017608643 + ], + [ + 286, + -6.952884674072266 + ], + [ + 59, + -7.062989711761475 + ], + [ + 120001, + -7.107339382171631 + ], + [ + 262, + -7.30739164352417 + ], + [ + 10, + -7.463981628417969 + ], + [ + 766, + -7.513264179229736 + ], + [ + 120042, + -7.572587013244629 + ], + [ + 946, + -7.6072516441345215 + ], + [ + 1064, + -7.675774097442627 + ], + [ + 502, + -7.829936981201172 + ], + [ + 14147, + -7.964859962463379 + ], + [ + 5274, + -8.04757022857666 + ] + ], + "logprob_of_token": -0.041387490928173065, + "top1_top2_margin": 4.840157575905323, + "top6_top7_margin": 0.35280704498291016 + }, + { + "gen_index": 22, + "token": 936, + "top": [ + [ + 936, + -0.06803283840417862 + ], + [ + 46, + -4.311829090118408 + ], + [ + 275, + -4.58304500579834 + ], + [ + 7510, + -5.17502498626709 + ], + [ + 263, + -5.428856372833252 + ], + [ + 120022, + -6.420966625213623 + ], + [ + 314, + -6.524914264678955 + ], + [ + 59, + -6.573870658874512 + ], + [ + 120001, + -6.590968608856201 + ], + [ + 262, + -6.754749298095703 + ], + [ + 120007, + -6.826612949371338 + ], + [ + 946, + -6.987396240234375 + ], + [ + 10, + -7.062582015991211 + ], + [ + 286, + -7.165233135223389 + ], + [ + 766, + -7.216186046600342 + ], + [ + 120042, + -7.242337226867676 + ], + [ + 32, + -7.39309549331665 + ], + [ + 502, + -7.508214473724365 + ], + [ + 14147, + -7.552567958831787 + ], + [ + 120173, + -7.5641632080078125 + ] + ], + "logprob_of_token": -0.06803283840417862, + "top1_top2_margin": 4.24379625171423, + "top6_top7_margin": 0.10394763946533203 + }, + { + "gen_index": 23, + "token": 936, + "top": [ + [ + 936, + -0.04569406807422638 + ], + [ + 46, + -4.773806095123291 + ], + [ + 275, + -5.1198883056640625 + ], + [ + 263, + -5.723989009857178 + ], + [ + 7510, + -5.959160327911377 + ], + [ + 120022, + -6.359298229217529 + ], + [ + 502, + -6.936364650726318 + ], + [ + 262, + -7.003081798553467 + ], + [ + 120007, + -7.003810405731201 + ], + [ + 314, + -7.040536880493164 + ], + [ + 120001, + -7.083032608032227 + ], + [ + 59, + -7.301276683807373 + ], + [ + 10, + -7.43131160736084 + ], + [ + 286, + -7.487872123718262 + ], + [ + 946, + -7.505748271942139 + ], + [ + 1333, + -7.575110912322998 + ], + [ + 32, + -7.776090145111084 + ], + [ + 120042, + -7.817329406738281 + ], + [ + 1064, + -7.821897506713867 + ], + [ + 14147, + -8.02394962310791 + ] + ], + "logprob_of_token": -0.04569406807422638, + "top1_top2_margin": 4.728112027049065, + "top6_top7_margin": 0.5770664215087891 + }, + { + "gen_index": 24, + "token": 936, + "top": [ + [ + 936, + -0.024492034688591957 + ], + [ + 46, + -5.754851341247559 + ], + [ + 275, + -6.332985877990723 + ], + [ + 7510, + -6.431128025054932 + ], + [ + 120022, + -6.493562698364258 + ], + [ + 263, + -6.8478593826293945 + ], + [ + 502, + -7.216926574707031 + ], + [ + 262, + -7.402034282684326 + ], + [ + 286, + -7.43800163269043 + ], + [ + 120007, + -7.484883785247803 + ], + [ + 59, + -7.553380012512207 + ], + [ + 1333, + -7.649660110473633 + ], + [ + 120001, + -7.748856544494629 + ], + [ + 314, + -7.927023410797119 + ], + [ + 1064, + -7.960379600524902 + ], + [ + 10, + -7.992568016052246 + ], + [ + 120042, + -8.28271484375 + ], + [ + 32, + -8.283924102783203 + ], + [ + 467, + -8.36862564086914 + ], + [ + 120008, + -8.63961410522461 + ] + ], + "logprob_of_token": -0.024492034688591957, + "top1_top2_margin": 5.730359306558967, + "top6_top7_margin": 0.3690671920776367 + }, + { + "gen_index": 25, + "token": 936, + "top": [ + [ + 936, + -0.024571139365434647 + ], + [ + 46, + -5.810328483581543 + ], + [ + 120022, + -6.397490978240967 + ], + [ + 275, + -6.556766510009766 + ], + [ + 7510, + -6.681835174560547 + ], + [ + 120007, + -6.979990482330322 + ], + [ + 263, + -7.013247013092041 + ], + [ + 262, + -7.109339237213135 + ], + [ + 502, + -7.320104598999023 + ], + [ + 59, + -7.478048801422119 + ], + [ + 286, + -7.514039516448975 + ], + [ + 1064, + -7.552928924560547 + ], + [ + 946, + -7.647192478179932 + ], + [ + 120001, + -7.785264015197754 + ], + [ + 766, + -8.113553047180176 + ], + [ + 314, + -8.120038032531738 + ], + [ + 10, + -8.179146766662598 + ], + [ + 32, + -8.288167953491211 + ], + [ + 565, + -8.468806266784668 + ], + [ + 1333, + -8.519338607788086 + ] + ], + "logprob_of_token": -0.024571139365434647, + "top1_top2_margin": 5.785757344216108, + "top6_top7_margin": 0.03325653076171875 + }, + { + "gen_index": 26, + "token": 936, + "top": [ + [ + 936, + -0.01939707249403 + ], + [ + 46, + -6.08329439163208 + ], + [ + 120022, + -6.481128215789795 + ], + [ + 7510, + -6.776832580566406 + ], + [ + 275, + -6.872337341308594 + ], + [ + 120007, + -7.0348381996154785 + ], + [ + 286, + -7.206664085388184 + ], + [ + 263, + -7.2972002029418945 + ], + [ + 59, + -7.599532604217529 + ], + [ + 1064, + -7.646966457366943 + ], + [ + 502, + -7.69055700302124 + ], + [ + 262, + -7.872590065002441 + ], + [ + 946, + -8.052336692810059 + ], + [ + 766, + -8.097748756408691 + ], + [ + 120001, + -8.134503364562988 + ], + [ + 314, + -8.339831352233887 + ], + [ + 10, + -8.390616416931152 + ], + [ + 5274, + -8.542342185974121 + ], + [ + 120042, + -8.584975242614746 + ], + [ + 14188, + -8.647921562194824 + ] + ], + "logprob_of_token": -0.01939707249403, + "top1_top2_margin": 6.06389731913805, + "top6_top7_margin": 0.17182588577270508 + }, + { + "gen_index": 27, + "token": 936, + "top": [ + [ + 936, + -0.030750608071684837 + ], + [ + 46, + -5.49826192855835 + ], + [ + 7510, + -5.868704319000244 + ], + [ + 120022, + -6.226830005645752 + ], + [ + 275, + -6.244052886962891 + ], + [ + 59, + -6.620508670806885 + ], + [ + 120007, + -6.676339149475098 + ], + [ + 263, + -6.685705184936523 + ], + [ + 262, + -7.174223899841309 + ], + [ + 286, + -7.265973091125488 + ], + [ + 314, + -7.638699531555176 + ], + [ + 946, + -7.655770778656006 + ], + [ + 10, + -7.729288578033447 + ], + [ + 120001, + -7.761528968811035 + ], + [ + 120042, + -7.802979469299316 + ], + [ + 766, + -7.935726642608643 + ], + [ + 32, + -7.992710113525391 + ], + [ + 565, + -8.117348670959473 + ], + [ + 1064, + -8.15233039855957 + ], + [ + 502, + -8.241600036621094 + ] + ], + "logprob_of_token": -0.030750608071684837, + "top1_top2_margin": 5.467511320486665, + "top6_top7_margin": 0.05583047866821289 + }, + { + "gen_index": 28, + "token": 936, + "top": [ + [ + 936, + -0.038099247962236404 + ], + [ + 46, + -5.038281440734863 + ], + [ + 275, + -5.465120792388916 + ], + [ + 7510, + -5.686629295349121 + ], + [ + 263, + -6.116491317749023 + ], + [ + 120022, + -6.47220516204834 + ], + [ + 120007, + -6.761831283569336 + ], + [ + 59, + -6.891021251678467 + ], + [ + 262, + -7.185276985168457 + ], + [ + 314, + -7.206261157989502 + ], + [ + 286, + -7.397216320037842 + ], + [ + 120001, + -7.432704448699951 + ], + [ + 10, + -7.5697126388549805 + ], + [ + 502, + -7.632359981536865 + ], + [ + 120042, + -7.719972133636475 + ], + [ + 946, + -7.760707855224609 + ], + [ + 565, + -7.9341559410095215 + ], + [ + 32, + -8.028946876525879 + ], + [ + 14147, + -8.037317276000977 + ], + [ + 766, + -8.083551406860352 + ] + ], + "logprob_of_token": -0.038099247962236404, + "top1_top2_margin": 5.000182192772627, + "top6_top7_margin": 0.2896261215209961 + }, + { + "gen_index": 29, + "token": 936, + "top": [ + [ + 936, + -0.04461328312754631 + ], + [ + 46, + -4.852050304412842 + ], + [ + 275, + -5.161144733428955 + ], + [ + 7510, + -5.60847282409668 + ], + [ + 263, + -5.8397016525268555 + ], + [ + 120022, + -6.2719597816467285 + ], + [ + 120007, + -6.623981952667236 + ], + [ + 59, + -6.867241859436035 + ], + [ + 314, + -6.992434024810791 + ], + [ + 262, + -7.237707614898682 + ], + [ + 120001, + -7.269947528839111 + ], + [ + 10, + -7.402920722961426 + ], + [ + 502, + -7.476230144500732 + ], + [ + 286, + -7.49738883972168 + ], + [ + 120042, + -7.593621730804443 + ], + [ + 946, + -7.787893295288086 + ], + [ + 120016, + -7.822384834289551 + ], + [ + 565, + -7.923832893371582 + ], + [ + 14147, + -7.945659637451172 + ], + [ + 32, + -7.99185848236084 + ] + ], + "logprob_of_token": -0.04461328312754631, + "top1_top2_margin": 4.8074370212852955, + "top6_top7_margin": 0.3520221710205078 + }, + { + "gen_index": 30, + "token": 936, + "top": [ + [ + 936, + -0.03309372812509537 + ], + [ + 46, + -5.27182674407959 + ], + [ + 275, + -5.916968822479248 + ], + [ + 7510, + -6.2386016845703125 + ], + [ + 120022, + -6.268324375152588 + ], + [ + 263, + -6.556791305541992 + ], + [ + 502, + -6.886851787567139 + ], + [ + 120007, + -6.994482040405273 + ], + [ + 262, + -7.2017645835876465 + ], + [ + 59, + -7.20768404006958 + ], + [ + 286, + -7.278251647949219 + ], + [ + 120001, + -7.509302139282227 + ], + [ + 1333, + -7.560741424560547 + ], + [ + 314, + -7.617971420288086 + ], + [ + 946, + -7.729918479919434 + ], + [ + 10, + -7.738460540771484 + ], + [ + 1064, + -7.751950263977051 + ], + [ + 120042, + -7.91758918762207 + ], + [ + 766, + -8.011626243591309 + ], + [ + 32, + -8.045736312866211 + ] + ], + "logprob_of_token": -0.03309372812509537, + "top1_top2_margin": 5.2387330159544945, + "top6_top7_margin": 0.3300604820251465 + }, + { + "gen_index": 31, + "token": 936, + "top": [ + [ + 936, + -0.02787255123257637 + ], + [ + 46, + -5.694863319396973 + ], + [ + 120022, + -6.215535640716553 + ], + [ + 7510, + -6.4596171379089355 + ], + [ + 275, + -6.629917144775391 + ], + [ + 120007, + -6.718471050262451 + ], + [ + 59, + -6.8159613609313965 + ], + [ + 263, + -6.976103782653809 + ], + [ + 262, + -7.113834857940674 + ], + [ + 286, + -7.251016139984131 + ], + [ + 946, + -7.339061260223389 + ], + [ + 502, + -7.539065837860107 + ], + [ + 120001, + -7.708276748657227 + ], + [ + 1064, + -7.783758640289307 + ], + [ + 766, + -7.878162860870361 + ], + [ + 120042, + -7.878484725952148 + ], + [ + 32, + -7.9210286140441895 + ], + [ + 10, + -8.11556625366211 + ], + [ + 314, + -8.155978202819824 + ], + [ + 1333, + -8.175960540771484 + ] + ], + "logprob_of_token": -0.02787255123257637, + "top1_top2_margin": 5.666990768164396, + "top6_top7_margin": 0.09749031066894531 + } + ] + }, + { + "prompt": "x1 = 3, x2 = 7, x3 = 11, x4 =", + "input_ids": [ + 120, + 49, + 576, + 32, + 51, + 44, + 14169, + 50, + 576, + 32, + 55, + 44, + 14169, + 51, + 576, + 32, + 49, + 49, + 44, + 14169, + 52, + 576 + ], + "generated_ids": [ + 32, + 49, + 51, + 44, + 14169, + 53, + 576, + 32, + 49, + 53, + 44, + 14169, + 54, + 576, + 32, + 49, + 55, + 44, + 14169, + 55, + 576, + 32, + 49, + 57, + 44, + 14169, + 56, + 576, + 32, + 50, + 49, + 44 + ], + "rows": [ + { + "gen_index": 0, + "token": 32, + "top": [ + [ + 32, + -0.015084456652402878 + ], + [ + 49, + -6.3592658042907715 + ], + [ + 14169, + -6.920379638671875 + ], + [ + 14153, + -7.267691612243652 + ], + [ + 120022, + -7.287038326263428 + ], + [ + 1829, + -8.063929557800293 + ], + [ + 5274, + -8.217724800109863 + ], + [ + 766, + -8.245162010192871 + ], + [ + 735, + -8.278360366821289 + ], + [ + 262, + -8.454033851623535 + ], + [ + 622, + -8.695334434509277 + ], + [ + 55, + -8.947364807128906 + ], + [ + 263, + -8.994633674621582 + ], + [ + 14188, + -9.00700855255127 + ], + [ + 941, + -9.112700462341309 + ], + [ + 120018, + -9.12043571472168 + ], + [ + 46, + -9.13534164428711 + ], + [ + 3326, + -9.277457237243652 + ], + [ + 946, + -9.425169944763184 + ], + [ + 502, + -9.441401481628418 + ] + ], + "logprob_of_token": -0.015084456652402878, + "top1_top2_margin": 6.344181347638369, + "top6_top7_margin": 0.1537952423095703 + }, + { + "gen_index": 1, + "token": 49, + "top": [ + [ + 49, + -0.14363844692707062 + ], + [ + 50, + -3.612182378768921 + ], + [ + 55, + -3.817157506942749 + ], + [ + 52, + -3.982752561569214 + ], + [ + 51, + -4.102163314819336 + ], + [ + 57, + -4.402234077453613 + ], + [ + 56, + -4.593587875366211 + ], + [ + 53, + -4.730338096618652 + ], + [ + 54, + -4.844057083129883 + ], + [ + 48, + -6.628164291381836 + ], + [ + 32, + -6.984034061431885 + ], + [ + 14153, + -8.652555465698242 + ], + [ + 766, + -9.1356840133667 + ], + [ + 63, + -9.263026237487793 + ], + [ + 120007, + -9.55985164642334 + ], + [ + 576, + -9.681626319885254 + ], + [ + 263, + -9.8002347946167 + ], + [ + 120022, + -9.844289779663086 + ], + [ + 46, + -9.975399017333984 + ], + [ + 946, + -9.984992980957031 + ] + ], + "logprob_of_token": -0.14363844692707062, + "top1_top2_margin": 3.4685439318418503, + "top6_top7_margin": 0.19135379791259766 + }, + { + "gen_index": 2, + "token": 51, + "top": [ + [ + 51, + -0.6400728821754456 + ], + [ + 53, + -2.3364505767822266 + ], + [ + 56, + -2.4233407974243164 + ], + [ + 57, + -2.4720346927642822 + ], + [ + 55, + -2.4867448806762695 + ], + [ + 54, + -3.2402563095092773 + ], + [ + 52, + -3.3983747959136963 + ], + [ + 50, + -4.581514835357666 + ], + [ + 49, + -4.9685282707214355 + ], + [ + 48, + -5.027946949005127 + ], + [ + 44, + -5.448459148406982 + ], + [ + 46, + -7.288488864898682 + ], + [ + 766, + -7.306797027587891 + ], + [ + 32, + -7.383284568786621 + ], + [ + 58, + -7.8981122970581055 + ], + [ + 263, + -7.938119411468506 + ], + [ + 286, + -8.043831825256348 + ], + [ + 63, + -8.410000801086426 + ], + [ + 10, + -8.545062065124512 + ], + [ + 59, + -8.628466606140137 + ] + ], + "logprob_of_token": -0.6400728821754456, + "top1_top2_margin": 1.696377694606781, + "top6_top7_margin": 0.15811848640441895 + }, + { + "gen_index": 3, + "token": 44, + "top": [ + [ + 44, + -0.10606690496206284 + ], + [ + 263, + -3.262115716934204 + ], + [ + 46, + -4.3922624588012695 + ], + [ + 275, + -4.705240249633789 + ], + [ + 766, + -5.5194501876831055 + ], + [ + 10, + -5.683718681335449 + ], + [ + 120007, + -5.697792053222656 + ], + [ + 1829, + -6.371627330780029 + ], + [ + 58, + -6.375916957855225 + ], + [ + 59, + -6.532310962677002 + ], + [ + 63, + -6.841960430145264 + ], + [ + 49, + -7.036924839019775 + ], + [ + 14188, + -7.247705459594727 + ], + [ + 286, + -7.327456474304199 + ], + [ + 14147, + -7.497951030731201 + ], + [ + 314, + -7.609344482421875 + ], + [ + 48, + -7.6524786949157715 + ], + [ + 120016, + -7.6742777824401855 + ], + [ + 52, + -7.848926544189453 + ], + [ + 120028, + -7.8657941818237305 + ] + ], + "logprob_of_token": -0.10606690496206284, + "top1_top2_margin": 3.1560488119721413, + "top6_top7_margin": 0.014073371887207031 + }, + { + "gen_index": 4, + "token": 14169, + "top": [ + [ + 14169, + -0.19714275002479553 + ], + [ + 286, + -3.675002336502075 + ], + [ + 936, + -3.820058584213257 + ], + [ + 262, + -3.942638635635376 + ], + [ + 7510, + -4.3828630447387695 + ], + [ + 32, + -5.259636878967285 + ], + [ + 120022, + -5.6826019287109375 + ], + [ + 1409, + -5.764428615570068 + ], + [ + 393, + -5.882109642028809 + ], + [ + 1776, + -6.0454630851745605 + ], + [ + 4743, + -6.057764530181885 + ], + [ + 565, + -6.139219284057617 + ], + [ + 310, + -6.338613510131836 + ], + [ + 527, + -6.989915370941162 + ], + [ + 669, + -7.1422834396362305 + ], + [ + 941, + -7.267220973968506 + ], + [ + 3326, + -7.317739963531494 + ], + [ + 420, + -7.497943878173828 + ], + [ + 3504, + -7.519680500030518 + ], + [ + 346, + -7.538569450378418 + ] + ], + "logprob_of_token": -0.19714275002479553, + "top1_top2_margin": 3.4778595864772797, + "top6_top7_margin": 0.42296504974365234 + }, + { + "gen_index": 5, + "token": 53, + "top": [ + [ + 53, + -0.046215981245040894 + ], + [ + 49, + -4.222041130065918 + ], + [ + 52, + -5.495726108551025 + ], + [ + 50, + -6.334848880767822 + ], + [ + 51, + -6.444006443023682 + ], + [ + 55, + -6.464365482330322 + ], + [ + 576, + -7.1649932861328125 + ], + [ + 54, + -7.409633636474609 + ], + [ + 32, + -7.466703414916992 + ], + [ + 56, + -7.744104385375977 + ], + [ + 57, + -7.857478141784668 + ], + [ + 48, + -8.199037551879883 + ], + [ + 63, + -8.856274604797363 + ], + [ + 263, + -8.95646858215332 + ], + [ + 110, + -9.098917007446289 + ], + [ + 379, + -9.125418663024902 + ], + [ + 46, + -9.305617332458496 + ], + [ + 622, + -9.35677719116211 + ], + [ + 44, + -9.368864059448242 + ], + [ + 4241, + -9.411447525024414 + ] + ], + "logprob_of_token": -0.046215981245040894, + "top1_top2_margin": 4.175825148820877, + "top6_top7_margin": 0.7006278038024902 + }, + { + "gen_index": 6, + "token": 576, + "top": [ + [ + 576, + -0.007217522710561752 + ], + [ + 61, + -6.820399761199951 + ], + [ + 735, + -7.237720489501953 + ], + [ + 32, + -7.979040145874023 + ], + [ + 1829, + -8.146734237670898 + ], + [ + 58, + -8.309813499450684 + ], + [ + 44, + -9.168231964111328 + ], + [ + 318, + -9.223140716552734 + ], + [ + 439, + -9.371265411376953 + ], + [ + 263, + -9.384431838989258 + ], + [ + 120007, + -9.408371925354004 + ], + [ + 14188, + -9.48838996887207 + ], + [ + 46, + -9.495048522949219 + ], + [ + 476, + -9.51304817199707 + ], + [ + 286, + -9.637453079223633 + ], + [ + 1270, + -9.680402755737305 + ], + [ + 528, + -9.853702545166016 + ], + [ + 262, + -9.920877456665039 + ], + [ + 622, + -9.941393852233887 + ], + [ + 120022, + -9.967187881469727 + ] + ], + "logprob_of_token": -0.007217522710561752, + "top1_top2_margin": 6.813182238489389, + "top6_top7_margin": 0.8584184646606445 + }, + { + "gen_index": 7, + "token": 32, + "top": [ + [ + 32, + -0.012553359381854534 + ], + [ + 49, + -6.461863994598389 + ], + [ + 318, + -7.529444694519043 + ], + [ + 1829, + -7.677826404571533 + ], + [ + 14153, + -7.795767307281494 + ], + [ + 5274, + -8.148360252380371 + ], + [ + 3417, + -8.429549217224121 + ], + [ + 120022, + -8.594405174255371 + ], + [ + 14188, + -8.607232093811035 + ], + [ + 946, + -8.66567325592041 + ], + [ + 327, + -8.817852973937988 + ], + [ + 120018, + -8.829594612121582 + ], + [ + 262, + -8.92876148223877 + ], + [ + 3326, + -9.12268352508545 + ], + [ + 766, + -9.212008476257324 + ], + [ + 14169, + -9.347590446472168 + ], + [ + 527, + -9.545134544372559 + ], + [ + 941, + -9.563258171081543 + ], + [ + 1765, + -9.573959350585938 + ], + [ + 502, + -9.625251770019531 + ] + ], + "logprob_of_token": -0.012553359381854534, + "top1_top2_margin": 6.449310635216534, + "top6_top7_margin": 0.28118896484375 + }, + { + "gen_index": 8, + "token": 49, + "top": [ + [ + 49, + -0.11967819184064865 + ], + [ + 55, + -4.362071514129639 + ], + [ + 21746, + -4.809305191040039 + ], + [ + 32, + -4.909008502960205 + ], + [ + 14330, + -5.2688117027282715 + ], + [ + 50, + -5.389189720153809 + ], + [ + 14267, + -5.646520614624023 + ], + [ + 53, + -5.7719407081604 + ], + [ + 57, + -5.809218883514404 + ], + [ + 56, + -6.175230026245117 + ], + [ + 54, + -6.262284278869629 + ], + [ + 48, + -6.494996070861816 + ], + [ + 51, + -6.522157669067383 + ], + [ + 16422, + -6.54470157623291 + ], + [ + 4823, + -6.667455196380615 + ], + [ + 52, + -7.032710552215576 + ], + [ + 262, + -7.131518363952637 + ], + [ + 14676, + -7.1498260498046875 + ], + [ + 946, + -7.310492992401123 + ], + [ + 766, + -7.428969383239746 + ] + ], + "logprob_of_token": -0.11967819184064865, + "top1_top2_margin": 4.24239332228899, + "top6_top7_margin": 0.25733089447021484 + }, + { + "gen_index": 9, + "token": 53, + "top": [ + [ + 53, + -0.1171046569943428 + ], + [ + 55, + -2.577408790588379 + ], + [ + 52, + -4.629706382751465 + ], + [ + 51, + -5.297666072845459 + ], + [ + 49, + -5.708714008331299 + ], + [ + 57, + -5.85432243347168 + ], + [ + 54, + -6.002771377563477 + ], + [ + 56, + -6.822127342224121 + ], + [ + 48, + -7.2848124504089355 + ], + [ + 50, + -7.652645111083984 + ], + [ + 44, + -7.845753192901611 + ], + [ + 46, + -8.183621406555176 + ], + [ + 32, + -8.217007637023926 + ], + [ + 10, + -8.701035499572754 + ], + [ + 318, + -8.708415031433105 + ], + [ + 766, + -9.04806900024414 + ], + [ + 263, + -9.197256088256836 + ], + [ + 63, + -9.563319206237793 + ], + [ + 58, + -9.575972557067871 + ], + [ + 576, + -9.828990936279297 + ] + ], + "logprob_of_token": -0.1171046569943428, + "top1_top2_margin": 2.460304133594036, + "top6_top7_margin": 0.14844894409179688 + }, + { + "gen_index": 10, + "token": 44, + "top": [ + [ + 44, + -0.3041866421699524 + ], + [ + 263, + -2.6075751781463623 + ], + [ + 46, + -2.945223569869995 + ], + [ + 275, + -3.1170403957366943 + ], + [ + 10, + -3.7627604007720947 + ], + [ + 314, + -4.498724460601807 + ], + [ + 120007, + -4.893522262573242 + ], + [ + 1829, + -5.409501075744629 + ], + [ + 766, + -5.4590935707092285 + ], + [ + 59, + -5.9693779945373535 + ], + [ + 14188, + -6.055475234985352 + ], + [ + 63, + -6.131381511688232 + ], + [ + 14147, + -6.390681266784668 + ], + [ + 988, + -6.583359241485596 + ], + [ + 58, + -6.601483345031738 + ], + [ + 120016, + -6.692890167236328 + ], + [ + 120028, + -7.193659782409668 + ], + [ + 14153, + -7.5640869140625 + ], + [ + 127906, + -7.583264350891113 + ], + [ + 745, + -7.67258882522583 + ] + ], + "logprob_of_token": -0.3041866421699524, + "top1_top2_margin": 2.30338853597641, + "top6_top7_margin": 0.39479780197143555 + }, + { + "gen_index": 11, + "token": 14169, + "top": [ + [ + 14169, + -0.2898001968860626 + ], + [ + 936, + -3.0520853996276855 + ], + [ + 286, + -3.28792142868042 + ], + [ + 262, + -3.340095043182373 + ], + [ + 7510, + -4.1422576904296875 + ], + [ + 1409, + -5.080878257751465 + ], + [ + 32, + -5.5586090087890625 + ], + [ + 4743, + -5.791656970977783 + ], + [ + 120022, + -5.849498748779297 + ], + [ + 565, + -5.937088966369629 + ], + [ + 393, + -5.989037990570068 + ], + [ + 3924, + -6.453277111053467 + ], + [ + 1776, + -6.586522102355957 + ], + [ + 453, + -6.636716365814209 + ], + [ + 2213, + -6.640210151672363 + ], + [ + 310, + -6.6695451736450195 + ], + [ + 3326, + -6.748667240142822 + ], + [ + 8545, + -6.767577171325684 + ], + [ + 1765, + -6.89389705657959 + ], + [ + 3688, + -6.9612932205200195 + ] + ], + "logprob_of_token": -0.2898001968860626, + "top1_top2_margin": 2.762285202741623, + "top6_top7_margin": 0.47773075103759766 + }, + { + "gen_index": 12, + "token": 54, + "top": [ + [ + 54, + -0.03722718730568886 + ], + [ + 49, + -4.062849521636963 + ], + [ + 53, + -5.262272357940674 + ], + [ + 50, + -6.19965934753418 + ], + [ + 55, + -6.631888389587402 + ], + [ + 52, + -6.682441711425781 + ], + [ + 51, + -6.750331878662109 + ], + [ + 576, + -7.1493048667907715 + ], + [ + 48, + -7.637809753417969 + ], + [ + 56, + -8.426420211791992 + ], + [ + 57, + -8.610057830810547 + ], + [ + 110, + -9.067063331604004 + ], + [ + 63, + -9.15294075012207 + ], + [ + 32, + -9.335084915161133 + ], + [ + 95, + -9.360967636108398 + ], + [ + 15085, + -9.643240928649902 + ], + [ + 589, + -9.769627571105957 + ], + [ + 61, + -10.053937911987305 + ], + [ + 1606, + -10.100146293640137 + ], + [ + 14163, + -10.131431579589844 + ] + ], + "logprob_of_token": -0.03722718730568886, + "top1_top2_margin": 4.025622334331274, + "top6_top7_margin": 0.06789016723632812 + }, + { + "gen_index": 13, + "token": 576, + "top": [ + [ + 576, + -0.00390079477801919 + ], + [ + 61, + -6.85364294052124 + ], + [ + 735, + -8.116104125976562 + ], + [ + 32, + -8.33452033996582 + ], + [ + 1829, + -8.74015998840332 + ], + [ + 58, + -8.865031242370605 + ], + [ + 44, + -9.212894439697266 + ], + [ + 63, + -9.629942893981934 + ], + [ + 46, + -9.891141891479492 + ], + [ + 120007, + -10.03756332397461 + ], + [ + 528, + -10.154093742370605 + ], + [ + 286, + -10.163928985595703 + ], + [ + 14188, + -10.167364120483398 + ], + [ + 49, + -10.442195892333984 + ], + [ + 95, + -10.479422569274902 + ], + [ + 120022, + -10.494672775268555 + ], + [ + 14713, + -10.666252136230469 + ], + [ + 14169, + -10.73774528503418 + ], + [ + 1270, + -10.751026153564453 + ], + [ + 263, + -10.834916114807129 + ] + ], + "logprob_of_token": -0.00390079477801919, + "top1_top2_margin": 6.849742145743221, + "top6_top7_margin": 0.34786319732666016 + }, + { + "gen_index": 14, + "token": 32, + "top": [ + [ + 32, + -0.008477158844470978 + ], + [ + 49, + -6.544477462768555 + ], + [ + 14153, + -7.340885639190674 + ], + [ + 1829, + -7.54326868057251 + ], + [ + 5274, + -8.360123634338379 + ], + [ + 120018, + -8.427773475646973 + ], + [ + 14188, + -8.619915962219238 + ], + [ + 766, + -8.948029518127441 + ], + [ + 3417, + -8.958922386169434 + ], + [ + 120022, + -8.979511260986328 + ], + [ + 14169, + -9.002401351928711 + ], + [ + 32099, + -9.44442081451416 + ], + [ + 55, + -9.58133602142334 + ], + [ + 946, + -9.602667808532715 + ], + [ + 941, + -9.649116516113281 + ], + [ + 936, + -9.721701622009277 + ], + [ + 122407, + -9.733193397521973 + ], + [ + 576, + -9.94857120513916 + ], + [ + 1409, + -10.010510444641113 + ], + [ + 14139, + -10.170195579528809 + ] + ], + "logprob_of_token": -0.008477158844470978, + "top1_top2_margin": 6.536000303924084, + "top6_top7_margin": 0.19214248657226562 + }, + { + "gen_index": 15, + "token": 49, + "top": [ + [ + 49, + -0.056989822536706924 + ], + [ + 55, + -4.1716203689575195 + ], + [ + 51, + -5.059605121612549 + ], + [ + 50, + -5.12028169631958 + ], + [ + 57, + -5.476280212402344 + ], + [ + 54, + -5.481762886047363 + ], + [ + 32, + -6.246181488037109 + ], + [ + 56, + -6.2668986320495605 + ], + [ + 14267, + -6.944471836090088 + ], + [ + 53, + -7.233572483062744 + ], + [ + 48, + -7.272799491882324 + ], + [ + 52, + -7.452142715454102 + ], + [ + 21746, + -7.8992204666137695 + ], + [ + 14330, + -8.240936279296875 + ], + [ + 119464, + -8.87961196899414 + ], + [ + 766, + -9.072338104248047 + ], + [ + 2051, + -9.14441204071045 + ], + [ + 44, + -9.175434112548828 + ], + [ + 7368, + -9.210670471191406 + ], + [ + 14153, + -9.241728782653809 + ] + ], + "logprob_of_token": -0.056989822536706924, + "top1_top2_margin": 4.114630546420813, + "top6_top7_margin": 0.7644186019897461 + }, + { + "gen_index": 16, + "token": 55, + "top": [ + [ + 55, + -0.0767039880156517 + ], + [ + 54, + -3.4795074462890625 + ], + [ + 53, + -3.7226743698120117 + ], + [ + 57, + -5.193547248840332 + ], + [ + 56, + -5.717581272125244 + ], + [ + 49, + -5.819818496704102 + ], + [ + 51, + -6.223694801330566 + ], + [ + 44, + -7.214615345001221 + ], + [ + 48, + -7.423644065856934 + ], + [ + 52, + -7.568536281585693 + ], + [ + 50, + -8.15272331237793 + ], + [ + 32, + -8.994935989379883 + ], + [ + 46, + -9.221572875976562 + ], + [ + 766, + -9.433008193969727 + ], + [ + 10, + -10.102283477783203 + ], + [ + 263, + -10.131759643554688 + ], + [ + 63, + -10.298050880432129 + ], + [ + 58, + -10.624658584594727 + ], + [ + 93, + -10.851980209350586 + ], + [ + 576, + -10.874215126037598 + ] + ], + "logprob_of_token": -0.0767039880156517, + "top1_top2_margin": 3.402803458273411, + "top6_top7_margin": 0.40387630462646484 + }, + { + "gen_index": 17, + "token": 44, + "top": [ + [ + 44, + -0.0145069295540452 + ], + [ + 263, + -5.303834438323975 + ], + [ + 46, + -6.7052741050720215 + ], + [ + 120007, + -6.939478397369385 + ], + [ + 275, + -6.961179256439209 + ], + [ + 10, + -7.182807922363281 + ], + [ + 766, + -7.62148380279541 + ], + [ + 120016, + -7.923587799072266 + ], + [ + 1829, + -8.448139190673828 + ], + [ + 63, + -8.539846420288086 + ], + [ + 59, + -8.755997657775879 + ], + [ + 286, + -8.769739151000977 + ], + [ + 14188, + -8.900967597961426 + ], + [ + 120028, + -8.926767349243164 + ], + [ + 121119, + -8.982860565185547 + ], + [ + 58, + -9.008453369140625 + ], + [ + 314, + -9.298807144165039 + ], + [ + 735, + -9.38483715057373 + ], + [ + 14169, + -9.490262985229492 + ], + [ + 988, + -9.504615783691406 + ] + ], + "logprob_of_token": -0.0145069295540452, + "top1_top2_margin": 5.289327508769929, + "top6_top7_margin": 0.4386758804321289 + }, + { + "gen_index": 18, + "token": 14169, + "top": [ + [ + 14169, + -0.040982529520988464 + ], + [ + 936, + -4.734824180603027 + ], + [ + 7510, + -5.380095958709717 + ], + [ + 286, + -6.056746959686279 + ], + [ + 262, + -6.124667167663574 + ], + [ + 120022, + -6.859787940979004 + ], + [ + 393, + -7.309315204620361 + ], + [ + 32, + -7.480709075927734 + ], + [ + 1409, + -7.8105950355529785 + ], + [ + 4743, + -8.116132736206055 + ], + [ + 310, + -8.202106475830078 + ], + [ + 120103, + -8.226029396057129 + ], + [ + 1776, + -8.287165641784668 + ], + [ + 941, + -8.604414939880371 + ], + [ + 3326, + -8.76456356048584 + ], + [ + 565, + -8.844950675964355 + ], + [ + 346, + -8.926972389221191 + ], + [ + 120087, + -8.99105167388916 + ], + [ + 3924, + -9.076071739196777 + ], + [ + 2213, + -9.17094898223877 + ] + ], + "logprob_of_token": -0.040982529520988464, + "top1_top2_margin": 4.693841651082039, + "top6_top7_margin": 0.4495272636413574 + }, + { + "gen_index": 19, + "token": 55, + "top": [ + [ + 55, + -0.005205147434026003 + ], + [ + 56, + -6.748823165893555 + ], + [ + 49, + -7.064023494720459 + ], + [ + 54, + -7.508597373962402 + ], + [ + 53, + -7.744954586029053 + ], + [ + 51, + -8.275028228759766 + ], + [ + 57, + -8.931926727294922 + ], + [ + 52, + -9.055868148803711 + ], + [ + 50, + -9.557502746582031 + ], + [ + 48, + -10.04910659790039 + ], + [ + 576, + -10.4215669631958 + ], + [ + 76591, + -10.817407608032227 + ], + [ + 263, + -10.972325325012207 + ], + [ + 12843, + -11.093735694885254 + ], + [ + 68202, + -11.312982559204102 + ], + [ + 63, + -11.327991485595703 + ], + [ + 117101, + -11.381624221801758 + ], + [ + 294, + -11.43581771850586 + ], + [ + 44, + -11.447782516479492 + ], + [ + 19827, + -11.493743896484375 + ] + ], + "logprob_of_token": -0.005205147434026003, + "top1_top2_margin": 6.743618018459529, + "top6_top7_margin": 0.6568984985351562 + }, + { + "gen_index": 20, + "token": 576, + "top": [ + [ + 576, + -0.001373399281874299 + ], + [ + 61, + -8.29165267944336 + ], + [ + 735, + -9.338265419006348 + ], + [ + 32, + -9.559770584106445 + ], + [ + 1829, + -9.60806655883789 + ], + [ + 58, + -10.041914939880371 + ], + [ + 44, + -10.547747611999512 + ], + [ + 14188, + -10.867134094238281 + ], + [ + 49, + -10.994585037231445 + ], + [ + 46, + -11.109314918518066 + ], + [ + 120022, + -11.415436744689941 + ], + [ + 318, + -11.503011703491211 + ], + [ + 120091, + -11.557531356811523 + ], + [ + 297, + -11.650140762329102 + ], + [ + 439, + -11.681818962097168 + ], + [ + 622, + -11.689615249633789 + ], + [ + 286, + -11.698554992675781 + ], + [ + 263, + -11.706138610839844 + ], + [ + 919, + -11.706533432006836 + ], + [ + 14153, + -11.742965698242188 + ] + ], + "logprob_of_token": -0.001373399281874299, + "top1_top2_margin": 8.290279280161485, + "top6_top7_margin": 0.5058326721191406 + }, + { + "gen_index": 21, + "token": 32, + "top": [ + [ + 32, + -0.004781932570040226 + ], + [ + 14153, + -7.940621376037598 + ], + [ + 49, + -8.22279167175293 + ], + [ + 1829, + -8.765382766723633 + ], + [ + 14188, + -9.189523696899414 + ], + [ + 3417, + -9.307024955749512 + ], + [ + 5274, + -9.40621280670166 + ], + [ + 946, + -9.472742080688477 + ], + [ + 120018, + -9.772932052612305 + ], + [ + 120022, + -9.948763847351074 + ], + [ + 14169, + -9.95962905883789 + ], + [ + 122407, + -9.974196434020996 + ], + [ + 32099, + -10.135065078735352 + ], + [ + 2945, + -10.204521179199219 + ], + [ + 120008, + -10.381956100463867 + ], + [ + 576, + -10.530552864074707 + ], + [ + 766, + -10.571867942810059 + ], + [ + 1333, + -10.594828605651855 + ], + [ + 4330, + -10.716415405273438 + ], + [ + 735, + -10.764403343200684 + ] + ], + "logprob_of_token": -0.004781932570040226, + "top1_top2_margin": 7.935839443467557, + "top6_top7_margin": 0.09918785095214844 + }, + { + "gen_index": 22, + "token": 49, + "top": [ + [ + 49, + -0.006852327845990658 + ], + [ + 50, + -6.934483528137207 + ], + [ + 51, + -6.947243690490723 + ], + [ + 48, + -6.975208759307861 + ], + [ + 57, + -7.1527419090271 + ], + [ + 55, + -8.171048164367676 + ], + [ + 32, + -8.389756202697754 + ], + [ + 56, + -8.889874458312988 + ], + [ + 53, + -9.002165794372559 + ], + [ + 127906, + -9.499251365661621 + ], + [ + 54, + -9.50477123260498 + ], + [ + 52, + -9.519522666931152 + ], + [ + 127908, + -10.078615188598633 + ], + [ + 263, + -10.265478134155273 + ], + [ + 1829, + -10.59193229675293 + ], + [ + 14169, + -10.860276222229004 + ], + [ + 44, + -10.93249797821045 + ], + [ + 10, + -11.026308059692383 + ], + [ + 286, + -11.111440658569336 + ], + [ + 766, + -11.1249361038208 + ] + ], + "logprob_of_token": -0.006852327845990658, + "top1_top2_margin": 6.927631200291216, + "top6_top7_margin": 0.21870803833007812 + }, + { + "gen_index": 23, + "token": 57, + "top": [ + [ + 57, + -0.03341877460479736 + ], + [ + 56, + -4.781099319458008 + ], + [ + 53, + -4.863519668579102 + ], + [ + 49, + -5.005621910095215 + ], + [ + 55, + -5.977904796600342 + ], + [ + 51, + -6.132622718811035 + ], + [ + 54, + -7.5751051902771 + ], + [ + 48, + -8.221588134765625 + ], + [ + 52, + -8.273508071899414 + ], + [ + 50, + -8.558216094970703 + ], + [ + 44, + -8.885833740234375 + ], + [ + 32, + -9.024659156799316 + ], + [ + 766, + -9.915199279785156 + ], + [ + 263, + -10.009065628051758 + ], + [ + 10, + -10.062670707702637 + ], + [ + 46, + -10.12011432647705 + ], + [ + 127906, + -10.517624855041504 + ], + [ + 58, + -10.574541091918945 + ], + [ + 735, + -10.767983436584473 + ], + [ + 576, + -10.795703887939453 + ] + ], + "logprob_of_token": -0.03341877460479736, + "top1_top2_margin": 4.7476805448532104, + "top6_top7_margin": 1.4424824714660645 + }, + { + "gen_index": 24, + "token": 44, + "top": [ + [ + 44, + -0.0034109645057469606 + ], + [ + 263, + -6.630707263946533 + ], + [ + 10, + -7.919034004211426 + ], + [ + 120007, + -8.819231986999512 + ], + [ + 46, + -9.029751777648926 + ], + [ + 766, + -9.416451454162598 + ], + [ + 275, + -9.488389015197754 + ], + [ + 58, + -9.536191940307617 + ], + [ + 127906, + -9.648859977722168 + ], + [ + 14188, + -9.674628257751465 + ], + [ + 1829, + -9.842951774597168 + ], + [ + 120016, + -9.875895500183105 + ], + [ + 59, + -9.923519134521484 + ], + [ + 286, + -10.061366081237793 + ], + [ + 988, + -10.079201698303223 + ], + [ + 121119, + -10.252175331115723 + ], + [ + 735, + -10.387696266174316 + ], + [ + 120028, + -10.396698951721191 + ], + [ + 120468, + -10.49785327911377 + ], + [ + 63, + -10.666775703430176 + ] + ], + "logprob_of_token": -0.0034109645057469606, + "top1_top2_margin": 6.627296299440786, + "top6_top7_margin": 0.07193756103515625 + }, + { + "gen_index": 25, + "token": 14169, + "top": [ + [ + 14169, + -0.006799756549298763 + ], + [ + 936, + -6.6548309326171875 + ], + [ + 7510, + -7.272500038146973 + ], + [ + 262, + -8.082990646362305 + ], + [ + 286, + -8.194225311279297 + ], + [ + 32, + -8.360857963562012 + ], + [ + 120103, + -9.16933822631836 + ], + [ + 127906, + -9.263503074645996 + ], + [ + 120, + -9.274442672729492 + ], + [ + 120022, + -9.296573638916016 + ], + [ + 393, + -9.530098915100098 + ], + [ + 263, + -9.656859397888184 + ], + [ + 941, + -9.746192932128906 + ], + [ + 3326, + -10.083490371704102 + ], + [ + 1409, + -10.292045593261719 + ], + [ + 1776, + -10.307945251464844 + ], + [ + 1765, + -10.427289962768555 + ], + [ + 120087, + -10.470197677612305 + ], + [ + 565, + -10.476219177246094 + ], + [ + 120016, + -10.545990943908691 + ] + ], + "logprob_of_token": -0.006799756549298763, + "top1_top2_margin": 6.648031176067889, + "top6_top7_margin": 0.8084802627563477 + }, + { + "gen_index": 26, + "token": 56, + "top": [ + [ + 56, + -0.0009220319334417582 + ], + [ + 57, + -8.800673484802246 + ], + [ + 53, + -8.911019325256348 + ], + [ + 49, + -9.124394416809082 + ], + [ + 55, + -9.634778022766113 + ], + [ + 51, + -9.797633171081543 + ], + [ + 263, + -9.893424034118652 + ], + [ + 52, + -10.05481243133545 + ], + [ + 50, + -10.241655349731445 + ], + [ + 54, + -10.28831672668457 + ], + [ + 127906, + -10.2993803024292 + ], + [ + 10, + -10.31319522857666 + ], + [ + 48, + -11.317549705505371 + ], + [ + 120016, + -12.591511726379395 + ], + [ + 37720, + -12.648422241210938 + ], + [ + 576, + -12.709691047668457 + ], + [ + 6238, + -12.803112983703613 + ], + [ + 14031, + -12.836603164672852 + ], + [ + 32, + -12.905619621276855 + ], + [ + 73987, + -12.938271522521973 + ] + ], + "logprob_of_token": -0.0009220319334417582, + "top1_top2_margin": 8.799751452868804, + "top6_top7_margin": 0.09579086303710938 + }, + { + "gen_index": 27, + "token": 576, + "top": [ + [ + 576, + -0.001199010293930769 + ], + [ + 263, + -8.485535621643066 + ], + [ + 61, + -8.717360496520996 + ], + [ + 127906, + -9.533833503723145 + ], + [ + 10, + -9.825193405151367 + ], + [ + 735, + -10.161231994628906 + ], + [ + 1829, + -10.355490684509277 + ], + [ + 120091, + -10.481490135192871 + ], + [ + 49, + -10.63657283782959 + ], + [ + 32, + -10.67255687713623 + ], + [ + 58, + -11.344107627868652 + ], + [ + 286, + -11.491583824157715 + ], + [ + 14188, + -11.586915969848633 + ], + [ + 120022, + -11.66008472442627 + ], + [ + 120103, + -11.718074798583984 + ], + [ + 3167, + -11.763392448425293 + ], + [ + 262, + -11.782325744628906 + ], + [ + 44, + -11.871899604797363 + ], + [ + 95, + -11.87641716003418 + ], + [ + 120016, + -11.922805786132812 + ] + ], + "logprob_of_token": -0.001199010293930769, + "top1_top2_margin": 8.484336611349136, + "top6_top7_margin": 0.1942586898803711 + }, + { + "gen_index": 28, + "token": 32, + "top": [ + [ + 32, + -0.0036924618761986494 + ], + [ + 50, + -8.785796165466309 + ], + [ + 5274, + -8.829134941101074 + ], + [ + 1829, + -9.130871772766113 + ], + [ + 14153, + -9.167854309082031 + ], + [ + 263, + -9.377470016479492 + ], + [ + 127906, + -9.778307914733887 + ], + [ + 3417, + -9.871234893798828 + ], + [ + 946, + -10.173995971679688 + ], + [ + 120022, + -10.212777137756348 + ], + [ + 120018, + -10.240165710449219 + ], + [ + 120014, + -10.317279815673828 + ], + [ + 14188, + -10.459711074829102 + ], + [ + 318, + -10.476349830627441 + ], + [ + 120103, + -10.697803497314453 + ], + [ + 14139, + -10.730161666870117 + ], + [ + 262, + -10.76773738861084 + ], + [ + 941, + -10.835319519042969 + ], + [ + 32099, + -10.846404075622559 + ], + [ + 19969, + -11.018876075744629 + ] + ], + "logprob_of_token": -0.0036924618761986494, + "top1_top2_margin": 8.78210370359011, + "top6_top7_margin": 0.40083789825439453 + }, + { + "gen_index": 29, + "token": 50, + "top": [ + [ + 50, + -0.05754948779940605 + ], + [ + 49, + -3.16542911529541 + ], + [ + 51, + -6.319636344909668 + ], + [ + 14267, + -7.023425102233887 + ], + [ + 32, + -7.028979778289795 + ], + [ + 14330, + -7.163966178894043 + ], + [ + 57, + -7.99974250793457 + ], + [ + 21746, + -8.413680076599121 + ], + [ + 55, + -8.471096992492676 + ], + [ + 53, + -8.628457069396973 + ], + [ + 16422, + -8.638701438903809 + ], + [ + 7368, + -8.649934768676758 + ], + [ + 52, + -8.768019676208496 + ], + [ + 4823, + -8.77347469329834 + ], + [ + 1427, + -8.936616897583008 + ], + [ + 56, + -8.998169898986816 + ], + [ + 12027, + -9.039971351623535 + ], + [ + 48, + -9.220492362976074 + ], + [ + 263, + -9.454405784606934 + ], + [ + 127906, + -9.623796463012695 + ] + ], + "logprob_of_token": -0.05754948779940605, + "top1_top2_margin": 3.107879627496004, + "top6_top7_margin": 0.8357763290405273 + }, + { + "gen_index": 30, + "token": 49, + "top": [ + [ + 49, + -0.0037667076103389263 + ], + [ + 48, + -6.399537563323975 + ], + [ + 51, + -7.076976299285889 + ], + [ + 53, + -7.712533950805664 + ], + [ + 55, + -8.661931037902832 + ], + [ + 50, + -8.758382797241211 + ], + [ + 57, + -9.794013023376465 + ], + [ + 263, + -9.811545372009277 + ], + [ + 52, + -10.078304290771484 + ], + [ + 32, + -10.476591110229492 + ], + [ + 127906, + -10.891615867614746 + ], + [ + 10, + -10.977104187011719 + ], + [ + 56, + -11.424344062805176 + ], + [ + 54, + -11.525392532348633 + ], + [ + 44, + -11.570719718933105 + ], + [ + 120007, + -11.840913772583008 + ], + [ + 46, + -12.051863670349121 + ], + [ + 766, + -12.260921478271484 + ], + [ + 294, + -12.578714370727539 + ], + [ + 63, + -12.76759147644043 + ] + ], + "logprob_of_token": -0.0037667076103389263, + "top1_top2_margin": 6.395770855713636, + "top6_top7_margin": 1.035630226135254 + }, + { + "gen_index": 31, + "token": 44, + "top": [ + [ + 44, + -0.003360128728672862 + ], + [ + 263, + -6.499362468719482 + ], + [ + 10, + -8.14769172668457 + ], + [ + 120007, + -8.731720924377441 + ], + [ + 46, + -8.773417472839355 + ], + [ + 275, + -9.256829261779785 + ], + [ + 120016, + -9.423718452453613 + ], + [ + 127906, + -9.461344718933105 + ], + [ + 766, + -9.593433380126953 + ], + [ + 121119, + -10.023233413696289 + ], + [ + 1829, + -10.078298568725586 + ], + [ + 14188, + -10.141622543334961 + ], + [ + 286, + -10.200352668762207 + ], + [ + 58, + -10.241419792175293 + ], + [ + 120028, + -10.29602336883545 + ], + [ + 988, + -10.4802885055542 + ], + [ + 59, + -10.615851402282715 + ], + [ + 124969, + -10.75730037689209 + ], + [ + 63, + -10.865551948547363 + ], + [ + 120468, + -11.073074340820312 + ] + ], + "logprob_of_token": -0.003360128728672862, + "top1_top2_margin": 6.49600233999081, + "top6_top7_margin": 0.16688919067382812 + } + ] + }, + { + "prompt": "Translation to German: the weather is beautiful today", + "input_ids": [ + 33607, + 318, + 4867, + 58, + 262, + 5995, + 735, + 5445, + 4484 + ], + "generated_ids": [ + 46, + 543, + 5995, + 735, + 33341, + 4484, + 46, + 543, + 5995, + 735, + 5445, + 4484, + 46, + 543, + 5995, + 735, + 33341, + 4484, + 46, + 543, + 5995, + 735, + 5445, + 4484, + 46, + 543, + 5995, + 735, + 33341, + 4484, + 46, + 543 + ], + "rows": [ + { + "gen_index": 0, + "token": 46, + "top": [ + [ + 46, + -1.1050755977630615 + ], + [ + 275, + -1.3775125741958618 + ], + [ + 4484, + -1.4435184001922607 + ], + [ + 314, + -2.799168348312378 + ], + [ + 262, + -3.6562650203704834 + ], + [ + 33, + -4.085268020629883 + ], + [ + 44, + -4.581437587738037 + ], + [ + 2519, + -4.767105579376221 + ], + [ + 4679, + -5.779081344604492 + ], + [ + 735, + -5.8423638343811035 + ], + [ + 22648, + -6.133277416229248 + ], + [ + 14188, + -6.189225673675537 + ], + [ + 4137, + -6.218161106109619 + ], + [ + 36209, + -6.628572940826416 + ], + [ + 15299, + -6.7016215324401855 + ], + [ + 10, + -6.754727840423584 + ], + [ + 263, + -6.804243564605713 + ], + [ + 766, + -6.914666175842285 + ], + [ + 14792, + -6.917995929718018 + ], + [ + 1829, + -6.923877716064453 + ] + ], + "logprob_of_token": -1.1050755977630615, + "top1_top2_margin": 0.2724369764328003, + "top6_top7_margin": 0.4961695671081543 + }, + { + "gen_index": 1, + "token": 543, + "top": [ + [ + 543, + -0.22090713679790497 + ], + [ + 9093, + -2.8966846466064453 + ], + [ + 14161, + -3.850330352783203 + ], + [ + 120014, + -3.8558349609375 + ], + [ + 127906, + -4.339704513549805 + ], + [ + 3780, + -5.005575180053711 + ], + [ + 1231, + -5.05341911315918 + ], + [ + 669, + -5.288260459899902 + ], + [ + 14147, + -5.368237495422363 + ], + [ + 1336, + -5.483147621154785 + ], + [ + 14896, + -5.579233169555664 + ], + [ + 4484, + -5.640289306640625 + ], + [ + 4759, + -5.842261791229248 + ], + [ + 24775, + -5.9142985343933105 + ], + [ + 1689, + -6.018376350402832 + ], + [ + 120004, + -6.127808094024658 + ], + [ + 7339, + -6.157416343688965 + ], + [ + 766, + -6.319542407989502 + ], + [ + 262, + -6.382192611694336 + ], + [ + 6372, + -6.740750312805176 + ] + ], + "logprob_of_token": -0.22090713679790497, + "top1_top2_margin": 2.6757775098085403, + "top6_top7_margin": 0.04784393310546875 + }, + { + "gen_index": 2, + "token": 5995, + "top": [ + [ + 5995, + -0.16318437457084656 + ], + [ + 14795, + -2.8396999835968018 + ], + [ + 21499, + -3.291565179824829 + ], + [ + 5445, + -4.226339817047119 + ], + [ + 543, + -4.713502883911133 + ], + [ + 8175, + -5.383094787597656 + ], + [ + 36836, + -6.299318790435791 + ], + [ + 4101, + -6.827108860015869 + ], + [ + 33341, + -7.219344615936279 + ], + [ + 24775, + -7.336633205413818 + ], + [ + 8263, + -7.485002517700195 + ], + [ + 14852, + -7.758148670196533 + ], + [ + 262, + -7.934658050537109 + ], + [ + 15893, + -8.008309364318848 + ], + [ + 5848, + -8.16612434387207 + ], + [ + 5954, + -8.335022926330566 + ], + [ + 34210, + -8.345133781433105 + ], + [ + 2935, + -8.368746757507324 + ], + [ + 1460, + -8.393925666809082 + ], + [ + 47805, + -8.431466102600098 + ] + ], + "logprob_of_token": -0.16318437457084656, + "top1_top2_margin": 2.676515609025955, + "top6_top7_margin": 0.9162240028381348 + }, + { + "gen_index": 3, + "token": 735, + "top": [ + [ + 735, + -0.041151512414216995 + ], + [ + 4484, + -3.4406769275665283 + ], + [ + 14950, + -5.942355632781982 + ], + [ + 439, + -6.623321056365967 + ], + [ + 622, + -7.4940571784973145 + ], + [ + 378, + -8.449535369873047 + ], + [ + 824, + -8.507137298583984 + ], + [ + 22648, + -8.644257545471191 + ], + [ + 18717, + -8.691649436950684 + ], + [ + 919, + -8.908361434936523 + ], + [ + 1503, + -9.137914657592773 + ], + [ + 286, + -9.3365478515625 + ], + [ + 5995, + -9.552993774414062 + ], + [ + 476, + -9.884767532348633 + ], + [ + 7222, + -9.955301284790039 + ], + [ + 52075, + -9.976407051086426 + ], + [ + 14060, + -10.026365280151367 + ], + [ + 5445, + -10.032125473022461 + ], + [ + 766, + -10.063672065734863 + ], + [ + 589, + -10.130571365356445 + ] + ], + "logprob_of_token": -0.041151512414216995, + "top1_top2_margin": 3.3995254151523113, + "top6_top7_margin": 0.0576019287109375 + }, + { + "gen_index": 4, + "token": 33341, + "top": [ + [ + 33341, + -0.7670180797576904 + ], + [ + 31642, + -1.8093698024749756 + ], + [ + 5445, + -2.3308160305023193 + ], + [ + 8358, + -2.8262431621551514 + ], + [ + 9162, + -3.7136523723602295 + ], + [ + 14394, + -3.8774325847625732 + ], + [ + 5190, + -3.962458372116089 + ], + [ + 30632, + -4.040456295013428 + ], + [ + 7176, + -4.124571323394775 + ], + [ + 30631, + -4.196866035461426 + ], + [ + 6642, + -4.745794296264648 + ], + [ + 4205, + -4.838137149810791 + ], + [ + 2302, + -4.846118450164795 + ], + [ + 11966, + -4.861865043640137 + ], + [ + 3713, + -5.4418721199035645 + ], + [ + 17602, + -5.444812774658203 + ], + [ + 2272, + -5.678732395172119 + ], + [ + 31946, + -5.797399044036865 + ], + [ + 35672, + -5.933264255523682 + ], + [ + 15675, + -5.9353508949279785 + ] + ], + "logprob_of_token": -0.7670180797576904, + "top1_top2_margin": 1.0423517227172852, + "top6_top7_margin": 0.08502578735351562 + }, + { + "gen_index": 5, + "token": 4484, + "top": [ + [ + 4484, + -0.69214928150177 + ], + [ + 286, + -0.8400585055351257 + ], + [ + 46, + -3.214602470397949 + ], + [ + 44, + -4.551047325134277 + ], + [ + 310, + -5.350272178649902 + ], + [ + 3368, + -5.707193374633789 + ], + [ + 22648, + -7.250174045562744 + ], + [ + 622, + -7.359379291534424 + ], + [ + 262, + -7.554294109344482 + ], + [ + 936, + -7.731977462768555 + ], + [ + 275, + -7.958789348602295 + ], + [ + 59, + -8.053873062133789 + ], + [ + 15853, + -8.084892272949219 + ], + [ + 4101, + -8.556746482849121 + ], + [ + 15299, + -8.691183090209961 + ], + [ + 1744, + -8.756744384765625 + ], + [ + 36209, + -8.777962684631348 + ], + [ + 2213, + -8.780856132507324 + ], + [ + 763, + -8.871992111206055 + ], + [ + 3583, + -8.961918830871582 + ] + ], + "logprob_of_token": -0.69214928150177, + "top1_top2_margin": 0.1479092240333557, + "top6_top7_margin": 1.542980670928955 + }, + { + "gen_index": 6, + "token": 46, + "top": [ + [ + 46, + -0.012268089689314365 + ], + [ + 44, + -5.230855941772461 + ], + [ + 4484, + -5.669576644897461 + ], + [ + 275, + -7.445128440856934 + ], + [ + 262, + -7.662182807922363 + ], + [ + 314, + -7.723201274871826 + ], + [ + 310, + -7.778859615325928 + ], + [ + 59, + -8.533258438110352 + ], + [ + 286, + -8.540815353393555 + ], + [ + 543, + -8.58165454864502 + ], + [ + 120230, + -8.98934268951416 + ], + [ + 14188, + -9.668481826782227 + ], + [ + 1829, + -9.821821212768555 + ], + [ + 12611, + -10.479509353637695 + ], + [ + 33341, + -10.505168914794922 + ], + [ + 36209, + -10.584132194519043 + ], + [ + 766, + -10.591909408569336 + ], + [ + 33, + -10.644943237304688 + ], + [ + 325, + -10.747018814086914 + ], + [ + 936, + -10.806296348571777 + ] + ], + "logprob_of_token": -0.012268089689314365, + "top1_top2_margin": 5.218587852083147, + "top6_top7_margin": 0.05565834045410156 + }, + { + "gen_index": 7, + "token": 543, + "top": [ + [ + 543, + -0.00493592256680131 + ], + [ + 1231, + -6.040314197540283 + ], + [ + 9093, + -6.817230701446533 + ], + [ + 6693, + -8.886303901672363 + ], + [ + 1194, + -9.565781593322754 + ], + [ + 120014, + -9.619565963745117 + ], + [ + 1689, + -9.70644760131836 + ], + [ + 58742, + -9.777853965759277 + ], + [ + 1336, + -10.048067092895508 + ], + [ + 14147, + -10.054159164428711 + ], + [ + 14161, + -10.110210418701172 + ], + [ + 669, + -10.307751655578613 + ], + [ + 127906, + -10.31252670288086 + ], + [ + 1914, + -10.367717742919922 + ], + [ + 3780, + -10.389242172241211 + ], + [ + 1988, + -10.704594612121582 + ], + [ + 24775, + -10.778968811035156 + ], + [ + 5775, + -10.922781944274902 + ], + [ + 14896, + -10.991792678833008 + ], + [ + 766, + -11.006986618041992 + ] + ], + "logprob_of_token": -0.00493592256680131, + "top1_top2_margin": 6.035378274973482, + "top6_top7_margin": 0.08688163757324219 + }, + { + "gen_index": 8, + "token": 5995, + "top": [ + [ + 5995, + -0.06749801337718964 + ], + [ + 14795, + -3.2058591842651367 + ], + [ + 21499, + -4.463512420654297 + ], + [ + 4101, + -7.033167839050293 + ], + [ + 36836, + -7.124513626098633 + ], + [ + 33341, + -7.132485389709473 + ], + [ + 5848, + -7.508442401885986 + ], + [ + 24775, + -7.759319305419922 + ], + [ + 14852, + -7.921724319458008 + ], + [ + 5954, + -8.052752494812012 + ], + [ + 15893, + -8.409805297851562 + ], + [ + 17392, + -8.424056053161621 + ], + [ + 4273, + -8.43734073638916 + ], + [ + 34210, + -8.49781608581543 + ], + [ + 47805, + -8.706940650939941 + ], + [ + 8263, + -8.862198829650879 + ], + [ + 6785, + -8.875767707824707 + ], + [ + 43211, + -9.020541191101074 + ], + [ + 14950, + -9.032639503479004 + ], + [ + 48683, + -9.146828651428223 + ] + ], + "logprob_of_token": -0.06749801337718964, + "top1_top2_margin": 3.138361170887947, + "top6_top7_margin": 0.37595701217651367 + }, + { + "gen_index": 9, + "token": 735, + "top": [ + [ + 735, + -0.00037283694837242365 + ], + [ + 439, + -9.480002403259277 + ], + [ + 4484, + -9.911158561706543 + ], + [ + 919, + -10.96802043914795 + ], + [ + 33341, + -11.016012191772461 + ], + [ + 18717, + -11.281610488891602 + ], + [ + 14950, + -11.405623435974121 + ], + [ + 378, + -11.430094718933105 + ], + [ + 476, + -11.480401039123535 + ], + [ + 824, + -11.49863338470459 + ], + [ + 1309, + -11.911142349243164 + ], + [ + 622, + -12.01522159576416 + ], + [ + 2459, + -12.101667404174805 + ], + [ + 330, + -12.25161075592041 + ], + [ + 1656, + -12.309210777282715 + ], + [ + 11577, + -12.375798225402832 + ], + [ + 589, + -12.574864387512207 + ], + [ + 5445, + -12.645608901977539 + ], + [ + 2286, + -12.841073036193848 + ], + [ + 5607, + -12.965795516967773 + ] + ], + "logprob_of_token": -0.00037283694837242365, + "top1_top2_margin": 9.479629566310905, + "top6_top7_margin": 0.12401294708251953 + }, + { + "gen_index": 10, + "token": 5445, + "top": [ + [ + 5445, + -0.45379430055618286 + ], + [ + 33341, + -1.714457392692566 + ], + [ + 5190, + -3.417680501937866 + ], + [ + 7176, + -3.508295774459839 + ], + [ + 74238, + -3.609715223312378 + ], + [ + 51717, + -3.899278402328491 + ], + [ + 11966, + -4.1803131103515625 + ], + [ + 30631, + -4.617650032043457 + ], + [ + 14394, + -4.876071929931641 + ], + [ + 31642, + -5.443275451660156 + ], + [ + 116858, + -5.706997871398926 + ], + [ + 7143, + -5.780665397644043 + ], + [ + 5657, + -6.391925811767578 + ], + [ + 8358, + -6.483955383300781 + ], + [ + 4205, + -6.766148567199707 + ], + [ + 15114, + -6.981889247894287 + ], + [ + 7833, + -7.077530384063721 + ], + [ + 18686, + -7.0822014808654785 + ], + [ + 2302, + -7.120942115783691 + ], + [ + 118445, + -7.186668872833252 + ] + ], + "logprob_of_token": -0.45379430055618286, + "top1_top2_margin": 1.260663092136383, + "top6_top7_margin": 0.2810347080230713 + }, + { + "gen_index": 11, + "token": 4484, + "top": [ + [ + 4484, + -0.0020790835842490196 + ], + [ + 22648, + -7.144425392150879 + ], + [ + 286, + -9.001628875732422 + ], + [ + 4101, + -9.05389404296875 + ], + [ + 46, + -9.181957244873047 + ], + [ + 15299, + -9.369403839111328 + ], + [ + 53535, + -9.452362060546875 + ], + [ + 4703, + -9.715536117553711 + ], + [ + 5071, + -9.740694046020508 + ], + [ + 318, + -10.175086975097656 + ], + [ + 2549, + -10.194842338562012 + ], + [ + 9093, + -10.225798606872559 + ], + [ + 1806, + -10.626323699951172 + ], + [ + 44, + -10.694219589233398 + ], + [ + 262, + -11.058072090148926 + ], + [ + 33341, + -11.064962387084961 + ], + [ + 12359, + -11.198923110961914 + ], + [ + 24973, + -11.217817306518555 + ], + [ + 763, + -11.301578521728516 + ], + [ + 622, + -11.376596450805664 + ] + ], + "logprob_of_token": -0.0020790835842490196, + "top1_top2_margin": 7.14234630856663, + "top6_top7_margin": 0.08295822143554688 + }, + { + "gen_index": 12, + "token": 46, + "top": [ + [ + 46, + -0.0012467523338273168 + ], + [ + 275, + -7.223470211029053 + ], + [ + 314, + -8.366216659545898 + ], + [ + 4484, + -10.17503833770752 + ], + [ + 44, + -10.232458114624023 + ], + [ + 36209, + -10.579851150512695 + ], + [ + 120230, + -10.80762767791748 + ], + [ + 4137, + -11.178387641906738 + ], + [ + 120099, + -11.388138771057129 + ], + [ + 120007, + -11.91576099395752 + ], + [ + 115, + -11.94143009185791 + ], + [ + 286, + -11.954569816589355 + ], + [ + 5071, + -12.100329399108887 + ], + [ + 543, + -12.24202823638916 + ], + [ + 63, + -12.310025215148926 + ], + [ + 262, + -12.367911338806152 + ], + [ + 735, + -12.394265174865723 + ], + [ + 120078, + -12.501082420349121 + ], + [ + 120000, + -12.596631050109863 + ], + [ + 59, + -12.600285530090332 + ] + ], + "logprob_of_token": -0.0012467523338273168, + "top1_top2_margin": 7.222223458695225, + "top6_top7_margin": 0.22777652740478516 + }, + { + "gen_index": 13, + "token": 543, + "top": [ + [ + 543, + -0.0005514353979378939 + ], + [ + 1231, + -9.538972854614258 + ], + [ + 120014, + -9.73277759552002 + ], + [ + 9093, + -10.0098295211792 + ], + [ + 1047, + -10.606405258178711 + ], + [ + 1336, + -10.67292308807373 + ], + [ + 1689, + -10.962242126464844 + ], + [ + 669, + -10.99664306640625 + ], + [ + 14161, + -11.062104225158691 + ], + [ + 1194, + -11.221902847290039 + ], + [ + 127906, + -11.337005615234375 + ], + [ + 6693, + -11.348845481872559 + ], + [ + 14147, + -11.42398452758789 + ], + [ + 7510, + -11.639019012451172 + ], + [ + 325, + -11.745104789733887 + ], + [ + 766, + -11.89031982421875 + ], + [ + 1438, + -11.890527725219727 + ], + [ + 3780, + -11.926475524902344 + ], + [ + 1988, + -11.927679061889648 + ], + [ + 24775, + -11.978816986083984 + ] + ], + "logprob_of_token": -0.0005514353979378939, + "top1_top2_margin": 9.53842141921632, + "top6_top7_margin": 0.2893190383911133 + }, + { + "gen_index": 14, + "token": 5995, + "top": [ + [ + 5995, + -0.46804097294807434 + ], + [ + 24775, + -5.482840061187744 + ], + [ + 30279, + -5.894724369049072 + ], + [ + 11268, + -5.900658130645752 + ], + [ + 41801, + -6.931631565093994 + ], + [ + 14795, + -6.988574028015137 + ], + [ + 527, + -7.246176242828369 + ], + [ + 21499, + -7.344478130340576 + ], + [ + 262, + -7.355576992034912 + ], + [ + 3515, + -7.816516399383545 + ], + [ + 33341, + -7.837042331695557 + ], + [ + 3143, + -7.863790035247803 + ], + [ + 11053, + -7.905999660491943 + ], + [ + 851, + -7.911478519439697 + ], + [ + 22847, + -7.9537672996521 + ], + [ + 61599, + -7.98191499710083 + ], + [ + 1460, + -7.986125469207764 + ], + [ + 5954, + -8.040227890014648 + ], + [ + 543, + -8.07016372680664 + ], + [ + 4484, + -8.116198539733887 + ] + ], + "logprob_of_token": -0.46804097294807434, + "top1_top2_margin": 5.01479908823967, + "top6_top7_margin": 0.2576022148132324 + }, + { + "gen_index": 15, + "token": 735, + "top": [ + [ + 735, + -0.0005807178094983101 + ], + [ + 33341, + -9.240635871887207 + ], + [ + 5995, + -9.350007057189941 + ], + [ + 46, + -10.226544380187988 + ], + [ + 44, + -11.069413185119629 + ], + [ + 58, + -11.178385734558105 + ], + [ + 2459, + -11.318851470947266 + ], + [ + 4484, + -11.34669017791748 + ], + [ + 14950, + -11.455962181091309 + ], + [ + 14896, + -11.514361381530762 + ], + [ + 622, + -11.541850090026855 + ], + [ + 5445, + -11.816008567810059 + ], + [ + 36836, + -11.926041603088379 + ], + [ + 527, + -11.94997501373291 + ], + [ + 378, + -12.044307708740234 + ], + [ + 439, + -12.080911636352539 + ], + [ + 919, + -12.163201332092285 + ], + [ + 120007, + -12.163590431213379 + ], + [ + 330, + -12.191971778869629 + ], + [ + 286, + -12.196002006530762 + ] + ], + "logprob_of_token": -0.0005807178094983101, + "top1_top2_margin": 9.240055154077709, + "top6_top7_margin": 0.14046573638916016 + }, + { + "gen_index": 16, + "token": 33341, + "top": [ + [ + 33341, + -0.4252980649471283 + ], + [ + 5445, + -1.1212161779403687 + ], + [ + 7176, + -6.062510013580322 + ], + [ + 31642, + -6.3457112312316895 + ], + [ + 11966, + -6.594090938568115 + ], + [ + 14394, + -6.638243198394775 + ], + [ + 9162, + -7.12634801864624 + ], + [ + 8358, + -7.332622051239014 + ], + [ + 2302, + -7.396718502044678 + ], + [ + 36836, + -7.766530513763428 + ], + [ + 7143, + -7.821345806121826 + ], + [ + 30631, + -7.871368408203125 + ], + [ + 74238, + -7.9263129234313965 + ], + [ + 5190, + -7.9618821144104 + ], + [ + 51717, + -8.000274658203125 + ], + [ + 30632, + -8.08521842956543 + ], + [ + 7107, + -8.399130821228027 + ], + [ + 58742, + -8.637176513671875 + ], + [ + 3713, + -8.795193672180176 + ], + [ + 116858, + -8.826164245605469 + ] + ], + "logprob_of_token": -0.4252980649471283, + "top1_top2_margin": 0.6959181129932404, + "top6_top7_margin": 0.48810482025146484 + }, + { + "gen_index": 17, + "token": 4484, + "top": [ + [ + 4484, + -0.00021644789376296103 + ], + [ + 4101, + -9.965470314025879 + ], + [ + 4703, + -10.57286548614502 + ], + [ + 22648, + -10.784586906433105 + ], + [ + 53535, + -11.024184226989746 + ], + [ + 286, + -11.080294609069824 + ], + [ + 9093, + -11.25435733795166 + ], + [ + 33341, + -11.582464218139648 + ], + [ + 15299, + -11.851149559020996 + ], + [ + 44, + -12.3026762008667 + ], + [ + 46, + -12.313982009887695 + ], + [ + 4774, + -12.601446151733398 + ], + [ + 5071, + -12.752388954162598 + ], + [ + 12359, + -12.769110679626465 + ], + [ + 262, + -12.962226867675781 + ], + [ + 5995, + -13.108893394470215 + ], + [ + 1744, + -13.133411407470703 + ], + [ + 735, + -13.200081825256348 + ], + [ + 5445, + -13.310209274291992 + ], + [ + 2548, + -13.59256649017334 + ] + ], + "logprob_of_token": -0.00021644789376296103, + "top1_top2_margin": 9.965253866132116, + "top6_top7_margin": 0.17406272888183594 + }, + { + "gen_index": 18, + "token": 46, + "top": [ + [ + 46, + -0.0014788709813728929 + ], + [ + 275, + -7.293149471282959 + ], + [ + 314, + -8.613734245300293 + ], + [ + 44, + -9.47753620147705 + ], + [ + 120230, + -9.976410865783691 + ], + [ + 36209, + -9.993945121765137 + ], + [ + 120007, + -10.124712944030762 + ], + [ + 4484, + -10.469499588012695 + ], + [ + 543, + -10.6467866897583 + ], + [ + 4137, + -10.834619522094727 + ], + [ + 735, + -10.932988166809082 + ], + [ + 63, + -11.175505638122559 + ], + [ + 3545, + -11.225421905517578 + ], + [ + 262, + -11.25198745727539 + ], + [ + 33, + -11.301758766174316 + ], + [ + 120099, + -11.387726783752441 + ], + [ + 120016, + -11.400444030761719 + ], + [ + 325, + -11.536375999450684 + ], + [ + 58, + -11.540136337280273 + ], + [ + 286, + -11.619229316711426 + ] + ], + "logprob_of_token": -0.0014788709813728929, + "top1_top2_margin": 7.291670600301586, + "top6_top7_margin": 0.130767822265625 + }, + { + "gen_index": 19, + "token": 543, + "top": [ + [ + 543, + -0.0006165020167827606 + ], + [ + 1047, + -9.67673110961914 + ], + [ + 120014, + -9.727027893066406 + ], + [ + 1689, + -10.185393333435059 + ], + [ + 1231, + -10.32180118560791 + ], + [ + 14147, + -10.341679573059082 + ], + [ + 14161, + -10.688722610473633 + ], + [ + 9093, + -10.731539726257324 + ], + [ + 127906, + -10.79261589050293 + ], + [ + 1194, + -10.880819320678711 + ], + [ + 669, + -11.259742736816406 + ], + [ + 1438, + -11.281800270080566 + ], + [ + 1336, + -11.374874114990234 + ], + [ + 2297, + -11.395437240600586 + ], + [ + 120004, + -11.397930145263672 + ], + [ + 6693, + -11.429635047912598 + ], + [ + 262, + -11.469767570495605 + ], + [ + 1914, + -11.503902435302734 + ], + [ + 611, + -11.506790161132812 + ], + [ + 1988, + -11.951663970947266 + ] + ], + "logprob_of_token": -0.0006165020167827606, + "top1_top2_margin": 9.676114607602358, + "top6_top7_margin": 0.3470430374145508 + }, + { + "gen_index": 20, + "token": 5995, + "top": [ + [ + 5995, + -0.28214338421821594 + ], + [ + 24775, + -5.646683216094971 + ], + [ + 11268, + -6.081058025360107 + ], + [ + 30279, + -6.227656841278076 + ], + [ + 262, + -7.008951187133789 + ], + [ + 41801, + -7.080395698547363 + ], + [ + 527, + -7.191055774688721 + ], + [ + 14795, + -7.241788864135742 + ], + [ + 33341, + -7.6481733322143555 + ], + [ + 32, + -7.717845916748047 + ], + [ + 61599, + -7.767543792724609 + ], + [ + 21499, + -7.889151096343994 + ], + [ + 851, + -7.905618667602539 + ], + [ + 3515, + -8.019462585449219 + ], + [ + 4484, + -8.134878158569336 + ], + [ + 1460, + -8.22006893157959 + ], + [ + 11053, + -8.255594253540039 + ], + [ + 4101, + -8.27274227142334 + ], + [ + 5954, + -8.283493995666504 + ], + [ + 36836, + -8.301236152648926 + ] + ], + "logprob_of_token": -0.28214338421821594, + "top1_top2_margin": 5.364539831876755, + "top6_top7_margin": 0.11066007614135742 + }, + { + "gen_index": 21, + "token": 735, + "top": [ + [ + 735, + -0.00041654438246041536 + ], + [ + 5445, + -9.880579948425293 + ], + [ + 46, + -10.33442211151123 + ], + [ + 5995, + -10.561641693115234 + ], + [ + 58, + -10.99756145477295 + ], + [ + 2459, + -11.283858299255371 + ], + [ + 8175, + -11.367953300476074 + ], + [ + 4484, + -11.571345329284668 + ], + [ + 44, + -11.582867622375488 + ], + [ + 14896, + -11.72933292388916 + ], + [ + 263, + -11.816056251525879 + ], + [ + 622, + -11.882035255432129 + ], + [ + 120007, + -11.910676002502441 + ], + [ + 824, + -12.066141128540039 + ], + [ + 476, + -12.100837707519531 + ], + [ + 919, + -12.130280494689941 + ], + [ + 527, + -12.188429832458496 + ], + [ + 439, + -12.279475212097168 + ], + [ + 33341, + -12.339150428771973 + ], + [ + 568, + -12.365006446838379 + ] + ], + "logprob_of_token": -0.00041654438246041536, + "top1_top2_margin": 9.880163404042833, + "top6_top7_margin": 0.08409500122070312 + }, + { + "gen_index": 22, + "token": 5445, + "top": [ + [ + 5445, + -0.0232845526188612 + ], + [ + 33341, + -3.902104139328003 + ], + [ + 14394, + -8.411730766296387 + ], + [ + 7176, + -8.458907127380371 + ], + [ + 11966, + -8.477835655212402 + ], + [ + 7143, + -9.085636138916016 + ], + [ + 31642, + -9.163802146911621 + ], + [ + 2302, + -9.326166152954102 + ], + [ + 8175, + -9.333148956298828 + ], + [ + 38183, + -9.412450790405273 + ], + [ + 74238, + -9.73835277557373 + ], + [ + 79608, + -9.92546272277832 + ], + [ + 5190, + -10.030405044555664 + ], + [ + 9162, + -10.115976333618164 + ], + [ + 5657, + -10.138641357421875 + ], + [ + 51717, + -10.142329216003418 + ], + [ + 7107, + -10.20447826385498 + ], + [ + 30631, + -10.215797424316406 + ], + [ + 8358, + -10.352165222167969 + ], + [ + 36836, + -10.473732948303223 + ] + ], + "logprob_of_token": -0.0232845526188612, + "top1_top2_margin": 3.8788195867091417, + "top6_top7_margin": 0.07816600799560547 + }, + { + "gen_index": 23, + "token": 4484, + "top": [ + [ + 4484, + -0.0003586458624340594 + ], + [ + 4703, + -9.499863624572754 + ], + [ + 22648, + -9.8574857711792 + ], + [ + 263, + -11.100568771362305 + ], + [ + 53535, + -11.124176025390625 + ], + [ + 4101, + -11.372909545898438 + ], + [ + 9093, + -11.509079933166504 + ], + [ + 2548, + -11.80743408203125 + ], + [ + 5995, + -11.934274673461914 + ], + [ + 15299, + -11.948602676391602 + ], + [ + 10, + -11.970422744750977 + ], + [ + 24973, + -12.014684677124023 + ], + [ + 262, + -12.11398696899414 + ], + [ + 33341, + -12.32107162475586 + ], + [ + 1744, + -12.390768051147461 + ], + [ + 65560, + -12.462150573730469 + ], + [ + 622, + -12.484623908996582 + ], + [ + 12359, + -12.492673873901367 + ], + [ + 127906, + -12.685955047607422 + ], + [ + 59099, + -12.755781173706055 + ] + ], + "logprob_of_token": -0.0003586458624340594, + "top1_top2_margin": 9.49950497871032, + "top6_top7_margin": 0.1361703872680664 + }, + { + "gen_index": 24, + "token": 46, + "top": [ + [ + 46, + -0.0007479006890207529 + ], + [ + 275, + -7.850764751434326 + ], + [ + 314, + -9.713052749633789 + ], + [ + 36209, + -10.456523895263672 + ], + [ + 44, + -10.68846321105957 + ], + [ + 735, + -11.05543327331543 + ], + [ + 120007, + -11.212103843688965 + ], + [ + 4484, + -11.282207489013672 + ], + [ + 4137, + -11.371125221252441 + ], + [ + 33, + -11.592246055603027 + ], + [ + 120099, + -11.71096420288086 + ], + [ + 120230, + -11.763956069946289 + ], + [ + 59, + -11.788722038269043 + ], + [ + 58, + -11.82295036315918 + ], + [ + 120001, + -11.855415344238281 + ], + [ + 543, + -11.85871696472168 + ], + [ + 262, + -11.859893798828125 + ], + [ + 63, + -12.018684387207031 + ], + [ + 286, + -12.023395538330078 + ], + [ + 120000, + -12.051138877868652 + ] + ], + "logprob_of_token": -0.0007479006890207529, + "top1_top2_margin": 7.850016850745305, + "top6_top7_margin": 0.15667057037353516 + }, + { + "gen_index": 25, + "token": 543, + "top": [ + [ + 543, + -0.0007612025365233421 + ], + [ + 1047, + -8.153302192687988 + ], + [ + 1438, + -9.995595932006836 + ], + [ + 120014, + -10.053260803222656 + ], + [ + 262, + -10.401847839355469 + ], + [ + 24775, + -10.442947387695312 + ], + [ + 1689, + -10.671098709106445 + ], + [ + 1231, + -10.674593925476074 + ], + [ + 127906, + -10.764137268066406 + ], + [ + 2297, + -10.806937217712402 + ], + [ + 1194, + -10.941788673400879 + ], + [ + 325, + -11.38902759552002 + ], + [ + 5995, + -11.429731369018555 + ], + [ + 669, + -11.69773006439209 + ], + [ + 14161, + -12.078781127929688 + ], + [ + 1336, + -12.08117389678955 + ], + [ + 4954, + -12.093324661254883 + ], + [ + 6693, + -12.15919303894043 + ], + [ + 32, + -12.26862907409668 + ], + [ + 14896, + -12.278697967529297 + ] + ], + "logprob_of_token": -0.0007612025365233421, + "top1_top2_margin": 8.152540990151465, + "top6_top7_margin": 0.2281513214111328 + }, + { + "gen_index": 26, + "token": 5995, + "top": [ + [ + 5995, + -0.07919774949550629 + ], + [ + 24775, + -5.919349670410156 + ], + [ + 11268, + -6.315591335296631 + ], + [ + 30279, + -6.659878253936768 + ], + [ + 41801, + -7.402411460876465 + ], + [ + 262, + -7.841686248779297 + ], + [ + 32, + -7.999003887176514 + ], + [ + 527, + -8.181597709655762 + ], + [ + 61599, + -8.184191703796387 + ], + [ + 14795, + -8.447006225585938 + ], + [ + 2554, + -8.846450805664062 + ], + [ + 3515, + -8.858295440673828 + ], + [ + 82241, + -8.865017890930176 + ], + [ + 21499, + -8.985331535339355 + ], + [ + 1460, + -9.031805038452148 + ], + [ + 543, + -9.059547424316406 + ], + [ + 735, + -9.075826644897461 + ], + [ + 33341, + -9.099246978759766 + ], + [ + 1324, + -9.11196231842041 + ], + [ + 851, + -9.139408111572266 + ] + ], + "logprob_of_token": -0.07919774949550629, + "top1_top2_margin": 5.84015192091465, + "top6_top7_margin": 0.1573176383972168 + }, + { + "gen_index": 27, + "token": 735, + "top": [ + [ + 735, + -0.0014072420308366418 + ], + [ + 33341, + -8.103029251098633 + ], + [ + 46, + -9.566289901733398 + ], + [ + 263, + -9.566988945007324 + ], + [ + 2459, + -10.228185653686523 + ], + [ + 568, + -10.424769401550293 + ], + [ + 58, + -10.655960083007812 + ], + [ + 5995, + -10.753543853759766 + ], + [ + 10, + -10.770384788513184 + ], + [ + 824, + -10.817689895629883 + ], + [ + 127906, + -10.853363037109375 + ], + [ + 58742, + -10.894713401794434 + ], + [ + 476, + -11.246736526489258 + ], + [ + 1309, + -11.450080871582031 + ], + [ + 14896, + -11.47819709777832 + ], + [ + 1656, + -11.49055290222168 + ], + [ + 44, + -11.507061958312988 + ], + [ + 919, + -11.599146842956543 + ], + [ + 527, + -11.659769058227539 + ], + [ + 439, + -11.709025382995605 + ] + ], + "logprob_of_token": -0.0014072420308366418, + "top1_top2_margin": 8.101622009067796, + "top6_top7_margin": 0.23119068145751953 + }, + { + "gen_index": 28, + "token": 33341, + "top": [ + [ + 33341, + -0.06624476611614227 + ], + [ + 5445, + -2.801511526107788 + ], + [ + 58742, + -8.235063552856445 + ], + [ + 11966, + -8.627706527709961 + ], + [ + 51717, + -8.860512733459473 + ], + [ + 74238, + -9.235855102539062 + ], + [ + 38183, + -9.276301383972168 + ], + [ + 31642, + -9.36076831817627 + ], + [ + 98066, + -9.550497055053711 + ], + [ + 7176, + -9.661860466003418 + ], + [ + 36836, + -9.690506935119629 + ], + [ + 100763, + -9.761580467224121 + ], + [ + 116858, + -9.896519660949707 + ], + [ + 44211, + -9.91081428527832 + ], + [ + 14394, + -9.98305606842041 + ], + [ + 30632, + -10.25229549407959 + ], + [ + 102927, + -10.258904457092285 + ], + [ + 79608, + -10.29578685760498 + ], + [ + 64451, + -10.418246269226074 + ], + [ + 30076, + -10.431395530700684 + ] + ], + "logprob_of_token": -0.06624476611614227, + "top1_top2_margin": 2.735266759991646, + "top6_top7_margin": 0.04044628143310547 + }, + { + "gen_index": 29, + "token": 4484, + "top": [ + [ + 4484, + -0.0012459168210625648 + ], + [ + 4703, + -7.972997188568115 + ], + [ + 263, + -8.169120788574219 + ], + [ + 10, + -9.497076034545898 + ], + [ + 22648, + -9.80154800415039 + ], + [ + 53535, + -10.146397590637207 + ], + [ + 9093, + -10.670491218566895 + ], + [ + 12359, + -10.81676197052002 + ], + [ + 262, + -10.896496772766113 + ], + [ + 24973, + -10.907434463500977 + ], + [ + 4101, + -10.927860260009766 + ], + [ + 65560, + -11.079668045043945 + ], + [ + 46, + -11.142589569091797 + ], + [ + 127906, + -11.184425354003906 + ], + [ + 5995, + -11.19392204284668 + ], + [ + 32, + -11.30613899230957 + ], + [ + 25250, + -11.425817489624023 + ], + [ + 735, + -11.68612289428711 + ], + [ + 1744, + -11.787208557128906 + ], + [ + 80867, + -12.002912521362305 + ] + ], + "logprob_of_token": -0.0012459168210625648, + "top1_top2_margin": 7.971751271747053, + "top6_top7_margin": 0.5240936279296875 + }, + { + "gen_index": 30, + "token": 46, + "top": [ + [ + 46, + -0.0020730511751025915 + ], + [ + 275, + -6.624024391174316 + ], + [ + 314, + -8.047683715820312 + ], + [ + 36209, + -9.741077423095703 + ], + [ + 4137, + -10.50115966796875 + ], + [ + 263, + -10.942302703857422 + ], + [ + 120099, + -11.005245208740234 + ], + [ + 120230, + -11.075876235961914 + ], + [ + 33, + -11.172441482543945 + ], + [ + 120016, + -11.217904090881348 + ], + [ + 120007, + -11.264753341674805 + ], + [ + 120000, + -11.291437149047852 + ], + [ + 10, + -11.323503494262695 + ], + [ + 44, + -11.354264259338379 + ], + [ + 120001, + -11.679144859313965 + ], + [ + 3545, + -11.788854598999023 + ], + [ + 262, + -11.895727157592773 + ], + [ + 543, + -11.944005012512207 + ], + [ + 120002, + -12.000423431396484 + ], + [ + 120078, + -12.029129028320312 + ] + ], + "logprob_of_token": -0.0020730511751025915, + "top1_top2_margin": 6.621951339999214, + "top6_top7_margin": 0.0629425048828125 + }, + { + "gen_index": 31, + "token": 543, + "top": [ + [ + 543, + -0.0018977040890604258 + ], + [ + 1047, + -7.235360145568848 + ], + [ + 24775, + -9.038370132446289 + ], + [ + 1438, + -9.241278648376465 + ], + [ + 120014, + -9.527000427246094 + ], + [ + 2297, + -9.661979675292969 + ], + [ + 127906, + -9.931957244873047 + ], + [ + 262, + -9.978264808654785 + ], + [ + 1689, + -10.347177505493164 + ], + [ + 1194, + -10.459095001220703 + ], + [ + 32, + -10.478646278381348 + ], + [ + 1231, + -10.537544250488281 + ], + [ + 611, + -10.97610092163086 + ], + [ + 14161, + -11.057907104492188 + ], + [ + 6693, + -11.071137428283691 + ], + [ + 669, + -11.116363525390625 + ], + [ + 1914, + -11.122068405151367 + ], + [ + 5995, + -11.232154846191406 + ], + [ + 325, + -11.309112548828125 + ], + [ + 9093, + -11.421590805053711 + ] + ], + "logprob_of_token": -0.0018977040890604258, + "top1_top2_margin": 7.233462441479787, + "top6_top7_margin": 0.2699775695800781 + } + ] + }, + { + "prompt": "Ein gutes Buch liest man am besten", + "input_ids": [ + 1113, + 29597, + 4363, + 51092, + 836, + 10304, + 9798 + ], + "generated_ids": [ + 30135, + 420, + 30134, + 46, + 1496, + 29597, + 4363, + 51092, + 836, + 10304, + 9798, + 30135, + 420, + 30134, + 46, + 1496, + 29597, + 4363, + 51092, + 836, + 10304, + 9798, + 30135, + 420, + 30134, + 46, + 1496, + 29597, + 4363, + 51092, + 836, + 10304 + ], + "rows": [ + { + "gen_index": 0, + "token": 30135, + "top": [ + [ + 30135, + -1.1752110719680786 + ], + [ + 622, + -1.249569058418274 + ], + [ + 913, + -2.2293529510498047 + ], + [ + 44, + -2.8669958114624023 + ], + [ + 120007, + -3.1574220657348633 + ], + [ + 2150, + -3.6212329864501953 + ], + [ + 939, + -4.232629776000977 + ], + [ + 1233, + -4.271480560302734 + ], + [ + 8066, + -4.526023864746094 + ], + [ + 46, + -4.562811851501465 + ], + [ + 52970, + -4.62589168548584 + ], + [ + 4299, + -4.650906562805176 + ], + [ + 24439, + -4.780928611755371 + ], + [ + 2625, + -5.097556114196777 + ], + [ + 1409, + -5.210165977478027 + ], + [ + 63, + -5.814115524291992 + ], + [ + 7314, + -5.8216142654418945 + ], + [ + 861, + -5.936429977416992 + ], + [ + 2361, + -6.051478385925293 + ], + [ + 10304, + -6.068352699279785 + ] + ], + "logprob_of_token": -1.1752110719680786, + "top1_top2_margin": 0.07435798645019531, + "top6_top7_margin": 0.6113967895507812 + }, + { + "gen_index": 1, + "token": 420, + "top": [ + [ + 420, + -1.0593405961990356 + ], + [ + 46, + -1.137900471687317 + ], + [ + 44, + -2.0153799057006836 + ], + [ + 275, + -2.703502655029297 + ], + [ + 1829, + -3.132020950317383 + ], + [ + 314, + -3.3474514484405518 + ], + [ + 58, + -4.084753036499023 + ], + [ + 120007, + -4.801302909851074 + ], + [ + 14188, + -5.102904319763184 + ], + [ + 59, + -5.705018997192383 + ], + [ + 10, + -6.0650482177734375 + ], + [ + 263, + -6.32063102722168 + ], + [ + 63, + -6.566944599151611 + ], + [ + 913, + -6.870926856994629 + ], + [ + 120016, + -6.877845287322998 + ], + [ + 14153, + -7.098616123199463 + ], + [ + 766, + -7.348272800445557 + ], + [ + 120022, + -7.5822224617004395 + ], + [ + 861, + -7.641483783721924 + ], + [ + 120021, + -7.739740371704102 + ] + ], + "logprob_of_token": -1.0593405961990356, + "top1_top2_margin": 0.07855987548828125, + "top6_top7_margin": 0.7373015880584717 + }, + { + "gen_index": 2, + "token": 30134, + "top": [ + [ + 30134, + -0.8230197429656982 + ], + [ + 913, + -1.1076496839523315 + ], + [ + 622, + -2.9299561977386475 + ], + [ + 29126, + -3.1336095333099365 + ], + [ + 68909, + -4.26573371887207 + ], + [ + 4299, + -4.312107086181641 + ], + [ + 63061, + -4.548758506774902 + ], + [ + 41537, + -4.662796974182129 + ], + [ + 14515, + -4.840873718261719 + ], + [ + 114838, + -5.059197425842285 + ], + [ + 7314, + -5.2887163162231445 + ], + [ + 26562, + -5.328287124633789 + ], + [ + 9352, + -5.757378578186035 + ], + [ + 107920, + -5.767876625061035 + ], + [ + 55480, + -5.775432586669922 + ], + [ + 45202, + -6.252490043640137 + ], + [ + 15205, + -6.310656547546387 + ], + [ + 75682, + -6.343569755554199 + ], + [ + 32, + -6.389643669128418 + ], + [ + 30135, + -6.423446178436279 + ] + ], + "logprob_of_token": -0.8230197429656982, + "top1_top2_margin": 0.2846299409866333, + "top6_top7_margin": 0.23665142059326172 + }, + { + "gen_index": 3, + "token": 46, + "top": [ + [ + 46, + -0.47151291370391846 + ], + [ + 44, + -1.8335801362991333 + ], + [ + 275, + -2.140695571899414 + ], + [ + 314, + -3.3260631561279297 + ], + [ + 1829, + -3.508643388748169 + ], + [ + 59, + -4.352289199829102 + ], + [ + 420, + -5.613744735717773 + ], + [ + 120007, + -5.775440216064453 + ], + [ + 14188, + -5.910433769226074 + ], + [ + 58, + -6.352657318115234 + ], + [ + 913, + -7.320557117462158 + ], + [ + 120016, + -7.461504936218262 + ], + [ + 10, + -7.646958827972412 + ], + [ + 63, + -7.706263065338135 + ], + [ + 263, + -7.738394737243652 + ], + [ + 120000, + -7.824571132659912 + ], + [ + 14153, + -7.8411760330200195 + ], + [ + 493, + -8.271681785583496 + ], + [ + 766, + -8.453155517578125 + ], + [ + 120021, + -8.788883209228516 + ] + ], + "logprob_of_token": -0.47151291370391846, + "top1_top2_margin": 1.3620672225952148, + "top6_top7_margin": 1.2614555358886719 + }, + { + "gen_index": 4, + "token": 1496, + "top": [ + [ + 1496, + -1.6660122871398926 + ], + [ + 3280, + -1.9103493690490723 + ], + [ + 2896, + -1.97855806350708 + ], + [ + 5084, + -2.5292763710021973 + ], + [ + 5289, + -2.6981406211853027 + ], + [ + 33573, + -3.2557597160339355 + ], + [ + 10694, + -3.3610310554504395 + ], + [ + 6336, + -3.8166565895080566 + ], + [ + 1220, + -3.862788677215576 + ], + [ + 1438, + -3.960448741912842 + ], + [ + 2297, + -4.001105785369873 + ], + [ + 97170, + -4.234951496124268 + ], + [ + 16242, + -4.241326808929443 + ], + [ + 9783, + -4.42234468460083 + ], + [ + 120014, + -4.575928211212158 + ], + [ + 2121, + -4.693348407745361 + ], + [ + 29181, + -4.975894451141357 + ], + [ + 44871, + -5.004374980926514 + ], + [ + 1047, + -5.0829644203186035 + ], + [ + 61335, + -5.350722789764404 + ] + ], + "logprob_of_token": -1.6660122871398926, + "top1_top2_margin": 0.2443370819091797, + "top6_top7_margin": 0.1052713394165039 + }, + { + "gen_index": 5, + "token": 29597, + "top": [ + [ + 29597, + -0.8249210715293884 + ], + [ + 4363, + -1.795899748802185 + ], + [ + 20263, + -2.298239231109619 + ], + [ + 6290, + -2.562865734100342 + ], + [ + 126713, + -3.612278461456299 + ], + [ + 29566, + -4.306111812591553 + ], + [ + 125733, + -4.4844536781311035 + ], + [ + 64544, + -4.76382303237915 + ], + [ + 76183, + -4.862557888031006 + ], + [ + 71506, + -4.915619373321533 + ], + [ + 4835, + -5.1308913230896 + ], + [ + 112499, + -5.172145366668701 + ], + [ + 11556, + -5.305777072906494 + ], + [ + 37669, + -5.345370769500732 + ], + [ + 94773, + -5.69325590133667 + ], + [ + 69939, + -5.787463665008545 + ], + [ + 9115, + -6.013187885284424 + ], + [ + 69370, + -6.0280375480651855 + ], + [ + 69735, + -6.088881015777588 + ], + [ + 8747, + -6.107729434967041 + ] + ], + "logprob_of_token": -0.8249210715293884, + "top1_top2_margin": 0.9709786772727966, + "top6_top7_margin": 0.17834186553955078 + }, + { + "gen_index": 6, + "token": 4363, + "top": [ + [ + 4363, + -0.07335212826728821 + ], + [ + 6896, + -3.56475567817688 + ], + [ + 65813, + -4.831501007080078 + ], + [ + 22580, + -5.197944164276123 + ], + [ + 37669, + -5.516625881195068 + ], + [ + 1618, + -6.074470520019531 + ], + [ + 27532, + -6.4490275382995605 + ], + [ + 29597, + -6.8804755210876465 + ], + [ + 35774, + -6.984523296356201 + ], + [ + 107837, + -7.021317005157471 + ], + [ + 69191, + -7.102543830871582 + ], + [ + 9515, + -7.173126697540283 + ], + [ + 3891, + -7.36716890335083 + ], + [ + 31155, + -7.4541401863098145 + ], + [ + 9024, + -7.813931465148926 + ], + [ + 5474, + -7.8488874435424805 + ], + [ + 12324, + -7.85652494430542 + ], + [ + 3717, + -7.934571743011475 + ], + [ + 5052, + -8.061210632324219 + ], + [ + 58951, + -8.097461700439453 + ] + ], + "logprob_of_token": -0.07335212826728821, + "top1_top2_margin": 3.4914035499095917, + "top6_top7_margin": 0.3745570182800293 + }, + { + "gen_index": 7, + "token": 51092, + "top": [ + [ + 51092, + -1.7325462102890015 + ], + [ + 2459, + -2.2159628868103027 + ], + [ + 2790, + -2.374760866165161 + ], + [ + 6501, + -3.2238736152648926 + ], + [ + 14515, + -3.4302916526794434 + ], + [ + 12364, + -3.496230363845825 + ], + [ + 1826, + -3.617438793182373 + ], + [ + 968, + -3.715226650238037 + ], + [ + 6326, + -3.796922206878662 + ], + [ + 27076, + -3.8223624229431152 + ], + [ + 24699, + -3.8340439796447754 + ], + [ + 48551, + -3.8392434120178223 + ], + [ + 98839, + -3.873626232147217 + ], + [ + 2941, + -3.9172492027282715 + ], + [ + 23097, + -3.9722683429718018 + ], + [ + 24113, + -4.05585241317749 + ], + [ + 54545, + -4.20756196975708 + ], + [ + 11757, + -4.241383075714111 + ], + [ + 6727, + -4.537486553192139 + ], + [ + 26735, + -4.608250141143799 + ] + ], + "logprob_of_token": -1.7325462102890015, + "top1_top2_margin": 0.48341667652130127, + "top6_top7_margin": 0.12120842933654785 + }, + { + "gen_index": 8, + "token": 836, + "top": [ + [ + 836, + -0.017659954726696014 + ], + [ + 845, + -4.10515022277832 + ], + [ + 2256, + -7.476178169250488 + ], + [ + 948, + -9.596965789794922 + ], + [ + 346, + -10.27616024017334 + ], + [ + 922, + -10.582736015319824 + ], + [ + 1195, + -10.818521499633789 + ], + [ + 518, + -11.073835372924805 + ], + [ + 3750, + -11.111919403076172 + ], + [ + 1241, + -11.151714324951172 + ], + [ + 939, + -11.195682525634766 + ], + [ + 11536, + -11.285091400146484 + ], + [ + 120007, + -11.318931579589844 + ], + [ + 7314, + -11.41506576538086 + ], + [ + 25912, + -11.589656829833984 + ], + [ + 9122, + -11.596806526184082 + ], + [ + 84124, + -11.675881385803223 + ], + [ + 44, + -11.72027587890625 + ], + [ + 1178, + -11.805337905883789 + ], + [ + 6443, + -11.859755516052246 + ] + ], + "logprob_of_token": -0.017659954726696014, + "top1_top2_margin": 4.087490268051624, + "top6_top7_margin": 0.23578548431396484 + }, + { + "gen_index": 9, + "token": 10304, + "top": [ + [ + 10304, + -0.48940789699554443 + ], + [ + 939, + -1.7385801076889038 + ], + [ + 30135, + -2.214844226837158 + ], + [ + 913, + -4.042539119720459 + ], + [ + 14581, + -4.367908954620361 + ], + [ + 1195, + -4.690634250640869 + ], + [ + 34291, + -5.028660297393799 + ], + [ + 44, + -5.231908321380615 + ], + [ + 7314, + -5.376057147979736 + ], + [ + 622, + -5.443079471588135 + ], + [ + 3504, + -5.5417304039001465 + ], + [ + 41769, + -5.686669826507568 + ], + [ + 12967, + -6.010717868804932 + ], + [ + 18830, + -6.013657093048096 + ], + [ + 845, + -6.326510906219482 + ], + [ + 39721, + -6.358001232147217 + ], + [ + 22991, + -6.431562900543213 + ], + [ + 20812, + -6.78082799911499 + ], + [ + 7799, + -6.847168445587158 + ], + [ + 1410, + -6.903244495391846 + ] + ], + "logprob_of_token": -0.48940789699554443, + "top1_top2_margin": 1.2491722106933594, + "top6_top7_margin": 0.3380260467529297 + }, + { + "gen_index": 10, + "token": 9798, + "top": [ + [ + 9798, + -0.006468309089541435 + ], + [ + 5710, + -5.8165764808654785 + ], + [ + 69462, + -6.543713092803955 + ], + [ + 31987, + -7.565115451812744 + ], + [ + 30135, + -8.809977531433105 + ], + [ + 17799, + -8.811357498168945 + ], + [ + 86709, + -8.979363441467285 + ], + [ + 9933, + -9.202845573425293 + ], + [ + 14445, + -9.231746673583984 + ], + [ + 11228, + -9.610326766967773 + ], + [ + 33107, + -9.932477951049805 + ], + [ + 47093, + -10.089886665344238 + ], + [ + 16994, + -10.526928901672363 + ], + [ + 7524, + -10.539578437805176 + ], + [ + 17353, + -10.636092185974121 + ], + [ + 14627, + -10.67350959777832 + ], + [ + 30134, + -10.736993789672852 + ], + [ + 18476, + -10.77074146270752 + ], + [ + 49790, + -10.878584861755371 + ], + [ + 12909, + -10.964118957519531 + ] + ], + "logprob_of_token": -0.006468309089541435, + "top1_top2_margin": 5.810108171775937, + "top6_top7_margin": 0.16800594329833984 + }, + { + "gen_index": 11, + "token": 30135, + "top": [ + [ + 30135, + -0.11805423349142075 + ], + [ + 622, + -3.7819204330444336 + ], + [ + 913, + -3.877577543258667 + ], + [ + 44, + -4.148164749145508 + ], + [ + 939, + -4.802729606628418 + ], + [ + 8066, + -5.005196571350098 + ], + [ + 30134, + -5.508737564086914 + ], + [ + 4299, + -5.531871795654297 + ], + [ + 120007, + -5.903459548950195 + ], + [ + 1409, + -5.920672416687012 + ], + [ + 7314, + -6.557191848754883 + ], + [ + 2625, + -6.960696220397949 + ], + [ + 14581, + -6.995852470397949 + ], + [ + 14218, + -6.996883392333984 + ], + [ + 24439, + -6.9970808029174805 + ], + [ + 1195, + -7.044038772583008 + ], + [ + 31985, + -7.044974327087402 + ], + [ + 6216, + -7.060898780822754 + ], + [ + 10304, + -7.416294097900391 + ], + [ + 29126, + -7.50223445892334 + ] + ], + "logprob_of_token": -0.11805423349142075, + "top1_top2_margin": 3.663866199553013, + "top6_top7_margin": 0.5035409927368164 + }, + { + "gen_index": 12, + "token": 420, + "top": [ + [ + 420, + -0.07068414986133575 + ], + [ + 46, + -3.407719373703003 + ], + [ + 44, + -3.5770528316497803 + ], + [ + 314, + -6.09935998916626 + ], + [ + 275, + -6.135706424713135 + ], + [ + 1829, + -6.923241138458252 + ], + [ + 59, + -7.713660717010498 + ], + [ + 120007, + -8.991230010986328 + ], + [ + 58, + -9.020639419555664 + ], + [ + 14188, + -9.263805389404297 + ], + [ + 861, + -9.40876293182373 + ], + [ + 63, + -9.706443786621094 + ], + [ + 21689, + -9.823429107666016 + ], + [ + 51092, + -9.969240188598633 + ], + [ + 913, + -10.156858444213867 + ], + [ + 21667, + -10.15933609008789 + ], + [ + 1117, + -10.60848617553711 + ], + [ + 766, + -10.618124008178711 + ], + [ + 10, + -10.852962493896484 + ], + [ + 14153, + -10.885610580444336 + ] + ], + "logprob_of_token": -0.07068414986133575, + "top1_top2_margin": 3.337035223841667, + "top6_top7_margin": 0.7904195785522461 + }, + { + "gen_index": 13, + "token": 30134, + "top": [ + [ + 30134, + -0.025633951649069786 + ], + [ + 913, + -4.949156761169434 + ], + [ + 861, + -6.771671295166016 + ], + [ + 26562, + -6.84102725982666 + ], + [ + 114838, + -7.067055702209473 + ], + [ + 29126, + -7.329255104064941 + ], + [ + 61212, + -7.426103591918945 + ], + [ + 37720, + -7.446596145629883 + ], + [ + 112499, + -7.528664588928223 + ], + [ + 30135, + -7.582066535949707 + ], + [ + 63061, + -7.618879318237305 + ], + [ + 622, + -7.630954742431641 + ], + [ + 4299, + -7.709151268005371 + ], + [ + 94773, + -8.017538070678711 + ], + [ + 15205, + -8.05550765991211 + ], + [ + 5222, + -8.157055854797363 + ], + [ + 112546, + -8.165657997131348 + ], + [ + 31985, + -8.172392845153809 + ], + [ + 19962, + -8.361316680908203 + ], + [ + 7314, + -8.37525463104248 + ] + ], + "logprob_of_token": -0.025633951649069786, + "top1_top2_margin": 4.923522809520364, + "top6_top7_margin": 0.0968484878540039 + }, + { + "gen_index": 14, + "token": 46, + "top": [ + [ + 46, + -0.5199297070503235 + ], + [ + 44, + -1.600157618522644 + ], + [ + 275, + -2.112870931625366 + ], + [ + 314, + -3.4467437267303467 + ], + [ + 420, + -3.990497350692749 + ], + [ + 1829, + -4.513326644897461 + ], + [ + 59, + -5.498587608337402 + ], + [ + 63, + -5.861505508422852 + ], + [ + 120007, + -6.500164985656738 + ], + [ + 14188, + -6.686309337615967 + ], + [ + 913, + -7.0356292724609375 + ], + [ + 21667, + -7.186286449432373 + ], + [ + 36209, + -7.543760776519775 + ], + [ + 766, + -7.728221893310547 + ], + [ + 51092, + -7.993165969848633 + ], + [ + 33, + -8.045132637023926 + ], + [ + 21689, + -8.097177505493164 + ], + [ + 27532, + -8.145842552185059 + ], + [ + 4137, + -8.151885986328125 + ], + [ + 1521, + -8.210395812988281 + ] + ], + "logprob_of_token": -0.5199297070503235, + "top1_top2_margin": 1.0802279114723206, + "top6_top7_margin": 0.9852609634399414 + }, + { + "gen_index": 15, + "token": 1496, + "top": [ + [ + 1496, + -0.10688314586877823 + ], + [ + 97170, + -4.456467628479004 + ], + [ + 2896, + -4.939138412475586 + ], + [ + 1438, + -5.203757286071777 + ], + [ + 120014, + -5.227646827697754 + ], + [ + 33573, + -5.385829925537109 + ], + [ + 3280, + -5.50438117980957 + ], + [ + 9783, + -5.649306297302246 + ], + [ + 44895, + -5.721900939941406 + ], + [ + 5289, + -6.049057960510254 + ], + [ + 21734, + -6.161826133728027 + ], + [ + 1047, + -6.201045989990234 + ], + [ + 5084, + -6.319664001464844 + ], + [ + 2121, + -6.326111793518066 + ], + [ + 766, + -6.4757184982299805 + ], + [ + 32, + -6.514443397521973 + ], + [ + 10694, + -6.533708572387695 + ], + [ + 1220, + -6.566145896911621 + ], + [ + 2297, + -6.585526466369629 + ], + [ + 4246, + -6.643085479736328 + ] + ], + "logprob_of_token": -0.10688314586877823, + "top1_top2_margin": 4.349584482610226, + "top6_top7_margin": 0.11855125427246094 + }, + { + "gen_index": 16, + "token": 29597, + "top": [ + [ + 29597, + -0.03335455805063248 + ], + [ + 4363, + -4.15578556060791 + ], + [ + 20263, + -4.791986465454102 + ], + [ + 94773, + -6.873473167419434 + ], + [ + 5222, + -6.994688987731934 + ], + [ + 4835, + -8.126993179321289 + ], + [ + 115531, + -8.177582740783691 + ], + [ + 125733, + -8.280625343322754 + ], + [ + 64544, + -8.600811004638672 + ], + [ + 112499, + -8.6377592086792 + ], + [ + 29566, + -8.672197341918945 + ], + [ + 14286, + -8.708173751831055 + ], + [ + 11556, + -8.841703414916992 + ], + [ + 22745, + -9.001483917236328 + ], + [ + 56937, + -9.118522644042969 + ], + [ + 3417, + -9.182034492492676 + ], + [ + 81335, + -9.309372901916504 + ], + [ + 16242, + -9.316763877868652 + ], + [ + 61335, + -9.35622787475586 + ], + [ + 8066, + -9.386794090270996 + ] + ], + "logprob_of_token": -0.03335455805063248, + "top1_top2_margin": 4.122431002557278, + "top6_top7_margin": 0.050589561462402344 + }, + { + "gen_index": 17, + "token": 4363, + "top": [ + [ + 4363, + -0.00147910974919796 + ], + [ + 29597, + -8.883688926696777 + ], + [ + 44, + -8.901327133178711 + ], + [ + 16242, + -9.584541320800781 + ], + [ + 27532, + -9.677407264709473 + ], + [ + 82880, + -9.791096687316895 + ], + [ + 120007, + -9.853202819824219 + ], + [ + 63790, + -10.049939155578613 + ], + [ + 55617, + -10.566534996032715 + ], + [ + 12698, + -10.6234712600708 + ], + [ + 65813, + -10.680325508117676 + ], + [ + 3891, + -10.70197582244873 + ], + [ + 37669, + -10.881403923034668 + ], + [ + 31155, + -10.899223327636719 + ], + [ + 9515, + -10.93326187133789 + ], + [ + 14286, + -11.076635360717773 + ], + [ + 32, + -11.28275203704834 + ], + [ + 35774, + -11.432209968566895 + ], + [ + 8429, + -11.54154109954834 + ], + [ + 120022, + -11.544294357299805 + ] + ], + "logprob_of_token": -0.00147910974919796, + "top1_top2_margin": 8.88220981694758, + "top6_top7_margin": 0.06210613250732422 + }, + { + "gen_index": 18, + "token": 51092, + "top": [ + [ + 51092, + -0.1034010723233223 + ], + [ + 2459, + -3.5375325679779053 + ], + [ + 2790, + -4.058823585510254 + ], + [ + 44, + -4.615614891052246 + ], + [ + 14515, + -5.546675682067871 + ], + [ + 6326, + -5.770271301269531 + ], + [ + 679, + -6.0327301025390625 + ], + [ + 39027, + -6.367603302001953 + ], + [ + 1826, + -6.3875932693481445 + ], + [ + 968, + -6.478630065917969 + ], + [ + 14016, + -6.531026840209961 + ], + [ + 1829, + -6.920754909515381 + ], + [ + 79317, + -7.03327751159668 + ], + [ + 2621, + -7.060227394104004 + ], + [ + 18988, + -7.1353936195373535 + ], + [ + 6501, + -7.205724239349365 + ], + [ + 27076, + -7.2675652503967285 + ], + [ + 21667, + -7.520576477050781 + ], + [ + 38362, + -7.7834343910217285 + ], + [ + 513, + -7.828537464141846 + ] + ], + "logprob_of_token": -0.1034010723233223, + "top1_top2_margin": 3.434131495654583, + "top6_top7_margin": 0.26245880126953125 + }, + { + "gen_index": 19, + "token": 836, + "top": [ + [ + 836, + -0.002115399343892932 + ], + [ + 120007, + -7.035358428955078 + ], + [ + 845, + -8.53799057006836 + ], + [ + 10304, + -8.854591369628906 + ], + [ + 2256, + -8.994962692260742 + ], + [ + 120016, + -9.31966781616211 + ], + [ + 120022, + -9.857436180114746 + ], + [ + 1829, + -9.880221366882324 + ], + [ + 46, + -9.942535400390625 + ], + [ + 2896, + -10.232999801635742 + ], + [ + 44, + -10.401721954345703 + ], + [ + 275, + -10.588077545166016 + ], + [ + 5222, + -10.690153121948242 + ], + [ + 20758, + -10.849237442016602 + ], + [ + 8476, + -10.98784065246582 + ], + [ + 9122, + -10.988985061645508 + ], + [ + 745, + -11.154727935791016 + ], + [ + 120021, + -11.203113555908203 + ], + [ + 346, + -11.28457260131836 + ], + [ + 420, + -11.458536148071289 + ] + ], + "logprob_of_token": -0.002115399343892932, + "top1_top2_margin": 7.033243029611185, + "top6_top7_margin": 0.5377683639526367 + }, + { + "gen_index": 20, + "token": 10304, + "top": [ + [ + 10304, + -0.15684384107589722 + ], + [ + 30135, + -2.1972262859344482 + ], + [ + 7314, + -4.400571346282959 + ], + [ + 120007, + -5.391473293304443 + ], + [ + 939, + -5.8676838874816895 + ], + [ + 14581, + -6.579975128173828 + ], + [ + 1410, + -6.619735240936279 + ], + [ + 1195, + -6.664201259613037 + ], + [ + 845, + -7.4421820640563965 + ], + [ + 120016, + -7.623304843902588 + ], + [ + 120022, + -7.749882221221924 + ], + [ + 30134, + -8.013662338256836 + ], + [ + 44, + -8.079608917236328 + ], + [ + 8066, + -8.089037895202637 + ], + [ + 5222, + -8.226551055908203 + ], + [ + 913, + -8.281094551086426 + ], + [ + 18830, + -8.348798751831055 + ], + [ + 8077, + -8.494925498962402 + ], + [ + 69370, + -8.556148529052734 + ], + [ + 31985, + -8.658772468566895 + ] + ], + "logprob_of_token": -0.15684384107589722, + "top1_top2_margin": 2.040382444858551, + "top6_top7_margin": 0.03976011276245117 + }, + { + "gen_index": 21, + "token": 9798, + "top": [ + [ + 9798, + -0.007605432998389006 + ], + [ + 1788, + -7.425817489624023 + ], + [ + 5710, + -7.709753036499023 + ], + [ + 11228, + -7.954341888427734 + ], + [ + 31987, + -8.00666332244873 + ], + [ + 7524, + -8.473175048828125 + ], + [ + 18476, + -8.56240177154541 + ], + [ + 86709, + -8.66004467010498 + ], + [ + 47581, + -8.891824722290039 + ], + [ + 73832, + -8.935498237609863 + ], + [ + 92664, + -8.9927339553833 + ], + [ + 33107, + -9.024901390075684 + ], + [ + 14445, + -9.156392097473145 + ], + [ + 7314, + -9.202768325805664 + ], + [ + 54970, + -9.34912395477295 + ], + [ + 49790, + -9.356832504272461 + ], + [ + 7389, + -9.36603832244873 + ], + [ + 11178, + -9.388957023620605 + ], + [ + 101813, + -9.39318561553955 + ], + [ + 69462, + -9.467570304870605 + ] + ], + "logprob_of_token": -0.007605432998389006, + "top1_top2_margin": 7.418212056625634, + "top6_top7_margin": 0.08922672271728516 + }, + { + "gen_index": 22, + "token": 30135, + "top": [ + [ + 30135, + -0.00617217505350709 + ], + [ + 120007, + -6.63276481628418 + ], + [ + 30134, + -6.81821346282959 + ], + [ + 913, + -7.818604469299316 + ], + [ + 31985, + -7.981662750244141 + ], + [ + 44, + -8.529899597167969 + ], + [ + 622, + -8.764298439025879 + ], + [ + 10895, + -8.853914260864258 + ], + [ + 46, + -8.873327255249023 + ], + [ + 26562, + -9.231534957885742 + ], + [ + 1409, + -9.352523803710938 + ], + [ + 69370, + -9.404155731201172 + ], + [ + 8066, + -9.426457405090332 + ], + [ + 8077, + -9.434534072875977 + ], + [ + 120022, + -9.476808547973633 + ], + [ + 20758, + -9.51773452758789 + ], + [ + 7314, + -9.567995071411133 + ], + [ + 115191, + -9.694091796875 + ], + [ + 120016, + -9.707315444946289 + ], + [ + 14424, + -9.781925201416016 + ] + ], + "logprob_of_token": -0.00617217505350709, + "top1_top2_margin": 6.626592641230673, + "top6_top7_margin": 0.23439884185791016 + }, + { + "gen_index": 23, + "token": 420, + "top": [ + [ + 420, + -0.008365236222743988 + ], + [ + 30134, + -5.3548359870910645 + ], + [ + 44, + -6.60399866104126 + ], + [ + 46, + -6.866027355194092 + ], + [ + 120007, + -8.198962211608887 + ], + [ + 861, + -8.36257266998291 + ], + [ + 275, + -9.322561264038086 + ], + [ + 1829, + -10.29325008392334 + ], + [ + 120022, + -10.398357391357422 + ], + [ + 285, + -10.606121063232422 + ], + [ + 913, + -10.746728897094727 + ], + [ + 314, + -10.85734748840332 + ], + [ + 45, + -10.933220863342285 + ], + [ + 37068, + -11.185039520263672 + ], + [ + 94773, + -11.264163970947266 + ], + [ + 120016, + -11.341682434082031 + ], + [ + 112499, + -11.35902214050293 + ], + [ + 32, + -11.43687629699707 + ], + [ + 513, + -11.445283889770508 + ], + [ + 120000, + -11.463216781616211 + ] + ], + "logprob_of_token": -0.008365236222743988, + "top1_top2_margin": 5.3464707508683205, + "top6_top7_margin": 0.9599885940551758 + }, + { + "gen_index": 24, + "token": 30134, + "top": [ + [ + 30134, + -0.008133497089147568 + ], + [ + 861, + -5.659092426300049 + ], + [ + 76007, + -7.7638163566589355 + ], + [ + 94773, + -8.294025421142578 + ], + [ + 45202, + -8.654725074768066 + ], + [ + 30135, + -8.722115516662598 + ], + [ + 32, + -8.838162422180176 + ], + [ + 26562, + -8.901537895202637 + ], + [ + 112499, + -9.075387954711914 + ], + [ + 112546, + -9.16903018951416 + ], + [ + 31924, + -9.21127700805664 + ], + [ + 100473, + -9.382453918457031 + ], + [ + 61212, + -9.620238304138184 + ], + [ + 15205, + -9.754914283752441 + ], + [ + 15738, + -9.824344635009766 + ], + [ + 1627, + -9.913178443908691 + ], + [ + 95918, + -9.925223350524902 + ], + [ + 913, + -9.944402694702148 + ], + [ + 88595, + -9.964505195617676 + ], + [ + 118194, + -9.975469589233398 + ] + ], + "logprob_of_token": -0.008133497089147568, + "top1_top2_margin": 5.650958929210901, + "top6_top7_margin": 0.11604690551757812 + }, + { + "gen_index": 25, + "token": 46, + "top": [ + [ + 46, + -0.2858915627002716 + ], + [ + 275, + -1.6166563034057617 + ], + [ + 314, + -3.1393938064575195 + ], + [ + 44, + -6.380636215209961 + ], + [ + 1829, + -7.508966445922852 + ], + [ + 120399, + -7.521501541137695 + ], + [ + 120007, + -7.5418853759765625 + ], + [ + 420, + -8.145721435546875 + ], + [ + 120016, + -8.279969215393066 + ], + [ + 33, + -8.499512672424316 + ], + [ + 36209, + -8.582366943359375 + ], + [ + 4137, + -8.975764274597168 + ], + [ + 58, + -9.151315689086914 + ], + [ + 59, + -9.166413307189941 + ], + [ + 14188, + -9.211721420288086 + ], + [ + 45202, + -9.35482406616211 + ], + [ + 2519, + -9.3798246383667 + ], + [ + 120118, + -9.508455276489258 + ], + [ + 11861, + -9.754068374633789 + ], + [ + 120021, + -9.836256980895996 + ] + ], + "logprob_of_token": -0.2858915627002716, + "top1_top2_margin": 1.3307647407054901, + "top6_top7_margin": 0.020383834838867188 + }, + { + "gen_index": 26, + "token": 1496, + "top": [ + [ + 1496, + -0.08470062911510468 + ], + [ + 44895, + -3.9669456481933594 + ], + [ + 3417, + -5.729308128356934 + ], + [ + 1438, + -5.758518218994141 + ], + [ + 766, + -5.822782516479492 + ], + [ + 2121, + -6.12399959564209 + ], + [ + 1220, + -6.169216156005859 + ], + [ + 120014, + -6.232387542724609 + ], + [ + 946, + -6.400815010070801 + ], + [ + 127906, + -6.436302185058594 + ], + [ + 33573, + -6.473171234130859 + ], + [ + 120022, + -6.5063018798828125 + ], + [ + 6336, + -6.523281097412109 + ], + [ + 523, + -6.524507522583008 + ], + [ + 10485, + -6.754807472229004 + ], + [ + 1047, + -6.7925519943237305 + ], + [ + 114245, + -6.798209190368652 + ], + [ + 72711, + -6.928581714630127 + ], + [ + 2896, + -7.011584281921387 + ], + [ + 5274, + -7.059133052825928 + ] + ], + "logprob_of_token": -0.08470062911510468, + "top1_top2_margin": 3.8822450190782547, + "top6_top7_margin": 0.04521656036376953 + }, + { + "gen_index": 27, + "token": 29597, + "top": [ + [ + 29597, + -0.009192869067192078 + ], + [ + 20263, + -5.464392185211182 + ], + [ + 4363, + -6.535007953643799 + ], + [ + 5222, + -8.125255584716797 + ], + [ + 14286, + -8.449724197387695 + ], + [ + 4835, + -8.573738098144531 + ], + [ + 56937, + -8.939478874206543 + ], + [ + 81335, + -9.235627174377441 + ], + [ + 11556, + -9.295528411865234 + ], + [ + 64544, + -9.316189765930176 + ], + [ + 120007, + -9.459930419921875 + ], + [ + 115531, + -9.514781951904297 + ], + [ + 61335, + -9.556299209594727 + ], + [ + 2302, + -9.714266777038574 + ], + [ + 3417, + -9.750160217285156 + ], + [ + 125733, + -9.789562225341797 + ], + [ + 69735, + -9.7918119430542 + ], + [ + 42701, + -9.970637321472168 + ], + [ + 8066, + -10.006274223327637 + ], + [ + 22188, + -10.100054740905762 + ] + ], + "logprob_of_token": -0.009192869067192078, + "top1_top2_margin": 5.45519931614399, + "top6_top7_margin": 0.3657407760620117 + }, + { + "gen_index": 28, + "token": 4363, + "top": [ + [ + 4363, + -0.001123522873967886 + ], + [ + 120007, + -8.41402816772461 + ], + [ + 63790, + -9.402521133422852 + ], + [ + 120022, + -9.773761749267578 + ], + [ + 55617, + -10.30059814453125 + ], + [ + 16242, + -10.433782577514648 + ], + [ + 44, + -10.659690856933594 + ], + [ + 3417, + -10.78149127960205 + ], + [ + 82880, + -10.990900039672852 + ], + [ + 120016, + -11.025121688842773 + ], + [ + 29597, + -11.030038833618164 + ], + [ + 9515, + -11.128568649291992 + ], + [ + 120410, + -11.130254745483398 + ], + [ + 263, + -11.274320602416992 + ], + [ + 27532, + -11.291020393371582 + ], + [ + 5474, + -11.31852912902832 + ], + [ + 120103, + -11.357550621032715 + ], + [ + 32245, + -11.373398780822754 + ], + [ + 120098, + -11.481695175170898 + ], + [ + 32, + -11.497074127197266 + ] + ], + "logprob_of_token": -0.001123522873967886, + "top1_top2_margin": 8.412904644850641, + "top6_top7_margin": 0.2259082794189453 + }, + { + "gen_index": 29, + "token": 51092, + "top": [ + [ + 51092, + -0.007862341590225697 + ], + [ + 2459, + -6.963552951812744 + ], + [ + 44, + -7.269016742706299 + ], + [ + 70765, + -7.733935832977295 + ], + [ + 120007, + -7.795454978942871 + ], + [ + 14515, + -7.910289287567139 + ], + [ + 1829, + -8.30157470703125 + ], + [ + 2790, + -8.428467750549316 + ], + [ + 14439, + -8.524106979370117 + ], + [ + 56811, + -8.737762451171875 + ], + [ + 39027, + -8.826950073242188 + ], + [ + 21667, + -9.010915756225586 + ], + [ + 679, + -9.13076114654541 + ], + [ + 120022, + -9.159425735473633 + ], + [ + 58, + -9.193937301635742 + ], + [ + 92487, + -9.23640251159668 + ], + [ + 79317, + -9.247482299804688 + ], + [ + 6326, + -9.273787498474121 + ], + [ + 35808, + -9.275463104248047 + ], + [ + 32, + -9.347054481506348 + ] + ], + "logprob_of_token": -0.007862341590225697, + "top1_top2_margin": 6.955690610222518, + "top6_top7_margin": 0.39128541946411133 + }, + { + "gen_index": 30, + "token": 836, + "top": [ + [ + 836, + -0.008317694067955017 + ], + [ + 127907, + -6.355640888214111 + ], + [ + 1178, + -6.965182304382324 + ], + [ + 16952, + -7.163394927978516 + ], + [ + 2256, + -7.216151237487793 + ], + [ + 2896, + -7.829752445220947 + ], + [ + 10304, + -7.905904293060303 + ], + [ + 44, + -8.023274421691895 + ], + [ + 845, + -8.239200592041016 + ], + [ + 120007, + -8.286028861999512 + ], + [ + 948, + -8.495347023010254 + ], + [ + 1241, + -8.990222930908203 + ], + [ + 6443, + -9.090060234069824 + ], + [ + 3646, + -9.272347450256348 + ], + [ + 101813, + -9.772409439086914 + ], + [ + 58, + -9.885851860046387 + ], + [ + 52389, + -9.918179512023926 + ], + [ + 18476, + -9.933317184448242 + ], + [ + 1788, + -9.969428062438965 + ], + [ + 346, + -10.117497444152832 + ] + ], + "logprob_of_token": -0.008317694067955017, + "top1_top2_margin": 6.347323194146156, + "top6_top7_margin": 0.07615184783935547 + }, + { + "gen_index": 31, + "token": 10304, + "top": [ + [ + 10304, + -0.0034363833256065845 + ], + [ + 30135, + -6.30530309677124 + ], + [ + 7314, + -8.102805137634277 + ], + [ + 120007, + -8.127137184143066 + ], + [ + 1410, + -9.296419143676758 + ], + [ + 939, + -9.469003677368164 + ], + [ + 845, + -9.58586597442627 + ], + [ + 1788, + -9.64742660522461 + ], + [ + 120022, + -9.791071891784668 + ], + [ + 120016, + -10.357354164123535 + ], + [ + 1195, + -10.495367050170898 + ], + [ + 44, + -10.53777027130127 + ], + [ + 913, + -11.16541576385498 + ], + [ + 14581, + -11.179350852966309 + ], + [ + 46, + -11.448713302612305 + ], + [ + 20758, + -11.505209922790527 + ], + [ + 1829, + -11.506875038146973 + ], + [ + 622, + -11.515031814575195 + ], + [ + 1911, + -11.533336639404297 + ], + [ + 745, + -11.557818412780762 + ] + ], + "logprob_of_token": -0.0034363833256065845, + "top1_top2_margin": 6.301866713445634, + "top6_top7_margin": 0.11686229705810547 + } + ] + }, + { + "prompt": "counting: one two three four five six seven", + "input_ids": [ + 586, + 259, + 58, + 2403, + 1311, + 2467, + 2555, + 4241, + 8445, + 12843 + ], + "generated_ids": [ + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843, + 12843 + ], + "rows": [ + { + "gen_index": 0, + "token": 12843, + "top": [ + [ + 12843, + -0.4320979714393616 + ], + [ + 14031, + -2.2126574516296387 + ], + [ + 58, + -2.945549488067627 + ], + [ + 8445, + -3.0403361320495605 + ], + [ + 30877, + -3.7706332206726074 + ], + [ + 2403, + -4.333765983581543 + ], + [ + 19827, + -4.900338649749756 + ], + [ + 6559, + -5.653625011444092 + ], + [ + 55333, + -5.726643085479736 + ], + [ + 31663, + -5.7469916343688965 + ], + [ + 14188, + -5.959738254547119 + ], + [ + 46, + -6.10899543762207 + ], + [ + 44, + -6.213806629180908 + ], + [ + 8206, + -6.269930362701416 + ], + [ + 2555, + -6.438248634338379 + ], + [ + 55, + -6.485141277313232 + ], + [ + 1204, + -6.50381326675415 + ], + [ + 10133, + -6.606703758239746 + ], + [ + 14395, + -6.655773639678955 + ], + [ + 37720, + -6.783947467803955 + ] + ], + "logprob_of_token": -0.4320979714393616, + "top1_top2_margin": 1.780559480190277, + "top6_top7_margin": 0.5665726661682129 + }, + { + "gen_index": 1, + "token": 12843, + "top": [ + [ + 12843, + -0.09370535612106323 + ], + [ + 14031, + -3.6826717853546143 + ], + [ + 2403, + -4.580366134643555 + ], + [ + 19827, + -5.129541873931885 + ], + [ + 58, + -5.258334636688232 + ], + [ + 55333, + -5.849850654602051 + ], + [ + 6559, + -6.2919840812683105 + ], + [ + 31663, + -6.301061630249023 + ], + [ + 8445, + -6.482666969299316 + ], + [ + 44, + -6.810084342956543 + ], + [ + 14395, + -6.811794281005859 + ], + [ + 46, + -6.99389123916626 + ], + [ + 26209, + -6.997154712677002 + ], + [ + 1204, + -7.017780780792236 + ], + [ + 14188, + -7.310215950012207 + ], + [ + 2555, + -7.3386430740356445 + ], + [ + 55332, + -7.343502044677734 + ], + [ + 59, + -7.361423015594482 + ], + [ + 4401, + -7.434317111968994 + ], + [ + 286, + -7.584293842315674 + ] + ], + "logprob_of_token": -0.09370535612106323, + "top1_top2_margin": 3.588966429233551, + "top6_top7_margin": 0.44213342666625977 + }, + { + "gen_index": 2, + "token": 12843, + "top": [ + [ + 12843, + -0.07013563066720963 + ], + [ + 2403, + -4.5391459465026855 + ], + [ + 14031, + -5.080627918243408 + ], + [ + 19827, + -5.127085208892822 + ], + [ + 55333, + -5.384922027587891 + ], + [ + 58, + -5.531792640686035 + ], + [ + 31663, + -6.294236183166504 + ], + [ + 6559, + -6.422512054443359 + ], + [ + 14395, + -6.618314266204834 + ], + [ + 26209, + -6.831147193908691 + ], + [ + 55, + -6.847322463989258 + ], + [ + 44, + -6.895613193511963 + ], + [ + 30877, + -7.098087787628174 + ], + [ + 46, + -7.174436569213867 + ], + [ + 59, + -7.321211338043213 + ], + [ + 14188, + -7.5723981857299805 + ], + [ + 286, + -7.633738994598389 + ], + [ + 80764, + -7.635289669036865 + ], + [ + 90236, + -7.808197498321533 + ], + [ + 55332, + -7.925700664520264 + ] + ], + "logprob_of_token": -0.07013563066720963, + "top1_top2_margin": 4.469010315835476, + "top6_top7_margin": 0.7624435424804688 + }, + { + "gen_index": 3, + "token": 12843, + "top": [ + [ + 12843, + -0.06768365949392319 + ], + [ + 2403, + -4.783086776733398 + ], + [ + 19827, + -4.9388322830200195 + ], + [ + 58, + -5.295265197753906 + ], + [ + 14031, + -5.5008063316345215 + ], + [ + 6559, + -5.719439506530762 + ], + [ + 55333, + -5.8535847663879395 + ], + [ + 30877, + -6.168983459472656 + ], + [ + 26209, + -6.341630935668945 + ], + [ + 31663, + -6.385552883148193 + ], + [ + 14395, + -6.828354358673096 + ], + [ + 44, + -7.141006946563721 + ], + [ + 90236, + -7.2629828453063965 + ], + [ + 55, + -7.32271146774292 + ], + [ + 14188, + -7.356174945831299 + ], + [ + 46, + -7.474184989929199 + ], + [ + 80764, + -7.576718807220459 + ], + [ + 8445, + -7.604499816894531 + ], + [ + 59, + -7.888840675354004 + ], + [ + 286, + -8.103196144104004 + ] + ], + "logprob_of_token": -0.06768365949392319, + "top1_top2_margin": 4.715403117239475, + "top6_top7_margin": 0.13414525985717773 + }, + { + "gen_index": 4, + "token": 12843, + "top": [ + [ + 12843, + -0.10248584300279617 + ], + [ + 19827, + -4.554352283477783 + ], + [ + 2403, + -4.76760196685791 + ], + [ + 14031, + -4.79788875579834 + ], + [ + 30877, + -5.4664459228515625 + ], + [ + 55333, + -5.484036922454834 + ], + [ + 8445, + -5.648110389709473 + ], + [ + 6559, + -5.6919169425964355 + ], + [ + 26209, + -5.879590034484863 + ], + [ + 31663, + -6.029397964477539 + ], + [ + 58, + -6.608819961547852 + ], + [ + 14395, + -6.977629661560059 + ], + [ + 44, + -7.020455360412598 + ], + [ + 55, + -7.327630519866943 + ], + [ + 90236, + -7.421656131744385 + ], + [ + 8206, + -7.586770534515381 + ], + [ + 14188, + -7.600701332092285 + ], + [ + 80764, + -7.625267505645752 + ], + [ + 5951, + -7.6273417472839355 + ], + [ + 28346, + -7.656322479248047 + ] + ], + "logprob_of_token": -0.10248584300279617, + "top1_top2_margin": 4.451866440474987, + "top6_top7_margin": 0.16407346725463867 + }, + { + "gen_index": 5, + "token": 12843, + "top": [ + [ + 12843, + -0.10658066719770432 + ], + [ + 2403, + -4.551984786987305 + ], + [ + 19827, + -4.607080936431885 + ], + [ + 14031, + -5.1341471672058105 + ], + [ + 8445, + -5.430270671844482 + ], + [ + 55333, + -5.469303607940674 + ], + [ + 6559, + -5.5165886878967285 + ], + [ + 30877, + -5.702096462249756 + ], + [ + 26209, + -5.9258880615234375 + ], + [ + 31663, + -6.09432315826416 + ], + [ + 58, + -6.182443618774414 + ], + [ + 44, + -6.905764102935791 + ], + [ + 8206, + -6.944779396057129 + ], + [ + 1204, + -7.117150783538818 + ], + [ + 14188, + -7.141580581665039 + ], + [ + 55, + -7.271273136138916 + ], + [ + 55332, + -7.283833980560303 + ], + [ + 286, + -7.293015003204346 + ], + [ + 90236, + -7.299356937408447 + ], + [ + 59, + -7.336628437042236 + ] + ], + "logprob_of_token": -0.10658066719770432, + "top1_top2_margin": 4.4454041197896, + "top6_top7_margin": 0.04728507995605469 + }, + { + "gen_index": 6, + "token": 12843, + "top": [ + [ + 12843, + -0.08401334285736084 + ], + [ + 2403, + -4.078409671783447 + ], + [ + 19827, + -4.523470401763916 + ], + [ + 14031, + -5.1724934577941895 + ], + [ + 55333, + -5.702210903167725 + ], + [ + 6559, + -5.827749729156494 + ], + [ + 30877, + -6.031262397766113 + ], + [ + 26209, + -6.1501970291137695 + ], + [ + 58, + -6.1566267013549805 + ], + [ + 31663, + -6.294826507568359 + ], + [ + 8445, + -7.039605617523193 + ], + [ + 55332, + -7.089849472045898 + ], + [ + 8206, + -7.235312461853027 + ], + [ + 55, + -7.255884170532227 + ], + [ + 80764, + -7.3016767501831055 + ], + [ + 90236, + -7.422865867614746 + ], + [ + 46, + -7.616029739379883 + ], + [ + 59, + -7.64255428314209 + ], + [ + 44, + -7.839158058166504 + ], + [ + 286, + -7.915099620819092 + ] + ], + "logprob_of_token": -0.08401334285736084, + "top1_top2_margin": 3.9943963289260864, + "top6_top7_margin": 0.20351266860961914 + }, + { + "gen_index": 7, + "token": 12843, + "top": [ + [ + 12843, + -0.09256406128406525 + ], + [ + 2403, + -3.6669869422912598 + ], + [ + 14031, + -4.816402435302734 + ], + [ + 19827, + -5.011592388153076 + ], + [ + 55333, + -5.386449337005615 + ], + [ + 6559, + -6.034371852874756 + ], + [ + 58, + -6.052370548248291 + ], + [ + 55332, + -6.252188682556152 + ], + [ + 31663, + -6.529880046844482 + ], + [ + 26209, + -6.71409273147583 + ], + [ + 59, + -6.880702972412109 + ], + [ + 44, + -6.9868879318237305 + ], + [ + 55, + -7.186211585998535 + ], + [ + 46, + -7.229464054107666 + ], + [ + 80764, + -7.351308345794678 + ], + [ + 30877, + -7.365549564361572 + ], + [ + 14395, + -7.505411148071289 + ], + [ + 2555, + -7.622544765472412 + ], + [ + 8445, + -7.709369659423828 + ], + [ + 90236, + -7.7104997634887695 + ] + ], + "logprob_of_token": -0.09256406128406525, + "top1_top2_margin": 3.5744228810071945, + "top6_top7_margin": 0.017998695373535156 + }, + { + "gen_index": 8, + "token": 12843, + "top": [ + [ + 12843, + -0.10465427488088608 + ], + [ + 2403, + -3.3856735229492188 + ], + [ + 14031, + -4.611199378967285 + ], + [ + 55333, + -4.943957328796387 + ], + [ + 19827, + -5.1787896156311035 + ], + [ + 58, + -5.964829444885254 + ], + [ + 55332, + -6.3124260902404785 + ], + [ + 6559, + -6.372195243835449 + ], + [ + 14395, + -6.512744903564453 + ], + [ + 26209, + -6.569828987121582 + ], + [ + 59, + -6.6947526931762695 + ], + [ + 31663, + -6.70290994644165 + ], + [ + 44, + -6.794713973999023 + ], + [ + 55, + -7.0782270431518555 + ], + [ + 46, + -7.230502128601074 + ], + [ + 80764, + -7.357231140136719 + ], + [ + 14188, + -7.64547872543335 + ], + [ + 286, + -7.723287105560303 + ], + [ + 946, + -7.88728141784668 + ], + [ + 90236, + -7.947686195373535 + ] + ], + "logprob_of_token": -0.10465427488088608, + "top1_top2_margin": 3.2810192480683327, + "top6_top7_margin": 0.3475966453552246 + }, + { + "gen_index": 9, + "token": 12843, + "top": [ + [ + 12843, + -0.13736337423324585 + ], + [ + 14031, + -3.388739585876465 + ], + [ + 2403, + -3.6056535243988037 + ], + [ + 19827, + -5.003187656402588 + ], + [ + 55333, + -5.38965368270874 + ], + [ + 58, + -5.655790328979492 + ], + [ + 1311, + -5.969396591186523 + ], + [ + 26209, + -6.077286243438721 + ], + [ + 44, + -6.137598037719727 + ], + [ + 46, + -6.380489349365234 + ], + [ + 59, + -6.42473030090332 + ], + [ + 6559, + -6.4406819343566895 + ], + [ + 14395, + -6.925199031829834 + ], + [ + 31663, + -6.9476518630981445 + ], + [ + 55, + -7.074004173278809 + ], + [ + 14188, + -7.095815181732178 + ], + [ + 8445, + -7.222349166870117 + ], + [ + 946, + -7.408656597137451 + ], + [ + 80764, + -7.694366931915283 + ], + [ + 286, + -7.752646446228027 + ] + ], + "logprob_of_token": -0.13736337423324585, + "top1_top2_margin": 3.251376211643219, + "top6_top7_margin": 0.31360626220703125 + }, + { + "gen_index": 10, + "token": 12843, + "top": [ + [ + 12843, + -0.1878502368927002 + ], + [ + 2403, + -3.2954065799713135 + ], + [ + 14031, + -3.6677401065826416 + ], + [ + 1311, + -4.319137096405029 + ], + [ + 19827, + -4.647482872009277 + ], + [ + 55333, + -4.788044452667236 + ], + [ + 58, + -5.683899402618408 + ], + [ + 26209, + -5.901371479034424 + ], + [ + 59, + -5.954987525939941 + ], + [ + 44, + -6.033434867858887 + ], + [ + 46, + -6.101747035980225 + ], + [ + 31663, + -6.24800968170166 + ], + [ + 946, + -6.558990955352783 + ], + [ + 6559, + -6.709531784057617 + ], + [ + 14188, + -6.837871551513672 + ], + [ + 55, + -6.840102195739746 + ], + [ + 14395, + -6.843001365661621 + ], + [ + 8445, + -6.8621110916137695 + ], + [ + 286, + -6.908825397491455 + ], + [ + 55332, + -6.95927095413208 + ] + ], + "logprob_of_token": -0.1878502368927002, + "top1_top2_margin": 3.1075563430786133, + "top6_top7_margin": 0.8958549499511719 + }, + { + "gen_index": 11, + "token": 12843, + "top": [ + [ + 12843, + -0.11069612205028534 + ], + [ + 14031, + -4.0004706382751465 + ], + [ + 2403, + -4.5683488845825195 + ], + [ + 19827, + -4.784101486206055 + ], + [ + 55333, + -4.91309118270874 + ], + [ + 58, + -6.10538387298584 + ], + [ + 31663, + -6.312209129333496 + ], + [ + 26209, + -6.5351080894470215 + ], + [ + 46, + -6.5481109619140625 + ], + [ + 6559, + -6.577279090881348 + ], + [ + 30877, + -6.712948799133301 + ], + [ + 55332, + -6.726067543029785 + ], + [ + 1311, + -6.740769863128662 + ], + [ + 44, + -6.831844329833984 + ], + [ + 59, + -6.866550922393799 + ], + [ + 946, + -6.866899013519287 + ], + [ + 55, + -6.870294570922852 + ], + [ + 14395, + -7.123883247375488 + ], + [ + 8445, + -7.137869358062744 + ], + [ + 14188, + -7.171542644500732 + ] + ], + "logprob_of_token": -0.11069612205028534, + "top1_top2_margin": 3.889774516224861, + "top6_top7_margin": 0.20682525634765625 + }, + { + "gen_index": 12, + "token": 12843, + "top": [ + [ + 12843, + -0.11890925467014313 + ], + [ + 14031, + -3.881338357925415 + ], + [ + 2403, + -4.004932880401611 + ], + [ + 55333, + -4.352983474731445 + ], + [ + 19827, + -4.968810081481934 + ], + [ + 58, + -6.133376121520996 + ], + [ + 26209, + -6.2977495193481445 + ], + [ + 6559, + -6.343536376953125 + ], + [ + 55332, + -6.442315578460693 + ], + [ + 31663, + -6.44270658493042 + ], + [ + 59, + -6.551259994506836 + ], + [ + 55, + -6.937966823577881 + ], + [ + 44, + -6.946694374084473 + ], + [ + 46, + -7.040759086608887 + ], + [ + 946, + -7.157247543334961 + ], + [ + 14395, + -7.2996954917907715 + ], + [ + 14188, + -7.337170124053955 + ], + [ + 286, + -7.420469760894775 + ], + [ + 80764, + -7.573487758636475 + ], + [ + 30877, + -7.596090793609619 + ] + ], + "logprob_of_token": -0.11890925467014313, + "top1_top2_margin": 3.762429103255272, + "top6_top7_margin": 0.16437339782714844 + }, + { + "gen_index": 13, + "token": 12843, + "top": [ + [ + 12843, + -0.1333489865064621 + ], + [ + 2403, + -3.624594211578369 + ], + [ + 14031, + -4.022881984710693 + ], + [ + 55333, + -4.400208950042725 + ], + [ + 19827, + -4.9319257736206055 + ], + [ + 26209, + -6.181283950805664 + ], + [ + 58, + -6.21773624420166 + ], + [ + 59, + -6.35675048828125 + ], + [ + 6559, + -6.38460636138916 + ], + [ + 31663, + -6.451272010803223 + ], + [ + 55332, + -6.481352806091309 + ], + [ + 44, + -6.636893272399902 + ], + [ + 46, + -6.823300838470459 + ], + [ + 55, + -6.8378190994262695 + ], + [ + 946, + -6.8809075355529785 + ], + [ + 14395, + -7.024350166320801 + ], + [ + 286, + -7.054954528808594 + ], + [ + 14188, + -7.331909656524658 + ], + [ + 80764, + -7.381792068481445 + ], + [ + 8445, + -7.5675129890441895 + ] + ], + "logprob_of_token": -0.1333489865064621, + "top1_top2_margin": 3.491245225071907, + "top6_top7_margin": 0.036452293395996094 + }, + { + "gen_index": 14, + "token": 12843, + "top": [ + [ + 12843, + -0.14040657877922058 + ], + [ + 2403, + -3.8037939071655273 + ], + [ + 14031, + -3.883464813232422 + ], + [ + 55333, + -4.361281871795654 + ], + [ + 19827, + -4.773635387420654 + ], + [ + 26209, + -6.128774166107178 + ], + [ + 59, + -6.178771495819092 + ], + [ + 58, + -6.282776832580566 + ], + [ + 6559, + -6.345128536224365 + ], + [ + 44, + -6.397447109222412 + ], + [ + 31663, + -6.463541030883789 + ], + [ + 46, + -6.533077239990234 + ], + [ + 55, + -6.5833258628845215 + ], + [ + 946, + -6.747133255004883 + ], + [ + 55332, + -6.828045845031738 + ], + [ + 14188, + -7.016407012939453 + ], + [ + 14395, + -7.025723934173584 + ], + [ + 80764, + -7.282598495483398 + ], + [ + 120022, + -7.346449375152588 + ], + [ + 286, + -7.352034568786621 + ] + ], + "logprob_of_token": -0.14040657877922058, + "top1_top2_margin": 3.6633873283863068, + "top6_top7_margin": 0.04999732971191406 + }, + { + "gen_index": 15, + "token": 12843, + "top": [ + [ + 12843, + -0.14140217006206512 + ], + [ + 14031, + -3.7335023880004883 + ], + [ + 2403, + -4.195651054382324 + ], + [ + 55333, + -4.538535118103027 + ], + [ + 19827, + -4.731936454772949 + ], + [ + 59, + -5.977987766265869 + ], + [ + 58, + -6.103712558746338 + ], + [ + 44, + -6.176599025726318 + ], + [ + 26209, + -6.201976776123047 + ], + [ + 46, + -6.269492149353027 + ], + [ + 55, + -6.383939743041992 + ], + [ + 31663, + -6.491192817687988 + ], + [ + 1311, + -6.498298168182373 + ], + [ + 6559, + -6.5584306716918945 + ], + [ + 946, + -6.77570915222168 + ], + [ + 14395, + -6.995114803314209 + ], + [ + 1932, + -7.019489288330078 + ], + [ + 120022, + -7.031761169433594 + ], + [ + 55332, + -7.034179210662842 + ], + [ + 14188, + -7.050736427307129 + ] + ], + "logprob_of_token": -0.14140217006206512, + "top1_top2_margin": 3.592100217938423, + "top6_top7_margin": 0.12572479248046875 + }, + { + "gen_index": 16, + "token": 12843, + "top": [ + [ + 12843, + -0.15325137972831726 + ], + [ + 14031, + -3.3965470790863037 + ], + [ + 2403, + -4.452692985534668 + ], + [ + 55333, + -4.58070707321167 + ], + [ + 19827, + -4.697951316833496 + ], + [ + 1311, + -6.070426940917969 + ], + [ + 58, + -6.241589546203613 + ], + [ + 26209, + -6.257894515991211 + ], + [ + 59, + -6.313932418823242 + ], + [ + 46, + -6.354233264923096 + ], + [ + 44, + -6.3709330558776855 + ], + [ + 31663, + -6.43051290512085 + ], + [ + 6559, + -6.632646083831787 + ], + [ + 55332, + -6.643820762634277 + ], + [ + 55, + -6.679722309112549 + ], + [ + 946, + -6.729017734527588 + ], + [ + 14395, + -6.915373802185059 + ], + [ + 14188, + -6.917906761169434 + ], + [ + 1932, + -7.003035068511963 + ], + [ + 8445, + -7.133552074432373 + ] + ], + "logprob_of_token": -0.15325137972831726, + "top1_top2_margin": 3.2432956993579865, + "top6_top7_margin": 0.17116260528564453 + }, + { + "gen_index": 17, + "token": 12843, + "top": [ + [ + 12843, + -0.1481878012418747 + ], + [ + 14031, + -3.6511547565460205 + ], + [ + 2403, + -4.005736827850342 + ], + [ + 55333, + -4.301150321960449 + ], + [ + 19827, + -4.78386116027832 + ], + [ + 31663, + -6.275219917297363 + ], + [ + 26209, + -6.278485298156738 + ], + [ + 55332, + -6.433075904846191 + ], + [ + 58, + -6.617971897125244 + ], + [ + 46, + -6.62540340423584 + ], + [ + 946, + -6.640639305114746 + ], + [ + 59, + -6.646288871765137 + ], + [ + 6559, + -6.752925872802734 + ], + [ + 1311, + -6.7707319259643555 + ], + [ + 55, + -6.888155937194824 + ], + [ + 44, + -6.9154534339904785 + ], + [ + 30877, + -6.989556789398193 + ], + [ + 14188, + -7.103755950927734 + ], + [ + 8445, + -7.13486909866333 + ], + [ + 14395, + -7.139366149902344 + ] + ], + "logprob_of_token": -0.1481878012418747, + "top1_top2_margin": 3.502966955304146, + "top6_top7_margin": 0.003265380859375 + }, + { + "gen_index": 18, + "token": 12843, + "top": [ + [ + 12843, + -0.1701292097568512 + ], + [ + 55333, + -3.718235492706299 + ], + [ + 2403, + -3.7228617668151855 + ], + [ + 14031, + -3.7303948402404785 + ], + [ + 19827, + -4.878814220428467 + ], + [ + 31663, + -5.958075046539307 + ], + [ + 946, + -6.095345973968506 + ], + [ + 55332, + -6.197300434112549 + ], + [ + 59, + -6.24211311340332 + ], + [ + 26209, + -6.271884918212891 + ], + [ + 58, + -6.5713324546813965 + ], + [ + 46, + -6.7083048820495605 + ], + [ + 44, + -6.77065896987915 + ], + [ + 55, + -6.7848615646362305 + ], + [ + 6559, + -6.939414978027344 + ], + [ + 94021, + -6.954206943511963 + ], + [ + 120022, + -7.01243257522583 + ], + [ + 14188, + -7.083091735839844 + ], + [ + 286, + -7.100123405456543 + ], + [ + 14395, + -7.160595893859863 + ] + ], + "logprob_of_token": -0.1701292097568512, + "top1_top2_margin": 3.5481062829494476, + "top6_top7_margin": 0.13727092742919922 + }, + { + "gen_index": 19, + "token": 12843, + "top": [ + [ + 12843, + -0.18021665513515472 + ], + [ + 2403, + -3.576190710067749 + ], + [ + 14031, + -3.594318389892578 + ], + [ + 55333, + -3.9500415325164795 + ], + [ + 19827, + -4.827542781829834 + ], + [ + 31663, + -5.903705596923828 + ], + [ + 58, + -5.970351219177246 + ], + [ + 59, + -6.048264026641846 + ], + [ + 26209, + -6.166182518005371 + ], + [ + 946, + -6.21992826461792 + ], + [ + 55332, + -6.508638381958008 + ], + [ + 46, + -6.54909610748291 + ], + [ + 44, + -6.573981285095215 + ], + [ + 55, + -6.580669403076172 + ], + [ + 120022, + -6.817914962768555 + ], + [ + 6559, + -6.869156837463379 + ], + [ + 94021, + -6.99709939956665 + ], + [ + 14188, + -7.009805202484131 + ], + [ + 14395, + -7.01889705657959 + ], + [ + 120007, + -7.053176403045654 + ] + ], + "logprob_of_token": -0.18021665513515472, + "top1_top2_margin": 3.3959740549325943, + "top6_top7_margin": 0.06664562225341797 + }, + { + "gen_index": 20, + "token": 12843, + "top": [ + [ + 12843, + -0.1765153557062149 + ], + [ + 2403, + -3.4467484951019287 + ], + [ + 14031, + -3.5573508739471436 + ], + [ + 55333, + -4.000722885131836 + ], + [ + 19827, + -4.729832172393799 + ], + [ + 58, + -5.935380458831787 + ], + [ + 26209, + -6.187304973602295 + ], + [ + 59, + -6.2981181144714355 + ], + [ + 31663, + -6.306155681610107 + ], + [ + 46, + -6.433865547180176 + ], + [ + 55332, + -6.550139904022217 + ], + [ + 44, + -6.596364974975586 + ], + [ + 6559, + -6.628188133239746 + ], + [ + 946, + -6.698892116546631 + ], + [ + 14395, + -6.791530132293701 + ], + [ + 55, + -6.793534755706787 + ], + [ + 94021, + -6.969479084014893 + ], + [ + 120022, + -7.067501544952393 + ], + [ + 120007, + -7.143977642059326 + ], + [ + 63, + -7.1883625984191895 + ] + ], + "logprob_of_token": -0.1765153557062149, + "top1_top2_margin": 3.270233139395714, + "top6_top7_margin": 0.2519245147705078 + }, + { + "gen_index": 21, + "token": 12843, + "top": [ + [ + 12843, + -0.19886063039302826 + ], + [ + 2403, + -3.069812297821045 + ], + [ + 55333, + -3.7385315895080566 + ], + [ + 14031, + -3.821533679962158 + ], + [ + 19827, + -4.737043380737305 + ], + [ + 26209, + -5.9235758781433105 + ], + [ + 31663, + -6.104220390319824 + ], + [ + 58, + -6.145110130310059 + ], + [ + 120022, + -6.341579914093018 + ], + [ + 946, + -6.349747657775879 + ], + [ + 59, + -6.373115539550781 + ], + [ + 55, + -6.463560104370117 + ], + [ + 55332, + -6.520257949829102 + ], + [ + 94021, + -6.702608108520508 + ], + [ + 63, + -6.759496688842773 + ], + [ + 120007, + -6.771385669708252 + ], + [ + 1311, + -6.8212175369262695 + ], + [ + 46, + -6.920307159423828 + ], + [ + 14395, + -6.930019855499268 + ], + [ + 44, + -6.985139846801758 + ] + ], + "logprob_of_token": -0.19886063039302826, + "top1_top2_margin": 2.8709516674280167, + "top6_top7_margin": 0.18064451217651367 + }, + { + "gen_index": 22, + "token": 12843, + "top": [ + [ + 12843, + -0.251214861869812 + ], + [ + 14031, + -3.1891841888427734 + ], + [ + 2403, + -3.249220609664917 + ], + [ + 55333, + -3.950247049331665 + ], + [ + 19827, + -4.910119533538818 + ], + [ + 59, + -5.781637668609619 + ], + [ + 120022, + -5.8501811027526855 + ], + [ + 26209, + -5.907618522644043 + ], + [ + 58, + -6.008721828460693 + ], + [ + 946, + -6.018280982971191 + ], + [ + 31663, + -6.087822914123535 + ], + [ + 44, + -6.106586456298828 + ], + [ + 46, + -6.166689395904541 + ], + [ + 286, + -6.268657684326172 + ], + [ + 55, + -6.353964328765869 + ], + [ + 120007, + -6.365779876708984 + ], + [ + 63, + -6.469816207885742 + ], + [ + 1311, + -6.510691165924072 + ], + [ + 94021, + -6.525615692138672 + ], + [ + 55332, + -6.551244258880615 + ] + ], + "logprob_of_token": -0.251214861869812, + "top1_top2_margin": 2.9379693269729614, + "top6_top7_margin": 0.0685434341430664 + }, + { + "gen_index": 23, + "token": 12843, + "top": [ + [ + 12843, + -0.24418574571609497 + ], + [ + 14031, + -3.087062120437622 + ], + [ + 2403, + -3.2201054096221924 + ], + [ + 55333, + -3.972791910171509 + ], + [ + 19827, + -4.8640875816345215 + ], + [ + 946, + -5.868285655975342 + ], + [ + 26209, + -5.951593399047852 + ], + [ + 31663, + -5.96602725982666 + ], + [ + 59, + -5.982452392578125 + ], + [ + 120022, + -6.166825771331787 + ], + [ + 44, + -6.359185695648193 + ], + [ + 94021, + -6.432215690612793 + ], + [ + 63, + -6.438755989074707 + ], + [ + 55332, + -6.482592582702637 + ], + [ + 46, + -6.563050746917725 + ], + [ + 120007, + -6.57243013381958 + ], + [ + 286, + -6.593961238861084 + ], + [ + 14395, + -6.64585542678833 + ], + [ + 1311, + -6.728163242340088 + ], + [ + 58, + -6.75308895111084 + ] + ], + "logprob_of_token": -0.24418574571609497, + "top1_top2_margin": 2.842876374721527, + "top6_top7_margin": 0.08330774307250977 + }, + { + "gen_index": 24, + "token": 12843, + "top": [ + [ + 12843, + -0.2349534034729004 + ], + [ + 14031, + -3.173255443572998 + ], + [ + 2403, + -3.4220385551452637 + ], + [ + 55333, + -3.670729160308838 + ], + [ + 19827, + -4.9815144538879395 + ], + [ + 31663, + -5.915050983428955 + ], + [ + 59, + -5.945680141448975 + ], + [ + 26209, + -6.0643086433410645 + ], + [ + 120022, + -6.191312313079834 + ], + [ + 946, + -6.215018272399902 + ], + [ + 55332, + -6.323953151702881 + ], + [ + 44, + -6.341022968292236 + ], + [ + 46, + -6.342888832092285 + ], + [ + 94021, + -6.359758377075195 + ], + [ + 286, + -6.469118118286133 + ], + [ + 63, + -6.562375545501709 + ], + [ + 14395, + -6.690091609954834 + ], + [ + 120007, + -6.709987163543701 + ], + [ + 58, + -6.846208572387695 + ], + [ + 14188, + -6.892481327056885 + ] + ], + "logprob_of_token": -0.2349534034729004, + "top1_top2_margin": 2.9383020401000977, + "top6_top7_margin": 0.03062915802001953 + }, + { + "gen_index": 25, + "token": 12843, + "top": [ + [ + 12843, + -0.22536112368106842 + ], + [ + 14031, + -3.2647793292999268 + ], + [ + 2403, + -3.431506395339966 + ], + [ + 55333, + -3.698349714279175 + ], + [ + 19827, + -4.945952892303467 + ], + [ + 59, + -5.790237903594971 + ], + [ + 31663, + -6.005599021911621 + ], + [ + 55332, + -6.113306522369385 + ], + [ + 26209, + -6.149260997772217 + ], + [ + 46, + -6.187338352203369 + ], + [ + 58, + -6.226804256439209 + ], + [ + 946, + -6.390742778778076 + ], + [ + 44, + -6.478643417358398 + ], + [ + 63, + -6.525091171264648 + ], + [ + 55, + -6.5621232986450195 + ], + [ + 94021, + -6.661096096038818 + ], + [ + 14188, + -6.700600624084473 + ], + [ + 14395, + -6.703388690948486 + ], + [ + 127906, + -6.747405052185059 + ], + [ + 120022, + -6.848928451538086 + ] + ], + "logprob_of_token": -0.22536112368106842, + "top1_top2_margin": 3.0394182056188583, + "top6_top7_margin": 0.2153611183166504 + }, + { + "gen_index": 26, + "token": 12843, + "top": [ + [ + 12843, + -0.26467832922935486 + ], + [ + 2403, + -3.082110643386841 + ], + [ + 14031, + -3.1407597064971924 + ], + [ + 55333, + -3.728771448135376 + ], + [ + 19827, + -4.783164978027344 + ], + [ + 59, + -5.550666332244873 + ], + [ + 58, + -5.709951400756836 + ], + [ + 46, + -5.866601943969727 + ], + [ + 31663, + -5.976805686950684 + ], + [ + 55332, + -6.102261543273926 + ], + [ + 26209, + -6.143770217895508 + ], + [ + 946, + -6.233554840087891 + ], + [ + 44, + -6.2661871910095215 + ], + [ + 94021, + -6.592296600341797 + ], + [ + 14188, + -6.5925726890563965 + ], + [ + 6559, + -6.630247592926025 + ], + [ + 55, + -6.698137283325195 + ], + [ + 14395, + -6.699254512786865 + ], + [ + 63, + -6.736631393432617 + ], + [ + 127906, + -6.78322696685791 + ] + ], + "logprob_of_token": -0.26467832922935486, + "top1_top2_margin": 2.817432314157486, + "top6_top7_margin": 0.1592850685119629 + }, + { + "gen_index": 27, + "token": 12843, + "top": [ + [ + 12843, + -0.2489628940820694 + ], + [ + 2403, + -2.93204927444458 + ], + [ + 14031, + -3.32102632522583 + ], + [ + 55333, + -3.8329873085021973 + ], + [ + 19827, + -4.8703179359436035 + ], + [ + 59, + -5.82244348526001 + ], + [ + 31663, + -5.910871505737305 + ], + [ + 58, + -6.065310478210449 + ], + [ + 26209, + -6.149692535400391 + ], + [ + 946, + -6.2656779289245605 + ], + [ + 46, + -6.304868698120117 + ], + [ + 55332, + -6.386532783508301 + ], + [ + 44, + -6.463113784790039 + ], + [ + 120022, + -6.470300674438477 + ], + [ + 14395, + -6.495214462280273 + ], + [ + 55, + -6.643364429473877 + ], + [ + 63, + -6.68116569519043 + ], + [ + 94021, + -6.707212924957275 + ], + [ + 127906, + -6.745218276977539 + ], + [ + 120007, + -6.90068244934082 + ] + ], + "logprob_of_token": -0.2489628940820694, + "top1_top2_margin": 2.6830863803625107, + "top6_top7_margin": 0.08842802047729492 + }, + { + "gen_index": 28, + "token": 12843, + "top": [ + [ + 12843, + -0.2459137886762619 + ], + [ + 14031, + -2.981412172317505 + ], + [ + 2403, + -3.292020082473755 + ], + [ + 55333, + -3.777183771133423 + ], + [ + 19827, + -4.906570911407471 + ], + [ + 31663, + -5.948519706726074 + ], + [ + 59, + -5.97721529006958 + ], + [ + 26209, + -6.076605319976807 + ], + [ + 120022, + -6.102211952209473 + ], + [ + 946, + -6.2702765464782715 + ], + [ + 94021, + -6.378515243530273 + ], + [ + 55332, + -6.4065141677856445 + ], + [ + 46, + -6.472891330718994 + ], + [ + 58, + -6.485308647155762 + ], + [ + 44, + -6.5062994956970215 + ], + [ + 14395, + -6.618289470672607 + ], + [ + 286, + -6.628331661224365 + ], + [ + 63, + -6.721354961395264 + ], + [ + 55, + -6.736670017242432 + ], + [ + 120007, + -6.794571876525879 + ] + ], + "logprob_of_token": -0.2459137886762619, + "top1_top2_margin": 2.735498383641243, + "top6_top7_margin": 0.02869558334350586 + }, + { + "gen_index": 29, + "token": 12843, + "top": [ + [ + 12843, + -0.23940782248973846 + ], + [ + 2403, + -3.225346803665161 + ], + [ + 14031, + -3.2589962482452393 + ], + [ + 55333, + -3.471008539199829 + ], + [ + 19827, + -4.782388210296631 + ], + [ + 31663, + -5.670225620269775 + ], + [ + 26209, + -5.989870548248291 + ], + [ + 120022, + -6.032419681549072 + ], + [ + 946, + -6.072874546051025 + ], + [ + 94021, + -6.162987232208252 + ], + [ + 55332, + -6.222386360168457 + ], + [ + 59, + -6.284063816070557 + ], + [ + 120007, + -6.621760368347168 + ], + [ + 63, + -6.657039165496826 + ], + [ + 286, + -6.714292526245117 + ], + [ + 14395, + -6.841530799865723 + ], + [ + 55, + -6.865250110626221 + ], + [ + 46, + -6.88853645324707 + ], + [ + 44, + -6.95176887512207 + ], + [ + 1311, + -6.978645324707031 + ] + ], + "logprob_of_token": -0.23940782248973846, + "top1_top2_margin": 2.9859389811754227, + "top6_top7_margin": 0.3196449279785156 + }, + { + "gen_index": 30, + "token": 12843, + "top": [ + [ + 12843, + -0.25397247076034546 + ], + [ + 55333, + -3.0386710166931152 + ], + [ + 2403, + -3.377336025238037 + ], + [ + 14031, + -3.384209156036377 + ], + [ + 19827, + -4.7731404304504395 + ], + [ + 120022, + -5.556106090545654 + ], + [ + 31663, + -5.779036521911621 + ], + [ + 63, + -5.849503517150879 + ], + [ + 94021, + -5.882835388183594 + ], + [ + 26209, + -6.050953388214111 + ], + [ + 120007, + -6.064478397369385 + ], + [ + 55332, + -6.107748031616211 + ], + [ + 59, + -6.188029766082764 + ], + [ + 286, + -6.456371784210205 + ], + [ + 1311, + -6.626758098602295 + ], + [ + 55, + -6.6672186851501465 + ], + [ + 946, + -6.725772380828857 + ], + [ + 46, + -6.845307350158691 + ], + [ + 121080, + -6.91619873046875 + ], + [ + 44, + -7.009884357452393 + ] + ], + "logprob_of_token": -0.25397247076034546, + "top1_top2_margin": 2.7846985459327698, + "top6_top7_margin": 0.2229304313659668 + }, + { + "gen_index": 31, + "token": 12843, + "top": [ + [ + 12843, + -0.31337517499923706 + ], + [ + 14031, + -2.971905469894409 + ], + [ + 2403, + -3.0842082500457764 + ], + [ + 55333, + -3.328660726547241 + ], + [ + 19827, + -4.9849042892456055 + ], + [ + 120022, + -5.212173938751221 + ], + [ + 120007, + -5.628828525543213 + ], + [ + 59, + -5.80322265625 + ], + [ + 94021, + -5.806195259094238 + ], + [ + 31663, + -5.870853900909424 + ], + [ + 63, + -6.010465621948242 + ], + [ + 946, + -6.0260772705078125 + ], + [ + 55332, + -6.035622596740723 + ], + [ + 26209, + -6.151800155639648 + ], + [ + 286, + -6.242814540863037 + ], + [ + 1311, + -6.33974552154541 + ], + [ + 46, + -6.428411483764648 + ], + [ + 14395, + -6.511769771575928 + ], + [ + 44, + -6.544284820556641 + ], + [ + 55, + -6.716195583343506 + ] + ], + "logprob_of_token": -0.31337517499923706, + "top1_top2_margin": 2.658530294895172, + "top6_top7_margin": 0.4166545867919922 + } + ] + } + ], + "gguf_sha256": "76ddb05e458cce1a023d42cd4f13dc8e8152fbb6501c1f680918fc7d2a0fcefd", + "sampling": "greedy (temperature 0)", + "dtype": "BF16" +} diff --git a/tests/vllm/models/kolibri1_primary_topk_rows.json b/tests/vllm/models/kolibri1_primary_topk_rows.json index 6a129630a..6ad1d96e9 100644 --- a/tests/vllm/models/kolibri1_primary_topk_rows.json +++ b/tests/vllm/models/kolibri1_primary_topk_rows.json @@ -1 +1 @@ -{"model": "/mnt/models/Aleph-Alpha/Kolibri-1-bf16-clean", "topk": 100, "max_new_tokens": 32, "prompts": [{"prompt": "alpha beta gamma delta epsilon zeta", "input_ids": [5249, 25079, 74493, 15774, 121598, 116026], "generated_ids": [116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026], "rows": [{"gen_index": 0, "token": 116026, "top": [[121598, -0.325004], [15774, -2.666602], [15930, -4.290113], [95373, -4.629995], [33343, -5.425639], [74493, -5.713079], [32, -5.768961], [21337, -6.122069], [15960, -6.215015], [42046, -6.347763], [115060, -6.445216], [25079, -6.809273], [121249, -6.853539], [125787, -6.88146], [44, -6.991154], [67223, -7.016564], [68158, -7.071229], [9734, -7.120121], [101051, -7.168147], [116908, -7.281675], [3167, -7.290723], [40301, -7.357125], [2125, -7.36853], [28594, -7.394494], [8055, -7.399162], [946, -7.426579], [116026, -7.447584], [127906, -7.513064], [22984, -7.625052], [94105, -7.678319], [286, -7.755596], [34, -7.771349], [7625, -7.789632], [9405, -7.791567], [8613, -7.802984], [63530, -7.806689], [46, -7.88222], [93847, -7.932858], [735, -7.939559], [122414, -7.958271], [2398, -8.022045], [14154, -8.032452], [76288, -8.048683], [14153, -8.094131], [16013, -8.11138], [936, -8.126092], [78924, -8.139388], [69096, -8.177582], [120675, -8.22146], [941, -8.281115], [14541, -8.299726], [123782, -8.309555], [108916, -8.335959], [86937, -8.375774], [2114, -8.384699], [69798, -8.425556], [262, -8.438234], [21730, -8.440032], [2157, -8.45245], [28623, -8.48579], [15622, -8.533874], [824, -8.548855], [47771, -8.571294], [26530, -8.572689], [23147, -8.573851], [115542, -8.585225], [3584, -8.600486], [47968, -8.614657], [4257, -8.628108], [121111, -8.656754], [7427, -8.723845], [9518, -8.742604], [113382, -8.755118], [120293, -8.760528], [82648, -8.761885], [37976, -8.77168], [52606, -8.772118], [5274, -8.816301], [14290, -8.821852], [622, -8.826412], [1409, -8.855533], [669, -8.859349], [120608, -8.910441], [36209, -8.918283], [63, -8.925576], [4075, -8.927264], [766, -8.927476], [120008, -8.940289], [1275, -8.94415], [99545, -8.944282], [22664, -8.948684], [49868, -8.953887], [51599, -8.967783], [1073, -8.973527], [3326, -8.975933], [10444, -8.982745], [37447, -8.987083], [60475, -8.993587], [122935, -8.99474], [17875, -8.996603]], "logprob_of_token": -7.447584, "top1_top2_margin": 2.341598, "top6_top7_margin": 0.055882}, {"gen_index": 1, "token": 116026, "top": [[116026, -0.943565], [121598, -1.214995], [34774, -3.574584], [15930, -3.654647], [125787, -3.789949], [15774, -4.635954], [16581, -5.033639], [115060, -5.832742], [32, -5.934945], [949, -6.094397], [14620, -6.118017], [116908, -6.447867], [44, -6.525632], [63530, -6.535117], [95373, -6.546416], [14541, -6.548631], [42046, -6.615215], [101051, -6.634198], [40301, -6.63574], [16013, -6.673426], [25079, -6.736976], [735, -6.762966], [123470, -6.885275], [936, -6.892465], [68158, -6.931103], [74493, -6.945714], [83150, -6.957963], [15960, -7.137805], [14153, -7.178715], [14188, -7.21796], [120653, -7.233123], [82275, -7.266447], [3786, -7.268791], [127604, -7.269865], [121322, -7.288667], [121249, -7.313475], [286, -7.328341], [123576, -7.362907], [14168, -7.372573], [94105, -7.376568], [32502, -7.402382], [120293, -7.419972], [120625, -7.479943], [16604, -7.568687], [127906, -7.589654], [122414, -7.665443], [46, -7.71692], [7510, -7.766733], [34, -7.780186], [67223, -7.83622], [19193, -7.842639], [14154, -7.843524], [318, -7.872367], [622, -7.898974], [14179, -7.909676], [262, -7.945328], [4257, -7.955871], [835, -8.033165], [60475, -8.046588], [2125, -8.08139], [946, -8.099908], [90, -8.102327], [68037, -8.118078], [122629, -8.12441], [766, -8.126954], [15521, -8.134634], [21216, -8.146012], [9405, -8.151453], [33343, -8.152681], [120007, -8.152865], [70741, -8.153075], [9734, -8.193198], [54566, -8.202256], [8613, -8.212846], [70338, -8.217828], [120675, -8.219712], [78924, -8.219971], [502, -8.240443], [120719, -8.24366], [63, -8.248103], [108916, -8.258881], [94742, -8.263838], [120626, -8.307992], [1275, -8.308658], [95343, -8.318584], [47, -8.321589], [101040, -8.357689], [39, -8.357843], [123124, -8.359466], [123302, -8.365518], [123653, -8.377089], [310, -8.380368], [54329, -8.380925], [39445, -8.407697], [21337, -8.41046], [14419, -8.430998], [22664, -8.432261], [51599, -8.432894], [685, -8.438673], [49430, -8.451316]], "logprob_of_token": -0.943565, "top1_top2_margin": 0.27143, "top6_top7_margin": 0.397685}, {"gen_index": 2, "token": 116026, "top": [[116026, -0.28033], [125787, -3.717885], [34774, -3.891269], [949, -5.001238], [121598, -5.072105], [14620, -5.751047], [16581, -5.7581], [14153, -5.792322], [83150, -5.81092], [32, -5.837166], [735, -5.967307], [120625, -6.090748], [116908, -6.095234], [14541, -6.150908], [63530, -6.36373], [42046, -6.412945], [15774, -6.437956], [120653, -6.755884], [120293, -6.99059], [25079, -6.994502], [127906, -7.054441], [101051, -7.121085], [121249, -7.180941], [14188, -7.195388], [123576, -7.198302], [32502, -7.216728], [121322, -7.224472], [936, -7.249109], [74493, -7.279641], [502, -7.319066], [44, -7.376373], [40301, -7.423328], [123182, -7.449378], [127604, -7.512552], [122629, -7.519501], [14179, -7.519935], [21216, -7.527208], [2125, -7.534264], [120719, -7.537275], [286, -7.554265], [16604, -7.578542], [119647, -7.589512], [68037, -7.610829], [941, -7.618158], [946, -7.626684], [94105, -7.628355], [14419, -7.636005], [3786, -7.65648], [622, -7.697617], [47, -7.750299], [49430, -7.774838], [60475, -7.796728], [34, -7.833864], [82275, -7.847462], [766, -7.867192], [22664, -7.940765], [1275, -7.962089], [115060, -8.018161], [82765, -8.031937], [94742, -8.063956], [262, -8.082161], [120675, -8.101073], [123302, -8.120425], [46, -8.134779], [3688, -8.169312], [43914, -8.192226], [34701, -8.19256], [7510, -8.201568], [15397, -8.218934], [70741, -8.226329], [2403, -8.252955], [318, -8.276404], [48752, -8.278963], [353, -8.281781], [90, -8.296161], [63, -8.29694], [1921, -8.304456], [120784, -8.312397], [835, -8.320029], [919, -8.346279], [310, -8.349547], [608, -8.355989], [120007, -8.389537], [279, -8.403831], [669, -8.422969], [40320, -8.423963], [123470, -8.435109], [14696, -8.454015], [70338, -8.465404], [52654, -8.474339], [39, -8.478629], [123653, -8.486492], [41086, -8.492318], [125030, -8.509742], [14168, -8.536981], [42, -8.613121], [2048, -8.616864], [4222, -8.619988], [5274, -8.626832], [33, -8.686282]], "logprob_of_token": -0.28033, "top1_top2_margin": 3.437556, "top6_top7_margin": 0.007053}, {"gen_index": 3, "token": 116026, "top": [[116026, -0.196718], [34774, -4.182076], [125787, -4.824233], [14620, -5.486257], [949, -5.639053], [83150, -5.745828], [14153, -5.816586], [32, -5.892428], [120625, -6.080964], [116908, -6.438009], [735, -6.727904], [127906, -6.811963], [63530, -6.811964], [14541, -6.850717], [42046, -6.88597], [14188, -7.006792], [101051, -7.010479], [82765, -7.039443], [123576, -7.051399], [121598, -7.09852], [44, -7.141848], [14179, -7.192352], [120293, -7.232328], [121249, -7.240458], [40301, -7.285811], [16581, -7.296166], [34, -7.367821], [21216, -7.381629], [2125, -7.482914], [286, -7.52734], [32502, -7.540429], [25079, -7.550499], [120719, -7.55905], [123182, -7.564181], [14419, -7.590094], [119647, -7.65942], [63, -7.660728], [15774, -7.68025], [49430, -7.706151], [936, -7.716871], [946, -7.726924], [941, -7.756649], [120653, -7.769949], [766, -7.774878], [120007, -7.782938], [502, -7.819664], [1921, -7.831703], [42, -7.870502], [46, -7.885034], [74493, -7.888696], [122629, -7.890704], [3688, -8.005363], [41086, -8.020237], [60475, -8.076193], [3786, -8.101127], [15397, -8.107032], [120784, -8.124231], [82275, -8.129847], [68037, -8.139324], [94105, -8.177014], [123302, -8.178482], [622, -8.179532], [279, -8.187475], [92, -8.203778], [22664, -8.224778], [34701, -8.255551], [24826, -8.263297], [120675, -8.287545], [47, -8.317632], [14696, -8.324061], [7510, -8.34537], [94742, -8.354381], [1275, -8.374681], [16604, -8.378954], [52654, -8.401011], [121322, -8.417905], [127604, -8.442327], [4075, -8.458821], [48752, -8.478937], [353, -8.481877], [835, -8.485716], [14825, -8.487791], [262, -8.505338], [5274, -8.510035], [120001, -8.531998], [39, -8.54531], [33, -8.56532], [44175, -8.610751], [318, -8.619858], [82618, -8.642966], [576, -8.648179], [125030, -8.665874], [669, -8.680348], [57926, -8.73616], [40320, -8.743459], [123653, -8.77478], [11292, -8.814057], [102925, -8.831044], [70338, -8.841774], [7878, -8.85553]], "logprob_of_token": -0.196718, "top1_top2_margin": 3.985358, "top6_top7_margin": 0.070758}, {"gen_index": 4, "token": 116026, "top": [[116026, -0.173224], [34774, -4.489264], [125787, -5.388278], [14620, -5.505294], [14153, -5.524546], [83150, -5.635072], [949, -5.764091], [32, -5.903965], [120625, -6.512772], [127906, -6.588139], [735, -6.702394], [14188, -6.764821], [42046, -6.813173], [14179, -6.838463], [116908, -6.884993], [123576, -6.926613], [34, -6.95461], [63530, -7.035307], [44, -7.035871], [82765, -7.148522], [14541, -7.24305], [2125, -7.297671], [1921, -7.390726], [3786, -7.400635], [32502, -7.401201], [120719, -7.412289], [101051, -7.417634], [49430, -7.428485], [120007, -7.44615], [21216, -7.481595], [42, -7.50359], [14419, -7.521393], [286, -7.545405], [120293, -7.547563], [121598, -7.590423], [63, -7.596025], [40301, -7.612348], [946, -7.613847], [121249, -7.62238], [120653, -7.639069], [936, -7.688882], [941, -7.70085], [766, -7.710064], [119647, -7.737994], [123182, -7.752089], [46, -7.752692], [25079, -7.800555], [502, -7.813896], [15397, -7.845284], [120784, -7.897136], [74493, -7.918328], [41086, -7.924503], [16581, -7.973563], [279, -8.04738], [14696, -8.074699], [47, -8.097081], [622, -8.107026], [34701, -8.119145], [3688, -8.124411], [92, -8.131016], [120001, -8.143876], [94742, -8.153236], [82275, -8.154406], [60475, -8.15851], [39, -8.16225], [52654, -8.233275], [4075, -8.237452], [15774, -8.242615], [121322, -8.273494], [122629, -8.29923], [1275, -8.341579], [40320, -8.342147], [5274, -8.382491], [262, -8.39465], [11292, -8.405959], [120675, -8.506384], [127604, -8.51586], [24826, -8.526167], [22664, -8.532944], [48752, -8.533025], [94105, -8.536296], [14825, -8.53966], [123653, -8.541541], [82618, -8.547755], [68037, -8.560548], [44175, -8.577784], [4222, -8.586921], [835, -8.605392], [16604, -8.6064], [7510, -8.607512], [123302, -8.633407], [33, -8.638978], [353, -8.653666], [94, -8.657977], [120256, -8.703202], [120046, -8.705647], [1427, -8.731259], [576, -8.737679], [318, -8.794255], [3167, -8.796716]], "logprob_of_token": -0.173224, "top1_top2_margin": 4.316039, "top6_top7_margin": 0.129019}, {"gen_index": 5, "token": 116026, "top": [[116026, -0.149603], [34774, -4.581424], [125787, -5.188057], [14620, -5.304764], [83150, -5.94779], [949, -6.008715], [14153, -6.175043], [32, -6.24312], [42046, -6.495979], [127906, -6.819831], [116908, -6.89772], [735, -6.972487], [123576, -7.037797], [121598, -7.138923], [14188, -7.144416], [63530, -7.154256], [120625, -7.325009], [14179, -7.34005], [44, -7.345974], [82765, -7.383025], [34, -7.394032], [25079, -7.398068], [101051, -7.411225], [14541, -7.455532], [40301, -7.488916], [32502, -7.530705], [120007, -7.542222], [2125, -7.597047], [119647, -7.597318], [120719, -7.627642], [14419, -7.654797], [74493, -7.678187], [286, -7.711649], [121249, -7.721799], [49430, -7.742292], [21216, -7.759426], [120293, -7.784167], [1921, -7.786206], [3786, -7.787584], [63, -7.826964], [42, -7.853367], [123182, -7.872451], [15774, -7.873745], [46, -7.893039], [120653, -7.897496], [120784, -7.910853], [946, -7.913068], [16581, -7.923325], [941, -7.927653], [502, -7.933892], [766, -7.939955], [14696, -7.946015], [94742, -8.072938], [15397, -8.089116], [40320, -8.098648], [82275, -8.109479], [41086, -8.118068], [936, -8.127682], [279, -8.18297], [120675, -8.187508], [120001, -8.191843], [4222, -8.330847], [52654, -8.333694], [34701, -8.350757], [4075, -8.367619], [3688, -8.377547], [92, -8.382283], [622, -8.387775], [68037, -8.38803], [122629, -8.419291], [94105, -8.437339], [5274, -8.477205], [127604, -8.502125], [22664, -8.503179], [60475, -8.509098], [47, -8.527867], [39, -8.535713], [82618, -8.536261], [262, -8.559451], [44175, -8.572951], [120256, -8.584937], [123653, -8.647142], [48752, -8.650065], [122532, -8.655699], [1275, -8.660582], [24826, -8.665693], [121322, -8.703844], [7510, -8.712208], [125030, -8.715397], [123302, -8.742142], [353, -8.743662], [16604, -8.746729], [11292, -8.757942], [94, -8.804266], [102925, -8.81884], [33, -8.877135], [1427, -8.894238], [90, -8.927576], [835, -8.953751], [116208, -8.964376]], "logprob_of_token": -0.149603, "top1_top2_margin": 4.431821, "top6_top7_margin": 0.166328}, {"gen_index": 6, "token": 116026, "top": [[116026, -0.232596], [34774, -4.483362], [125787, -5.109098], [14620, -5.242196], [14153, -5.423881], [949, -5.744764], [32, -5.77037], [83150, -5.776521], [42046, -6.196381], [127906, -6.318517], [14188, -6.543626], [63530, -6.550564], [116908, -6.585923], [14179, -6.682994], [34, -6.730018], [735, -6.73101], [121598, -6.857399], [123576, -6.898092], [44, -6.919734], [101051, -6.97945], [1921, -7.016634], [120007, -7.0581], [120625, -7.060365], [2125, -7.068582], [119647, -7.111773], [40301, -7.155483], [82765, -7.158255], [25079, -7.174389], [3786, -7.179891], [74493, -7.185115], [14541, -7.262149], [21216, -7.269149], [14419, -7.274875], [120784, -7.282437], [120293, -7.306055], [936, -7.309459], [946, -7.327044], [941, -7.34581], [286, -7.348948], [120719, -7.397561], [42, -7.434875], [15397, -7.436905], [32502, -7.457675], [123182, -7.485784], [49430, -7.512737], [120653, -7.5135], [766, -7.519428], [121249, -7.534765], [46, -7.550596], [15774, -7.579831], [63, -7.589024], [94742, -7.595835], [120001, -7.610577], [14696, -7.642587], [502, -7.645393], [16581, -7.657777], [40320, -7.719603], [41086, -7.741054], [4075, -7.807598], [34701, -7.827061], [82275, -7.853185], [279, -7.921012], [47, -7.960981], [3688, -7.969303], [94105, -7.989054], [5274, -8.001665], [39, -8.001982], [52654, -8.010425], [68037, -8.04032], [92, -8.043977], [262, -8.052316], [622, -8.056581], [120675, -8.062101], [60475, -8.097099], [44175, -8.106353], [1427, -8.111322], [121322, -8.127662], [82618, -8.161067], [22664, -8.182942], [122629, -8.22133], [123653, -8.223645], [48752, -8.236941], [127604, -8.268043], [7510, -8.284358], [353, -8.288216], [94, -8.309646], [4222, -8.314444], [3167, -8.319161], [1275, -8.322021], [11292, -8.357121], [102925, -8.382531], [14825, -8.394168], [24826, -8.427649], [122532, -8.434432], [123302, -8.439647], [57926, -8.445092], [16604, -8.453732], [669, -8.487374], [120256, -8.490761], [120046, -8.506452]], "logprob_of_token": -0.232596, "top1_top2_margin": 4.250766, "top6_top7_margin": 0.025606}, {"gen_index": 7, "token": 116026, "top": [[116026, -0.146932], [34774, -4.383215], [125787, -5.365145], [14620, -5.553035], [14153, -6.038159], [42046, -6.07339], [949, -6.14592], [83150, -6.149242], [32, -6.384641], [121598, -6.517893], [63530, -6.718482], [116908, -6.773697], [735, -6.798128], [101051, -6.854596], [120625, -6.897747], [127906, -6.984481], [14188, -7.148897], [74493, -7.177018], [123576, -7.201331], [15774, -7.244215], [25079, -7.260833], [34, -7.298819], [14179, -7.307822], [40301, -7.324168], [120007, -7.483157], [120293, -7.547967], [44, -7.559719], [3786, -7.560548], [1921, -7.580326], [82765, -7.621009], [121249, -7.695311], [123182, -7.698365], [32502, -7.751911], [120784, -7.769492], [15397, -7.774908], [14541, -7.778614], [16581, -7.785157], [119647, -7.8061], [941, -7.811966], [946, -7.848022], [936, -7.849794], [42, -7.868192], [14419, -7.888973], [21216, -7.906795], [286, -7.917084], [2125, -7.923155], [34701, -7.946257], [120653, -7.946432], [40320, -7.952593], [94105, -8.031379], [94742, -8.039186], [14696, -8.043146], [120675, -8.082977], [63, -8.09102], [766, -8.095583], [82275, -8.154499], [502, -8.200462], [49430, -8.211566], [68037, -8.215963], [41086, -8.29456], [46, -8.33573], [120719, -8.368337], [60475, -8.369164], [122629, -8.414452], [123302, -8.428143], [52654, -8.439885], [3688, -8.44704], [262, -8.455092], [39, -8.464931], [4075, -8.470879], [120001, -8.479867], [47, -8.482013], [102925, -8.492012], [5274, -8.497869], [123653, -8.5036], [82618, -8.529493], [279, -8.541051], [44175, -8.563727], [622, -8.664222], [22664, -8.672496], [3167, -8.680796], [24826, -8.682806], [121322, -8.698612], [48752, -8.701421], [92, -8.715517], [1427, -8.755259], [57926, -8.787089], [122532, -8.803504], [120256, -8.810096], [1275, -8.824433], [127604, -8.836958], [2403, -8.840558], [11292, -8.873818], [94, -8.923336], [353, -8.9315], [90, -8.933933], [7510, -8.937016], [33, -8.977077], [669, -9.018834], [22984, -9.06984]], "logprob_of_token": -0.146932, "top1_top2_margin": 4.236283, "top6_top7_margin": 0.072531}, {"gen_index": 8, "token": 116026, "top": [[116026, -0.155252], [34774, -4.252292], [125787, -5.444586], [14620, -5.539608], [14153, -5.616455], [42046, -6.167215], [83150, -6.347967], [949, -6.410456], [121598, -6.442207], [32, -6.542826], [116908, -6.638913], [101051, -6.690417], [63530, -6.82989], [120625, -6.939594], [735, -7.00308], [3786, -7.152304], [123576, -7.20037], [14541, -7.226284], [14179, -7.233861], [74493, -7.313004], [14188, -7.325675], [25079, -7.336085], [15774, -7.386776], [127906, -7.411449], [40301, -7.434958], [82765, -7.520795], [120007, -7.573292], [44, -7.582824], [121249, -7.628951], [1921, -7.660713], [34, -7.683399], [120293, -7.709993], [941, -7.718882], [15397, -7.723451], [286, -7.729772], [120784, -7.765379], [946, -7.76768], [123182, -7.810535], [936, -7.814664], [32502, -7.845312], [2125, -7.952138], [49430, -7.97059], [34701, -7.98628], [120719, -8.014228], [63, -8.014764], [14419, -8.018055], [42, -8.024223], [21216, -8.030016], [119647, -8.03408], [40320, -8.04081], [94105, -8.087794], [120675, -8.092746], [120653, -8.118642], [16581, -8.140038], [14696, -8.157495], [60475, -8.193638], [766, -8.260139], [82275, -8.286323], [279, -8.287396], [52654, -8.305243], [82618, -8.338574], [262, -8.347482], [1427, -8.385246], [46, -8.386016], [41086, -8.418133], [68037, -8.427325], [502, -8.430079], [4075, -8.435774], [122629, -8.450141], [94742, -8.467464], [33, -8.486566], [22664, -8.489207], [3688, -8.495605], [622, -8.514754], [1275, -8.547407], [39, -8.550916], [127604, -8.61121], [102925, -8.632804], [123653, -8.634282], [120256, -8.650949], [47, -8.65273], [2403, -8.672722], [123302, -8.712788], [799, -8.721414], [44175, -8.742476], [120001, -8.767988], [121322, -8.783065], [122532, -8.812522], [353, -8.825335], [11292, -8.862725], [48752, -8.867995], [92, -8.894912], [4222, -8.911269], [919, -8.918629], [5274, -8.938355], [3167, -8.938508], [24826, -8.93924], [57926, -8.959148], [1083, -8.982392], [474, -9.011747]], "logprob_of_token": -0.155252, "top1_top2_margin": 4.09704, "top6_top7_margin": 0.180751}, {"gen_index": 9, "token": 116026, "top": [[116026, -0.17914], [34774, -4.177118], [14153, -5.531055], [125787, -5.600605], [14620, -5.748708], [83150, -6.083608], [42046, -6.30116], [32, -6.391456], [949, -6.401186], [116908, -6.486259], [121598, -6.502058], [101051, -6.568483], [63530, -6.57573], [3786, -6.785843], [735, -6.786435], [120625, -6.828762], [14179, -6.942231], [127906, -7.030303], [14188, -7.166528], [123576, -7.213346], [1921, -7.272552], [34, -7.313684], [82765, -7.316761], [946, -7.368574], [14541, -7.375408], [40301, -7.38859], [120007, -7.397816], [74493, -7.46349], [44, -7.466432], [120293, -7.490117], [941, -7.498012], [25079, -7.540706], [2125, -7.559088], [15397, -7.577851], [121249, -7.59314], [286, -7.611322], [42, -7.687581], [120784, -7.690905], [936, -7.692556], [32502, -7.69989], [15774, -7.717023], [123182, -7.747944], [119647, -7.834051], [14419, -7.852239], [40320, -7.898308], [34701, -7.926107], [94105, -7.941306], [63, -7.958414], [262, -7.990048], [16581, -7.991902], [49430, -8.017719], [60475, -8.064503], [279, -8.067529], [120719, -8.069152], [21216, -8.077017], [766, -8.121145], [502, -8.160544], [82275, -8.169171], [4075, -8.172524], [82618, -8.185528], [3688, -8.19899], [14696, -8.241097], [52654, -8.245217], [120675, -8.252934], [120653, -8.258018], [46, -8.306235], [622, -8.330461], [94742, -8.334307], [799, -8.337687], [22664, -8.337838], [68037, -8.353455], [44175, -8.359352], [41086, -8.368134], [122629, -8.372501], [1275, -8.379029], [1427, -8.400408], [39, -8.419751], [33, -8.426169], [2403, -8.44243], [47, -8.507925], [5274, -8.586086], [120001, -8.58621], [92, -8.593454], [102925, -8.606213], [123653, -8.628879], [11292, -8.645933], [353, -8.646219], [127604, -8.656151], [123302, -8.681158], [4222, -8.691757], [2879, -8.712639], [923, -8.764708], [121322, -8.772664], [919, -8.776854], [3167, -8.814955], [48752, -8.819899], [3660, -8.838964], [121488, -8.869833], [57926, -8.876331], [125030, -8.88406]], "logprob_of_token": -0.17914, "top1_top2_margin": 3.997978, "top6_top7_margin": 0.217553}, {"gen_index": 10, "token": 116026, "top": [[116026, -0.214139], [34774, -4.059031], [125787, -5.349232], [14153, -5.364075], [14620, -5.87317], [83150, -6.118178], [42046, -6.138655], [32, -6.203332], [101051, -6.267337], [949, -6.397766], [116908, -6.441831], [735, -6.507747], [121598, -6.541161], [14179, -6.548682], [127906, -6.609882], [3786, -6.695408], [14188, -6.700424], [63530, -6.709047], [34, -6.945343], [120625, -6.972238], [1921, -7.027221], [44, -7.182063], [120293, -7.194681], [123576, -7.215834], [15774, -7.305512], [25079, -7.346329], [120007, -7.437829], [42, -7.451442], [2125, -7.472991], [936, -7.490566], [74493, -7.504387], [14541, -7.562642], [946, -7.565078], [286, -7.58406], [123182, -7.592371], [941, -7.595849], [82765, -7.60546], [16581, -7.611189], [15397, -7.653976], [32502, -7.690938], [40301, -7.697265], [46, -7.712595], [120784, -7.731669], [121249, -7.742409], [766, -7.762351], [119647, -7.80284], [262, -7.816278], [94105, -7.863254], [14419, -7.897367], [622, -7.897512], [40320, -7.933633], [279, -7.972957], [49430, -7.99346], [60475, -8.001378], [120675, -8.006626], [502, -8.013243], [5274, -8.01566], [120653, -8.021037], [63, -8.021915], [94742, -8.037565], [3688, -8.038624], [122629, -8.052217], [4075, -8.056412], [120001, -8.068822], [34701, -8.138568], [82275, -8.140354], [39, -8.178419], [21216, -8.190437], [799, -8.224128], [52654, -8.237545], [47, -8.238666], [1427, -8.302228], [123653, -8.310796], [14696, -8.351113], [68037, -8.358834], [1275, -8.365053], [82618, -8.398736], [22664, -8.401374], [41086, -8.402188], [123302, -8.409705], [48752, -8.418482], [92, -8.429633], [33, -8.43497], [120719, -8.438327], [2403, -8.445195], [102925, -8.491309], [3167, -8.524145], [121322, -8.547231], [44175, -8.55306], [353, -8.593699], [669, -8.615597], [923, -8.621189], [7510, -8.646791], [127604, -8.650765], [11292, -8.705247], [125030, -8.734479], [57926, -8.739627], [919, -8.744226], [4222, -8.745306], [26794, -8.750511]], "logprob_of_token": -0.214139, "top1_top2_margin": 3.844892, "top6_top7_margin": 0.020476}, {"gen_index": 11, "token": 116026, "top": [[116026, -0.220966], [34774, -4.098984], [14153, -5.205594], [125787, -5.324138], [83150, -5.765213], [14620, -5.927832], [42046, -6.104386], [735, -6.178851], [32, -6.180986], [949, -6.267801], [101051, -6.418283], [127906, -6.467418], [14179, -6.507319], [14188, -6.514053], [116908, -6.542013], [3786, -6.738823], [63530, -6.76085], [34, -6.766266], [121598, -6.777373], [1921, -6.806792], [120625, -6.885299], [44, -7.066495], [123576, -7.230806], [946, -7.27739], [2125, -7.324162], [120293, -7.340911], [936, -7.34263], [32502, -7.344838], [15774, -7.366433], [120007, -7.37786], [42, -7.379075], [25079, -7.380044], [123182, -7.413077], [46, -7.526003], [941, -7.576118], [286, -7.579933], [14541, -7.580173], [15397, -7.592534], [16581, -7.596739], [82765, -7.600698], [40301, -7.602423], [622, -7.647131], [74493, -7.654032], [120784, -7.691669], [121249, -7.750553], [119647, -7.762995], [63, -7.804749], [262, -7.81713], [766, -7.819563], [502, -7.841083], [120675, -7.848923], [14419, -7.864909], [4075, -7.888356], [94742, -7.910779], [122629, -7.912663], [279, -7.931439], [5274, -7.938852], [40320, -7.954093], [3688, -7.956635], [49430, -7.960465], [39, -7.976981], [94105, -7.995167], [60475, -8.052526], [120001, -8.089004], [21216, -8.141519], [1275, -8.150365], [82275, -8.159352], [799, -8.179116], [34701, -8.240002], [52654, -8.244732], [33, -8.260285], [68037, -8.275157], [14696, -8.284616], [123653, -8.289448], [1427, -8.293825], [120653, -8.325435], [48752, -8.339006], [47, -8.363029], [120719, -8.369858], [123302, -8.376785], [22664, -8.387285], [92, -8.398927], [82618, -8.412107], [102925, -8.454967], [923, -8.471251], [669, -8.489395], [353, -8.491117], [44175, -8.494984], [2403, -8.498348], [41086, -8.50719], [3167, -8.510426], [2879, -8.51344], [3660, -8.588295], [318, -8.597619], [121322, -8.632396], [11292, -8.648144], [919, -8.663664], [4222, -8.665626], [835, -8.67484], [7510, -8.717854]], "logprob_of_token": -0.220966, "top1_top2_margin": 3.878017, "top6_top7_margin": 0.176554}, {"gen_index": 12, "token": 116026, "top": [[116026, -0.221366], [34774, -4.05696], [14153, -5.071674], [125787, -5.108666], [83150, -5.95602], [14620, -6.010282], [42046, -6.049], [32, -6.173602], [101051, -6.211216], [735, -6.228268], [127906, -6.265152], [14179, -6.306836], [14188, -6.343781], [116908, -6.455972], [121598, -6.500722], [949, -6.508884], [34, -6.593764], [1921, -6.704309], [63530, -6.705129], [120625, -6.785425], [3786, -6.867409], [44, -7.02971], [15774, -7.185435], [42, -7.205015], [936, -7.26958], [120293, -7.288566], [25079, -7.325937], [120007, -7.32606], [46, -7.33285], [946, -7.33926], [123576, -7.339727], [16581, -7.357383], [2125, -7.507483], [941, -7.51875], [40301, -7.52654], [32502, -7.5272], [286, -7.531495], [123182, -7.55398], [15397, -7.59625], [74493, -7.611757], [120784, -7.661821], [766, -7.699142], [5274, -7.703248], [14541, -7.720409], [622, -7.727886], [82765, -7.730402], [121249, -7.733891], [122629, -7.747332], [262, -7.749028], [120675, -7.76769], [63, -7.81898], [39, -7.877123], [4075, -7.879328], [502, -7.896554], [94742, -7.92929], [40320, -7.956269], [119647, -7.957056], [120001, -7.964952], [14419, -7.969215], [279, -8.000192], [94105, -8.02353], [60475, -8.037392], [799, -8.056584], [3688, -8.068421], [49430, -8.129637], [34701, -8.142418], [82275, -8.189962], [21216, -8.249154], [1275, -8.259094], [52654, -8.270461], [33, -8.27143], [123653, -8.291618], [48752, -8.343003], [14696, -8.366408], [120653, -8.374629], [47, -8.395553], [68037, -8.408349], [120719, -8.421409], [1427, -8.422341], [123302, -8.463396], [44175, -8.473288], [3167, -8.480302], [41086, -8.48335], [923, -8.497068], [669, -8.499876], [7510, -8.506739], [2879, -8.507274], [102925, -8.520493], [22664, -8.522129], [353, -8.5223], [94, -8.55303], [92, -8.574161], [4222, -8.577468], [2403, -8.584446], [3660, -8.611001], [57926, -8.627698], [82618, -8.652406], [4225, -8.666532], [318, -8.670354], [120078, -8.70357]], "logprob_of_token": -0.221366, "top1_top2_margin": 3.835594, "top6_top7_margin": 0.038718}, {"gen_index": 13, "token": 116026, "top": [[116026, -0.217906], [34774, -4.169117], [14153, -5.007516], [125787, -5.353379], [83150, -5.752275], [14620, -5.982059], [42046, -6.055925], [32, -6.16994], [735, -6.199688], [14179, -6.315643], [101051, -6.334944], [127906, -6.342017], [14188, -6.355669], [949, -6.454762], [116908, -6.653527], [121598, -6.655653], [34, -6.733337], [1921, -6.738711], [3786, -6.87303], [120625, -6.899198], [63530, -7.011073], [44, -7.122687], [15774, -7.168021], [936, -7.230577], [120007, -7.251983], [42, -7.266948], [123182, -7.289954], [123576, -7.321665], [32502, -7.355408], [120293, -7.370892], [2125, -7.413526], [46, -7.415448], [946, -7.419498], [15397, -7.419703], [941, -7.426353], [120784, -7.463141], [25079, -7.472077], [40301, -7.589268], [74493, -7.622932], [286, -7.652081], [94742, -7.700947], [622, -7.701871], [119647, -7.711157], [120675, -7.733778], [63, -7.734125], [40320, -7.737884], [14541, -7.763243], [766, -7.767466], [262, -7.779915], [82765, -7.784272], [16581, -7.794728], [121249, -7.831607], [5274, -7.843325], [502, -7.890669], [49430, -7.90953], [39, -7.925989], [120001, -7.950307], [94105, -7.954029], [4075, -7.961937], [122629, -7.989929], [3688, -8.053998], [60475, -8.066195], [14419, -8.066406], [799, -8.096527], [82275, -8.117641], [21216, -8.134314], [52654, -8.137815], [33, -8.160316], [1275, -8.177262], [279, -8.198318], [120719, -8.203678], [123653, -8.209331], [34701, -8.259715], [1427, -8.271686], [82618, -8.339316], [14696, -8.352023], [48752, -8.362926], [102925, -8.373688], [22664, -8.385357], [68037, -8.392175], [123302, -8.415605], [2403, -8.437635], [120653, -8.438558], [4222, -8.441282], [41086, -8.465497], [3167, -8.472349], [11292, -8.511894], [44175, -8.512717], [47, -8.538554], [92, -8.553125], [669, -8.599301], [923, -8.60003], [120078, -8.615157], [127604, -8.635139], [4225, -8.653817], [3660, -8.658753], [57926, -8.675664], [318, -8.680966], [121322, -8.709496], [353, -8.715616]], "logprob_of_token": -0.217906, "top1_top2_margin": 3.951212, "top6_top7_margin": 0.073867}, {"gen_index": 14, "token": 116026, "top": [[116026, -0.226791], [34774, -4.047577], [14153, -4.848548], [125787, -5.49928], [83150, -5.950099], [14620, -6.026671], [32, -6.144125], [42046, -6.157796], [735, -6.162344], [14179, -6.165459], [127906, -6.168988], [101051, -6.203489], [14188, -6.243527], [34, -6.406094], [949, -6.460997], [1921, -6.537082], [116908, -6.579731], [121598, -6.751076], [120625, -6.794054], [3786, -6.894283], [42, -6.943576], [63530, -7.008821], [123576, -7.234756], [946, -7.240776], [44, -7.308625], [936, -7.312153], [120007, -7.340899], [15397, -7.375353], [941, -7.381907], [120293, -7.401543], [32502, -7.408994], [15774, -7.409807], [25079, -7.478018], [46, -7.50482], [120784, -7.517854], [123182, -7.536701], [40301, -7.555814], [2125, -7.583279], [286, -7.585793], [82765, -7.60635], [74493, -7.633219], [262, -7.661844], [40320, -7.665755], [5274, -7.671689], [766, -7.686461], [4075, -7.745671], [622, -7.792737], [16581, -7.798036], [39, -7.849268], [502, -7.849896], [120001, -7.865968], [94742, -7.87364], [120675, -7.880455], [121249, -7.909965], [119647, -7.940187], [82275, -7.944251], [63, -7.965501], [14541, -7.988296], [122629, -8.012122], [52654, -8.0149], [34701, -8.031021], [94105, -8.042442], [14419, -8.042802], [279, -8.045348], [3688, -8.094579], [799, -8.094748], [49430, -8.109043], [60475, -8.112549], [21216, -8.124112], [41086, -8.135978], [123653, -8.166283], [48752, -8.199647], [120719, -8.248705], [33, -8.266101], [1275, -8.281788], [120653, -8.29984], [14696, -8.332461], [102925, -8.33522], [3167, -8.354526], [4222, -8.357769], [44175, -8.370073], [82618, -8.389354], [123302, -8.409997], [1427, -8.420737], [22664, -8.471662], [47, -8.47816], [669, -8.503332], [120078, -8.514359], [68037, -8.522034], [2403, -8.549086], [2879, -8.580994], [92, -8.597158], [94, -8.608157], [11292, -8.613233], [4225, -8.627322], [90, -8.65215], [30591, -8.656926], [122532, -8.658229], [121322, -8.671027], [353, -8.677649]], "logprob_of_token": -0.226791, "top1_top2_margin": 3.820787, "top6_top7_margin": 0.117455}, {"gen_index": 15, "token": 116026, "top": [[116026, -0.224912], [34774, -4.123631], [14153, -4.836545], [14620, -5.713966], [125787, -5.720962], [83150, -5.774072], [14179, -6.082921], [32, -6.202761], [127906, -6.225384], [14188, -6.237654], [735, -6.255515], [34, -6.409298], [42046, -6.42075], [949, -6.422311], [101051, -6.485773], [1921, -6.528764], [3786, -6.733232], [116908, -6.779043], [120625, -6.78281], [121598, -6.853142], [42, -6.887307], [123576, -7.035428], [63530, -7.090033], [946, -7.181209], [32502, -7.252185], [44, -7.253171], [120007, -7.272688], [941, -7.337089], [82765, -7.374479], [15397, -7.382262], [936, -7.390321], [46, -7.443176], [123182, -7.449899], [120293, -7.504489], [2125, -7.512795], [40320, -7.516586], [120784, -7.526102], [25079, -7.598353], [40301, -7.634347], [286, -7.640469], [15774, -7.667294], [5274, -7.695348], [262, -7.699721], [766, -7.745424], [622, -7.745996], [4075, -7.753345], [63, -7.777257], [119647, -7.785655], [82275, -7.787646], [502, -7.824568], [74493, -7.85197], [14541, -7.869271], [39, -7.880526], [52654, -7.882573], [94742, -7.887578], [121249, -7.908135], [49430, -7.915281], [120001, -7.93064], [799, -7.968324], [21216, -7.99685], [3688, -8.002329], [279, -8.048877], [122629, -8.05612], [33, -8.075733], [94105, -8.077879], [14419, -8.089323], [41086, -8.090897], [34701, -8.100783], [82618, -8.103518], [60475, -8.116658], [120719, -8.132896], [120675, -8.141264], [1275, -8.154011], [123653, -8.154701], [48752, -8.159431], [16581, -8.167018], [120653, -8.19879], [44175, -8.247087], [123302, -8.262507], [14696, -8.284285], [3167, -8.293818], [102925, -8.29934], [4222, -8.327029], [92, -8.420034], [11292, -8.440888], [120078, -8.459116], [122532, -8.49879], [1427, -8.503991], [47, -8.521169], [2403, -8.533581], [22664, -8.591165], [919, -8.613553], [121322, -8.622202], [90, -8.635995], [30591, -8.641915], [310, -8.645049], [127604, -8.652896], [669, -8.654552], [2879, -8.670189], [353, -8.677289]], "logprob_of_token": -0.224912, "top1_top2_margin": 3.898719, "top6_top7_margin": 0.308849}, {"gen_index": 16, "token": 116026, "top": [[116026, -0.11523], [34774, -4.380249], [14153, -5.180806], [125787, -6.142705], [14620, -6.29507], [83150, -6.302358], [949, -6.687837], [127906, -6.68826], [32, -6.714365], [42046, -6.798734], [116908, -7.040753], [101051, -7.048756], [14188, -7.127708], [34, -7.212582], [121598, -7.224433], [14179, -7.250818], [3786, -7.288586], [1921, -7.299646], [42, -7.444413], [735, -7.451808], [63530, -7.571698], [2125, -7.621597], [946, -7.646679], [120007, -7.659781], [32502, -7.666008], [941, -7.71904], [40301, -7.736178], [82765, -7.753648], [44, -7.772618], [120625, -7.782564], [123576, -7.863247], [120784, -7.953242], [40320, -8.002574], [120293, -8.032603], [49430, -8.046781], [123182, -8.062438], [74493, -8.078684], [14541, -8.106445], [46, -8.126575], [936, -8.154116], [4075, -8.209542], [25079, -8.2107], [286, -8.258423], [63, -8.288949], [14419, -8.31314], [121249, -8.340439], [15774, -8.347749], [15397, -8.352681], [120675, -8.392089], [94105, -8.415751], [33, -8.42317], [262, -8.452394], [766, -8.495154], [92, -8.51612], [622, -8.529789], [39, -8.555778], [82275, -8.576987], [799, -8.58364], [120001, -8.603345], [279, -8.608703], [82618, -8.609559], [119647, -8.612556], [14696, -8.645045], [1275, -8.650158], [21216, -8.687383], [120719, -8.690409], [120653, -8.699206], [52654, -8.737128], [41086, -8.763618], [68037, -8.764319], [60475, -8.772517], [1427, -8.807212], [502, -8.823239], [34701, -8.824515], [16581, -8.839536], [3688, -8.840518], [123653, -8.899161], [22664, -8.90693], [94742, -8.935575], [122629, -8.98603], [5274, -8.987568], [2403, -9.002658], [94, -9.023843], [11292, -9.028728], [90, -9.076416], [102925, -9.081068], [120078, -9.084468], [919, -9.096219], [44175, -9.097341], [22984, -9.101323], [669, -9.12144], [47, -9.135934], [474, -9.138485], [45, -9.146528], [120256, -9.168826], [121322, -9.244232], [3167, -9.254881], [14926, -9.276689], [318, -9.276715], [127604, -9.286924]], "logprob_of_token": -0.11523, "top1_top2_margin": 4.265019, "top6_top7_margin": 0.385479}, {"gen_index": 17, "token": 116026, "top": [[116026, -0.151379], [34774, -4.336407], [14153, -5.066794], [14620, -5.965719], [83150, -6.094578], [125787, -6.270358], [949, -6.273166], [127906, -6.43968], [101051, -6.459503], [42046, -6.578889], [32, -6.651485], [14179, -6.703426], [116908, -6.720677], [1921, -6.767036], [14188, -6.768631], [34, -6.879018], [735, -6.927598], [3786, -7.000342], [42, -7.011817], [120007, -7.162955], [120625, -7.219595], [121598, -7.25302], [63530, -7.261444], [946, -7.46119], [2125, -7.515083], [941, -7.527322], [82765, -7.581238], [44, -7.593712], [123576, -7.637472], [120293, -7.649299], [40301, -7.702099], [120784, -7.748811], [40320, -7.771141], [14419, -7.780868], [46, -7.79686], [32502, -7.8002], [936, -7.886254], [123182, -7.899358], [49430, -7.94018], [74493, -7.968844], [14541, -7.978691], [286, -7.983126], [1427, -7.996595], [262, -8.034245], [15397, -8.044706], [94105, -8.072777], [766, -8.086466], [120675, -8.103018], [25079, -8.116325], [4075, -8.128644], [15774, -8.14146], [63, -8.156732], [60475, -8.159553], [52654, -8.198574], [120001, -8.247606], [82275, -8.248528], [121249, -8.253854], [622, -8.282596], [14696, -8.30215], [21216, -8.314713], [502, -8.344914], [39, -8.389091], [119647, -8.394856], [82618, -8.397175], [120719, -8.415475], [5274, -8.419858], [92, -8.435964], [34701, -8.495385], [94742, -8.499304], [2403, -8.504525], [41086, -8.525031], [3688, -8.525973], [279, -8.528008], [799, -8.538781], [122629, -8.548568], [33, -8.588562], [102925, -8.596399], [1275, -8.6253], [120653, -8.632947], [11292, -8.652462], [22664, -8.656802], [4222, -8.698164], [123653, -8.71347], [47, -8.733175], [22984, -8.75796], [48752, -8.790406], [44175, -8.812618], [16581, -8.823201], [123302, -8.827903], [120078, -8.835904], [68037, -8.859326], [90, -8.863526], [3167, -8.898029], [45, -8.94383], [94, -8.953884], [9518, -8.964911], [4225, -8.991798], [923, -8.994729], [669, -9.013322], [121322, -9.017798]], "logprob_of_token": -0.151379, "top1_top2_margin": 4.185028, "top6_top7_margin": 0.002809}, {"gen_index": 18, "token": 116026, "top": [[116026, -0.152369], [34774, -4.274918], [14153, -5.12978], [83150, -5.958493], [125787, -6.01854], [14620, -6.223208], [949, -6.293509], [127906, -6.32903], [101051, -6.562318], [32, -6.563417], [1921, -6.636177], [42046, -6.690884], [14179, -6.735009], [14188, -6.763477], [116908, -6.765554], [735, -6.83675], [34, -6.897573], [42, -6.965073], [120007, -7.087869], [120625, -7.089836], [3786, -7.150435], [941, -7.168669], [63530, -7.238398], [121598, -7.242867], [946, -7.307006], [2125, -7.425997], [120293, -7.45437], [40301, -7.523285], [32502, -7.606413], [44, -7.622312], [82765, -7.700504], [120784, -7.732563], [123182, -7.77928], [14541, -7.880997], [123576, -7.890263], [46, -7.897324], [40320, -7.928113], [936, -7.931472], [14419, -7.946445], [286, -7.98103], [262, -7.983858], [63, -8.029786], [15774, -8.032607], [15397, -8.043557], [4075, -8.094354], [94105, -8.108701], [766, -8.115301], [502, -8.129027], [622, -8.134083], [74493, -8.158922], [120675, -8.177338], [49430, -8.188891], [120001, -8.246622], [16581, -8.261017], [25079, -8.266165], [5274, -8.276525], [3688, -8.278866], [82275, -8.28912], [39, -8.348602], [1427, -8.36614], [52654, -8.371131], [121249, -8.377563], [119647, -8.384684], [60475, -8.385277], [2403, -8.396062], [799, -8.410208], [92, -8.429957], [21216, -8.469224], [33, -8.474568], [279, -8.485567], [94742, -8.497697], [122629, -8.509583], [14696, -8.522833], [102925, -8.554101], [34701, -8.582799], [1275, -8.591113], [4222, -8.645061], [82618, -8.658472], [123653, -8.689268], [22664, -8.693028], [120653, -8.700702], [11292, -8.729851], [94, -8.756616], [68037, -8.764663], [41086, -8.785319], [47, -8.813276], [90, -8.813975], [123302, -8.826958], [120078, -8.857582], [9518, -8.873755], [120719, -8.874072], [22984, -8.888097], [3167, -8.905986], [48752, -8.924466], [6391, -8.971745], [669, -8.97457], [44175, -8.979543], [4225, -8.981339], [26794, -8.984641], [120022, -9.000343]], "logprob_of_token": -0.152369, "top1_top2_margin": 4.122549, "top6_top7_margin": 0.070301}, {"gen_index": 19, "token": 116026, "top": [[116026, -0.142193], [34774, -4.289646], [14153, -5.254857], [83150, -6.13191], [14620, -6.165463], [125787, -6.21833], [127906, -6.420015], [949, -6.456233], [101051, -6.674968], [1921, -6.715364], [32, -6.732166], [116908, -6.773849], [42046, -6.922446], [14188, -6.923231], [34, -6.942303], [14179, -6.958304], [735, -6.979003], [42, -7.011169], [120007, -7.107255], [120625, -7.148418], [3786, -7.188019], [946, -7.331904], [63530, -7.338582], [121598, -7.384163], [941, -7.449509], [2125, -7.530574], [82765, -7.586312], [40301, -7.612845], [120293, -7.637973], [44, -7.739621], [120784, -7.784324], [32502, -7.806136], [14419, -7.825172], [123576, -7.843842], [40320, -7.875694], [123182, -7.890913], [46, -7.926907], [936, -7.956702], [14541, -7.998451], [49430, -8.030906], [262, -8.031491], [286, -8.033613], [63, -8.060375], [120675, -8.119977], [502, -8.139004], [4075, -8.164967], [766, -8.184855], [94105, -8.23663], [74493, -8.265882], [15397, -8.272606], [1427, -8.27887], [120001, -8.279852], [15774, -8.305017], [82275, -8.325669], [622, -8.326965], [121249, -8.3638], [52654, -8.407546], [39, -8.431228], [60475, -8.445251], [21216, -8.447296], [3688, -8.453978], [92, -8.479227], [25079, -8.48081], [279, -8.483622], [799, -8.491325], [5274, -8.496212], [119647, -8.506637], [82618, -8.540279], [2403, -8.552372], [122629, -8.559258], [14696, -8.574482], [33, -8.57535], [94742, -8.583499], [34701, -8.613795], [102925, -8.618735], [1275, -8.646051], [16581, -8.68256], [41086, -8.696239], [120719, -8.70348], [120653, -8.72219], [11292, -8.7245], [4222, -8.728806], [22664, -8.734874], [123653, -8.741099], [68037, -8.839435], [123302, -8.853905], [120078, -8.882239], [47, -8.909012], [4225, -8.911556], [22984, -8.92669], [3167, -8.928231], [94, -8.9354], [9518, -8.936834], [120022, -8.958754], [90, -8.985587], [7878, -8.998697], [24826, -9.036655], [923, -9.050272], [669, -9.051168], [44175, -9.067544]], "logprob_of_token": -0.142193, "top1_top2_margin": 4.147453, "top6_top7_margin": 0.201684}, {"gen_index": 20, "token": 116026, "top": [[116026, -0.126498], [34774, -4.313104], [14153, -5.353465], [14620, -6.000209], [83150, -6.310007], [125787, -6.386564], [949, -6.451238], [127906, -6.560059], [101051, -6.754798], [116908, -6.846919], [32, -6.864282], [1921, -6.909392], [14179, -6.958903], [42, -6.991379], [42046, -7.057988], [34, -7.065197], [120007, -7.099726], [14188, -7.163642], [120625, -7.252673], [735, -7.300404], [3786, -7.334966], [63530, -7.490418], [121598, -7.522704], [82765, -7.524332], [941, -7.531808], [946, -7.569512], [40301, -7.707245], [120293, -7.717054], [123576, -7.755363], [2125, -7.834015], [120784, -7.850014], [44, -7.864117], [40320, -7.881433], [32502, -7.920986], [14419, -7.930685], [49430, -8.054902], [46, -8.059236], [123182, -8.091801], [936, -8.166329], [14541, -8.171688], [262, -8.226515], [63, -8.290597], [286, -8.309169], [502, -8.338446], [766, -8.348783], [82275, -8.365588], [121249, -8.376371], [74493, -8.39522], [120675, -8.41199], [120001, -8.412475], [94105, -8.429527], [60475, -8.45929], [4075, -8.47189], [1427, -8.492436], [21216, -8.494996], [622, -8.506741], [25079, -8.50787], [15397, -8.527489], [52654, -8.563259], [120719, -8.564776], [799, -8.569982], [82618, -8.575916], [92, -8.577785], [41086, -8.583992], [39, -8.591224], [14696, -8.595445], [34701, -8.603103], [279, -8.607799], [33, -8.623853], [15774, -8.666995], [3688, -8.677548], [119647, -8.682105], [120653, -8.701314], [5274, -8.731882], [123653, -8.732711], [1275, -8.7409], [122629, -8.745379], [102925, -8.784736], [94742, -8.81775], [2403, -8.856299], [22664, -8.85778], [4222, -8.875079], [47, -8.913263], [68037, -8.923173], [120078, -8.930654], [4225, -8.936336], [11292, -8.945362], [90, -8.962595], [44175, -8.964981], [123302, -8.981098], [45, -9.007923], [94, -9.019457], [120256, -9.028193], [120022, -9.065812], [122532, -9.096122], [16581, -9.104202], [22984, -9.120055], [3167, -9.122559], [14926, -9.148409], [127604, -9.172231]], "logprob_of_token": -0.126498, "top1_top2_margin": 4.186606, "top6_top7_margin": 0.064674}, {"gen_index": 21, "token": 116026, "top": [[116026, -0.195596], [34774, -4.03717], [14153, -4.84715], [125787, -5.926567], [83150, -5.953283], [14620, -5.971854], [127906, -6.060036], [14179, -6.17169], [735, -6.355146], [34, -6.395843], [949, -6.406524], [1921, -6.420864], [32, -6.448002], [101051, -6.512183], [14188, -6.52714], [42, -6.55009], [3786, -6.805671], [116908, -6.819211], [120625, -6.824008], [42046, -6.874869], [120007, -6.95672], [121598, -7.180634], [63530, -7.281417], [46, -7.302742], [946, -7.358188], [44, -7.386756], [941, -7.428677], [2125, -7.465447], [82765, -7.490104], [32502, -7.495235], [120293, -7.522677], [123576, -7.593017], [936, -7.638214], [502, -7.653159], [123182, -7.705478], [40301, -7.713494], [262, -7.716771], [14419, -7.723327], [40320, -7.728017], [622, -7.75265], [799, -7.789109], [120001, -7.794744], [286, -7.794873], [5274, -7.817503], [120784, -7.817914], [766, -7.935887], [279, -7.960168], [49430, -8.007844], [39, -8.028397], [122629, -8.036665], [52654, -8.06601], [82275, -8.076307], [3688, -8.08111], [63, -8.103665], [4075, -8.103848], [15397, -8.107135], [14541, -8.117766], [60475, -8.139869], [119647, -8.187453], [92, -8.203039], [1427, -8.213416], [25079, -8.21943], [16581, -8.24774], [121249, -8.247995], [74493, -8.262182], [15774, -8.267008], [120675, -8.272364], [94105, -8.330621], [120078, -8.34166], [1275, -8.36269], [123653, -8.38555], [21216, -8.391235], [123302, -8.391259], [94742, -8.392521], [3711, -8.409871], [82618, -8.422091], [3167, -8.425933], [33, -8.438419], [4222, -8.443336], [41086, -8.443864], [102925, -8.447222], [2879, -8.451358], [4225, -8.483515], [2403, -8.500988], [45, -8.509733], [120653, -8.531696], [47, -8.549071], [120719, -8.57377], [48752, -8.581211], [22664, -8.58947], [11292, -8.592647], [120022, -8.618264], [310, -8.654917], [14696, -8.656757], [34701, -8.666756], [94, -8.681746], [669, -8.684937], [44175, -8.717509], [919, -8.734859], [36209, -8.7472]], "logprob_of_token": -0.195596, "top1_top2_margin": 3.841574, "top6_top7_margin": 0.088182}, {"gen_index": 22, "token": 116026, "top": [[116026, -0.191108], [34774, -4.167604], [14153, -5.154263], [125787, -5.624022], [83150, -5.941192], [127906, -5.970204], [14620, -6.013557], [14179, -6.268024], [101051, -6.268931], [34, -6.41264], [14188, -6.489748], [1921, -6.505914], [32, -6.51605], [949, -6.517841], [735, -6.521889], [120625, -6.64781], [42046, -6.654843], [42, -6.70844], [3786, -6.715792], [116908, -6.755687], [120007, -7.034777], [121598, -7.118275], [63530, -7.297564], [946, -7.305384], [941, -7.319293], [46, -7.359197], [44, -7.396214], [32502, -7.482085], [2125, -7.508289], [120293, -7.529387], [502, -7.576235], [82765, -7.587736], [123576, -7.59548], [14419, -7.612601], [936, -7.727608], [120784, -7.733665], [123182, -7.750037], [40301, -7.751842], [40320, -7.766616], [622, -7.766833], [286, -7.797152], [262, -7.818655], [120001, -7.837329], [5274, -7.866517], [799, -7.892658], [766, -7.946643], [39, -8.026426], [4075, -8.031723], [16581, -8.069618], [122629, -8.082245], [15397, -8.093249], [63, -8.104246], [119647, -8.110147], [279, -8.133491], [82275, -8.135022], [3688, -8.140743], [25079, -8.15345], [60475, -8.167991], [15774, -8.188311], [14541, -8.193791], [121249, -8.200974], [52654, -8.203834], [49430, -8.232627], [1427, -8.287755], [120675, -8.294007], [94105, -8.294439], [74493, -8.300707], [3711, -8.340146], [94742, -8.345109], [92, -8.34861], [120078, -8.348674], [123302, -8.389832], [41086, -8.390409], [33, -8.398527], [2403, -8.401525], [4222, -8.428964], [1275, -8.442758], [123653, -8.465267], [21216, -8.480763], [3167, -8.484465], [14696, -8.50135], [102925, -8.519616], [4225, -8.53403], [2879, -8.543259], [120719, -8.580686], [82618, -8.589832], [45, -8.625746], [669, -8.63549], [48752, -8.640676], [34701, -8.645106], [120022, -8.669292], [47, -8.66989], [44175, -8.682022], [9518, -8.716889], [11292, -8.722405], [36209, -8.726717], [22664, -8.739561], [2466, -8.763706], [94, -8.764923], [923, -8.786706]], "logprob_of_token": -0.191108, "top1_top2_margin": 3.976497, "top6_top7_margin": 0.043354}, {"gen_index": 23, "token": 116026, "top": [[116026, -0.180405], [34774, -4.097687], [14153, -5.167802], [125787, -5.568368], [83150, -5.999307], [127906, -6.006808], [14620, -6.168437], [14179, -6.268202], [101051, -6.331859], [735, -6.480398], [34, -6.485365], [14188, -6.490177], [949, -6.522426], [32, -6.540335], [42046, -6.605954], [120625, -6.613502], [1921, -6.620394], [42, -6.826808], [3786, -6.856777], [116908, -6.999727], [121598, -7.054582], [120007, -7.144252], [46, -7.313979], [63530, -7.361484], [941, -7.456605], [946, -7.462914], [44, -7.474168], [32502, -7.476533], [120293, -7.520643], [82765, -7.643452], [40301, -7.670441], [2125, -7.724146], [123576, -7.725327], [14419, -7.729486], [123182, -7.734674], [622, -7.774345], [120001, -7.812144], [936, -7.820897], [40320, -7.831423], [5274, -7.849821], [502, -7.865621], [16581, -7.893581], [262, -7.934151], [286, -7.937595], [799, -7.986242], [120784, -7.989116], [122629, -7.993741], [25079, -8.020644], [766, -8.049006], [15397, -8.080705], [39, -8.116207], [3711, -8.131471], [15774, -8.133654], [63, -8.13521], [4075, -8.149599], [82275, -8.161123], [1427, -8.185802], [279, -8.192131], [121249, -8.204651], [3688, -8.214843], [74493, -8.255307], [119647, -8.269047], [49430, -8.276531], [60475, -8.307394], [2403, -8.309956], [120675, -8.345469], [94105, -8.345614], [123653, -8.362789], [120078, -8.381483], [33, -8.397018], [52654, -8.410377], [94742, -8.412788], [14541, -8.420431], [1275, -8.434011], [14696, -8.459415], [123302, -8.482925], [102925, -8.486074], [41086, -8.486504], [4222, -8.489049], [92, -8.505838], [3167, -8.506795], [82618, -8.542295], [21216, -8.549814], [669, -8.615614], [34701, -8.625555], [2879, -8.630368], [45, -8.638694], [11292, -8.672718], [36209, -8.684008], [4225, -8.697239], [94, -8.704712], [44175, -8.70953], [310, -8.709738], [22664, -8.714885], [120719, -8.729008], [120022, -8.743458], [919, -8.753421], [68037, -8.773024], [48752, -8.821688], [90, -8.823117]], "logprob_of_token": -0.180405, "top1_top2_margin": 3.917282, "top6_top7_margin": 0.161629}, {"gen_index": 24, "token": 116026, "top": [[116026, -0.135986], [34774, -4.29864], [14153, -5.250825], [125787, -5.999073], [14620, -6.090496], [83150, -6.124857], [127906, -6.161064], [949, -6.62076], [101051, -6.699859], [34, -6.761175], [14179, -6.801813], [42, -6.804836], [32, -6.808363], [116908, -6.815207], [14188, -6.870326], [1921, -6.875344], [120007, -6.912887], [735, -6.939533], [120625, -7.033329], [42046, -7.064862], [121598, -7.217469], [63530, -7.266604], [941, -7.364903], [3786, -7.44771], [120293, -7.475764], [46, -7.625508], [946, -7.646959], [2125, -7.663634], [82765, -7.676491], [44, -7.678382], [14419, -7.74099], [32502, -7.775237], [40301, -7.784334], [120784, -7.815021], [14541, -7.919074], [936, -7.940833], [40320, -7.975269], [123576, -7.977068], [63, -8.005198], [123182, -8.069242], [120001, -8.162992], [262, -8.16881], [766, -8.18217], [286, -8.186735], [502, -8.2242], [49430, -8.276275], [121249, -8.285273], [33, -8.310965], [94105, -8.314224], [622, -8.332867], [120675, -8.335253], [15774, -8.336369], [15397, -8.33975], [5274, -8.350163], [74493, -8.391178], [92, -8.403331], [25079, -8.411236], [39, -8.416521], [16581, -8.421259], [279, -8.426571], [799, -8.438666], [82275, -8.495189], [60475, -8.495207], [94742, -8.510689], [1427, -8.515113], [52654, -8.51851], [119647, -8.520554], [4075, -8.523396], [122629, -8.556028], [3688, -8.565215], [120719, -8.621958], [4222, -8.663949], [102925, -8.665782], [123653, -8.676598], [21216, -8.694504], [120078, -8.696833], [1275, -8.710828], [4225, -8.726624], [41086, -8.741731], [3711, -8.747897], [14696, -8.750291], [82618, -8.761319], [34701, -8.775012], [2403, -8.819436], [94, -8.822382], [68037, -8.853624], [22664, -8.86022], [36209, -8.888797], [120022, -8.896025], [11292, -8.906728], [123302, -8.908776], [120653, -8.925526], [669, -8.95534], [47, -8.96547], [45, -8.973833], [90, -8.980844], [22984, -8.984171], [44175, -8.995293], [3167, -9.007079], [120410, -9.007702]], "logprob_of_token": -0.135986, "top1_top2_margin": 4.162654, "top6_top7_margin": 0.036207}, {"gen_index": 25, "token": 116026, "top": [[116026, -0.112955], [34774, -4.390644], [14153, -5.520161], [125787, -6.124608], [14620, -6.127542], [83150, -6.310405], [127906, -6.49539], [949, -6.598806], [101051, -6.803309], [116908, -6.847218], [32, -7.017406], [14179, -7.021517], [34, -7.051136], [120007, -7.083318], [1921, -7.090289], [42046, -7.12134], [42, -7.124259], [14188, -7.139764], [3786, -7.307479], [120625, -7.360085], [63530, -7.434021], [735, -7.438997], [121598, -7.484292], [941, -7.63727], [82765, -7.678082], [946, -7.682044], [120293, -7.714212], [14419, -7.783792], [40301, -7.846779], [2125, -7.919415], [46, -7.925772], [32502, -7.968143], [120784, -7.991833], [44, -8.002726], [40320, -8.032408], [123576, -8.071996], [936, -8.150747], [49430, -8.170221], [123182, -8.266526], [14541, -8.30583], [63, -8.318422], [262, -8.358374], [120675, -8.36977], [502, -8.398841], [120001, -8.413542], [286, -8.425405], [121249, -8.430535], [94105, -8.453655], [766, -8.48057], [74493, -8.498779], [82275, -8.507483], [33, -8.553076], [52654, -8.570406], [4075, -8.579327], [799, -8.614107], [15774, -8.623512], [1427, -8.633084], [622, -8.633666], [120719, -8.648167], [122629, -8.656332], [25079, -8.659949], [39, -8.66225], [60475, -8.67455], [82618, -8.681148], [15397, -8.691418], [21216, -8.693953], [119647, -8.708285], [5274, -8.711014], [92, -8.717793], [94742, -8.75407], [14696, -8.754784], [16581, -8.7611], [3688, -8.807093], [279, -8.809855], [1275, -8.852765], [22664, -8.895233], [102925, -8.906336], [41086, -8.909161], [123653, -8.911463], [68037, -8.92389], [120078, -8.940001], [34701, -8.967119], [2403, -8.985599], [11292, -8.988276], [4222, -8.989807], [120022, -9.026504], [120653, -9.040867], [123302, -9.046171], [4225, -9.065451], [3711, -9.066318], [44175, -9.093338], [90, -9.10371], [36209, -9.117451], [22984, -9.167246], [669, -9.175639], [94, -9.191253], [3167, -9.234373], [7510, -9.238198], [24826, -9.243174], [122532, -9.251611]], "logprob_of_token": -0.112955, "top1_top2_margin": 4.277689, "top6_top7_margin": 0.184985}, {"gen_index": 26, "token": 116026, "top": [[116026, -0.094652], [34774, -4.448398], [14153, -5.718497], [125787, -6.370509], [14620, -6.390882], [83150, -6.519943], [127906, -6.660604], [949, -6.862512], [116908, -6.889254], [101051, -6.946187], [120007, -7.179848], [14179, -7.186651], [32, -7.216547], [42046, -7.29084], [1921, -7.332041], [63530, -7.381352], [42, -7.397121], [34, -7.452437], [14188, -7.460842], [120625, -7.505394], [3786, -7.575601], [735, -7.719901], [121598, -7.725234], [941, -7.728462], [40301, -7.729652], [82765, -7.805763], [120293, -7.856996], [40320, -8.037522], [946, -8.042138], [123576, -8.062319], [2125, -8.079829], [120784, -8.100839], [14419, -8.110286], [936, -8.210246], [49430, -8.222174], [44, -8.229993], [32502, -8.264305], [46, -8.28396], [502, -8.327645], [120675, -8.380873], [262, -8.460421], [121249, -8.494249], [122629, -8.499471], [120719, -8.531606], [120001, -8.554366], [123182, -8.562717], [799, -8.567308], [14541, -8.573583], [74493, -8.635713], [286, -8.66063], [82275, -8.689493], [766, -8.694571], [1427, -8.709679], [21216, -8.713173], [63, -8.717473], [52654, -8.723891], [82618, -8.733148], [622, -8.747438], [14696, -8.769481], [94105, -8.831468], [60475, -8.837667], [92, -8.848806], [15397, -8.858941], [279, -8.880485], [33, -8.900714], [22664, -8.923544], [1275, -8.925175], [119647, -8.957413], [11292, -8.962569], [25079, -8.96724], [15774, -8.992027], [5274, -8.997903], [4075, -9.009888], [34701, -9.018012], [3688, -9.046572], [102925, -9.051837], [41086, -9.056266], [120022, -9.059991], [68037, -9.068782], [39, -9.097455], [44175, -9.116812], [4222, -9.119338], [16581, -9.125672], [94742, -9.160055], [2403, -9.190879], [22984, -9.196776], [4225, -9.24181], [123653, -9.308107], [120078, -9.314137], [94, -9.326371], [7510, -9.333745], [14794, -9.344583], [9518, -9.35171], [3711, -9.357466], [90, -9.413972], [24826, -9.426868], [1319, -9.429764], [14330, -9.43066], [123302, -9.444077], [120653, -9.451543]], "logprob_of_token": -0.094652, "top1_top2_margin": 4.353747, "top6_top7_margin": 0.140661}, {"gen_index": 27, "token": 116026, "top": [[116026, -0.107255], [34774, -4.398672], [14153, -5.476737], [14620, -6.217939], [125787, -6.3439], [83150, -6.354041], [127906, -6.579822], [949, -6.663146], [42046, -6.792686], [116908, -6.804129], [101051, -6.814703], [120007, -6.97676], [1921, -7.040008], [32, -7.048754], [34, -7.064774], [14179, -7.1806], [42, -7.209083], [3786, -7.212016], [14188, -7.260649], [735, -7.306459], [120625, -7.392094], [63530, -7.485167], [941, -7.58287], [946, -7.598833], [2125, -7.648682], [40301, -7.706605], [121598, -7.741004], [14419, -7.771817], [82765, -7.812902], [120293, -7.846112], [120784, -7.863575], [46, -7.942118], [32502, -7.942719], [44, -7.980669], [123576, -8.147135], [936, -8.158508], [40320, -8.180365], [286, -8.189631], [120675, -8.253635], [123182, -8.285171], [63, -8.307221], [49430, -8.318089], [502, -8.330613], [262, -8.420621], [122629, -8.442359], [622, -8.452368], [799, -8.458264], [121249, -8.474668], [120001, -8.475946], [33, -8.487119], [766, -8.517962], [92, -8.519418], [14541, -8.521537], [1275, -8.574883], [4075, -8.588668], [74493, -8.613387], [279, -8.631635], [21216, -8.664617], [82618, -8.667983], [15774, -8.67021], [25079, -8.724036], [39, -8.731412], [94105, -8.734674], [120719, -8.738094], [82275, -8.73957], [1427, -8.75341], [3688, -8.777651], [119647, -8.78125], [52654, -8.789073], [68037, -8.813659], [60475, -8.819032], [15397, -8.846934], [22664, -8.851371], [120022, -8.916608], [14696, -8.917785], [5274, -8.934996], [120078, -8.988723], [123302, -9.015767], [44175, -9.02415], [2403, -9.062136], [16581, -9.062273], [34701, -9.093567], [3711, -9.121911], [7510, -9.124351], [4222, -9.128119], [94742, -9.13064], [9518, -9.142926], [36209, -9.181558], [669, -9.182582], [3660, -9.188498], [318, -9.190403], [11292, -9.191403], [102925, -9.219937], [123653, -9.242134], [41086, -9.244033], [474, -9.24577], [2213, -9.269416], [120653, -9.276179], [1083, -9.284794], [919, -9.300258]], "logprob_of_token": -0.107255, "top1_top2_margin": 4.291417, "top6_top7_margin": 0.225781}, {"gen_index": 28, "token": 116026, "top": [[116026, -0.240798], [34774, -4.011719], [14153, -4.989996], [127906, -5.617486], [125787, -5.680673], [83150, -5.854718], [14620, -6.021101], [34, -6.021776], [14179, -6.070504], [735, -6.237357], [949, -6.252407], [1921, -6.271354], [14188, -6.323408], [101051, -6.331288], [32, -6.37021], [42, -6.426627], [116908, -6.496916], [120007, -6.558359], [3786, -6.595013], [120625, -6.713104], [42046, -6.782549], [46, -6.99009], [946, -7.028994], [121598, -7.080571], [941, -7.133629], [63530, -7.137708], [44, -7.238507], [799, -7.264427], [2125, -7.335487], [32502, -7.356976], [936, -7.359029], [120293, -7.366277], [502, -7.387234], [262, -7.416004], [14419, -7.474724], [622, -7.498729], [82765, -7.561441], [5274, -7.563543], [40320, -7.58485], [120001, -7.589708], [286, -7.663023], [3711, -7.674911], [123576, -7.703856], [123182, -7.721323], [766, -7.760699], [122629, -7.776834], [120784, -7.796655], [3688, -7.81124], [40301, -7.826327], [279, -7.846076], [39, -7.863592], [4075, -7.865695], [63, -7.896055], [16581, -7.964426], [119647, -7.964538], [1427, -8.006981], [92, -8.028075], [82275, -8.04471], [52654, -8.067266], [15397, -8.100995], [2879, -8.106201], [49430, -8.116137], [120078, -8.136147], [1275, -8.136681], [2403, -8.144622], [60475, -8.149389], [41, -8.150679], [33, -8.157525], [94742, -8.186089], [15774, -8.193841], [120675, -8.196778], [14541, -8.211941], [120022, -8.239929], [25079, -8.259505], [121249, -8.281766], [74493, -8.291376], [22664, -8.322069], [102925, -8.327111], [36209, -8.333755], [4225, -8.353365], [14696, -8.359244], [45, -8.374509], [94105, -8.375987], [123653, -8.379866], [2466, -8.382924], [4222, -8.390373], [47, -8.419291], [11292, -8.42447], [9518, -8.426694], [90, -8.437389], [21216, -8.439643], [120719, -8.441932], [919, -8.451272], [44175, -8.471034], [310, -8.492862], [41086, -8.500526], [3167, -8.504829], [94, -8.506001], [82618, -8.528225], [669, -8.53008]], "logprob_of_token": -0.240798, "top1_top2_margin": 3.770922, "top6_top7_margin": 0.166383}, {"gen_index": 29, "token": 116026, "top": [[116026, -0.215047], [34774, -4.012899], [14153, -5.024065], [125787, -5.562246], [127906, -5.631803], [83150, -5.847662], [34, -5.963132], [14620, -6.04681], [14179, -6.161354], [14188, -6.207224], [101051, -6.321721], [735, -6.331173], [1921, -6.403356], [32, -6.409155], [42, -6.426017], [949, -6.448093], [116908, -6.528375], [3786, -6.691319], [42046, -6.71735], [120007, -6.728256], [120625, -6.788155], [46, -6.914889], [121598, -7.059199], [946, -7.07413], [44, -7.224682], [63530, -7.228878], [941, -7.273012], [32502, -7.310369], [120293, -7.348989], [502, -7.424747], [2125, -7.43846], [799, -7.465019], [936, -7.498734], [622, -7.511268], [262, -7.556044], [14419, -7.564812], [5274, -7.594017], [120001, -7.600185], [82765, -7.614227], [3711, -7.682719], [286, -7.724151], [123576, -7.765541], [766, -7.781868], [40320, -7.80983], [123182, -7.815996], [120784, -7.832567], [16581, -7.85698], [4075, -7.869474], [39, -7.874359], [40301, -7.877445], [122629, -7.924607], [63, -7.926218], [3688, -7.933504], [279, -8.066029], [15774, -8.066758], [92, -8.084038], [1427, -8.09386], [119647, -8.127216], [120078, -8.129226], [82275, -8.1699], [33, -8.17117], [94742, -8.172344], [41, -8.178415], [60475, -8.193659], [15397, -8.193866], [25079, -8.204951], [52654, -8.207276], [1275, -8.220017], [49430, -8.220135], [120675, -8.247404], [2403, -8.253561], [2879, -8.256371], [121249, -8.297782], [36209, -8.302476], [74493, -8.311227], [14541, -8.333779], [120022, -8.382903], [2466, -8.42341], [94105, -8.428617], [102925, -8.460971], [123653, -8.463599], [4222, -8.46577], [22664, -8.476578], [4225, -8.477345], [90, -8.492002], [45, -8.507882], [14696, -8.52665], [669, -8.531547], [41086, -8.535635], [3167, -8.544045], [9518, -8.564059], [47, -8.57326], [11292, -8.591712], [3660, -8.60427], [30591, -8.605086], [123302, -8.605556], [94, -8.614219], [44175, -8.627807], [21216, -8.647723], [120719, -8.672511]], "logprob_of_token": -0.215047, "top1_top2_margin": 3.797853, "top6_top7_margin": 0.11547}, {"gen_index": 30, "token": 116026, "top": [[116026, -0.209233], [34774, -3.946184], [14153, -4.918225], [125787, -5.482661], [127906, -5.632333], [83150, -5.863402], [34, -6.025612], [14179, -6.042259], [14620, -6.131755], [14188, -6.161694], [735, -6.343286], [32, -6.391172], [1921, -6.448824], [101051, -6.46075], [42, -6.497237], [949, -6.503363], [120625, -6.714063], [42046, -6.756217], [116908, -6.797956], [120007, -6.816042], [3786, -6.869045], [46, -6.955276], [121598, -7.023832], [44, -7.201402], [63530, -7.254443], [946, -7.265741], [32502, -7.269105], [941, -7.334671], [120293, -7.37439], [2125, -7.522725], [799, -7.546788], [5274, -7.561147], [16581, -7.581609], [622, -7.586084], [936, -7.587739], [120001, -7.606971], [82765, -7.636352], [502, -7.686385], [262, -7.704094], [123182, -7.728216], [3711, -7.729296], [14419, -7.776845], [123576, -7.844293], [286, -7.847787], [40301, -7.857904], [766, -7.88094], [39, -7.889297], [40320, -7.905282], [63, -7.943151], [4075, -8.006957], [122629, -8.01229], [3688, -8.01333], [120784, -8.021529], [15397, -8.073683], [33, -8.128039], [82275, -8.143211], [15774, -8.143642], [94742, -8.148161], [119647, -8.165924], [279, -8.170459], [25079, -8.176644], [120078, -8.186496], [92, -8.188109], [121249, -8.251332], [1275, -8.252299], [74493, -8.261236], [36209, -8.277729], [41, -8.28002], [60475, -8.325459], [1427, -8.326856], [123653, -8.338087], [2403, -8.378046], [120675, -8.378124], [52654, -8.379923], [49430, -8.388796], [94105, -8.419692], [14541, -8.421474], [45, -8.434509], [90, -8.442785], [41086, -8.485336], [30591, -8.500099], [22664, -8.502742], [2879, -8.507318], [94, -8.526344], [102925, -8.52687], [120022, -8.537647], [2466, -8.547291], [68037, -8.550478], [3167, -8.575935], [44175, -8.58525], [4225, -8.600662], [123302, -8.604527], [14696, -8.611044], [669, -8.625223], [34701, -8.628972], [310, -8.641309], [4222, -8.651224], [120410, -8.658325], [82618, -8.67099], [10, -8.674802]], "logprob_of_token": -0.209233, "top1_top2_margin": 3.736951, "top6_top7_margin": 0.16221}, {"gen_index": 31, "token": 116026, "top": [[116026, -0.187156], [34774, -3.99317], [14153, -5.19964], [125787, -5.754674], [127906, -5.818665], [83150, -5.9544], [14620, -6.026567], [34, -6.159082], [14179, -6.252769], [14188, -6.364125], [735, -6.470119], [101051, -6.48258], [42, -6.539076], [1921, -6.568319], [949, -6.574884], [32, -6.587629], [116908, -6.779234], [3786, -6.798497], [120625, -6.845716], [120007, -6.90814], [42046, -6.913494], [46, -7.105327], [121598, -7.184875], [946, -7.29793], [32502, -7.330115], [44, -7.378779], [63530, -7.409159], [120293, -7.435295], [936, -7.49854], [941, -7.513786], [502, -7.553862], [799, -7.557127], [82765, -7.58314], [2125, -7.663548], [622, -7.713136], [5274, -7.724329], [14419, -7.798676], [262, -7.79935], [120001, -7.808749], [123576, -7.828268], [40320, -7.869943], [3711, -7.879512], [766, -7.94391], [123182, -7.94889], [286, -7.951833], [16581, -8.046754], [40301, -8.048589], [63, -8.053365], [120784, -8.065665], [39, -8.07116], [122629, -8.073999], [4075, -8.094135], [82275, -8.148512], [3688, -8.166982], [120078, -8.214414], [15774, -8.235763], [33, -8.243347], [92, -8.249674], [15397, -8.250196], [52654, -8.278305], [279, -8.314118], [94742, -8.320529], [49430, -8.320678], [119647, -8.333474], [25079, -8.338155], [121249, -8.341331], [120675, -8.357841], [1427, -8.3693], [1275, -8.387332], [74493, -8.390803], [60475, -8.400666], [36209, -8.408366], [2403, -8.414498], [41, -8.419433], [123653, -8.421893], [41086, -8.430177], [90, -8.471249], [2879, -8.479853], [14696, -8.514588], [4222, -8.550591], [94105, -8.550895], [120719, -8.561778], [14541, -8.562526], [4225, -8.566558], [120022, -8.593347], [82618, -8.615157], [102925, -8.618531], [22664, -8.62356], [2466, -8.640987], [34701, -8.642348], [44175, -8.655731], [11292, -8.664721], [669, -8.667044], [30591, -8.68967], [3167, -8.705312], [123302, -8.720635], [45, -8.723842], [94, -8.738241], [21216, -8.752561], [48752, -8.780336]], "logprob_of_token": -0.187156, "top1_top2_margin": 3.806014, "top6_top7_margin": 0.072167}]}, {"prompt": "der Mond scheint hell \u00fcber den Bergen", "input_ids": [339, 39046, 19373, 19573, 1489, 1178, 35423], "generated_ids": [948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423], "rows": [{"gen_index": 0, "token": 948, "top": [[1178, -3.089503], [19866, -3.104388], [66360, -3.598807], [20387, -4.893447], [32, -4.894697], [103541, -4.994757], [39715, -5.062906], [2125, -5.135899], [4691, -5.245246], [19573, -5.25374], [948, -5.270692], [420, -5.37411], [12831, -5.462849], [7389, -5.553463], [34654, -5.5851], [5274, -5.649434], [39046, -5.654584], [946, -5.681637], [8342, -5.731196], [346, -5.766985], [66847, -5.777843], [33072, -5.811238], [9702, -5.893275], [466, -5.899471], [840, -5.915207], [36500, -5.916464], [44, -5.938521], [47354, -6.07727], [36975, -6.083155], [3417, -6.089494], [26451, -6.267469], [1489, -6.276533], [28423, -6.280477], [737, -6.281603], [56604, -6.354227], [21499, -6.384704], [46790, -6.388548], [826, -6.391561], [53684, -6.398985], [1921, -6.429152], [10966, -6.433555], [7435, -6.446784], [58498, -6.478614], [24035, -6.500974], [7524, -6.588728], [35866, -6.600739], [48396, -6.605777], [104251, -6.618143], [353, -6.619389], [92, -6.636106], [12785, -6.637766], [1241, -6.643928], [12559, -6.654941], [11789, -6.655739], [6592, -6.659569], [845, -6.671682], [43869, -6.675103], [5565, -6.691087], [10492, -6.7065], [286, -6.736907], [38748, -6.749782], [9798, -6.75337], [61291, -6.798937], [46, -6.805806], [46672, -6.814368], [9710, -6.817121], [12123, -6.818038], [26884, -6.820505], [967, -6.825702], [3389, -6.861356], [77623, -6.869897], [30178, -6.872684], [21085, -6.904735], [1864, -6.911572], [119857, -6.928626], [34, -6.967393], [266, -6.986838], [32533, -6.987244], [25067, -6.990169], [74659, -7.009485], [126661, -7.012541], [14445, -7.016018], [1829, -7.054991], [115, -7.055029], [61184, -7.056973], [35009, -7.060725], [10331, -7.067397], [51527, -7.081951], [39297, -7.097492], [622, -7.099334], [12295, -7.102543], [102011, -7.111562], [3579, -7.113186], [60216, -7.113195], [12163, -7.128281], [38533, -7.148256], [42454, -7.152199], [318, -7.153224], [2421, -7.168705], [120007, -7.170354]], "logprob_of_token": -5.270692, "top1_top2_margin": 0.014885, "top6_top7_margin": 0.068149}, {"gen_index": 1, "token": 35423, "top": [[948, -1.65594], [420, -1.859744], [46, -1.955116], [1178, -2.045219], [44, -2.938481], [346, -3.292462], [275, -3.412409], [1829, -3.957183], [826, -4.750793], [831, -4.874519], [913, -5.082882], [622, -5.214382], [1489, -5.287446], [2625, -5.295294], [518, -5.49917], [1200, -5.518711], [35423, -5.58669], [2125, -5.935601], [513, -5.945812], [127906, -5.950424], [10304, -5.962291], [23819, -6.053146], [861, -6.057868], [58, -6.122584], [21938, -6.162566], [115, -6.24315], [5643, -6.276726], [14594, -6.279521], [262, -6.319017], [46252, -6.399632], [3504, -6.400877], [3643, -6.448873], [5274, -6.517865], [92, -6.554599], [1233, -6.558595], [8141, -6.598678], [59, -6.682604], [845, -6.72296], [466, -6.81501], [263, -6.815928], [11265, -6.828115], [2459, -6.844843], [493, -6.919385], [120007, -7.108161], [63, -7.195643], [294, -7.211545], [34, -7.238572], [2260, -7.29891], [286, -7.327006], [939, -7.38917], [526, -7.394493], [1687, -7.438732], [19573, -7.46465], [31496, -7.464776], [14188, -7.473892], [7314, -7.488957], [766, -7.50535], [1117, -7.537018], [614, -7.582353], [377, -7.664596], [2150, -7.666919], [44455, -7.725984], [4561, -7.729044], [1409, -7.773903], [16683, -7.788182], [3417, -7.797512], [15476, -7.798806], [1195, -7.800025], [7357, -7.822298], [7640, -7.837302], [45, -7.906219], [39, -7.916605], [1046, -7.973638], [14154, -8.028769], [14215, -8.033872], [266, -8.105201], [7815, -8.136633], [1953, -8.173905], [22863, -8.184803], [1241, -8.184843], [1047, -8.193429], [4351, -8.20012], [125259, -8.227242], [2361, -8.231826], [4550, -8.234878], [12975, -8.235361], [4610, -8.25509], [946, -8.269015], [1921, -8.27632], [11397, -8.279099], [61432, -8.302708], [1803, -8.30339], [7616, -8.339629], [836, -8.351975], [1917, -8.354033], [36, -8.379484], [2156, -8.38003], [1410, -8.39312], [2342, -8.396134], [279, -8.397001]], "logprob_of_token": -5.58669, "top1_top2_margin": 0.203804, "top6_top7_margin": 0.119946}, {"gen_index": 2, "token": 948, "top": [[35423, -1.136905], [46252, -1.139087], [948, -2.175403], [7616, -4.654821], [11397, -4.682821], [29394, -5.244864], [43492, -5.873023], [1178, -5.969798], [34654, -6.005474], [420, -6.025621], [22211, -6.402571], [55950, -6.524991], [66396, -6.761616], [2297, -6.771942], [3389, -6.935366], [346, -7.004312], [9702, -7.038393], [49541, -7.065762], [47607, -7.114076], [826, -7.139492], [103140, -7.152207], [52657, -7.152678], [34991, -7.20823], [26884, -7.248607], [21771, -7.292271], [66863, -7.345891], [80325, -7.453481], [48716, -7.456789], [127906, -7.464399], [28528, -7.478939], [38748, -7.492741], [46644, -7.506542], [6933, -7.526272], [43869, -7.553418], [12895, -7.562504], [28320, -7.592627], [1829, -7.638917], [53753, -7.643176], [21085, -7.652057], [11282, -7.664376], [8342, -7.674467], [19866, -7.695437], [36270, -7.728187], [5274, -7.74343], [46, -7.765998], [66360, -7.772136], [622, -7.794486], [24656, -7.850356], [15002, -7.850443], [78542, -7.854913], [845, -7.866642], [922, -7.914185], [60216, -7.9344], [8086, -7.93995], [100136, -7.95266], [339, -7.954942], [32533, -7.96725], [27300, -7.988195], [39229, -7.988412], [79493, -8.00399], [35009, -8.013159], [44, -8.016708], [840, -8.023356], [39077, -8.028454], [34560, -8.043055], [34748, -8.044768], [3395, -8.05859], [49848, -8.066907], [12163, -8.073489], [121167, -8.134031], [40202, -8.13698], [35091, -8.153726], [17485, -8.157074], [11789, -8.159834], [71890, -8.166971], [60147, -8.172666], [52553, -8.173855], [26451, -8.180286], [108251, -8.218671], [19089, -8.227318], [61827, -8.237209], [3417, -8.242928], [831, -8.250157], [33740, -8.256598], [58665, -8.258089], [51527, -8.267679], [8795, -8.274423], [43532, -8.276138], [108392, -8.296371], [1151, -8.317116], [5513, -8.318718], [33072, -8.320726], [32, -8.330267], [87462, -8.354807], [55998, -8.356791], [86354, -8.356894], [30778, -8.358923], [70201, -8.361137], [518, -8.36348], [262, -8.368948]], "logprob_of_token": -2.175403, "top1_top2_margin": 0.002182, "top6_top7_margin": 0.62816}, {"gen_index": 3, "token": 35423, "top": [[948, -0.017007], [831, -6.676363], [420, -6.695712], [346, -6.804394], [35423, -6.905784], [339, -7.051366], [279, -7.105613], [46, -7.193281], [1178, -7.265254], [518, -8.161531], [44, -8.557957], [262, -8.767467], [826, -8.832377], [1829, -8.864812], [845, -8.996182], [127906, -9.295753], [275, -9.32693], [2459, -9.462752], [2297, -9.519208], [1200, -9.555494], [493, -9.676376], [115, -9.678226], [922, -9.845046], [622, -9.967896], [58, -9.988896], [7616, -10.021588], [1151, -10.102294], [913, -10.116126], [4733, -10.127441], [3504, -10.156885], [14154, -10.165103], [5274, -10.184172], [1409, -10.205832], [43492, -10.258601], [122693, -10.316993], [11397, -10.321041], [34, -10.340228], [2625, -10.388453], [589, -10.418489], [939, -10.502195], [46252, -10.511056], [8590, -10.542594], [6808, -10.554509], [286, -10.595484], [576, -10.630061], [120007, -10.637574], [56434, -10.638627], [63, -10.642997], [3643, -10.679624], [52387, -10.686302], [122883, -10.69418], [735, -10.719853], [1117, -10.761003], [266, -10.831192], [263, -10.847028], [466, -10.874083], [6443, -10.879457], [946, -10.895194], [314, -10.895581], [14168, -10.896192], [1195, -10.915874], [1921, -10.927864], [14188, -10.950624], [1469, -10.958672], [2260, -10.967856], [526, -10.99312], [32, -10.997632], [1450, -11.027862], [4561, -11.095591], [861, -11.113217], [4290, -11.170676], [294, -11.196009], [268, -11.22949], [66863, -11.232743], [9122, -11.238824], [766, -11.244797], [10, -11.247611], [47, -11.25034], [39077, -11.258677], [1233, -11.290013], [1687, -11.293313], [465, -11.295585], [59, -11.303914], [614, -11.334027], [3750, -11.339334], [1410, -11.347575], [5590, -11.34758], [278, -11.361251], [3417, -11.361789], [103140, -11.365131], [2120, -11.405079], [121167, -11.460969], [120015, -11.473393], [7314, -11.477896], [1047, -11.484336], [1489, -11.492911], [836, -11.493911], [679, -11.519238], [11158, -11.5209], [2125, -11.52151]], "logprob_of_token": -6.905784, "top1_top2_margin": 6.659357, "top6_top7_margin": 0.054247}, {"gen_index": 4, "token": 948, "top": [[35423, -0.062435], [46252, -5.45203], [43492, -6.272994], [36270, -6.524741], [66863, -6.703104], [7616, -7.178102], [11397, -7.229268], [16754, -7.610052], [948, -7.86172], [1178, -7.886569], [420, -8.018817], [103140, -8.057749], [66396, -8.221669], [91252, -8.241833], [55950, -8.35489], [82856, -8.501991], [97543, -8.553028], [52918, -8.559061], [121167, -8.708572], [32533, -8.78462], [108392, -8.922232], [5274, -8.985349], [49848, -8.997986], [46, -9.070192], [96379, -9.070284], [25751, -9.087881], [119878, -9.087934], [127906, -9.14531], [52553, -9.194598], [60216, -9.225117], [346, -9.232725], [12559, -9.257879], [52217, -9.275084], [39077, -9.280115], [1537, -9.285167], [44, -9.305458], [55998, -9.318588], [114885, -9.319674], [826, -9.334906], [845, -9.361107], [26884, -9.364563], [125313, -9.392133], [60147, -9.41205], [51935, -9.485046], [29394, -9.527051], [120007, -9.532435], [7510, -9.535884], [21771, -9.542933], [4118, -9.580013], [34025, -9.622218], [286, -9.644537], [25205, -9.653306], [922, -9.658482], [19963, -9.673924], [96186, -9.696898], [32, -9.795622], [34991, -9.805524], [622, -9.807011], [97925, -9.818212], [24468, -9.847687], [74299, -9.853338], [1097, -9.856503], [88938, -9.88307], [16727, -9.883486], [1450, -9.883568], [117126, -9.883602], [24999, -9.898083], [109992, -9.907038], [107755, -9.911993], [42196, -9.927589], [23638, -9.945813], [74683, -9.952232], [48716, -9.955019], [66473, -9.962008], [48137, -9.968961], [35815, -9.970825], [104251, -9.979384], [77892, -9.98107], [116312, -9.985641], [4479, -9.992496], [1829, -10.000202], [735, -10.011083], [946, -10.021235], [78542, -10.028123], [105405, -10.058922], [406, -10.059386], [101938, -10.082756], [110404, -10.082915], [7640, -10.083421], [30778, -10.096962], [42454, -10.101667], [49541, -10.108878], [2459, -10.109953], [101757, -10.144297], [53753, -10.148985], [34, -10.157566], [44830, -10.173963], [9702, -10.176605], [55442, -10.187571], [25065, -10.187964]], "logprob_of_token": -7.86172, "top1_top2_margin": 5.389595, "top6_top7_margin": 0.051166}, {"gen_index": 5, "token": 35423, "top": [[948, -0.007947], [346, -6.468032], [279, -7.585879], [420, -7.607677], [831, -7.634878], [262, -7.917514], [339, -8.078179], [2459, -8.254696], [518, -8.355668], [1178, -8.589068], [44, -9.001321], [735, -9.097533], [46, -9.305812], [127906, -9.363564], [922, -9.540053], [1921, -9.606494], [2297, -9.645387], [6443, -9.667921], [35423, -9.928052], [5274, -9.935399], [286, -9.976232], [32, -10.023435], [34, -10.173508], [845, -10.23706], [946, -10.309077], [939, -10.34288], [2125, -10.3658], [622, -10.436725], [120007, -10.525261], [493, -10.530647], [7467, -10.653117], [1409, -10.690351], [826, -10.711097], [14168, -10.764664], [576, -10.779468], [1829, -10.797363], [9122, -10.810698], [58, -10.816449], [14154, -10.945186], [7510, -11.074561], [275, -11.085822], [327, -11.137469], [968, -11.138988], [10664, -11.153147], [378, -11.15445], [95, -11.167548], [913, -11.187846], [3504, -11.194491], [589, -11.209263], [1469, -11.22097], [56434, -11.226207], [3417, -11.301741], [669, -11.31807], [8590, -11.340305], [2225, -11.425112], [1195, -11.428752], [941, -11.437346], [42, -11.445474], [766, -11.463488], [63, -11.47594], [120022, -11.509881], [614, -11.546084], [2260, -11.608295], [14188, -11.613429], [2625, -11.614736], [527, -11.6232], [836, -11.643954], [263, -11.682293], [716, -11.691409], [2120, -11.703925], [907, -11.710777], [353, -11.720366], [294, -11.727431], [10, -11.729483], [888, -11.743587], [739, -11.750608], [679, -11.767445], [43492, -11.825436], [39, -11.837623], [1151, -11.852679], [3643, -11.858771], [1765, -11.861837], [861, -11.872085], [39077, -11.890323], [4733, -11.895424], [1117, -11.91595], [10304, -11.917887], [965, -11.927046], [7616, -11.928768], [46252, -11.939335], [4561, -11.941989], [115, -11.943801], [379, -11.946612], [11265, -11.973956], [1200, -11.999998], [47, -12.028703], [1410, -12.033187], [919, -12.041905], [1047, -12.08402], [465, -12.118423]], "logprob_of_token": -9.928052, "top1_top2_margin": 6.460086, "top6_top7_margin": 0.160665}, {"gen_index": 6, "token": 948, "top": [[35423, -0.04126], [46252, -5.153008], [43492, -6.464613], [66863, -6.976958], [36270, -7.029515], [7616, -7.257824], [11397, -7.367272], [420, -7.950217], [103140, -8.116261], [66396, -8.363324], [948, -8.410472], [16754, -8.425591], [91252, -8.550142], [55950, -8.630129], [5274, -8.901583], [82856, -8.903896], [1178, -8.905289], [48716, -8.950304], [29394, -9.169559], [97543, -9.408874], [96379, -9.423809], [12559, -9.431143], [32, -9.452203], [52217, -9.469418], [119878, -9.517702], [25751, -9.527275], [46, -9.559844], [121167, -9.573968], [44, -9.574028], [7510, -9.606842], [127906, -9.627791], [32533, -9.651975], [52918, -9.680096], [34025, -9.698608], [49848, -9.702337], [120007, -9.731013], [1829, -9.791102], [845, -9.808119], [88938, -9.829016], [346, -9.831271], [96186, -9.842422], [108392, -9.864267], [286, -9.870171], [52553, -9.906167], [4118, -9.919863], [25205, -9.944343], [26884, -9.944773], [71890, -9.958557], [49541, -9.968587], [60147, -9.969685], [114885, -9.996106], [922, -10.030738], [826, -10.059599], [34991, -10.060255], [60216, -10.06942], [406, -10.072696], [24468, -10.228367], [126141, -10.239412], [946, -10.254732], [107755, -10.267403], [55998, -10.271366], [74299, -10.277174], [97925, -10.278684], [39077, -10.289059], [125313, -10.307131], [118702, -10.32023], [117126, -10.321201], [104251, -10.344004], [108251, -10.360523], [116312, -10.386428], [24656, -10.405525], [19963, -10.412975], [109992, -10.413889], [735, -10.419586], [1097, -10.420649], [70201, -10.46195], [3417, -10.464334], [1921, -10.465137], [836, -10.474429], [90754, -10.483242], [17485, -10.499609], [101757, -10.506187], [49, -10.506935], [21771, -10.520136], [263, -10.524879], [16727, -10.525574], [92431, -10.53413], [2459, -10.542893], [78542, -10.546873], [90068, -10.550547], [69814, -10.564339], [28320, -10.577174], [51935, -10.598552], [110160, -10.613211], [76649, -10.615286], [36500, -10.623485], [53753, -10.625324], [766, -10.628798], [110404, -10.636343], [30778, -10.642647]], "logprob_of_token": -8.410472, "top1_top2_margin": 5.111748, "top6_top7_margin": 0.109448}, {"gen_index": 7, "token": 35423, "top": [[948, -0.010813], [346, -5.766737], [279, -6.896678], [420, -7.242452], [262, -7.299593], [831, -7.319973], [339, -8.095181], [518, -8.153142], [2459, -8.286221], [735, -8.554355], [1178, -8.884897], [44, -8.93026], [46, -9.38011], [845, -9.466847], [1921, -9.530132], [127906, -9.56816], [35423, -9.594393], [6443, -9.943508], [32, -9.99602], [5274, -10.081312], [286, -10.202471], [922, -10.216033], [493, -10.238941], [2297, -10.244448], [946, -10.281747], [34, -10.377619], [58, -10.384641], [576, -10.411436], [2125, -10.527984], [826, -10.578585], [14168, -10.674126], [589, -10.683962], [1829, -10.70019], [622, -10.769964], [9122, -10.77928], [378, -10.80622], [3504, -10.821793], [115, -10.861065], [968, -10.889335], [1409, -10.901464], [2225, -10.909998], [4733, -10.982248], [14154, -10.99878], [913, -11.007403], [95, -11.032906], [1469, -11.163755], [7510, -11.165854], [120007, -11.175108], [275, -11.197761], [42, -11.235368], [10, -11.266102], [10664, -11.274009], [3417, -11.282099], [941, -11.28824], [7467, -11.303883], [263, -11.408789], [939, -11.41985], [14188, -11.438967], [2260, -11.45737], [63, -11.46575], [327, -11.46971], [527, -11.494077], [766, -11.508285], [836, -11.50879], [3643, -11.544125], [888, -11.553898], [543, -11.55699], [2120, -11.568469], [919, -11.568951], [353, -11.581885], [669, -11.598802], [1765, -11.601072], [4561, -11.631937], [43492, -11.659224], [614, -11.669214], [8590, -11.669857], [39, -11.679327], [3340, -11.700298], [1117, -11.70781], [120022, -11.726616], [4840, -11.780524], [47, -11.791591], [2625, -11.79407], [679, -11.807428], [716, -11.85408], [1047, -11.854502], [294, -11.858295], [7616, -11.875862], [465, -11.89622], [56434, -11.929545], [1195, -11.934911], [739, -11.953934], [14153, -11.95724], [10304, -11.963881], [1151, -11.97462], [122693, -11.979992], [14825, -12.013995], [1410, -12.016785], [1200, -12.033323], [861, -12.034549]], "logprob_of_token": -9.594393, "top1_top2_margin": 5.755924, "top6_top7_margin": 0.775208}, {"gen_index": 8, "token": 948, "top": [[35423, -0.089295], [46252, -5.059877], [36270, -5.946158], [43492, -6.215271], [66863, -6.342783], [11397, -7.007117], [7616, -7.078213], [103140, -7.638999], [948, -7.666663], [66396, -7.701189], [16754, -7.707895], [55950, -7.737543], [1178, -8.175294], [82856, -8.196703], [420, -8.262736], [91252, -8.419953], [48716, -8.497018], [29394, -8.555869], [5274, -8.728423], [32533, -8.822743], [12559, -8.872384], [52217, -8.876595], [60216, -8.887889], [52553, -8.89457], [121167, -8.906949], [125313, -8.915132], [60147, -8.974059], [97543, -8.985385], [119878, -9.017054], [52918, -9.044401], [25751, -9.066206], [32, -9.073694], [96379, -9.083773], [108392, -9.091093], [88938, -9.104447], [46, -9.199542], [4118, -9.204268], [826, -9.218665], [127906, -9.224429], [104251, -9.240352], [346, -9.279635], [17485, -9.337466], [49848, -9.345627], [34025, -9.351493], [96186, -9.354653], [118702, -9.380838], [114885, -9.4002], [24468, -9.41114], [44, -9.442149], [55998, -9.454991], [26884, -9.466532], [70201, -9.47225], [78542, -9.477817], [71890, -9.483877], [7510, -9.486624], [946, -9.487072], [76649, -9.490634], [49541, -9.505844], [97925, -9.527223], [39077, -9.530408], [116312, -9.533051], [21771, -9.568997], [25205, -9.58739], [1537, -9.589789], [126141, -9.62876], [845, -9.629416], [74299, -9.629624], [97049, -9.644298], [51935, -9.648067], [101757, -9.669158], [34991, -9.671416], [16727, -9.672035], [52663, -9.690182], [53753, -9.691093], [92431, -9.704782], [30778, -9.713971], [1829, -9.725419], [12131, -9.729157], [4479, -9.729371], [66473, -9.731688], [28320, -9.764064], [82128, -9.765879], [3417, -9.766078], [24656, -9.773476], [117126, -9.782287], [107755, -9.797935], [58949, -9.863252], [74683, -9.873956], [110404, -9.879168], [69814, -9.883868], [52297, -9.894595], [34654, -9.900809], [100136, -9.929682], [36500, -9.930634], [95061, -9.931645], [72865, -9.965882], [109992, -9.970557], [67028, -9.975112], [94281, -9.984048], [101106, -9.987088]], "logprob_of_token": -7.666663, "top1_top2_margin": 4.970582, "top6_top7_margin": 0.071096}, {"gen_index": 9, "token": 35423, "top": [[948, -0.010106], [279, -6.020691], [346, -6.443161], [831, -6.671188], [262, -7.58426], [339, -8.011243], [420, -8.317416], [518, -8.330314], [2459, -8.372693], [735, -8.550394], [1178, -8.710942], [44, -8.95435], [46, -9.650659], [1921, -9.658198], [493, -9.704171], [127906, -9.843222], [35423, -9.882871], [2297, -10.073314], [6443, -10.132655], [845, -10.202764], [286, -10.243862], [58, -10.386336], [922, -10.482327], [5274, -10.546699], [2125, -10.581248], [32, -10.585559], [622, -10.618526], [576, -10.637654], [826, -10.650409], [946, -10.66223], [378, -10.712088], [34, -10.76214], [14168, -10.857615], [9122, -10.924317], [115, -10.94128], [589, -11.007747], [968, -11.016365], [527, -11.051464], [4733, -11.145574], [95, -11.181367], [7467, -11.218225], [1409, -11.243927], [669, -11.295903], [10664, -11.317971], [10, -11.326121], [919, -11.365432], [939, -11.415536], [1200, -11.428603], [7510, -11.464426], [3417, -11.498239], [941, -11.500022], [1829, -11.515326], [4561, -11.522904], [275, -11.533551], [716, -11.544547], [3504, -11.545213], [913, -11.551015], [14154, -11.584931], [63, -11.603942], [8590, -11.624614], [42, -11.645284], [467, -11.65215], [1151, -11.667353], [56434, -11.705801], [1765, -11.715395], [327, -11.755909], [122883, -11.756319], [2225, -11.768689], [10304, -11.832319], [353, -11.851058], [14188, -11.882668], [2625, -11.882699], [836, -11.905654], [1469, -11.90917], [120007, -11.926648], [3643, -11.942598], [39077, -11.943522], [907, -11.944499], [1195, -11.959654], [465, -11.961737], [4840, -11.967764], [278, -11.98048], [122693, -11.989669], [614, -11.996175], [543, -11.997928], [263, -11.998373], [46252, -12.004888], [43492, -12.008147], [739, -12.016891], [2260, -12.021092], [120022, -12.022668], [766, -12.041251], [888, -12.041548], [679, -12.061334], [1826, -12.082131], [314, -12.117908], [39, -12.124118], [379, -12.134409], [1275, -12.142091], [568, -12.164512]], "logprob_of_token": -9.882871, "top1_top2_margin": 6.010585, "top6_top7_margin": 0.306173}, {"gen_index": 10, "token": 948, "top": [[35423, -0.058269], [46252, -5.274625], [36270, -6.312867], [43492, -6.79656], [66863, -6.918274], [7616, -7.347601], [11397, -7.519506], [66396, -7.867814], [948, -7.943836], [55950, -8.006306], [103140, -8.139022], [16754, -8.225823], [1178, -8.254675], [420, -8.370694], [5274, -8.643643], [48716, -8.699914], [29394, -8.788877], [96379, -8.864033], [60216, -8.958586], [32533, -8.969121], [82856, -9.013383], [12559, -9.031651], [32, -9.077428], [52553, -9.091993], [91252, -9.112374], [52217, -9.192924], [108392, -9.266621], [46, -9.325463], [4118, -9.343143], [127906, -9.361676], [826, -9.393736], [121167, -9.395539], [26884, -9.401531], [49848, -9.412082], [119878, -9.424026], [104251, -9.425491], [52918, -9.448968], [49541, -9.509327], [346, -9.518184], [34991, -9.542434], [60147, -9.56898], [97543, -9.569991], [96186, -9.596659], [845, -9.598115], [44, -9.609664], [125313, -9.622026], [25751, -9.628398], [25205, -9.631968], [71890, -9.64944], [7510, -9.690269], [34025, -9.756271], [88938, -9.768824], [114885, -9.769502], [74299, -9.7698], [78542, -9.773542], [946, -9.782409], [24468, -9.784165], [922, -9.792813], [17485, -9.824314], [76649, -9.832178], [101757, -9.83239], [1537, -9.861655], [39077, -9.861974], [1097, -9.862813], [95061, -9.869232], [34654, -9.918578], [1829, -9.923241], [70201, -9.923651], [24656, -9.930033], [118702, -9.96948], [126141, -9.972892], [12131, -10.003295], [52663, -10.026538], [30778, -10.028294], [51935, -10.065088], [116312, -10.065312], [21771, -10.085177], [3417, -10.091044], [74683, -10.100826], [92431, -10.110948], [55998, -10.116474], [9702, -10.129423], [61184, -10.153788], [97049, -10.17426], [101106, -10.176675], [107755, -10.183795], [46667, -10.185014], [77651, -10.190794], [55442, -10.199365], [28320, -10.207824], [36500, -10.236956], [51527, -10.240969], [286, -10.241071], [10, -10.243544], [77623, -10.250962], [120007, -10.265561], [20283, -10.279712], [35009, -10.295123], [82128, -10.306561], [106822, -10.311465]], "logprob_of_token": -7.943836, "top1_top2_margin": 5.216357, "top6_top7_margin": 0.171905}, {"gen_index": 11, "token": 35423, "top": [[948, -0.012289], [279, -5.75437], [346, -6.219283], [831, -6.725702], [262, -7.304384], [420, -7.87043], [518, -8.258957], [339, -8.315458], [2459, -8.383263], [1178, -8.619398], [735, -8.653182], [44, -8.770093], [1921, -8.771336], [46, -9.366659], [35423, -9.502765], [127906, -9.605448], [286, -9.652411], [493, -9.744934], [845, -9.828894], [5274, -9.840364], [6443, -9.847836], [2125, -9.896935], [2297, -10.053171], [922, -10.093822], [32, -10.12502], [58, -10.170651], [622, -10.186106], [576, -10.323793], [946, -10.333134], [34, -10.497192], [826, -10.522872], [378, -10.593273], [95, -10.665305], [10, -10.670016], [1409, -10.687358], [9122, -10.715023], [527, -10.734041], [14168, -10.773464], [1200, -10.88409], [669, -10.904696], [115, -11.06682], [3417, -11.080816], [1829, -11.091695], [10664, -11.094433], [968, -11.101987], [939, -11.11158], [941, -11.147147], [3504, -11.184798], [589, -11.209276], [7510, -11.20952], [913, -11.218929], [42, -11.220578], [4733, -11.247309], [467, -11.280293], [14154, -11.314589], [919, -11.342192], [14188, -11.356192], [275, -11.35688], [716, -11.364559], [120022, -11.392783], [353, -11.42603], [1151, -11.463493], [7467, -11.483373], [4561, -11.494199], [1765, -11.533613], [568, -11.548452], [1195, -11.549643], [39077, -11.559905], [4840, -11.561575], [10304, -11.562666], [14825, -11.573044], [63, -11.581493], [327, -11.585663], [3643, -11.60112], [263, -11.611083], [46252, -11.618634], [120007, -11.625284], [799, -11.684983], [314, -11.68507], [614, -11.700815], [836, -11.70417], [2225, -11.71037], [465, -11.721369], [1275, -11.731376], [1469, -11.753444], [543, -11.770294], [766, -11.773376], [739, -11.778214], [278, -11.820883], [122883, -11.827768], [379, -11.836515], [8590, -11.840624], [122693, -11.840851], [294, -11.875125], [888, -11.875634], [2120, -11.87612], [43492, -11.876705], [907, -11.877995], [2625, -11.893078], [14153, -11.909563]], "logprob_of_token": -9.502765, "top1_top2_margin": 5.742082, "top6_top7_margin": 0.388526}, {"gen_index": 12, "token": 948, "top": [[35423, -0.053151], [46252, -5.485057], [36270, -6.456213], [66863, -7.013963], [43492, -7.12018], [7616, -7.234499], [11397, -7.85486], [420, -7.903615], [66396, -7.94774], [55950, -8.080044], [16754, -8.156383], [103140, -8.264574], [948, -8.318745], [48716, -8.329107], [5274, -8.378014], [1178, -8.420612], [32, -8.69224], [32533, -8.88975], [34991, -8.948301], [96379, -8.963722], [49541, -9.048262], [60216, -9.11289], [46, -9.114239], [49848, -9.141968], [127906, -9.16916], [52553, -9.195921], [29394, -9.21862], [12559, -9.249866], [7510, -9.341749], [108392, -9.343473], [26884, -9.361869], [82856, -9.417027], [52918, -9.441019], [286, -9.476102], [104251, -9.52422], [1537, -9.530725], [4118, -9.540445], [826, -9.568899], [946, -9.579002], [44, -9.584338], [52217, -9.613028], [96186, -9.632326], [10, -9.671364], [74299, -9.674201], [91252, -9.718166], [845, -9.725423], [25205, -9.752048], [101757, -9.755891], [922, -9.763485], [25751, -9.776288], [34654, -9.784867], [1921, -9.795221], [24656, -9.802019], [121167, -9.818794], [1829, -9.828403], [1097, -9.863054], [97543, -9.869925], [71890, -9.877028], [78542, -9.895988], [406, -9.91316], [346, -9.918449], [39077, -9.927635], [17485, -9.936855], [95061, -9.964898], [119878, -9.973903], [125313, -9.974878], [24468, -10.001124], [34025, -10.011967], [60147, -10.019032], [61184, -10.027666], [28320, -10.047073], [12131, -10.070246], [88938, -10.090163], [9702, -10.091362], [77623, -10.103565], [70201, -10.111527], [52663, -10.123371], [120007, -10.133632], [28097, -10.13737], [3417, -10.138511], [13229, -10.153894], [263, -10.154675], [25065, -10.168658], [75452, -10.17933], [34, -10.191443], [114885, -10.199627], [30778, -10.213024], [101106, -10.226621], [735, -10.255831], [21085, -10.256012], [92431, -10.262306], [49, -10.270648], [126141, -10.274513], [46667, -10.277748], [116312, -10.285013], [58949, -10.290546], [2125, -10.29289], [36500, -10.301803], [55998, -10.303543], [86195, -10.31649]], "logprob_of_token": -8.318745, "top1_top2_margin": 5.431907, "top6_top7_margin": 0.620361}, {"gen_index": 13, "token": 35423, "top": [[948, -0.018658], [279, -5.125301], [346, -5.959042], [262, -6.351574], [831, -6.720358], [420, -7.331496], [1921, -7.783193], [518, -8.152273], [339, -8.286994], [1178, -8.341443], [735, -8.501345], [2459, -8.731423], [286, -8.816374], [44, -8.916018], [127906, -9.064602], [5274, -9.326125], [2125, -9.34602], [46, -9.495261], [845, -9.650211], [946, -9.752472], [922, -9.7531], [2297, -9.829105], [576, -9.840399], [493, -9.855103], [622, -9.891853], [6443, -9.955696], [32, -9.965141], [35423, -9.997101], [58, -10.102277], [95, -10.162462], [34, -10.185995], [1409, -10.228522], [10, -10.250861], [378, -10.292522], [941, -10.319131], [826, -10.343954], [527, -10.477694], [589, -10.516986], [9122, -10.597274], [115, -10.684714], [42, -10.700983], [3504, -10.72364], [14168, -10.734803], [3417, -10.817156], [467, -10.877354], [1829, -10.877628], [939, -10.900723], [669, -10.908316], [4733, -10.95781], [968, -10.978183], [1200, -10.986497], [919, -11.006398], [543, -11.033933], [739, -11.04195], [1765, -11.050126], [799, -11.052874], [716, -11.062504], [913, -11.069486], [14825, -11.069991], [327, -11.077594], [10664, -11.081505], [4840, -11.098101], [1151, -11.108279], [14154, -11.11209], [14188, -11.124673], [1195, -11.129932], [353, -11.135921], [568, -11.154947], [2362, -11.176647], [7467, -11.205941], [278, -11.273174], [275, -11.274303], [263, -11.283397], [39, -11.29808], [3643, -11.354638], [39077, -11.359096], [2225, -11.370728], [1275, -11.403242], [7510, -11.40414], [56434, -11.422792], [122693, -11.461006], [766, -11.470731], [4561, -11.503835], [120022, -11.510376], [294, -11.51137], [2120, -11.527246], [1469, -11.531019], [314, -11.550524], [836, -11.55682], [122883, -11.55759], [379, -11.560968], [8590, -11.585327], [1410, -11.596392], [92, -11.625608], [63, -11.633055], [1117, -11.668474], [614, -11.673064], [2625, -11.675253], [861, -11.682938], [936, -11.691124]], "logprob_of_token": -9.997101, "top1_top2_margin": 5.106644, "top6_top7_margin": 0.451696}, {"gen_index": 14, "token": 948, "top": [[35423, -0.090496], [46252, -4.676392], [36270, -6.070704], [66863, -6.232024], [7616, -6.666371], [420, -6.770772], [43492, -6.842713], [11397, -7.415016], [948, -7.522968], [5274, -7.595144], [66396, -7.665767], [1178, -7.778488], [16754, -7.868306], [34991, -7.945523], [103140, -8.052782], [49541, -8.072098], [55950, -8.12484], [48716, -8.197368], [32, -8.312769], [46, -8.461538], [286, -8.551405], [127906, -8.566494], [82856, -8.612364], [946, -8.772433], [10, -8.792714], [826, -8.865664], [44, -8.883381], [49848, -8.940685], [32533, -8.988699], [26884, -9.015761], [1829, -9.020304], [346, -9.065926], [25751, -9.066378], [1921, -9.072368], [29394, -9.07761], [91252, -9.207043], [121167, -9.214072], [1537, -9.240682], [922, -9.249999], [60216, -9.25482], [125313, -9.256069], [39077, -9.25869], [96379, -9.268669], [97543, -9.291681], [7510, -9.300674], [52918, -9.302565], [12559, -9.325836], [52553, -9.334607], [845, -9.391027], [34, -9.434134], [58949, -9.443068], [3417, -9.458113], [1097, -9.519168], [262, -9.527003], [24468, -9.527569], [74299, -9.537215], [263, -9.564174], [836, -9.576691], [101757, -9.584185], [108392, -9.603405], [60147, -9.632645], [55998, -9.639974], [9702, -9.642746], [24656, -9.646706], [4118, -9.657038], [406, -9.685217], [49, -9.691871], [52217, -9.698324], [353, -9.710821], [766, -9.715408], [622, -9.715422], [735, -9.757257], [70201, -9.768603], [100136, -9.794857], [28320, -9.799749], [88938, -9.804877], [115205, -9.812125], [25205, -9.812871], [17485, -9.812905], [2125, -9.81596], [119878, -9.834793], [104251, -9.883355], [34025, -9.885329], [71890, -9.887029], [28097, -9.889151], [941, -9.894345], [114885, -9.903289], [294, -9.91845], [53753, -9.92412], [34654, -9.924704], [126141, -9.926111], [21085, -9.932535], [72865, -9.933831], [13229, -9.936291], [86195, -9.938468], [76649, -9.949352], [52663, -9.959879], [25065, -9.978712], [78542, -9.987737], [51935, -9.995948]], "logprob_of_token": -7.522968, "top1_top2_margin": 4.585896, "top6_top7_margin": 0.071942}, {"gen_index": 15, "token": 35423, "top": [[948, -0.022052], [279, -5.026405], [346, -5.678197], [262, -6.21919], [831, -6.710714], [420, -7.32426], [1921, -7.506644], [1178, -7.824664], [518, -7.91552], [339, -8.156553], [286, -8.61209], [735, -8.67645], [44, -8.864944], [5274, -9.006598], [127906, -9.012994], [2459, -9.166381], [2125, -9.177706], [35423, -9.183545], [845, -9.41529], [946, -9.435298], [46, -9.476052], [493, -9.522989], [922, -9.576274], [2297, -9.634946], [622, -9.646947], [32, -9.71115], [576, -9.754189], [826, -9.950871], [58, -9.952417], [6443, -9.979434], [941, -10.102788], [95, -10.129583], [1409, -10.138627], [34, -10.170039], [10, -10.22551], [9122, -10.254503], [378, -10.256346], [42, -10.339742], [527, -10.390122], [467, -10.479083], [10664, -10.5286], [589, -10.556871], [3417, -10.566911], [115, -10.61053], [543, -10.649938], [1829, -10.664071], [14168, -10.72288], [2362, -10.739909], [14825, -10.749045], [3504, -10.75524], [4840, -10.776366], [913, -10.786649], [14188, -10.803782], [4733, -10.836886], [669, -10.845836], [1151, -10.902932], [716, -10.904603], [353, -10.947705], [1195, -11.000692], [739, -11.013317], [14154, -11.023549], [919, -11.030538], [7467, -11.032492], [1765, -11.063141], [568, -11.067893], [799, -11.076434], [1200, -11.094876], [939, -11.098825], [263, -11.102589], [968, -11.102697], [766, -11.109017], [39, -11.119582], [3643, -11.126317], [4561, -11.15579], [39077, -11.16326], [327, -11.166831], [1275, -11.177835], [7510, -11.194424], [836, -11.212057], [275, -11.242597], [278, -11.264675], [2225, -11.282306], [1047, -11.321316], [120022, -11.325822], [379, -11.341739], [294, -11.352858], [3340, -11.359278], [1469, -11.41056], [92, -11.414553], [122693, -11.420793], [614, -11.424525], [14139, -11.447228], [56434, -11.451503], [122883, -11.452538], [861, -11.454339], [10304, -11.467222], [1117, -11.473855], [2625, -11.510436], [2120, -11.522492], [2260, -11.537108]], "logprob_of_token": -9.183545, "top1_top2_margin": 5.004353, "top6_top7_margin": 0.182384}, {"gen_index": 16, "token": 948, "top": [[35423, -0.087031], [46252, -4.96768], [66863, -6.203496], [36270, -6.277391], [420, -6.49001], [7616, -6.642731], [43492, -6.94203], [11397, -7.362784], [948, -7.478059], [5274, -7.661315], [66396, -7.751429], [55950, -8.003934], [48716, -8.047254], [1178, -8.133566], [16754, -8.254128], [103140, -8.256171], [32533, -8.380555], [32, -8.449365], [46, -8.461924], [286, -8.659391], [29394, -8.670959], [82856, -8.730249], [49541, -8.800075], [96379, -8.813523], [1829, -8.837915], [826, -8.854253], [34991, -8.868352], [12559, -8.875001], [346, -8.879989], [127906, -8.914193], [26884, -8.914731], [946, -8.921969], [60216, -8.933581], [52553, -8.977189], [25751, -8.982003], [49848, -9.004697], [44, -9.027826], [4118, -9.05105], [922, -9.099019], [121167, -9.149854], [91252, -9.180512], [52918, -9.199737], [52217, -9.203291], [3417, -9.221041], [10, -9.22752], [108392, -9.232555], [845, -9.240578], [7510, -9.245385], [25205, -9.248005], [104251, -9.306883], [74299, -9.336898], [1921, -9.349166], [1537, -9.352498], [119878, -9.380911], [17485, -9.395459], [1097, -9.456076], [96186, -9.456238], [97543, -9.460547], [9702, -9.462987], [24656, -9.48365], [34, -9.490454], [55998, -9.520861], [34025, -9.530216], [71890, -9.559158], [622, -9.60529], [49, -9.610945], [60147, -9.619476], [97049, -9.622956], [88938, -9.645764], [39077, -9.648724], [101757, -9.661889], [836, -9.675433], [28097, -9.685927], [76649, -9.720732], [70201, -9.739944], [52663, -9.742878], [34654, -9.748166], [78542, -9.753453], [58949, -9.76567], [67329, -9.776644], [353, -9.780813], [105405, -9.784443], [51935, -9.795877], [77623, -9.801814], [262, -9.807868], [74390, -9.819636], [30778, -9.830684], [111723, -9.83282], [82128, -9.834266], [86195, -9.856154], [766, -9.868861], [941, -9.877729], [111170, -9.878266], [294, -9.878775], [92431, -9.880156], [28320, -9.883878], [112200, -9.906106], [125313, -9.910548], [115205, -9.92588], [1917, -9.935241]], "logprob_of_token": -7.478059, "top1_top2_margin": 4.880649, "top6_top7_margin": 0.299299}, {"gen_index": 17, "token": 35423, "top": [[948, -0.021059], [279, -5.022784], [346, -5.864919], [262, -5.941074], [831, -6.92907], [420, -7.35689], [1921, -7.482967], [518, -8.078432], [1178, -8.146351], [286, -8.375585], [339, -8.378663], [35423, -8.625134], [735, -8.75576], [44, -9.120512], [5274, -9.132976], [127906, -9.275328], [2125, -9.27972], [2459, -9.567361], [576, -9.608875], [845, -9.629532], [946, -9.694778], [46, -9.704258], [922, -9.709042], [622, -9.747186], [32, -9.809029], [2297, -9.825223], [941, -9.856188], [493, -9.863297], [6443, -10.150124], [10664, -10.183236], [826, -10.205384], [95, -10.220101], [58, -10.243738], [10, -10.310993], [527, -10.326302], [378, -10.381743], [1409, -10.388405], [9122, -10.413256], [115, -10.434334], [34, -10.470924], [467, -10.49052], [14188, -10.533077], [42, -10.540941], [589, -10.556705], [2362, -10.690811], [543, -10.721329], [3417, -10.725204], [669, -10.766108], [14825, -10.768291], [14168, -10.834294], [1829, -10.837814], [919, -10.962369], [1275, -11.019843], [4733, -11.02], [716, -11.027882], [913, -11.052828], [3504, -11.061861], [7510, -11.076037], [379, -11.080288], [7467, -11.083124], [739, -11.086388], [766, -11.117406], [14154, -11.123066], [1765, -11.149565], [799, -11.158877], [39077, -11.159022], [327, -11.188887], [353, -11.190427], [263, -11.200674], [1151, -11.207951], [4840, -11.221943], [568, -11.27532], [14419, -11.311969], [836, -11.327337], [1195, -11.328215], [3643, -11.387673], [275, -11.391245], [46252, -11.401387], [4561, -11.407628], [39, -11.419266], [14541, -11.430903], [120022, -11.449996], [1047, -11.463966], [1200, -11.490294], [968, -11.505591], [14153, -11.507721], [122883, -11.52602], [3340, -11.530942], [43492, -11.552229], [1410, -11.573513], [314, -11.583222], [970, -11.591631], [2625, -11.613867], [14139, -11.618624], [294, -11.626062], [92, -11.646549], [278, -11.660818], [3326, -11.67532], [939, -11.677029], [614, -11.689078]], "logprob_of_token": -8.625134, "top1_top2_margin": 5.001725, "top6_top7_margin": 0.126078}, {"gen_index": 18, "token": 948, "top": [[35423, -0.055457], [948, -5.458436], [66863, -5.91864], [46252, -5.947107], [36270, -6.832779], [420, -6.897986], [346, -7.776965], [1178, -7.822876], [10, -7.993552], [826, -8.050973], [7616, -8.098945], [46, -8.220269], [26884, -8.419984], [922, -8.498759], [5274, -8.579279], [11397, -8.599883], [279, -8.854196], [48716, -8.877512], [60216, -8.87798], [28320, -8.902991], [32533, -8.919052], [120007, -9.035678], [43492, -9.055992], [913, -9.080525], [5422, -9.24819], [49541, -9.283416], [82856, -9.309377], [4118, -9.353598], [845, -9.375812], [44, -9.379289], [766, -9.38441], [518, -9.431645], [286, -9.441133], [622, -9.46392], [1195, -9.473594], [32, -9.494967], [1537, -9.51785], [1829, -9.524262], [20283, -9.538041], [1200, -9.559319], [16754, -9.5611], [34025, -9.563795], [831, -9.568034], [49848, -9.572845], [103140, -9.60167], [1151, -9.610775], [836, -9.611741], [582, -9.654222], [493, -9.662578], [939, -9.68611], [77262, -9.68784], [25751, -9.724355], [42454, -9.736119], [3504, -9.752512], [74683, -9.76555], [124, -9.767406], [1097, -9.787704], [30778, -9.7881], [11544, -9.824944], [12895, -9.847615], [55950, -9.856774], [294, -9.859794], [1982, -9.883478], [656, -9.891809], [52553, -9.893996], [22726, -9.909425], [52217, -9.919299], [699, -9.920615], [66396, -9.940743], [10304, -9.944058], [17485, -9.947578], [263, -9.948987], [14594, -9.952415], [44830, -9.957404], [77623, -9.962123], [861, -9.974335], [67329, -9.974511], [50240, -10.004916], [2625, -10.013995], [1117, -10.017406], [58, -10.021466], [2260, -10.031071], [29394, -10.032931], [34991, -10.041364], [614, -10.047978], [104251, -10.073898], [25205, -10.078452], [41769, -10.087731], [502, -10.134974], [119878, -10.135603], [66, -10.144889], [1687, -10.144964], [1469, -10.156878], [53753, -10.179543], [120831, -10.246944], [123801, -10.248708], [275, -10.249529], [14179, -10.25104], [19040, -10.253476], [112621, -10.25714]], "logprob_of_token": -5.458436, "top1_top2_margin": 5.402978, "top6_top7_margin": 0.878979}, {"gen_index": 19, "token": 35423, "top": [[948, -0.006603], [35423, -6.233656], [346, -7.217196], [831, -7.426483], [1178, -7.53823], [279, -7.653049], [420, -8.627061], [46, -9.242404], [518, -9.292055], [44, -9.328915], [262, -9.493668], [58, -9.757515], [115, -9.773333], [826, -9.856831], [10, -9.899562], [339, -10.020614], [1921, -10.050114], [493, -10.087976], [622, -10.296444], [14188, -10.452319], [2297, -10.584425], [576, -10.851399], [32, -11.040653], [1829, -11.173958], [2459, -11.186457], [845, -11.269283], [263, -11.302296], [46252, -11.357045], [286, -11.374461], [42, -11.382791], [59, -11.382799], [14153, -11.437403], [922, -11.464714], [127906, -11.475224], [5274, -11.485706], [314, -11.623763], [2125, -11.673847], [275, -11.683133], [1200, -11.702236], [7510, -11.722463], [10664, -11.740229], [34, -11.78756], [7616, -11.793106], [3504, -11.812904], [1151, -11.828863], [6443, -11.832673], [39077, -11.854428], [36270, -11.871162], [913, -11.89229], [122883, -11.92324], [122693, -11.941923], [52387, -12.008767], [766, -12.011796], [14825, -12.019188], [941, -12.033342], [4561, -12.083036], [1117, -12.113601], [1409, -12.118699], [120022, -12.127532], [2625, -12.136678], [735, -12.15202], [3643, -12.153683], [614, -12.165039], [1233, -12.19952], [970, -12.226114], [582, -12.254272], [479, -12.280878], [379, -12.292753], [656, -12.32823], [10304, -12.339396], [95, -12.369967], [1049, -12.378523], [63, -12.392645], [4733, -12.43905], [3750, -12.442101], [6808, -12.44228], [836, -12.526112], [946, -12.53527], [861, -12.535788], [1047, -12.547083], [47, -12.562809], [527, -12.610161], [2362, -12.610715], [66863, -12.631357], [939, -12.652428], [120008, -12.65618], [9122, -12.677926], [965, -12.683668], [1687, -12.698414], [467, -12.753055], [968, -12.771634], [39, -12.788767], [103140, -12.805738], [3417, -12.825095], [24695, -12.826775], [8590, -12.835435], [589, -12.837481], [14168, -12.843739], [378, -12.850738], [1717, -12.851464]], "logprob_of_token": -6.233656, "top1_top2_margin": 6.227053, "top6_top7_margin": 0.974012}, {"gen_index": 20, "token": 948, "top": [[35423, -0.010021], [46252, -6.072443], [66863, -6.408176], [36270, -6.45581], [7616, -7.306755], [11397, -9.009934], [43492, -9.690136], [55950, -9.852695], [82856, -9.977791], [103140, -10.05638], [16754, -10.244477], [1178, -10.454], [66396, -10.536432], [26884, -10.544231], [52918, -10.737821], [60216, -10.760213], [32, -10.774693], [52553, -10.843739], [125313, -10.852402], [48716, -10.864334], [55998, -10.885935], [52217, -10.913977], [39077, -10.961648], [948, -11.026007], [66473, -11.100473], [49541, -11.192737], [28320, -11.200187], [34991, -11.214796], [420, -11.220553], [25065, -11.268758], [49848, -11.281416], [74299, -11.309239], [114885, -11.313286], [97543, -11.340536], [32533, -11.396828], [91252, -11.40061], [25205, -11.449575], [25751, -11.516544], [60147, -11.553505], [53753, -11.605322], [121167, -11.627621], [44, -11.652946], [46, -11.671221], [96186, -11.679688], [826, -11.722632], [66, -11.725843], [34025, -11.730055], [5422, -11.807543], [92010, -11.807955], [29394, -11.811401], [4479, -11.820713], [622, -11.918768], [96379, -11.928776], [108392, -11.929876], [79262, -11.951504], [346, -11.98232], [20283, -11.990599], [12895, -11.992489], [263, -12.039795], [123801, -12.040263], [1537, -12.044145], [840, -12.045684], [87462, -12.050002], [10, -12.054552], [5274, -12.05504], [119878, -12.06963], [77262, -12.073217], [9986, -12.092145], [46667, -12.149411], [104251, -12.159215], [101757, -12.160249], [406, -12.160434], [22726, -12.186857], [95061, -12.202185], [36500, -12.230671], [17485, -12.244469], [42454, -12.260235], [1097, -12.272827], [922, -12.29693], [77623, -12.307505], [110404, -12.308695], [4118, -12.311579], [24468, -12.324151], [19040, -12.336558], [107755, -12.339922], [744, -12.362062], [50240, -12.383741], [58, -12.391386], [105405, -12.440646], [12559, -12.473037], [30778, -12.479704], [845, -12.499134], [101106, -12.503376], [120007, -12.506691], [444, -12.518179], [3209, -12.526313], [493, -12.529022], [97925, -12.535446], [68683, -12.541979], [44830, -12.546022]], "logprob_of_token": -11.026007, "top1_top2_margin": 6.062422, "top6_top7_margin": 0.680202}, {"gen_index": 21, "token": 35423, "top": [[948, -0.002312], [346, -7.677886], [831, -8.129501], [279, -8.795275], [35423, -9.164421], [1178, -9.169239], [518, -9.503319], [420, -9.656118], [46, -10.162544], [339, -10.40827], [1921, -10.490519], [44, -10.498693], [2459, -10.562149], [10, -10.609898], [2297, -10.633166], [58, -10.766106], [32, -10.957432], [922, -11.000893], [115, -11.001685], [14188, -11.025196], [826, -11.05862], [622, -11.146259], [10664, -11.205563], [493, -11.333897], [262, -11.374653], [5274, -11.420796], [845, -11.471859], [6443, -11.551533], [127906, -11.554779], [1829, -11.796557], [576, -11.833873], [263, -11.864305], [122883, -11.96443], [614, -11.976585], [14153, -11.979594], [3340, -12.079226], [735, -12.094627], [479, -12.114376], [34, -12.164232], [2125, -12.232711], [378, -12.350533], [913, -12.371871], [46252, -12.383385], [946, -12.389055], [3504, -12.425947], [1151, -12.442966], [9122, -12.447059], [275, -12.481274], [120022, -12.487022], [122693, -12.493699], [314, -12.508516], [939, -12.508585], [39077, -12.527746], [970, -12.533193], [1409, -12.563396], [14168, -12.581675], [63, -12.59338], [4561, -12.593925], [14825, -12.598287], [59, -12.602257], [888, -12.602737], [1117, -12.607004], [14154, -12.641782], [861, -12.67457], [4840, -12.684725], [968, -12.686309], [3643, -12.698112], [1717, -12.733109], [286, -12.743484], [3750, -12.744994], [1687, -12.773795], [1233, -12.79722], [2625, -12.815989], [527, -12.816989], [42, -12.824368], [120008, -12.849533], [3417, -12.929845], [582, -12.955475], [6808, -12.964027], [766, -12.969913], [4733, -12.992189], [1200, -12.992546], [2225, -13.002303], [699, -13.035084], [669, -13.035748], [1521, -13.042818], [120001, -13.086142], [941, -13.10897], [1047, -13.120737], [56434, -13.123871], [379, -13.139452], [8590, -13.157228], [10304, -13.174412], [52387, -13.187569], [1049, -13.194521], [836, -13.206062], [7510, -13.207932], [1469, -13.259622], [14541, -13.261954], [2150, -13.26818]], "logprob_of_token": -9.164421, "top1_top2_margin": 7.675574, "top6_top7_margin": 0.33408}, {"gen_index": 22, "token": 948, "top": [[35423, -0.018417], [46252, -5.574096], [36270, -6.068895], [66863, -6.199244], [7616, -7.091406], [11397, -8.410127], [43492, -9.225888], [103140, -9.269588], [26884, -9.334297], [55950, -9.400316], [82856, -9.498044], [1178, -9.546333], [16754, -9.670124], [420, -9.725719], [948, -9.7834], [32, -9.887906], [52553, -10.033882], [60216, -10.041698], [66396, -10.178735], [52217, -10.227228], [25205, -10.232702], [55998, -10.291061], [46, -10.295876], [52918, -10.298714], [826, -10.313667], [49541, -10.396739], [125313, -10.409876], [25751, -10.485153], [28320, -10.490723], [32533, -10.49347], [114885, -10.512624], [44, -10.512821], [39077, -10.513986], [49848, -10.564682], [48716, -10.566327], [34991, -10.586241], [91252, -10.626236], [77262, -10.721773], [346, -10.735561], [79262, -10.794988], [97543, -10.795677], [42454, -10.80079], [5274, -10.86858], [96379, -10.879443], [622, -10.88275], [22726, -10.927341], [121167, -10.949607], [53753, -10.959232], [74299, -10.969316], [60147, -10.972549], [12895, -10.985098], [34025, -10.988541], [96186, -11.003433], [20283, -11.041666], [5422, -11.043304], [66473, -11.067493], [4118, -11.106266], [12559, -11.122348], [66, -11.130337], [263, -11.145447], [1097, -11.17571], [58, -11.181014], [104251, -11.200813], [10, -11.220235], [493, -11.241851], [29394, -11.25615], [922, -11.256366], [74390, -11.29106], [4479, -11.310041], [108392, -11.314706], [840, -11.330317], [20593, -11.352511], [36500, -11.359198], [49, -11.365463], [25065, -11.388741], [87462, -11.415137], [59, -11.449816], [845, -11.460266], [77623, -11.486812], [46667, -11.489166], [3504, -11.4943], [39229, -11.496011], [353, -11.516924], [97346, -11.53184], [766, -11.538244], [120007, -11.546163], [19040, -11.548531], [9986, -11.557976], [101757, -11.572209], [12465, -11.58387], [1537, -11.592794], [2459, -11.594131], [10694, -11.600143], [115, -11.601957], [1829, -11.603776], [744, -11.615705], [286, -11.62211], [92431, -11.626751], [93940, -11.627456], [9702, -11.639423]], "logprob_of_token": -9.7834, "top1_top2_margin": 5.555678, "top6_top7_margin": 0.815762}, {"gen_index": 23, "token": 35423, "top": [[948, -0.00208], [346, -7.708152], [831, -8.23362], [279, -9.198888], [518, -9.388824], [1178, -9.441731], [420, -9.707898], [35423, -10.009739], [46, -10.10255], [2459, -10.199477], [44, -10.530293], [1921, -10.530956], [10, -10.641068], [58, -10.643972], [339, -10.696118], [922, -10.839078], [32, -11.053736], [14188, -11.074655], [622, -11.113145], [2297, -11.223086], [115, -11.244992], [826, -11.277531], [5274, -11.394141], [10664, -11.398716], [6443, -11.456751], [493, -11.491298], [845, -11.543698], [127906, -11.573272], [614, -11.690802], [262, -11.702884], [263, -11.928952], [1829, -11.940643], [576, -11.954509], [735, -11.992879], [14153, -12.036729], [3340, -12.056399], [479, -12.173307], [120022, -12.175397], [122883, -12.191131], [3504, -12.269049], [913, -12.269547], [14168, -12.290275], [34, -12.308496], [1151, -12.328876], [378, -12.330631], [946, -12.367684], [14154, -12.396732], [1717, -12.430728], [861, -12.452247], [939, -12.460221], [1117, -12.461867], [314, -12.483579], [275, -12.488931], [63, -12.516184], [3643, -12.518639], [14825, -12.552113], [9122, -12.556403], [59, -12.559306], [968, -12.620262], [4561, -12.630221], [970, -12.63131], [39077, -12.640141], [2125, -12.650294], [888, -12.667852], [1233, -12.682361], [4840, -12.704762], [2625, -12.719411], [122693, -12.727259], [1687, -12.72735], [1409, -12.744954], [3750, -12.792871], [766, -12.886531], [527, -12.906021], [286, -12.916512], [42, -12.933099], [46252, -12.933729], [120008, -12.9378], [3417, -12.940244], [10304, -12.951062], [965, -12.973617], [1200, -12.975074], [2225, -12.992624], [699, -13.0158], [7470, -13.073892], [120001, -13.085589], [6808, -13.095092], [14541, -13.097157], [941, -13.105967], [4733, -13.110147], [379, -13.118167], [513, -13.123979], [120007, -13.162671], [836, -13.166729], [582, -13.200944], [1521, -13.205298], [669, -13.234919], [2150, -13.270118], [7510, -13.27279], [1469, -13.306561], [1195, -13.337987]], "logprob_of_token": -10.009739, "top1_top2_margin": 7.706072, "top6_top7_margin": 0.266167}, {"gen_index": 24, "token": 948, "top": [[35423, -0.011202], [46252, -5.726727], [36270, -6.655426], [66863, -7.009681], [7616, -7.613799], [11397, -8.617946], [43492, -9.577766], [103140, -9.72909], [55950, -9.866292], [26884, -9.908529], [16754, -10.13805], [82856, -10.17572], [48716, -10.251266], [66396, -10.366039], [32, -10.432213], [52217, -10.445113], [60216, -10.460836], [52553, -10.500971], [1178, -10.558552], [948, -10.599632], [52918, -10.782633], [420, -10.803225], [55998, -10.807824], [125313, -10.846638], [28320, -10.886959], [114885, -10.961944], [39077, -10.965207], [91252, -10.972679], [34991, -11.030616], [49541, -11.050847], [66473, -11.053299], [25205, -11.0624], [74299, -11.074344], [44, -11.079885], [96186, -11.081624], [32533, -11.084192], [60147, -11.105919], [97543, -11.121641], [49848, -11.144547], [25751, -11.211819], [46, -11.227726], [121167, -11.235331], [96379, -11.283993], [826, -11.381353], [53753, -11.391478], [34025, -11.414626], [36500, -11.498594], [29394, -11.536555], [87462, -11.541176], [104251, -11.552167], [346, -11.597834], [622, -11.624317], [79262, -11.658009], [20283, -11.664226], [10, -11.679517], [12895, -11.704085], [108392, -11.710963], [12559, -11.743845], [263, -11.749516], [22726, -11.772837], [46667, -11.791802], [922, -11.796453], [4479, -11.796842], [1097, -11.810002], [5274, -11.816141], [4118, -11.818267], [101757, -11.82112], [120007, -11.826442], [77262, -11.861465], [42454, -11.867825], [25065, -11.870916], [123801, -11.873163], [119878, -11.883876], [1537, -11.908114], [93940, -11.915951], [66, -11.93408], [58, -11.934764], [107755, -11.946326], [117126, -11.981546], [110404, -11.983761], [74390, -12.04677], [76649, -12.080486], [50240, -12.08158], [39229, -12.093875], [19040, -12.112481], [77651, -12.113691], [78542, -12.126163], [105405, -12.134644], [30778, -12.139077], [95061, -12.145464], [77623, -12.155284], [63361, -12.171974], [845, -12.19763], [9702, -12.2026], [52663, -12.208471], [20593, -12.214828], [55442, -12.215658], [24468, -12.218173], [766, -12.236349], [101106, -12.242235]], "logprob_of_token": -10.599632, "top1_top2_margin": 5.715525, "top6_top7_margin": 0.959821}, {"gen_index": 25, "token": 35423, "top": [[948, -0.002295], [346, -7.468822], [831, -8.377931], [518, -9.304068], [279, -9.493025], [2459, -9.534737], [46, -9.643812], [420, -9.679604], [1178, -10.113348], [10, -10.288314], [339, -10.390664], [1921, -10.428519], [44, -10.486156], [922, -10.51503], [58, -10.546041], [32, -10.60972], [14188, -10.765814], [127906, -10.869678], [5274, -10.988008], [6443, -11.018429], [2297, -11.051186], [115, -11.128989], [622, -11.262589], [10664, -11.264505], [614, -11.295488], [845, -11.501694], [263, -11.526093], [735, -11.529806], [262, -11.604649], [1829, -11.639208], [493, -11.64731], [576, -11.661139], [826, -11.677906], [34, -11.755294], [35423, -11.831766], [14168, -11.889248], [939, -11.947948], [946, -11.970054], [120022, -11.970842], [14153, -11.99448], [479, -12.052521], [378, -12.084149], [275, -12.12209], [314, -12.125673], [63, -12.135644], [14154, -12.165161], [3340, -12.193052], [2125, -12.213273], [3504, -12.223029], [888, -12.263298], [1117, -12.270066], [1151, -12.289101], [913, -12.306469], [59, -12.321472], [14825, -12.37672], [1717, -12.402653], [968, -12.416842], [120001, -12.426746], [122883, -12.4384], [9122, -12.514703], [861, -12.517527], [2225, -12.548158], [14541, -12.55108], [3643, -12.56747], [3417, -12.569427], [527, -12.58219], [120008, -12.61981], [766, -12.635136], [699, -12.638198], [4840, -12.646962], [3750, -12.727179], [669, -12.732909], [1687, -12.79341], [1409, -12.80654], [120007, -12.809438], [1233, -12.814648], [379, -12.834726], [122693, -12.839199], [582, -12.841338], [7470, -12.841475], [4561, -12.853964], [1200, -12.88835], [120006, -12.889447], [2625, -12.891281], [42, -12.8993], [465, -12.906199], [286, -12.931561], [941, -12.942904], [39077, -12.944694], [2790, -12.94741], [10304, -12.973625], [56434, -13.003527], [1826, -13.004765], [2120, -13.01806], [970, -13.055259], [4733, -13.075674], [14794, -13.097178], [1521, -13.10235], [525, -13.114637], [965, -13.133005]], "logprob_of_token": -11.831766, "top1_top2_margin": 7.466528, "top6_top7_margin": 0.109076}, {"gen_index": 26, "token": 948, "top": [[35423, -0.018285], [46252, -5.836532], [36270, -6.048545], [66863, -6.157454], [7616, -7.68819], [11397, -8.766518], [948, -9.046479], [1178, -9.339169], [55950, -9.377085], [82856, -9.430161], [43492, -9.464632], [103140, -9.575012], [26884, -9.674365], [420, -9.712376], [60216, -9.770923], [52217, -9.918528], [52553, -9.95353], [66396, -10.076074], [52918, -10.086042], [46, -10.171714], [25205, -10.204042], [55998, -10.205439], [48716, -10.27127], [125313, -10.282957], [16754, -10.29186], [826, -10.31036], [114885, -10.366925], [25751, -10.376259], [44, -10.410677], [79262, -10.418036], [39077, -10.434447], [34991, -10.45327], [49541, -10.459074], [346, -10.47184], [32, -10.54129], [32533, -10.562699], [96379, -10.634188], [28320, -10.64908], [53753, -10.687963], [96186, -10.742037], [91252, -10.776643], [622, -10.784419], [121167, -10.787859], [97543, -10.835235], [922, -10.841924], [49848, -10.850199], [60147, -10.861726], [5274, -10.868128], [20283, -10.882337], [77262, -10.883617], [42454, -10.884942], [10, -10.915801], [4118, -10.916306], [74299, -10.948692], [12895, -10.955214], [34025, -10.993496], [46667, -11.001454], [5422, -11.005925], [104251, -11.021488], [263, -11.023799], [29394, -11.046772], [1097, -11.04885], [12559, -11.053668], [66473, -11.054037], [77623, -11.125818], [19040, -11.128692], [74390, -11.134182], [87462, -11.212029], [22726, -11.225204], [108392, -11.24007], [493, -11.252432], [36500, -11.288672], [4479, -11.292147], [58, -11.306816], [20593, -11.348053], [3504, -11.365192], [120007, -11.37363], [845, -11.382438], [59, -11.388672], [1537, -11.391837], [97346, -11.393297], [353, -11.403021], [93940, -11.408147], [30778, -11.422215], [1151, -11.432718], [39229, -11.447559], [24468, -11.456677], [12465, -11.45874], [116312, -11.472773], [123801, -11.480177], [101757, -11.482977], [76649, -11.485496], [67028, -11.489254], [107755, -11.494561], [49, -11.498644], [101106, -11.50408], [766, -11.51998], [10664, -11.523505], [699, -11.525998], [55442, -11.52758]], "logprob_of_token": -9.046479, "top1_top2_margin": 5.818247, "top6_top7_margin": 0.279962}, {"gen_index": 27, "token": 35423, "top": [[948, -0.002647], [346, -7.29813], [831, -8.31129], [518, -9.03261], [46, -9.355142], [420, -9.372839], [279, -9.598863], [2459, -9.685118], [1178, -9.740997], [10, -10.231962], [44, -10.272499], [1921, -10.372836], [339, -10.384106], [58, -10.401386], [922, -10.421964], [32, -10.477022], [14188, -10.65387], [115, -10.815346], [5274, -10.888504], [127906, -10.91529], [6443, -11.004313], [622, -11.062391], [2297, -11.107656], [614, -11.146888], [10664, -11.175536], [826, -11.259354], [493, -11.402158], [263, -11.432734], [845, -11.462093], [262, -11.484909], [34, -11.566553], [120022, -11.569551], [1829, -11.58981], [479, -11.666917], [576, -11.686853], [735, -11.710395], [14168, -11.743308], [3340, -11.791037], [35423, -11.824324], [946, -11.827517], [939, -11.902536], [14154, -11.910341], [63, -11.912291], [1117, -11.942802], [275, -11.980151], [913, -12.035136], [3504, -12.039171], [314, -12.042259], [378, -12.053146], [59, -12.076591], [14153, -12.082822], [1151, -12.146242], [14825, -12.158674], [888, -12.161739], [120007, -12.18067], [120001, -12.182064], [2125, -12.255847], [9122, -12.277183], [14541, -12.297594], [1233, -12.30682], [766, -12.312644], [1717, -12.339855], [861, -12.385571], [3417, -12.393612], [122883, -12.402021], [3643, -12.418204], [4840, -12.434258], [1687, -12.475222], [968, -12.475883], [2225, -12.517301], [120008, -12.528988], [965, -12.564296], [3750, -12.577561], [699, -12.597939], [7470, -12.626556], [527, -12.653625], [1409, -12.661142], [42, -12.672211], [2625, -12.677334], [970, -12.681976], [4561, -12.711168], [379, -12.721018], [465, -12.782307], [582, -12.805267], [941, -12.820023], [120098, -12.824541], [286, -12.829748], [122693, -12.830165], [120006, -12.857911], [669, -12.865144], [1200, -12.866903], [1521, -12.879954], [10304, -12.891554], [513, -12.892959], [2120, -12.939813], [14794, -12.946829], [2790, -12.9639], [1195, -12.978304], [589, -13.022436], [4733, -13.05499]], "logprob_of_token": -11.824324, "top1_top2_margin": 7.295483, "top6_top7_margin": 0.226024}, {"gen_index": 28, "token": 948, "top": [[35423, -0.010717], [46252, -6.025943], [36270, -6.311584], [66863, -7.172316], [7616, -8.202638], [11397, -8.898069], [103140, -9.448693], [43492, -9.487103], [55950, -9.977804], [48716, -10.059363], [32, -10.087628], [16754, -10.183931], [82856, -10.393481], [26884, -10.421384], [66396, -10.493148], [52217, -10.510406], [60216, -10.58005], [52553, -10.588475], [96186, -10.624923], [28320, -10.629009], [114885, -10.825897], [39077, -10.843287], [52918, -10.861183], [32533, -10.883529], [55998, -10.981311], [74299, -10.999448], [66473, -11.00015], [1178, -11.04376], [91252, -11.10602], [125313, -11.114853], [53753, -11.209188], [121167, -11.218378], [36500, -11.247152], [97543, -11.259658], [29394, -11.265579], [420, -11.302855], [60147, -11.314242], [948, -11.32157], [79262, -11.391152], [34991, -11.398364], [123801, -11.462692], [49848, -11.477599], [46667, -11.480371], [96379, -11.51127], [120007, -11.511676], [44, -11.514832], [22726, -11.515188], [5274, -11.529228], [104251, -11.532662], [87462, -11.533357], [25205, -11.555463], [25751, -11.564585], [93940, -11.57058], [20283, -11.595078], [826, -11.59658], [78542, -11.597384], [4118, -11.680947], [34025, -11.710457], [12559, -11.76582], [53404, -11.773589], [1097, -11.777173], [12895, -11.77724], [108392, -11.802501], [119878, -11.823428], [346, -11.834167], [49541, -11.844827], [922, -11.861366], [117126, -11.875798], [42454, -11.932652], [622, -11.955431], [4479, -11.955504], [12131, -11.963546], [74390, -11.991253], [25065, -11.993915], [12465, -11.997689], [97925, -12.004753], [76649, -12.006293], [41979, -12.007803], [77651, -12.011401], [97346, -12.014792], [1537, -12.023241], [10, -12.025143], [24468, -12.031957], [110404, -12.038156], [52663, -12.060589], [77262, -12.065743], [19040, -12.069492], [46, -12.072322], [66, -12.07658], [118043, -12.078603], [35815, -12.099901], [9986, -12.131696], [79631, -12.132782], [103975, -12.149922], [107755, -12.167619], [105405, -12.17164], [493, -12.185214], [77623, -12.196118], [353, -12.197362], [14794, -12.198529]], "logprob_of_token": -11.32157, "top1_top2_margin": 6.015226, "top6_top7_margin": 0.550624}, {"gen_index": 30, "token": 948, "top": [[35423, -0.015313], [46252, -5.279257], [36270, -6.334226], [66863, -6.799027], [7616, -8.022084], [11397, -8.401065], [48716, -9.313724], [103140, -9.463489], [43492, -9.488955], [82856, -9.518279], [26884, -9.653367], [55950, -9.673532], [16754, -10.023543], [52217, -10.04712], [66396, -10.067321], [32, -10.168932], [52553, -10.383835], [91252, -10.548594], [60216, -10.64142], [96186, -10.655112], [1178, -10.656535], [49541, -10.704011], [74299, -10.725738], [60147, -10.730045], [420, -10.746599], [36500, -10.750387], [125313, -10.873023], [34991, -10.881351], [52918, -10.886594], [87462, -10.900548], [28320, -10.937259], [96379, -10.939363], [66473, -11.001959], [44, -11.014849], [55998, -11.027645], [114885, -11.04024], [948, -11.079961], [25205, -11.090049], [39077, -11.122932], [53753, -11.124496], [32533, -11.152802], [25751, -11.15281], [121167, -11.216681], [29394, -11.218854], [49848, -11.272004], [120007, -11.293301], [101757, -11.306115], [34025, -11.349137], [119878, -11.362761], [104251, -11.36929], [826, -11.40356], [46, -11.410855], [78542, -11.451916], [12559, -11.463178], [97543, -11.465387], [79262, -11.482541], [4118, -11.4856], [1097, -11.503337], [5274, -11.534167], [5422, -11.550515], [76649, -11.58813], [12895, -11.594789], [922, -11.625606], [20283, -11.645556], [39229, -11.667059], [107755, -11.677577], [22726, -11.686561], [108392, -11.689612], [46667, -11.693202], [77651, -11.699046], [1537, -11.704493], [50240, -11.720178], [74390, -11.720449], [116312, -11.735028], [123801, -11.735626], [93940, -11.745411], [9702, -11.75236], [10, -11.76187], [110404, -11.780557], [4479, -11.788571], [75452, -11.792965], [117126, -11.796376], [103975, -11.801229], [24468, -11.814271], [34560, -11.818244], [104432, -11.832859], [86354, -11.833534], [53404, -11.843127], [52663, -11.844752], [79493, -11.864408], [622, -11.890048], [19040, -11.8904], [766, -11.892926], [34654, -11.898252], [35815, -11.907897], [66, -11.908216], [118043, -11.941617], [49, -11.942464], [97925, -11.944201], [346, -11.975239]], "logprob_of_token": -11.079961, "top1_top2_margin": 5.263944, "top6_top7_margin": 0.912659}]}, {"prompt": "The capital of Australia is", "input_ids": [325, 9255, 279, 5240, 735], "generated_ids": [75361, 46, 75361, 735, 262, 9255, 279, 5240, 46, 75361, 735, 7789, 622, 262, 7252, 13919, 37112, 46, 75361, 735, 262, 6980, 6547, 622, 262, 7252, 13919, 37112, 46, 75361, 735, 262], "rows": [{"gen_index": 0, "token": 75361, "top": [[735, -0.099518], [63, -4.251739], [46, -4.300756], [1043, -4.500887], [589, -5.134798], [275, -5.354086], [58, -5.423425], [44, -5.495846], [314, -5.589654], [460, -5.66993], [766, -5.94256], [378, -6.402532], [263, -6.455599], [10, -6.512238], [120007, -6.525488], [919, -6.698536], [528, -6.981005], [14188, -7.070613], [14153, -7.499663], [622, -7.54938], [1829, -7.646606], [5240, -7.805052], [59, -7.878418], [405, -7.977887], [20733, -7.995696], [568, -8.170443], [1656, -8.310414], [286, -8.393669], [617, -8.464211], [120022, -8.492651], [8150, -8.52213], [576, -8.526487], [476, -8.536707], [20773, -8.548826], [2459, -8.679111], [393, -8.695612], [9255, -8.734155], [310, -8.789992], [23441, -8.835849], [830, -8.855879], [5415, -8.884385], [279, -8.905725], [1309, -8.926426], [262, -8.984463], [327, -9.109263], [10471, -9.110718], [75361, -9.135028], [120016, -9.225824], [32, -9.283172], [439, -9.35697], [4384, -9.405661], [14896, -9.42664], [656, -9.449747], [1410, -9.629436], [1270, -9.647821], [93472, -9.672937], [1275, -9.698283], [7772, -9.75255], [103784, -9.770414], [14147, -9.796413], [3402, -9.842627], [120021, -9.857458], [1958, -9.879433], [34, -9.889691], [467, -9.890849], [47, -9.894879], [14439, -9.909431], [120610, -9.911961], [15762, -9.926516], [379, -9.947376], [20615, -9.974874], [824, -9.99267], [18126, -10.062075], [6172, -10.089297], [3688, -10.099709], [120018, -10.110201], [39, -10.127926], [15239, -10.132337], [11577, -10.138151], [20668, -10.174295], [582, -10.197821], [1064, -10.207487], [2286, -10.208086], [120006, -10.208696], [745, -10.230975], [125920, -10.235415], [33, -10.245113], [2554, -10.338083], [799, -10.347717], [25288, -10.354944], [946, -10.366791], [8140, -10.371071], [1283, -10.373906], [474, -10.386256], [4278, -10.393194], [1112, -10.401594], [14179, -10.403341], [669, -10.417855], [13919, -10.50001], [330, -10.513009]], "logprob_of_token": -9.135028, "top1_top2_margin": 4.152221, "top6_top7_margin": 0.069339}, {"gen_index": 1, "token": 46, "top": [[75361, -0.106103], [20733, -2.49697], [23441, -6.110179], [120007, -6.277777], [262, -6.498446], [5274, -6.825605], [5240, -7.555398], [32, -7.585652], [502, -7.62844], [34122, -8.022045], [3960, -8.025498], [91515, -8.070083], [120022, -8.103549], [9255, -8.414601], [941, -8.440371], [476, -8.498549], [13919, -8.58509], [64119, -8.640576], [49123, -8.993575], [58209, -9.017131], [44573, -9.136701], [27565, -9.140844], [946, -9.161827], [762, -9.433983], [120016, -9.463002], [8546, -9.513971], [28872, -9.51467], [7252, -9.536365], [622, -9.55003], [93472, -9.566845], [63, -9.57282], [4361, -9.797003], [46, -9.799577], [5513, -9.814089], [745, -9.861514], [63585, -9.886218], [7789, -9.992709], [1410, -10.086102], [58, -10.119845], [1283, -10.168071], [120021, -10.178692], [28851, -10.191761], [4075, -10.204048], [5639, -10.225629], [1921, -10.23213], [2602, -10.315092], [36995, -10.351173], [393, -10.361515], [104792, -10.386243], [31055, -10.401322], [49146, -10.410806], [86627, -10.420785], [766, -10.480241], [9224, -10.489657], [16474, -10.536067], [735, -10.55169], [110874, -10.582237], [543, -10.631488], [327, -10.650859], [28234, -10.655528], [5672, -10.661296], [16545, -10.679351], [24507, -10.70013], [54977, -10.71109], [120410, -10.730481], [18677, -10.780387], [6030, -10.781026], [14188, -10.782546], [41875, -10.788893], [10, -10.831432], [67327, -10.848107], [67370, -10.884612], [799, -10.886731], [29296, -10.896161], [11533, -10.900737], [20758, -10.905276], [87056, -10.928323], [14052, -10.953179], [3327, -10.953391], [3660, -10.980504], [1043, -10.988743], [263, -11.001473], [2807, -11.002864], [20321, -11.096273], [459, -11.103785], [21690, -11.112456], [656, -11.113591], [523, -11.124379], [44, -11.125959], [30316, -11.133243], [16424, -11.13993], [2150, -11.174464], [20023, -11.176312], [2403, -11.200677], [2944, -11.229957], [48470, -11.230244], [76115, -11.251735], [120103, -11.2529], [120001, -11.306274], [2457, -11.345265]], "logprob_of_token": -9.799577, "top1_top2_margin": 2.390867, "top6_top7_margin": 0.729794}, {"gen_index": 2, "token": 75361, "top": [[46, -0.627708], [275, -1.176136], [314, -2.461591], [44, -3.619084], [766, -3.864588], [59, -5.149523], [63, -5.923138], [120007, -6.220485], [14188, -6.357808], [1043, -6.741031], [120399, -7.240429], [1829, -7.541419], [120016, -7.542417], [735, -7.751037], [263, -7.852379], [10, -8.000595], [4137, -8.123127], [460, -8.143785], [405, -8.268641], [36209, -8.316492], [120230, -8.49476], [393, -8.7178], [120021, -8.741953], [286, -8.776192], [14153, -8.816912], [5240, -8.818169], [93457, -8.947159], [51880, -8.955561], [13594, -9.363817], [502, -9.380506], [120048, -9.386671], [12611, -9.398576], [120001, -9.420811], [120022, -9.475858], [58, -9.480394], [622, -9.515017], [327, -9.585511], [36198, -9.604198], [120000, -9.610703], [28872, -9.612015], [745, -9.684325], [120078, -9.710539], [30989, -9.805544], [34589, -9.852526], [75361, -9.865339], [120214, -9.962196], [120064, -10.011195], [33, -10.064598], [120002, -10.117779], [120360, -10.12271], [284, -10.12272], [988, -10.125371], [120347, -10.213411], [120099, -10.220205], [120241, -10.22461], [120140, -10.234927], [126123, -10.239473], [32, -10.315673], [595, -10.359055], [44176, -10.378721], [262, -10.431481], [2519, -10.445278], [6391, -10.46133], [34588, -10.485987], [40, -10.499953], [11861, -10.52261], [103784, -10.565125], [120969, -10.575756], [120173, -10.579065], [14179, -10.615974], [120003, -10.630545], [124455, -10.642416], [120008, -10.643372], [7252, -10.689405], [120068, -10.692015], [120410, -10.766786], [120028, -10.778166], [120359, -10.874361], [656, -10.889364], [120108, -10.904585], [85447, -10.914553], [20758, -10.931809], [33676, -10.977871], [120610, -10.980901], [10829, -10.997249], [9255, -11.017918], [44455, -11.021355], [378, -11.051597], [476, -11.058415], [669, -11.059634], [589, -11.063579], [50492, -11.082089], [74254, -11.085712], [120103, -11.100038], [310, -11.105599], [120110, -11.114468], [333, -11.115234], [120084, -11.120886], [936, -11.122843], [120018, -11.126722]], "logprob_of_token": -9.865339, "top1_top2_margin": 0.548428, "top6_top7_margin": 0.773615}, {"gen_index": 4, "token": 262, "top": [[735, -0.331929], [378, -1.91456], [4278, -2.684932], [919, -3.874975], [44, -4.512024], [589, -4.992129], [46, -5.486988], [11201, -5.660077], [766, -6.239947], [52776, -6.600882], [21925, -6.900023], [14439, -6.938468], [1410, -7.105514], [476, -7.470593], [58, -7.552036], [10757, -7.807938], [75361, -7.872204], [7789, -7.982588], [13032, -8.095985], [262, -8.183058], [275, -8.308036], [7330, -8.30827], [4225, -8.473519], [4440, -8.48255], [14380, -8.505855], [622, -8.540207], [4617, -8.565274], [4088, -8.567205], [617, -8.610145], [16740, -8.647677], [14598, -8.712106], [8140, -8.724154], [120007, -8.758443], [976, -8.895727], [1275, -8.912897], [1958, -8.940596], [5240, -9.036345], [10471, -9.102546], [13308, -9.137014], [63, -9.169091], [830, -9.181324], [12195, -9.250653], [286, -9.257542], [18227, -9.266868], [1030, -9.292575], [20615, -9.305844], [20748, -9.31716], [1812, -9.383111], [14188, -9.407496], [9727, -9.424507], [14153, -9.436317], [6547, -9.473915], [8150, -9.485936], [824, -9.490178], [4384, -9.501166], [314, -9.501771], [2879, -9.502803], [263, -9.551177], [120022, -9.571827], [1270, -9.573593], [1829, -9.589509], [6581, -9.607583], [279, -9.612653], [11338, -9.659911], [10, -9.668082], [37296, -9.728727], [28872, -9.781649], [14052, -9.851533], [2807, -9.872153], [439, -9.878118], [20773, -9.901919], [14262, -9.94463], [11319, -9.963798], [4884, -9.965147], [32, -10.054002], [669, -10.069278], [6513, -10.079303], [2347, -10.117501], [13438, -10.146122], [17446, -10.148826], [17155, -10.166997], [9255, -10.172709], [393, -10.191768], [9169, -10.199856], [5598, -10.270081], [2459, -10.291102], [1656, -10.293176], [59, -10.318166], [13493, -10.323466], [11523, -10.349924], [6030, -10.355003], [11308, -10.35996], [3865, -10.363032], [502, -10.398369], [662, -10.407286], [11769, -10.41533], [3326, -10.493896], [37322, -10.50243], [19701, -10.566461], [12243, -10.579825]], "logprob_of_token": -8.183058, "top1_top2_margin": 1.582631, "top6_top7_margin": 0.494859}, {"gen_index": 5, "token": 9255, "top": [[262, -0.700852], [7789, -1.376184], [941, -1.85588], [502, -3.690639], [1410, -4.212526], [15132, -4.777377], [5240, -4.799485], [622, -5.085109], [5407, -5.402536], [13438, -5.507686], [834, -5.935584], [2602, -6.067038], [2150, -6.082267], [6030, -6.902984], [14386, -7.127004], [799, -7.237372], [14052, -7.415844], [9255, -7.642775], [5639, -7.712229], [2403, -7.903582], [3892, -8.23383], [1739, -8.391411], [7252, -8.392576], [5874, -8.432338], [8255, -8.611733], [75361, -8.625588], [12511, -8.642002], [4080, -8.652556], [3893, -8.683486], [1075, -8.716693], [10301, -8.774436], [8784, -8.780351], [4191, -8.810496], [2457, -8.823949], [3379, -8.867724], [15967, -8.943904], [3327, -9.035268], [85056, -9.161405], [23132, -9.184123], [121222, -9.191953], [32, -9.199272], [1781, -9.305096], [3145, -9.356153], [1812, -9.434373], [15038, -9.434939], [2702, -9.474767], [37889, -9.504988], [923, -9.530846], [2288, -9.592011], [2642, -9.619357], [15684, -9.649755], [13969, -9.652184], [2769, -9.658835], [14380, -9.688556], [72062, -9.731582], [1127, -9.751437], [900, -9.758417], [3992, -9.78058], [3647, -9.785786], [33499, -9.793627], [7641, -9.793903], [26216, -9.821757], [54882, -9.841914], [327, -9.843869], [19952, -9.858157], [8254, -9.891617], [3660, -9.892802], [828, -9.937858], [5397, -9.963739], [15087, -9.96481], [82073, -9.981944], [3806, -9.985322], [4225, -9.989341], [318, -9.990586], [21393, -9.995071], [1744, -10.031897], [9169, -10.051917], [5220, -10.051984], [7411, -10.058757], [23373, -10.072803], [3437, -10.080752], [13636, -10.123435], [2048, -10.135055], [851, -10.193873], [2584, -10.206373], [27840, -10.246389], [31046, -10.24966], [946, -10.267531], [3166, -10.285964], [11234, -10.296362], [9662, -10.325132], [49484, -10.339658], [14197, -10.351418], [13074, -10.361389], [6131, -10.368973], [3326, -10.369294], [2417, -10.385162], [1436, -10.429019], [12386, -10.450786], [9344, -10.457411]], "logprob_of_token": -7.642775, "top1_top2_margin": 0.675332, "top6_top7_margin": 0.022108}, {"gen_index": 7, "token": 5240, "top": [[279, -0.71508], [6547, -0.78054], [46, -4.063272], [44, -4.503077], [286, -4.669266], [22130, -5.53514], [779, -5.999345], [275, -6.401587], [59, -6.435038], [3756, -7.504812], [936, -7.913919], [314, -8.24332], [9255, -8.880745], [474, -8.944555], [7252, -9.055679], [622, -9.074173], [5216, -9.146024], [327, -9.173954], [502, -9.213601], [124214, -9.244558], [75361, -9.24972], [14205, -9.32356], [5763, -9.337856], [43035, -9.557227], [834, -9.855959], [3547, -9.935441], [1444, -9.972139], [1366, -10.033831], [766, -10.140038], [14476, -10.157676], [14197, -10.184914], [393, -10.319265], [4338, -10.340881], [379, -10.386392], [14232, -10.455555], [1275, -10.472926], [5090, -10.509251], [1112, -10.530359], [5240, -10.595954], [120007, -10.619963], [63, -10.647787], [58, -10.731258], [735, -10.783608], [14188, -10.801004], [5481, -10.810803], [35038, -10.839157], [262, -10.855001], [36758, -10.937871], [589, -10.96596], [2322, -10.988468], [1790, -10.997534], [2930, -11.03325], [799, -11.051707], [14390, -11.054765], [2457, -11.115188], [37112, -11.148372], [1409, -11.220768], [318, -11.285501], [7789, -11.306367], [777, -11.320141], [3666, -11.35197], [2107, -11.357723], [4086, -11.368467], [2288, -11.407705], [739, -11.432996], [4711, -11.434898], [1829, -11.438376], [14346, -11.478787], [310, -11.481325], [1042, -11.547565], [5502, -11.560218], [42586, -11.566069], [4508, -11.586629], [467, -11.591032], [9598, -11.612255], [378, -11.647315], [7331, -11.650429], [4225, -11.686193], [121222, -11.689225], [33, -11.712229], [17111, -11.749612], [10, -11.776793], [527, -11.791609], [15437, -11.809526], [5501, -11.830532], [9669, -11.831446], [18060, -11.893906], [4191, -11.913678], [3158, -11.920236], [20076, -11.926641], [7532, -11.929934], [3395, -11.935465], [763, -11.955779], [28872, -11.989429], [12020, -11.991026], [32, -12.015432], [4743, -12.028493], [263, -12.075724], [1739, -12.087742], [14181, -12.095608]], "logprob_of_token": -10.595954, "top1_top2_margin": 0.065459, "top6_top7_margin": 0.464205}, {"gen_index": 9, "token": 75361, "top": [[46, -0.561985], [286, -1.64692], [44, -2.052217], [275, -2.706178], [59, -4.411422], [314, -4.433134], [779, -5.114922], [7789, -6.133554], [936, -6.543835], [589, -6.648255], [3756, -6.954038], [766, -7.712215], [327, -7.72105], [63, -7.88865], [120007, -8.534723], [393, -8.594658], [799, -8.732182], [1275, -8.761672], [622, -8.766886], [834, -8.770813], [3326, -9.180076], [120399, -9.223872], [735, -9.38291], [739, -9.471678], [4137, -9.525374], [14188, -9.599762], [1043, -9.639759], [75361, -9.6769], [58, -9.677553], [1112, -9.69549], [617, -9.739224], [474, -9.820028], [36209, -9.924182], [263, -9.956186], [120016, -9.960289], [2930, -10.097622], [2457, -10.104116], [777, -10.104689], [33, -10.122313], [1231, -10.165809], [279, -10.175152], [310, -10.241596], [502, -10.348292], [3863, -10.373601], [5407, -10.417873], [262, -10.434399], [467, -10.4401], [4191, -10.460579], [120001, -10.550349], [10, -10.56588], [1829, -10.587547], [4086, -10.600005], [5090, -10.605799], [13636, -10.610629], [120230, -10.736481], [1409, -10.762778], [30989, -10.765597], [378, -10.864256], [379, -10.888261], [120064, -10.976927], [15132, -11.024956], [14153, -11.037397], [1765, -11.123601], [120000, -11.132307], [4265, -11.149238], [120003, -11.154159], [1444, -11.158309], [5240, -11.180011], [2051, -11.2176], [13594, -11.276391], [1988, -11.278913], [120022, -11.280931], [120068, -11.323788], [4508, -11.324719], [1790, -11.330712], [1972, -11.361025], [9169, -11.391394], [6000, -11.412563], [420, -11.41549], [4225, -11.42124], [405, -11.424152], [919, -11.471704], [527, -11.548656], [460, -11.549908], [669, -11.567587], [543, -11.57264], [14052, -11.588957], [7692, -11.629873], [9255, -11.647296], [120021, -11.669441], [270, -11.691643], [5639, -11.692446], [120048, -11.701632], [14386, -11.704647], [318, -11.749169], [120241, -11.767428], [476, -11.781639], [93457, -11.799293], [2519, -11.822102], [120008, -11.827379]], "logprob_of_token": -9.6769, "top1_top2_margin": 1.084935, "top6_top7_margin": 0.681788}, {"gen_index": 11, "token": 7789, "top": [[735, -0.219205], [378, -2.036697], [4278, -3.786479], [919, -4.364099], [44, -4.676873], [589, -5.098885], [11201, -6.245733], [7789, -6.412693], [52776, -6.553286], [14439, -6.635589], [46, -7.133049], [1410, -7.779206], [286, -8.025517], [13032, -8.246965], [58, -8.427554], [476, -8.473445], [10757, -8.514091], [21925, -8.52384], [10471, -8.680556], [14598, -8.713969], [14380, -8.801311], [4088, -8.805634], [4617, -8.811979], [275, -8.8243], [1958, -8.863961], [262, -8.938731], [16740, -9.004532], [766, -9.015872], [37296, -9.110806], [622, -9.119406], [11319, -9.214488], [617, -9.283499], [439, -9.329768], [7330, -9.450791], [4440, -9.451134], [120007, -9.462228], [1270, -9.478841], [6547, -9.554334], [20615, -9.710402], [1812, -9.73921], [8140, -9.808389], [58415, -9.858621], [12195, -9.89763], [4884, -9.963778], [830, -9.977824], [75361, -9.990129], [4191, -10.031263], [4384, -10.082947], [976, -10.105815], [2347, -10.146055], [5240, -10.174912], [8150, -10.18671], [13438, -10.190219], [2879, -10.199672], [4225, -10.233608], [314, -10.271142], [1275, -10.282963], [14262, -10.284648], [9255, -10.353892], [13493, -10.355491], [1656, -10.381255], [19701, -10.396625], [14153, -10.441987], [1064, -10.452378], [9169, -10.460732], [6513, -10.519601], [576, -10.559234], [13636, -10.587112], [13308, -10.596813], [11338, -10.599349], [20748, -10.619008], [4032, -10.623607], [9669, -10.651837], [824, -10.679927], [26216, -10.68091], [14188, -10.702202], [38863, -10.719316], [279, -10.719562], [1030, -10.770797], [16404, -10.787869], [5598, -10.795121], [5216, -10.813144], [11265, -10.821488], [1829, -10.879926], [528, -10.896744], [662, -10.931463], [19661, -10.937507], [63, -10.958291], [17155, -10.958918], [120022, -10.963908], [9727, -11.009367], [37322, -11.074618], [18227, -11.080166], [5415, -11.102708], [11317, -11.103851], [3725, -11.180802], [2807, -11.199819], [87805, -11.227734], [20773, -11.229556], [11308, -11.236403]], "logprob_of_token": -6.412693, "top1_top2_margin": 1.817492, "top6_top7_margin": 1.146848}, {"gen_index": 12, "token": 622, "top": [[7789, -0.684612], [941, -1.599159], [262, -1.835038], [1410, -2.580433], [622, -3.736016], [5407, -5.067179], [502, -5.069961], [15132, -5.618517], [2150, -6.000785], [13438, -6.290527], [834, -6.614531], [5639, -6.736056], [799, -7.145288], [5240, -7.463264], [75361, -7.625746], [2602, -7.773242], [14052, -7.906127], [1075, -8.12493], [2403, -8.186753], [6030, -8.194304], [9255, -8.314872], [10301, -8.646548], [3145, -8.760202], [14386, -8.867192], [2457, -8.915416], [1739, -8.916215], [4619, -9.015902], [4191, -9.075101], [23132, -9.131134], [85056, -9.197694], [2642, -9.373773], [15967, -9.374949], [3647, -9.38005], [1812, -9.405694], [2288, -9.477519], [1127, -9.506951], [8784, -9.515313], [82073, -9.52974], [32, -9.615773], [2769, -9.645915], [12511, -9.673898], [63248, -9.737432], [2584, -9.793955], [7252, -9.79516], [5874, -9.819519], [3379, -9.908824], [14380, -9.926026], [2702, -9.983067], [3892, -9.991901], [3327, -10.053874], [851, -10.089324], [1781, -10.10237], [13969, -10.114232], [3893, -10.126384], [121222, -10.15145], [72062, -10.171817], [2653, -10.189332], [33499, -10.223428], [15038, -10.224302], [923, -10.267611], [3660, -10.318112], [2048, -10.333398], [8255, -10.345508], [3137, -10.413495], [3992, -10.449654], [4518, -10.472276], [33807, -10.477554], [1436, -10.519239], [762, -10.528585], [26216, -10.540323], [3368, -10.544168], [1744, -10.544873], [5929, -10.569341], [9344, -10.578305], [3918, -10.606439], [7641, -10.61185], [19952, -10.627349], [18783, -10.644254], [15087, -10.646947], [17414, -10.65822], [900, -10.667041], [828, -10.676225], [2605, -10.698184], [13636, -10.707483], [3326, -10.707865], [7411, -10.728511], [6846, -10.743808], [8129, -10.761466], [19693, -10.769256], [11960, -10.807924], [1444, -10.812238], [4205, -10.815304], [327, -10.826606], [2575, -10.858451], [2249, -10.872497], [16330, -10.875974], [5220, -10.892258], [67873, -10.90363], [5445, -10.945974], [3096, -10.958429]], "logprob_of_token": -3.736016, "top1_top2_margin": 0.914547, "top6_top7_margin": 0.002782}, {"gen_index": 13, "token": 262, "top": [[622, -0.081199], [834, -2.674149], [2457, -5.034026], [2288, -6.970887], [121222, -8.16808], [2769, -8.772044], [120007, -9.207801], [3660, -9.305516], [6791, -9.559796], [467, -9.979779], [14667, -10.046049], [318, -10.172091], [16330, -10.234175], [799, -10.260322], [8255, -10.310628], [4529, -10.574616], [21393, -10.732066], [923, -10.850444], [1275, -10.966712], [120022, -10.978215], [4518, -11.007899], [7252, -11.15344], [4610, -11.288523], [46, -11.450892], [502, -11.490085], [14570, -11.784531], [15597, -11.844264], [279, -11.876306], [5675, -11.905231], [5240, -11.934945], [262, -11.941394], [29250, -11.950582], [1972, -11.959702], [15135, -12.045489], [1744, -12.052281], [745, -12.113886], [828, -12.1397], [3165, -12.151441], [310, -12.16527], [1444, -12.265283], [75361, -12.272948], [6846, -12.275611], [16383, -12.280131], [5146, -12.293351], [32, -12.317361], [1474, -12.393003], [15673, -12.416575], [3583, -12.507422], [4907, -12.537463], [3093, -12.582013], [379, -12.586169], [2025, -12.603328], [1155, -12.607933], [717, -12.609619], [900, -12.618231], [27246, -12.6282], [63, -12.642184], [1112, -12.686011], [120016, -12.710025], [7331, -12.721883], [2625, -12.754928], [474, -12.778224], [2046, -12.804442], [7789, -12.823552], [938, -12.831725], [941, -12.831839], [44, -12.863071], [393, -12.875703], [14942, -12.887321], [7641, -12.895741], [763, -12.945094], [28872, -12.946372], [90255, -12.959525], [9538, -12.970022], [3755, -13.014759], [11234, -13.015199], [762, -13.091859], [38925, -13.106898], [1790, -13.137941], [14856, -13.141197], [13658, -13.154571], [54482, -13.175246], [1637, -13.21213], [8975, -13.227082], [3919, -13.233582], [1093, -13.251739], [15132, -13.252883], [4080, -13.268268], [685, -13.276014], [120410, -13.277399], [735, -13.279238], [3977, -13.291705], [86955, -13.305513], [10617, -13.325518], [327, -13.344493], [12749, -13.358617], [8784, -13.366377], [42296, -13.375179], [4205, -13.376557], [6380, -13.39482]], "logprob_of_token": -11.941394, "top1_top2_margin": 2.59295, "top6_top7_margin": 0.435757}, {"gen_index": 14, "token": 7252, "top": [[262, -0.032218], [7252, -3.916158], [5240, -5.529859], [1283, -5.699623], [75361, -6.326711], [54482, -7.023061], [14856, -8.966296], [67370, -8.967914], [16424, -9.067069], [834, -9.122808], [941, -9.297248], [3465, -9.833524], [27992, -9.841264], [43425, -10.151923], [762, -10.223411], [120007, -10.2604], [393, -10.817243], [13919, -10.829127], [41875, -10.875635], [14871, -10.962307], [28872, -10.97185], [29250, -11.047137], [938, -11.050964], [9255, -11.064034], [50394, -11.13161], [3312, -11.239491], [4881, -11.252122], [900, -11.259749], [2150, -11.307219], [8546, -11.30967], [89226, -11.406575], [14667, -11.429618], [17907, -11.443174], [8207, -11.458646], [543, -11.656326], [32, -11.691685], [54901, -11.782889], [63870, -11.8625], [56768, -11.945409], [22130, -12.070143], [5521, -12.078424], [8615, -12.085694], [37112, -12.100656], [6392, -12.167593], [19246, -12.196315], [12813, -12.238029], [26103, -12.243323], [597, -12.261962], [16474, -12.268764], [120022, -12.30576], [6622, -12.341861], [1133, -12.356371], [106198, -12.413762], [20733, -12.456165], [37270, -12.51625], [34140, -12.549863], [622, -12.603868], [3326, -12.622405], [4203, -12.62395], [1920, -12.628339], [4305, -12.71033], [261, -12.719274], [23441, -12.73405], [36758, -12.737844], [13748, -12.825034], [6866, -12.82767], [2403, -12.8362], [9593, -12.852697], [99932, -12.917884], [14197, -12.930595], [2986, -12.953436], [8960, -12.989228], [2288, -12.995418], [106433, -13.050319], [2420, -13.061571], [3327, -13.080255], [21690, -13.088061], [2246, -13.107353], [1389, -13.129104], [327, -13.149403], [49146, -13.193597], [2807, -13.202517], [24405, -13.204112], [21986, -13.218588], [2457, -13.220351], [1744, -13.227172], [6781, -13.234615], [1739, -13.249617], [8734, -13.279417], [4955, -13.283055], [18462, -13.309998], [745, -13.33259], [8255, -13.419127], [1862, -13.440911], [8382, -13.453963], [7940, -13.457442], [5274, -13.463747], [3096, -13.47432], [9071, -13.479206], [43035, -13.486978]], "logprob_of_token": -3.916158, "top1_top2_margin": 3.88394, "top6_top7_margin": 1.943235}, {"gen_index": 15, "token": 13919, "top": [[7252, -0.006369], [75361, -6.062605], [54482, -7.758632], [13919, -7.852929], [28872, -8.062071], [50394, -8.240054], [9255, -8.405437], [9593, -8.579066], [22130, -8.834402], [14856, -8.962554], [6187, -9.170347], [5240, -9.203398], [37112, -9.261868], [2420, -9.346598], [8615, -9.639709], [4338, -9.799621], [14871, -9.823389], [29250, -9.916059], [27992, -9.958142], [3465, -10.003529], [89226, -10.21031], [3312, -10.354309], [14232, -10.496313], [36758, -10.504616], [21690, -10.567795], [54901, -10.740583], [5763, -10.744778], [8382, -10.769047], [106433, -10.774292], [8207, -10.88294], [14667, -10.886154], [1366, -10.923141], [4881, -11.000575], [5481, -11.231987], [2107, -11.257513], [26758, -11.31856], [1920, -11.537284], [106198, -11.562925], [4305, -11.61462], [114279, -11.709215], [2962, -11.719433], [1283, -11.739771], [84803, -11.776974], [38337, -11.81414], [6662, -11.871828], [28999, -11.886459], [25001, -11.900155], [6209, -11.956268], [59342, -12.031871], [12813, -12.079443], [834, -12.08167], [17907, -12.093916], [10829, -12.101928], [5521, -12.222663], [65382, -12.223562], [20733, -12.242336], [8960, -12.257463], [23995, -12.258717], [9502, -12.28697], [34140, -12.307796], [5987, -12.310912], [3960, -12.332375], [24405, -12.357635], [11240, -12.38519], [7017, -12.387487], [19246, -12.407227], [2807, -12.427403], [68072, -12.439775], [43425, -12.51705], [56768, -12.566105], [63585, -12.599531], [13096, -12.606356], [41875, -12.624023], [121222, -12.676531], [1389, -12.682568], [4960, -12.706649], [23367, -12.715812], [67370, -12.718611], [23441, -12.724315], [16424, -12.758751], [63870, -12.762882], [14390, -12.844714], [28914, -12.857031], [1937, -12.870749], [48189, -12.88599], [5002, -12.91655], [2920, -12.923754], [8546, -12.930017], [23799, -12.937377], [476, -12.957217], [14181, -12.977108], [17111, -12.978869], [26103, -12.982622], [16474, -12.983522], [26835, -13.03471], [6480, -13.048028], [36398, -13.111868], [20065, -13.146713], [33029, -13.156436], [18028, -13.176661]], "logprob_of_token": -7.852929, "top1_top2_margin": 6.056236, "top6_top7_margin": 0.165383}, {"gen_index": 16, "token": 37112, "top": [[13919, -0.000654], [9255, -7.44448], [52684, -10.549218], [35330, -11.883224], [69505, -12.428955], [75361, -12.48586], [57501, -12.630986], [9593, -12.79371], [16399, -13.121492], [37112, -13.234026], [54901, -13.327229], [21690, -13.493184], [22130, -13.75499], [7252, -13.929621], [3336, -14.451688], [2420, -14.605719], [26114, -14.785373], [125920, -14.94616], [25001, -14.983277], [9728, -15.154286], [12813, -15.199094], [36758, -15.231019], [19617, -15.249805], [22090, -15.250341], [6480, -15.261954], [5002, -15.342459], [89128, -15.459461], [85056, -15.483596], [16474, -15.622999], [12342, -15.662761], [63442, -15.772398], [5690, -15.83208], [23799, -15.84489], [18945, -15.864811], [59342, -15.883245], [38337, -16.019627], [37748, -16.086576], [6146, -16.095613], [87340, -16.163054], [43014, -16.173538], [11094, -16.199728], [68907, -16.239643], [27992, -16.251709], [62453, -16.263477], [35358, -16.276569], [26411, -16.299051], [18363, -16.346106], [36618, -16.385084], [6209, -16.414492], [5481, -16.439135], [50774, -16.491236], [32019, -16.524935], [18669, -16.598471], [29617, -16.739466], [5898, -16.825731], [28872, -16.904226], [4711, -16.921366], [14871, -16.948521], [61473, -16.972553], [20291, -16.975241], [32731, -16.979662], [23280, -17.016462], [11710, -17.026293], [58949, -17.114706], [8615, -17.154243], [9502, -17.305552], [54482, -17.325527], [42629, -17.354933], [3808, -17.38509], [11240, -17.391062], [46120, -17.395887], [13247, -17.451094], [25019, -17.464821], [17003, -17.471258], [16409, -17.479605], [16424, -17.487041], [119822, -17.529413], [5156, -17.564352], [5234, -17.586676], [89226, -17.58824], [34140, -17.596626], [3960, -17.598034], [45419, -17.598488], [3465, -17.600847], [54983, -17.605026], [39909, -17.61064], [19412, -17.651382], [91617, -17.696507], [995, -17.710398], [27214, -17.723215], [25748, -17.728777], [9346, -17.734892], [55916, -17.738661], [8960, -17.741356], [14655, -17.742613], [6662, -17.756645], [13096, -17.757833], [6622, -17.774515], [49931, -17.789526], [2807, -17.81259]], "logprob_of_token": -13.234026, "top1_top2_margin": 7.443826, "top6_top7_margin": 0.145126}, {"gen_index": 17, "token": 46, "top": [[37112, -3.4e-05], [59342, -12.163361], [22130, -12.394899], [6187, -12.458388], [63091, -12.820167], [72805, -13.22027], [55898, -13.659981], [72755, -13.715622], [50037, -13.932981], [109249, -14.051713], [18463, -14.501507], [60878, -14.559458], [13096, -14.684853], [3095, -14.757731], [41205, -14.902037], [53035, -14.953529], [34919, -15.03228], [36758, -15.214361], [39889, -15.240376], [5216, -15.442143], [11408, -15.566583], [24557, -15.575426], [11101, -15.577568], [114051, -15.623068], [80239, -15.652416], [35711, -15.697114], [120007, -15.738832], [19132, -15.747387], [54413, -15.75935], [2920, -15.779888], [22339, -15.851704], [12525, -15.909441], [9379, -15.921435], [11710, -15.971827], [9848, -15.974405], [13200, -16.01325], [8814, -16.056379], [13967, -16.065311], [98611, -16.110123], [27460, -16.215891], [64946, -16.310911], [39139, -16.354828], [76669, -16.366407], [17667, -16.537214], [14258, -16.544203], [47743, -16.596148], [15670, -16.635529], [16720, -16.65151], [21316, -16.651695], [50231, -16.659664], [59834, -16.719612], [4708, -16.722717], [21690, -16.72949], [23968, -16.768267], [27108, -16.800444], [29295, -16.812317], [13919, -16.847609], [79438, -16.875679], [25322, -16.88315], [13892, -16.964073], [5784, -16.971642], [23787, -16.979332], [38373, -17.025593], [75361, -17.060825], [119568, -17.095432], [115, -17.111919], [75508, -17.114799], [14115, -17.153601], [36728, -17.160606], [38130, -17.186548], [6209, -17.211229], [23987, -17.252163], [6624, -17.263727], [21437, -17.302721], [86759, -17.317791], [54260, -17.388996], [66095, -17.399906], [112912, -17.41638], [6146, -17.438459], [120022, -17.457211], [120016, -17.458069], [21822, -17.478739], [55905, -17.489792], [42397, -17.540316], [36223, -17.546967], [46, -17.575016], [112924, -17.587368], [279, -17.609121], [9736, -17.615211], [24426, -17.616512], [9593, -17.618896], [5418, -17.633621], [4519, -17.645382], [13205, -17.666571], [8615, -17.67338], [18669, -17.676205], [21126, -17.697628], [6597, -17.741692], [51897, -17.74666], [43035, -17.777624]], "logprob_of_token": -17.575016, "top1_top2_margin": 12.163327, "top6_top7_margin": 0.439711}, {"gen_index": 18, "token": 75361, "top": [[46, -0.409737], [766, -1.318228], [275, -3.423332], [44, -3.901871], [314, -4.871673], [834, -5.114256], [622, -7.978035], [393, -8.214187], [279, -9.29985], [286, -9.410493], [63, -9.435526], [2457, -9.526763], [28872, -9.562424], [59, -9.611803], [120007, -9.728365], [7252, -10.015263], [120399, -10.207886], [4610, -10.469672], [523, -10.558105], [936, -10.806694], [120016, -10.846382], [25997, -10.96254], [2769, -11.008852], [14188, -11.094093], [1275, -11.116417], [48237, -11.141431], [58, -11.165668], [5240, -11.329068], [120001, -11.42698], [75361, -11.481241], [40, -11.512671], [10, -11.554943], [1829, -11.602734], [2288, -11.727124], [327, -11.781439], [4137, -11.855274], [67581, -11.931965], [10829, -11.933627], [6391, -11.966122], [36209, -11.970783], [263, -11.985733], [120230, -12.075304], [120021, -12.128565], [1112, -12.149445], [262, -12.16339], [14153, -12.179552], [799, -12.219305], [15135, -12.236975], [1043, -12.242985], [310, -12.288731], [122981, -12.442019], [33, -12.44976], [120048, -12.500832], [4529, -12.536886], [3688, -12.575705], [7789, -12.643744], [379, -12.678291], [36198, -12.681149], [120099, -12.691118], [589, -12.69297], [103219, -12.729868], [120360, -12.770521], [2807, -12.777622], [120241, -12.784452], [763, -12.791451], [51992, -12.818041], [18813, -12.826095], [120003, -12.835039], [1790, -12.844461], [12611, -12.880571], [13594, -12.901948], [120000, -12.91156], [120864, -12.954779], [121146, -13.021738], [81125, -13.02428], [69722, -13.028508], [120347, -13.053674], [126091, -13.054992], [12749, -13.056259], [779, -13.076214], [3863, -13.076595], [120022, -13.103804], [120338, -13.107584], [121172, -13.175844], [745, -13.186707], [543, -13.207809], [460, -13.212451], [44455, -13.217598], [405, -13.240474], [4518, -13.241262], [7510, -13.251345], [120667, -13.258392], [120885, -13.260647], [93457, -13.262383], [120068, -13.270742], [32, -13.31358], [1765, -13.31775], [43933, -13.329479], [120002, -13.350259], [318, -13.362963]], "logprob_of_token": -11.481241, "top1_top2_margin": 0.908491, "top6_top7_margin": 2.863779}, {"gen_index": 22, "token": 6547, "top": [[6980, -0.39496], [9255, -1.780419], [14390, -2.383105], [11818, -4.452945], [6662, -5.161774], [1444, -5.200858], [2991, -5.303867], [1840, -5.514607], [2322, -5.850384], [5397, -5.903284], [15967, -6.011439], [26458, -6.471815], [9322, -6.597424], [7771, -6.609281], [7278, -6.672338], [29350, -6.797248], [14232, -7.041832], [6547, -7.051476], [31663, -7.098048], [7252, -7.186527], [9669, -7.356025], [32, -7.358107], [5763, -7.434339], [10636, -7.445103], [13331, -7.469833], [40165, -7.688156], [5032, -7.93332], [6634, -7.9914], [64315, -8.038294], [5516, -8.039302], [5171, -8.198038], [1075, -8.287603], [8445, -8.359704], [37560, -8.412062], [6014, -8.45348], [48600, -8.594055], [7296, -8.686455], [15038, -8.740544], [5498, -8.784212], [8658, -8.815466], [26796, -8.83194], [1161, -8.969307], [5481, -8.972822], [75361, -9.108768], [69734, -9.144423], [1995, -9.164019], [26604, -9.188223], [86343, -9.204714], [28800, -9.207237], [125920, -9.226054], [14031, -9.290475], [64012, -9.379751], [4711, -9.382734], [19246, -9.388523], [5501, -9.390158], [995, -9.402854], [72733, -9.461972], [14856, -9.494097], [13919, -9.523202], [14600, -9.531092], [24081, -9.560127], [86972, -9.573587], [7792, -9.664782], [3754, -9.736822], [36217, -9.741436], [2420, -9.771696], [1819, -9.812759], [52951, -9.872839], [4595, -9.875267], [67089, -9.92732], [33680, -9.9505], [4063, -9.958806], [14386, -9.977421], [2929, -9.989138], [19829, -10.000397], [6917, -10.014797], [22090, -10.020117], [5240, -10.040899], [4259, -10.057371], [1560, -10.071747], [726, -10.089074], [54387, -10.160756], [68820, -10.180443], [92867, -10.208489], [1788, -10.210854], [10699, -10.216772], [27131, -10.22189], [3515, -10.225208], [15109, -10.238218], [8764, -10.260553], [32405, -10.264578], [9598, -10.289604], [16605, -10.304556], [5432, -10.312548], [19266, -10.315547], [2996, -10.315715], [12999, -10.349171], [14173, -10.380568], [14395, -10.385048], [28346, -10.389174]], "logprob_of_token": -7.051476, "top1_top2_margin": 1.385459, "top6_top7_margin": 0.103009}, {"gen_index": 23, "token": 622, "top": [[6547, -0.001622], [121222, -7.229407], [9255, -9.022068], [9598, -9.459701], [14205, -9.589561], [286, -9.624021], [14346, -10.02611], [124214, -10.434138], [7252, -10.457505], [14476, -10.579583], [33029, -10.666707], [1819, -10.941691], [3547, -11.500896], [2322, -11.54901], [3395, -11.565221], [13085, -11.621345], [9431, -11.700809], [622, -11.716695], [75361, -11.769848], [5216, -11.79188], [25326, -11.848645], [5763, -11.915858], [279, -12.040136], [22130, -12.236167], [19664, -12.29412], [35038, -12.309829], [23162, -12.403289], [14232, -12.518264], [6662, -12.566419], [2329, -12.718736], [4098, -12.743533], [1874, -12.77184], [7847, -12.791244], [8658, -12.846805], [14197, -13.003641], [3688, -13.008497], [25019, -13.014445], [11793, -13.031287], [2107, -13.143697], [41079, -13.168423], [25127, -13.201944], [14514, -13.20477], [43035, -13.224275], [61645, -13.230577], [98459, -13.291195], [7532, -13.311041], [32331, -13.321253], [60145, -13.332086], [54901, -13.333795], [1827, -13.36833], [27705, -13.435789], [6837, -13.459917], [4711, -13.46013], [14603, -13.473168], [54787, -13.521182], [44, -13.523681], [8382, -13.552573], [15437, -13.560162], [3388, -13.577998], [15967, -13.599455], [262, -13.618171], [22257, -13.686652], [104888, -13.698615], [4103, -13.699205], [16328, -13.710855], [3300, -13.729022], [4551, -13.781121], [12958, -13.790152], [5323, -13.808969], [32878, -13.813269], [14781, -13.834163], [9547, -13.847442], [33018, -13.8518], [15364, -13.87741], [17926, -14.003835], [34568, -14.007756], [13015, -14.010945], [26836, -14.043517], [1995, -14.060199], [30191, -14.062062], [7367, -14.064292], [4536, -14.076213], [59686, -14.089949], [8734, -14.098969], [5501, -14.108308], [3819, -14.117222], [836, -14.128948], [17653, -14.136706], [16406, -14.152221], [9123, -14.154986], [17111, -14.155142], [8983, -14.186057], [2821, -14.202277], [127800, -14.2226], [6170, -14.242908], [43066, -14.250497], [6271, -14.255574], [6755, -14.260859], [3938, -14.263488], [19829, -14.2657]], "logprob_of_token": -11.716695, "top1_top2_margin": 7.227785, "top6_top7_margin": 0.402089}, {"gen_index": 24, "token": 262, "top": [[622, -0.001698], [2457, -6.949277], [279, -8.208735], [286, -9.005898], [2288, -9.673425], [6791, -10.520643], [834, -10.713753], [7789, -10.75165], [120007, -10.766848], [327, -10.855777], [63, -10.973066], [502, -11.445329], [766, -11.915065], [44, -12.064709], [47, -12.086419], [735, -12.279586], [467, -12.435549], [10406, -12.452138], [46, -12.504682], [4518, -12.640753], [3688, -12.849178], [310, -12.920697], [7692, -13.076327], [121222, -13.123612], [936, -13.262661], [262, -13.314804], [120022, -13.34907], [379, -13.364269], [8775, -13.541885], [2625, -13.580469], [717, -13.607463], [258, -13.622087], [1275, -13.677001], [45, -13.682507], [3583, -13.742102], [9255, -13.746156], [474, -13.78322], [13438, -13.850444], [5240, -13.941355], [32, -13.947886], [1155, -14.003068], [318, -14.006231], [393, -14.011643], [1225, -14.036661], [120016, -14.058891], [4529, -14.060169], [42102, -14.089718], [2769, -14.096539], [275, -14.153852], [739, -14.248017], [5639, -14.330166], [75361, -14.337173], [745, -14.349752], [1765, -14.442821], [58, -14.459646], [6030, -14.482654], [28872, -14.52174], [685, -14.525744], [6380, -14.632563], [1744, -14.642632], [7252, -14.736254], [59, -14.74074], [589, -14.750648], [23132, -14.776727], [307, -14.811818], [3660, -14.858339], [1444, -14.877596], [15132, -14.878365], [1043, -14.899142], [17831, -14.909927], [1790, -14.928993], [1112, -14.971479], [5274, -14.994326], [11234, -15.022379], [2602, -15.036076], [1921, -15.046885], [763, -15.115683], [1840, -15.151157], [938, -15.154653], [2362, -15.156153], [777, -15.184086], [799, -15.208321], [4080, -15.224688], [33748, -15.259319], [900, -15.279277], [115, -15.287391], [7060, -15.297465], [14153, -15.313663], [1210, -15.32309], [2642, -15.347225], [3756, -15.369913], [4257, -15.380077], [13019, -15.41452], [120410, -15.431918], [14667, -15.459031], [12158, -15.493287], [861, -15.500667], [7847, -15.502111], [1410, -15.513396], [14188, -15.53166]], "logprob_of_token": -13.314804, "top1_top2_margin": 6.947579, "top6_top7_margin": 0.19311}, {"gen_index": 25, "token": 7252, "top": [[262, -0.027018], [5240, -3.699555], [28872, -7.581914], [7252, -8.273125], [67370, -8.309011], [327, -8.482334], [75361, -8.843413], [565, -10.053475], [938, -10.36882], [37270, -10.648089], [1283, -10.769108], [16424, -11.008794], [3327, -11.040519], [22130, -11.116619], [8615, -11.448766], [18462, -11.457025], [41875, -11.586907], [3465, -11.61123], [6131, -11.681367], [43425, -11.721244], [900, -11.855637], [941, -11.917171], [25997, -12.006572], [523, -12.107732], [26103, -12.121846], [4955, -12.128006], [3326, -12.207886], [597, -12.218455], [10829, -12.24451], [22225, -12.413134], [54901, -12.43524], [120007, -12.517032], [261, -12.545594], [947, -12.5682], [4283, -12.588119], [8207, -12.892196], [1977, -12.941074], [1862, -12.948531], [393, -12.979131], [6619, -12.981837], [37112, -13.020787], [43662, -13.045769], [22526, -13.066277], [1744, -13.094223], [13748, -13.096408], [54482, -13.119811], [543, -13.166317], [286, -13.177693], [24970, -13.192121], [36758, -13.231394], [468, -13.236625], [17203, -13.26073], [15368, -13.268726], [4549, -13.29708], [3312, -13.2981], [99932, -13.298705], [44, -13.305645], [19246, -13.350165], [8546, -13.355971], [1739, -13.374203], [2213, -13.395989], [4203, -13.469728], [2807, -13.492894], [8215, -13.514583], [17133, -13.519467], [23670, -13.520257], [762, -13.540525], [13447, -13.585046], [8574, -13.595654], [32, -13.663239], [103219, -13.663962], [20624, -13.70869], [966, -13.732388], [22804, -13.780855], [1776, -13.790257], [10416, -13.802893], [30460, -13.822875], [14856, -13.855854], [6392, -13.868314], [502, -13.875393], [1578, -13.878959], [58630, -13.889423], [24328, -13.900361], [59540, -13.920621], [113022, -13.921218], [9255, -13.927775], [9071, -14.004676], [120022, -14.016916], [2986, -14.026128], [5345, -14.043676], [10347, -14.050611], [6905, -14.081376], [14871, -14.092504], [16694, -14.094047], [6622, -14.117594], [1086, -14.12079], [29808, -14.132849], [45, -14.133484], [106198, -14.158202], [43035, -14.196762]], "logprob_of_token": -8.273125, "top1_top2_margin": 3.672537, "top6_top7_margin": 0.361079}, {"gen_index": 26, "token": 13919, "top": [[7252, -0.159213], [28872, -1.98572], [22130, -5.592571], [523, -7.477071], [37112, -7.584695], [5240, -7.775342], [36758, -8.06198], [8615, -8.245116], [25997, -8.43944], [8382, -8.804326], [22225, -8.833325], [75361, -8.859969], [2107, -8.959693], [1920, -9.046829], [13919, -9.273496], [9255, -9.317203], [10829, -9.318578], [50394, -9.480857], [2420, -9.702903], [8207, -9.801591], [59342, -9.836832], [113022, -9.965409], [21690, -10.006106], [26758, -10.075959], [3312, -10.150483], [5763, -10.19298], [114279, -10.509243], [43035, -10.540895], [103219, -10.559673], [2807, -10.561137], [38337, -10.574784], [4881, -10.702704], [106450, -10.790063], [23439, -10.796703], [3465, -10.836081], [85415, -10.876412], [106433, -10.901046], [14871, -10.922898], [106631, -10.937215], [5259, -10.957153], [18813, -10.983764], [4305, -10.993992], [1366, -11.035322], [54901, -11.059417], [37701, -11.080911], [61966, -11.180974], [89947, -11.222484], [14232, -11.232596], [48189, -11.236983], [2962, -11.242965], [69722, -11.277078], [1283, -11.279464], [1389, -11.295758], [11240, -11.307633], [9593, -11.328721], [83833, -11.392581], [3666, -11.397669], [6662, -11.406425], [119232, -11.406531], [126108, -11.407863], [6817, -11.433177], [51992, -11.495568], [13243, -11.566523], [22070, -11.594778], [43933, -11.61089], [84803, -11.634419], [35038, -11.650983], [30294, -11.654603], [67370, -11.664035], [121172, -11.671457], [106198, -11.679598], [41875, -11.699132], [1937, -11.705468], [48168, -11.770865], [5737, -11.775123], [14856, -11.791635], [14181, -11.805285], [52424, -11.809443], [12813, -11.830195], [126091, -11.833695], [72755, -11.838145], [18242, -11.860181], [5521, -11.920912], [4960, -11.936242], [23441, -11.94604], [11703, -11.963822], [123539, -11.96872], [11408, -11.985393], [34140, -11.986055], [81125, -12.002656], [12200, -12.005666], [16424, -12.02241], [17111, -12.023211], [20164, -12.026828], [30962, -12.082517], [122538, -12.117301], [1311, -12.135525], [947, -12.15144], [4338, -12.151721], [39017, -12.190726]], "logprob_of_token": -9.273496, "top1_top2_margin": 1.826507, "top6_top7_margin": 0.286638}, {"gen_index": 27, "token": 37112, "top": [[13919, -0.000335], [9255, -8.499598], [28872, -10.582454], [35330, -10.716779], [52684, -10.896177], [57501, -11.8436], [9728, -12.148711], [37112, -12.329112], [16399, -12.360234], [2807, -12.421378], [7252, -13.449159], [22130, -13.668357], [5002, -13.772264], [32019, -13.775424], [2420, -13.901881], [75361, -13.935414], [10259, -14.022222], [41669, -14.040374], [21690, -14.050071], [9593, -14.063621], [89128, -14.072176], [59342, -14.07879], [25997, -14.257514], [12924, -14.386155], [36758, -14.404061], [11094, -14.555675], [10829, -14.686269], [10884, -14.894309], [38337, -14.917313], [22090, -14.927858], [30332, -14.958726], [54901, -14.962808], [69505, -15.119686], [125920, -15.152133], [3336, -15.216359], [17003, -15.266724], [5690, -15.296078], [20291, -15.3466], [13232, -15.364227], [13892, -15.37623], [3960, -15.409727], [84483, -15.478715], [7943, -15.505242], [11710, -15.532954], [18363, -15.533458], [66111, -15.551078], [8615, -15.562274], [3465, -15.568936], [5234, -15.617749], [85056, -15.627158], [22212, -15.644412], [36618, -15.672553], [23280, -15.715954], [102982, -15.720491], [126055, -15.728054], [23688, -15.747524], [35358, -15.753743], [87340, -15.756429], [22070, -15.794318], [24952, -15.80808], [19412, -15.814931], [63442, -15.849627], [11742, -15.857837], [6993, -15.866549], [20669, -15.903045], [6480, -15.959331], [25001, -16.030897], [9379, -16.1374], [25748, -16.153793], [16299, -16.17178], [13243, -16.203255], [39017, -16.222851], [6226, -16.251202], [11240, -16.254385], [24776, -16.255611], [6209, -16.268167], [45590, -16.284178], [15646, -16.286283], [14406, -16.298782], [6017, -16.307215], [2911, -16.321896], [5240, -16.326576], [6622, -16.328503], [22642, -16.328686], [18113, -16.331825], [26650, -16.332506], [19311, -16.337214], [50774, -16.341303], [62453, -16.348515], [120007, -16.373075], [43014, -16.380831], [65180, -16.384476], [18204, -16.399487], [20223, -16.413906], [1920, -16.450451], [37061, -16.45356], [8382, -16.461777], [63304, -16.475655], [73338, -16.480446], [32731, -16.484371]], "logprob_of_token": -12.329112, "top1_top2_margin": 8.499263, "top6_top7_margin": 0.305111}, {"gen_index": 29, "token": 75361, "top": [[46, -0.076381], [275, -3.525598], [63, -3.595031], [314, -4.614439], [766, -6.248385], [286, -6.711029], [44, -6.935647], [120007, -7.163888], [936, -7.991559], [1043, -8.304433], [460, -9.104266], [467, -9.466165], [120016, -9.620677], [523, -9.658748], [59, -9.741765], [120399, -9.915866], [120022, -10.433227], [622, -10.537031], [735, -10.85402], [28872, -10.91433], [120021, -11.08657], [120002, -11.105659], [3863, -11.114292], [25997, -11.209675], [1275, -11.258006], [7252, -11.288951], [120018, -11.628458], [120001, -11.647561], [120739, -11.722815], [58, -11.742146], [120151, -11.808661], [33, -11.819861], [36209, -11.824731], [7510, -11.859605], [327, -11.950027], [103784, -11.969862], [4137, -11.973323], [67581, -12.010489], [103842, -12.080712], [745, -12.104064], [262, -12.124587], [6000, -12.13478], [5240, -12.180856], [10, -12.182884], [4375, -12.202439], [120230, -12.246426], [22278, -12.291635], [14188, -12.352029], [310, -12.390424], [263, -12.426787], [502, -12.477753], [1829, -12.482294], [1765, -12.509877], [120000, -12.523627], [279, -12.533175], [1112, -12.627165], [40, -12.654693], [1444, -12.678261], [48237, -12.731788], [20758, -12.744559], [14153, -12.760443], [393, -12.790112], [65, -12.798415], [75361, -12.850134], [120103, -12.857041], [589, -12.872944], [103219, -12.91553], [51992, -12.965167], [120099, -12.966618], [543, -12.998701], [120047, -13.07747], [18813, -13.106358], [32, -13.106952], [44455, -13.130267], [22225, -13.132434], [4731, -13.157666], [13594, -13.160571], [121146, -13.196625], [1366, -13.197], [47, -13.198676], [14825, -13.218054], [6391, -13.301357], [10829, -13.301417], [834, -13.337586], [1921, -13.374768], [123745, -13.410542], [2457, -13.435995], [7162, -13.446363], [22247, -13.446399], [1988, -13.455707], [120140, -13.457675], [18242, -13.458107], [33676, -13.47144], [1474, -13.495614], [34157, -13.502339], [4265, -13.504253], [799, -13.53861], [3688, -13.55418], [4529, -13.590953], [120048, -13.599177]], "logprob_of_token": -12.850134, "top1_top2_margin": 3.449217, "top6_top7_margin": 0.224619}, {"gen_index": 30, "token": 735, "top": [[75361, -0.026837], [543, -4.501348], [3960, -6.070168], [120014, -6.842396], [14896, -7.239886], [20733, -7.613883], [6693, -7.701883], [1231, -7.736896], [1689, -7.747011], [1905, -7.815725], [1914, -8.146971], [717, -8.277392], [76115, -8.590307], [669, -8.596322], [5240, -8.607759], [34122, -8.780816], [5775, -8.81206], [8067, -8.900056], [611, -8.92734], [63585, -8.984167], [7252, -9.044082], [6455, -9.096286], [58209, -9.105193], [4759, -9.111259], [120004, -9.195861], [1194, -9.250171], [1336, -9.271703], [3780, -9.411791], [11533, -9.471109], [120022, -9.519171], [23441, -9.607635], [4361, -9.735032], [1988, -9.735995], [1692, -9.815139], [2560, -9.845079], [28872, -9.903437], [14161, -9.904933], [32, -9.912066], [8758, -10.027923], [15934, -10.032145], [5513, -10.068789], [476, -10.092566], [742, -10.094266], [3463, -10.095566], [6372, -10.116388], [7510, -10.215965], [97820, -10.332292], [766, -10.335542], [2284, -10.37451], [5274, -10.389588], [120103, -10.418763], [104647, -10.439211], [68029, -10.466613], [6814, -10.487346], [1010, -10.511128], [14147, -10.547552], [20321, -10.611609], [17299, -10.613188], [4408, -10.706813], [8009, -10.708966], [735, -10.764733], [127906, -10.769633], [4902, -10.781863], [64119, -10.788363], [4246, -10.820554], [6104, -10.825738], [24507, -10.832446], [16545, -10.832496], [29296, -10.838959], [2861, -10.861721], [4001, -10.876921], [106198, -10.896115], [7302, -10.900173], [523, -10.907712], [6131, -10.909053], [7643, -10.911454], [28484, -10.914317], [9980, -10.954038], [7433, -10.984343], [25808, -11.020165], [7339, -11.058854], [3872, -11.085088], [21051, -11.117802], [18757, -11.143999], [8546, -11.157207], [6123, -11.16057], [55034, -11.167664], [49123, -11.168297], [21690, -11.170562], [3516, -11.198656], [1283, -11.205004], [91515, -11.207016], [2865, -11.216135], [67370, -11.222722], [7189, -11.247763], [1254, -11.261437], [1048, -11.262242], [37061, -11.273623], [5686, -11.300697], [72735, -11.314891]], "logprob_of_token": -10.764733, "top1_top2_margin": 4.47451, "top6_top7_margin": 0.088}, {"gen_index": 31, "token": 262, "top": [[735, -0.083692], [919, -3.210581], [378, -3.327932], [589, -6.427649], [4278, -7.297641], [11201, -7.758871], [976, -9.119777], [1819, -9.614036], [37296, -9.739966], [44, -9.750373], [14598, -10.179275], [11319, -10.323264], [1270, -10.667279], [476, -10.709651], [10471, -10.735827], [52776, -10.834723], [120007, -10.837949], [617, -10.877792], [14380, -10.912902], [13032, -10.920392], [286, -10.938586], [4088, -11.025236], [2347, -11.262289], [58, -11.362119], [622, -11.412871], [16740, -11.431609], [662, -11.447762], [19701, -11.49449], [1656, -11.517272], [439, -11.561133], [766, -11.637403], [13636, -11.63869], [10852, -11.647842], [2459, -11.650371], [66165, -11.672027], [14439, -11.740077], [330, -11.794583], [1064, -11.813692], [1958, -11.894931], [13648, -11.913562], [1812, -11.916541], [4617, -11.917523], [528, -11.936535], [1309, -11.969158], [830, -12.011172], [7330, -12.11312], [529, -12.123429], [26216, -12.236199], [34643, -12.258256], [21925, -12.286657], [20615, -12.34106], [34705, -12.341094], [6117, -12.342561], [4440, -12.360866], [21884, -12.371665], [2286, -12.386168], [46, -12.433921], [568, -12.439473], [824, -12.440886], [4884, -12.462888], [9169, -12.46674], [18882, -12.517614], [39, -12.537242], [8140, -12.537441], [262, -12.618573], [13493, -12.624997], [1275, -12.663916], [14896, -12.680121], [11035, -12.692479], [120022, -12.696683], [4711, -12.705502], [8150, -12.723576], [8944, -12.729552], [1030, -12.731281], [2879, -12.734198], [4032, -12.750222], [24003, -12.774072], [120016, -12.779304], [11317, -12.780118], [31445, -12.793929], [6513, -12.859633], [5415, -12.883881], [1220, -12.912896], [6547, -12.934105], [12195, -12.956117], [20748, -12.956191], [9443, -12.957017], [63, -12.96012], [12745, -12.985286], [4384, -13.019094], [3865, -13.046405], [32578, -13.0684], [25005, -13.071739], [10757, -13.081594], [32, -13.116724], [18227, -13.119959], [60206, -13.142271], [13044, -13.1444], [279, -13.167918], [5598, -13.171693]], "logprob_of_token": -12.618573, "top1_top2_margin": 3.126889, "top6_top7_margin": 1.360906}]}, {"prompt": "Wissen ist Macht, aber Zeit ist Geld", "input_ids": [81623, 2459, 18680, 44, 3504, 2042, 2459, 4771], "generated_ids": [46, 4246, 44, 2042, 735, 2973, 44, 1409, 44, 1584, 735, 2973, 44, 1409, 44, 1584, 735, 2973, 44, 1409, 44, 1584, 735, 2973, 44, 1409, 44, 1584, 735, 2973, 44, 1409], "rows": [{"gen_index": 3, "token": 2042, "top": [[44, -2.738184], [1410, -2.740728], [2042, -2.844477], [94680, -3.063647], [353, -3.224506], [3754, -3.27684], [12629, -3.367055], [2790, -3.492308], [1584, -3.54508], [19239, -3.720957], [4771, -3.734951], [120007, -3.758406], [488, -3.790329], [70491, -3.862291], [7314, -3.89022], [1523, -3.973233], [836, -4.086775], [21545, -4.112719], [41672, -4.194186], [6326, -4.245938], [2093, -4.278549], [1213, -4.368668], [1592, -4.426614], [6443, -4.495652], [3654, -4.55477], [6190, -4.683594], [12378, -4.857392], [26992, -4.907596], [11401, -4.913013], [32, -5.1148], [527, -5.189974], [120895, -5.197505], [18625, -5.206243], [9916, -5.326788], [2973, -5.362578], [1044, -5.436369], [30230, -5.442472], [22182, -5.476003], [27084, -5.483392], [3384, -5.516566], [3565, -5.564393], [669, -5.567889], [825, -5.571354], [2459, -5.599298], [1409, -5.663372], [465, -5.782151], [4165, -5.880034], [6727, -5.932137], [2225, -5.968126], [5610, -6.033185], [1865, -6.069729], [10304, -6.111847], [18522, -6.11832], [3918, -6.161833], [50345, -6.179649], [4122, -6.188768], [24903, -6.203147], [965, -6.204878], [1064, -6.222486], [20812, -6.225089], [28758, -6.232221], [23100, -6.250176], [12094, -6.349276], [1626, -6.435416], [14794, -6.451655], [3974, -6.468572], [117246, -6.522134], [346, -6.544731], [3650, -6.572835], [18639, -6.583447], [99103, -6.651065], [14225, -6.658227], [5496, -6.661016], [1270, -6.675463], [29571, -6.726398], [622, -6.727809], [11698, -6.743321], [29353, -6.759208], [559, -6.784481], [39027, -6.803251], [1914, -6.811112], [56464, -6.819397], [27888, -6.851674], [74484, -6.870726], [4703, -6.926023], [9122, -6.931817], [18226, -6.946381], [81519, -6.988723], [58, -7.004019], [21597, -7.005795], [14154, -7.104929], [453, -7.151613], [120022, -7.156745], [36066, -7.160604], [25928, -7.171511], [6501, -7.198334], [44615, -7.230016], [4246, -7.247912], [12579, -7.265742], [34972, -7.294684]], "logprob_of_token": -2.844477, "top1_top2_margin": 0.002544, "top6_top7_margin": 0.090215}, {"gen_index": 5, "token": 2973, "top": [[735, -0.162877], [2459, -2.045914], [1679, -4.357117], [318, -6.869848], [576, -6.955207], [3527, -7.002783], [34858, -7.473354], [7826, -7.839483], [20787, -8.588899], [919, -9.300315], [907, -9.55433], [59405, -9.648099], [2973, -9.660784], [34719, -9.776534], [622, -9.806546], [513, -9.869106], [24408, -9.86918], [6727, -9.876462], [836, -9.927604], [286, -10.016419], [679, -10.052243], [20773, -10.104536], [8157, -10.117787], [29208, -10.138421], [22644, -10.144718], [21545, -10.153357], [346, -10.196698], [1204, -10.250533], [439, -10.281573], [14896, -10.285869], [1064, -10.297009], [44, -10.329166], [379, -10.398973], [59335, -10.425565], [589, -10.480775], [1410, -10.482438], [46, -10.508067], [102179, -10.548906], [54769, -10.604173], [18754, -10.612885], [4384, -10.632913], [25733, -10.669769], [7222, -10.693582], [14168, -10.70962], [922, -10.743093], [476, -10.781972], [1584, -10.80959], [4771, -10.812581], [1270, -10.831135], [502, -10.844245], [7770, -10.845655], [10244, -10.887755], [614, -10.905239], [61, -10.908005], [32, -10.954573], [824, -10.989194], [4088, -11.008136], [279, -11.05294], [9488, -11.079329], [420, -11.089393], [36533, -11.10336], [33, -11.119278], [56464, -11.145045], [378, -11.181288], [58, -11.182582], [79396, -11.18901], [120007, -11.198131], [41026, -11.247607], [1687, -11.258166], [12717, -11.258943], [968, -11.260406], [1213, -11.338956], [1826, -11.343206], [2625, -11.358275], [35257, -11.36468], [7080, -11.40138], [2286, -11.429946], [7732, -11.433543], [47923, -11.434978], [127650, -11.485475], [11308, -11.502725], [34324, -11.51109], [13728, -11.53668], [766, -11.551669], [121817, -11.554679], [32049, -11.561848], [11265, -11.584836], [2042, -11.59971], [12243, -11.618762], [29353, -11.634005], [35137, -11.644044], [115, -11.649251], [1200, -11.649424], [2790, -11.684892], [44615, -11.714738], [65197, -11.734768], [518, -11.738691], [5947, -11.757569], [14242, -11.773328], [1309, -11.788901]], "logprob_of_token": -9.660784, "top1_top2_margin": 1.883037, "top6_top7_margin": 0.470571}, {"gen_index": 6, "token": 44, "top": [[2973, -0.235647], [20142, -2.648251], [1584, -3.569356], [4771, -3.880639], [279, -4.278219], [5496, -4.738937], [3647, -5.175553], [262, -5.273962], [1410, -5.719247], [2468, -5.894859], [3142, -5.979664], [941, -6.114785], [502, -6.170293], [12915, -6.501475], [18710, -6.582561], [6464, -6.718298], [14272, -7.233566], [3937, -7.571777], [2839, -7.584023], [1333, -7.597586], [9833, -7.696623], [762, -7.702713], [4205, -7.715235], [836, -7.768977], [2042, -7.8163], [8608, -7.891367], [3368, -7.897479], [44, -8.066649], [37690, -8.085648], [1840, -8.11059], [2613, -8.130696], [51770, -8.142291], [120007, -8.196644], [1319, -8.230567], [2302, -8.271921], [2213, -8.283481], [4621, -8.320737], [7116, -8.383247], [32, -8.447288], [1755, -8.52791], [84282, -8.55367], [2896, -8.560657], [766, -8.628952], [46, -8.64532], [2272, -8.652603], [41084, -8.685627], [41026, -8.687684], [1409, -8.752931], [68408, -8.76615], [4689, -8.802994], [2377, -8.832725], [3658, -8.836539], [110546, -8.873868], [22777, -8.892995], [48764, -8.921218], [19313, -8.925713], [1903, -8.931342], [735, -8.948665], [4700, -8.951221], [828, -8.968343], [5888, -8.989783], [8263, -9.005141], [3918, -9.046622], [3326, -9.057463], [4298, -9.116107], [120022, -9.153916], [8536, -9.161095], [89678, -9.211785], [119815, -9.226942], [7833, -9.236102], [622, -9.246502], [14052, -9.257989], [527, -9.259408], [117113, -9.280334], [116957, -9.288814], [113480, -9.29815], [15853, -9.304206], [2403, -9.344967], [3166, -9.356345], [318, -9.375694], [1972, -9.37778], [2157, -9.384273], [15117, -9.402706], [2690, -9.406161], [4315, -9.433694], [12107, -9.44445], [11698, -9.451476], [7270, -9.456808], [1627, -9.557395], [18965, -9.632065], [4917, -9.635239], [2150, -9.649658], [6030, -9.666654], [7411, -9.683631], [1688, -9.699094], [1591, -9.73458], [5062, -9.739421], [1662, -9.745667], [39, -9.748717], [2117, -9.75776]], "logprob_of_token": -8.066649, "top1_top2_margin": 2.412604, "top6_top7_margin": 0.436616}, {"gen_index": 7, "token": 1409, "top": [[44, -0.597928], [46, -1.012313], [275, -3.426528], [33, -3.99276], [735, -4.38907], [1409, -5.451666], [314, -5.465394], [63, -5.68256], [286, -5.716377], [120007, -6.217464], [2519, -6.551296], [936, -7.499591], [4679, -8.198721], [779, -8.368361], [1410, -8.587236], [1043, -8.686703], [622, -8.744785], [1914, -8.779438], [1584, -8.8365], [58, -9.186533], [7331, -9.212805], [2973, -9.312796], [4384, -9.334089], [59, -9.815775], [420, -10.065134], [120000, -10.150703], [7148, -10.16136], [32, -10.190821], [766, -10.285496], [4137, -10.524317], [120016, -10.595957], [4412, -10.636847], [1988, -10.659859], [318, -10.682335], [263, -10.694633], [1829, -10.70425], [120022, -10.70632], [7510, -10.710972], [379, -10.805538], [4619, -10.812935], [393, -10.83206], [330, -10.839966], [74254, -10.848772], [460, -10.858995], [120001, -10.938873], [476, -10.949739], [14188, -10.966307], [10, -10.989372], [17870, -11.019421], [2459, -11.0807], [14153, -11.117182], [1275, -11.192631], [36209, -11.226543], [3688, -11.236155], [3368, -11.28307], [1765, -11.306726], [14052, -11.31151], [4554, -11.326761], [2362, -11.337858], [120003, -11.374763], [1333, -11.398256], [5496, -11.417063], [988, -11.444208], [745, -11.473192], [568, -11.505526], [18390, -11.529812], [327, -11.557272], [763, -11.558222], [30538, -11.566004], [120008, -11.599152], [589, -11.686701], [103784, -11.698473], [19078, -11.701941], [8279, -11.707584], [262, -11.716721], [19043, -11.739103], [4246, -11.754686], [123367, -11.765623], [14896, -11.809296], [8157, -11.816484], [836, -11.824839], [9980, -11.82501], [1407, -11.841949], [5071, -11.845404], [1656, -11.849554], [527, -11.877665], [120468, -11.877966], [120002, -11.88743], [467, -11.91346], [378, -11.924456], [120399, -11.981659], [106108, -12.02976], [5274, -12.032227], [1689, -12.033705], [3756, -12.044079], [34, -12.093416], [120021, -12.10194], [2773, -12.109203], [8545, -12.138271], [2042, -12.139544]], "logprob_of_token": -5.451666, "top1_top2_margin": 0.414386, "top6_top7_margin": 0.013727}, {"gen_index": 9, "token": 1584, "top": [[44, -0.513808], [527, -1.939202], [1584, -1.956355], [1523, -3.192963], [12629, -4.38946], [2973, -4.57015], [825, -4.747238], [5496, -5.637424], [8545, -5.655802], [9916, -5.73044], [669, -5.919326], [3117, -5.923891], [353, -6.253684], [1213, -6.379127], [1765, -6.781415], [2042, -6.792536], [453, -6.841718], [1592, -6.908116], [1806, -7.672348], [3326, -7.802923], [836, -7.850969], [2093, -7.874402], [4057, -7.958159], [488, -8.109987], [14412, -8.110666], [1633, -8.23389], [716, -8.238264], [3924, -8.278359], [3754, -8.278588], [20142, -8.36582], [14177, -8.400896], [46, -8.466253], [120007, -8.485133], [3594, -8.51294], [1626, -8.667697], [2219, -8.679406], [14015, -8.755486], [4037, -8.769373], [3384, -8.856633], [1409, -8.874821], [2468, -8.891196], [1736, -8.914444], [11935, -8.951829], [5888, -8.957587], [3611, -8.965787], [1435, -9.04079], [3368, -9.059341], [7615, -9.150912], [1026, -9.167274], [1064, -9.195797], [2622, -9.220486], [1333, -9.223554], [4194, -9.289065], [1679, -9.290523], [1128, -9.377024], [74484, -9.392194], [1324, -9.415811], [4731, -9.448685], [2157, -9.526813], [3737, -9.579377], [2799, -9.584409], [2213, -9.586896], [3671, -9.592376], [2773, -9.639949], [8206, -9.651317], [1194, -9.665016], [5610, -9.66606], [7770, -9.67727], [5879, -9.712979], [1812, -9.721559], [1744, -9.722973], [4771, -9.750668], [9628, -9.76539], [2218, -9.771837], [7753, -9.803197], [2246, -9.82809], [43660, -9.832692], [14792, -9.848506], [17393, -9.857041], [327, -9.862944], [762, -9.87669], [4700, -9.87708], [11689, -9.882195], [3974, -9.956939], [3129, -9.969975], [622, -9.978666], [318, -9.98099], [799, -9.984654], [2302, -9.99261], [3624, -9.996108], [4959, -9.99661], [1270, -10.003459], [763, -10.010354], [766, -10.022471], [16981, -10.059451], [529, -10.115966], [5402, -10.132306], [14529, -10.134097], [14242, -10.159974], [13789, -10.187131]], "logprob_of_token": -1.956355, "top1_top2_margin": 1.425393, "top6_top7_margin": 0.177088}, {"gen_index": 11, "token": 2973, "top": [[735, -0.017848], [589, -6.320194], [1679, -6.71851], [1064, -7.292925], [44, -7.387665], [7732, -7.504636], [2973, -8.088585], [1270, -8.468804], [20787, -8.646387], [919, -8.667753], [1584, -8.678312], [46, -8.691216], [34858, -8.820711], [476, -8.896261], [568, -8.969608], [22644, -9.05859], [318, -9.090445], [576, -9.166777], [9916, -9.184894], [120801, -9.196421], [1633, -9.305593], [59405, -9.329098], [622, -9.367081], [1213, -9.442757], [14177, -9.487005], [330, -9.497478], [8157, -9.5028], [7770, -9.547907], [1333, -9.553007], [836, -9.577489], [2459, -9.57846], [12195, -9.600199], [3924, -9.633655], [527, -9.63805], [41026, -9.692268], [61, -9.748308], [262, -9.76457], [4384, -9.768093], [18754, -9.816755], [617, -9.844201], [12243, -9.923793], [378, -9.954943], [120625, -9.958023], [3527, -9.984477], [35211, -10.014124], [286, -10.0151], [36533, -10.048065], [716, -10.049978], [12629, -10.115257], [14896, -10.136973], [72836, -10.157998], [57125, -10.173342], [824, -10.180651], [12717, -10.212545], [4037, -10.258436], [1656, -10.273015], [33417, -10.289755], [2362, -10.31481], [21681, -10.357414], [3671, -10.374383], [353, -10.374414], [3117, -10.381041], [14188, -10.381971], [120007, -10.390862], [32, -10.391398], [830, -10.405106], [2117, -10.417488], [52269, -10.453178], [10244, -10.475185], [6581, -10.49791], [528, -10.521381], [1409, -10.534764], [379, -10.535788], [120670, -10.55416], [14419, -10.559885], [1323, -10.574537], [40882, -10.603115], [11308, -10.627645], [766, -10.629689], [14847, -10.631833], [825, -10.637166], [20773, -10.647337], [23134, -10.689372], [73707, -10.713097], [54769, -10.731043], [58, -10.754845], [1829, -10.768806], [2213, -10.772499], [41399, -10.810034], [18126, -10.813229], [3679, -10.82264], [121817, -10.841072], [3326, -10.841288], [439, -10.858555], [4700, -10.866136], [33275, -10.882283], [2272, -10.886295], [1902, -10.907203], [25835, -10.939346], [502, -10.954397]], "logprob_of_token": -8.088585, "top1_top2_margin": 6.302346, "top6_top7_margin": 0.583949}, {"gen_index": 12, "token": 44, "top": [[2973, -0.077282], [12915, -4.089171], [1584, -4.122693], [3647, -4.700113], [18710, -5.397539], [279, -5.617806], [2468, -6.624899], [14272, -6.706903], [2157, -6.961578], [4700, -6.984038], [262, -7.058962], [3142, -7.244162], [4621, -7.366251], [4205, -7.373131], [1755, -7.520979], [7116, -7.70481], [2302, -7.757176], [502, -7.854265], [41026, -8.061245], [22777, -8.216452], [20142, -8.323889], [3368, -8.334521], [1409, -8.411001], [7833, -8.437398], [8859, -8.44698], [4771, -8.501856], [1333, -8.59248], [4689, -8.648417], [2690, -8.709017], [3937, -8.71091], [9833, -8.759223], [44, -8.812503], [32, -8.88025], [19898, -8.931085], [941, -9.005392], [1319, -9.026977], [68408, -9.155603], [2839, -9.230462], [1410, -9.275763], [120007, -9.308083], [762, -9.33278], [5888, -9.335421], [48764, -9.350916], [7210, -9.353031], [113480, -9.396581], [18965, -9.425615], [1591, -9.427287], [13789, -9.4433], [7270, -9.451866], [2272, -9.482664], [15117, -9.494804], [17016, -9.583668], [1840, -9.590093], [3658, -9.598401], [11021, -9.626773], [2613, -9.654232], [46, -9.675926], [4315, -9.686724], [117113, -9.688146], [41084, -9.723778], [836, -9.742651], [923, -9.783698], [488, -9.787354], [2377, -9.805531], [1903, -9.837749], [5062, -9.845461], [10244, -9.855433], [2213, -9.869083], [4959, -9.898677], [4298, -9.953969], [31653, -9.959359], [828, -10.022188], [2117, -10.045054], [7770, -10.047014], [2457, -10.053905], [3918, -10.067595], [1662, -10.076391], [14231, -10.082122], [2878, -10.175572], [1093, -10.18364], [8858, -10.185132], [29344, -10.202774], [766, -10.217424], [1324, -10.217982], [15899, -10.243933], [2711, -10.288265], [27880, -10.304708], [622, -10.311057], [8263, -10.318252], [4372, -10.318367], [18967, -10.336944], [4314, -10.369154], [527, -10.392683], [8106, -10.423548], [8536, -10.428467], [3660, -10.429306], [1972, -10.429715], [20196, -10.450267], [119815, -10.484284], [3326, -10.489179]], "logprob_of_token": -8.812503, "top1_top2_margin": 4.01189, "top6_top7_margin": 1.007093}, {"gen_index": 13, "token": 1409, "top": [[44, -0.030388], [46, -4.067344], [275, -4.75624], [1409, -7.272545], [735, -7.448352], [63, -7.484184], [120007, -7.869177], [314, -8.108793], [33, -8.790432], [286, -9.874984], [59, -10.037411], [2519, -10.061598], [3368, -10.108292], [1043, -10.119948], [7331, -10.173029], [120468, -10.238767], [4384, -10.310379], [779, -10.431067], [1275, -10.570656], [58, -10.573963], [120016, -10.611306], [1914, -10.632671], [5071, -10.660819], [14188, -10.676362], [1584, -10.786716], [766, -11.073023], [936, -11.104738], [988, -11.185365], [622, -11.195145], [14153, -11.234494], [120028, -11.238966], [263, -11.292836], [1765, -11.339989], [4137, -11.387716], [1829, -11.401772], [1410, -11.410024], [19078, -11.468971], [763, -11.527694], [379, -11.547375], [18390, -11.680248], [476, -11.70047], [120022, -11.707307], [589, -11.734548], [318, -11.774401], [4412, -11.775042], [327, -11.915678], [3918, -11.944445], [1407, -11.94644], [74254, -11.974019], [32, -12.002436], [745, -12.007937], [121119, -12.039589], [467, -12.048498], [120003, -12.053063], [10, -12.058466], [120008, -12.061779], [5696, -12.117102], [1064, -12.123817], [15853, -12.146551], [14052, -12.190544], [405, -12.200218], [26530, -12.229568], [120000, -12.310648], [527, -12.382307], [1656, -12.388036], [576, -12.483343], [4554, -12.526814], [262, -12.531622], [420, -12.580499], [528, -12.630216], [502, -12.688158], [279, -12.721321], [1333, -12.73223], [12243, -12.73702], [120409, -12.74468], [4679, -12.756374], [460, -12.781404], [36209, -12.798892], [101703, -12.8134], [8545, -12.848539], [2459, -12.901438], [7510, -12.904453], [4343, -12.916546], [3326, -12.943666], [20196, -12.962265], [393, -12.977526], [919, -13.001965], [1444, -13.023528], [2213, -13.02509], [4619, -13.03895], [8157, -13.050369], [4484, -13.050743], [836, -13.061836], [120021, -13.062082], [669, -13.06832], [14792, -13.076836], [1270, -13.103583], [9980, -13.116522], [20758, -13.140287], [330, -13.143399]], "logprob_of_token": -7.272545, "top1_top2_margin": 4.036956, "top6_top7_margin": 0.384993}, {"gen_index": 15, "token": 1584, "top": [[44, -0.005469], [1584, -5.913205], [46, -8.217719], [120468, -8.271973], [120007, -8.356386], [120003, -9.74826], [5496, -9.871017], [527, -10.232157], [275, -10.394464], [2773, -10.543233], [59, -10.550352], [534, -10.694819], [2042, -10.716299], [121119, -10.81372], [3326, -10.831928], [120008, -10.86013], [3368, -10.921822], [1409, -11.026993], [988, -11.10903], [120028, -11.324149], [2973, -11.349579], [123367, -11.361564], [120409, -11.377043], [1765, -11.396342], [766, -11.499999], [8545, -11.509424], [2213, -11.572668], [286, -11.59124], [120022, -11.625789], [2468, -11.70293], [669, -11.726467], [14188, -11.732765], [120277, -11.763636], [314, -11.775572], [63, -11.776926], [405, -11.848799], [1633, -11.867551], [1333, -11.870154], [14792, -11.878956], [58, -11.881186], [120000, -11.902064], [327, -11.932261], [120501, -11.994857], [94365, -12.047237], [1410, -12.098398], [121083, -12.121067], [716, -12.139807], [4619, -12.143682], [5071, -12.149116], [745, -12.157365], [262, -12.166922], [32, -12.169418], [65268, -12.189858], [33, -12.19477], [453, -12.218905], [2302, -12.248846], [1523, -12.251144], [25945, -12.279987], [1744, -12.284737], [318, -12.302297], [8152, -12.317455], [8722, -12.32971], [2093, -12.349968], [825, -12.362711], [120016, -12.401613], [1972, -12.402463], [353, -12.46302], [120436, -12.464502], [936, -12.467979], [502, -12.496784], [120057, -12.504983], [120049, -12.588944], [941, -12.603337], [7768, -12.626371], [1435, -12.655085], [3924, -12.65522], [379, -12.665378], [1903, -12.687077], [3117, -12.703314], [29094, -12.755316], [5675, -12.770742], [21672, -12.775554], [763, -12.790457], [3918, -12.790874], [488, -12.814657], [1324, -12.840595], [4743, -12.852644], [122416, -12.862393], [735, -12.900735], [7510, -12.900835], [1806, -12.918455], [622, -12.919441], [14153, -12.923491], [18390, -12.926253], [25388, -12.927753], [2410, -12.942001], [3550, -12.969502], [4731, -12.972919], [10, -12.985322], [2403, -12.988164]], "logprob_of_token": -5.913205, "top1_top2_margin": 5.907736, "top6_top7_margin": 0.122758}, {"gen_index": 17, "token": 2973, "top": [[735, -0.003706], [7732, -8.719553], [1064, -8.764236], [44, -9.162375], [2973, -9.167271], [286, -9.262997], [46, -9.318254], [120007, -9.589394], [919, -9.631523], [330, -9.886775], [589, -9.958114], [20787, -10.048776], [4384, -10.107173], [2459, -10.150812], [476, -10.196135], [1679, -10.247509], [22644, -10.326269], [1584, -10.32719], [59405, -10.328415], [34858, -10.425879], [18754, -10.434818], [576, -10.444056], [568, -10.48539], [32, -10.549128], [1270, -10.578986], [8157, -10.614291], [35211, -10.636539], [7770, -10.638905], [72836, -10.683107], [318, -10.754187], [378, -10.764071], [622, -10.84213], [120801, -10.851049], [527, -10.960745], [262, -10.965865], [12195, -11.022753], [11308, -11.06506], [12629, -11.094289], [120022, -11.135578], [1656, -11.219772], [41026, -11.277454], [275, -11.299481], [9916, -11.300825], [439, -11.310443], [33275, -11.313004], [14896, -11.313082], [12243, -11.314111], [14177, -11.332094], [1633, -11.334441], [62024, -11.357414], [36533, -11.374081], [14188, -11.375175], [58, -11.380583], [33417, -11.438541], [528, -11.444676], [61, -11.448948], [10244, -11.51289], [824, -11.513483], [52269, -11.529901], [830, -11.533796], [73707, -11.579762], [7080, -11.614026], [1409, -11.661859], [20773, -11.667888], [279, -11.696673], [3326, -11.72608], [63, -11.765203], [21681, -11.778738], [120625, -11.856962], [3924, -11.891459], [65197, -11.903212], [34324, -11.91274], [836, -11.917277], [120000, -11.950491], [766, -11.97324], [32049, -11.977913], [120670, -12.006866], [40882, -12.042277], [379, -12.097288], [113613, -12.09745], [14419, -12.119483], [6581, -12.151497], [102698, -12.152201], [3402, -12.163968], [18126, -12.16893], [1591, -12.172516], [12717, -12.181295], [716, -12.236234], [2362, -12.242338], [2213, -12.257143], [941, -12.263426], [3679, -12.301003], [120001, -12.305496], [314, -12.319466], [1309, -12.335411], [1213, -12.378453], [353, -12.383583], [502, -12.405249], [14153, -12.408706], [5888, -12.433907]], "logprob_of_token": -9.167271, "top1_top2_margin": 8.715847, "top6_top7_margin": 0.055258}, {"gen_index": 18, "token": 44, "top": [[2973, -0.028469], [1584, -3.982863], [12915, -7.176819], [3647, -7.592798], [18710, -7.664031], [262, -7.805958], [3142, -7.936998], [14272, -8.333873], [20142, -8.375145], [502, -8.58672], [2468, -8.61052], [120007, -8.727776], [3368, -8.926491], [2302, -9.054514], [32, -9.207135], [44, -9.36359], [4205, -9.371592], [41084, -9.406263], [4771, -9.41073], [4689, -9.450537], [4700, -9.468276], [1409, -9.529093], [1755, -9.637209], [3918, -9.673656], [2157, -9.698488], [22777, -9.722189], [4621, -9.857746], [2690, -9.941943], [46, -9.950043], [41026, -9.955203], [4315, -10.017067], [1319, -10.034609], [7833, -10.044928], [279, -10.16328], [762, -10.265563], [9833, -10.299018], [3658, -10.320656], [120022, -10.337458], [7210, -10.346314], [37690, -10.37571], [1333, -10.39765], [941, -10.49169], [828, -10.505751], [1591, -10.511255], [8536, -10.568827], [3937, -10.578251], [1840, -10.591134], [1903, -10.620256], [8859, -10.623912], [2213, -10.627838], [2272, -10.679209], [2117, -10.709412], [2711, -10.714452], [923, -10.72559], [4959, -10.740792], [13789, -10.781096], [5496, -10.806052], [19898, -10.812186], [1410, -10.82308], [33274, -10.825384], [2839, -10.874628], [836, -10.922743], [19102, -10.994509], [1324, -11.003164], [113480, -11.024193], [527, -11.043082], [4314, -11.043368], [1662, -11.086781], [7770, -11.108425], [8263, -11.114516], [17016, -11.134934], [2155, -11.14534], [10244, -11.154288], [68408, -11.154895], [7208, -11.172148], [5888, -11.182382], [110546, -11.236372], [12107, -11.238323], [3467, -11.260659], [26530, -11.280807], [488, -11.302444], [11981, -11.30944], [766, -11.316472], [2377, -11.333248], [1436, -11.335098], [51770, -11.338358], [6563, -11.346292], [4647, -11.34732], [1972, -11.353254], [2608, -11.353323], [16000, -11.378966], [2944, -11.383547], [4372, -11.389561], [1688, -11.409492], [98621, -11.420111], [3166, -11.427809], [11021, -11.429881], [7116, -11.45097], [453, -11.467125], [48764, -11.47403]], "logprob_of_token": -9.36359, "top1_top2_margin": 3.954394, "top6_top7_margin": 0.13104}, {"gen_index": 19, "token": 1409, "top": [[44, -0.10879], [275, -2.990793], [46, -3.084752], [120007, -5.836138], [314, -7.276059], [63, -7.282247], [33, -7.615205], [120016, -8.045359], [1409, -8.392349], [2519, -8.820807], [735, -9.121815], [59, -9.66051], [14188, -9.731679], [1043, -9.974463], [120022, -10.174067], [1914, -10.308564], [745, -10.3539], [120468, -10.415023], [286, -10.452434], [14153, -10.523174], [121119, -10.594933], [1829, -10.642021], [120028, -10.84736], [263, -10.861922], [4137, -10.864835], [7510, -10.938948], [405, -10.975476], [5071, -11.032621], [988, -11.042512], [120021, -11.050965], [120003, -11.063783], [766, -11.073359], [58, -11.10971], [74254, -11.111486], [3368, -11.181861], [120409, -11.220421], [120000, -11.221417], [779, -11.299489], [4412, -11.405934], [124969, -11.460533], [32, -11.728544], [120002, -11.765539], [622, -11.766822], [20758, -11.840095], [11861, -11.862003], [19078, -11.895619], [10, -12.006355], [1275, -12.008493], [18390, -12.032758], [26530, -12.037033], [122158, -12.048725], [4679, -12.275958], [33676, -12.308729], [467, -12.312291], [327, -12.336801], [7331, -12.343838], [120359, -12.362121], [936, -12.365218], [120103, -12.376334], [379, -12.39139], [1765, -12.401719], [589, -12.435584], [120008, -12.473985], [1407, -12.480652], [121083, -12.506371], [36209, -12.543858], [4554, -12.545173], [1584, -12.554027], [318, -12.555511], [4384, -12.570303], [121379, -12.578406], [15853, -12.595568], [120410, -12.627021], [2213, -12.631622], [527, -12.635281], [3918, -12.641297], [763, -12.670944], [420, -12.688696], [120277, -12.689355], [14179, -12.692083], [101703, -12.777452], [120893, -12.847388], [7496, -12.851079], [262, -12.861764], [576, -12.893866], [120001, -12.902688], [44455, -12.910438], [476, -12.942568], [120399, -12.949159], [17870, -12.952613], [4484, -12.99012], [20196, -12.992472], [4343, -12.992486], [103784, -13.018018], [120347, -13.021894], [30035, -13.026324], [1410, -13.069165], [127906, -13.074705], [120436, -13.124753], [460, -13.156419]], "logprob_of_token": -8.392349, "top1_top2_margin": 2.882003, "top6_top7_margin": 0.332958}, {"gen_index": 21, "token": 1584, "top": [[44, -0.029325], [120007, -4.207463], [46, -5.833782], [1584, -5.887466], [120016, -6.05013], [275, -6.383191], [120022, -7.903996], [120021, -8.176575], [314, -8.455587], [745, -8.650787], [120468, -8.779144], [121119, -8.882395], [2457, -9.15859], [120000, -9.193219], [120028, -9.434644], [2773, -9.603767], [988, -9.782664], [124969, -9.821856], [120103, -9.833913], [20758, -9.929467], [534, -10.186805], [5496, -10.307718], [11861, -10.323873], [14188, -10.330394], [59, -10.335558], [263, -10.342526], [120409, -10.432083], [120003, -10.469365], [120002, -10.529546], [2042, -10.606917], [63, -10.652722], [10, -10.690732], [766, -10.698373], [69555, -10.836234], [33, -10.866614], [121379, -10.872451], [405, -10.956473], [7510, -11.022381], [58, -11.094573], [120410, -11.106106], [3326, -11.143297], [120087, -11.206218], [122158, -11.262399], [120277, -11.274487], [120359, -11.275243], [1043, -11.303346], [669, -11.3277], [121083, -11.426431], [1409, -11.468946], [25945, -11.483937], [65268, -11.513031], [2519, -11.533196], [262, -11.548366], [94365, -11.613819], [527, -11.615623], [327, -11.62535], [126545, -11.650717], [3368, -11.657557], [120844, -11.695152], [120001, -11.721506], [32, -11.731792], [8152, -11.750641], [286, -11.758723], [120008, -11.76413], [120302, -11.785069], [5675, -11.819397], [2302, -11.869851], [1410, -11.937334], [57125, -11.962346], [120214, -12.03439], [7833, -12.073817], [14153, -12.076867], [7768, -12.145495], [8722, -12.174124], [25071, -12.189637], [1062, -12.224926], [502, -12.229918], [29094, -12.236466], [8894, -12.241872], [2213, -12.24826], [20196, -12.261781], [14792, -12.271934], [126203, -12.27553], [41836, -12.316334], [1744, -12.337543], [123367, -12.380626], [14179, -12.426459], [900, -12.434463], [3924, -12.446972], [18390, -12.451275], [120098, -12.471867], [1829, -12.480425], [318, -12.488938], [26530, -12.500026], [120751, -12.500446], [1308, -12.518778], [1323, -12.568262], [936, -12.573318], [2973, -12.575427], [120501, -12.579642]], "logprob_of_token": -5.887466, "top1_top2_margin": 4.178138, "top6_top7_margin": 1.520805}, {"gen_index": 23, "token": 2973, "top": [[735, -0.002778], [120007, -7.879786], [46, -8.508558], [2973, -9.062181], [330, -9.354948], [120022, -9.524983], [44, -9.571858], [275, -9.696572], [7732, -10.406098], [2459, -10.407601], [622, -10.409759], [1064, -10.507012], [589, -10.535758], [32, -10.545038], [919, -10.657306], [63, -10.736837], [476, -10.866687], [568, -10.920923], [120016, -11.156331], [314, -11.201921], [262, -11.284799], [527, -11.292381], [14188, -11.309908], [286, -11.320714], [20787, -11.373973], [14896, -11.394029], [73707, -11.427216], [1584, -11.430253], [120000, -11.489278], [1656, -11.506048], [1409, -11.515779], [120625, -11.558627], [378, -11.562283], [263, -11.610286], [3326, -11.709582], [528, -11.712009], [120801, -11.734288], [8157, -11.745404], [58, -11.771191], [120670, -11.796178], [12243, -11.818906], [18754, -11.834173], [1270, -11.860218], [4384, -11.868739], [279, -11.913936], [14419, -11.958665], [824, -12.005404], [745, -12.045776], [20773, -12.049244], [14177, -12.070788], [318, -12.127468], [941, -12.139185], [11308, -12.141301], [439, -12.172559], [7770, -12.198979], [1309, -12.206539], [12195, -12.207373], [22644, -12.24481], [1043, -12.258372], [502, -12.261812], [35211, -12.264338], [41026, -12.301463], [18126, -12.304572], [20758, -12.305775], [120021, -12.310697], [669, -12.311523], [7510, -12.341449], [21681, -12.36413], [57125, -12.372352], [120001, -12.403273], [1333, -12.426471], [120410, -12.451828], [72836, -12.47025], [120098, -12.470935], [1679, -12.475316], [4771, -12.492156], [36533, -12.503969], [3402, -12.516322], [10, -12.574992], [379, -12.579064], [936, -12.593719], [836, -12.604081], [52269, -12.606948], [59405, -12.609531], [14153, -12.649615], [62024, -12.655185], [59, -12.70143], [766, -12.70168], [120002, -12.702625], [93, -12.714372], [120008, -12.723511], [2457, -12.735314], [34858, -12.736354], [10244, -12.739893], [576, -12.751241], [1436, -12.769563], [33275, -12.789283], [61, -12.814279], [2213, -12.827502], [103784, -12.844742]], "logprob_of_token": -9.062181, "top1_top2_margin": 7.877008, "top6_top7_margin": 0.046875}, {"gen_index": 24, "token": 44, "top": [[2973, -0.039225], [1584, -3.564401], [1409, -6.550417], [120007, -7.285471], [44, -8.14054], [41084, -8.311318], [262, -8.369339], [120022, -8.55123], [263, -8.587457], [10, -8.588494], [735, -8.61235], [502, -8.786916], [3368, -9.181705], [4771, -9.445849], [3142, -9.525262], [2117, -9.699409], [32, -9.734819], [828, -9.828473], [836, -9.890281], [1410, -9.953305], [46, -9.964587], [1090, -9.987495], [12107, -10.030917], [120021, -10.042794], [2468, -10.047601], [4315, -10.081679], [1436, -10.170592], [7510, -10.239619], [20142, -10.242831], [120016, -10.258635], [1319, -10.267844], [823, -10.277209], [37690, -10.281783], [1333, -10.350423], [8345, -10.36099], [3918, -10.366763], [3658, -10.385983], [8536, -10.423538], [2302, -10.433469], [3467, -10.442697], [2213, -10.487235], [527, -10.53327], [110629, -10.558855], [2668, -10.562422], [14272, -10.62678], [120087, -10.633866], [941, -10.782374], [3702, -10.788784], [98621, -10.814003], [3924, -10.815053], [1972, -10.849172], [20758, -10.858916], [14188, -10.873698], [2042, -10.912599], [3737, -10.913196], [488, -10.949881], [2246, -10.964865], [94416, -10.968616], [1662, -10.969769], [1744, -10.993625], [110546, -11.002223], [762, -11.031805], [3326, -11.035708], [1324, -11.069905], [33274, -11.09656], [2374, -11.107125], [2711, -11.115046], [4273, -11.129827], [12973, -11.138911], [745, -11.140813], [9310, -11.162173], [534, -11.173646], [4959, -11.180785], [11981, -11.188096], [453, -11.231982], [314, -11.232162], [120000, -11.247339], [9474, -11.296969], [988, -11.307392], [4700, -11.315703], [4731, -11.31839], [4787, -11.324473], [3314, -11.354855], [398, -11.359184], [779, -11.364118], [6563, -11.38921], [57125, -11.431788], [8594, -11.435103], [15697, -11.437602], [7208, -11.450477], [1093, -11.450669], [2487, -11.452298], [4384, -11.452342], [10664, -11.460836], [20196, -11.461923], [127906, -11.480653], [1305, -11.507157], [286, -11.518854], [2157, -11.522756], [327, -11.524392]], "logprob_of_token": -8.14054, "top1_top2_margin": 3.525176, "top6_top7_margin": 0.058021}, {"gen_index": 25, "token": 1409, "top": [[44, -0.05804], [275, -3.466556], [46, -4.055504], [120007, -5.942165], [314, -6.349172], [120016, -7.119812], [63, -8.297703], [263, -8.648309], [988, -8.851474], [120021, -9.011184], [33, -9.045419], [120022, -9.078936], [14188, -9.239408], [10, -9.504897], [2519, -9.551747], [120028, -9.669751], [120468, -9.957668], [121119, -9.963527], [735, -10.033869], [124969, -10.266543], [1409, -10.421771], [1043, -10.441224], [7510, -10.56682], [745, -10.635077], [59, -10.679851], [120103, -10.68688], [766, -10.751557], [120003, -10.889187], [4137, -10.893917], [120002, -10.937623], [127906, -10.950141], [1914, -11.018132], [11861, -11.02614], [405, -11.035085], [14153, -11.053549], [1829, -11.067439], [120008, -11.2147], [120409, -11.268316], [122158, -11.371438], [120000, -11.423079], [121379, -11.522806], [20758, -11.53791], [32, -11.581962], [58, -11.612253], [120359, -11.631248], [120410, -11.723045], [4679, -11.838414], [286, -11.859494], [4412, -11.954988], [120001, -12.044368], [120087, -12.105201], [36209, -12.136439], [74254, -12.181375], [120844, -12.284335], [120277, -12.304022], [121083, -12.306273], [30035, -12.339386], [120399, -12.344481], [69555, -12.371621], [120302, -12.395269], [126545, -12.408166], [120214, -12.412362], [779, -12.453847], [120489, -12.45618], [36040, -12.507412], [26530, -12.517536], [4343, -12.556182], [14179, -12.556442], [18390, -12.649291], [669, -12.667446], [120241, -12.693028], [460, -12.713909], [262, -12.742599], [589, -12.75739], [5071, -12.76303], [34, -12.809274], [622, -12.817669], [6391, -12.850637], [7496, -12.872315], [45507, -12.904716], [120751, -12.914697], [103784, -12.92802], [120173, -12.937755], [33676, -12.953465], [656, -12.964789], [467, -12.980111], [8894, -12.996827], [120230, -13.020609], [3290, -13.065844], [2459, -13.071408], [20196, -13.074309], [17870, -13.075665], [1275, -13.099313], [58965, -13.11255], [44455, -13.116017], [2410, -13.117623], [57628, -13.119016], [120101, -13.121126], [122226, -13.141204], [531, -13.145051]], "logprob_of_token": -10.421771, "top1_top2_margin": 3.408516, "top6_top7_margin": 1.177891}, {"gen_index": 27, "token": 1584, "top": [[44, -0.016246], [1584, -4.762782], [120007, -6.274761], [46, -7.077208], [988, -7.640601], [10, -7.817922], [120016, -8.278234], [120021, -8.343671], [263, -8.358121], [275, -8.453708], [314, -8.482071], [120028, -8.880195], [120022, -9.446979], [534, -9.514729], [2773, -9.687295], [120000, -9.743567], [2457, -10.046502], [120468, -10.085823], [5496, -10.139529], [121119, -10.172753], [2042, -10.192204], [745, -10.298882], [262, -10.316318], [14188, -10.49904], [32, -10.650573], [1409, -10.830555], [766, -10.891477], [127906, -10.907202], [286, -10.911008], [33, -11.011549], [94365, -11.013632], [58, -11.018607], [120087, -11.051274], [121379, -11.086954], [669, -11.142286], [405, -11.217301], [59, -11.223828], [7510, -11.226969], [63, -11.241799], [124969, -11.319274], [120410, -11.377008], [20758, -11.382855], [25945, -11.418067], [120103, -11.449589], [120003, -11.451836], [120214, -11.467425], [65268, -11.476159], [120008, -11.500767], [8152, -11.529231], [126545, -11.555889], [327, -11.600661], [34, -11.677467], [7768, -11.690777], [527, -11.692978], [1410, -11.716333], [122226, -11.748693], [3326, -11.833378], [5675, -11.86184], [120001, -11.865129], [29094, -11.943787], [656, -11.948703], [122158, -11.96556], [2302, -11.968024], [25071, -12.023997], [941, -12.041671], [120002, -12.100404], [11861, -12.132397], [3368, -12.182744], [123367, -12.186799], [122046, -12.19386], [318, -12.25929], [1436, -12.264745], [1659, -12.313685], [120409, -12.336563], [117149, -12.341899], [120359, -12.390416], [379, -12.396777], [6391, -12.41687], [1829, -12.420623], [120277, -12.429283], [1744, -12.435914], [284, -12.442816], [121083, -12.454091], [26071, -12.458796], [69555, -12.472166], [1275, -12.478426], [49, -12.497969], [3924, -12.543332], [120098, -12.555038], [936, -12.56746], [2213, -12.58939], [14153, -12.592112], [1062, -12.594266], [57125, -12.599101], [900, -12.599715], [1914, -12.643507], [1043, -12.644256], [14139, -12.65978], [4679, -12.663368], [735, -12.668815]], "logprob_of_token": -4.762782, "top1_top2_margin": 4.746536, "top6_top7_margin": 0.460312}, {"gen_index": 29, "token": 2973, "top": [[735, -0.003883], [10, -7.424285], [263, -7.916348], [120007, -8.400033], [2459, -8.834937], [120022, -8.91986], [120021, -9.57484], [46, -9.614745], [120016, -9.945802], [127906, -10.078028], [120087, -10.145789], [314, -10.36906], [330, -10.372417], [44, -10.462987], [275, -10.572417], [2973, -10.588895], [589, -10.664644], [32, -10.788424], [919, -10.958355], [14896, -11.019507], [73707, -11.060391], [568, -11.123289], [120000, -11.176119], [262, -11.187696], [14419, -11.188294], [14188, -11.202434], [63, -11.295733], [120103, -11.308288], [18126, -11.311982], [1409, -11.364203], [622, -11.376697], [1064, -11.398451], [120214, -11.420929], [120098, -11.485888], [476, -11.516042], [120004, -11.584115], [120002, -11.647041], [527, -11.706705], [1584, -11.765229], [120670, -11.785624], [120410, -11.861609], [378, -11.919036], [120724, -11.928638], [988, -11.935668], [120038, -11.962122], [120625, -11.966022], [7732, -12.003499], [1656, -12.017213], [20758, -12.029961], [121407, -12.052191], [120302, -12.057563], [120001, -12.066485], [120489, -12.226137], [286, -12.251308], [58, -12.258109], [941, -12.263009], [528, -12.265367], [669, -12.268613], [14177, -12.27694], [576, -12.281138], [20773, -12.295156], [824, -12.317555], [3326, -12.321603], [1043, -12.327895], [122158, -12.349286], [279, -12.350334], [120014, -12.35649], [502, -12.368411], [127908, -12.37276], [120173, -12.409427], [120008, -12.430797], [120801, -12.476472], [745, -12.557845], [61, -12.576384], [122046, -12.609737], [318, -12.635027], [1309, -12.636849], [93, -12.640145], [439, -12.641196], [1270, -12.645881], [123745, -12.680655], [7510, -12.744163], [12195, -12.757871], [460, -12.777304], [1333, -12.778476], [1436, -12.784816], [6989, -12.856573], [46952, -12.889157], [4384, -12.896941], [1410, -12.898966], [57125, -12.904249], [49, -12.920158], [127393, -12.925481], [766, -12.930274], [830, -12.970482], [617, -12.971128], [120844, -13.003014], [37690, -13.007627], [103784, -13.01218], [3402, -13.012355]], "logprob_of_token": -10.588895, "top1_top2_margin": 7.420403, "top6_top7_margin": 0.65498}, {"gen_index": 30, "token": 44, "top": [[2973, -0.017022], [1584, -4.59157], [1409, -7.029116], [120007, -7.59503], [263, -7.784834], [10, -7.967087], [262, -8.63885], [41084, -8.699019], [120022, -8.843251], [502, -9.209098], [735, -9.324258], [32, -9.713183], [44, -9.927121], [120021, -9.953107], [3368, -10.070463], [4771, -10.0715], [1090, -10.129255], [120016, -10.257934], [828, -10.316998], [3142, -10.355825], [2117, -10.359801], [12107, -10.45652], [1333, -10.467376], [4315, -10.48248], [20142, -10.583217], [8536, -10.617187], [120087, -10.645065], [1436, -10.667809], [1410, -10.684965], [37690, -10.773398], [8345, -10.794929], [110629, -10.795808], [1319, -10.81231], [2668, -10.88122], [836, -10.903696], [127906, -10.932978], [823, -10.957792], [2213, -11.006173], [3658, -11.064605], [3467, -11.068288], [527, -11.085507], [941, -11.096555], [3702, -11.145921], [14272, -11.211395], [110546, -11.24153], [46, -11.263062], [3918, -11.269635], [7510, -11.273326], [98621, -11.276338], [94416, -11.35295], [20758, -11.373137], [6563, -11.414178], [745, -11.417455], [14188, -11.43296], [9310, -11.434539], [33274, -11.442286], [2302, -11.454429], [762, -11.470278], [4273, -11.517341], [120410, -11.530742], [2246, -11.531917], [13798, -11.549967], [1972, -11.565635], [3314, -11.57048], [3924, -11.57918], [3326, -11.580617], [120004, -11.590269], [1744, -11.600883], [11981, -11.613984], [120103, -11.633353], [120098, -11.646996], [3737, -11.654716], [106570, -11.698765], [7208, -11.708857], [327, -11.711054], [453, -11.724067], [2711, -11.733174], [1093, -11.746325], [120000, -11.781591], [900, -11.794616], [1324, -11.797259], [2468, -11.831117], [565, -11.831584], [1930, -11.833558], [14419, -11.841971], [4731, -11.876021], [8594, -11.891666], [2487, -11.900419], [13789, -11.941228], [10664, -11.942228], [622, -11.948013], [7838, -11.961029], [1662, -11.963468], [122158, -11.965352], [121379, -11.969251], [2374, -11.977102], [4647, -11.978238], [120002, -12.003007], [12973, -12.007204], [2944, -12.00878]], "logprob_of_token": -9.927121, "top1_top2_margin": 4.574549, "top6_top7_margin": 0.671763}, {"gen_index": 31, "token": 1409, "top": [[44, -0.055193], [275, -3.475779], [46, -4.470738], [314, -5.733935], [120007, -6.023149], [120016, -6.782587], [263, -7.306023], [988, -7.771289], [120021, -8.268553], [10, -8.295378], [120028, -8.581098], [63, -8.933051], [14188, -9.052765], [33, -9.14968], [120022, -9.277219], [2519, -9.343305], [120468, -9.499022], [121119, -9.618787], [124969, -9.745341], [127906, -9.810296], [4137, -9.93344], [735, -10.238001], [120003, -10.296152], [120103, -10.350797], [766, -10.393643], [7510, -10.446074], [120002, -10.566964], [120008, -10.587211], [1043, -10.616216], [122158, -10.645658], [11861, -10.697174], [745, -10.813455], [59, -10.834928], [405, -10.855535], [121379, -10.85561], [1409, -10.904165], [1829, -10.986424], [120359, -11.016164], [120000, -11.036668], [120410, -11.069457], [32, -11.072021], [36209, -11.088618], [4679, -11.131166], [14153, -11.171035], [1914, -11.270325], [126545, -11.327054], [120087, -11.413655], [120409, -11.427498], [120214, -11.450391], [58, -11.455455], [286, -11.599568], [120302, -11.685682], [120399, -11.712962], [20758, -11.727341], [4343, -11.791298], [120001, -11.807333], [4412, -11.807717], [120241, -11.817882], [30035, -11.862357], [14179, -11.88681], [34, -11.921994], [120844, -11.956148], [69555, -11.957915], [120277, -12.025536], [121083, -12.104815], [669, -12.121266], [120751, -12.134223], [13594, -12.150709], [120489, -12.195609], [36040, -12.218022], [622, -12.234605], [122226, -12.242534], [120173, -12.249513], [120230, -12.296068], [120347, -12.323832], [656, -12.334603], [120068, -12.338859], [18730, -12.363296], [262, -12.386878], [589, -12.395164], [44455, -12.401526], [127908, -12.414507], [779, -12.423532], [3078, -12.44578], [93457, -12.458518], [74254, -12.458695], [460, -12.479259], [467, -12.50139], [45507, -12.55906], [115, -12.562376], [122046, -12.573767], [120101, -12.578883], [120014, -12.580916], [20196, -12.593622], [8894, -12.611064], [531, -12.635453], [3290, -12.648434], [58965, -12.663826], [2410, -12.669455], [7496, -12.725207]], "logprob_of_token": -10.904165, "top1_top2_margin": 3.420586, "top6_top7_margin": 0.523436}]}, {"prompt": "x1 = 3, x2 = 7, x3 = 11, x4 =", "input_ids": [120, 49, 576, 32, 51, 44, 14169, 50, 576, 32, 55, 44, 14169, 51, 576, 32, 49, 49, 44, 14169, 52, 576], "generated_ids": [32, 49, 51, 44, 14169, 53, 576, 32, 49, 53, 44, 14169, 54, 576, 32, 49, 55, 44, 14169, 55, 576, 32, 49, 57, 44, 14169, 56, 576, 32, 50, 49, 44], "rows": [{"gen_index": 0, "token": 32, "top": [[576, -0.053311], [735, -4.607003], [32, -5.330575], [49, -5.426615], [61, -5.990069], [439, -6.280692], [318, -6.624381], [286, -7.057251], [58, -7.223506], [919, -7.249568], [1829, -7.549873], [52, -7.574397], [476, -7.667939], [1064, -7.753165], [528, -7.785528], [1270, -7.786395], [44, -7.809808], [120007, -7.944574], [55, -8.022307], [48, -8.079042], [57, -8.135289], [53, -8.216617], [50, -8.226844], [51, -8.270421], [622, -8.354891], [46, -8.419709], [54, -8.560827], [766, -8.565114], [824, -8.626594], [120022, -8.70776], [3660, -8.753873], [14153, -8.762038], [14188, -8.817166], [1073, -8.903451], [56, -8.940828], [19907, -8.997795], [2839, -9.022503], [568, -9.116699], [379, -9.121874], [262, -9.129956], [377, -9.136846], [4088, -9.137746], [14417, -9.171663], [2457, -9.204445], [1656, -9.207791], [7732, -9.262166], [936, -9.283679], [310, -9.29415], [120000, -9.333254], [4743, -9.360967], [34324, -9.377437], [1765, -9.426439], [45, -9.439009], [502, -9.440112], [1309, -9.442518], [3167, -9.46091], [8055, -9.476243], [1427, -9.516313], [11035, -9.519754], [11308, -9.545838], [263, -9.55078], [7772, -9.562213], [4869, -9.572555], [279, -9.593293], [14439, -9.602829], [27225, -9.610878], [1410, -9.614669], [393, -9.626403], [15239, -9.691744], [25288, -9.702111], [4895, -9.709092], [7510, -9.712718], [378, -9.718661], [63, -9.74212], [830, -9.745345], [467, -9.747759], [474, -9.763627], [327, -9.811934], [120091, -9.905284], [95, -9.916593], [32578, -9.916965], [23754, -9.920064], [5415, -9.926145], [1339, -9.930863], [4384, -9.940521], [11317, -9.988765], [589, -10.066845], [127797, -10.066976], [8150, -10.101817], [15703, -10.122544], [35099, -10.143422], [20773, -10.156238], [5274, -10.175208], [10794, -10.188359], [13627, -10.195942], [14179, -10.195952], [3402, -10.209003], [9727, -10.231151], [19166, -10.23359], [2459, -10.241308]], "logprob_of_token": -5.330575, "top1_top2_margin": 4.553692, "top6_top7_margin": 0.343689}, {"gen_index": 1, "token": 49, "top": [[32, -0.026733], [49, -6.134008], [120022, -6.455525], [14169, -7.01132], [14153, -7.201931], [622, -7.50798], [735, -7.702252], [262, -7.737743], [766, -7.861623], [1829, -8.132801], [5274, -8.155343], [120018, -8.382079], [502, -8.393432], [55, -8.515473], [263, -8.538724], [941, -8.564663], [946, -8.574819], [936, -8.626318], [3326, -8.645182], [565, -8.728118], [14188, -8.841568], [2403, -8.854323], [1410, -8.888513], [120007, -8.891307], [7510, -8.900639], [50, -8.915139], [46, -9.061361], [2457, -9.083184], [669, -9.087613], [52, -9.110706], [44, -9.278248], [122407, -9.329122], [318, -9.356044], [120383, -9.387219], [2213, -9.435948], [14179, -9.43735], [286, -9.479394], [393, -9.494914], [1427, -9.516999], [1688, -9.517705], [120008, -9.552297], [57, -9.556504], [63, -9.601671], [51, -9.602697], [8545, -9.626555], [6391, -9.628959], [120098, -9.632064], [54, -9.644209], [14172, -9.657336], [53, -9.671992], [120610, -9.695705], [1333, -9.698552], [310, -9.758916], [120103, -9.784977], [527, -9.810555], [120014, -9.813238], [919, -9.824616], [4330, -9.842487], [56, -9.866026], [1409, -9.938652], [3660, -9.948406], [1435, -10.011256], [576, -10.01847], [1073, -10.022607], [474, -10.034628], [467, -10.040812], [14439, -10.042274], [4743, -10.09531], [523, -10.100674], [20758, -10.126123], [120001, -10.130315], [297, -10.169644], [4869, -10.177444], [327, -10.193096], [13460, -10.201537], [528, -10.218133], [58, -10.243099], [103844, -10.291114], [48, -10.308389], [379, -10.35708], [14139, -10.369071], [3544, -10.3873], [18586, -10.417953], [2839, -10.421491], [1319, -10.431649], [439, -10.435027], [275, -10.43838], [582, -10.440818], [2246, -10.441494], [3402, -10.459996], [378, -10.476061], [762, -10.492336], [468, -10.513867], [1765, -10.516465], [8416, -10.520891], [59, -10.542718], [1776, -10.545979], [28851, -10.552381], [11035, -10.581464], [2125, -10.582673]], "logprob_of_token": -6.134008, "top1_top2_margin": 6.107275, "top6_top7_margin": 0.194272}, {"gen_index": 2, "token": 51, "top": [[49, -0.165499], [50, -2.757861], [55, -3.890499], [52, -3.970312], [53, -4.29491], [57, -4.560981], [51, -4.582895], [54, -4.991714], [56, -5.460793], [48, -7.409721], [32, -8.222566], [766, -10.46909], [14153, -10.521907], [120022, -11.154675], [63, -11.156735], [946, -11.193673], [622, -11.359455], [735, -11.44226], [263, -11.495331], [576, -11.514626], [936, -11.540946], [120007, -11.679756], [941, -11.691725], [669, -11.712594], [286, -11.72119], [46, -11.788096], [5274, -11.790101], [262, -11.853225], [20668, -11.853992], [1829, -11.873256], [7510, -11.893864], [2125, -11.901553], [310, -11.924864], [3326, -11.949176], [318, -11.960349], [44, -11.984156], [127906, -12.044783], [3688, -12.152179], [275, -12.169201], [3311, -12.195087], [379, -12.198141], [58, -12.201665], [523, -12.22239], [1688, -12.266849], [2457, -12.284023], [582, -12.329787], [20486, -12.406992], [1049, -12.408121], [297, -12.417706], [502, -12.419756], [1765, -12.444919], [119464, -12.450812], [1043, -12.453223], [14169, -12.476562], [95, -12.491493], [1319, -12.492311], [393, -12.496217], [6391, -12.497576], [1073, -12.498023], [327, -12.499253], [120018, -12.511057], [565, -12.517584], [94, -12.526927], [59, -12.5379], [3544, -12.542898], [1435, -12.569106], [14179, -12.590504], [14188, -12.59059], [467, -12.634999], [840, -12.676348], [10, -12.708184], [30981, -12.711591], [8545, -12.729887], [353, -12.735806], [377, -12.746437], [527, -12.749562], [61, -12.766393], [3167, -12.780804], [1427, -12.798525], [3660, -12.810001], [543, -12.81524], [405, -12.818727], [4396, -12.859531], [1083, -12.862012], [15543, -12.87312], [3780, -12.899728], [120436, -12.909137], [294, -12.919793], [120014, -12.926694], [120008, -12.988528], [1086, -12.994187], [29038, -12.995378], [14162, -13.003728], [1336, -13.014547], [1410, -13.01563], [120000, -13.018922], [528, -13.040354], [36209, -13.043527], [22984, -13.063074], [923, -13.064261]], "logprob_of_token": -4.582895, "top1_top2_margin": 2.592362, "top6_top7_margin": 0.021914}, {"gen_index": 3, "token": 44, "top": [[51, -0.759833], [53, -1.953462], [56, -2.181536], [54, -2.637465], [55, -2.889556], [52, -3.098016], [57, -3.407479], [50, -3.998603], [44, -4.606879], [49, -4.687778], [48, -4.7808], [46, -6.703824], [32, -6.931884], [766, -7.098828], [286, -7.462192], [263, -7.544831], [10, -7.68997], [318, -7.728132], [58, -7.869236], [59, -7.92673], [63, -8.017906], [467, -8.116012], [735, -8.257814], [3688, -8.309188], [377, -8.665214], [327, -8.670833], [275, -8.713737], [1829, -8.881338], [622, -9.021407], [279, -9.081656], [45, -9.082227], [576, -9.109378], [936, -9.215877], [14188, -9.474158], [379, -9.486947], [4869, -9.54033], [439, -9.615523], [14153, -9.620876], [5274, -9.621556], [393, -9.656272], [946, -9.67874], [120007, -9.69137], [310, -9.712754], [1765, -9.739863], [3660, -9.769869], [2457, -9.837865], [941, -9.848041], [14147, -9.858912], [919, -9.859832], [47, -9.922962], [127906, -9.983209], [294, -10.025172], [1917, -10.026102], [1410, -10.081617], [262, -10.087512], [1073, -10.127181], [14169, -10.13542], [34, -10.216481], [33, -10.236506], [502, -10.243852], [476, -10.247299], [3326, -10.247975], [43, -10.248331], [314, -10.252645], [656, -10.25683], [523, -10.269603], [1062, -10.270751], [1086, -10.278623], [565, -10.345294], [14139, -10.346889], [420, -10.369592], [120000, -10.372373], [474, -10.388], [1333, -10.391675], [65, -10.407471], [589, -10.463322], [1739, -10.576076], [120, -10.594771], [2342, -10.597578], [67, -10.611518], [4743, -10.641416], [2403, -10.662642], [3093, -10.667732], [834, -10.682474], [3402, -10.75777], [3301, -10.773029], [14161, -10.775792], [1049, -10.807877], [1064, -10.82086], [4895, -10.824666], [1275, -10.827489], [3003, -10.833984], [94, -10.840659], [669, -10.84956], [779, -10.849759], [14163, -10.852977], [5275, -10.869433], [4257, -10.870877], [2839, -10.906112], [316, -10.913389]], "logprob_of_token": -4.606879, "top1_top2_margin": 1.193628, "top6_top7_margin": 0.309464}, {"gen_index": 4, "token": 14169, "top": [[44, -0.085712], [263, -3.636346], [46, -4.716066], [120007, -5.28509], [275, -5.797589], [10, -5.993475], [766, -6.0387], [58, -6.24261], [286, -6.582505], [1829, -6.8378], [59, -7.052978], [49, -7.096219], [120016, -7.230496], [63, -7.300761], [3688, -7.381109], [14188, -7.680315], [420, -7.777338], [7510, -7.861465], [120028, -7.86238], [32, -7.895322], [936, -7.89608], [14147, -7.900383], [622, -8.0235], [735, -8.22544], [14169, -8.304464], [52, -8.327024], [1765, -8.327968], [120022, -8.331402], [988, -8.336215], [377, -8.370954], [262, -8.373075], [48, -8.386602], [310, -8.438196], [121119, -8.534431], [120000, -8.537207], [50, -8.636056], [314, -8.657184], [745, -8.663306], [327, -8.683091], [576, -8.834968], [14161, -8.884634], [47, -8.893282], [120468, -8.914883], [318, -9.009291], [127906, -9.023466], [1062, -9.097943], [51, -9.119226], [467, -9.142782], [120409, -9.190217], [14153, -9.195309], [53, -9.205991], [36040, -9.212287], [121083, -9.222486], [57, -9.268477], [4743, -9.270553], [120008, -9.275237], [1117, -9.286896], [565, -9.350843], [379, -9.429242], [3660, -9.462256], [120038, -9.478675], [54, -9.501081], [1043, -9.513686], [1917, -9.539948], [55, -9.54312], [405, -9.572721], [1394, -9.606059], [5275, -9.645558], [3078, -9.65721], [20758, -9.671885], [946, -9.706409], [2459, -9.716537], [124969, -9.723184], [45, -9.732587], [56, -9.750115], [763, -9.754768], [120021, -9.78889], [2362, -9.793254], [393, -9.810243], [1073, -9.877757], [120, -9.892757], [3326, -9.907058], [33, -9.924706], [120014, -9.984626], [4508, -9.995443], [120003, -9.998909], [2342, -10.008307], [20486, -10.010208], [34, -10.022309], [11861, -10.092635], [474, -10.162673], [120002, -10.173755], [9635, -10.213187], [16604, -10.237554], [14179, -10.239481], [18092, -10.247454], [1474, -10.263603], [582, -10.278195], [913, -10.291225], [5274, -10.307341]], "logprob_of_token": -8.304464, "top1_top2_margin": 3.550634, "top6_top7_margin": 0.045224}, {"gen_index": 5, "token": 53, "top": [[14169, -0.116961], [286, -3.952365], [7510, -4.103142], [262, -4.486613], [936, -4.588646], [32, -5.127793], [393, -6.101033], [120022, -6.115542], [565, -6.596114], [1776, -6.756018], [1409, -6.860757], [4743, -7.228199], [310, -7.360388], [2213, -7.80613], [3326, -7.807307], [669, -7.821028], [527, -7.833769], [120103, -7.983978], [14172, -8.003814], [3688, -8.180576], [941, -8.199311], [622, -8.248912], [120942, -8.382017], [946, -8.420063], [379, -8.426587], [120383, -8.441959], [1765, -8.443984], [766, -8.470486], [2150, -8.546096], [20758, -8.615839], [318, -8.621404], [5274, -8.641106], [327, -8.649114], [474, -8.671431], [1744, -8.73482], [8545, -8.808547], [120087, -8.825035], [20890, -8.871325], [799, -8.883206], [420, -8.886168], [346, -8.887103], [122629, -8.918565], [36040, -8.94632], [120098, -8.952689], [453, -8.95642], [49, -8.962695], [1688, -9.006474], [2839, -9.01338], [1333, -9.037194], [763, -9.037801], [739, -9.082856], [3504, -9.116012], [543, -9.122692], [948, -9.126023], [1862, -9.136753], [1275, -9.13763], [107274, -9.168642], [16604, -9.17422], [523, -9.200147], [120, -9.200192], [14541, -9.251413], [120014, -9.269242], [762, -9.270256], [14620, -9.294756], [18092, -9.360703], [3924, -9.442683], [124256, -9.442974], [1435, -9.458959], [14163, -9.48757], [576, -9.493812], [1436, -9.516544], [14162, -9.51855], [7162, -9.520917], [14159, -9.535157], [467, -9.579068], [735, -9.591306], [2362, -9.608275], [518, -9.641263], [2457, -9.644837], [3660, -9.646783], [263, -9.68645], [53, -9.699144], [120007, -9.700322], [779, -9.71408], [14792, -9.714664], [1086, -9.724447], [42298, -9.727395], [1917, -9.73665], [14729, -9.768563], [2548, -9.777927], [502, -9.780771], [1336, -9.786654], [1410, -9.787639], [459, -9.793425], [3368, -9.825334], [1806, -9.858259], [14188, -9.859953], [597, -9.861773], [468, -9.875591], [970, -9.904369]], "logprob_of_token": -9.699144, "top1_top2_margin": 3.835403, "top6_top7_margin": 0.97324}, {"gen_index": 6, "token": 576, "top": [[53, -0.037366], [49, -4.666469], [52, -5.481412], [51, -5.916451], [55, -6.184651], [50, -6.656289], [54, -6.940261], [56, -7.411177], [57, -7.756173], [576, -7.967408], [32, -8.651873], [48, -8.716862], [263, -8.950784], [4241, -9.455506], [10, -9.552073], [379, -9.787692], [46, -9.831085], [65, -9.990469], [44, -10.07023], [58, -10.282753], [63, -10.293619], [766, -10.30518], [120007, -10.328772], [73, -10.369864], [622, -10.404145], [735, -10.49604], [61, -10.535888], [318, -10.549545], [262, -10.59833], [13331, -10.627665], [127906, -10.63114], [95, -10.672569], [286, -10.773108], [1073, -10.779232], [79, -10.808292], [59, -10.825569], [84993, -10.840982], [7510, -10.861649], [5274, -10.887093], [439, -10.901343], [14153, -10.946262], [7294, -10.998628], [75, -11.048025], [325, -11.052744], [39, -11.05765], [275, -11.076612], [56280, -11.081075], [294, -11.09508], [110, -11.126066], [14169, -11.1428], [78, -11.153469], [589, -11.17541], [35, -11.196299], [2457, -11.223763], [67, -11.240276], [120016, -11.246829], [77, -11.260011], [85595, -11.302622], [14139, -11.303905], [936, -11.315481], [1275, -11.333298], [1829, -11.356594], [4396, -11.405934], [1606, -11.407999], [115, -11.446539], [52573, -11.488396], [97, -11.495075], [120, -11.497485], [68, -11.499292], [941, -11.50168], [127908, -11.543726], [279, -11.567385], [34, -11.56778], [70, -11.574216], [1319, -11.579662], [99, -11.579859], [327, -11.597102], [66, -11.618437], [1305, -11.621113], [523, -11.628169], [3688, -11.641688], [1112, -11.641804], [1776, -11.646037], [58077, -11.663973], [310, -11.667827], [476, -11.679739], [45, -11.700018], [669, -11.71054], [14163, -11.725885], [80, -11.750404], [4257, -11.773376], [467, -11.794713], [835, -11.802547], [40, -11.812279], [36, -11.814615], [2150, -11.817242], [94, -11.830731], [47, -11.833549], [834, -11.847123], [120022, -11.851425]], "logprob_of_token": -7.967408, "top1_top2_margin": 4.629103, "top6_top7_margin": 0.283972}, {"gen_index": 7, "token": 32, "top": [[576, -0.010168], [735, -6.641381], [32, -7.057438], [61, -7.173608], [286, -8.296378], [58, -8.348286], [1829, -8.35598], [318, -8.400919], [44, -8.579918], [46, -8.770277], [120007, -9.047634], [263, -9.125509], [14188, -9.266115], [476, -9.337988], [439, -9.352749], [622, -9.410049], [919, -9.451656], [120022, -9.481665], [1270, -9.505644], [528, -9.70458], [262, -9.802399], [766, -9.808215], [327, -9.83617], [568, -10.003807], [379, -10.023497], [936, -10.138011], [14153, -10.209963], [1064, -10.241203], [393, -10.264906], [310, -10.271847], [49, -10.286876], [1656, -10.293509], [2457, -10.406511], [275, -10.484517], [10, -10.561081], [279, -10.579016], [474, -10.585032], [824, -10.666525], [378, -10.676414], [527, -10.677297], [63, -10.678525], [1073, -10.70229], [1765, -10.708282], [120016, -10.738167], [4743, -10.756028], [2839, -10.76598], [7510, -10.825239], [1275, -10.839643], [589, -10.879717], [59, -10.914156], [502, -10.916275], [2459, -10.937373], [120091, -10.95612], [3688, -10.95682], [3167, -10.982674], [11577, -10.983594], [127797, -11.024922], [14169, -11.060106], [1444, -11.063826], [95, -11.095932], [830, -11.113616], [1309, -11.166245], [14713, -11.166573], [4869, -11.172432], [5274, -11.236278], [1972, -11.294239], [120103, -11.308033], [14139, -11.308887], [467, -11.318664], [8150, -11.337168], [3326, -11.378775], [1410, -11.381217], [20758, -11.399953], [34, -11.426485], [1409, -11.434425], [8055, -11.436113], [18092, -11.501408], [15703, -11.503149], [420, -11.504577], [48, -11.52959], [4088, -11.541138], [14417, -11.564962], [617, -11.582281], [4384, -11.611052], [47, -11.613817], [3402, -11.620524], [120006, -11.630068], [3660, -11.632854], [946, -11.638207], [297, -11.645268], [34324, -11.648681], [15239, -11.668622], [8954, -11.675987], [1427, -11.677197], [565, -11.680637], [4508, -11.683704], [120000, -11.690342], [115, -11.712122], [127906, -11.72261], [11308, -11.7278]], "logprob_of_token": -7.057438, "top1_top2_margin": 6.631213, "top6_top7_margin": 0.007694}, {"gen_index": 8, "token": 49, "top": [[32, -0.010157], [49, -6.918803], [318, -7.524134], [120022, -8.411795], [946, -8.554582], [5274, -8.598548], [1829, -8.72589], [14188, -9.001615], [14153, -9.007601], [327, -9.21234], [262, -9.254811], [3417, -9.307836], [120018, -9.511207], [502, -9.511933], [766, -9.51828], [3326, -9.584823], [735, -9.606971], [20195, -9.652133], [622, -9.720092], [286, -9.823689], [46, -9.854865], [941, -9.894671], [1765, -9.910903], [379, -9.967692], [936, -9.983247], [2213, -10.016858], [263, -10.026035], [1410, -10.074914], [2945, -10.097638], [393, -10.191768], [4075, -10.227559], [7510, -10.271989], [44, -10.377737], [1409, -10.381986], [527, -10.398206], [474, -10.415948], [1688, -10.4166], [120007, -10.419639], [4330, -10.423395], [2457, -10.540717], [297, -10.546029], [669, -10.632609], [923, -10.640993], [565, -10.642433], [58, -10.710406], [120383, -10.743737], [8545, -10.81956], [582, -10.860351], [122407, -10.861252], [1917, -10.869041], [20758, -10.908914], [1333, -10.911965], [439, -10.920548], [14169, -10.923402], [14541, -10.939999], [103844, -10.946581], [32099, -10.976068], [4743, -10.984385], [14139, -10.994608], [3544, -10.999175], [2051, -11.010278], [420, -11.086897], [4869, -11.125461], [120008, -11.12864], [2403, -11.129689], [1776, -11.146915], [120098, -11.147205], [3660, -11.168044], [310, -11.18891], [3688, -11.191136], [1270, -11.195093], [59, -11.197272], [120610, -11.211298], [18586, -11.238465], [50, -11.259078], [275, -11.260776], [543, -11.291932], [378, -11.297753], [14179, -11.298451], [476, -11.323666], [120103, -11.335242], [1435, -11.346279], [63, -11.352424], [53, -11.369563], [405, -11.396842], [1275, -11.400045], [2944, -11.433187], [14267, -11.443175], [55, -11.45114], [1578, -11.457586], [22984, -11.459327], [597, -11.459726], [1444, -11.4643], [3827, -11.472748], [4396, -11.48647], [5796, -11.500749], [13460, -11.505569], [346, -11.526381], [3678, -11.54144], [6391, -11.548618]], "logprob_of_token": -6.918803, "top1_top2_margin": 6.908646, "top6_top7_margin": 0.127342}, {"gen_index": 9, "token": 53, "top": [[49, -0.03329], [57, -5.61594], [50, -5.772367], [55, -6.069972], [53, -6.253333], [51, -6.522624], [56, -6.708572], [32, -6.949883], [54, -7.310229], [52, -7.47662], [48, -7.810314], [946, -9.122028], [766, -9.23528], [14153, -9.421279], [1829, -9.499951], [576, -9.581608], [5274, -9.58666], [327, -9.750481], [262, -9.814134], [622, -9.996481], [14188, -10.068368], [393, -10.100128], [127906, -10.148216], [286, -10.226872], [7510, -10.238601], [379, -10.255242], [20195, -10.272449], [3326, -10.308331], [318, -10.316527], [582, -10.423864], [120007, -10.457189], [297, -10.508983], [735, -10.522222], [2125, -10.553985], [120022, -10.575057], [58, -10.592058], [44, -10.619875], [669, -10.624187], [263, -10.632312], [3688, -10.674903], [6391, -10.729409], [941, -10.746078], [46, -10.76615], [1765, -10.796315], [1073, -10.821347], [1688, -10.855945], [936, -10.862404], [55332, -10.872432], [527, -10.923835], [3311, -10.942442], [63, -10.980107], [923, -11.038005], [405, -11.081932], [543, -11.122019], [294, -11.149571], [502, -11.156405], [565, -11.158277], [377, -11.159239], [10, -11.165616], [14179, -11.165754], [3544, -11.226291], [4396, -11.254423], [127907, -11.254624], [59, -11.260801], [275, -11.273074], [85713, -11.314041], [22984, -11.315202], [1435, -11.320476], [39, -11.324455], [1049, -11.337237], [1972, -11.347092], [14419, -11.350125], [120008, -11.350762], [4631, -11.379555], [310, -11.401132], [120000, -11.416689], [61, -11.431122], [1410, -11.44735], [14158, -11.473202], [2945, -11.478986], [3417, -11.497031], [14541, -11.500912], [14267, -11.525113], [127908, -11.525818], [439, -11.526935], [9, -11.560613], [14163, -11.575864], [4075, -11.581381], [1275, -11.5909], [3167, -11.595594], [14139, -11.59973], [420, -11.620644], [18586, -11.639709], [3660, -11.649592], [353, -11.650752], [745, -11.662321], [120018, -11.666294], [10664, -11.667976], [2560, -11.67353], [474, -11.676971]], "logprob_of_token": -6.253333, "top1_top2_margin": 5.58265, "top6_top7_margin": 0.185949}, {"gen_index": 10, "token": 44, "top": [[53, -0.107705], [55, -2.568122], [52, -4.895137], [49, -5.534876], [51, -5.790875], [54, -5.900092], [57, -6.185662], [56, -6.694687], [48, -7.429935], [50, -8.064353], [32, -8.956109], [44, -9.137658], [46, -9.458824], [318, -9.633429], [766, -10.139009], [10, -10.214343], [63, -10.74147], [263, -10.757082], [58, -10.813759], [735, -10.815581], [34, -11.132512], [576, -11.175061], [946, -11.191503], [59, -11.256763], [379, -11.274447], [275, -11.276652], [127906, -11.290805], [3688, -11.299581], [286, -11.316897], [622, -11.41453], [1765, -11.447105], [279, -11.462175], [327, -11.466146], [4241, -11.549953], [14153, -11.605018], [3326, -11.626442], [936, -11.699922], [120007, -11.757933], [7510, -11.776384], [262, -11.840824], [120000, -11.916297], [3660, -11.93094], [45, -11.966036], [2125, -11.994577], [669, -12.071933], [1275, -12.109426], [101, -12.147915], [14541, -12.152438], [310, -12.175299], [919, -12.2032], [1829, -12.219437], [14188, -12.24688], [5274, -12.281117], [52573, -12.284196], [314, -12.292107], [474, -12.294803], [377, -12.302488], [93, -12.351317], [1073, -12.362199], [543, -12.366703], [47, -12.388647], [947, -12.440785], [582, -12.471025], [439, -12.495611], [527, -12.505594], [294, -12.515159], [2839, -12.515712], [2114, -12.517953], [941, -12.52821], [1410, -12.537989], [43, -12.547013], [5398, -12.551518], [14139, -12.581503], [923, -12.589721], [589, -12.590281], [1744, -12.592486], [1409, -12.60102], [4895, -12.602347], [523, -12.606928], [393, -12.623755], [37, -12.628518], [577, -12.651212], [39, -12.659493], [61, -12.667253], [6391, -12.687166], [467, -12.708686], [1049, -12.717902], [14267, -12.721494], [14417, -12.722162], [420, -12.726016], [353, -12.731305], [530, -12.737598], [41, -12.747187], [4396, -12.77046], [4075, -12.77502], [3544, -12.78934], [502, -12.795407], [2342, -12.80911], [4743, -12.813128], [14147, -12.818851]], "logprob_of_token": -9.137658, "top1_top2_margin": 2.460417, "top6_top7_margin": 0.28557}, {"gen_index": 11, "token": 14169, "top": [[44, -0.248119], [263, -2.426573], [275, -3.162819], [46, -3.388186], [10, -4.702243], [120007, -5.171977], [314, -5.749051], [120016, -6.025383], [1829, -6.15507], [766, -6.288589], [59, -6.630172], [14188, -6.637054], [58, -6.876138], [120028, -6.895717], [63, -7.164836], [988, -7.312323], [14147, -7.322253], [286, -7.33868], [127906, -7.534198], [32, -7.944901], [3688, -7.955015], [745, -7.956418], [11861, -8.051085], [121119, -8.182258], [14161, -8.217814], [1765, -8.262869], [124969, -8.352337], [120021, -8.376941], [14153, -8.383347], [120468, -8.452912], [120000, -8.560322], [120038, -8.675953], [622, -8.692131], [262, -8.711737], [735, -8.729124], [405, -8.816132], [7510, -8.849514], [7360, -8.857487], [420, -8.868992], [120022, -8.904708], [2519, -9.022955], [1043, -9.046155], [14169, -9.054331], [310, -9.065882], [121083, -9.097537], [120003, -9.112159], [318, -9.133831], [327, -9.16819], [936, -9.249022], [377, -9.268927], [1394, -9.297698], [33, -9.30884], [3078, -9.336418], [1062, -9.353168], [20758, -9.417125], [120014, -9.43957], [5275, -9.444214], [120409, -9.563478], [467, -9.623064], [120277, -9.632485], [47, -9.661554], [120008, -9.662305], [20486, -9.685582], [4137, -9.687029], [2342, -9.71713], [120002, -9.72746], [34, -9.745089], [14179, -9.796601], [379, -9.824164], [36040, -9.884645], [93, -9.885675], [120359, -9.887445], [120724, -9.903709], [45, -9.90743], [120103, -9.962134], [279, -9.964721], [595, -9.992577], [49, -9.997922], [1117, -10.008509], [11104, -10.063024], [393, -10.090213], [576, -10.091791], [474, -10.098383], [69555, -10.157639], [127908, -10.168547], [3326, -10.172831], [110441, -10.178502], [120375, -10.20515], [126203, -10.212092], [1275, -10.22226], [763, -10.228477], [543, -10.241637], [120399, -10.281493], [656, -10.284616], [565, -10.297112], [946, -10.304806], [121379, -10.335124], [5274, -10.361363], [47526, -10.364039], [779, -10.365658]], "logprob_of_token": -9.054331, "top1_top2_margin": 2.178454, "top6_top7_margin": 0.577074}, {"gen_index": 13, "token": 576, "top": [[54, -0.03363], [49, -4.172588], [53, -5.372095], [55, -6.377333], [50, -6.458109], [51, -6.505355], [52, -7.001744], [576, -7.732057], [56, -7.863202], [57, -8.076077], [48, -8.166525], [32, -9.19582], [63, -9.354131], [263, -9.926886], [120007, -9.940647], [95, -10.021466], [61, -10.385985], [294, -10.406947], [44, -10.443021], [110, -10.63737], [1606, -10.65296], [46, -10.723671], [379, -10.792694], [63960, -10.794092], [10, -10.857144], [14153, -10.890499], [58, -10.89227], [766, -10.917002], [589, -10.918438], [735, -10.9322], [73, -10.958624], [1073, -10.985779], [4573, -11.002878], [97, -11.028644], [1702, -11.257173], [94, -11.260267], [15085, -11.282684], [11088, -11.311886], [35, -11.327383], [12903, -11.33724], [286, -11.348423], [120016, -11.39742], [5274, -11.424908], [99, -11.446613], [42, -11.473983], [127906, -11.491298], [65, -11.500505], [7510, -11.522129], [318, -11.529991], [13380, -11.530066], [77, -11.54404], [14163, -11.606276], [75, -11.629893], [78, -11.662855], [79, -11.681045], [89, -11.694391], [13187, -11.725956], [101, -11.72621], [121, -11.744852], [2342, -11.753602], [8445, -11.758013], [40, -11.771486], [622, -11.788908], [38464, -11.812735], [1829, -11.815416], [120, -11.822762], [67, -11.822979], [43, -11.851918], [47, -11.875671], [14139, -11.909343], [100, -11.914306], [68, -11.922326], [53650, -11.95726], [109, -11.993785], [120018, -12.002136], [59, -12.046661], [4088, -12.052052], [275, -12.060006], [4396, -12.080992], [39, -12.092229], [3688, -12.103988], [34, -12.11355], [1275, -12.125736], [105, -12.151076], [120022, -12.160102], [14825, -12.173344], [5169, -12.1809], [80, -12.188207], [66085, -12.189863], [83, -12.205646], [14791, -12.211181], [33, -12.229601], [36, -12.241157], [88, -12.249005], [9635, -12.252522], [262, -12.252573], [26691, -12.252896], [45, -12.258134], [439, -12.261952], [26458, -12.266203]], "logprob_of_token": -7.732057, "top1_top2_margin": 4.138958, "top6_top7_margin": 0.496389}, {"gen_index": 14, "token": 32, "top": [[576, -0.008022], [735, -6.88334], [32, -6.967399], [61, -6.995432], [1829, -8.243021], [44, -8.383392], [58, -8.893761], [46, -8.90167], [286, -9.04417], [120007, -9.184325], [528, -9.440772], [318, -9.441831], [14188, -9.496231], [120022, -9.621435], [263, -9.632608], [63, -9.860776], [1270, -9.914723], [439, -10.05646], [919, -10.12721], [476, -10.127769], [49, -10.129282], [95, -10.155253], [14169, -10.21447], [14153, -10.348267], [1064, -10.418175], [120717, -10.478723], [622, -10.488028], [766, -10.581702], [275, -10.671245], [378, -10.721207], [127797, -10.813757], [20758, -10.82806], [824, -10.878222], [120016, -10.886416], [1656, -10.886822], [14417, -10.889872], [279, -10.988729], [830, -11.00268], [120000, -11.021369], [936, -11.024847], [59, -11.027061], [568, -11.047817], [3167, -11.06408], [2839, -11.069512], [1073, -11.09596], [262, -11.126517], [2459, -11.167544], [297, -11.174053], [4088, -11.188131], [14713, -11.192711], [48, -11.217114], [120001, -11.225625], [120091, -11.247295], [45, -11.278234], [379, -11.284664], [120018, -11.370888], [120006, -11.383032], [1765, -11.416584], [7510, -11.420545], [3402, -11.423314], [15397, -11.459217], [120103, -11.461229], [474, -11.471037], [11035, -11.485692], [377, -11.507347], [120, -11.513042], [745, -11.517839], [120008, -11.542301], [4743, -11.561662], [1309, -11.590137], [20773, -11.638008], [310, -11.664073], [3688, -11.665405], [54, -11.692], [10, -11.694418], [14139, -11.707429], [8055, -11.725937], [4508, -11.72781], [2457, -11.754468], [4384, -11.75794], [327, -11.771333], [467, -11.782799], [1275, -11.792638], [2125, -11.798319], [5274, -11.817411], [22241, -11.824068], [34259, -11.828997], [39, -11.841778], [34, -11.878426], [420, -11.899638], [38685, -11.936064], [8150, -11.957005], [18390, -11.965128], [1062, -11.987344], [120098, -11.993731], [18092, -12.001717], [120002, -12.022399], [502, -12.03513], [127906, -12.051066], [946, -12.055649]], "logprob_of_token": -6.967399, "top1_top2_margin": 6.875318, "top6_top7_margin": 0.510368}, {"gen_index": 15, "token": 49, "top": [[32, -0.006954], [49, -6.961304], [1829, -7.825834], [120022, -8.154613], [14153, -8.307761], [14188, -8.621851], [120018, -8.625505], [5274, -9.025939], [946, -9.385019], [766, -9.551846], [3417, -9.662664], [122407, -9.78642], [14169, -9.923276], [263, -10.157326], [941, -10.169277], [32099, -10.195238], [286, -10.303679], [120610, -10.371387], [120383, -10.389006], [120008, -10.403542], [20758, -10.421968], [936, -10.432934], [120103, -10.43563], [55, -10.494587], [14172, -10.535661], [2945, -10.554857], [7510, -10.587285], [297, -10.587706], [103844, -10.638514], [502, -10.653151], [4330, -10.656059], [576, -10.67033], [51, -10.678177], [44, -10.696711], [262, -10.698415], [120007, -10.725334], [1409, -10.743232], [57, -10.749609], [46, -10.750746], [318, -10.904911], [622, -10.905519], [735, -10.90588], [405, -10.907101], [120098, -10.941628], [120014, -10.966549], [439, -11.011752], [14139, -11.025448], [50, -11.104805], [63, -11.160824], [14179, -11.162014], [327, -11.219204], [2125, -11.307164], [54, -11.311281], [59, -11.323452], [346, -11.325817], [48, -11.337978], [377, -11.386276], [4075, -11.393418], [1688, -11.425396], [1410, -11.427454], [120029, -11.436775], [22168, -11.456174], [420, -11.50256], [1917, -11.506938], [8355, -11.510962], [2051, -11.511083], [565, -11.528669], [2213, -11.577784], [1333, -11.600912], [476, -11.612104], [379, -11.613253], [1765, -11.648602], [474, -11.659739], [527, -11.674475], [13460, -11.678443], [14541, -11.680557], [3326, -11.692688], [275, -11.723708], [14267, -11.739652], [18586, -11.770036], [120001, -11.774641], [127906, -11.823641], [56, -11.828803], [3678, -11.836812], [15397, -11.845448], [4508, -11.848372], [42613, -11.850783], [2403, -11.866287], [6391, -11.888492], [1073, -11.903531], [1064, -11.962961], [1178, -11.979351], [58, -11.986353], [8545, -11.993399], [4743, -12.03908], [2457, -12.042816], [14325, -12.049524], [75112, -12.052891], [4396, -12.062686], [4869, -12.086669]], "logprob_of_token": -6.961304, "top1_top2_margin": 6.95435, "top6_top7_margin": 0.003654}, {"gen_index": 16, "token": 55, "top": [[49, -0.047858], [57, -4.584245], [51, -4.664498], [55, -5.164598], [54, -5.734149], [50, -5.868979], [56, -6.68185], [32, -7.011839], [53, -7.158524], [48, -7.179264], [52, -7.513999], [14267, -7.942534], [2051, -8.675048], [119464, -9.052303], [766, -9.630231], [7368, -9.695404], [14153, -9.840762], [286, -9.848958], [44, -9.87494], [946, -9.926776], [1829, -9.943293], [576, -10.186996], [120007, -10.280366], [622, -10.483], [127906, -10.492814], [1073, -10.500338], [5274, -10.500381], [120022, -10.647016], [582, -10.68117], [63, -10.730998], [327, -10.802367], [48976, -10.822269], [7510, -10.825255], [3311, -10.826037], [262, -10.837585], [735, -10.873], [379, -10.903591], [14188, -10.929705], [46, -10.932283], [58, -10.944433], [1972, -10.957002], [81389, -10.965608], [59, -10.997108], [1765, -11.04071], [1209, -11.047394], [297, -11.048575], [941, -11.067468], [318, -11.094705], [294, -11.117423], [936, -11.119859], [263, -11.127149], [120000, -11.253425], [6617, -11.259436], [275, -11.264901], [1409, -11.298577], [377, -11.306606], [61, -11.340861], [2125, -11.371442], [12009, -11.419743], [14169, -11.422403], [3326, -11.441166], [106373, -11.445477], [7469, -11.473728], [93, -11.474108], [527, -11.483229], [1083, -11.502688], [1049, -11.512358], [1343, -11.513061], [6391, -11.527225], [474, -11.579203], [26767, -11.603389], [10, -11.671567], [14179, -11.738803], [14330, -11.755599], [20486, -11.764784], [393, -11.770586], [34387, -11.770666], [310, -11.773072], [2150, -11.780743], [502, -11.794421], [3301, -11.800445], [34, -11.804996], [3688, -11.810845], [5169, -11.819795], [405, -11.825736], [120061, -11.839864], [120008, -11.871892], [39, -11.8729], [43, -11.884631], [10767, -11.891341], [20668, -11.893661], [99187, -11.894855], [3516, -11.911269], [543, -11.927074], [408, -11.930718], [120098, -11.932155], [115856, -11.933081], [21746, -11.946445], [1064, -11.953647], [4284, -11.956365]], "logprob_of_token": -5.164598, "top1_top2_margin": 4.536386, "top6_top7_margin": 0.812871}, {"gen_index": 17, "token": 44, "top": [[55, -0.08338], [54, -3.346283], [53, -3.559853], [57, -5.582496], [56, -5.655877], [49, -5.769195], [51, -5.899771], [52, -7.722095], [48, -7.750207], [50, -8.167708], [44, -8.902111], [32, -10.151542], [46, -10.294256], [766, -10.491858], [10, -11.236279], [263, -11.298192], [93, -11.423811], [58, -11.452258], [63, -11.475854], [275, -11.934376], [127906, -11.964733], [946, -12.015903], [59, -12.046621], [76591, -12.049509], [420, -12.076997], [576, -12.085279], [47, -12.157237], [286, -12.157721], [45, -12.285634], [43, -12.294005], [14153, -12.34582], [120007, -12.34736], [735, -12.418164], [318, -12.476121], [294, -12.52775], [120000, -12.552951], [19827, -12.576522], [2125, -12.5855], [61, -12.693388], [1073, -12.708879], [377, -12.720615], [34, -12.752445], [5274, -12.762175], [379, -12.81283], [12843, -12.860652], [117101, -12.957011], [40, -12.982981], [101, -13.004194], [353, -13.005565], [279, -13.02955], [3688, -13.047842], [314, -13.053268], [41, -13.066259], [4869, -13.132014], [11104, -13.136175], [125, -13.142564], [14188, -13.149903], [2342, -13.185981], [941, -13.18896], [14139, -13.241227], [15543, -13.246941], [7510, -13.256679], [3003, -13.275044], [120, -13.332458], [4075, -13.33989], [37, -13.345582], [1829, -13.364968], [33, -13.37825], [1765, -13.389194], [36, -13.422925], [3326, -13.435635], [582, -13.467509], [4743, -13.47872], [7360, -13.485655], [3301, -13.486541], [262, -13.507276], [120107, -13.52434], [1410, -13.533221], [310, -13.534672], [1921, -13.539704], [936, -13.550407], [531, -13.5532], [5398, -13.556734], [589, -13.560493], [100, -13.56479], [3311, -13.570495], [95, -13.581049], [1049, -13.596291], [68, -13.604425], [11115, -13.605164], [120436, -13.6071], [115, -13.612268], [14147, -13.643357], [622, -13.64535], [68743, -13.65163], [3603, -13.67838], [94, -13.678554], [1043, -13.684521], [1409, -13.686564], [527, -13.690197]], "logprob_of_token": -8.902111, "top1_top2_margin": 3.262903, "top6_top7_margin": 0.130576}, {"gen_index": 18, "token": 14169, "top": [[44, -0.023945], [263, -4.724777], [275, -6.316539], [46, -6.345425], [120007, -6.487103], [120016, -6.70361], [10, -7.097265], [766, -7.521585], [286, -8.260779], [1829, -8.517488], [121119, -8.561986], [120028, -8.592787], [63, -8.625182], [59, -8.69005], [14188, -8.839733], [124969, -8.975009], [735, -8.994333], [58, -9.005936], [314, -9.174148], [7510, -9.201258], [11861, -9.301832], [3688, -9.322693], [14169, -9.386008], [127906, -9.419817], [988, -9.424483], [120022, -9.526768], [745, -9.579551], [120468, -9.600505], [420, -9.680035], [120021, -9.73368], [120409, -9.837156], [36040, -9.842624], [120008, -9.880611], [120000, -9.968121], [622, -9.972694], [120375, -9.992766], [14147, -10.11189], [576, -10.118906], [32, -10.121881], [14153, -10.203657], [120103, -10.204837], [121083, -10.324887], [936, -10.326019], [327, -10.382303], [310, -10.388089], [1765, -10.437984], [14161, -10.470457], [467, -10.5757], [120, -10.593478], [120003, -10.668555], [377, -10.745445], [318, -10.776108], [1043, -10.783348], [20758, -10.786705], [120038, -10.80048], [262, -10.843763], [45, -10.858], [2931, -10.948395], [69555, -10.965984], [1394, -11.038187], [47, -11.038435], [122158, -11.055182], [120002, -11.086267], [1073, -11.195216], [393, -11.21207], [2410, -11.212955], [3078, -11.217096], [120436, -11.219918], [49, -11.224314], [120014, -11.226988], [405, -11.236585], [5275, -11.246319], [1062, -11.307747], [1117, -11.322096], [20486, -11.322493], [120107, -11.332504], [14179, -11.346548], [1275, -11.39922], [120724, -11.435526], [1409, -11.446304], [126545, -11.459655], [126203, -11.485119], [476, -11.506837], [568, -11.514712], [474, -11.523212], [4743, -11.544555], [2362, -11.557832], [120410, -11.575472], [3003, -11.61651], [379, -11.65357], [16604, -11.662577], [7419, -11.663157], [294, -11.68998], [5274, -11.708429], [8894, -11.741433], [120081, -11.748772], [48, -11.754724], [33, -11.760654], [3326, -11.764891], [47526, -11.788901]], "logprob_of_token": -9.386008, "top1_top2_margin": 4.700832, "top6_top7_margin": 0.393654}, {"gen_index": 20, "token": 576, "top": [[55, -0.010434], [56, -5.742158], [54, -6.576767], [49, -6.920684], [53, -7.243528], [51, -7.73319], [57, -8.172394], [52, -8.188691], [50, -9.050154], [48, -9.755982], [76591, -10.548486], [263, -10.648776], [12843, -11.03416], [117101, -11.108913], [576, -11.125775], [44, -11.257201], [68202, -11.435246], [127906, -11.449294], [19827, -11.503929], [35, -11.532299], [63, -11.537224], [294, -11.645364], [10, -11.737601], [32, -11.7651], [104223, -11.77072], [286, -11.822021], [120007, -11.839335], [46, -11.903332], [120016, -11.969352], [622, -11.982327], [95, -12.042735], [66032, -12.09085], [766, -12.112346], [58, -12.15557], [275, -12.204265], [135, -12.242903], [38336, -12.303416], [183, -12.303607], [6559, -12.310104], [61, -12.326262], [580, -12.369591], [39, -12.4554], [90236, -12.463662], [94, -12.465236], [2051, -12.522887], [26209, -12.537881], [42, -12.554835], [120, -12.562223], [14139, -12.602462], [65, -12.608119], [379, -12.658023], [1606, -12.664825], [110, -12.66911], [7510, -12.672344], [34, -12.714452], [5274, -12.718455], [59, -12.721253], [13380, -12.734362], [310, -12.748353], [115, -12.788231], [735, -12.798036], [40, -12.806694], [3990, -12.844112], [31663, -12.847974], [262, -12.857591], [120000, -12.86939], [96, -12.872947], [1112, -12.882868], [467, -12.893123], [279, -12.904304], [99, -12.930645], [123, -12.940262], [97, -12.957838], [318, -12.958669], [79, -12.968265], [4573, -12.975174], [68743, -12.983038], [78, -12.991233], [121, -13.001879], [1073, -13.025407], [589, -13.065693], [69, -13.082994], [127908, -13.088809], [36, -13.099743], [14153, -13.112022], [75, -13.146839], [4688, -13.150433], [101, -13.188072], [33, -13.200923], [60, -13.20094], [14825, -13.214023], [77, -13.215003], [276, -13.215674], [76, -13.217942], [4396, -13.219534], [5005, -13.225252], [297, -13.228888], [568, -13.235353], [1829, -13.239298], [7684, -13.252736]], "logprob_of_token": -11.125775, "top1_top2_margin": 5.731725, "top6_top7_margin": 0.439204}, {"gen_index": 21, "token": 32, "top": [[576, -0.003114], [61, -7.939677], [32, -8.212572], [735, -8.720762], [1829, -9.306396], [44, -9.63653], [58, -9.802591], [14188, -10.158043], [46, -10.194554], [120022, -10.59617], [286, -10.718393], [49, -11.003687], [318, -11.00821], [120007, -11.027847], [263, -11.03095], [14153, -11.11658], [622, -11.167803], [439, -11.277702], [476, -11.293882], [14169, -11.331873], [1073, -11.356035], [1270, -11.394651], [297, -11.424717], [919, -11.445899], [936, -11.462549], [528, -11.46959], [120006, -11.525209], [120091, -11.569466], [3167, -11.60922], [262, -11.610135], [127797, -11.670532], [1656, -11.698969], [766, -11.699713], [14417, -11.705223], [95, -11.761201], [59, -11.770879], [2459, -11.773805], [14713, -11.788223], [15397, -11.892762], [279, -11.91642], [120717, -11.998976], [120008, -12.032471], [378, -12.038393], [474, -12.055227], [10, -12.073717], [63, -12.084755], [275, -12.112566], [327, -12.135159], [568, -12.159831], [18092, -12.274041], [1064, -12.27601], [420, -12.326214], [20758, -12.327356], [8055, -12.333285], [5809, -12.336178], [1339, -12.351071], [379, -12.381254], [127906, -12.382036], [824, -12.410067], [120001, -12.414986], [2839, -12.44535], [5274, -12.44961], [15703, -12.451633], [4743, -12.463124], [120016, -12.491034], [393, -12.521978], [50, -12.560766], [14139, -12.575481], [1410, -12.592112], [14179, -12.592916], [120, -12.603876], [120103, -12.610092], [1275, -12.61398], [22241, -12.65338], [8150, -12.661038], [48, -12.672286], [38685, -12.706239], [7510, -12.735431], [3660, -12.740543], [310, -12.742], [34, -12.744232], [1409, -12.763598], [941, -12.764957], [745, -12.772028], [120000, -12.772316], [34259, -12.778335], [467, -12.784132], [582, -12.78563], [2362, -12.800594], [679, -12.80678], [2457, -12.846354], [4088, -12.869978], [120018, -12.881021], [1309, -12.895601], [18390, -12.926983], [527, -12.944879], [120098, -12.949606], [3688, -12.958386], [47, -12.965157], [1917, -12.981784]], "logprob_of_token": -8.212572, "top1_top2_margin": 7.936562, "top6_top7_margin": 0.166061}, {"gen_index": 22, "token": 49, "top": [[32, -0.00568], [14153, -7.874918], [49, -8.254919], [1829, -9.073245], [946, -9.292014], [14188, -9.384704], [5274, -9.68507], [120018, -9.685596], [3417, -9.875065], [122407, -9.888794], [4330, -10.017494], [120022, -10.04167], [1333, -10.124763], [2945, -10.152193], [286, -10.199798], [14169, -10.271252], [120008, -10.340534], [262, -10.453874], [32099, -10.509545], [13460, -10.584567], [766, -10.5923], [44, -10.699402], [318, -10.811255], [735, -10.889175], [4075, -10.918587], [120014, -11.012771], [14267, -11.134123], [622, -11.170324], [7510, -11.183022], [936, -11.197121], [420, -11.229694], [941, -11.268762], [14172, -11.2818], [120383, -11.282262], [1410, -11.296799], [3326, -11.306136], [2051, -11.343048], [263, -11.383215], [297, -11.402831], [3678, -11.453135], [22168, -11.554543], [327, -11.577388], [3688, -11.611191], [103844, -11.653675], [2125, -11.661604], [120004, -11.669611], [14139, -11.671368], [71599, -11.709211], [120029, -11.727736], [576, -11.755786], [523, -11.764193], [14179, -11.781436], [527, -11.781742], [120098, -11.842426], [127906, -11.856758], [543, -11.868956], [346, -11.898835], [120001, -11.926348], [565, -12.007838], [3301, -12.022005], [379, -12.029629], [20758, -12.034742], [46, -12.036016], [502, -12.050087], [8545, -12.058855], [2246, -12.079283], [1688, -12.093664], [1073, -12.133069], [122790, -12.134384], [97582, -12.134817], [57, -12.135733], [474, -12.151654], [1578, -12.164954], [2150, -12.171548], [59, -12.178574], [1427, -12.186411], [14541, -12.188712], [56097, -12.189001], [2457, -12.193571], [8355, -12.200274], [393, -12.20237], [4127, -12.240965], [50, -12.243865], [1254, -12.257675], [378, -12.31137], [1765, -12.335685], [120103, -12.336571], [939, -12.347348], [18586, -12.360736], [120610, -12.362514], [669, -12.366587], [8416, -12.374632], [4869, -12.389861], [45, -12.45393], [15397, -12.467519], [14419, -12.469141], [530, -12.472309], [2403, -12.477661], [405, -12.481906], [453, -12.483685]], "logprob_of_token": -8.254919, "top1_top2_margin": 7.869238, "top6_top7_margin": 0.300366}, {"gen_index": 23, "token": 57, "top": [[49, -0.012676], [50, -6.333052], [57, -6.371463], [51, -6.469691], [48, -7.108022], [55, -7.950715], [56, -8.104878], [32, -8.491845], [53, -8.617648], [52, -8.927205], [54, -9.081532], [127906, -9.089744], [127908, -9.842626], [1829, -9.900823], [263, -10.066948], [44, -10.132767], [120007, -10.352206], [10, -10.62913], [766, -10.692367], [14169, -10.728244], [5274, -10.889459], [14188, -10.908927], [14153, -10.927679], [576, -10.943489], [120000, -10.9678], [622, -10.980639], [63, -10.991983], [127907, -10.994706], [13684, -11.016974], [286, -11.033715], [7510, -11.118314], [294, -11.141526], [735, -11.225539], [120016, -11.248775], [745, -11.403643], [1073, -11.488396], [946, -11.505549], [318, -11.548789], [39, -11.56385], [46, -11.59738], [275, -11.621514], [120021, -11.634932], [377, -11.662302], [262, -11.691351], [26767, -11.756309], [120022, -11.883809], [58, -11.922648], [14825, -11.929892], [1336, -11.949755], [11685, -11.954066], [59, -12.019912], [3688, -12.074636], [941, -12.112267], [18092, -12.116261], [12009, -12.131984], [543, -12.135509], [3003, -12.157662], [1914, -12.163583], [120014, -12.176163], [582, -12.190891], [565, -12.204324], [3167, -12.206127], [83911, -12.231905], [531, -12.23706], [3311, -12.237448], [1409, -12.245439], [420, -12.251959], [379, -12.260959], [3523, -12.284677], [120, -12.291525], [327, -12.323603], [60, -12.324433], [11861, -12.356184], [6238, -12.372723], [120003, -12.376908], [314, -12.40119], [3326, -12.414468], [3350, -12.415751], [94, -12.415864], [1394, -12.417408], [14179, -12.432493], [647, -12.455026], [14165, -12.460142], [2459, -12.470411], [34, -12.471208], [22467, -12.487553], [1043, -12.500221], [3078, -12.514059], [717, -12.518999], [103784, -12.568123], [14147, -12.570961], [61, -12.573125], [120004, -12.587007], [2125, -12.594369], [405, -12.601974], [919, -12.616152], [467, -12.623209], [45, -12.658846], [36, -12.659763], [123, -12.664159]], "logprob_of_token": -6.371463, "top1_top2_margin": 6.320376, "top6_top7_margin": 0.154163}, {"gen_index": 24, "token": 44, "top": [[57, -0.022705], [56, -4.772058], [49, -5.493873], [53, -5.577604], [55, -6.176287], [51, -6.731209], [54, -8.120455], [52, -8.868246], [44, -8.979523], [48, -9.077155], [50, -9.15497], [766, -10.354946], [32, -10.47934], [46, -10.630586], [735, -10.686285], [10, -10.807644], [263, -10.856407], [318, -11.109199], [576, -11.190934], [120007, -11.26274], [58, -11.384756], [127906, -11.429544], [63, -11.679296], [275, -11.793053], [622, -11.857237], [262, -11.869263], [502, -11.916333], [286, -11.99261], [84797, -12.031448], [946, -12.067328], [34, -12.13961], [379, -12.234945], [3688, -12.237877], [1275, -12.249827], [59, -12.27384], [14395, -12.371971], [24677, -12.448944], [330, -12.449117], [420, -12.485309], [279, -12.515787], [936, -12.55312], [941, -12.624618], [101, -12.628275], [61, -12.649699], [565, -12.67779], [310, -12.686456], [314, -12.733327], [46160, -12.756935], [1765, -12.811548], [3326, -12.816907], [7510, -12.848936], [474, -12.852406], [294, -12.866318], [93, -12.911331], [327, -12.930524], [14153, -12.950613], [3660, -12.970016], [1410, -12.993793], [120000, -13.033432], [5274, -13.06622], [120016, -13.073667], [45, -13.079171], [70, -13.082404], [97, -13.152911], [919, -13.162125], [531, -13.16653], [878, -13.192359], [120021, -13.217883], [14188, -13.225129], [393, -13.233563], [47, -13.255148], [120022, -13.259661], [1829, -13.259874], [115, -13.283488], [3003, -13.290369], [40165, -13.319788], [33, -13.320538], [3078, -13.333871], [1073, -13.353699], [527, -13.355301], [439, -13.359389], [1115, -13.359917], [43, -13.382023], [137, -13.384756], [65, -13.386831], [467, -13.406745], [127908, -13.420862], [377, -13.42936], [120436, -13.437827], [120014, -13.439297], [1784, -13.464435], [100, -13.472766], [543, -13.474541], [40, -13.47877], [2125, -13.504352], [745, -13.512149], [4743, -13.539882], [1656, -13.540147], [120, -13.542278], [656, -13.554293]], "logprob_of_token": -8.979523, "top1_top2_margin": 4.749353, "top6_top7_margin": 1.389246}, {"gen_index": 25, "token": 14169, "top": [[44, -0.007648], [263, -6.032911], [10, -7.104734], [120007, -7.559783], [120016, -8.033611], [275, -8.104013], [46, -8.202526], [766, -8.958744], [14188, -8.969307], [121119, -9.21511], [286, -9.281217], [59, -9.2926], [988, -9.301266], [58, -9.440238], [127906, -9.70636], [1829, -9.72678], [124969, -9.735494], [120028, -9.828032], [120468, -9.885421], [735, -10.144749], [14169, -10.184318], [120008, -10.379761], [63, -10.407042], [120021, -10.419876], [745, -10.433075], [11861, -10.433813], [32, -10.485638], [120375, -10.553404], [120, -10.740197], [120022, -10.744402], [314, -10.814638], [420, -10.83926], [3688, -10.902136], [7510, -10.968263], [120000, -10.984574], [120409, -11.046993], [576, -11.162737], [47, -11.21986], [120038, -11.228242], [262, -11.299661], [121083, -11.340878], [120103, -11.358617], [49, -11.383869], [622, -11.488607], [120003, -11.513226], [936, -11.587883], [14153, -11.596679], [531, -11.59839], [126545, -11.631656], [1765, -11.63769], [36040, -11.66176], [318, -11.734613], [3003, -11.77201], [69555, -11.784311], [45, -11.793864], [20758, -11.80444], [405, -11.939228], [2410, -11.997486], [126203, -12.006172], [2931, -12.017543], [310, -12.025114], [327, -12.045552], [122158, -12.048863], [467, -12.091794], [3290, -12.104339], [1073, -12.105461], [47526, -12.160843], [34, -12.165263], [4343, -12.165625], [120107, -12.216767], [377, -12.222298], [1275, -12.228514], [2313, -12.235641], [120410, -12.242375], [1394, -12.330093], [474, -12.36418], [5274, -12.463783], [82347, -12.489909], [14161, -12.53303], [568, -12.535986], [56294, -12.542534], [120436, -12.556645], [43, -12.560609], [279, -12.614394], [120014, -12.622648], [14147, -12.649133], [1409, -12.67976], [120081, -12.696939], [2342, -12.710281], [48, -12.717313], [1062, -12.738519], [294, -12.744236], [120023, -12.774689], [379, -12.778641], [3078, -12.783607], [125, -12.791871], [115, -12.794025], [669, -12.821321], [2362, -12.841681], [14139, -12.846125]], "logprob_of_token": -10.184318, "top1_top2_margin": 6.025263, "top6_top7_margin": 0.098513}, {"gen_index": 26, "token": 56, "top": [[14169, -0.015824], [7510, -5.490372], [936, -6.871875], [286, -7.436156], [120103, -7.555599], [262, -7.596864], [120022, -7.6545], [32, -8.074599], [120087, -8.937801], [120016, -9.111136], [393, -9.173955], [36040, -9.237208], [120014, -9.2394], [120, -9.258358], [1409, -9.382451], [263, -9.514711], [3326, -9.533824], [127906, -9.541436], [941, -9.626434], [1776, -9.721416], [565, -9.759639], [669, -9.78849], [120007, -9.801973], [16604, -9.816497], [318, -10.075517], [69555, -10.092647], [1765, -10.191241], [5274, -10.225113], [120383, -10.239711], [735, -10.244374], [527, -10.286851], [310, -10.309909], [766, -10.39914], [20758, -10.41869], [18092, -10.446884], [14172, -10.448483], [16897, -10.45996], [14541, -10.482984], [4743, -10.486184], [3688, -10.521469], [120942, -10.530289], [622, -10.5506], [2213, -10.640896], [3924, -10.648655], [474, -10.654681], [14419, -10.751348], [346, -10.762518], [543, -10.768725], [453, -10.772074], [14188, -10.77409], [502, -10.813275], [120008, -10.813575], [120355, -10.850493], [107274, -10.880207], [1688, -10.888072], [121122, -10.888186], [739, -10.89078], [56, -10.915694], [120021, -10.945956], [8545, -10.957178], [34259, -10.966338], [1744, -10.967975], [327, -10.993184], [120001, -11.018586], [799, -11.04339], [467, -11.084826], [20890, -11.104781], [2931, -11.104861], [120081, -11.129391], [120004, -11.131499], [120098, -11.140326], [1275, -11.140932], [1333, -11.160885], [14158, -11.171482], [2150, -11.193512], [275, -11.208499], [120375, -11.21371], [946, -11.247307], [49, -11.258629], [122629, -11.264554], [1689, -11.317767], [523, -11.340688], [42298, -11.356736], [1785, -11.401177], [2457, -11.416076], [10, -11.431069], [120724, -11.459156], [1336, -11.467751], [3504, -11.47077], [14791, -11.485576], [35519, -11.50567], [14154, -11.509126], [576, -11.518517], [11861, -11.526871], [3078, -11.527714], [420, -11.52818], [1829, -11.53742], [1578, -11.54378], [1083, -11.548826], [18085, -11.556099]], "logprob_of_token": -10.915694, "top1_top2_margin": 5.474548, "top6_top7_margin": 0.057636}, {"gen_index": 27, "token": 576, "top": [[56, -0.001105], [57, -8.531166], [55, -8.652449], [53, -9.168521], [49, -9.298694], [51, -9.674884], [54, -9.879696], [50, -10.178618], [52, -10.252837], [263, -10.696631], [48, -10.76291], [10, -11.212996], [127906, -11.489306], [37720, -12.258239], [32, -12.542289], [14031, -12.606632], [115, -13.115453], [136, -13.226856], [120016, -13.296002], [73987, -13.357125], [120724, -13.544707], [127908, -13.548368], [10133, -13.557099], [576, -13.608098], [38555, -13.658334], [29350, -13.796453], [6238, -13.901033], [95, -13.903351], [120007, -13.924232], [1243, -13.946732], [40143, -13.990519], [63, -14.041874], [294, -14.077798], [7510, -14.105446], [120, -14.120578], [120038, -14.142478], [735, -14.197362], [34006, -14.225995], [27835, -14.253901], [72432, -14.408657], [101, -14.410447], [120021, -14.469454], [647, -14.491376], [44, -14.509092], [184, -14.52194], [110, -14.53506], [120014, -14.550318], [103, -14.558057], [3078, -14.601015], [2051, -14.601632], [125693, -14.664449], [122, -14.667579], [34, -14.67043], [46, -14.677598], [622, -14.70766], [72, -14.709517], [120000, -14.771556], [1606, -14.779063], [93710, -14.821453], [90879, -14.83726], [766, -14.851224], [77, -14.885144], [60, -14.894834], [1829, -14.903638], [65, -14.941231], [325, -14.951169], [286, -14.953794], [3688, -14.981523], [107, -14.993188], [5274, -15.03015], [936, -15.033553], [78, -15.049747], [580, -15.053141], [275, -15.053373], [4622, -15.059462], [262, -15.083135], [97, -15.093637], [589, -15.096791], [727, -15.099549], [120844, -15.101796], [96, -15.12641], [36, -15.133301], [946, -15.133588], [1043, -15.154232], [86374, -15.156211], [531, -15.172965], [113, -15.179875], [110441, -15.193781], [467, -15.206205], [582, -15.210835], [117, -15.2115], [104, -15.245049], [168, -15.24756], [4688, -15.254879], [7264, -15.26253], [61, -15.264073], [45, -15.296779], [94, -15.29753], [120002, -15.30323], [266, -15.305103]], "logprob_of_token": -13.608098, "top1_top2_margin": 8.530061, "top6_top7_margin": 0.204812}, {"gen_index": 28, "token": 32, "top": [[576, -0.002706], [263, -7.960163], [61, -8.518574], [10, -8.986053], [127906, -9.632462], [1829, -9.846473], [735, -9.864235], [120091, -9.868246], [32, -9.953769], [120103, -10.569967], [120016, -10.619359], [14188, -10.623259], [120022, -10.684517], [58, -10.712614], [120007, -11.064253], [14169, -11.087069], [44, -11.216478], [46, -11.366684], [3167, -11.375904], [49, -11.381742], [262, -11.409431], [297, -11.471371], [286, -11.482001], [14417, -11.625252], [120087, -11.715174], [275, -11.758137], [95, -11.836085], [63, -11.881414], [622, -11.950267], [1073, -12.025301], [34, -12.096516], [69555, -12.099577], [120724, -12.119729], [50, -12.14533], [48, -12.149405], [18092, -12.164354], [766, -12.167012], [120038, -12.178028], [127908, -12.184888], [528, -12.240895], [120021, -12.244031], [120001, -12.244222], [14153, -12.254406], [2457, -12.262525], [1270, -12.263317], [127797, -12.345699], [120006, -12.357876], [318, -12.373113], [1339, -12.412327], [5274, -12.43168], [120717, -12.434875], [439, -12.51969], [378, -12.527826], [19464, -12.557286], [11861, -12.562422], [14825, -12.566132], [120018, -12.587915], [941, -12.595746], [15397, -12.595808], [120014, -12.600962], [14713, -12.602647], [45, -12.64049], [120, -12.649381], [47, -12.658701], [20758, -12.659479], [2459, -12.660622], [6238, -12.694979], [669, -12.708477], [476, -12.720237], [120000, -12.761645], [8055, -12.786413], [34259, -12.787228], [327, -12.790514], [5809, -12.796501], [1656, -12.8351], [919, -12.83581], [314, -12.843717], [582, -12.858358], [936, -12.859561], [15703, -12.871337], [420, -12.893337], [22241, -12.930844], [527, -12.932657], [120835, -12.945266], [2125, -12.94981], [3660, -12.958406], [589, -12.961239], [474, -12.969873], [120173, -12.990195], [14139, -13.000275], [125, -13.016973], [381, -13.040966], [19166, -13.044457], [279, -13.074431], [13627, -13.09082], [18390, -13.102556], [120008, -13.110182], [36, -13.118053], [1275, -13.125622], [120098, -13.158578]], "logprob_of_token": -9.953769, "top1_top2_margin": 7.957456, "top6_top7_margin": 0.017762}, {"gen_index": 29, "token": 50, "top": [[32, -0.004505], [50, -9.118624], [263, -9.236519], [120022, -9.385974], [5274, -9.462116], [1829, -9.781265], [120014, -9.868161], [14153, -9.890202], [120103, -9.938662], [127906, -10.089113], [946, -10.209212], [941, -10.290291], [14188, -10.423774], [120018, -10.460911], [262, -10.474968], [286, -10.539347], [318, -10.591341], [3417, -10.758594], [1333, -10.77969], [766, -10.815245], [120004, -10.854465], [19969, -10.869248], [622, -10.914326], [7510, -10.950835], [10, -10.97381], [14139, -11.017414], [120087, -11.020187], [297, -11.107831], [20758, -11.262701], [936, -11.319393], [3326, -11.389054], [439, -11.528522], [44, -11.534733], [120610, -11.535048], [474, -11.537159], [923, -11.578432], [565, -11.579702], [14141, -11.607852], [120008, -11.666937], [63, -11.68863], [2945, -11.705965], [49, -11.722422], [2403, -11.774633], [46, -11.810074], [502, -11.826768], [103844, -11.843267], [120098, -11.855729], [2125, -11.873499], [4075, -11.885794], [14169, -11.888539], [32099, -11.90414], [294, -11.913549], [69555, -11.931877], [669, -11.943913], [2213, -11.995666], [97582, -12.002648], [1688, -12.032243], [1409, -12.056337], [120007, -12.065707], [527, -12.093903], [3166, -12.115719], [1311, -12.155958], [543, -12.173603], [3688, -12.192005], [327, -12.197683], [120016, -12.209982], [3252, -12.294577], [346, -12.299827], [120420, -12.324732], [275, -12.352161], [1254, -12.352571], [1578, -12.366033], [735, -12.385424], [120001, -12.409768], [2150, -12.413974], [393, -12.42795], [1073, -12.465647], [3678, -12.469819], [9, -12.47595], [122407, -12.484904], [14179, -12.485516], [922, -12.498652], [45, -12.516979], [58725, -12.532278], [2457, -12.54908], [75112, -12.552173], [1410, -12.581506], [5169, -12.61288], [19464, -12.632254], [58, -12.646471], [1042, -12.650194], [453, -12.657177], [13460, -12.672822], [18586, -12.673363], [1336, -12.683689], [1275, -12.699398], [14541, -12.714803], [34, -12.719608], [3167, -12.725938], [835, -12.733447]], "logprob_of_token": -9.118624, "top1_top2_margin": 9.114118, "top6_top7_margin": 0.086896}, {"gen_index": 30, "token": 49, "top": [[50, -0.053962], [49, -3.270574], [51, -6.075505], [32, -7.048511], [57, -7.463025], [14267, -7.870887], [14330, -8.238916], [55, -8.407892], [56, -8.41855], [53, -8.516536], [21746, -8.95164], [48, -8.960686], [263, -9.063192], [127906, -9.097478], [52, -9.203403], [766, -9.551704], [16422, -9.628661], [946, -9.678727], [1829, -9.680186], [2051, -9.768226], [120007, -9.801129], [54, -9.815436], [44, -9.816119], [7368, -9.821095], [12027, -9.887339], [10, -10.061456], [4823, -10.139864], [5274, -10.167918], [14153, -10.200663], [286, -10.212014], [120022, -10.247566], [262, -10.312748], [1972, -10.425014], [622, -10.471807], [63, -10.503623], [14188, -10.518218], [576, -10.555584], [19969, -10.586977], [474, -10.616488], [127907, -10.63236], [81389, -10.788027], [941, -10.790977], [1073, -10.833602], [294, -10.874171], [119464, -10.9047], [37943, -10.919869], [58, -10.940881], [48976, -10.95258], [14676, -10.968185], [3326, -10.97704], [59, -11.064357], [7510, -11.07056], [46, -11.081962], [936, -11.110611], [3544, -11.120746], [318, -11.123153], [379, -11.134719], [275, -11.142602], [1427, -11.15512], [120016, -11.182194], [327, -11.183372], [735, -11.254705], [1083, -11.310954], [12009, -11.348291], [120000, -11.369542], [93, -11.405679], [120103, -11.453389], [297, -11.493331], [34387, -11.498369], [14179, -11.536468], [1753, -11.568908], [3688, -11.570299], [565, -11.576304], [47, -11.581724], [39863, -11.584173], [127908, -11.58619], [72450, -11.603324], [3301, -11.606181], [582, -11.606367], [1765, -11.61456], [377, -11.621284], [6391, -11.647646], [14825, -11.651061], [34, -11.677256], [61, -11.690648], [120014, -11.695685], [527, -11.70509], [5169, -11.711034], [543, -11.739209], [493, -11.743222], [20486, -11.744425], [2125, -11.749254], [7360, -11.752011], [1311, -11.754672], [120061, -11.760051], [39, -11.822207], [7243, -11.841196], [3078, -11.856517], [669, -11.859004], [5275, -11.885716]], "logprob_of_token": -3.270574, "top1_top2_margin": 3.216612, "top6_top7_margin": 0.368029}, {"gen_index": 31, "token": 44, "top": [[49, -0.005677], [48, -6.056363], [51, -6.505764], [53, -8.146623], [50, -8.380777], [55, -8.755465], [263, -9.250937], [57, -9.629709], [52, -9.888516], [32, -10.069122], [44, -10.290421], [10, -10.348498], [127906, -10.601967], [120007, -10.647953], [54, -11.334322], [56, -11.48877], [46, -11.51945], [766, -11.631905], [120016, -11.701761], [63, -12.188993], [120022, -12.309443], [286, -12.313159], [58, -12.414072], [294, -12.446851], [318, -12.457818], [735, -12.46604], [275, -12.51207], [120021, -12.634344], [2125, -12.71249], [5274, -12.723989], [622, -12.750559], [120103, -12.873951], [941, -12.935979], [13684, -13.035994], [34, -13.046414], [88, -13.071856], [576, -13.203479], [61, -13.218512], [262, -13.22188], [120000, -13.241159], [353, -13.248598], [73, -13.332494], [11685, -13.366245], [120014, -13.367623], [59, -13.38224], [93, -13.416127], [327, -13.487514], [95, -13.488127], [120, -13.572681], [1073, -13.628311], [946, -13.633087], [105, -13.657639], [379, -13.68696], [107, -13.690407], [120038, -13.690897], [45, -13.691799], [43, -13.714781], [314, -13.71561], [439, -13.718969], [589, -13.745265], [40, -13.781923], [42, -13.783807], [39, -13.785118], [47, -13.852734], [115, -13.860372], [62, -13.871131], [310, -13.874444], [127908, -13.878903], [1062, -13.879103], [2342, -13.892406], [14141, -13.915973], [20486, -13.918303], [279, -13.93521], [120087, -13.959615], [97, -13.959641], [94, -13.997686], [36, -14.015066], [325, -14.025805], [297, -14.032877], [1829, -14.037131], [76, -14.04318], [120028, -14.045894], [2839, -14.056013], [123, -14.070573], [502, -14.075799], [3252, -14.080959], [14153, -14.085895], [266, -14.104448], [108, -14.117309], [125, -14.132843], [3326, -14.144985], [527, -14.157415], [377, -14.170059], [66, -14.196417], [14417, -14.208426], [4075, -14.209989], [467, -14.212951], [120410, -14.215199], [14188, -14.231628], [14139, -14.23545]], "logprob_of_token": -10.290421, "top1_top2_margin": 6.050686, "top6_top7_margin": 0.495472}]}, {"prompt": "Translation to German: the weather is beautiful today", "input_ids": [33607, 318, 4867, 58, 262, 5995, 735, 5445, 4484], "generated_ids": [46, 543, 5995, 735, 33341, 286, 262, 21499, 735, 5657, 46, 543, 5995, 735, 5445, 286, 262, 21499, 735, 5657, 46, 543, 5995, 735, 5445, 286, 262, 21499, 735, 5657, 46, 543], "rows": [{"gen_index": 0, "token": 46, "top": [[46, -0.537685], [275, -1.238328], [735, -3.427562], [44, -3.711473], [314, -3.936829], [286, -4.826334], [33, -4.925732], [59, -5.378697], [4137, -5.750629], [2519, -5.893059], [622, -6.115573], [763, -6.448175], [4484, -6.989567], [936, -7.00686], [36209, -7.085936], [58, -7.165145], [5445, -7.271877], [263, -7.49983], [1829, -7.740708], [14188, -7.767784], [766, -7.948912], [2457, -8.055889], [5995, -8.12742], [34, -8.184742], [3583, -8.211027], [63, -8.247047], [1790, -8.249524], [4679, -8.325126], [15853, -8.374668], [13594, -8.518875], [93457, -8.522896], [2459, -8.732826], [310, -8.791382], [36836, -8.801661], [33341, -8.812395], [30538, -8.944889], [1062, -8.958599], [330, -8.97057], [120101, -8.988039], [779, -9.042553], [262, -9.155317], [1275, -9.219526], [127906, -9.238907], [44455, -9.321125], [120007, -9.333195], [120015, -9.366165], [26951, -9.379562], [120347, -9.39275], [467, -9.417917], [1043, -9.420826], [120241, -9.458508], [120230, -9.471804], [10, -9.503887], [8175, -9.519987], [656, -9.54896], [120016, -9.566011], [120399, -9.581062], [3078, -9.603882], [379, -9.648659], [19043, -9.672037], [18126, -9.679186], [127655, -9.759964], [45375, -9.762249], [3688, -9.854769], [919, -9.866085], [405, -9.87076], [120068, -9.887426], [946, -9.892128], [14896, -9.90049], [32, -9.923481], [14153, -9.958401], [3368, -9.960089], [318, -9.970694], [14052, -9.977812], [6791, -9.992491], [1765, -10.058203], [31642, -10.07069], [595, -10.083015], [1409, -10.123192], [3247, -10.130335], [20486, -10.187431], [284, -10.247293], [777, -10.270882], [120099, -10.276924], [18390, -10.2967], [589, -10.329464], [1921, -10.343132], [3918, -10.35181], [378, -10.367439], [120078, -10.440762], [44176, -10.444633], [2548, -10.448229], [5019, -10.468454], [12611, -10.476734], [38183, -10.496359], [5380, -10.528637], [375, -10.562601], [4272, -10.567579], [36198, -10.578566], [1155, -10.592028]], "logprob_of_token": -0.537685, "top1_top2_margin": 0.700643, "top6_top7_margin": 0.099399}, {"gen_index": 1, "token": 543, "top": [[46, -0.891099], [275, -1.11564], [314, -2.914019], [33, -3.072019], [4484, -3.655938], [44, -4.045199], [2519, -4.078416], [262, -4.222149], [735, -5.309325], [4679, -5.455543], [59, -5.526917], [1829, -5.673591], [14188, -5.882936], [286, -6.176564], [58, -6.338013], [766, -6.478528], [263, -6.507309], [4137, -6.516523], [22648, -6.691981], [622, -6.775719], [36209, -6.866401], [1765, -6.888452], [10, -6.940696], [936, -6.981519], [14153, -7.045083], [405, -7.15169], [63, -7.153459], [12611, -7.288183], [5995, -7.318031], [763, -7.322148], [3737, -7.352829], [310, -7.36848], [5445, -7.491157], [15299, -7.528751], [120399, -7.574273], [120230, -7.576257], [14792, -7.591455], [779, -7.768426], [14052, -7.77138], [127906, -7.786103], [589, -7.851312], [44455, -7.911569], [669, -7.944863], [2213, -7.957191], [127655, -8.004772], [3326, -8.080948], [93457, -8.081835], [1275, -8.081952], [30538, -8.088139], [1043, -8.177995], [19043, -8.19062], [4101, -8.223311], [34, -8.238407], [3863, -8.263084], [1409, -8.420461], [3368, -8.482286], [13594, -8.487679], [8545, -8.517769], [120078, -8.560623], [120007, -8.619616], [543, -8.640268], [1790, -8.708013], [1112, -8.74511], [19078, -8.789408], [4869, -8.796114], [1921, -8.818951], [5071, -8.881738], [120347, -8.89376], [15096, -8.907216], [379, -8.912284], [2549, -8.917727], [777, -8.926638], [120099, -8.943666], [30989, -8.946688], [120031, -8.957072], [1739, -8.973245], [120241, -9.020879], [1042, -9.026499], [38183, -9.027109], [318, -9.033926], [120016, -9.034223], [1410, -9.046777], [565, -9.057456], [941, -9.057467], [6785, -9.08466], [1806, -9.088586], [17728, -9.121368], [18390, -9.128616], [900, -9.141712], [617, -9.164897], [325, -9.166422], [3660, -9.168536], [527, -9.169262], [32, -9.179933], [919, -9.186316], [946, -9.18868], [120108, -9.249413], [7510, -9.25129], [2544, -9.273991], [9093, -9.276181]], "logprob_of_token": -8.640268, "top1_top2_margin": 0.224541, "top6_top7_margin": 0.033217}, {"gen_index": 2, "token": 5995, "top": [[543, -0.145512], [9093, -3.441448], [127906, -4.131752], [120014, -4.673546], [3780, -5.22365], [1336, -5.33517], [14161, -5.468826], [669, -5.533264], [1689, -5.567423], [14896, -5.646327], [1231, -5.693195], [14147, -5.819664], [120004, -5.881647], [4759, -6.000916], [262, -6.006805], [766, -6.087722], [1692, -6.463651], [4484, -6.506088], [8266, -6.849595], [1194, -6.862328], [127655, -6.912471], [24775, -7.024765], [7339, -7.081998], [1914, -7.087433], [1905, -7.218623], [611, -7.284514], [5775, -7.296972], [32, -7.394978], [23070, -7.474978], [2883, -7.66144], [6372, -7.718422], [6693, -7.742801], [717, -7.795691], [742, -7.796094], [1580, -7.843716], [12359, -7.880433], [2560, -7.917503], [20605, -7.977015], [14777, -8.155253], [5439, -8.193995], [2743, -8.234017], [29182, -8.292855], [5995, -8.294636], [3501, -8.43629], [735, -8.453921], [840, -8.457162], [9643, -8.480653], [1921, -8.496808], [8307, -8.531113], [8067, -8.536771], [7510, -8.568572], [4246, -8.615968], [21977, -8.62617], [14188, -8.64844], [1829, -8.663537], [1988, -8.805704], [4888, -8.824004], [6143, -8.865207], [10, -8.872268], [9830, -8.89512], [6814, -8.928959], [6859, -8.930213], [1254, -8.943537], [7098, -8.994928], [4703, -9.062832], [263, -9.070655], [15934, -9.072844], [13389, -9.081691], [19710, -9.134896], [6983, -9.153833], [4001, -9.179502], [946, -9.228742], [17285, -9.262969], [27775, -9.283801], [95245, -9.286881], [5274, -9.292295], [1962, -9.293163], [35088, -9.317153], [19313, -9.326938], [1047, -9.36629], [11185, -9.378953], [25250, -9.402661], [2865, -9.405732], [2291, -9.419892], [5438, -9.452628], [5445, -9.454215], [15980, -9.469839], [124489, -9.471993], [523, -9.495463], [3872, -9.509391], [127908, -9.511058], [39124, -9.517646], [7940, -9.526389], [44116, -9.527544], [7643, -9.575971], [14053, -9.614402], [14153, -9.629126], [6455, -9.655849], [53535, -9.69966], [1049, -9.715377]], "logprob_of_token": -8.294636, "top1_top2_margin": 3.295936, "top6_top7_margin": 0.133656}, {"gen_index": 3, "token": 735, "top": [[5995, -0.039308], [14795, -4.285779], [21499, -4.838317], [8175, -6.564228], [5445, -7.145256], [543, -7.170849], [36836, -7.660544], [33341, -8.10768], [262, -8.283764], [24775, -8.529801], [4101, -8.553038], [1460, -8.618007], [14950, -8.682616], [1843, -8.718007], [3388, -8.890862], [17392, -8.986297], [5848, -9.070739], [5954, -9.13041], [14852, -9.204049], [30279, -9.242891], [11268, -9.359484], [14803, -9.438323], [2935, -9.544259], [18762, -9.55589], [9172, -9.608665], [6547, -9.618943], [47805, -9.624462], [4273, -9.655778], [8263, -9.66653], [7882, -9.712987], [34210, -9.740663], [25343, -9.872571], [1427, -9.928201], [5344, -9.993995], [14341, -9.994576], [5865, -10.030113], [7940, -10.075318], [28326, -10.09731], [15893, -10.106631], [18686, -10.190156], [4739, -10.194963], [6785, -10.196231], [11309, -10.205557], [32, -10.207414], [4595, -10.218458], [43211, -10.221492], [6700, -10.224919], [6339, -10.255992], [11053, -10.280996], [6074, -10.286704], [1788, -10.299537], [2059, -10.308496], [9089, -10.310739], [3515, -10.322419], [263, -10.323877], [10822, -10.327506], [5403, -10.334435], [61599, -10.335914], [735, -10.336432], [2550, -10.379592], [14321, -10.380043], [8275, -10.383511], [3519, -10.410687], [1324, -10.414292], [2302, -10.421796], [24244, -10.443414], [1584, -10.444279], [19898, -10.456586], [1652, -10.461365], [46, -10.470085], [766, -10.516699], [12913, -10.523244], [30084, -10.546771], [48683, -10.548379], [7852, -10.556016], [5657, -10.58616], [58, -10.590711], [3713, -10.612948], [5381, -10.614696], [14264, -10.619843], [946, -10.651798], [8358, -10.661538], [3917, -10.679132], [5061, -10.681634], [2838, -10.690798], [6344, -10.691329], [936, -10.693816], [4774, -10.708238], [4850, -10.710021], [353, -10.710109], [5032, -10.715653], [44, -10.716115], [6563, -10.731839], [4931, -10.756106], [7424, -10.757348], [19682, -10.770176], [2821, -10.775157], [14394, -10.777686], [29314, -10.785157], [6678, -10.788177]], "logprob_of_token": -10.336432, "top1_top2_margin": 4.246472, "top6_top7_margin": 0.489695}, {"gen_index": 4, "token": 33341, "top": [[735, -0.00849], [4484, -5.359167], [14950, -7.382668], [622, -8.418117], [919, -8.502404], [18717, -8.642559], [5995, -8.801644], [439, -8.946842], [286, -9.129786], [378, -9.556973], [824, -9.838902], [589, -10.399006], [476, -10.438882], [5445, -10.455938], [22648, -10.46013], [766, -10.533749], [1503, -10.569736], [7222, -10.572897], [52075, -10.75016], [24348, -10.769269], [2459, -10.773989], [8175, -10.806322], [3368, -10.821025], [1309, -10.875891], [1656, -10.960897], [58, -10.965348], [1270, -11.009651], [3583, -11.033023], [44, -11.034181], [4225, -11.125182], [14795, -11.144992], [3881, -11.192483], [4703, -11.204041], [36836, -11.231606], [527, -11.241581], [9093, -11.321582], [33341, -11.330993], [4088, -11.382376], [1064, -11.401951], [8150, -11.411424], [528, -11.4175], [14060, -11.433296], [3992, -11.438871], [127655, -11.469978], [11577, -11.485546], [379, -11.521835], [15299, -11.562881], [279, -11.573214], [8157, -11.607226], [13032, -11.609744], [11317, -11.620223], [7499, -11.626669], [17714, -11.632713], [7732, -11.644861], [565, -11.649788], [9727, -11.675036], [568, -11.685213], [330, -11.694913], [14896, -11.704085], [11910, -11.707414], [23754, -11.733088], [46, -11.753225], [617, -11.768013], [60478, -11.824903], [21499, -11.844711], [53535, -11.899949], [38183, -11.905155], [18296, -11.916335], [27673, -11.983966], [49987, -12.007417], [45375, -12.024885], [1112, -12.066378], [1410, -12.067759], [32, -12.06958], [13255, -12.105615], [2286, -12.113121], [763, -12.130224], [12359, -12.140156], [2935, -12.14731], [8263, -12.154756], [4895, -12.248241], [2272, -12.264669], [9668, -12.273486], [5607, -12.313909], [20773, -12.313958], [2548, -12.367874], [3918, -12.36854], [12243, -12.376181], [15853, -12.377223], [24251, -12.398113], [3519, -12.40097], [1275, -12.423113], [104437, -12.428006], [22347, -12.460627], [2457, -12.477826], [6172, -12.488858], [24973, -12.514566], [262, -12.530125], [14353, -12.530229], [3363, -12.548619]], "logprob_of_token": -11.330993, "top1_top2_margin": 5.350677, "top6_top7_margin": 0.159085}, {"gen_index": 6, "token": 262, "top": [[286, -0.629348], [4484, -1.053403], [46, -2.532125], [44, -4.684503], [310, -4.870762], [3368, -4.893592], [622, -6.456853], [22648, -6.874489], [275, -6.962801], [15853, -7.494205], [59, -7.550739], [936, -7.585606], [4101, -7.640152], [3583, -7.832888], [262, -7.956479], [763, -8.297314], [2213, -8.314793], [314, -8.446085], [15299, -8.50788], [3247, -8.555427], [1744, -8.731039], [4703, -8.750826], [36209, -8.912948], [5995, -8.956291], [33, -9.004742], [53535, -9.073616], [3992, -9.217636], [45375, -9.228757], [9093, -9.282146], [766, -9.368314], [120230, -9.374708], [1806, -9.399961], [33341, -9.442025], [1790, -9.469633], [5071, -9.517787], [4137, -9.532722], [543, -9.621378], [2548, -9.646482], [7510, -9.655183], [779, -9.670897], [4774, -9.70088], [3660, -9.823795], [1323, -9.890144], [1275, -9.897081], [318, -9.911959], [63, -9.936239], [6785, -9.940802], [467, -10.026123], [1829, -10.069937], [3519, -10.10659], [2403, -10.110605], [3688, -10.13446], [379, -10.136206], [2549, -10.17448], [420, -10.180208], [11966, -10.219788], [14188, -10.238058], [44455, -10.251818], [7060, -10.2845], [777, -10.347961], [1112, -10.35715], [21499, -10.371919], [1409, -10.389692], [5837, -10.391126], [2457, -10.433087], [2362, -10.435982], [12359, -10.468735], [3093, -10.487066], [58, -10.489781], [14052, -10.496696], [19078, -10.512755], [1765, -10.531448], [51577, -10.533064], [3863, -10.533959], [3755, -10.552635], [47, -10.573108], [4743, -10.635893], [735, -10.640244], [4508, -10.707313], [938, -10.780435], [799, -10.782387], [7331, -10.79521], [527, -10.800045], [3918, -10.816968], [3737, -10.830825], [1410, -10.844103], [120241, -10.845602], [1988, -10.851629], [474, -10.889205], [15849, -10.906346], [6803, -10.942747], [3827, -10.975069], [5445, -10.980077], [124489, -10.994538], [15984, -11.020796], [16330, -11.03524], [565, -11.037596], [405, -11.062851], [47805, -11.075747], [1739, -11.108139]], "logprob_of_token": -7.956479, "top1_top2_margin": 0.424055, "top6_top7_margin": 1.563261}, {"gen_index": 8, "token": 735, "top": [[21499, -0.245728], [14795, -2.347845], [5995, -2.638182], [47805, -3.916231], [262, -5.54314], [48683, -5.874585], [1460, -6.290854], [36836, -6.373221], [4101, -6.536023], [14852, -7.21335], [4774, -7.28882], [5848, -7.462604], [4273, -7.463507], [18762, -7.687263], [5954, -7.702159], [16719, -7.84452], [11527, -7.927649], [14950, -7.980478], [8263, -8.080696], [33341, -8.184295], [1324, -8.25338], [17392, -8.433838], [15893, -8.455963], [19090, -8.641847], [5865, -8.721458], [26960, -8.88429], [6547, -8.904401], [22597, -8.913809], [9172, -8.915007], [6785, -9.025251], [34210, -9.038118], [4484, -9.117641], [4836, -9.127687], [43211, -9.228873], [2935, -9.229781], [24627, -9.237854], [5657, -9.306422], [7852, -9.311352], [2550, -9.33394], [23015, -9.400381], [84254, -9.415545], [5344, -9.418151], [3917, -9.437815], [14257, -9.536533], [10822, -9.537861], [40540, -9.568956], [286, -9.57106], [14803, -9.572139], [3881, -9.5835], [14805, -9.59336], [9089, -9.612351], [3388, -9.618453], [20726, -9.672692], [24244, -9.696976], [50359, -9.749046], [41436, -9.756979], [16320, -9.886045], [19866, -9.892223], [13729, -9.903175], [543, -9.917597], [33611, -9.961378], [90637, -9.963575], [6803, -10.006267], [11966, -10.006758], [8175, -10.010692], [33340, -10.023771], [24775, -10.031529], [3583, -10.054306], [32537, -10.05587], [1843, -10.064761], [14341, -10.089081], [30279, -10.148177], [4850, -10.148976], [5381, -10.159932], [20341, -10.160351], [2468, -10.209899], [6678, -10.246997], [8275, -10.254433], [46098, -10.255405], [84272, -10.278751], [735, -10.283897], [30486, -10.308683], [15984, -10.332491], [14211, -10.3379], [1584, -10.345781], [1427, -10.358708], [12747, -10.362564], [11309, -10.367115], [121428, -10.368812], [3016, -10.39002], [27673, -10.391653], [10703, -10.398303], [52075, -10.409916], [5445, -10.426081], [15708, -10.445121], [12290, -10.451839], [10725, -10.477627], [2376, -10.487493], [14841, -10.499363], [19783, -10.50742]], "logprob_of_token": -10.283897, "top1_top2_margin": 2.102117, "top6_top7_margin": 0.416269}, {"gen_index": 9, "token": 5657, "top": [[735, -0.000119], [18717, -10.223605], [21499, -10.643851], [919, -11.802328], [568, -12.042781], [5657, -12.394917], [2459, -12.899189], [330, -13.252137], [286, -13.614993], [439, -13.623286], [589, -13.714908], [476, -13.716376], [11910, -13.727812], [18126, -13.850289], [14896, -13.996683], [24348, -14.083926], [378, -14.148496], [7222, -14.166883], [4769, -14.340482], [11527, -14.347107], [4895, -14.352411], [44, -14.40286], [115, -14.408577], [11966, -14.449651], [766, -14.503495], [5445, -14.618451], [8157, -14.638307], [824, -14.685102], [1309, -14.802804], [528, -14.845071], [1270, -14.866431], [32, -14.928828], [60478, -14.931735], [58, -15.010205], [46, -15.132352], [262, -15.146963], [830, -15.191897], [1656, -15.232949], [11577, -15.281039], [4484, -15.285856], [48683, -15.365153], [18854, -15.410139], [617, -15.427829], [18296, -15.434531], [10794, -15.452432], [5995, -15.492291], [47805, -15.577868], [622, -15.593749], [37159, -15.632667], [7732, -15.643258], [1829, -15.68897], [34643, -15.697007], [576, -15.77737], [8263, -15.788438], [9727, -15.800197], [310, -15.822009], [17714, -15.865454], [13032, -15.90235], [127655, -15.926948], [4836, -15.940643], [1064, -15.950796], [8175, -15.977422], [279, -15.985823], [14188, -16.001448], [12243, -16.023949], [2492, -16.120596], [20869, -16.143772], [11035, -16.187092], [379, -16.2363], [12195, -16.2374], [543, -16.255529], [275, -16.264547], [19317, -16.288254], [263, -16.340248], [4088, -16.348986], [2347, -16.351231], [35099, -16.372915], [15762, -16.375807], [527, -16.382822], [3688, -16.399836], [53186, -16.423178], [31445, -16.436251], [6172, -16.452526], [20726, -16.478962], [7017, -16.503708], [941, -16.508623], [25982, -16.509283], [20773, -16.543818], [26116, -16.576191], [14153, -16.579283], [405, -16.583469], [11308, -16.585699], [16719, -16.629232], [5415, -16.629868], [23754, -16.654238], [4384, -16.659689], [2952, -16.66955], [1275, -16.67865], [936, -16.715727], [31752, -16.732349]], "logprob_of_token": -12.394917, "top1_top2_margin": 10.223486, "top6_top7_margin": 0.504272}, {"gen_index": 11, "token": 543, "top": [[46, -0.110995], [286, -2.630671], [4484, -3.733052], [275, -5.501427], [44, -6.581279], [310, -6.782663], [59, -6.975863], [314, -7.926473], [120230, -9.301323], [936, -9.576622], [5657, -9.590313], [543, -9.629744], [15853, -9.860529], [9093, -9.98673], [622, -10.346078], [4703, -10.432033], [36209, -10.496865], [4769, -10.582569], [12359, -10.797702], [3368, -10.962284], [44455, -10.984102], [262, -10.988481], [4137, -11.158761], [5071, -11.211206], [1829, -11.232498], [763, -11.410226], [120241, -11.436728], [120099, -11.487683], [63, -11.496412], [7510, -11.550388], [53535, -11.557548], [21499, -11.587038], [33, -11.693331], [766, -11.742839], [2213, -11.786394], [14188, -11.876081], [1275, -11.879318], [325, -11.916512], [1409, -11.926752], [58, -11.984758], [3583, -12.02545], [735, -12.056214], [379, -12.213766], [120007, -12.242397], [120078, -12.275911], [120001, -12.298982], [1765, -12.344795], [12611, -12.3967], [779, -12.40743], [44102, -12.421178], [22648, -12.432432], [474, -12.481955], [3093, -12.509933], [3247, -12.521599], [5445, -12.538025], [2403, -12.551475], [3519, -12.562349], [120064, -12.579002], [799, -12.655075], [120140, -12.725362], [467, -12.771364], [45375, -12.820949], [120399, -12.869146], [1988, -12.887592], [14153, -12.888972], [38183, -12.90101], [263, -12.902808], [1744, -12.905797], [15299, -12.915881], [16554, -12.950048], [393, -12.956352], [318, -12.957569], [32, -13.000902], [3992, -13.028578], [24973, -13.031326], [93457, -13.062383], [270, -13.071299], [3755, -13.078798], [13594, -13.083506], [25250, -13.088589], [420, -13.116091], [777, -13.121558], [405, -13.140539], [127906, -13.148209], [2549, -13.158475], [5995, -13.171716], [3660, -13.199978], [120031, -13.210592], [2457, -13.22984], [127655, -13.24107], [80867, -13.253175], [4743, -13.262854], [1806, -13.268217], [2550, -13.27804], [8175, -13.28045], [28336, -13.287636], [120003, -13.307856], [9289, -13.353929], [1410, -13.364929], [120260, -13.436023]], "logprob_of_token": -9.629744, "top1_top2_margin": 2.519676, "top6_top7_margin": 0.1932}, {"gen_index": 14, "token": 5445, "top": [[735, -0.001293], [14950, -7.85755], [4484, -9.388145], [1503, -9.923906], [919, -10.129281], [286, -10.167208], [439, -10.408743], [2722, -10.596453], [18717, -10.666798], [476, -10.783141], [824, -10.797758], [9668, -10.846349], [3881, -10.996243], [5995, -11.08161], [622, -11.156872], [33341, -11.216421], [1309, -11.312424], [14060, -11.419355], [5607, -11.545023], [1656, -11.573121], [378, -11.580584], [2459, -11.619555], [11577, -11.64678], [5445, -11.663441], [330, -11.884466], [7222, -11.935713], [52075, -11.951836], [14353, -12.005262], [4895, -12.064143], [8157, -12.09913], [24348, -12.281452], [4088, -12.37503], [5865, -12.379765], [13255, -12.399447], [17714, -12.479866], [589, -12.542959], [1064, -12.640274], [7732, -12.683182], [11317, -12.692237], [11910, -12.713467], [528, -12.731421], [1270, -12.742918], [3363, -12.767262], [1041, -12.918516], [9727, -12.965572], [5344, -12.990269], [568, -13.007624], [14896, -13.027813], [127655, -13.060462], [15762, -13.085592], [766, -13.102989], [58, -13.132675], [20787, -13.137371], [8175, -13.179123], [13032, -13.196542], [44, -13.219079], [2584, -13.238157], [7499, -13.250742], [5954, -13.297343], [23754, -13.327076], [38997, -13.334839], [576, -13.339531], [527, -13.339849], [75248, -13.377481], [14795, -13.460894], [10794, -13.476329], [11035, -13.492342], [18126, -13.496981], [18296, -13.511071], [8150, -13.524374], [2286, -13.528517], [5415, -13.55324], [22347, -13.582805], [49987, -13.590656], [36836, -13.591219], [20028, -13.62042], [32, -13.651399], [16874, -13.661019], [11308, -13.695002], [22648, -13.714041], [379, -13.73251], [6344, -13.745528], [12243, -13.754619], [34643, -13.756039], [27673, -13.762567], [9471, -13.785898], [16514, -13.789084], [4384, -13.804888], [26040, -13.815926], [46, -13.859179], [1843, -13.865363], [32578, -13.867017], [2463, -13.868434], [6172, -13.889134], [2374, -13.911824], [3583, -13.916919], [24356, -13.922924], [617, -13.923256], [279, -13.947927], [44886, -13.9587]], "logprob_of_token": -11.663441, "top1_top2_margin": 7.856256, "top6_top7_margin": 0.241535}, {"gen_index": 16, "token": 262, "top": [[286, -0.146789], [4484, -2.020483], [46, -7.157006], [310, -7.727454], [15853, -8.236414], [4101, -8.59523], [936, -8.610106], [622, -8.916761], [9093, -9.130299], [22648, -9.239267], [53535, -9.247725], [5071, -9.567804], [275, -9.613066], [12359, -9.650244], [4703, -9.70677], [44, -9.768444], [763, -9.77179], [2213, -10.061003], [3583, -10.291998], [3368, -10.575577], [318, -10.601265], [3519, -10.698069], [45375, -10.712847], [33341, -10.736349], [420, -10.786703], [5995, -10.888449], [3247, -10.958054], [1806, -10.965963], [3093, -11.152706], [314, -11.194067], [5445, -11.224392], [1275, -11.230427], [779, -11.230795], [15299, -11.277016], [3755, -11.292606], [59, -11.322195], [735, -11.325062], [467, -11.351093], [3918, -11.422199], [379, -11.583364], [2457, -11.607391], [1409, -11.609077], [36836, -11.657108], [262, -11.737534], [58, -11.788906], [4272, -11.807051], [270, -11.861816], [36209, -11.889603], [3737, -11.907581], [8175, -11.911467], [14795, -11.934345], [2549, -11.982683], [1790, -11.986124], [65560, -12.017536], [2403, -12.055532], [766, -12.118759], [59099, -12.135544], [1739, -12.176069], [1744, -12.197958], [25250, -12.255398], [4774, -12.291145], [5657, -12.318766], [393, -12.345066], [33, -12.351276], [7510, -12.358923], [3688, -12.379021], [29009, -12.38282], [4769, -12.384848], [2051, -12.39728], [1765, -12.400888], [26530, -12.403509], [4529, -12.420408], [2362, -12.433023], [1988, -12.455084], [4137, -12.463818], [80867, -12.465984], [900, -12.471968], [19078, -12.508005], [7557, -12.508911], [41514, -12.511072], [34, -12.519819], [474, -12.552454], [4638, -12.566437], [16554, -12.584305], [6785, -12.587112], [1410, -12.659451], [1776, -12.689129], [12742, -12.689976], [1840, -12.694599], [799, -12.705589], [6803, -12.714458], [3863, -12.730213], [3660, -12.751123], [279, -12.756426], [1093, -12.796091], [502, -12.830484], [1155, -12.852617], [4375, -12.859903], [5978, -12.864393], [2548, -12.870228]], "logprob_of_token": -11.737534, "top1_top2_margin": 1.873693, "top6_top7_margin": 0.014875}, {"gen_index": 19, "token": 5657, "top": [[735, -4e-05], [18717, -11.702826], [21499, -12.345528], [330, -12.957219], [568, -13.298789], [2459, -13.387648], [919, -13.410952], [7222, -14.016492], [5657, -14.022766], [439, -14.077453], [1270, -14.156395], [476, -14.167964], [18126, -14.239024], [10794, -14.253213], [286, -14.310712], [1656, -14.482203], [24348, -14.553462], [8157, -14.658386], [1309, -14.686717], [378, -14.747432], [14896, -14.863866], [824, -15.189502], [589, -15.257119], [528, -15.291738], [18296, -15.350146], [37159, -15.370952], [44, -15.436506], [17714, -15.510865], [11910, -15.532534], [1064, -15.556058], [46, -15.581216], [310, -15.693192], [32, -15.714732], [4769, -15.805437], [8150, -15.816793], [11577, -15.832305], [4895, -15.866566], [622, -15.879367], [766, -15.906247], [830, -15.962396], [31445, -15.968889], [115, -15.988035], [11527, -16.138552], [4088, -16.166941], [4484, -16.181295], [279, -16.323263], [576, -16.334667], [60478, -16.334751], [7732, -16.341169], [9727, -16.422464], [120007, -16.461296], [73707, -16.487045], [318, -16.555668], [379, -16.580435], [34643, -16.605272], [527, -16.605875], [1275, -16.666258], [58, -16.713083], [617, -16.726982], [7499, -16.76512], [6172, -16.768501], [11317, -16.822479], [262, -16.84605], [25288, -16.856049], [7017, -16.861517], [63, -16.869732], [49987, -16.897211], [1409, -16.90484], [19317, -16.907595], [20773, -16.915007], [18854, -16.92527], [47805, -16.936079], [936, -16.951941], [12195, -16.954565], [35099, -17.027849], [5445, -17.067266], [4384, -17.13608], [20726, -17.141361], [44102, -17.144625], [5995, -17.160109], [127655, -17.189833], [941, -17.22279], [467, -17.225674], [275, -17.226261], [2347, -17.253588], [120670, -17.26955], [5415, -17.286793], [9668, -17.317945], [11308, -17.331831], [13308, -17.332865], [1829, -17.346933], [12243, -17.347355], [47, -17.363503], [8954, -17.364836], [2286, -17.365934], [35269, -17.394239], [20615, -17.39957], [13032, -17.400515], [48683, -17.405527], [4836, -17.452471]], "logprob_of_token": -14.022766, "top1_top2_margin": 11.702787, "top6_top7_margin": 0.023304}, {"gen_index": 21, "token": 543, "top": [[46, -0.002199], [275, -6.48788], [286, -7.818186], [314, -9.395445], [4484, -9.669877], [44, -11.049353], [21499, -11.236504], [310, -11.373882], [120230, -11.954325], [63, -12.025702], [735, -12.136086], [936, -12.408206], [5071, -12.44426], [15853, -12.877079], [36209, -12.983709], [543, -13.047163], [59, -13.471971], [262, -13.501512], [120099, -13.510275], [44455, -13.549326], [5995, -13.645756], [33, -13.740287], [622, -13.756252], [325, -13.860394], [766, -13.931439], [2213, -14.002349], [47805, -14.105788], [4137, -14.170736], [120007, -14.185312], [12359, -14.308498], [120241, -14.357845], [120078, -14.429171], [7510, -14.57986], [58, -14.581145], [3368, -14.63511], [763, -14.645616], [3545, -14.659801], [1275, -14.664821], [11527, -14.705334], [120140, -14.711908], [1765, -14.756016], [7331, -14.878613], [9093, -14.889677], [379, -14.904238], [19078, -15.043083], [1409, -15.071673], [1829, -15.074867], [5657, -15.139532], [420, -15.178018], [779, -15.206593], [4703, -15.278855], [32, -15.27965], [1806, -15.294771], [467, -15.381007], [14188, -15.384209], [120031, -15.478556], [120118, -15.483377], [1112, -15.492033], [120001, -15.5021], [93457, -15.53862], [4769, -15.611164], [10725, -15.627708], [127906, -15.653113], [3688, -15.722355], [120399, -15.740436], [568, -15.801724], [474, -15.802731], [3918, -15.816193], [589, -15.828884], [3247, -15.832016], [120015, -15.837022], [9289, -15.839408], [318, -15.945796], [120020, -15.953819], [327, -15.957517], [1460, -15.965846], [120100, -15.984279], [263, -15.997331], [125874, -16.00746], [2457, -16.012526], [919, -16.023941], [12611, -16.029583], [10, -16.040146], [120054, -16.044065], [4101, -16.049671], [3711, -16.05607], [1988, -16.064087], [120347, -16.067755], [878, -16.094831], [47, -16.100544], [799, -16.130692], [5445, -16.137249], [110358, -16.138645], [3326, -16.143854], [26530, -16.154137], [1776, -16.20578], [1225, -16.20657], [375, -16.223886], [120618, -16.225468], [120110, -16.246704]], "logprob_of_token": -13.047163, "top1_top2_margin": 6.485681, "top6_top7_margin": 0.187151}, {"gen_index": 23, "token": 735, "top": [[5995, -0.637452], [21499, -3.621179], [24775, -5.523089], [30279, -5.927743], [11268, -5.999994], [14795, -6.449523], [41801, -6.607731], [262, -6.744582], [527, -6.781271], [16719, -6.852619], [1460, -6.912944], [11527, -7.025633], [47805, -7.095088], [32, -7.307505], [3515, -7.312119], [2554, -7.549482], [851, -7.567487], [543, -7.589352], [7852, -7.622581], [4273, -7.624371], [10461, -7.635229], [5344, -7.702524], [5865, -7.764968], [5954, -7.769378], [2376, -7.784396], [7510, -7.827051], [61599, -7.8336], [17392, -7.907233], [3143, -7.91281], [5660, -7.925948], [3388, -7.928878], [735, -7.950524], [1843, -8.02692], [782, -8.031203], [33341, -8.070897], [1305, -8.074779], [2711, -8.087731], [1343, -8.098489], [1427, -8.101234], [3917, -8.105211], [873, -8.151636], [4595, -8.155272], [3142, -8.161979], [4206, -8.17483], [6785, -8.193226], [7940, -8.207927], [82241, -8.213275], [669, -8.258534], [36836, -8.272629], [1194, -8.28041], [14805, -8.286402], [14950, -8.287202], [8175, -8.291979], [6547, -8.323811], [3353, -8.338384], [1523, -8.339063], [4101, -8.34028], [125884, -8.341638], [14803, -8.34376], [28326, -8.347872], [6700, -8.365545], [10301, -8.369096], [10054, -8.374244], [3937, -8.384246], [286, -8.386235], [1324, -8.392272], [12042, -8.395968], [26040, -8.396635], [2645, -8.399856], [936, -8.40816], [13709, -8.410023], [4205, -8.415855], [59199, -8.416508], [16320, -8.420601], [1788, -8.435788], [2821, -8.437945], [34210, -8.442715], [1309, -8.446719], [44, -8.447287], [3335, -8.449456], [11053, -8.479711], [5032, -8.479876], [46, -8.482149], [6900, -8.488134], [5714, -8.489196], [1963, -8.493345], [11443, -8.494866], [10262, -8.4982], [4758, -8.498832], [9172, -8.499509], [2887, -8.506958], [12913, -8.514952], [6563, -8.521408], [2302, -8.521975], [1970, -8.522189], [1806, -8.52778], [1744, -8.533669], [7292, -8.539164], [2213, -8.541726], [2935, -8.546612]], "logprob_of_token": -7.950524, "top1_top2_margin": 2.983727, "top6_top7_margin": 0.158208}, {"gen_index": 24, "token": 5445, "top": [[735, -0.000296], [5995, -10.711704], [286, -11.285948], [33341, -11.326376], [5445, -11.382284], [14950, -11.620565], [476, -11.934462], [824, -11.946546], [919, -11.96563], [330, -11.975466], [439, -11.979695], [622, -12.097425], [568, -12.102963], [378, -12.383644], [2459, -12.423973], [1309, -12.587411], [18717, -12.595185], [115, -12.841959], [44, -12.873516], [14896, -12.916054], [1656, -12.92004], [17714, -12.923203], [3881, -13.097565], [14795, -13.158061], [1270, -13.162758], [36836, -13.243942], [11577, -13.271037], [1064, -13.351048], [13255, -13.394403], [58, -13.44611], [18126, -13.520124], [528, -13.539515], [263, -13.731546], [127655, -13.747753], [4484, -13.756786], [120007, -13.770779], [589, -13.785105], [310, -13.786531], [527, -13.818244], [7222, -13.839808], [2722, -13.861526], [14353, -13.895564], [2286, -13.905005], [3363, -13.924397], [379, -13.950838], [279, -13.962806], [7510, -13.990452], [8175, -13.993948], [46, -14.141771], [766, -14.166695], [21499, -14.175414], [10, -14.204933], [20773, -14.219027], [9668, -14.248521], [8150, -14.258849], [4088, -14.261278], [5607, -14.269305], [20787, -14.270023], [24348, -14.278309], [262, -14.332031], [9727, -14.340635], [1503, -14.346954], [2302, -14.350395], [31642, -14.435909], [502, -14.498615], [936, -14.500317], [11317, -14.505851], [124489, -14.586973], [851, -14.609159], [32, -14.632874], [120670, -14.641141], [45375, -14.665857], [14188, -14.707782], [58742, -14.766768], [3660, -14.806809], [1041, -14.819302], [10794, -14.834856], [4895, -14.874771], [830, -14.888761], [73707, -14.892719], [5865, -14.895401], [49987, -14.929046], [669, -14.937972], [2457, -14.957781], [12243, -14.960608], [1052, -14.961985], [14153, -14.966994], [2213, -14.986558], [3402, -14.999552], [127906, -15.001204], [63, -15.006436], [60478, -15.008143], [8263, -15.017633], [79211, -15.041321], [3326, -15.067559], [7499, -15.071026], [6339, -15.071734], [6344, -15.075139], [75248, -15.120611], [11910, -15.121941]], "logprob_of_token": -11.382284, "top1_top2_margin": 10.711408, "top6_top7_margin": 0.313896}, {"gen_index": 26, "token": 262, "top": [[286, -0.007592], [46, -5.714468], [4484, -5.796437], [936, -7.522622], [275, -8.884477], [44, -9.984604], [310, -9.997713], [15853, -10.412168], [622, -10.509851], [314, -10.777287], [5995, -10.984014], [1806, -11.323054], [420, -11.388614], [12359, -11.592196], [735, -11.644284], [1275, -11.721915], [59, -11.725139], [9093, -11.87627], [4101, -11.931368], [318, -11.998119], [2213, -12.058166], [5071, -12.199771], [53535, -12.238868], [7510, -12.262465], [120007, -12.264262], [379, -12.428018], [63, -12.464749], [263, -12.464978], [36209, -12.476985], [3688, -12.491115], [1093, -12.552854], [45375, -12.61769], [763, -12.623879], [58, -12.645106], [22648, -12.647149], [766, -12.648086], [270, -12.651539], [467, -12.768554], [1409, -12.773486], [4703, -12.79217], [3583, -12.865324], [779, -12.916926], [34, -12.934347], [262, -12.94526], [33, -12.980205], [2457, -13.005055], [127655, -13.017054], [4137, -13.128022], [10, -13.185051], [21499, -13.185855], [2403, -13.312976], [3368, -13.335217], [1829, -13.354956], [474, -13.382497], [33341, -13.393357], [36836, -13.454322], [279, -13.499018], [120078, -13.503289], [3093, -13.508827], [32, -13.518666], [3247, -13.521163], [3918, -13.531864], [24973, -13.535296], [1225, -13.581536], [327, -13.588862], [2051, -13.658046], [2549, -13.670478], [120230, -13.746309], [3737, -13.751225], [1739, -13.799058], [14153, -13.800477], [799, -13.853587], [4638, -13.853894], [6785, -13.863893], [502, -13.875424], [1988, -13.904507], [12742, -13.934235], [7557, -13.949253], [26530, -13.957962], [120015, -13.973931], [120410, -14.000308], [127906, -14.034412], [1410, -14.037742], [900, -14.043211], [47, -14.052735], [4375, -14.107499], [923, -14.125753], [120001, -14.152622], [41514, -14.153921], [7331, -14.213807], [120099, -14.235914], [93457, -14.236806], [1744, -14.251618], [14188, -14.273541], [3755, -14.276635], [375, -14.319951], [2376, -14.366118], [777, -14.387081], [6000, -14.394408], [1776, -14.400055]], "logprob_of_token": -12.94526, "top1_top2_margin": 5.706876, "top6_top7_margin": 0.013109}, {"gen_index": 27, "token": 21499, "top": [[262, -0.000332], [1744, -10.250504], [3326, -10.416061], [3142, -10.476535], [2213, -10.586518], [5445, -10.807884], [3737, -10.964205], [33341, -11.055441], [527, -11.540526], [669, -11.656471], [261, -11.93043], [5657, -12.080867], [15853, -12.611569], [735, -12.651155], [120007, -12.686261], [1435, -12.736035], [4484, -12.90521], [453, -12.92443], [1436, -12.998297], [11966, -13.079196], [21499, -13.103275], [900, -13.15242], [1806, -13.160625], [543, -13.432938], [1409, -13.4952], [2302, -13.51762], [1776, -13.525661], [1739, -13.558434], [4315, -13.565963], [565, -13.618238], [31642, -13.633467], [3918, -13.704093], [941, -13.708189], [7176, -13.818616], [1319, -13.833625], [120022, -13.867086], [938, -13.92234], [1862, -13.937051], [622, -13.986523], [1324, -14.00525], [3166, -14.008249], [286, -14.017695], [327, -14.079438], [762, -14.081373], [4205, -14.123055], [3327, -14.153416], [1656, -14.205815], [325, -14.217351], [27169, -14.299761], [2503, -14.355556], [346, -14.367556], [4731, -14.368434], [476, -14.374924], [597, -14.394842], [120410, -14.43155], [14394, -14.437273], [58742, -14.451761], [5190, -14.456274], [36836, -14.478687], [379, -14.525461], [1333, -14.587743], [919, -14.602093], [2403, -14.641985], [3713, -14.654872], [502, -14.666105], [468, -14.715642], [32, -14.716816], [851, -14.748112], [4743, -14.776916], [9162, -14.783995], [763, -14.785393], [1410, -14.806585], [19898, -14.814277], [18717, -14.960815], [936, -14.962659], [4314, -14.963636], [318, -14.965231], [9474, -14.967804], [8358, -14.993191], [1578, -15.010487], [310, -15.036821], [44, -15.052792], [120016, -15.061527], [8545, -15.070007], [2895, -15.075274], [2246, -15.079583], [279, -15.086285], [3550, -15.087855], [946, -15.088772], [115, -15.094633], [1275, -15.117778], [7510, -15.131003], [3892, -15.143993], [39523, -15.151962], [1765, -15.159872], [2307, -15.177582], [6564, -15.180078], [7107, -15.233571], [5071, -15.241325], [51988, -15.2507]], "logprob_of_token": -13.103275, "top1_top2_margin": 10.250172, "top6_top7_margin": 0.156321}, {"gen_index": 28, "token": 735, "top": [[21499, -0.161431], [5995, -3.144601], [11527, -4.772936], [14795, -5.633736], [1460, -6.597935], [16719, -6.80688], [19866, -6.835342], [47805, -7.21894], [17392, -7.625453], [59199, -7.67903], [7852, -7.75895], [84254, -7.869611], [262, -7.967792], [10262, -8.04614], [33341, -8.112196], [4273, -8.167416], [3388, -8.181457], [5848, -8.187233], [11268, -8.22752], [527, -8.253678], [6900, -8.354233], [851, -8.355465], [36836, -8.440089], [34210, -8.449109], [4836, -8.454555], [8794, -8.45827], [6785, -8.460042], [2376, -8.462503], [5657, -8.462875], [9172, -8.532219], [3515, -8.545558], [115, -8.564672], [941, -8.600199], [15708, -8.642804], [9616, -8.654075], [14341, -8.664304], [14852, -8.665351], [6547, -8.681073], [286, -8.685421], [32, -8.687572], [41801, -8.707945], [6700, -8.71654], [8263, -8.728206], [873, -8.741951], [43211, -8.769014], [936, -8.793284], [12006, -8.797935], [4101, -8.842233], [30279, -8.867486], [18686, -8.871324], [735, -8.872411], [4205, -8.963887], [9501, -8.97128], [10461, -8.97575], [9089, -9.0213], [24775, -9.024251], [120007, -9.02506], [14321, -9.030232], [10520, -9.039544], [14805, -9.043835], [11309, -9.05542], [5032, -9.067198], [5274, -9.092039], [19898, -9.101989], [3713, -9.132246], [1305, -9.137036], [8506, -9.141533], [18174, -9.145569], [61599, -9.192534], [14803, -9.192669], [1409, -9.222824], [1427, -9.239773], [3937, -9.246563], [16785, -9.252905], [7193, -9.256972], [4850, -9.269237], [16320, -9.272704], [1625, -9.277338], [14233, -9.286445], [6789, -9.302695], [14950, -9.312095], [766, -9.31785], [14244, -9.351583], [622, -9.357487], [5660, -9.36086], [41436, -9.378044], [52634, -9.381986], [2377, -9.383421], [8275, -9.386442], [52331, -9.39026], [30971, -9.395218], [63, -9.409514], [14197, -9.418225], [26925, -9.423607], [124524, -9.442706], [7304, -9.450048], [46, -9.458162], [4758, -9.474906], [33611, -9.486169], [45089, -9.490994]], "logprob_of_token": -8.872411, "top1_top2_margin": 2.98317, "top6_top7_margin": 0.028462}, {"gen_index": 29, "token": 5657, "top": [[735, -0.000173], [330, -11.274178], [5657, -11.325265], [824, -11.801607], [120007, -11.896514], [568, -11.958755], [18717, -12.08986], [1656, -12.261598], [476, -12.33791], [919, -12.448577], [439, -12.530341], [2459, -12.575373], [1309, -12.642815], [46, -13.022457], [18126, -13.052214], [1270, -13.082121], [622, -13.237507], [44, -13.289177], [8150, -13.489351], [63, -13.562681], [14896, -13.599108], [11577, -13.819056], [263, -13.840144], [286, -13.925182], [10794, -13.971255], [378, -14.009668], [73707, -14.043222], [58, -14.081894], [589, -14.101796], [7222, -14.123255], [127906, -14.191148], [21499, -14.214801], [20773, -14.251752], [13255, -14.300685], [115, -14.337698], [44102, -14.365219], [17714, -14.374102], [1064, -14.406422], [10, -14.407627], [120022, -14.416302], [528, -14.458139], [279, -14.486596], [32, -14.508068], [7017, -14.511034], [7510, -14.517679], [120410, -14.524203], [2286, -14.544166], [745, -14.546094], [49987, -14.58378], [18296, -14.585141], [1409, -14.585676], [310, -14.594172], [120670, -14.620046], [936, -14.66234], [7499, -14.666057], [766, -14.724558], [13248, -14.774594], [120000, -14.825272], [527, -14.838761], [617, -14.839295], [576, -14.841743], [11317, -14.854171], [502, -14.886253], [59, -14.924753], [120016, -14.953526], [4769, -14.964959], [20498, -14.972818], [34, -15.026774], [275, -15.03765], [4688, -15.0461], [1829, -15.10559], [14188, -15.123792], [37159, -15.14716], [379, -15.174538], [127655, -15.185168], [60478, -15.196148], [24348, -15.216785], [6172, -15.260079], [318, -15.288505], [4731, -15.323485], [405, -15.325943], [8157, -15.328023], [11910, -15.361813], [31445, -15.394416], [2492, -15.41197], [120625, -15.435493], [1275, -15.487127], [262, -15.497807], [5445, -15.50185], [4895, -15.512287], [20787, -15.520149], [1765, -15.524451], [2376, -15.528009], [25288, -15.529468], [1637, -15.568764], [941, -15.58042], [938, -15.592715], [49, -15.602564], [46952, -15.655052], [3311, -15.664387]], "logprob_of_token": -11.325265, "top1_top2_margin": 11.274004, "top6_top7_margin": 0.131104}, {"gen_index": 31, "token": 543, "top": [[46, -0.001788], [275, -6.662164], [314, -7.949977], [286, -9.777364], [36209, -11.579667], [44, -11.782876], [63, -12.227355], [33, -12.471418], [4137, -12.568925], [10, -12.662465], [120007, -12.712359], [120230, -12.810319], [120099, -13.197602], [263, -13.234548], [120000, -13.405762], [543, -13.430453], [58, -13.484319], [59, -13.498656], [120001, -13.657731], [936, -13.667012], [120241, -13.83148], [766, -13.861428], [13594, -13.938046], [120078, -13.973308], [120399, -14.046866], [120016, -14.100991], [3545, -14.153104], [325, -14.169223], [44455, -14.171335], [49, -14.222725], [7510, -14.231425], [262, -14.331332], [1829, -14.359507], [93457, -14.392824], [120118, -14.481668], [310, -14.495028], [120002, -14.521994], [622, -14.56957], [5071, -14.623041], [120140, -14.759817], [420, -14.858506], [120050, -14.907453], [735, -14.935651], [1275, -14.945662], [127906, -14.963662], [327, -14.969914], [48, -15.001975], [32, -15.006348], [2213, -15.026246], [50, -15.087935], [120003, -15.130947], [745, -15.131133], [120020, -15.133807], [51, -15.150299], [120015, -15.169835], [120618, -15.172265], [26951, -15.201838], [379, -15.210129], [120068, -15.213779], [15853, -15.22409], [14188, -15.228167], [120021, -15.330884], [120100, -15.367555], [120064, -15.435543], [1093, -15.483558], [120347, -15.503757], [9289, -15.527464], [52, -15.547643], [121066, -15.63732], [123440, -15.641953], [279, -15.658511], [120031, -15.659191], [3711, -15.683629], [120063, -15.696572], [120360, -15.703006], [120277, -15.73327], [12611, -15.739552], [121617, -15.76333], [53, -15.771123], [779, -15.775773], [120048, -15.785165], [474, -15.791422], [467, -15.853632], [120208, -15.875531], [270, -15.927598], [120463, -15.969141], [318, -15.991498], [110358, -16.056229], [1776, -16.059881], [57, -16.151527], [121238, -16.158131], [120080, -16.165159], [120110, -16.227989], [763, -16.24295], [120059, -16.251234], [120214, -16.259441], [34, -16.25976], [11861, -16.262339], [1988, -16.26527], [47, -16.267679]], "logprob_of_token": -13.430453, "top1_top2_margin": 6.660375, "top6_top7_margin": 0.444479}]}, {"prompt": "Ein gutes Buch liest man am besten", "input_ids": [1113, 29597, 4363, 51092, 836, 10304, 9798], "generated_ids": [30135, 420, 30134, 46, 1496, 29597, 4363, 2459, 888, 922, 20263, 11794, 58, 5084, 46696, 7640, 13111, 14225, 1687, 45455, 2042, 46, 1496, 29597, 4363, 2459, 888, 922, 20263, 11794, 58, 5084], "rows": [{"gen_index": 0, "token": 30135, "top": [[9798, -0.081773], [69462, -3.446329], [5710, -3.518733], [9933, -5.017556], [12909, -6.68941], [31987, -6.723385], [8429, -7.092453], [16994, -7.257419], [24516, -7.924639], [30135, -7.969963], [86709, -8.060691], [83390, -8.142971], [5906, -8.619289], [17799, -8.700219], [9078, -8.949422], [6933, -8.996089], [73832, -9.140843], [52344, -9.288564], [120007, -9.517074], [7524, -9.541118], [6592, -9.541501], [15295, -9.563192], [4363, -9.736323], [17353, -9.806857], [32, -9.88063], [16317, -9.884479], [105203, -9.897923], [90434, -9.92425], [19903, -9.946803], [95070, -10.018933], [20387, -10.055718], [19287, -10.094901], [35019, -10.1445], [33107, -10.175032], [30134, -10.286769], [11228, -10.296842], [71827, -10.298965], [19226, -10.36045], [87091, -10.377892], [105110, -10.433388], [11789, -10.469707], [15367, -10.530787], [16347, -10.542209], [63988, -10.542905], [10302, -10.596885], [32950, -10.599678], [16438, -10.6169], [14240, -10.660197], [49790, -10.684142], [3241, -10.689605], [845, -10.69702], [26562, -10.702468], [90280, -10.728612], [70914, -10.731218], [14445, -10.731763], [118912, -10.732391], [19683, -10.779561], [36092, -10.782684], [7389, -10.802153], [23419, -10.813365], [23313, -10.847034], [103022, -10.848823], [15855, -10.877734], [66162, -10.895254], [41537, -10.916437], [120022, -10.982615], [56604, -11.016283], [1618, -11.036174], [13539, -11.052307], [50076, -11.109187], [14627, -11.123529], [84308, -11.132026], [90351, -11.154803], [44531, -11.156751], [5274, -11.16015], [20216, -11.200414], [76313, -11.204759], [18476, -11.25067], [26731, -11.310337], [7435, -11.326119], [23973, -11.332796], [18668, -11.333076], [10331, -11.362432], [23052, -11.437834], [8066, -11.440625], [40619, -11.465203], [28912, -11.472387], [39028, -11.485694], [12553, -11.491687], [16377, -11.507386], [16925, -11.537031], [10580, -11.551398], [54485, -11.564348], [76855, -11.603132], [31985, -11.609443], [17632, -11.611447], [31686, -11.630527], [11178, -11.635528], [23053, -11.648973], [21489, -11.650325]], "logprob_of_token": -7.969963, "top1_top2_margin": 3.364556, "top6_top7_margin": 0.369068}, {"gen_index": 1, "token": 420, "top": [[30135, -1.095977], [622, -1.274363], [913, -2.290061], [44, -2.804624], [120007, -3.293723], [2150, -3.92182], [8066, -4.407973], [46, -4.482898], [939, -4.498896], [1233, -4.504972], [4299, -4.525717], [1409, -4.677046], [24439, -5.000513], [52970, -5.048901], [2625, -5.077458], [45623, -5.732415], [6216, -5.785768], [861, -5.802293], [7314, -6.016885], [2361, -6.067248], [275, -6.078217], [493, -6.110979], [39721, -6.11132], [1687, -6.193512], [63, -6.202098], [31985, -6.249182], [65702, -6.250835], [120016, -6.258525], [120022, -6.336586], [513, -6.541144], [30623, -6.600361], [10304, -6.639008], [5590, -6.702229], [5680, -6.762909], [745, -6.774389], [20758, -6.854609], [8077, -6.903383], [45594, -6.932104], [4610, -6.942875], [58, -6.997452], [14581, -7.070366], [2944, -7.137825], [29126, -7.13845], [120021, -7.178442], [15303, -7.203821], [1829, -7.234784], [55190, -7.259652], [3234, -7.266423], [32, -7.303702], [888, -7.309735], [314, -7.312848], [2424, -7.419675], [10666, -7.422512], [38033, -7.453313], [86066, -7.526815], [59, -7.580769], [2225, -7.6297], [3643, -7.647224], [1717, -7.7076], [28155, -7.71522], [15356, -7.72757], [11861, -7.766462], [9506, -7.783934], [26562, -7.803351], [5291, -7.813847], [30134, -7.828741], [2102, -7.852345], [14460, -7.865558], [5274, -7.878443], [10895, -7.890263], [14351, -7.979634], [1489, -8.022499], [420, -8.063095], [54183, -8.180265], [41537, -8.208409], [5632, -8.212258], [1803, -8.264033], [4336, -8.281566], [48802, -8.315744], [10, -8.322993], [11178, -8.375121], [14265, -8.411204], [9881, -8.499557], [1953, -8.510067], [3154, -8.514455], [104824, -8.519185], [30512, -8.533842], [614, -8.566948], [14218, -8.594951], [263, -8.651512], [4561, -8.667869], [1573, -8.681085], [922, -8.686469], [1521, -8.757503], [4703, -8.758882], [74166, -8.786904], [14188, -8.810697], [120103, -8.81321], [15205, -8.813236], [46738, -8.876863]], "logprob_of_token": -8.063095, "top1_top2_margin": 0.178386, "top6_top7_margin": 0.486154}, {"gen_index": 2, "token": 30134, "top": [[420, -0.962737], [46, -1.247078], [44, -1.92484], [275, -2.806192], [1829, -3.182425], [314, -3.457553], [58, -4.233252], [120007, -4.707757], [14188, -5.119944], [59, -5.713776], [10, -6.261904], [263, -6.461124], [120016, -6.693883], [913, -6.717936], [63, -6.987771], [14153, -7.037428], [861, -7.547585], [120022, -7.550669], [766, -7.566208], [120021, -7.599588], [120000, -7.798491], [20758, -7.810828], [745, -7.859394], [21667, -7.958926], [656, -8.201205], [988, -8.39982], [21689, -8.611911], [1117, -8.6374], [121304, -8.65424], [70765, -8.83712], [11861, -8.841568], [1687, -9.021617], [1062, -9.032655], [2361, -9.044473], [622, -9.088885], [51092, -9.104468], [33, -9.192324], [493, -9.205699], [30135, -9.298703], [1043, -9.394218], [27532, -9.423079], [2102, -9.429207], [120103, -9.48034], [14576, -9.50854], [120008, -9.518607], [3504, -9.548125], [120001, -9.616343], [7865, -9.636804], [32, -9.644347], [120214, -9.71872], [2150, -9.719224], [36209, -9.751494], [121638, -9.756188], [120410, -9.760619], [1521, -9.763063], [69555, -9.76647], [14179, -9.858643], [120359, -9.882184], [120468, -9.957381], [120002, -10.021763], [405, -10.05022], [45, -10.056709], [120087, -10.07655], [1953, -10.201591], [15943, -10.217083], [2625, -10.230882], [4137, -10.234394], [120028, -10.247343], [576, -10.256538], [2362, -10.292278], [614, -10.344115], [513, -10.36044], [12698, -10.374075], [114168, -10.41831], [120003, -10.48744], [34, -10.499825], [120118, -10.517191], [460, -10.537616], [3643, -10.557865], [64337, -10.558483], [10304, -10.578429], [122158, -10.652462], [922, -10.670662], [120004, -10.720384], [26071, -10.740788], [2519, -10.780941], [286, -10.802365], [284, -10.822195], [7314, -10.908513], [4299, -10.911361], [120098, -10.919667], [5274, -10.938386], [2156, -10.938663], [8066, -10.96992], [346, -11.000545], [120006, -11.010551], [30134, -11.023417], [47, -11.036601], [121119, -11.03992], [1489, -11.099401]], "logprob_of_token": -11.023417, "top1_top2_margin": 0.284341, "top6_top7_margin": 0.775699}, {"gen_index": 6, "token": 4363, "top": [[29597, -1.003155], [4363, -1.859575], [6290, -1.95083], [20263, -2.231907], [126713, -3.438337], [125733, -4.247484], [76183, -4.52026], [11556, -4.837044], [64544, -4.844225], [29566, -4.963085], [69939, -5.010189], [71506, -5.117755], [37669, -5.383876], [4835, -5.49349], [112499, -5.691274], [48692, -5.861094], [66604, -5.916255], [8747, -6.096979], [9115, -6.121302], [104683, -6.140302], [65813, -6.220593], [69735, -6.278316], [94773, -6.439561], [115531, -6.499222], [9024, -6.522823], [61082, -6.620897], [39940, -6.648187], [37857, -6.664644], [69191, -6.718293], [76298, -6.718989], [46885, -6.739883], [13819, -6.755569], [35119, -6.759105], [90098, -6.762591], [73771, -6.792257], [69370, -6.793601], [79104, -6.826068], [28882, -6.826214], [5162, -6.874111], [5222, -6.897767], [51321, -6.918651], [56937, -6.938007], [32, -6.960243], [15298, -7.002226], [96154, -7.013963], [52088, -7.074734], [48802, -7.142735], [27693, -7.182985], [35126, -7.204577], [23174, -7.214475], [107837, -7.257336], [10824, -7.258661], [24665, -7.259681], [17632, -7.261616], [37091, -7.278415], [55507, -7.296672], [5052, -7.325676], [39040, -7.326445], [29553, -7.351401], [44197, -7.410518], [9710, -7.411767], [13663, -7.468954], [81335, -7.519211], [29065, -7.536311], [8066, -7.55358], [9683, -7.564167], [26258, -7.626759], [6776, -7.635656], [22745, -7.659539], [32655, -7.699799], [16952, -7.704478], [70710, -7.710032], [18118, -7.714606], [122907, -7.71901], [35146, -7.721009], [70223, -7.72302], [2150, -7.730566], [66539, -7.745065], [99697, -7.778178], [56155, -7.785148], [7668, -7.789792], [38275, -7.804867], [32768, -7.805635], [2114, -7.830246], [23306, -7.833156], [68924, -7.836571], [18799, -7.861916], [40670, -7.890602], [90112, -7.909009], [20478, -7.913088], [73232, -7.919178], [19228, -7.937355], [861, -7.938525], [36509, -7.967567], [37670, -7.991481], [96507, -8.032086], [4858, -8.035556], [1409, -8.035941], [49992, -8.036847], [3891, -8.101069]], "logprob_of_token": -1.859575, "top1_top2_margin": 0.85642, "top6_top7_margin": 0.272777}, {"gen_index": 9, "token": 922, "top": [[888, -0.381317], [922, -1.925264], [939, -3.494348], [699, -3.623163], [41769, -3.827056], [18830, -4.520531], [6843, -4.747281], [7314, -4.965014], [614, -5.250383], [14581, -5.261433], [21034, -5.681751], [9277, -5.69166], [1195, -5.826718], [5222, -5.978801], [1409, -6.091503], [1006, -6.142214], [3504, -6.241872], [3514, -6.255967], [5276, -6.33311], [14154, -6.428274], [518, -6.614161], [346, -6.64727], [10304, -6.75604], [6606, -6.948063], [75642, -6.999283], [44, -7.016587], [3234, -7.067177], [14357, -7.175082], [622, -7.289648], [37206, -7.364714], [8032, -7.428127], [1627, -7.497541], [17090, -7.527143], [948, -7.578169], [61212, -7.585539], [14240, -7.615104], [1410, -7.642193], [28724, -7.713514], [836, -7.761442], [17117, -7.785048], [18324, -7.79677], [39685, -7.866988], [5680, -7.942415], [14543, -7.966054], [14649, -7.99361], [14573, -8.092916], [14542, -8.128722], [1151, -8.135589], [26562, -8.202007], [1803, -8.21316], [14276, -8.299313], [2361, -8.376549], [861, -8.459255], [46203, -8.46713], [7799, -8.609875], [36821, -8.644732], [34402, -8.664827], [4245, -8.745512], [30560, -8.751253], [7226, -8.758679], [18967, -8.792314], [6105, -8.812414], [8747, -8.89355], [13560, -8.902718], [12579, -8.908656], [2625, -8.921312], [18198, -8.97011], [33990, -8.98805], [17424, -9.023256], [23474, -9.026087], [47581, -9.042898], [2120, -9.100317], [14225, -9.185544], [5152, -9.211409], [3502, -9.248068], [8077, -9.263435], [15845, -9.314996], [1853, -9.344068], [58343, -9.351704], [14994, -9.356717], [14625, -9.357643], [30135, -9.367378], [13638, -9.368075], [36624, -9.394409], [51380, -9.397545], [1097, -9.437202], [3916, -9.477219], [14566, -9.501823], [29331, -9.528187], [20812, -9.53214], [31985, -9.540401], [6587, -9.54904], [9881, -9.554495], [6089, -9.57963], [37857, -9.585746], [20458, -9.66928], [4703, -9.67953], [65702, -9.696516], [120007, -9.701499], [15900, -9.72886]], "logprob_of_token": -1.925264, "top1_top2_margin": 1.543946, "top6_top7_margin": 0.22675}, {"gen_index": 10, "token": 20263, "top": [[922, -0.029767], [699, -3.583387], [14286, -8.140334], [29597, -8.572018], [346, -8.689567], [518, -8.75328], [3717, -8.768528], [20263, -9.727784], [948, -9.937635], [120007, -10.435138], [1241, -10.48592], [12567, -11.160611], [3090, -11.163033], [5222, -11.178633], [11536, -11.182128], [25406, -11.414458], [888, -11.452197], [11794, -11.626412], [32139, -11.640414], [8032, -11.660736], [22676, -11.84195], [16925, -11.854927], [6843, -11.965053], [9067, -12.246316], [13902, -12.348298], [31511, -12.354247], [23419, -12.411916], [18582, -12.538609], [16838, -12.561433], [120016, -12.716726], [1195, -12.721418], [52114, -12.732425], [120022, -12.771779], [2042, -12.816875], [7629, -12.835875], [622, -12.840697], [4771, -12.841296], [11090, -12.897716], [12905, -12.928029], [26421, -13.03405], [22580, -13.044446], [120410, -13.059275], [1151, -13.09036], [8608, -13.123496], [22188, -13.123797], [13732, -13.144933], [40203, -13.157226], [29481, -13.235478], [20421, -13.299833], [21262, -13.316266], [3579, -13.330071], [7072, -13.338128], [4657, -13.394596], [32816, -13.397824], [43773, -13.399363], [4269, -13.407557], [11637, -13.437005], [1097, -13.447757], [15955, -13.458704], [1496, -13.474055], [65702, -13.494254], [4938, -13.553746], [4254, -13.570165], [41769, -13.583627], [10492, -13.599068], [2260, -13.623279], [11226, -13.635888], [14783, -13.65227], [61335, -13.656844], [6896, -13.663171], [27430, -13.676242], [33415, -13.71861], [745, -13.76747], [2625, -13.848481], [7462, -13.849159], [17647, -13.888915], [614, -13.945992], [75716, -13.949145], [836, -13.982105], [9726, -13.985124], [16479, -13.985188], [31991, -13.998877], [84260, -14.008458], [10447, -14.010449], [1044, -14.021307], [3514, -14.084533], [2796, -14.09534], [13635, -14.125492], [62499, -14.128919], [16377, -14.135137], [14462, -14.141804], [1953, -14.149407], [1233, -14.14991], [26805, -14.154052], [7799, -14.15742], [9277, -14.162564], [15343, -14.171361], [18908, -14.177507], [16220, -14.208036], [3916, -14.211696]], "logprob_of_token": -9.727784, "top1_top2_margin": 3.553619, "top6_top7_margin": 0.015248}, {"gen_index": 11, "token": 11794, "top": [[20263, -0.401089], [9067, -2.464873], [29597, -2.556331], [8846, -3.366534], [6896, -3.818623], [65685, -4.151031], [11869, -4.350523], [23419, -4.578087], [26421, -5.034663], [33415, -5.122456], [30758, -5.492136], [94846, -5.950931], [49992, -5.962269], [21832, -5.990944], [11090, -6.050263], [15209, -6.118112], [63714, -6.388236], [24736, -6.418622], [56937, -6.606737], [52088, -6.616362], [87755, -6.723071], [2944, -6.808259], [5222, -6.955326], [3364, -6.964981], [9273, -7.02555], [48802, -7.172678], [92748, -7.198825], [118960, -7.238575], [11794, -7.3566], [64544, -7.490603], [14286, -7.624446], [25948, -7.674336], [13844, -7.694614], [17899, -7.812967], [22676, -7.863671], [115531, -7.879945], [15550, -7.893044], [23052, -7.89964], [47099, -8.016408], [12184, -8.180265], [110792, -8.192472], [17512, -8.196272], [21496, -8.229117], [29824, -8.268132], [93872, -8.309026], [91469, -8.405702], [33225, -8.439262], [38275, -8.461267], [11208, -8.48847], [3717, -8.505651], [38605, -8.56156], [24653, -8.606769], [112499, -8.615411], [14462, -8.617083], [41400, -8.619579], [105126, -8.629592], [108281, -8.646397], [63656, -8.656755], [19903, -8.748654], [91660, -8.754964], [116336, -8.759203], [50240, -8.769053], [1618, -8.79081], [25406, -8.817908], [22745, -8.820524], [37670, -8.834371], [71154, -8.838597], [16486, -8.867933], [36286, -8.916132], [15388, -8.92475], [4835, -8.930327], [37669, -8.952745], [87612, -8.977345], [43773, -8.992618], [63547, -9.030184], [48079, -9.047049], [35774, -9.069813], [69370, -9.072288], [84419, -9.082523], [22188, -9.08585], [26805, -9.106219], [17471, -9.117957], [5052, -9.136263], [11041, -9.142405], [47704, -9.190782], [56336, -9.191287], [15482, -9.2349], [75382, -9.242383], [14847, -9.244827], [10975, -9.251249], [26562, -9.25169], [29331, -9.255779], [7879, -9.268621], [31212, -9.285069], [68307, -9.299664], [4846, -9.347058], [69724, -9.37373], [61082, -9.389463], [50665, -9.392276], [96463, -9.401981]], "logprob_of_token": -7.3566, "top1_top2_margin": 2.063784, "top6_top7_margin": 0.199492}, {"gen_index": 16, "token": 13111, "top": [[7640, -0.773958], [845, -1.186258], [2796, -1.752149], [2260, -2.996244], [14225, -5.189879], [913, -6.744457], [2120, -8.134019], [1241, -8.278204], [1687, -8.467825], [46110, -8.614205], [4336, -8.855491], [922, -8.905143], [30135, -8.942358], [1178, -9.324749], [13111, -9.59484], [4550, -9.69687], [43918, -9.827217], [622, -9.874967], [1233, -9.910886], [699, -9.931006], [518, -10.040015], [3327, -10.097082], [8032, -10.13146], [10304, -10.229668], [2625, -10.269954], [7314, -10.291275], [41769, -10.305095], [1489, -10.490314], [46696, -10.49748], [8066, -10.562922], [40052, -10.673248], [2228, -10.7273], [31438, -10.887248], [43530, -10.905262], [21034, -10.90897], [18571, -10.996814], [346, -11.013728], [420, -11.017291], [4657, -11.048835], [836, -11.056735], [1195, -11.090394], [9506, -11.12688], [7073, -11.168797], [14612, -11.208288], [1006, -11.299489], [47354, -11.327794], [4391, -11.399071], [7108, -11.47997], [41390, -11.498984], [62264, -11.513291], [2042, -11.523108], [7799, -11.582159], [59299, -11.592341], [5680, -11.64832], [861, -11.671189], [2764, -11.683698], [28625, -11.733655], [22579, -11.751386], [45304, -11.758269], [3408, -11.779487], [38605, -11.789476], [3154, -11.794124], [939, -11.82183], [42099, -11.849147], [14573, -11.853979], [766, -11.877362], [6003, -11.939347], [1573, -11.953382], [6606, -11.957664], [2424, -12.001058], [2361, -12.025479], [75138, -12.046008], [13635, -12.066066], [2445, -12.093289], [12238, -12.100026], [8850, -12.106235], [47984, -12.124055], [52389, -12.150075], [1521, -12.162395], [11178, -12.183614], [4733, -12.192668], [39010, -12.227822], [9115, -12.242842], [11698, -12.249049], [5632, -12.274122], [9746, -12.295472], [9006, -12.320451], [34473, -12.417109], [3916, -12.447227], [14168, -12.457091], [614, -12.460149], [10917, -12.487403], [493, -12.493474], [2270, -12.500686], [2767, -12.511964], [888, -12.530122], [10003, -12.572233], [44, -12.573823], [32, -12.606207], [41129, -12.615698]], "logprob_of_token": -9.59484, "top1_top2_margin": 0.4123, "top6_top7_margin": 1.389562}, {"gen_index": 18, "token": 1687, "top": [[14225, -0.162617], [44, -2.967338], [10304, -3.593747], [913, -4.781754], [2120, -4.895789], [622, -4.930826], [4336, -4.945183], [75138, -5.096225], [30135, -5.098756], [1687, -5.338537], [420, -5.533622], [2625, -5.572346], [10003, -5.602428], [43530, -5.958136], [7314, -6.006598], [1489, -6.790282], [45304, -7.320917], [1195, -7.428388], [3408, -7.669514], [8066, -7.675573], [1233, -7.913021], [861, -8.021398], [8747, -8.023287], [939, -8.111345], [46696, -8.54245], [41769, -8.686464], [18262, -8.972136], [14573, -9.175884], [8429, -9.327925], [5680, -9.394903], [7799, -9.55265], [21034, -9.677332], [14612, -9.710723], [1521, -9.725961], [20812, -9.762212], [46, -9.805061], [35723, -9.893479], [2225, -10.000814], [2361, -10.020465], [1597, -10.187845], [766, -10.19051], [11178, -10.220654], [1409, -10.324265], [493, -10.404999], [9115, -10.455576], [26345, -10.476897], [7470, -10.583534], [25901, -10.583956], [1573, -10.601216], [39010, -10.886617], [845, -10.894973], [1829, -11.023253], [1006, -11.097113], [5906, -11.133606], [346, -11.193149], [103601, -11.281782], [15298, -11.316899], [40158, -11.356718], [81502, -11.386108], [5224, -11.416018], [14543, -11.425423], [2424, -11.430571], [10913, -11.498274], [9798, -11.508875], [74045, -11.515554], [14282, -11.575115], [2042, -11.57791], [3916, -11.582479], [6003, -11.597919], [1788, -11.598858], [31248, -11.619392], [19375, -11.629197], [614, -11.643423], [61212, -11.648561], [7226, -11.649561], [5222, -11.700694], [101482, -11.701358], [120007, -11.704065], [14794, -11.721189], [1803, -11.750507], [5276, -11.754004], [948, -11.775209], [14581, -11.777392], [48802, -11.812862], [2150, -11.833933], [513, -11.837488], [2502, -11.857338], [31677, -11.88328], [275, -11.901022], [1117, -11.923617], [28049, -11.926216], [59, -11.927382], [12549, -11.93597], [47803, -11.950638], [22863, -11.981972], [24903, -11.991364], [8715, -12.046532], [19474, -12.063497], [6452, -12.092873], [40052, -12.139238]], "logprob_of_token": -5.338537, "top1_top2_margin": 2.804721, "top6_top7_margin": 0.014357}, {"gen_index": 20, "token": 2042, "top": [[45455, -0.659997], [420, -0.797217], [1151, -4.548782], [922, -5.066894], [18230, -5.303678], [948, -6.257881], [8032, -6.479885], [87890, -6.809682], [32816, -7.10022], [16925, -7.586485], [2042, -7.648482], [61212, -7.690225], [101081, -7.711104], [4118, -8.032248], [59825, -8.244035], [20016, -8.435534], [15128, -8.667115], [9914, -8.794647], [57318, -9.021534], [118196, -9.103385], [19820, -9.218504], [71797, -9.301412], [9702, -9.400955], [109147, -9.50629], [41296, -9.698466], [45044, -9.810431], [19987, -9.923373], [32, -9.93039], [826, -10.069448], [6838, -10.098034], [20263, -10.177068], [12559, -10.210312], [20990, -10.328297], [12465, -10.371725], [49992, -10.426713], [112022, -10.458076], [14576, -10.463377], [4490, -10.49922], [11128, -10.535933], [48802, -10.582122], [61810, -10.637181], [20311, -10.679992], [84124, -10.818511], [1006, -10.833453], [398, -10.873555], [1097, -10.894204], [938, -10.95469], [35146, -11.013206], [7365, -11.088309], [3916, -11.095719], [18118, -11.111466], [285, -11.111558], [17799, -11.192854], [26562, -11.209317], [1178, -11.341968], [699, -11.435855], [21034, -11.436613], [3750, -11.478084], [70322, -11.520032], [6709, -11.543689], [68701, -11.618544], [11775, -11.62435], [112499, -11.662126], [51676, -11.685482], [55161, -11.691956], [74584, -11.695938], [123979, -11.709471], [29707, -11.711917], [7865, -11.717223], [41160, -11.719459], [11178, -11.739496], [63061, -11.841969], [37796, -11.862771], [56787, -11.870059], [16312, -11.890168], [49127, -11.898959], [353, -11.902442], [16486, -11.904284], [4733, -11.967404], [61882, -11.986566], [286, -11.995252], [44736, -12.044892], [840, -12.054038], [6586, -12.067111], [10881, -12.084779], [57606, -12.090055], [25576, -12.100703], [29968, -12.127542], [62164, -12.130388], [19040, -12.130845], [23053, -12.139449], [41537, -12.142246], [125574, -12.150988], [15298, -12.153866], [40074, -12.174643], [84027, -12.218579], [18262, -12.245086], [4290, -12.370515], [64130, -12.387639], [6986, -12.413299]], "logprob_of_token": -7.648482, "top1_top2_margin": 0.13722, "top6_top7_margin": 0.222004}, {"gen_index": 24, "token": 4363, "top": [[29597, -0.208825], [20263, -2.428285], [4363, -2.728029], [125733, -4.801091], [6290, -5.254883], [13819, -6.758399], [64544, -7.009707], [11556, -7.345553], [5222, -7.365604], [51321, -7.657734], [29566, -7.723682], [48692, -7.766337], [71506, -7.867004], [66604, -7.947249], [56937, -7.94884], [4835, -7.953991], [5162, -8.037929], [115531, -8.05379], [16242, -8.158712], [37669, -8.168109], [9115, -8.256407], [37091, -8.353375], [20478, -8.556908], [39940, -8.60971], [69735, -8.612975], [126713, -8.639235], [65813, -8.814506], [66539, -8.832043], [111168, -8.845231], [15298, -8.855998], [9683, -8.939013], [9024, -8.953852], [122907, -8.959869], [16952, -8.961068], [71154, -8.969481], [8747, -8.971556], [32768, -9.017674], [22745, -9.084902], [27693, -9.094728], [9067, -9.094733], [81335, -9.110406], [13844, -9.154658], [61082, -9.167871], [18118, -9.194441], [94773, -9.198947], [14286, -9.212008], [69939, -9.220098], [27923, -9.226995], [46885, -9.228404], [23306, -9.230134], [73771, -9.246588], [5213, -9.255649], [112499, -9.256405], [32, -9.28135], [70223, -9.297526], [44197, -9.358371], [31155, -9.453002], [107837, -9.508665], [18799, -9.557272], [70765, -9.643629], [35146, -9.709653], [79104, -9.730679], [80935, -9.764382], [115560, -9.811381], [24665, -9.820474], [40670, -9.847877], [2302, -9.853373], [2150, -9.874425], [11794, -9.881167], [36750, -9.886826], [13663, -9.892041], [42701, -9.903228], [96220, -9.904092], [76298, -9.959342], [47046, -9.981645], [9515, -10.014634], [69191, -10.0151], [61335, -10.015371], [124248, -10.015552], [6776, -10.036211], [104683, -10.042331], [56155, -10.048408], [58890, -10.061142], [35757, -10.078616], [35126, -10.084833], [59446, -10.091786], [5052, -10.092961], [35119, -10.099907], [119607, -10.103902], [87755, -10.108921], [10824, -10.126735], [26412, -10.137736], [91718, -10.144994], [1604, -10.148394], [22188, -10.178351], [100103, -10.179217], [52088, -10.183555], [4858, -10.20853], [21832, -10.212624], [17632, -10.22515]], "logprob_of_token": -2.728029, "top1_top2_margin": 2.21946, "top6_top7_margin": 0.251308}, {"gen_index": 27, "token": 922, "top": [[888, -0.335629], [1195, -1.502206], [922, -3.813314], [17090, -5.067742], [699, -5.249539], [1410, -5.443803], [939, -5.481812], [14581, -5.923679], [7314, -6.148438], [21034, -6.191732], [18324, -6.480092], [3504, -6.899707], [41769, -7.271003], [6843, -7.364983], [18830, -7.565119], [518, -7.729427], [346, -7.798421], [5222, -7.823941], [28724, -8.189003], [3234, -8.243899], [614, -8.373855], [3514, -8.599005], [61212, -8.700886], [948, -9.130066], [39685, -9.135577], [2361, -9.164165], [14994, -9.169636], [14542, -9.173732], [1409, -9.173732], [18967, -9.328268], [19191, -9.339069], [17117, -9.365457], [8032, -9.367941], [51380, -9.387942], [2120, -9.396077], [37206, -9.466689], [34162, -9.486549], [7450, -9.498757], [4835, -9.539186], [861, -9.541496], [622, -9.558196], [14276, -9.564687], [24026, -9.609189], [14573, -9.634576], [14649, -9.689275], [36821, -9.742694], [1627, -9.790102], [36624, -9.865756], [17424, -9.874009], [7799, -9.874094], [9115, -9.897478], [120007, -9.929085], [33990, -9.944127], [9277, -10.04322], [38868, -10.075654], [27899, -10.103267], [76616, -10.159822], [63635, -10.160698], [20812, -10.211484], [44, -10.222404], [1853, -10.229228], [61082, -10.229931], [7226, -10.231303], [913, -10.26532], [58343, -10.267537], [8747, -10.273014], [29331, -10.273125], [14357, -10.285061], [1006, -10.31216], [93825, -10.314251], [14154, -10.331051], [14864, -10.350059], [5152, -10.353518], [34402, -10.357459], [4299, -10.369969], [38905, -10.396064], [1803, -10.408055], [70574, -10.419663], [16488, -10.483323], [10304, -10.527442], [4938, -10.561208], [19474, -10.565421], [14566, -10.569593], [23474, -10.588332], [493, -10.603154], [12220, -10.617921], [65702, -10.62931], [14543, -10.637221], [6606, -10.64294], [55992, -10.644617], [11698, -10.674788], [4657, -10.677262], [26848, -10.694212], [420, -10.711858], [3916, -10.712811], [51638, -10.720255], [11178, -10.731019], [1489, -10.811208], [10909, -10.816759], [12420, -10.819704]], "logprob_of_token": -3.813314, "top1_top2_margin": 1.166576, "top6_top7_margin": 0.038009}, {"gen_index": 28, "token": 20263, "top": [[922, -0.07861], [699, -2.617978], [14286, -7.082593], [3717, -7.341501], [29597, -7.95048], [346, -8.645336], [20263, -8.868498], [518, -9.374082], [948, -10.329077], [1241, -10.795142], [5222, -11.086827], [7629, -11.203286], [22676, -11.330684], [7072, -11.45964], [120007, -11.573537], [25406, -11.592789], [8032, -11.735804], [3090, -11.956546], [11536, -11.988458], [29481, -12.077376], [1195, -12.109078], [84260, -12.259465], [4771, -12.280951], [6843, -12.347226], [4657, -12.443138], [11794, -12.46271], [29307, -12.65324], [22188, -12.664401], [16925, -12.684729], [20421, -12.768086], [32816, -12.792699], [18582, -12.894566], [26761, -12.914136], [8608, -12.953111], [27430, -13.026135], [12567, -13.108068], [1618, -13.207448], [32139, -13.302084], [20075, -13.387254], [2042, -13.43784], [52088, -13.472354], [13732, -13.475715], [4938, -13.490066], [1044, -13.502382], [23127, -13.519534], [3579, -13.537015], [45396, -13.574503], [120022, -13.614762], [11691, -13.616158], [27497, -13.627684], [4269, -13.628392], [9726, -13.641922], [21262, -13.650142], [6674, -13.668374], [3514, -13.674443], [11226, -13.700717], [58343, -13.702971], [52114, -13.721275], [11698, -13.774007], [5617, -13.777236], [15955, -13.797875], [1151, -13.801398], [31991, -13.809564], [11090, -13.819131], [61335, -13.861817], [622, -13.87387], [64544, -13.876929], [941, -13.908395], [13902, -13.913115], [10917, -13.932963], [46773, -13.954988], [5845, -13.957457], [8846, -13.985634], [621, -13.988254], [3916, -13.998337], [17485, -14.019641], [8326, -14.036315], [32, -14.037402], [78424, -14.049814], [26805, -14.060843], [888, -14.077447], [3750, -14.111192], [1496, -14.135206], [18400, -14.146664], [21627, -14.148015], [17902, -14.151431], [58228, -14.15828], [75716, -14.181406], [120410, -14.239636], [9277, -14.26702], [33573, -14.267739], [2260, -14.270289], [836, -14.276858], [51446, -14.284619], [36158, -14.284865], [3691, -14.334268], [15343, -14.349216], [22580, -14.355457], [14576, -14.383464], [23597, -14.403735]], "logprob_of_token": -8.868498, "top1_top2_margin": 2.539368, "top6_top7_margin": 0.223162}, {"gen_index": 29, "token": 11794, "top": [[20263, -0.120432], [29597, -2.866827], [9067, -4.432018], [26421, -4.866663], [8846, -5.104492], [11869, -5.121602], [6896, -5.881386], [65685, -6.079451], [52088, -6.940335], [30758, -7.066039], [3717, -7.101633], [33415, -7.409599], [37669, -7.49687], [11090, -7.580323], [35774, -7.652678], [94846, -7.659531], [23419, -7.808871], [49992, -8.050231], [3364, -8.135012], [41400, -8.15017], [64544, -8.260504], [33225, -8.290954], [5222, -8.356237], [110792, -8.397222], [25948, -8.430055], [1618, -8.488814], [11208, -8.544269], [13844, -8.588429], [15209, -8.658808], [38060, -8.698668], [36572, -8.730799], [14286, -8.793973], [22676, -8.830424], [23052, -8.887156], [9024, -8.910595], [17899, -8.924405], [84419, -8.929075], [16486, -8.970013], [5052, -9.072498], [87755, -9.075884], [25406, -9.100603], [59825, -9.115516], [35757, -9.157829], [11794, -9.273745], [45994, -9.277754], [18162, -9.314251], [21832, -9.318976], [20688, -9.320335], [118960, -9.334919], [19356, -9.434397], [10975, -9.467144], [40670, -9.468345], [112499, -9.485428], [61082, -9.539345], [92748, -9.541582], [15113, -9.568161], [3891, -9.575852], [4835, -9.582384], [5622, -9.624878], [63714, -9.676485], [64729, -9.676706], [22745, -9.696841], [46918, -9.711126], [22188, -9.732381], [108281, -9.759096], [102011, -9.780166], [48802, -9.787956], [115531, -9.805896], [28888, -9.818657], [69724, -9.822031], [58951, -9.839945], [9683, -9.859652], [16172, -9.864403], [13498, -9.867802], [12095, -9.870984], [47099, -9.889927], [56937, -9.922205], [26682, -9.955122], [36286, -10.001293], [5213, -10.039154], [37670, -10.095177], [9273, -10.109457], [43892, -10.13392], [34361, -10.157568], [18625, -10.173097], [15550, -10.238226], [2944, -10.239304], [86104, -10.241622], [122907, -10.24437], [29824, -10.256102], [8429, -10.264029], [116336, -10.278431], [11397, -10.304621], [124853, -10.34176], [67554, -10.348824], [16811, -10.354904], [21034, -10.362411], [61212, -10.369173], [77235, -10.371058], [14462, -10.402905]], "logprob_of_token": -9.273745, "top1_top2_margin": 2.746394, "top6_top7_margin": 0.759785}]}, {"prompt": "counting: one two three four five six seven", "input_ids": [586, 259, 58, 2403, 1311, 2467, 2555, 4241, 8445, 12843], "generated_ids": [12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843], "rows": [{"gen_index": 0, "token": 12843, "top": [[8445, -0.184412], [12843, -2.726078], [2403, -4.038544], [58, -4.326438], [8435, -5.525877], [16363, -5.619025], [44, -5.939901], [46612, -6.086347], [30877, -6.224005], [14188, -6.383551], [46, -6.580112], [8206, -6.716327], [19827, -6.819881], [32, -6.874831], [54, -6.953902], [14031, -6.992788], [735, -7.065187], [59, -7.111911], [78308, -7.173494], [4241, -7.318043], [1932, -7.466565], [2555, -7.497138], [405, -7.587195], [286, -7.631402], [65112, -7.658482], [55333, -7.698431], [1829, -7.851638], [26458, -7.859461], [63, -7.871953], [23556, -7.876517], [55, -7.89961], [941, -7.958606], [120007, -7.982994], [766, -7.9862], [6559, -8.015289], [90236, -8.097683], [14313, -8.174839], [42613, -8.205259], [527, -8.234654], [262, -8.26074], [5951, -8.262667], [127906, -8.279712], [31663, -8.347639], [1343, -8.396482], [1275, -8.397554], [14395, -8.410183], [5274, -8.419439], [946, -8.451488], [4401, -8.459185], [310, -8.460964], [53650, -8.506228], [2376, -8.532296], [622, -8.578186], [1702, -8.627603], [1311, -8.764975], [263, -8.78713], [529, -8.870873], [26209, -8.919907], [79108, -9.014686], [28346, -9.03483], [120022, -9.066082], [379, -9.074869], [58588, -9.10691], [353, -9.143929], [33335, -9.171442], [14825, -9.180789], [120006, -9.18625], [2799, -9.205421], [14179, -9.209064], [6917, -9.22451], [122545, -9.23005], [14983, -9.260784], [4739, -9.280259], [1781, -9.305672], [568, -9.325342], [5218, -9.329863], [476, -9.340193], [2944, -9.347441], [900, -9.375608], [1409, -9.383676], [582, -9.40415], [9156, -9.406406], [275, -9.409719], [14729, -9.416076], [318, -9.443342], [63487, -9.466074], [4688, -9.479126], [716, -9.480237], [3301, -9.499191], [565, -9.524141], [1765, -9.53327], [1333, -9.535637], [936, -9.537602], [816, -9.544125], [2467, -9.552402], [33417, -9.565722], [4037, -9.568077], [72714, -9.572006], [8545, -9.573257], [20665, -9.580579]], "logprob_of_token": -2.726078, "top1_top2_margin": 2.541666, "top6_top7_margin": 0.320877}, {"gen_index": 1, "token": 12843, "top": [[12843, -0.815395], [8445, -1.540498], [14031, -1.669002], [2403, -3.630401], [58, -4.216987], [30877, -4.826238], [19827, -5.003707], [14188, -5.922303], [2555, -6.005994], [55333, -6.034135], [37720, -6.084331], [44, -6.306763], [10133, -6.31306], [6559, -6.38477], [8206, -6.51736], [31663, -6.612529], [14395, -6.621855], [46, -6.639769], [8435, -6.652195], [735, -6.71067], [46612, -6.723635], [55, -6.864413], [16363, -6.890546], [59, -7.007078], [286, -7.012008], [262, -7.042014], [1932, -7.214604], [29350, -7.251261], [1204, -7.264328], [90236, -7.34958], [56, -7.400673], [26209, -7.429516], [1311, -7.495175], [1829, -7.518827], [32, -7.561996], [941, -7.602576], [1275, -7.614415], [263, -7.665797], [94021, -7.68912], [405, -7.704704], [42613, -7.715331], [766, -7.757552], [28346, -7.79815], [38555, -7.854369], [76591, -7.856811], [127906, -7.890366], [622, -7.938189], [946, -8.058021], [1702, -8.060067], [4401, -8.082618], [527, -8.123175], [5274, -8.218606], [55332, -8.272053], [54, -8.338875], [310, -8.346809], [63, -8.347288], [4241, -8.36349], [90879, -8.377305], [122545, -8.382167], [936, -8.385848], [43032, -8.442967], [120006, -8.445748], [120007, -8.448193], [73987, -8.590486], [63487, -8.61248], [43605, -8.641831], [4595, -8.647016], [275, -8.651028], [68743, -8.66401], [120022, -8.74776], [56097, -8.753196], [1333, -8.75927], [5951, -8.782698], [53650, -8.826706], [816, -8.841438], [66032, -8.854041], [75282, -8.860878], [379, -8.867151], [33335, -8.87059], [1409, -8.946554], [4758, -8.947641], [353, -8.954741], [80764, -8.963527], [23556, -8.989081], [78308, -8.997004], [1343, -9.014752], [2376, -9.017049], [9156, -9.035531], [5218, -9.080675], [318, -9.104599], [2467, -9.118965], [15533, -9.121716], [7510, -9.132402], [70341, -9.141969], [108744, -9.152862], [121080, -9.162307], [72714, -9.165308], [900, -9.18942], [26458, -9.19828], [3084, -9.207273]], "logprob_of_token": -0.815395, "top1_top2_margin": 0.725103, "top6_top7_margin": 0.177469}, {"gen_index": 2, "token": 12843, "top": [[12843, -0.166266], [14031, -2.393613], [19827, -4.765736], [2403, -4.884791], [8445, -5.890542], [55333, -5.943286], [58, -6.195442], [31663, -6.369451], [6559, -6.645507], [37720, -6.906727], [26209, -6.961033], [44, -6.963228], [14395, -7.011555], [14188, -7.304338], [55, -7.493507], [90236, -7.497094], [46, -7.551224], [59, -7.587005], [29350, -7.673464], [286, -7.693159], [1204, -7.841482], [1932, -7.969646], [55332, -7.986974], [76591, -7.99811], [10133, -8.029291], [80764, -8.157786], [4401, -8.185964], [2555, -8.191562], [1275, -8.219628], [735, -8.249954], [941, -8.346663], [262, -8.364902], [38336, -8.532698], [38555, -8.562325], [94021, -8.62275], [30877, -8.645925], [68743, -8.707938], [405, -8.786031], [1829, -8.817154], [263, -8.836511], [66032, -8.838078], [5274, -8.85884], [1311, -8.880809], [946, -8.899854], [33335, -8.903583], [766, -8.908214], [127906, -9.031907], [1409, -9.05866], [32, -9.117917], [5951, -9.150284], [2376, -9.163886], [56, -9.171168], [4241, -9.238438], [120007, -9.262518], [63, -9.309419], [527, -9.316241], [108744, -9.320111], [34210, -9.344142], [121080, -9.3576], [622, -9.371846], [936, -9.416379], [28346, -9.424067], [75282, -9.427621], [275, -9.432176], [70341, -9.432443], [43605, -9.475667], [310, -9.491101], [4758, -9.504027], [120022, -9.514313], [33274, -9.697495], [4739, -9.724751], [2944, -9.725242], [4595, -9.791749], [919, -9.795205], [19898, -9.825653], [2213, -9.874503], [2467, -9.877059], [1333, -9.893994], [7510, -9.922871], [5637, -9.926346], [4205, -9.952669], [90879, -9.984698], [900, -10.016593], [72714, -10.022722], [1739, -10.046653], [4850, -10.07013], [125745, -10.076541], [117101, -10.100403], [2503, -10.103732], [318, -10.115525], [73987, -10.141782], [5218, -10.150476], [1848, -10.173195], [8206, -10.180095], [3326, -10.189062], [966, -10.210956], [1433, -10.210975], [120006, -10.213344], [68987, -10.215072], [43032, -10.232515]], "logprob_of_token": -0.166266, "top1_top2_margin": 2.227347, "top6_top7_margin": 0.252156}, {"gen_index": 3, "token": 12843, "top": [[12843, -0.09775], [14031, -3.623824], [2403, -4.586133], [19827, -4.589899], [55333, -5.6545], [58, -6.123263], [31663, -6.404834], [6559, -6.450133], [44, -6.637889], [26209, -6.680522], [14395, -6.693928], [8445, -7.008032], [14188, -7.089682], [286, -7.132187], [55, -7.204679], [46, -7.250264], [90236, -7.278174], [59, -7.384793], [37720, -7.821185], [30877, -7.832809], [80764, -7.899472], [38336, -8.133911], [735, -8.208008], [1932, -8.257859], [55332, -8.274179], [5951, -8.288465], [76591, -8.388725], [33335, -8.483534], [2555, -8.519253], [1829, -8.533293], [262, -8.542514], [66032, -8.54538], [68743, -8.57522], [405, -8.63201], [1275, -8.647912], [29350, -8.662336], [263, -8.67579], [127906, -8.742529], [4401, -8.752678], [94021, -8.785027], [946, -8.818512], [1311, -8.830317], [941, -8.83374], [120007, -8.851587], [766, -8.880778], [5274, -8.889924], [10133, -8.914769], [622, -8.999316], [63, -9.004223], [43605, -9.023951], [4241, -9.077174], [32, -9.082569], [120022, -9.093428], [1409, -9.148939], [121080, -9.192871], [4739, -9.284155], [108744, -9.32695], [275, -9.331852], [527, -9.399481], [72714, -9.406867], [4758, -9.422032], [38555, -9.441982], [2376, -9.445433], [310, -9.448391], [117101, -9.482132], [8206, -9.488209], [2467, -9.611491], [2944, -9.623853], [936, -9.627282], [28346, -9.64735], [4205, -9.701674], [125745, -9.730861], [12456, -9.734976], [34210, -9.74978], [2213, -9.758024], [5071, -9.763238], [1204, -9.867937], [56, -9.883375], [5218, -9.884083], [919, -9.901881], [11292, -9.915584], [17736, -9.938639], [120006, -9.991737], [318, -10.068918], [1333, -10.074128], [70341, -10.079792], [5637, -10.092794], [900, -10.102575], [75282, -10.131375], [4731, -10.149862], [33274, -10.157258], [7510, -10.162196], [8265, -10.169571], [777, -10.179652], [120008, -10.187579], [4850, -10.188632], [13460, -10.194212], [33, -10.22067], [14147, -10.253658], [19898, -10.263314]], "logprob_of_token": -0.09775, "top1_top2_margin": 3.526075, "top6_top7_margin": 0.281571}, {"gen_index": 4, "token": 12843, "top": [[12843, -0.161755], [14031, -3.230798], [2403, -4.186324], [19827, -4.543851], [58, -5.409203], [44, -5.529599], [6559, -5.575794], [55333, -5.697674], [30877, -5.814146], [26209, -6.105219], [14188, -6.178917], [31663, -6.404621], [14395, -6.442501], [8445, -6.444872], [46, -6.484912], [90236, -6.626428], [59, -6.825016], [55, -7.17079], [37720, -7.423167], [10133, -7.439329], [1829, -7.525312], [286, -7.594337], [80764, -7.616508], [405, -7.779074], [29350, -7.780748], [94021, -7.874374], [66032, -7.908918], [263, -7.960694], [127906, -7.962029], [68743, -7.967648], [63, -8.008668], [76591, -8.01946], [5951, -8.032857], [262, -8.058355], [946, -8.143443], [4241, -8.189334], [1932, -8.197228], [735, -8.219212], [622, -8.245505], [8206, -8.27356], [43605, -8.313395], [55332, -8.395797], [33335, -8.421618], [38336, -8.422572], [72714, -8.559697], [2555, -8.56511], [275, -8.565269], [120007, -8.578795], [12456, -8.588951], [941, -8.589017], [5274, -8.598216], [28346, -8.610558], [766, -8.675718], [90879, -8.718284], [38555, -8.745723], [117101, -8.768267], [32, -8.770608], [120022, -8.845534], [1275, -8.849909], [4739, -8.953115], [310, -9.059498], [1311, -9.069706], [120006, -9.134956], [527, -9.166131], [33, -9.187304], [1409, -9.206038], [40506, -9.226737], [2467, -9.269604], [936, -9.279021], [2376, -9.303294], [17736, -9.306752], [259, -9.343557], [80524, -9.377192], [56, -9.388541], [8265, -9.411028], [14147, -9.426938], [12611, -9.435065], [4401, -9.447707], [75282, -9.454332], [1204, -9.468745], [2944, -9.469329], [121080, -9.477219], [5071, -9.478002], [2213, -9.482675], [125745, -9.494514], [14161, -9.507496], [816, -9.523767], [1433, -9.53839], [14179, -9.538813], [318, -9.547511], [120008, -9.554282], [19969, -9.567267], [5218, -9.599072], [669, -9.623395], [108744, -9.64506], [122545, -9.648713], [17308, -9.699698], [4688, -9.707589], [7449, -9.721807], [763, -9.722293]], "logprob_of_token": -0.161755, "top1_top2_margin": 3.069042, "top6_top7_margin": 0.046196}, {"gen_index": 5, "token": 12843, "top": [[12843, -0.118376], [14031, -4.083147], [19827, -4.454775], [8445, -4.697456], [2403, -4.721086], [55333, -5.71385], [26209, -5.837894], [6559, -5.872963], [31663, -6.062454], [44, -6.61413], [14395, -6.924112], [30877, -7.030813], [90236, -7.305811], [58, -7.330418], [14188, -7.379669], [55, -7.406588], [28346, -7.595141], [286, -7.603053], [1311, -7.687927], [4241, -7.705192], [59, -7.742961], [5951, -7.846578], [66032, -7.851225], [80764, -7.856721], [68743, -7.870645], [46, -7.90783], [33335, -7.945145], [55332, -7.950677], [43605, -8.177483], [946, -8.184325], [37720, -8.192404], [1932, -8.214965], [38336, -8.25041], [76591, -8.250735], [262, -8.344554], [735, -8.413358], [8206, -8.43531], [10133, -8.580844], [29350, -8.619245], [32, -8.620975], [63, -8.706014], [941, -8.715142], [1275, -8.722739], [94021, -8.742986], [622, -8.74932], [46612, -8.768043], [2467, -8.771679], [1829, -8.883129], [405, -8.899597], [2555, -8.909862], [5274, -8.917181], [125745, -8.963363], [766, -8.966052], [1409, -8.987988], [127906, -9.000597], [120007, -9.026182], [12456, -9.065296], [4739, -9.077064], [2213, -9.081182], [121080, -9.090709], [117101, -9.128282], [310, -9.194459], [2376, -9.253292], [936, -9.295256], [263, -9.31096], [38555, -9.341197], [120022, -9.341655], [8435, -9.358871], [318, -9.369052], [2944, -9.372294], [43032, -9.403301], [40506, -9.40442], [4401, -9.419543], [108744, -9.422904], [900, -9.463866], [16363, -9.489789], [72714, -9.50663], [20665, -9.514513], [527, -9.557254], [33445, -9.576827], [1781, -9.620035], [275, -9.657113], [42613, -9.672861], [1204, -9.688278], [19969, -9.69706], [2503, -9.708385], [4758, -9.718093], [17736, -9.724555], [3688, -9.749498], [4869, -9.785883], [565, -9.792805], [122545, -9.811637], [1410, -9.817038], [11292, -9.833003], [75112, -9.848931], [14729, -9.894923], [919, -9.895709], [1270, -9.913898], [4205, -9.919282], [33274, -9.928302]], "logprob_of_token": -0.118376, "top1_top2_margin": 3.96477, "top6_top7_margin": 0.124044}, {"gen_index": 6, "token": 12843, "top": [[12843, -0.148157], [14031, -3.141271], [2403, -4.473216], [19827, -4.52387], [8445, -4.713568], [55333, -5.448925], [26209, -5.987475], [6559, -6.055719], [31663, -6.476735], [30877, -6.769867], [44, -6.815725], [37720, -7.109514], [90236, -7.21115], [14188, -7.223661], [286, -7.298899], [58, -7.351489], [55, -7.422726], [59, -7.51274], [14395, -7.610473], [55332, -7.611509], [46, -7.676079], [8206, -7.711915], [10133, -7.816278], [68743, -7.855288], [5951, -7.931669], [1932, -7.958672], [735, -7.959657], [80764, -7.980254], [66032, -7.983788], [94021, -7.98825], [946, -8.035486], [1311, -8.059583], [28346, -8.078008], [4241, -8.103733], [76591, -8.190335], [29350, -8.274047], [262, -8.312328], [63, -8.384716], [1275, -8.429363], [38555, -8.453364], [2467, -8.48849], [46612, -8.509933], [2503, -8.580413], [33335, -8.599777], [941, -8.607937], [1829, -8.613335], [405, -8.619934], [5274, -8.64663], [32, -8.676417], [2555, -8.683132], [766, -8.720088], [120022, -8.806864], [120007, -8.815013], [622, -8.834818], [1204, -8.838284], [318, -8.844009], [121080, -8.844994], [127906, -8.899634], [43605, -8.952471], [12456, -8.960286], [263, -9.01294], [4401, -9.014696], [38336, -9.042856], [1409, -9.072663], [527, -9.088127], [900, -9.105124], [310, -9.157398], [2944, -9.23], [936, -9.275841], [43032, -9.293344], [108744, -9.321049], [4739, -9.35729], [42613, -9.359642], [1270, -9.400793], [275, -9.405462], [2376, -9.417276], [919, -9.439978], [125745, -9.45361], [90879, -9.478014], [56, -9.478138], [40506, -9.486799], [16363, -9.562101], [1781, -9.566938], [1840, -9.594667], [117101, -9.597611], [72714, -9.617335], [11292, -9.624122], [1410, -9.628925], [8435, -9.651666], [2213, -9.654076], [476, -9.660046], [75282, -9.679291], [17736, -9.681112], [970, -9.682896], [1776, -9.687408], [20665, -9.702909], [4758, -9.709142], [3688, -9.76266], [19969, -9.79134], [8265, -9.794106]], "logprob_of_token": -0.148157, "top1_top2_margin": 2.993113, "top6_top7_margin": 0.53855}, {"gen_index": 7, "token": 12843, "top": [[12843, -0.125249], [2403, -3.532024], [19827, -4.256833], [14031, -4.600856], [55333, -5.378962], [8445, -5.885662], [6559, -5.926008], [26209, -6.117514], [31663, -6.279401], [30877, -6.46485], [58, -6.720351], [55332, -6.985964], [44, -7.112034], [286, -7.189442], [90236, -7.221461], [55, -7.356144], [80764, -7.436442], [59, -7.478818], [46, -7.481127], [14188, -7.48597], [8206, -7.539181], [735, -7.81646], [68743, -7.885255], [14395, -7.889966], [2555, -7.931814], [66032, -7.939871], [76591, -8.03778], [1932, -8.263576], [37720, -8.270656], [1275, -8.314405], [63, -8.337449], [121080, -8.393661], [262, -8.417233], [1829, -8.466295], [941, -8.540645], [946, -8.561099], [38336, -8.578038], [622, -8.719813], [4241, -8.743234], [5951, -8.758028], [127906, -8.758671], [766, -8.8599], [405, -8.879807], [2503, -8.892644], [10133, -8.908781], [263, -8.931373], [120022, -8.961569], [2944, -8.96164], [8265, -8.962398], [94021, -8.97314], [108744, -8.988617], [72714, -8.991632], [43032, -8.996504], [1204, -9.014156], [120007, -9.017617], [527, -9.032709], [1409, -9.036456], [5274, -9.053566], [816, -9.054068], [2467, -9.070039], [275, -9.156013], [33335, -9.157632], [125745, -9.158876], [32, -9.185127], [310, -9.196172], [28346, -9.236694], [43605, -9.271611], [63487, -9.272458], [4401, -9.288451], [900, -9.32149], [40506, -9.37193], [919, -9.37774], [29350, -9.389543], [46612, -9.394786], [1311, -9.395631], [117101, -9.484473], [4739, -9.509217], [1848, -9.543195], [318, -9.560234], [1333, -9.592783], [936, -9.650223], [2376, -9.697442], [1319, -9.698263], [20195, -9.699102], [33445, -9.720056], [378, -9.734843], [5071, -9.780023], [70341, -9.788655], [1776, -9.790099], [17736, -9.793707], [122545, -9.801742], [42613, -9.838901], [1270, -9.841573], [835, -9.872487], [1309, -9.875401], [120006, -9.875894], [4731, -9.880535], [3924, -9.886447], [33417, -9.889342], [38555, -9.895646]], "logprob_of_token": -0.125249, "top1_top2_margin": 3.406775, "top6_top7_margin": 0.040346}, {"gen_index": 8, "token": 12843, "top": [[12843, -0.110007], [2403, -3.648125], [14031, -4.550103], [19827, -4.60081], [55333, -5.182156], [6559, -5.876659], [55332, -6.028842], [26209, -6.477029], [31663, -6.496632], [44, -6.782563], [55, -6.878343], [8445, -6.908375], [58, -7.053852], [59, -7.08255], [90236, -7.218184], [80764, -7.276705], [2555, -7.533314], [14188, -7.573152], [286, -7.581415], [46, -7.698027], [76591, -7.702788], [14395, -7.712135], [735, -7.76984], [30877, -8.020029], [66032, -8.113227], [121080, -8.16238], [1932, -8.171261], [127906, -8.308064], [43032, -8.318046], [5951, -8.337913], [38336, -8.363286], [946, -8.367223], [68743, -8.437228], [941, -8.470565], [37720, -8.492429], [1829, -8.493668], [63, -8.497565], [262, -8.645125], [10133, -8.650266], [263, -8.667756], [622, -8.706218], [94021, -8.715645], [405, -8.719129], [43605, -8.749041], [108744, -8.782028], [1275, -8.805271], [4241, -8.809773], [20195, -8.816184], [527, -8.860979], [8206, -8.867959], [2944, -8.932891], [766, -8.964429], [33335, -8.990596], [63487, -9.060546], [120022, -9.078399], [72714, -9.080157], [5274, -9.140571], [816, -9.142187], [117101, -9.182261], [275, -9.190673], [120007, -9.210129], [1409, -9.232091], [42613, -9.252349], [919, -9.259724], [4739, -9.27997], [310, -9.296786], [32, -9.305657], [28346, -9.330504], [900, -9.350593], [8265, -9.427784], [4401, -9.454216], [125745, -9.469367], [1311, -9.505349], [12456, -9.542244], [936, -9.565593], [29350, -9.598933], [4595, -9.61309], [70341, -9.624286], [33445, -9.679223], [1204, -9.687274], [2467, -9.705395], [2376, -9.729529], [378, -9.732944], [37033, -9.818749], [4758, -9.843778], [318, -9.894875], [5071, -9.912962], [4731, -9.938973], [14147, -9.977767], [279, -9.989217], [1270, -10.013791], [8545, -10.016013], [38555, -10.016254], [1333, -10.023243], [19969, -10.031216], [1776, -10.035701], [2213, -10.035993], [1309, -10.046216], [379, -10.046219], [5637, -10.04893]], "logprob_of_token": -0.110007, "top1_top2_margin": 3.538117, "top6_top7_margin": 0.152183}, {"gen_index": 9, "token": 12843, "top": [[12843, -0.084679], [2403, -3.884549], [14031, -4.516746], [19827, -4.848345], [55333, -5.26974], [6559, -6.407638], [26209, -6.509662], [55332, -6.535925], [31663, -6.748278], [44, -6.839641], [14395, -6.842545], [55, -7.145283], [59, -7.179792], [58, -7.214432], [90236, -7.500954], [80764, -7.55827], [286, -7.590541], [14188, -7.698604], [8445, -7.779981], [46, -7.809248], [76591, -8.264267], [2555, -8.297916], [735, -8.41046], [946, -8.426487], [68743, -8.489218], [4241, -8.496346], [66032, -8.531189], [127906, -8.621296], [38336, -8.637303], [94021, -8.653432], [37720, -8.666465], [121080, -8.674755], [941, -8.710802], [1829, -8.812157], [5951, -8.831608], [1932, -8.882337], [43605, -8.891141], [262, -8.903419], [10133, -8.90353], [263, -8.995731], [43032, -9.01256], [20195, -9.058151], [33335, -9.058569], [1275, -9.09729], [405, -9.159302], [63, -9.219293], [622, -9.260939], [108744, -9.293215], [1311, -9.302612], [527, -9.33381], [5274, -9.365512], [766, -9.387581], [117101, -9.403025], [72714, -9.44142], [310, -9.456414], [120022, -9.466812], [275, -9.511368], [4739, -9.516109], [1409, -9.566742], [63487, -9.573917], [8265, -9.582186], [29350, -9.603811], [900, -9.612534], [2944, -9.632729], [919, -9.666136], [28346, -9.699339], [816, -9.736446], [32, -9.743376], [120007, -9.758896], [125745, -9.772614], [30877, -9.780905], [2467, -9.898903], [4595, -9.943512], [2376, -9.973351], [8206, -9.990768], [19969, -9.993971], [378, -10.00802], [38555, -10.021883], [1204, -10.03149], [12456, -10.055656], [936, -10.077654], [4758, -10.107235], [4401, -10.122109], [318, -10.142959], [4205, -10.213256], [42613, -10.218616], [14825, -10.241626], [17736, -10.242275], [14147, -10.26193], [2213, -10.271339], [70341, -10.272193], [14729, -10.28854], [439, -10.327106], [379, -10.332065], [279, -10.357734], [5071, -10.361767], [474, -10.371235], [1848, -10.387472], [777, -10.413454], [5637, -10.414948]], "logprob_of_token": -0.084679, "top1_top2_margin": 3.79987, "top6_top7_margin": 0.102024}, {"gen_index": 10, "token": 12843, "top": [[12843, -0.145011], [14031, -3.279888], [2403, -3.796991], [19827, -4.816258], [55333, -5.552557], [44, -5.826604], [1311, -5.857767], [8445, -5.9424], [26209, -6.060638], [59, -6.146777], [46, -6.444537], [14395, -6.468999], [6559, -6.631058], [58, -6.745364], [31663, -6.784735], [14188, -6.821221], [55, -7.066834], [286, -7.382678], [55332, -7.483642], [946, -7.590862], [90236, -7.735914], [37720, -7.752428], [4241, -7.788081], [80764, -7.833899], [735, -7.925186], [127906, -7.944681], [1829, -7.9698], [94021, -7.991643], [43605, -7.991927], [2555, -7.998034], [263, -8.096999], [33335, -8.153525], [63, -8.193088], [10133, -8.29988], [1932, -8.300344], [941, -8.347803], [68743, -8.389915], [66032, -8.401933], [262, -8.417357], [5951, -8.444232], [76591, -8.466368], [527, -8.486199], [38336, -8.519975], [29350, -8.526111], [28346, -8.531484], [275, -8.53516], [5274, -8.585376], [766, -8.63482], [405, -8.667059], [120022, -8.708666], [32, -8.770736], [1275, -8.779098], [318, -8.798455], [622, -8.805419], [121080, -8.82749], [2467, -8.896665], [38555, -8.961994], [1409, -8.969097], [43032, -9.039921], [120007, -9.057257], [900, -9.07899], [8265, -9.10775], [72714, -9.123171], [936, -9.129951], [310, -9.144545], [1204, -9.162578], [19969, -9.271392], [7510, -9.302377], [8206, -9.36891], [12456, -9.425941], [14161, -9.448207], [30877, -9.448274], [2376, -9.457032], [14147, -9.473571], [125745, -9.481254], [56, -9.49303], [4739, -9.494494], [2944, -9.52579], [439, -9.57753], [716, -9.598451], [1270, -9.609834], [14825, -9.623513], [5218, -9.632844], [33, -9.634531], [2213, -9.639581], [117101, -9.654365], [20195, -9.659673], [1410, -9.66688], [75282, -9.667994], [14729, -9.677161], [476, -9.678519], [108744, -9.682148], [120014, -9.693113], [4401, -9.698239], [531, -9.729308], [4758, -9.76871], [63487, -9.771554], [46612, -9.777075], [3688, -9.778743], [1781, -9.779843]], "logprob_of_token": -0.145011, "top1_top2_margin": 3.134877, "top6_top7_margin": 0.031163}, {"gen_index": 11, "token": 12843, "top": [[12843, -0.250067], [14031, -2.908847], [2403, -3.420883], [1311, -4.400662], [19827, -4.503201], [55333, -5.269587], [8445, -5.604636], [44, -5.743447], [26209, -5.790687], [59, -5.794238], [946, -6.184695], [31663, -6.201623], [46, -6.266025], [14395, -6.314613], [14188, -6.400184], [55, -6.565038], [286, -6.571421], [63, -6.843802], [6559, -6.883597], [37720, -7.06582], [55332, -7.078272], [58, -7.081702], [318, -7.228042], [90236, -7.316137], [120022, -7.343711], [766, -7.428054], [1829, -7.445779], [94021, -7.462596], [127906, -7.557623], [1932, -7.568333], [262, -7.576609], [120007, -7.600095], [735, -7.604349], [33335, -7.605775], [527, -7.647993], [405, -7.65859], [43605, -7.702718], [29350, -7.720928], [32, -7.743239], [1275, -7.778856], [622, -7.846674], [263, -7.851091], [80764, -7.864675], [5951, -7.889118], [38555, -8.063897], [1409, -8.073785], [941, -8.084898], [121080, -8.129688], [5274, -8.137559], [4401, -8.146802], [68743, -8.149592], [28346, -8.159022], [76591, -8.173636], [2555, -8.175003], [936, -8.181355], [4241, -8.187543], [19969, -8.242276], [7510, -8.281139], [10133, -8.293954], [275, -8.306977], [2376, -8.348042], [66032, -8.366564], [8265, -8.480217], [2467, -8.520208], [56, -8.534163], [310, -8.591505], [4595, -8.630851], [1204, -8.655375], [1410, -8.669477], [14177, -8.674253], [900, -8.674754], [72714, -8.685914], [2944, -8.702825], [1781, -8.727155], [38336, -8.768067], [716, -8.864602], [14825, -8.897633], [919, -8.915126], [46612, -8.949293], [4731, -8.950477], [4739, -8.970296], [30877, -8.976629], [125745, -8.989443], [439, -8.99904], [3688, -8.999606], [12456, -9.00015], [4758, -9.014333], [3394, -9.021129], [33, -9.035515], [8206, -9.035989], [1840, -9.036187], [1305, -9.061888], [14792, -9.076912], [5218, -9.081979], [1270, -9.082674], [2213, -9.082787], [379, -9.102544], [3368, -9.113687], [378, -9.119404], [3924, -9.124645]], "logprob_of_token": -0.250067, "top1_top2_margin": 2.65878, "top6_top7_margin": 0.335049}, {"gen_index": 12, "token": 12843, "top": [[12843, -0.200057], [14031, -2.538481], [2403, -4.224605], [19827, -4.611159], [55333, -5.023101], [8445, -6.178604], [26209, -6.224174], [31663, -6.566052], [44, -6.599555], [1311, -6.63255], [37720, -6.718376], [6559, -6.788961], [14395, -6.810611], [55332, -6.852025], [59, -6.951281], [946, -6.988882], [14188, -6.998437], [55, -7.026042], [46, -7.069701], [286, -7.183759], [94021, -7.291121], [1932, -7.371749], [90236, -7.375775], [58, -7.412359], [2555, -7.631014], [10133, -7.749166], [29350, -7.873283], [262, -7.907352], [76591, -7.923961], [38555, -7.967308], [80764, -7.979764], [120022, -8.005896], [30877, -8.007817], [63, -8.011665], [1829, -8.037468], [735, -8.110402], [941, -8.139785], [405, -8.190042], [127906, -8.251942], [32, -8.252015], [68743, -8.256976], [43032, -8.274531], [43605, -8.295086], [120007, -8.297716], [28346, -8.298275], [622, -8.315168], [527, -8.339838], [318, -8.35353], [2467, -8.401983], [263, -8.418225], [5274, -8.437228], [121080, -8.442309], [766, -8.450847], [66032, -8.475228], [1275, -8.475828], [1409, -8.495396], [33335, -8.548005], [4401, -8.587606], [5951, -8.596431], [4241, -8.601482], [900, -8.629715], [8206, -8.644187], [38336, -8.655768], [56, -8.696362], [1204, -8.77939], [19969, -8.781283], [310, -8.908973], [63487, -8.976803], [275, -8.98453], [919, -9.000073], [936, -9.013358], [7510, -9.014368], [20195, -9.070522], [72714, -9.075967], [12456, -9.080632], [108744, -9.083633], [2944, -9.100727], [4595, -9.232628], [42613, -9.256228], [33274, -9.265031], [1806, -9.320713], [379, -9.323339], [2213, -9.341737], [8265, -9.367509], [46612, -9.380265], [75282, -9.393016], [2503, -9.406996], [3688, -9.408962], [1343, -9.422656], [4205, -9.462663], [2376, -9.475015], [5218, -9.488572], [125745, -9.498189], [17736, -9.503219], [33445, -9.529905], [14825, -9.531748], [2457, -9.542926], [565, -9.570203], [529, -9.584189], [16147, -9.585752]], "logprob_of_token": -0.200057, "top1_top2_margin": 2.338424, "top6_top7_margin": 0.045571}, {"gen_index": 13, "token": 12843, "top": [[12843, -0.115972], [2403, -3.936986], [14031, -4.106618], [19827, -4.535508], [55333, -4.902473], [26209, -6.09319], [6559, -6.366802], [31663, -6.399648], [55332, -6.551434], [44, -6.891788], [8445, -6.946733], [59, -6.956622], [286, -6.993724], [55, -7.004461], [14188, -7.118436], [58, -7.168076], [90236, -7.318169], [14395, -7.366148], [46, -7.393741], [2555, -7.510241], [80764, -7.520123], [946, -7.647804], [76591, -7.736794], [1932, -7.87329], [68743, -7.882811], [120022, -7.884765], [120007, -7.995493], [37720, -8.009822], [1829, -8.107691], [63, -8.125895], [127906, -8.168295], [66032, -8.285516], [121080, -8.292705], [263, -8.359376], [262, -8.365179], [94021, -8.365199], [735, -8.394037], [405, -8.404481], [1275, -8.460585], [941, -8.534126], [38336, -8.539062], [30877, -8.576651], [43032, -8.635002], [4241, -8.641935], [10133, -8.718207], [622, -8.745403], [63487, -8.794222], [33335, -8.821509], [527, -8.841147], [766, -8.855946], [5274, -8.862374], [43605, -8.887792], [5951, -8.894007], [108744, -8.929458], [1409, -8.935953], [72714, -8.979591], [1204, -9.002679], [8206, -9.033458], [4401, -9.037924], [32, -9.052138], [29350, -9.068878], [2944, -9.079404], [7510, -9.096005], [275, -9.128984], [8265, -9.205516], [20195, -9.205997], [310, -9.20966], [1311, -9.306004], [900, -9.326715], [936, -9.334106], [125745, -9.336893], [38555, -9.339331], [28346, -9.415693], [919, -9.41824], [4739, -9.438153], [318, -9.44178], [2467, -9.519276], [4595, -9.565392], [2376, -9.605525], [379, -9.606122], [19969, -9.606422], [117101, -9.634617], [14825, -9.659922], [14161, -9.670731], [12456, -9.680807], [17736, -9.74416], [2457, -9.77231], [33274, -9.782969], [4205, -9.7882], [14147, -9.795746], [1848, -9.811453], [120014, -9.819965], [1333, -9.820471], [2213, -9.828262], [3688, -9.840626], [42613, -9.885096], [12611, -9.886331], [119747, -9.887373], [70341, -9.896538], [2503, -9.907218]], "logprob_of_token": -0.115972, "top1_top2_margin": 3.821013, "top6_top7_margin": 0.273612}, {"gen_index": 14, "token": 12843, "top": [[12843, -0.094339], [2403, -4.215338], [14031, -4.427439], [19827, -4.527095], [55333, -4.814873], [26209, -6.11969], [6559, -6.369989], [31663, -6.468896], [55332, -6.627021], [55, -6.917965], [14395, -7.052605], [59, -7.129756], [44, -7.178986], [90236, -7.290728], [8445, -7.333644], [80764, -7.376491], [286, -7.460896], [14188, -7.725491], [68743, -7.792401], [58, -7.822892], [46, -7.823303], [76591, -7.959035], [946, -8.13344], [2555, -8.143377], [66032, -8.195721], [1932, -8.224432], [37720, -8.272615], [121080, -8.321037], [127906, -8.356818], [94021, -8.443625], [38336, -8.455111], [120022, -8.543483], [43605, -8.675223], [735, -8.706013], [1829, -8.713355], [63, -8.748913], [120007, -8.767937], [33335, -8.7696], [941, -8.799482], [262, -8.802719], [4241, -8.838729], [5951, -8.852807], [1275, -8.86259], [10133, -8.900302], [405, -8.911387], [263, -8.961846], [527, -8.996706], [622, -9.059749], [108744, -9.059931], [5274, -9.132832], [1311, -9.135503], [43032, -9.154441], [72714, -9.212456], [63487, -9.226627], [117101, -9.254541], [2944, -9.327973], [125745, -9.356137], [29350, -9.359075], [310, -9.366516], [7510, -9.408205], [32, -9.423302], [4739, -9.427838], [766, -9.436869], [20195, -9.48452], [8265, -9.485902], [1409, -9.486464], [28346, -9.539341], [1204, -9.565504], [30877, -9.575946], [19969, -9.576241], [919, -9.621154], [38555, -9.622889], [275, -9.65554], [8206, -9.692188], [900, -9.702726], [2376, -9.761952], [936, -9.787894], [4401, -9.804819], [2467, -9.840059], [12456, -9.850127], [318, -9.851113], [119747, -9.875521], [378, -9.914173], [4595, -9.93258], [816, -9.93434], [14161, -9.949858], [379, -9.975449], [4205, -9.977152], [70341, -9.984785], [17736, -10.048116], [14147, -10.049898], [14825, -10.131507], [2457, -10.133408], [2213, -10.137331], [4731, -10.148273], [1806, -10.177438], [120014, -10.183887], [3688, -10.198937], [46612, -10.22821], [474, -10.230176]], "logprob_of_token": -0.094339, "top1_top2_margin": 4.120998, "top6_top7_margin": 0.250299}, {"gen_index": 15, "token": 12843, "top": [[12843, -0.14766], [14031, -3.664807], [2403, -4.200065], [55333, -4.413767], [19827, -4.482469], [26209, -5.944407], [44, -6.080669], [59, -6.184213], [6559, -6.184876], [55, -6.385059], [31663, -6.389256], [55332, -6.622128], [14395, -6.66429], [46, -6.735123], [14188, -6.823491], [8445, -7.018827], [946, -7.026486], [90236, -7.109144], [80764, -7.224241], [94021, -7.371033], [58, -7.392742], [286, -7.413547], [37720, -7.530222], [1932, -7.664546], [127906, -7.692761], [120022, -7.763176], [76591, -7.80575], [1829, -7.849675], [68743, -7.867537], [735, -7.884965], [63, -7.899797], [43605, -7.956202], [66032, -7.968228], [10133, -8.008354], [405, -8.043716], [120007, -8.09885], [121080, -8.126295], [1311, -8.160532], [5951, -8.17666], [263, -8.224949], [38336, -8.23698], [2555, -8.251101], [33335, -8.270161], [527, -8.388596], [262, -8.398005], [5274, -8.452644], [766, -8.485184], [1275, -8.533318], [622, -8.547536], [29350, -8.557166], [941, -8.611272], [72714, -8.652208], [32, -8.689312], [4241, -8.713777], [8206, -8.737672], [117101, -8.743506], [43032, -8.794317], [19969, -8.804273], [7510, -8.809299], [275, -8.811338], [28346, -8.827547], [63487, -8.829506], [108744, -8.846002], [38555, -8.908112], [310, -8.943575], [4739, -9.012667], [125745, -9.033621], [12456, -9.059408], [1409, -9.107224], [30877, -9.110974], [936, -9.124268], [318, -9.13808], [2944, -9.157495], [56, -9.16735], [20195, -9.186401], [1204, -9.190851], [14161, -9.192729], [119747, -9.206754], [900, -9.209241], [919, -9.238104], [8265, -9.254221], [5218, -9.289964], [378, -9.314629], [14147, -9.327562], [4401, -9.337305], [46612, -9.388394], [2376, -9.404959], [2467, -9.428667], [12611, -9.454967], [70341, -9.48314], [582, -9.493052], [17736, -9.497162], [75282, -9.508023], [379, -9.509078], [120014, -9.522372], [4205, -9.535508], [2213, -9.536934], [14825, -9.538694], [279, -9.602112], [33, -9.607386]], "logprob_of_token": -0.14766, "top1_top2_margin": 3.517147, "top6_top7_margin": 0.136261}, {"gen_index": 16, "token": 12843, "top": [[12843, -0.16218], [14031, -3.486134], [2403, -4.078034], [19827, -4.537114], [55333, -4.827373], [44, -5.734944], [59, -5.893452], [26209, -6.046065], [46, -6.345705], [6559, -6.489926], [8445, -6.492896], [31663, -6.541966], [14188, -6.558928], [55, -6.608861], [14395, -6.713758], [946, -6.883789], [55332, -6.94493], [58, -7.007803], [286, -7.099735], [1311, -7.222782], [90236, -7.227705], [1932, -7.371099], [63, -7.375696], [120022, -7.491559], [37720, -7.497785], [94021, -7.51459], [735, -7.525789], [127906, -7.543835], [80764, -7.546128], [1829, -7.632735], [5951, -7.641905], [120007, -7.892493], [2555, -7.976612], [263, -7.981925], [43605, -7.986559], [68743, -7.999782], [76591, -8.02457], [405, -8.046114], [4241, -8.079769], [527, -8.105114], [10133, -8.142316], [66032, -8.167477], [1275, -8.190554], [121080, -8.192881], [262, -8.209818], [766, -8.218157], [5274, -8.253793], [38336, -8.301159], [33335, -8.313774], [622, -8.34531], [7510, -8.371423], [29350, -8.397778], [32, -8.415041], [275, -8.428271], [941, -8.463881], [8206, -8.529073], [318, -8.536888], [12456, -8.669477], [28346, -8.716869], [936, -8.779762], [72714, -8.807873], [5218, -8.810101], [2467, -8.81028], [4401, -8.812091], [19969, -8.845753], [1409, -8.858437], [310, -8.874244], [900, -8.888352], [1204, -8.901609], [14161, -8.911762], [38555, -9.004043], [919, -9.010091], [108744, -9.017543], [125745, -9.020656], [63487, -9.049531], [117101, -9.09663], [14825, -9.135747], [56, -9.146649], [30877, -9.162155], [378, -9.179804], [4739, -9.186631], [582, -9.187917], [2944, -9.198969], [2376, -9.200495], [14147, -9.200724], [43032, -9.252765], [120014, -9.26674], [8265, -9.313305], [2213, -9.328184], [4205, -9.352089], [379, -9.357884], [120008, -9.369862], [17736, -9.381149], [33, -9.387], [70341, -9.399051], [46612, -9.411427], [33445, -9.424812], [20195, -9.431216], [439, -9.432783], [12611, -9.439928]], "logprob_of_token": -0.16218, "top1_top2_margin": 3.323955, "top6_top7_margin": 0.158507}, {"gen_index": 17, "token": 12843, "top": [[12843, -0.20502], [14031, -2.933274], [2403, -4.019503], [19827, -4.513413], [55333, -4.626474], [26209, -5.8908], [59, -6.090323], [44, -6.169318], [946, -6.28213], [31663, -6.293376], [8445, -6.293777], [46, -6.476558], [14188, -6.615485], [55, -6.630625], [286, -6.68367], [94021, -6.771517], [6559, -6.807194], [37720, -6.832378], [55332, -6.879329], [14395, -6.898961], [63, -6.921424], [1311, -7.114775], [1932, -7.16132], [90236, -7.23663], [5951, -7.270622], [120022, -7.353018], [58, -7.388897], [735, -7.431756], [127906, -7.467666], [29350, -7.585847], [1829, -7.683813], [80764, -7.745478], [405, -7.763305], [120007, -7.818556], [10133, -7.829126], [121080, -7.899896], [1275, -7.927901], [766, -7.963334], [2555, -8.012285], [38555, -8.014405], [68743, -8.019081], [262, -8.034961], [263, -8.088357], [527, -8.101976], [32, -8.132021], [76591, -8.144865], [4241, -8.164701], [43605, -8.165139], [5274, -8.166705], [622, -8.192849], [7510, -8.199932], [318, -8.211867], [33335, -8.266436], [8206, -8.304289], [66032, -8.36387], [941, -8.443], [936, -8.451209], [1409, -8.48201], [275, -8.510544], [30877, -8.511395], [56, -8.538613], [19969, -8.5669], [4401, -8.668497], [12456, -8.685027], [5218, -8.730802], [2467, -8.756337], [310, -8.759751], [2944, -8.764747], [38336, -8.805862], [1204, -8.816459], [28346, -8.819614], [378, -8.857812], [72714, -8.863358], [8265, -8.8739], [46612, -8.876724], [63487, -8.917254], [1781, -8.920146], [900, -8.926528], [2376, -8.94168], [108744, -8.946452], [919, -8.950505], [43032, -8.978173], [125745, -8.982819], [14161, -9.037291], [14825, -9.040307], [1410, -9.115708], [1840, -9.120778], [379, -9.123698], [4595, -9.137572], [5060, -9.142315], [75282, -9.152007], [4739, -9.156232], [582, -9.199484], [17736, -9.201623], [20195, -9.210294], [120014, -9.217436], [4758, -9.222345], [439, -9.266845], [2213, -9.269078], [12611, -9.274442]], "logprob_of_token": -0.20502, "top1_top2_margin": 2.728253, "top6_top7_margin": 0.199523}, {"gen_index": 18, "token": 12843, "top": [[12843, -0.175224], [14031, -3.031421], [2403, -4.232296], [19827, -4.504908], [55333, -4.68363], [26209, -6.145706], [44, -6.41989], [31663, -6.428841], [8445, -6.541143], [46, -6.637979], [55, -6.662473], [55332, -6.711078], [6559, -6.722103], [59, -6.724761], [14188, -6.778906], [946, -6.979898], [37720, -6.98461], [90236, -7.029956], [94021, -7.081637], [14395, -7.093663], [1932, -7.225844], [286, -7.244574], [58, -7.281334], [735, -7.28899], [1311, -7.377495], [63, -7.485225], [76591, -7.67987], [80764, -7.735771], [127906, -7.762589], [10133, -7.815133], [1829, -7.821814], [120022, -7.859233], [29350, -7.960652], [30877, -7.982231], [5951, -7.999508], [527, -8.000555], [405, -8.045472], [68743, -8.057493], [2555, -8.093158], [766, -8.093431], [262, -8.093854], [121080, -8.131889], [8206, -8.163642], [1275, -8.211381], [120007, -8.212158], [5274, -8.226374], [622, -8.254563], [38555, -8.274304], [263, -8.290077], [66032, -8.313758], [43605, -8.368755], [38336, -8.485787], [43032, -8.488032], [941, -8.524256], [32, -8.558806], [919, -8.592785], [2467, -8.661093], [4241, -8.676216], [56, -8.682126], [310, -8.693885], [275, -8.745476], [19969, -8.749791], [318, -8.769573], [378, -8.840288], [936, -8.931972], [72714, -8.948449], [1409, -8.952823], [108744, -8.976066], [7510, -8.989174], [4401, -8.991974], [900, -9.024384], [33335, -9.044565], [5218, -9.046901], [28346, -9.051335], [12456, -9.053971], [46612, -9.058641], [63487, -9.061813], [117101, -9.076356], [1204, -9.080116], [2944, -9.120424], [379, -9.156188], [20195, -9.183875], [8265, -9.214828], [125745, -9.270954], [14161, -9.283476], [1840, -9.287311], [33445, -9.333394], [439, -9.33911], [75282, -9.347353], [12611, -9.348932], [1064, -9.353317], [17736, -9.403708], [1309, -9.405308], [2376, -9.412591], [2213, -9.428274], [2457, -9.430655], [1410, -9.465341], [33274, -9.474124], [1343, -9.483577], [16147, -9.491582]], "logprob_of_token": -0.175224, "top1_top2_margin": 2.856196, "top6_top7_margin": 0.274184}, {"gen_index": 19, "token": 12843, "top": [[12843, -0.165102], [14031, -3.074993], [2403, -4.179349], [55333, -4.519988], [19827, -4.659892], [44, -6.278743], [26209, -6.324092], [46, -6.426998], [31663, -6.500042], [14188, -6.513262], [59, -6.569556], [58, -6.573135], [8445, -6.591124], [6559, -6.694628], [55332, -6.773273], [55, -6.78775], [90236, -6.930378], [946, -7.020452], [37720, -7.141565], [94021, -7.142463], [14395, -7.278873], [286, -7.460659], [735, -7.545033], [63, -7.556275], [1932, -7.566387], [76591, -7.725132], [1829, -7.758219], [10133, -7.781486], [80764, -7.797867], [127906, -7.834485], [1275, -7.93103], [120022, -7.931807], [2555, -7.94704], [1311, -8.028717], [405, -8.037008], [766, -8.051194], [263, -8.088871], [29350, -8.120917], [121080, -8.147825], [262, -8.251416], [527, -8.279775], [68743, -8.290343], [30877, -8.294237], [941, -8.359165], [5274, -8.384442], [120007, -8.398616], [66032, -8.402666], [622, -8.402719], [38555, -8.44347], [5951, -8.489693], [32, -8.495234], [8206, -8.510683], [919, -8.549888], [38336, -8.585526], [43605, -8.604372], [43032, -8.661037], [275, -8.666267], [4241, -8.81656], [108744, -8.846291], [56, -8.849408], [310, -8.862186], [2467, -8.956679], [63487, -8.963446], [7510, -8.986492], [72714, -8.995192], [936, -8.996107], [318, -9.008313], [19969, -9.016517], [46612, -9.051596], [33335, -9.058323], [28346, -9.110078], [900, -9.116981], [2944, -9.123417], [1409, -9.125816], [117101, -9.155449], [4401, -9.156652], [378, -9.156727], [379, -9.171275], [4595, -9.220737], [1204, -9.233006], [12611, -9.25195], [14161, -9.285986], [12456, -9.303224], [4739, -9.361205], [20195, -9.405769], [33445, -9.413158], [5218, -9.416069], [75282, -9.423404], [125745, -9.439547], [8265, -9.442478], [17736, -9.471697], [90879, -9.475451], [14147, -9.500075], [4758, -9.507563], [1840, -9.5141], [33, -9.524155], [2457, -9.543189], [1806, -9.558894], [33274, -9.56208], [529, -9.571707]], "logprob_of_token": -0.165102, "top1_top2_margin": 2.909891, "top6_top7_margin": 0.045349}, {"gen_index": 20, "token": 12843, "top": [[12843, -0.195545], [14031, -3.346319], [2403, -3.644821], [55333, -4.214867], [19827, -4.618723], [59, -6.019478], [26209, -6.089339], [44, -6.166478], [31663, -6.235827], [946, -6.312256], [55, -6.428728], [46, -6.475902], [6559, -6.52153], [8445, -6.547847], [55332, -6.572919], [14188, -6.585105], [58, -6.623749], [286, -6.961462], [94021, -6.979184], [14395, -7.004608], [63, -7.016805], [90236, -7.145025], [1932, -7.187735], [37720, -7.231791], [120022, -7.24069], [127906, -7.403225], [735, -7.511386], [80764, -7.552589], [1275, -7.588429], [120007, -7.616137], [766, -7.620137], [1829, -7.629442], [405, -7.672167], [121080, -7.749829], [76591, -7.823881], [263, -7.849413], [10133, -7.859712], [262, -7.89225], [30877, -7.947739], [8206, -7.94927], [29350, -7.972518], [941, -7.975502], [527, -8.007], [2555, -8.06931], [5951, -8.078568], [68743, -8.198454], [622, -8.200045], [66032, -8.209559], [5274, -8.252019], [7510, -8.340233], [1311, -8.43231], [32, -8.440166], [38555, -8.486344], [33335, -8.508152], [275, -8.551303], [2944, -8.559967], [936, -8.565393], [310, -8.570133], [318, -8.576783], [1409, -8.589211], [43605, -8.597102], [4241, -8.600706], [4595, -8.61652], [38336, -8.658539], [108744, -8.672853], [63487, -8.675874], [72714, -8.703027], [56, -8.714499], [4401, -8.758569], [46612, -8.766536], [19969, -8.786251], [919, -8.786755], [4739, -8.829839], [379, -8.878226], [8265, -8.887169], [1204, -8.893966], [43032, -8.956028], [2376, -8.961943], [900, -8.962471], [378, -8.994474], [125745, -9.055921], [1781, -9.092295], [1840, -9.111786], [12611, -9.117937], [4731, -9.120657], [20195, -9.121464], [14161, -9.131202], [117101, -9.16462], [16147, -9.176737], [12456, -9.181034], [120014, -9.193119], [119747, -9.19342], [14825, -9.195489], [14792, -9.228971], [5060, -9.252142], [2457, -9.254925], [2467, -9.255683], [33, -9.275503], [4205, -9.282792], [75282, -9.295497]], "logprob_of_token": -0.195545, "top1_top2_margin": 3.150774, "top6_top7_margin": 0.069861}, {"gen_index": 21, "token": 12843, "top": [[12843, -0.168808], [14031, -3.553237], [2403, -3.598616], [55333, -4.368864], [19827, -4.596746], [26209, -6.061943], [44, -6.127974], [59, -6.14887], [46, -6.209271], [6559, -6.436604], [31663, -6.52933], [55, -6.546843], [58, -6.594088], [14188, -6.682376], [8445, -6.719226], [55332, -6.791615], [14395, -6.864579], [946, -7.052495], [120022, -7.143551], [94021, -7.165531], [90236, -7.216768], [286, -7.250043], [63, -7.255512], [127906, -7.307765], [120007, -7.333428], [37720, -7.42639], [80764, -7.474651], [735, -7.565714], [1829, -7.688179], [1932, -7.705553], [2555, -7.83511], [76591, -7.863245], [405, -7.878962], [121080, -7.882945], [263, -7.922814], [10133, -8.007729], [68743, -8.038868], [5274, -8.170925], [527, -8.173018], [262, -8.216372], [66032, -8.219365], [38336, -8.232974], [766, -8.250146], [1275, -8.257981], [941, -8.281166], [29350, -8.470112], [275, -8.47245], [622, -8.488515], [5951, -8.499063], [43605, -8.541912], [32, -8.553919], [1311, -8.556061], [72714, -8.56502], [4241, -8.617614], [8206, -8.635103], [7510, -8.652568], [63487, -8.670224], [30877, -8.689914], [108744, -8.731886], [8265, -8.738487], [38555, -8.757349], [33335, -8.80541], [14161, -8.846436], [310, -8.892506], [900, -8.899542], [919, -8.94026], [43032, -8.959262], [1409, -8.985924], [936, -8.986556], [378, -8.989667], [2944, -9.035841], [1204, -9.039052], [19969, -9.083481], [56, -9.100946], [2467, -9.106488], [33, -9.130455], [318, -9.155834], [117101, -9.160081], [125745, -9.177712], [2213, -9.185432], [46612, -9.201972], [120014, -9.207338], [4739, -9.229483], [119747, -9.234272], [14147, -9.253111], [12611, -9.285046], [379, -9.298546], [20195, -9.33718], [2457, -9.338212], [12456, -9.340987], [816, -9.368947], [17736, -9.374952], [5218, -9.380211], [28346, -9.382196], [582, -9.428004], [14825, -9.430096], [4401, -9.453993], [75282, -9.473562], [5060, -9.481209], [1840, -9.530845]], "logprob_of_token": -0.168808, "top1_top2_margin": 3.384429, "top6_top7_margin": 0.066031}, {"gen_index": 22, "token": 12843, "top": [[12843, -0.162187], [14031, -3.47818], [2403, -3.665802], [55333, -4.606608], [19827, -4.643154], [26209, -6.053372], [59, -6.062214], [44, -6.131867], [46, -6.482021], [31663, -6.520673], [6559, -6.583216], [8445, -6.672561], [55, -6.702342], [946, -6.735197], [14188, -6.739111], [58, -6.806054], [14395, -6.948155], [55332, -6.973753], [120022, -7.114511], [63, -7.213449], [286, -7.215565], [90236, -7.316166], [94021, -7.332858], [127906, -7.378776], [120007, -7.426714], [37720, -7.485385], [80764, -7.618716], [735, -7.688106], [1932, -7.742031], [1829, -7.796272], [1311, -7.832893], [2555, -7.975831], [405, -8.00573], [121080, -8.034089], [76591, -8.035913], [5274, -8.079766], [68743, -8.123229], [263, -8.126077], [10133, -8.1368], [262, -8.211946], [1275, -8.294143], [527, -8.321743], [38336, -8.334815], [43605, -8.357802], [941, -8.365685], [4241, -8.368511], [32, -8.371751], [66032, -8.37474], [29350, -8.394279], [766, -8.427348], [5951, -8.496698], [7510, -8.499454], [33335, -8.636921], [622, -8.640903], [275, -8.662158], [72714, -8.698918], [8206, -8.820749], [63487, -8.867657], [8265, -8.869517], [38555, -8.880429], [108744, -8.923362], [14161, -8.932145], [30877, -8.94346], [936, -8.961702], [378, -8.972193], [318, -8.981511], [2467, -8.981897], [310, -8.986236], [19969, -9.009696], [1409, -9.012748], [1204, -9.023034], [900, -9.078469], [919, -9.131249], [28346, -9.220561], [14825, -9.226379], [56, -9.244144], [14147, -9.262389], [117101, -9.262395], [43032, -9.26691], [125745, -9.272591], [120014, -9.273791], [4739, -9.274179], [5218, -9.293479], [2944, -9.317693], [379, -9.33994], [12611, -9.342521], [46612, -9.350358], [582, -9.353492], [17736, -9.354821], [33, -9.360394], [119747, -9.402133], [4401, -9.407231], [20195, -9.410355], [12456, -9.414081], [2213, -9.42157], [5060, -9.461276], [70341, -9.492137], [2457, -9.537065], [16147, -9.540545], [3688, -9.565486]], "logprob_of_token": -0.162187, "top1_top2_margin": 3.315993, "top6_top7_margin": 0.008842}, {"gen_index": 23, "token": 12843, "top": [[12843, -0.231678], [14031, -3.066586], [2403, -3.383929], [19827, -4.509361], [55333, -4.554258], [59, -5.644147], [44, -5.757606], [26209, -5.83217], [946, -6.031779], [14188, -6.185181], [31663, -6.254896], [46, -6.266712], [8445, -6.466387], [286, -6.52808], [55, -6.616777], [63, -6.627348], [14395, -6.724739], [120022, -6.738626], [6559, -6.76056], [58, -6.82455], [94021, -6.883327], [37720, -6.902185], [55332, -6.920349], [127906, -7.121677], [735, -7.159125], [120007, -7.213637], [90236, -7.235098], [1311, -7.2804], [1829, -7.318393], [1932, -7.379997], [29350, -7.606372], [405, -7.641244], [80764, -7.662586], [121080, -7.690382], [5274, -7.723448], [262, -7.838724], [527, -7.839323], [263, -7.842319], [10133, -7.843239], [766, -7.881514], [1275, -7.8877], [2555, -7.907422], [68743, -7.915319], [5951, -7.915887], [76591, -7.955658], [32, -8.042118], [7510, -8.056598], [941, -8.098696], [4241, -8.139703], [38555, -8.195605], [622, -8.314793], [936, -8.32481], [8265, -8.344677], [275, -8.361892], [43605, -8.367491], [66032, -8.377719], [72714, -8.379108], [8206, -8.397917], [33335, -8.404576], [378, -8.427027], [318, -8.433357], [2467, -8.494223], [1409, -8.510523], [1204, -8.572405], [30877, -8.577973], [310, -8.603912], [2944, -8.622961], [38336, -8.627263], [919, -8.640288], [14161, -8.659116], [56, -8.710474], [19969, -8.734032], [4401, -8.773853], [120014, -8.817728], [63487, -8.837133], [12611, -8.849426], [14825, -8.918982], [46612, -8.955392], [108744, -8.960961], [900, -8.963783], [5060, -8.985977], [379, -9.013673], [125745, -9.015961], [582, -9.023068], [5218, -9.025277], [4739, -9.043837], [1840, -9.050674], [17736, -9.052027], [2376, -9.065804], [14147, -9.080089], [1781, -9.083227], [28346, -9.085837], [12456, -9.105622], [120018, -9.136099], [119747, -9.145722], [127750, -9.158314], [117101, -9.159964], [439, -9.166036], [4595, -9.166859], [33, -9.167038]], "logprob_of_token": -0.231678, "top1_top2_margin": 2.834908, "top6_top7_margin": 0.113459}, {"gen_index": 24, "token": 12843, "top": [[12843, -0.247178], [14031, -2.894381], [2403, -3.596329], [55333, -4.344783], [19827, -4.558344], [59, -5.814743], [44, -5.83988], [26209, -5.863685], [31663, -6.044907], [946, -6.167519], [8445, -6.308944], [46, -6.371175], [14188, -6.429442], [94021, -6.546793], [63, -6.552769], [14395, -6.559606], [286, -6.617087], [55, -6.678557], [120022, -6.697958], [37720, -6.704596], [55332, -6.70652], [6559, -6.846324], [120007, -7.091007], [1932, -7.184164], [127906, -7.192007], [90236, -7.196934], [735, -7.273976], [58, -7.290267], [29350, -7.312097], [1311, -7.400771], [1829, -7.478912], [121080, -7.519267], [405, -7.559875], [527, -7.566903], [2555, -7.629349], [262, -7.633383], [1275, -7.750726], [80764, -7.755519], [5951, -7.783235], [5274, -7.820912], [10133, -7.834523], [76591, -7.856649], [38555, -7.884761], [766, -7.899975], [68743, -7.919326], [32, -7.978245], [263, -8.015826], [941, -8.01827], [7510, -8.052755], [33335, -8.115278], [622, -8.116375], [8206, -8.118303], [43605, -8.134266], [30877, -8.177786], [4241, -8.183728], [936, -8.278031], [66032, -8.286176], [318, -8.290782], [1409, -8.298084], [63487, -8.3598], [19969, -8.383883], [1204, -8.392466], [2467, -8.430198], [275, -8.438963], [378, -8.475672], [310, -8.490854], [8265, -8.504934], [919, -8.520378], [72714, -8.555634], [1840, -8.59571], [56, -8.631297], [46612, -8.645494], [38336, -8.673792], [4401, -8.705512], [28346, -8.733958], [108744, -8.746327], [2944, -8.766979], [4595, -8.782487], [379, -8.810635], [4739, -8.816564], [12611, -8.839658], [16147, -8.851091], [1781, -8.85414], [900, -8.880723], [5060, -8.886621], [43032, -8.89701], [14161, -8.903631], [20195, -8.903665], [125745, -8.910796], [5218, -8.922383], [14825, -8.936117], [12456, -8.946314], [120014, -8.961105], [2376, -8.992735], [119747, -9.009559], [1427, -9.029793], [17736, -9.066164], [582, -9.087365], [2213, -9.093674], [117101, -9.097491]], "logprob_of_token": -0.247178, "top1_top2_margin": 2.647202, "top6_top7_margin": 0.025137}, {"gen_index": 25, "token": 12843, "top": [[12843, -0.214128], [14031, -3.13718], [2403, -3.344204], [55333, -4.18485], [19827, -4.666062], [26209, -6.024407], [31663, -6.263214], [44, -6.276526], [59, -6.301949], [946, -6.345513], [46, -6.603945], [8445, -6.626819], [94021, -6.627418], [14188, -6.627666], [55332, -6.68739], [14395, -6.767965], [286, -6.773085], [6559, -6.833801], [120022, -6.849443], [63, -6.86543], [55, -6.982706], [37720, -7.007823], [58, -7.20089], [120007, -7.260379], [127906, -7.336646], [90236, -7.350343], [735, -7.533154], [1932, -7.544291], [2555, -7.566051], [1829, -7.632478], [29350, -7.721925], [121080, -7.753932], [80764, -7.782591], [405, -7.824081], [527, -7.832716], [262, -7.88799], [76591, -7.95132], [1275, -7.953814], [10133, -7.968113], [68743, -7.989076], [263, -8.045527], [5274, -8.051754], [5951, -8.057956], [941, -8.138403], [63487, -8.229829], [38555, -8.241015], [766, -8.241325], [1311, -8.273466], [4241, -8.32418], [43605, -8.349545], [66032, -8.371353], [32, -8.371366], [622, -8.373793], [7510, -8.413348], [8265, -8.437603], [1409, -8.497266], [33335, -8.515022], [1204, -8.556646], [72714, -8.610078], [275, -8.610948], [310, -8.635417], [38336, -8.640149], [318, -8.655889], [8206, -8.667795], [378, -8.681098], [2467, -8.71556], [108744, -8.731432], [30877, -8.733162], [19969, -8.752335], [46612, -8.768429], [900, -8.772006], [936, -8.780198], [919, -8.78518], [43032, -8.849567], [28346, -8.889101], [14161, -8.954941], [379, -8.964194], [1840, -8.976694], [120014, -8.986562], [119747, -8.993921], [4595, -9.000901], [20195, -9.010467], [4739, -9.01749], [16147, -9.03238], [14825, -9.041385], [12611, -9.096968], [2944, -9.142255], [12456, -9.145741], [125745, -9.170257], [56, -9.180331], [4401, -9.183774], [5218, -9.227721], [14179, -9.247002], [117101, -9.264717], [1427, -9.290437], [5060, -9.292928], [582, -9.297487], [2213, -9.311987], [33445, -9.316487], [75282, -9.318141]], "logprob_of_token": -0.214128, "top1_top2_margin": 2.923052, "top6_top7_margin": 0.238807}, {"gen_index": 26, "token": 12843, "top": [[12843, -0.265538], [2403, -3.034591], [14031, -3.04766], [55333, -4.04865], [19827, -4.693202], [59, -5.798028], [26209, -5.969791], [31663, -6.014322], [44, -6.037302], [946, -6.038788], [94021, -6.300242], [63, -6.307936], [14188, -6.414771], [46, -6.42212], [8445, -6.461873], [55332, -6.520382], [120022, -6.593705], [55, -6.611568], [14395, -6.77273], [286, -6.784053], [6559, -6.833415], [120007, -6.861824], [37720, -6.881299], [58, -6.933025], [127906, -6.99512], [90236, -7.223176], [735, -7.25436], [29350, -7.351194], [1829, -7.370909], [121080, -7.391142], [1932, -7.391394], [1275, -7.421654], [405, -7.439493], [2555, -7.518685], [80764, -7.678687], [10133, -7.729819], [5951, -7.743013], [262, -7.767571], [766, -7.849842], [76591, -7.866899], [263, -7.892126], [38555, -7.904615], [8265, -7.90542], [5274, -7.917984], [527, -7.919462], [7510, -7.930688], [1311, -7.972456], [941, -8.024473], [63487, -8.056098], [622, -8.065503], [68743, -8.125014], [4241, -8.248845], [378, -8.268532], [43605, -8.275629], [72714, -8.283207], [8206, -8.289446], [32, -8.30131], [33335, -8.321535], [19969, -8.351715], [1409, -8.385988], [66032, -8.395956], [46612, -8.416202], [936, -8.432033], [919, -8.460439], [275, -8.487218], [310, -8.487979], [38336, -8.556888], [4595, -8.604559], [318, -8.6186], [56, -8.635536], [108744, -8.650685], [1840, -8.701834], [379, -8.718692], [2467, -8.721201], [30877, -8.734978], [4401, -8.742085], [1204, -8.742996], [4739, -8.74372], [2944, -8.753919], [12611, -8.767654], [119747, -8.773736], [16147, -8.776005], [43032, -8.78505], [900, -8.836712], [1781, -8.926825], [20195, -8.943761], [33, -8.971169], [120014, -8.9816], [14825, -8.985274], [14792, -9.005939], [1427, -9.024648], [14161, -9.025707], [2376, -9.030956], [125745, -9.050224], [5060, -9.06274], [582, -9.071758], [2457, -9.073089], [75282, -9.084445], [5218, -9.087105], [12456, -9.095039]], "logprob_of_token": -0.265538, "top1_top2_margin": 2.769054, "top6_top7_margin": 0.171764}, {"gen_index": 27, "token": 12843, "top": [[12843, -0.244526], [14031, -2.945174], [2403, -3.139876], [55333, -4.280517], [19827, -4.724515], [59, -5.86404], [44, -5.90944], [26209, -6.160082], [31663, -6.224309], [46, -6.228725], [14188, -6.3938], [946, -6.456692], [58, -6.518472], [8445, -6.538554], [63, -6.561436], [94021, -6.589547], [14395, -6.63392], [120022, -6.717846], [55, -6.797238], [55332, -6.804806], [286, -6.846394], [6559, -6.868908], [37720, -6.962018], [120007, -6.972814], [127906, -7.088172], [735, -7.31505], [90236, -7.371045], [1829, -7.376753], [2555, -7.490581], [29350, -7.534894], [1932, -7.545044], [121080, -7.587615], [405, -7.602117], [80764, -7.669091], [1275, -7.774324], [262, -7.803401], [10133, -7.815508], [1311, -7.859831], [527, -7.983593], [263, -8.000064], [76591, -8.002363], [7510, -8.028229], [941, -8.048061], [766, -8.091551], [5274, -8.095888], [38555, -8.182014], [622, -8.199647], [5951, -8.246529], [68743, -8.251456], [43605, -8.319472], [72714, -8.323129], [1409, -8.323631], [4241, -8.339842], [32, -8.340359], [8265, -8.355734], [900, -8.358541], [63487, -8.403412], [66032, -8.463915], [275, -8.463961], [33335, -8.482094], [38336, -8.501804], [936, -8.530813], [310, -8.540668], [378, -8.574956], [318, -8.616444], [2467, -8.67275], [919, -8.683719], [1204, -8.684638], [19969, -8.756735], [56, -8.776701], [8206, -8.776998], [108744, -8.793671], [14161, -8.864737], [379, -8.885551], [2944, -8.886848], [1840, -8.888523], [33, -8.914837], [4401, -8.945367], [12611, -8.956553], [46612, -8.958999], [28346, -9.008137], [120014, -9.01659], [1781, -9.065075], [4595, -9.069915], [43032, -9.074493], [14825, -9.089511], [30877, -9.091777], [2213, -9.091803], [14792, -9.094147], [4739, -9.121354], [125745, -9.126401], [5218, -9.127823], [14147, -9.151147], [16147, -9.151303], [2376, -9.165552], [119747, -9.16869], [4205, -9.172631], [582, -9.179202], [75282, -9.200432], [2457, -9.203175]], "logprob_of_token": -0.244526, "top1_top2_margin": 2.700648, "top6_top7_margin": 0.0454}, {"gen_index": 28, "token": 12843, "top": [[12843, -0.183944], [14031, -3.184249], [2403, -3.339851], [55333, -4.386891], [19827, -4.790474], [26209, -6.160634], [31663, -6.314657], [59, -6.39459], [44, -6.527627], [46, -6.761196], [55332, -6.832662], [55, -6.838218], [6559, -6.838928], [8445, -6.881375], [14188, -6.899031], [94021, -6.921711], [946, -6.93587], [14395, -6.960927], [58, -6.96507], [120022, -7.025362], [63, -7.171122], [127906, -7.29099], [37720, -7.300254], [286, -7.34022], [120007, -7.361512], [90236, -7.421232], [80764, -7.534492], [735, -7.623866], [2555, -7.733676], [1932, -7.743862], [121080, -7.785328], [1311, -7.885311], [29350, -7.916457], [1829, -7.933031], [76591, -7.999571], [405, -8.061645], [10133, -8.120887], [5274, -8.208388], [262, -8.240246], [527, -8.249656], [1275, -8.256458], [68743, -8.280129], [263, -8.314248], [43605, -8.347807], [72714, -8.429239], [32, -8.434343], [941, -8.447298], [66032, -8.476849], [7510, -8.489903], [38555, -8.507332], [8265, -8.518031], [38336, -8.528805], [5951, -8.559157], [622, -8.607018], [63487, -8.680891], [766, -8.684597], [1409, -8.71366], [378, -8.739038], [4241, -8.741406], [2467, -8.755868], [900, -8.780688], [33335, -8.83185], [936, -8.892642], [919, -8.921653], [310, -8.93756], [108744, -8.95075], [318, -8.962337], [275, -9.009591], [14161, -9.046756], [43032, -9.053792], [19969, -9.099152], [56, -9.11528], [1204, -9.133259], [28346, -9.158978], [125745, -9.213873], [5218, -9.217986], [14177, -9.255486], [119747, -9.276383], [12611, -9.334506], [14147, -9.345155], [2213, -9.358212], [4739, -9.371733], [12456, -9.381187], [33, -9.388857], [117101, -9.394965], [379, -9.401965], [14825, -9.404847], [1848, -9.414029], [46612, -9.421662], [439, -9.42772], [120014, -9.431458], [16147, -9.467169], [816, -9.482255], [835, -9.487323], [582, -9.504294], [1270, -9.506345], [2944, -9.510465], [75282, -9.530055], [8206, -9.548236], [14179, -9.559552]], "logprob_of_token": -0.183944, "top1_top2_margin": 3.000305, "top6_top7_margin": 0.154024}, {"gen_index": 29, "token": 12843, "top": [[12843, -0.155874], [14031, -3.375538], [2403, -3.736369], [55333, -4.471072], [19827, -4.561987], [26209, -6.12228], [31663, -6.306095], [59, -6.744856], [946, -6.787422], [55332, -6.85201], [44, -6.888877], [55, -6.897931], [120022, -6.905454], [6559, -6.943297], [8445, -6.953818], [14395, -6.986226], [46, -7.012233], [14188, -7.102303], [58, -7.128098], [94021, -7.174055], [286, -7.383577], [37720, -7.38862], [127906, -7.399092], [63, -7.409299], [120007, -7.447428], [90236, -7.463384], [1932, -7.680939], [80764, -7.686966], [121080, -7.711813], [1311, -7.73983], [2555, -7.762376], [735, -7.885885], [76591, -8.02421], [5274, -8.084112], [29350, -8.11275], [1829, -8.17134], [68743, -8.173409], [32, -8.295465], [405, -8.323586], [10133, -8.397623], [527, -8.401861], [262, -8.463905], [263, -8.476694], [7510, -8.480103], [5951, -8.528247], [941, -8.540053], [4241, -8.597131], [43605, -8.616352], [66032, -8.630198], [1275, -8.644266], [2467, -8.657372], [38336, -8.681179], [38555, -8.710576], [8265, -8.764619], [378, -8.794606], [72714, -8.811528], [63487, -8.821247], [766, -8.864806], [33335, -8.879791], [1409, -8.880199], [622, -8.932009], [318, -9.030338], [919, -9.068467], [108744, -9.069478], [14161, -9.074523], [900, -9.121707], [19969, -9.12275], [936, -9.145757], [1204, -9.145953], [5218, -9.157815], [310, -9.162601], [125745, -9.187737], [43032, -9.199777], [275, -9.225994], [28346, -9.257968], [119747, -9.286115], [14147, -9.325942], [12456, -9.366677], [14825, -9.378336], [56, -9.3883], [439, -9.411826], [120014, -9.472853], [4739, -9.478938], [379, -9.490264], [2944, -9.504521], [117101, -9.521692], [70341, -9.530246], [12611, -9.531035], [4401, -9.539997], [16147, -9.551395], [582, -9.565123], [46612, -9.573638], [33, -9.590926], [1270, -9.644382], [5060, -9.654759], [2376, -9.657252], [4205, -9.662873], [14179, -9.673566], [1836, -9.678427], [17736, -9.680973]], "logprob_of_token": -0.155874, "top1_top2_margin": 3.219665, "top6_top7_margin": 0.183815}, {"gen_index": 30, "token": 12843, "top": [[12843, -0.200363], [2403, -3.462614], [14031, -3.462834], [55333, -4.220222], [19827, -4.585575], [31663, -5.839258], [26209, -5.892839], [946, -6.19641], [120022, -6.225583], [59, -6.362056], [55332, -6.536539], [44, -6.683349], [55, -6.693326], [8445, -6.748756], [63, -6.793344], [286, -6.829645], [94021, -6.841571], [14188, -6.847879], [14395, -6.873939], [120007, -6.888911], [46, -7.071371], [127906, -7.094482], [121080, -7.186486], [6559, -7.189363], [1311, -7.270302], [37720, -7.314288], [90236, -7.319341], [1932, -7.331357], [5274, -7.609352], [29350, -7.65892], [80764, -7.702688], [735, -7.720404], [58, -7.722038], [405, -7.795843], [2555, -7.797513], [1829, -7.801564], [32, -7.802414], [76591, -7.879306], [5951, -7.935671], [262, -7.979897], [7510, -8.007263], [527, -8.040891], [1275, -8.043516], [68743, -8.053074], [263, -8.150662], [4241, -8.248102], [378, -8.25905], [941, -8.296516], [8265, -8.321211], [766, -8.373769], [38555, -8.386849], [43605, -8.395038], [1409, -8.425322], [19969, -8.438965], [33335, -8.441006], [2467, -8.442286], [936, -8.523866], [4595, -8.551066], [622, -8.575383], [38336, -8.575856], [66032, -8.599195], [72714, -8.661364], [1204, -8.674089], [318, -8.68252], [919, -8.702512], [63487, -8.708706], [2944, -8.732581], [10133, -8.735268], [310, -8.76297], [1840, -8.789398], [108744, -8.858873], [4739, -8.894016], [125745, -8.903896], [2376, -8.916641], [119747, -8.957715], [5218, -8.998535], [1427, -9.003344], [14792, -9.02766], [46612, -9.052646], [4401, -9.059917], [12456, -9.070772], [275, -9.072979], [4205, -9.090795], [12611, -9.100568], [5060, -9.10985], [14161, -9.110985], [120014, -9.115482], [379, -9.12307], [43032, -9.137392], [4731, -9.157755], [14825, -9.164999], [1836, -9.176372], [56, -9.190271], [20195, -9.198586], [900, -9.210082], [14153, -9.217043], [439, -9.221121], [1848, -9.224588], [16147, -9.225458], [14147, -9.231767]], "logprob_of_token": -0.200363, "top1_top2_margin": 3.262251, "top6_top7_margin": 0.053582}, {"gen_index": 31, "token": 12843, "top": [[12843, -0.203416], [14031, -2.941558], [2403, -3.911496], [55333, -4.286592], [19827, -4.493407], [26209, -6.209076], [31663, -6.258585], [59, -6.36902], [44, -6.391716], [14188, -6.47758], [55332, -6.491922], [46, -6.622794], [8445, -6.672137], [94021, -6.693477], [946, -6.717226], [37720, -6.779004], [55, -6.830685], [14395, -6.86359], [120022, -6.884349], [6559, -6.935833], [63, -6.950726], [286, -7.123561], [1311, -7.264499], [120007, -7.302782], [90236, -7.329062], [127906, -7.359162], [58, -7.430628], [1932, -7.435064], [121080, -7.470266], [735, -7.560138], [29350, -7.651911], [80764, -7.718251], [76591, -7.749419], [1829, -7.772657], [2555, -7.796728], [405, -7.83355], [5274, -7.892382], [10133, -7.906152], [1275, -8.012774], [527, -8.024633], [262, -8.050371], [32, -8.07859], [43605, -8.143138], [38555, -8.145509], [68743, -8.166533], [5951, -8.272088], [622, -8.295722], [941, -8.299162], [378, -8.318688], [2467, -8.323562], [919, -8.365564], [7510, -8.365973], [66032, -8.466352], [4241, -8.479696], [263, -8.500422], [19969, -8.554983], [72714, -8.563099], [936, -8.579988], [38336, -8.587337], [766, -8.621472], [33335, -8.648625], [63487, -8.708103], [43032, -8.720751], [310, -8.738504], [108744, -8.799365], [1409, -8.807184], [56, -8.821589], [8265, -8.880153], [12611, -8.895183], [318, -8.9105], [379, -8.952929], [5218, -8.975418], [1204, -8.977339], [14179, -8.98379], [28346, -9.009271], [275, -9.029426], [17736, -9.037602], [900, -9.062423], [46612, -9.063193], [4739, -9.106833], [12456, -9.112885], [8206, -9.119933], [33, -9.130063], [1840, -9.136298], [2944, -9.137265], [125745, -9.138093], [117101, -9.138774], [439, -9.165845], [4595, -9.175396], [14147, -9.197707], [14153, -9.207583], [14161, -9.219347], [119747, -9.243661], [20195, -9.248713], [75282, -9.326109], [1836, -9.33256], [33445, -9.337289], [16147, -9.37337], [127750, -9.398942], [1270, -9.418251]], "logprob_of_token": -0.203416, "top1_top2_margin": 2.738142, "top6_top7_margin": 0.049509}]}]} +{"model": "/mnt/models/Aleph-Alpha/Kolibri-1-bf16-clean", "topk": 100, "max_new_tokens": 32, "prompts": [{"prompt": "alpha beta gamma delta epsilon zeta", "input_ids": [5249, 25079, 74493, 15774, 121598, 116026], "generated_ids": [116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026, 116026], "rows": [{"gen_index": 0, "token": 116026, "top": [[116026, -0.943565], [121598, -1.214995], [34774, -3.574584], [15930, -3.654647], [125787, -3.789949], [15774, -4.635954], [16581, -5.033639], [115060, -5.832742], [32, -5.934945], [949, -6.094397], [14620, -6.118017], [116908, -6.447867], [44, -6.525632], [63530, -6.535117], [95373, -6.546416], [14541, -6.548631], [42046, -6.615215], [101051, -6.634198], [40301, -6.63574], [16013, -6.673426], [25079, -6.736976], [735, -6.762966], [123470, -6.885275], [936, -6.892465], [68158, -6.931103], [74493, -6.945714], [83150, -6.957963], [15960, -7.137805], [14153, -7.178715], [14188, -7.21796], [120653, -7.233123], [82275, -7.266447], [3786, -7.268791], [127604, -7.269865], [121322, -7.288667], [121249, -7.313475], [286, -7.328341], [123576, -7.362907], [14168, -7.372573], [94105, -7.376568], [32502, -7.402382], [120293, -7.419972], [120625, -7.479943], [16604, -7.568687], [127906, -7.589654], [122414, -7.665443], [46, -7.71692], [7510, -7.766733], [34, -7.780186], [67223, -7.83622], [19193, -7.842639], [14154, -7.843524], [318, -7.872367], [622, -7.898974], [14179, -7.909676], [262, -7.945328], [4257, -7.955871], [835, -8.033165], [60475, -8.046588], [2125, -8.08139], [946, -8.099908], [90, -8.102327], [68037, -8.118078], [122629, -8.12441], [766, -8.126954], [15521, -8.134634], [21216, -8.146012], [9405, -8.151453], [33343, -8.152681], [120007, -8.152865], [70741, -8.153075], [9734, -8.193198], [54566, -8.202256], [8613, -8.212846], [70338, -8.217828], [120675, -8.219712], [78924, -8.219971], [502, -8.240443], [120719, -8.24366], [63, -8.248103], [108916, -8.258881], [94742, -8.263838], [120626, -8.307992], [1275, -8.308658], [95343, -8.318584], [47, -8.321589], [101040, -8.357689], [39, -8.357843], [123124, -8.359466], [123302, -8.365518], [123653, -8.377089], [310, -8.380368], [54329, -8.380925], [39445, -8.407697], [21337, -8.41046], [14419, -8.430998], [22664, -8.432261], [51599, -8.432894], [685, -8.438673], [49430, -8.451316]], "logprob_of_token": -0.943565, "top1_top2_margin": 0.27143, "top6_top7_margin": 0.397685}, {"gen_index": 1, "token": 116026, "top": [[116026, -0.28033], [125787, -3.717885], [34774, -3.891269], [949, -5.001238], [121598, -5.072105], [14620, -5.751047], [16581, -5.7581], [14153, -5.792322], [83150, -5.81092], [32, -5.837166], [735, -5.967307], [120625, -6.090748], [116908, -6.095234], [14541, -6.150908], [63530, -6.36373], [42046, -6.412945], [15774, -6.437956], [120653, -6.755884], [120293, -6.99059], [25079, -6.994502], [127906, -7.054441], [101051, -7.121085], [121249, -7.180941], [14188, -7.195388], [123576, -7.198302], [32502, -7.216728], [121322, -7.224472], [936, -7.249109], [74493, -7.279641], [502, -7.319066], [44, -7.376373], [40301, -7.423328], [123182, -7.449378], [127604, -7.512552], [122629, -7.519501], [14179, -7.519935], [21216, -7.527208], [2125, -7.534264], [120719, -7.537275], [286, -7.554265], [16604, -7.578542], [119647, -7.589512], [68037, -7.610829], [941, -7.618158], [946, -7.626684], [94105, -7.628355], [14419, -7.636005], [3786, -7.65648], [622, -7.697617], [47, -7.750299], [49430, -7.774838], [60475, -7.796728], [34, -7.833864], [82275, -7.847462], [766, -7.867192], [22664, -7.940765], [1275, -7.962089], [115060, -8.018161], [82765, -8.031937], [94742, -8.063956], [262, -8.082161], [120675, -8.101073], [123302, -8.120425], [46, -8.134779], [3688, -8.169312], [43914, -8.192226], [34701, -8.19256], [7510, -8.201568], [15397, -8.218934], [70741, -8.226329], [2403, -8.252955], [318, -8.276404], [48752, -8.278963], [353, -8.281781], [90, -8.296161], [63, -8.29694], [1921, -8.304456], [120784, -8.312397], [835, -8.320029], [919, -8.346279], [310, -8.349547], [608, -8.355989], [120007, -8.389537], [279, -8.403831], [669, -8.422969], [40320, -8.423963], [123470, -8.435109], [14696, -8.454015], [70338, -8.465404], [52654, -8.474339], [39, -8.478629], [123653, -8.486492], [41086, -8.492318], [125030, -8.509742], [14168, -8.536981], [42, -8.613121], [2048, -8.616864], [4222, -8.619988], [5274, -8.626832], [33, -8.686282]], "logprob_of_token": -0.28033, "top1_top2_margin": 3.437556, "top6_top7_margin": 0.007053}, {"gen_index": 2, "token": 116026, "top": [[116026, -0.196718], [34774, -4.182076], [125787, -4.824233], [14620, -5.486257], [949, -5.639053], [83150, -5.745828], [14153, -5.816586], [32, -5.892428], [120625, -6.080964], [116908, -6.438009], [735, -6.727904], [127906, -6.811963], [63530, -6.811964], [14541, -6.850717], [42046, -6.88597], [14188, -7.006792], [101051, -7.010479], [82765, -7.039443], [123576, -7.051399], [121598, -7.09852], [44, -7.141848], [14179, -7.192352], [120293, -7.232328], [121249, -7.240458], [40301, -7.285811], [16581, -7.296166], [34, -7.367821], [21216, -7.381629], [2125, -7.482914], [286, -7.52734], [32502, -7.540429], [25079, -7.550499], [120719, -7.55905], [123182, -7.564181], [14419, -7.590094], [119647, -7.65942], [63, -7.660728], [15774, -7.68025], [49430, -7.706151], [936, -7.716871], [946, -7.726924], [941, -7.756649], [120653, -7.769949], [766, -7.774878], [120007, -7.782938], [502, -7.819664], [1921, -7.831703], [42, -7.870502], [46, -7.885034], [74493, -7.888696], [122629, -7.890704], [3688, -8.005363], [41086, -8.020237], [60475, -8.076193], [3786, -8.101127], [15397, -8.107032], [120784, -8.124231], [82275, -8.129847], [68037, -8.139324], [94105, -8.177014], [123302, -8.178482], [622, -8.179532], [279, -8.187475], [92, -8.203778], [22664, -8.224778], [34701, -8.255551], [24826, -8.263297], [120675, -8.287545], [47, -8.317632], [14696, -8.324061], [7510, -8.34537], [94742, -8.354381], [1275, -8.374681], [16604, -8.378954], [52654, -8.401011], [121322, -8.417905], [127604, -8.442327], [4075, -8.458821], [48752, -8.478937], [353, -8.481877], [835, -8.485716], [14825, -8.487791], [262, -8.505338], [5274, -8.510035], [120001, -8.531998], [39, -8.54531], [33, -8.56532], [44175, -8.610751], [318, -8.619858], [82618, -8.642966], [576, -8.648179], [125030, -8.665874], [669, -8.680348], [57926, -8.73616], [40320, -8.743459], [123653, -8.77478], [11292, -8.814057], [102925, -8.831044], [70338, -8.841774], [7878, -8.85553]], "logprob_of_token": -0.196718, "top1_top2_margin": 3.985358, "top6_top7_margin": 0.070758}, {"gen_index": 3, "token": 116026, "top": [[116026, -0.173224], [34774, -4.489264], [125787, -5.388278], [14620, -5.505294], [14153, -5.524546], [83150, -5.635072], [949, -5.764091], [32, -5.903965], [120625, -6.512772], [127906, -6.588139], [735, -6.702394], [14188, -6.764821], [42046, -6.813173], [14179, -6.838463], [116908, -6.884993], [123576, -6.926613], [34, -6.95461], [63530, -7.035307], [44, -7.035871], [82765, -7.148522], [14541, -7.24305], [2125, -7.297671], [1921, -7.390726], [3786, -7.400635], [32502, -7.401201], [120719, -7.412289], [101051, -7.417634], [49430, -7.428485], [120007, -7.44615], [21216, -7.481595], [42, -7.50359], [14419, -7.521393], [286, -7.545405], [120293, -7.547563], [121598, -7.590423], [63, -7.596025], [40301, -7.612348], [946, -7.613847], [121249, -7.62238], [120653, -7.639069], [936, -7.688882], [941, -7.70085], [766, -7.710064], [119647, -7.737994], [123182, -7.752089], [46, -7.752692], [25079, -7.800555], [502, -7.813896], [15397, -7.845284], [120784, -7.897136], [74493, -7.918328], [41086, -7.924503], [16581, -7.973563], [279, -8.04738], [14696, -8.074699], [47, -8.097081], [622, -8.107026], [34701, -8.119145], [3688, -8.124411], [92, -8.131016], [120001, -8.143876], [94742, -8.153236], [82275, -8.154406], [60475, -8.15851], [39, -8.16225], [52654, -8.233275], [4075, -8.237452], [15774, -8.242615], [121322, -8.273494], [122629, -8.29923], [1275, -8.341579], [40320, -8.342147], [5274, -8.382491], [262, -8.39465], [11292, -8.405959], [120675, -8.506384], [127604, -8.51586], [24826, -8.526167], [22664, -8.532944], [48752, -8.533025], [94105, -8.536296], [14825, -8.53966], [123653, -8.541541], [82618, -8.547755], [68037, -8.560548], [44175, -8.577784], [4222, -8.586921], [835, -8.605392], [16604, -8.6064], [7510, -8.607512], [123302, -8.633407], [33, -8.638978], [353, -8.653666], [94, -8.657977], [120256, -8.703202], [120046, -8.705647], [1427, -8.731259], [576, -8.737679], [318, -8.794255], [3167, -8.796716]], "logprob_of_token": -0.173224, "top1_top2_margin": 4.316039, "top6_top7_margin": 0.129019}, {"gen_index": 4, "token": 116026, "top": [[116026, -0.149603], [34774, -4.581424], [125787, -5.188057], [14620, -5.304764], [83150, -5.94779], [949, -6.008715], [14153, -6.175043], [32, -6.24312], [42046, -6.495979], [127906, -6.819831], [116908, -6.89772], [735, -6.972487], [123576, -7.037797], [121598, -7.138923], [14188, -7.144416], [63530, -7.154256], [120625, -7.325009], [14179, -7.34005], [44, -7.345974], [82765, -7.383025], [34, -7.394032], [25079, -7.398068], [101051, -7.411225], [14541, -7.455532], [40301, -7.488916], [32502, -7.530705], [120007, -7.542222], [2125, -7.597047], [119647, -7.597318], [120719, -7.627642], [14419, -7.654797], [74493, -7.678187], [286, -7.711649], [121249, -7.721799], [49430, -7.742292], [21216, -7.759426], [120293, -7.784167], [1921, -7.786206], [3786, -7.787584], [63, -7.826964], [42, -7.853367], [123182, -7.872451], [15774, -7.873745], [46, -7.893039], [120653, -7.897496], [120784, -7.910853], [946, -7.913068], [16581, -7.923325], [941, -7.927653], [502, -7.933892], [766, -7.939955], [14696, -7.946015], [94742, -8.072938], [15397, -8.089116], [40320, -8.098648], [82275, -8.109479], [41086, -8.118068], [936, -8.127682], [279, -8.18297], [120675, -8.187508], [120001, -8.191843], [4222, -8.330847], [52654, -8.333694], [34701, -8.350757], [4075, -8.367619], [3688, -8.377547], [92, -8.382283], [622, -8.387775], [68037, -8.38803], [122629, -8.419291], [94105, -8.437339], [5274, -8.477205], [127604, -8.502125], [22664, -8.503179], [60475, -8.509098], [47, -8.527867], [39, -8.535713], [82618, -8.536261], [262, -8.559451], [44175, -8.572951], [120256, -8.584937], [123653, -8.647142], [48752, -8.650065], [122532, -8.655699], [1275, -8.660582], [24826, -8.665693], [121322, -8.703844], [7510, -8.712208], [125030, -8.715397], [123302, -8.742142], [353, -8.743662], [16604, -8.746729], [11292, -8.757942], [94, -8.804266], [102925, -8.81884], [33, -8.877135], [1427, -8.894238], [90, -8.927576], [835, -8.953751], [116208, -8.964376]], "logprob_of_token": -0.149603, "top1_top2_margin": 4.431821, "top6_top7_margin": 0.166328}, {"gen_index": 5, "token": 116026, "top": [[116026, -0.232596], [34774, -4.483362], [125787, -5.109098], [14620, -5.242196], [14153, -5.423881], [949, -5.744764], [32, -5.77037], [83150, -5.776521], [42046, -6.196381], [127906, -6.318517], [14188, -6.543626], [63530, -6.550564], [116908, -6.585923], [14179, -6.682994], [34, -6.730018], [735, -6.73101], [121598, -6.857399], [123576, -6.898092], [44, -6.919734], [101051, -6.97945], [1921, -7.016634], [120007, -7.0581], [120625, -7.060365], [2125, -7.068582], [119647, -7.111773], [40301, -7.155483], [82765, -7.158255], [25079, -7.174389], [3786, -7.179891], [74493, -7.185115], [14541, -7.262149], [21216, -7.269149], [14419, -7.274875], [120784, -7.282437], [120293, -7.306055], [936, -7.309459], [946, -7.327044], [941, -7.34581], [286, -7.348948], [120719, -7.397561], [42, -7.434875], [15397, -7.436905], [32502, -7.457675], [123182, -7.485784], [49430, -7.512737], [120653, -7.5135], [766, -7.519428], [121249, -7.534765], [46, -7.550596], [15774, -7.579831], [63, -7.589024], [94742, -7.595835], [120001, -7.610577], [14696, -7.642587], [502, -7.645393], [16581, -7.657777], [40320, -7.719603], [41086, -7.741054], [4075, -7.807598], [34701, -7.827061], [82275, -7.853185], [279, -7.921012], [47, -7.960981], [3688, -7.969303], [94105, -7.989054], [5274, -8.001665], [39, -8.001982], [52654, -8.010425], [68037, -8.04032], [92, -8.043977], [262, -8.052316], [622, -8.056581], [120675, -8.062101], [60475, -8.097099], [44175, -8.106353], [1427, -8.111322], [121322, -8.127662], [82618, -8.161067], [22664, -8.182942], [122629, -8.22133], [123653, -8.223645], [48752, -8.236941], [127604, -8.268043], [7510, -8.284358], [353, -8.288216], [94, -8.309646], [4222, -8.314444], [3167, -8.319161], [1275, -8.322021], [11292, -8.357121], [102925, -8.382531], [14825, -8.394168], [24826, -8.427649], [122532, -8.434432], [123302, -8.439647], [57926, -8.445092], [16604, -8.453732], [669, -8.487374], [120256, -8.490761], [120046, -8.506452]], "logprob_of_token": -0.232596, "top1_top2_margin": 4.250766, "top6_top7_margin": 0.025606}, {"gen_index": 6, "token": 116026, "top": [[116026, -0.146932], [34774, -4.383215], [125787, -5.365145], [14620, -5.553035], [14153, -6.038159], [42046, -6.07339], [949, -6.14592], [83150, -6.149242], [32, -6.384641], [121598, -6.517893], [63530, -6.718482], [116908, -6.773697], [735, -6.798128], [101051, -6.854596], [120625, -6.897747], [127906, -6.984481], [14188, -7.148897], [74493, -7.177018], [123576, -7.201331], [15774, -7.244215], [25079, -7.260833], [34, -7.298819], [14179, -7.307822], [40301, -7.324168], [120007, -7.483157], [120293, -7.547967], [44, -7.559719], [3786, -7.560548], [1921, -7.580326], [82765, -7.621009], [121249, -7.695311], [123182, -7.698365], [32502, -7.751911], [120784, -7.769492], [15397, -7.774908], [14541, -7.778614], [16581, -7.785157], [119647, -7.8061], [941, -7.811966], [946, -7.848022], [936, -7.849794], [42, -7.868192], [14419, -7.888973], [21216, -7.906795], [286, -7.917084], [2125, -7.923155], [34701, -7.946257], [120653, -7.946432], [40320, -7.952593], [94105, -8.031379], [94742, -8.039186], [14696, -8.043146], [120675, -8.082977], [63, -8.09102], [766, -8.095583], [82275, -8.154499], [502, -8.200462], [49430, -8.211566], [68037, -8.215963], [41086, -8.29456], [46, -8.33573], [120719, -8.368337], [60475, -8.369164], [122629, -8.414452], [123302, -8.428143], [52654, -8.439885], [3688, -8.44704], [262, -8.455092], [39, -8.464931], [4075, -8.470879], [120001, -8.479867], [47, -8.482013], [102925, -8.492012], [5274, -8.497869], [123653, -8.5036], [82618, -8.529493], [279, -8.541051], [44175, -8.563727], [622, -8.664222], [22664, -8.672496], [3167, -8.680796], [24826, -8.682806], [121322, -8.698612], [48752, -8.701421], [92, -8.715517], [1427, -8.755259], [57926, -8.787089], [122532, -8.803504], [120256, -8.810096], [1275, -8.824433], [127604, -8.836958], [2403, -8.840558], [11292, -8.873818], [94, -8.923336], [353, -8.9315], [90, -8.933933], [7510, -8.937016], [33, -8.977077], [669, -9.018834], [22984, -9.06984]], "logprob_of_token": -0.146932, "top1_top2_margin": 4.236283, "top6_top7_margin": 0.072531}, {"gen_index": 7, "token": 116026, "top": [[116026, -0.155252], [34774, -4.252292], [125787, -5.444586], [14620, -5.539608], [14153, -5.616455], [42046, -6.167215], [83150, -6.347967], [949, -6.410456], [121598, -6.442207], [32, -6.542826], [116908, -6.638913], [101051, -6.690417], [63530, -6.82989], [120625, -6.939594], [735, -7.00308], [3786, -7.152304], [123576, -7.20037], [14541, -7.226284], [14179, -7.233861], [74493, -7.313004], [14188, -7.325675], [25079, -7.336085], [15774, -7.386776], [127906, -7.411449], [40301, -7.434958], [82765, -7.520795], [120007, -7.573292], [44, -7.582824], [121249, -7.628951], [1921, -7.660713], [34, -7.683399], [120293, -7.709993], [941, -7.718882], [15397, -7.723451], [286, -7.729772], [120784, -7.765379], [946, -7.76768], [123182, -7.810535], [936, -7.814664], [32502, -7.845312], [2125, -7.952138], [49430, -7.97059], [34701, -7.98628], [120719, -8.014228], [63, -8.014764], [14419, -8.018055], [42, -8.024223], [21216, -8.030016], [119647, -8.03408], [40320, -8.04081], [94105, -8.087794], [120675, -8.092746], [120653, -8.118642], [16581, -8.140038], [14696, -8.157495], [60475, -8.193638], [766, -8.260139], [82275, -8.286323], [279, -8.287396], [52654, -8.305243], [82618, -8.338574], [262, -8.347482], [1427, -8.385246], [46, -8.386016], [41086, -8.418133], [68037, -8.427325], [502, -8.430079], [4075, -8.435774], [122629, -8.450141], [94742, -8.467464], [33, -8.486566], [22664, -8.489207], [3688, -8.495605], [622, -8.514754], [1275, -8.547407], [39, -8.550916], [127604, -8.61121], [102925, -8.632804], [123653, -8.634282], [120256, -8.650949], [47, -8.65273], [2403, -8.672722], [123302, -8.712788], [799, -8.721414], [44175, -8.742476], [120001, -8.767988], [121322, -8.783065], [122532, -8.812522], [353, -8.825335], [11292, -8.862725], [48752, -8.867995], [92, -8.894912], [4222, -8.911269], [919, -8.918629], [5274, -8.938355], [3167, -8.938508], [24826, -8.93924], [57926, -8.959148], [1083, -8.982392], [474, -9.011747]], "logprob_of_token": -0.155252, "top1_top2_margin": 4.09704, "top6_top7_margin": 0.180751}, {"gen_index": 8, "token": 116026, "top": [[116026, -0.17914], [34774, -4.177118], [14153, -5.531055], [125787, -5.600605], [14620, -5.748708], [83150, -6.083608], [42046, -6.30116], [32, -6.391456], [949, -6.401186], [116908, -6.486259], [121598, -6.502058], [101051, -6.568483], [63530, -6.57573], [3786, -6.785843], [735, -6.786435], [120625, -6.828762], [14179, -6.942231], [127906, -7.030303], [14188, -7.166528], [123576, -7.213346], [1921, -7.272552], [34, -7.313684], [82765, -7.316761], [946, -7.368574], [14541, -7.375408], [40301, -7.38859], [120007, -7.397816], [74493, -7.46349], [44, -7.466432], [120293, -7.490117], [941, -7.498012], [25079, -7.540706], [2125, -7.559088], [15397, -7.577851], [121249, -7.59314], [286, -7.611322], [42, -7.687581], [120784, -7.690905], [936, -7.692556], [32502, -7.69989], [15774, -7.717023], [123182, -7.747944], [119647, -7.834051], [14419, -7.852239], [40320, -7.898308], [34701, -7.926107], [94105, -7.941306], [63, -7.958414], [262, -7.990048], [16581, -7.991902], [49430, -8.017719], [60475, -8.064503], [279, -8.067529], [120719, -8.069152], [21216, -8.077017], [766, -8.121145], [502, -8.160544], [82275, -8.169171], [4075, -8.172524], [82618, -8.185528], [3688, -8.19899], [14696, -8.241097], [52654, -8.245217], [120675, -8.252934], [120653, -8.258018], [46, -8.306235], [622, -8.330461], [94742, -8.334307], [799, -8.337687], [22664, -8.337838], [68037, -8.353455], [44175, -8.359352], [41086, -8.368134], [122629, -8.372501], [1275, -8.379029], [1427, -8.400408], [39, -8.419751], [33, -8.426169], [2403, -8.44243], [47, -8.507925], [5274, -8.586086], [120001, -8.58621], [92, -8.593454], [102925, -8.606213], [123653, -8.628879], [11292, -8.645933], [353, -8.646219], [127604, -8.656151], [123302, -8.681158], [4222, -8.691757], [2879, -8.712639], [923, -8.764708], [121322, -8.772664], [919, -8.776854], [3167, -8.814955], [48752, -8.819899], [3660, -8.838964], [121488, -8.869833], [57926, -8.876331], [125030, -8.88406]], "logprob_of_token": -0.17914, "top1_top2_margin": 3.997978, "top6_top7_margin": 0.217553}, {"gen_index": 9, "token": 116026, "top": [[116026, -0.214139], [34774, -4.059031], [125787, -5.349232], [14153, -5.364075], [14620, -5.87317], [83150, -6.118178], [42046, -6.138655], [32, -6.203332], [101051, -6.267337], [949, -6.397766], [116908, -6.441831], [735, -6.507747], [121598, -6.541161], [14179, -6.548682], [127906, -6.609882], [3786, -6.695408], [14188, -6.700424], [63530, -6.709047], [34, -6.945343], [120625, -6.972238], [1921, -7.027221], [44, -7.182063], [120293, -7.194681], [123576, -7.215834], [15774, -7.305512], [25079, -7.346329], [120007, -7.437829], [42, -7.451442], [2125, -7.472991], [936, -7.490566], [74493, -7.504387], [14541, -7.562642], [946, -7.565078], [286, -7.58406], [123182, -7.592371], [941, -7.595849], [82765, -7.60546], [16581, -7.611189], [15397, -7.653976], [32502, -7.690938], [40301, -7.697265], [46, -7.712595], [120784, -7.731669], [121249, -7.742409], [766, -7.762351], [119647, -7.80284], [262, -7.816278], [94105, -7.863254], [14419, -7.897367], [622, -7.897512], [40320, -7.933633], [279, -7.972957], [49430, -7.99346], [60475, -8.001378], [120675, -8.006626], [502, -8.013243], [5274, -8.01566], [120653, -8.021037], [63, -8.021915], [94742, -8.037565], [3688, -8.038624], [122629, -8.052217], [4075, -8.056412], [120001, -8.068822], [34701, -8.138568], [82275, -8.140354], [39, -8.178419], [21216, -8.190437], [799, -8.224128], [52654, -8.237545], [47, -8.238666], [1427, -8.302228], [123653, -8.310796], [14696, -8.351113], [68037, -8.358834], [1275, -8.365053], [82618, -8.398736], [22664, -8.401374], [41086, -8.402188], [123302, -8.409705], [48752, -8.418482], [92, -8.429633], [33, -8.43497], [120719, -8.438327], [2403, -8.445195], [102925, -8.491309], [3167, -8.524145], [121322, -8.547231], [44175, -8.55306], [353, -8.593699], [669, -8.615597], [923, -8.621189], [7510, -8.646791], [127604, -8.650765], [11292, -8.705247], [125030, -8.734479], [57926, -8.739627], [919, -8.744226], [4222, -8.745306], [26794, -8.750511]], "logprob_of_token": -0.214139, "top1_top2_margin": 3.844892, "top6_top7_margin": 0.020476}, {"gen_index": 10, "token": 116026, "top": [[116026, -0.220966], [34774, -4.098984], [14153, -5.205594], [125787, -5.324138], [83150, -5.765213], [14620, -5.927832], [42046, -6.104386], [735, -6.178851], [32, -6.180986], [949, -6.267801], [101051, -6.418283], [127906, -6.467418], [14179, -6.507319], [14188, -6.514053], [116908, -6.542013], [3786, -6.738823], [63530, -6.76085], [34, -6.766266], [121598, -6.777373], [1921, -6.806792], [120625, -6.885299], [44, -7.066495], [123576, -7.230806], [946, -7.27739], [2125, -7.324162], [120293, -7.340911], [936, -7.34263], [32502, -7.344838], [15774, -7.366433], [120007, -7.37786], [42, -7.379075], [25079, -7.380044], [123182, -7.413077], [46, -7.526003], [941, -7.576118], [286, -7.579933], [14541, -7.580173], [15397, -7.592534], [16581, -7.596739], [82765, -7.600698], [40301, -7.602423], [622, -7.647131], [74493, -7.654032], [120784, -7.691669], [121249, -7.750553], [119647, -7.762995], [63, -7.804749], [262, -7.81713], [766, -7.819563], [502, -7.841083], [120675, -7.848923], [14419, -7.864909], [4075, -7.888356], [94742, -7.910779], [122629, -7.912663], [279, -7.931439], [5274, -7.938852], [40320, -7.954093], [3688, -7.956635], [49430, -7.960465], [39, -7.976981], [94105, -7.995167], [60475, -8.052526], [120001, -8.089004], [21216, -8.141519], [1275, -8.150365], [82275, -8.159352], [799, -8.179116], [34701, -8.240002], [52654, -8.244732], [33, -8.260285], [68037, -8.275157], [14696, -8.284616], [123653, -8.289448], [1427, -8.293825], [120653, -8.325435], [48752, -8.339006], [47, -8.363029], [120719, -8.369858], [123302, -8.376785], [22664, -8.387285], [92, -8.398927], [82618, -8.412107], [102925, -8.454967], [923, -8.471251], [669, -8.489395], [353, -8.491117], [44175, -8.494984], [2403, -8.498348], [41086, -8.50719], [3167, -8.510426], [2879, -8.51344], [3660, -8.588295], [318, -8.597619], [121322, -8.632396], [11292, -8.648144], [919, -8.663664], [4222, -8.665626], [835, -8.67484], [7510, -8.717854]], "logprob_of_token": -0.220966, "top1_top2_margin": 3.878017, "top6_top7_margin": 0.176554}, {"gen_index": 11, "token": 116026, "top": [[116026, -0.221366], [34774, -4.05696], [14153, -5.071674], [125787, -5.108666], [83150, -5.95602], [14620, -6.010282], [42046, -6.049], [32, -6.173602], [101051, -6.211216], [735, -6.228268], [127906, -6.265152], [14179, -6.306836], [14188, -6.343781], [116908, -6.455972], [121598, -6.500722], [949, -6.508884], [34, -6.593764], [1921, -6.704309], [63530, -6.705129], [120625, -6.785425], [3786, -6.867409], [44, -7.02971], [15774, -7.185435], [42, -7.205015], [936, -7.26958], [120293, -7.288566], [25079, -7.325937], [120007, -7.32606], [46, -7.33285], [946, -7.33926], [123576, -7.339727], [16581, -7.357383], [2125, -7.507483], [941, -7.51875], [40301, -7.52654], [32502, -7.5272], [286, -7.531495], [123182, -7.55398], [15397, -7.59625], [74493, -7.611757], [120784, -7.661821], [766, -7.699142], [5274, -7.703248], [14541, -7.720409], [622, -7.727886], [82765, -7.730402], [121249, -7.733891], [122629, -7.747332], [262, -7.749028], [120675, -7.76769], [63, -7.81898], [39, -7.877123], [4075, -7.879328], [502, -7.896554], [94742, -7.92929], [40320, -7.956269], [119647, -7.957056], [120001, -7.964952], [14419, -7.969215], [279, -8.000192], [94105, -8.02353], [60475, -8.037392], [799, -8.056584], [3688, -8.068421], [49430, -8.129637], [34701, -8.142418], [82275, -8.189962], [21216, -8.249154], [1275, -8.259094], [52654, -8.270461], [33, -8.27143], [123653, -8.291618], [48752, -8.343003], [14696, -8.366408], [120653, -8.374629], [47, -8.395553], [68037, -8.408349], [120719, -8.421409], [1427, -8.422341], [123302, -8.463396], [44175, -8.473288], [3167, -8.480302], [41086, -8.48335], [923, -8.497068], [669, -8.499876], [7510, -8.506739], [2879, -8.507274], [102925, -8.520493], [22664, -8.522129], [353, -8.5223], [94, -8.55303], [92, -8.574161], [4222, -8.577468], [2403, -8.584446], [3660, -8.611001], [57926, -8.627698], [82618, -8.652406], [4225, -8.666532], [318, -8.670354], [120078, -8.70357]], "logprob_of_token": -0.221366, "top1_top2_margin": 3.835594, "top6_top7_margin": 0.038718}, {"gen_index": 12, "token": 116026, "top": [[116026, -0.217906], [34774, -4.169117], [14153, -5.007516], [125787, -5.353379], [83150, -5.752275], [14620, -5.982059], [42046, -6.055925], [32, -6.16994], [735, -6.199688], [14179, -6.315643], [101051, -6.334944], [127906, -6.342017], [14188, -6.355669], [949, -6.454762], [116908, -6.653527], [121598, -6.655653], [34, -6.733337], [1921, -6.738711], [3786, -6.87303], [120625, -6.899198], [63530, -7.011073], [44, -7.122687], [15774, -7.168021], [936, -7.230577], [120007, -7.251983], [42, -7.266948], [123182, -7.289954], [123576, -7.321665], [32502, -7.355408], [120293, -7.370892], [2125, -7.413526], [46, -7.415448], [946, -7.419498], [15397, -7.419703], [941, -7.426353], [120784, -7.463141], [25079, -7.472077], [40301, -7.589268], [74493, -7.622932], [286, -7.652081], [94742, -7.700947], [622, -7.701871], [119647, -7.711157], [120675, -7.733778], [63, -7.734125], [40320, -7.737884], [14541, -7.763243], [766, -7.767466], [262, -7.779915], [82765, -7.784272], [16581, -7.794728], [121249, -7.831607], [5274, -7.843325], [502, -7.890669], [49430, -7.90953], [39, -7.925989], [120001, -7.950307], [94105, -7.954029], [4075, -7.961937], [122629, -7.989929], [3688, -8.053998], [60475, -8.066195], [14419, -8.066406], [799, -8.096527], [82275, -8.117641], [21216, -8.134314], [52654, -8.137815], [33, -8.160316], [1275, -8.177262], [279, -8.198318], [120719, -8.203678], [123653, -8.209331], [34701, -8.259715], [1427, -8.271686], [82618, -8.339316], [14696, -8.352023], [48752, -8.362926], [102925, -8.373688], [22664, -8.385357], [68037, -8.392175], [123302, -8.415605], [2403, -8.437635], [120653, -8.438558], [4222, -8.441282], [41086, -8.465497], [3167, -8.472349], [11292, -8.511894], [44175, -8.512717], [47, -8.538554], [92, -8.553125], [669, -8.599301], [923, -8.60003], [120078, -8.615157], [127604, -8.635139], [4225, -8.653817], [3660, -8.658753], [57926, -8.675664], [318, -8.680966], [121322, -8.709496], [353, -8.715616]], "logprob_of_token": -0.217906, "top1_top2_margin": 3.951212, "top6_top7_margin": 0.073867}, {"gen_index": 13, "token": 116026, "top": [[116026, -0.226791], [34774, -4.047577], [14153, -4.848548], [125787, -5.49928], [83150, -5.950099], [14620, -6.026671], [32, -6.144125], [42046, -6.157796], [735, -6.162344], [14179, -6.165459], [127906, -6.168988], [101051, -6.203489], [14188, -6.243527], [34, -6.406094], [949, -6.460997], [1921, -6.537082], [116908, -6.579731], [121598, -6.751076], [120625, -6.794054], [3786, -6.894283], [42, -6.943576], [63530, -7.008821], [123576, -7.234756], [946, -7.240776], [44, -7.308625], [936, -7.312153], [120007, -7.340899], [15397, -7.375353], [941, -7.381907], [120293, -7.401543], [32502, -7.408994], [15774, -7.409807], [25079, -7.478018], [46, -7.50482], [120784, -7.517854], [123182, -7.536701], [40301, -7.555814], [2125, -7.583279], [286, -7.585793], [82765, -7.60635], [74493, -7.633219], [262, -7.661844], [40320, -7.665755], [5274, -7.671689], [766, -7.686461], [4075, -7.745671], [622, -7.792737], [16581, -7.798036], [39, -7.849268], [502, -7.849896], [120001, -7.865968], [94742, -7.87364], [120675, -7.880455], [121249, -7.909965], [119647, -7.940187], [82275, -7.944251], [63, -7.965501], [14541, -7.988296], [122629, -8.012122], [52654, -8.0149], [34701, -8.031021], [94105, -8.042442], [14419, -8.042802], [279, -8.045348], [3688, -8.094579], [799, -8.094748], [49430, -8.109043], [60475, -8.112549], [21216, -8.124112], [41086, -8.135978], [123653, -8.166283], [48752, -8.199647], [120719, -8.248705], [33, -8.266101], [1275, -8.281788], [120653, -8.29984], [14696, -8.332461], [102925, -8.33522], [3167, -8.354526], [4222, -8.357769], [44175, -8.370073], [82618, -8.389354], [123302, -8.409997], [1427, -8.420737], [22664, -8.471662], [47, -8.47816], [669, -8.503332], [120078, -8.514359], [68037, -8.522034], [2403, -8.549086], [2879, -8.580994], [92, -8.597158], [94, -8.608157], [11292, -8.613233], [4225, -8.627322], [90, -8.65215], [30591, -8.656926], [122532, -8.658229], [121322, -8.671027], [353, -8.677649]], "logprob_of_token": -0.226791, "top1_top2_margin": 3.820787, "top6_top7_margin": 0.117455}, {"gen_index": 14, "token": 116026, "top": [[116026, -0.224912], [34774, -4.123631], [14153, -4.836545], [14620, -5.713966], [125787, -5.720962], [83150, -5.774072], [14179, -6.082921], [32, -6.202761], [127906, -6.225384], [14188, -6.237654], [735, -6.255515], [34, -6.409298], [42046, -6.42075], [949, -6.422311], [101051, -6.485773], [1921, -6.528764], [3786, -6.733232], [116908, -6.779043], [120625, -6.78281], [121598, -6.853142], [42, -6.887307], [123576, -7.035428], [63530, -7.090033], [946, -7.181209], [32502, -7.252185], [44, -7.253171], [120007, -7.272688], [941, -7.337089], [82765, -7.374479], [15397, -7.382262], [936, -7.390321], [46, -7.443176], [123182, -7.449899], [120293, -7.504489], [2125, -7.512795], [40320, -7.516586], [120784, -7.526102], [25079, -7.598353], [40301, -7.634347], [286, -7.640469], [15774, -7.667294], [5274, -7.695348], [262, -7.699721], [766, -7.745424], [622, -7.745996], [4075, -7.753345], [63, -7.777257], [119647, -7.785655], [82275, -7.787646], [502, -7.824568], [74493, -7.85197], [14541, -7.869271], [39, -7.880526], [52654, -7.882573], [94742, -7.887578], [121249, -7.908135], [49430, -7.915281], [120001, -7.93064], [799, -7.968324], [21216, -7.99685], [3688, -8.002329], [279, -8.048877], [122629, -8.05612], [33, -8.075733], [94105, -8.077879], [14419, -8.089323], [41086, -8.090897], [34701, -8.100783], [82618, -8.103518], [60475, -8.116658], [120719, -8.132896], [120675, -8.141264], [1275, -8.154011], [123653, -8.154701], [48752, -8.159431], [16581, -8.167018], [120653, -8.19879], [44175, -8.247087], [123302, -8.262507], [14696, -8.284285], [3167, -8.293818], [102925, -8.29934], [4222, -8.327029], [92, -8.420034], [11292, -8.440888], [120078, -8.459116], [122532, -8.49879], [1427, -8.503991], [47, -8.521169], [2403, -8.533581], [22664, -8.591165], [919, -8.613553], [121322, -8.622202], [90, -8.635995], [30591, -8.641915], [310, -8.645049], [127604, -8.652896], [669, -8.654552], [2879, -8.670189], [353, -8.677289]], "logprob_of_token": -0.224912, "top1_top2_margin": 3.898719, "top6_top7_margin": 0.308849}, {"gen_index": 15, "token": 116026, "top": [[116026, -0.11523], [34774, -4.380249], [14153, -5.180806], [125787, -6.142705], [14620, -6.29507], [83150, -6.302358], [949, -6.687837], [127906, -6.68826], [32, -6.714365], [42046, -6.798734], [116908, -7.040753], [101051, -7.048756], [14188, -7.127708], [34, -7.212582], [121598, -7.224433], [14179, -7.250818], [3786, -7.288586], [1921, -7.299646], [42, -7.444413], [735, -7.451808], [63530, -7.571698], [2125, -7.621597], [946, -7.646679], [120007, -7.659781], [32502, -7.666008], [941, -7.71904], [40301, -7.736178], [82765, -7.753648], [44, -7.772618], [120625, -7.782564], [123576, -7.863247], [120784, -7.953242], [40320, -8.002574], [120293, -8.032603], [49430, -8.046781], [123182, -8.062438], [74493, -8.078684], [14541, -8.106445], [46, -8.126575], [936, -8.154116], [4075, -8.209542], [25079, -8.2107], [286, -8.258423], [63, -8.288949], [14419, -8.31314], [121249, -8.340439], [15774, -8.347749], [15397, -8.352681], [120675, -8.392089], [94105, -8.415751], [33, -8.42317], [262, -8.452394], [766, -8.495154], [92, -8.51612], [622, -8.529789], [39, -8.555778], [82275, -8.576987], [799, -8.58364], [120001, -8.603345], [279, -8.608703], [82618, -8.609559], [119647, -8.612556], [14696, -8.645045], [1275, -8.650158], [21216, -8.687383], [120719, -8.690409], [120653, -8.699206], [52654, -8.737128], [41086, -8.763618], [68037, -8.764319], [60475, -8.772517], [1427, -8.807212], [502, -8.823239], [34701, -8.824515], [16581, -8.839536], [3688, -8.840518], [123653, -8.899161], [22664, -8.90693], [94742, -8.935575], [122629, -8.98603], [5274, -8.987568], [2403, -9.002658], [94, -9.023843], [11292, -9.028728], [90, -9.076416], [102925, -9.081068], [120078, -9.084468], [919, -9.096219], [44175, -9.097341], [22984, -9.101323], [669, -9.12144], [47, -9.135934], [474, -9.138485], [45, -9.146528], [120256, -9.168826], [121322, -9.244232], [3167, -9.254881], [14926, -9.276689], [318, -9.276715], [127604, -9.286924]], "logprob_of_token": -0.11523, "top1_top2_margin": 4.265019, "top6_top7_margin": 0.385479}, {"gen_index": 16, "token": 116026, "top": [[116026, -0.151379], [34774, -4.336407], [14153, -5.066794], [14620, -5.965719], [83150, -6.094578], [125787, -6.270358], [949, -6.273166], [127906, -6.43968], [101051, -6.459503], [42046, -6.578889], [32, -6.651485], [14179, -6.703426], [116908, -6.720677], [1921, -6.767036], [14188, -6.768631], [34, -6.879018], [735, -6.927598], [3786, -7.000342], [42, -7.011817], [120007, -7.162955], [120625, -7.219595], [121598, -7.25302], [63530, -7.261444], [946, -7.46119], [2125, -7.515083], [941, -7.527322], [82765, -7.581238], [44, -7.593712], [123576, -7.637472], [120293, -7.649299], [40301, -7.702099], [120784, -7.748811], [40320, -7.771141], [14419, -7.780868], [46, -7.79686], [32502, -7.8002], [936, -7.886254], [123182, -7.899358], [49430, -7.94018], [74493, -7.968844], [14541, -7.978691], [286, -7.983126], [1427, -7.996595], [262, -8.034245], [15397, -8.044706], [94105, -8.072777], [766, -8.086466], [120675, -8.103018], [25079, -8.116325], [4075, -8.128644], [15774, -8.14146], [63, -8.156732], [60475, -8.159553], [52654, -8.198574], [120001, -8.247606], [82275, -8.248528], [121249, -8.253854], [622, -8.282596], [14696, -8.30215], [21216, -8.314713], [502, -8.344914], [39, -8.389091], [119647, -8.394856], [82618, -8.397175], [120719, -8.415475], [5274, -8.419858], [92, -8.435964], [34701, -8.495385], [94742, -8.499304], [2403, -8.504525], [41086, -8.525031], [3688, -8.525973], [279, -8.528008], [799, -8.538781], [122629, -8.548568], [33, -8.588562], [102925, -8.596399], [1275, -8.6253], [120653, -8.632947], [11292, -8.652462], [22664, -8.656802], [4222, -8.698164], [123653, -8.71347], [47, -8.733175], [22984, -8.75796], [48752, -8.790406], [44175, -8.812618], [16581, -8.823201], [123302, -8.827903], [120078, -8.835904], [68037, -8.859326], [90, -8.863526], [3167, -8.898029], [45, -8.94383], [94, -8.953884], [9518, -8.964911], [4225, -8.991798], [923, -8.994729], [669, -9.013322], [121322, -9.017798]], "logprob_of_token": -0.151379, "top1_top2_margin": 4.185028, "top6_top7_margin": 0.002809}, {"gen_index": 17, "token": 116026, "top": [[116026, -0.152369], [34774, -4.274918], [14153, -5.12978], [83150, -5.958493], [125787, -6.01854], [14620, -6.223208], [949, -6.293509], [127906, -6.32903], [101051, -6.562318], [32, -6.563417], [1921, -6.636177], [42046, -6.690884], [14179, -6.735009], [14188, -6.763477], [116908, -6.765554], [735, -6.83675], [34, -6.897573], [42, -6.965073], [120007, -7.087869], [120625, -7.089836], [3786, -7.150435], [941, -7.168669], [63530, -7.238398], [121598, -7.242867], [946, -7.307006], [2125, -7.425997], [120293, -7.45437], [40301, -7.523285], [32502, -7.606413], [44, -7.622312], [82765, -7.700504], [120784, -7.732563], [123182, -7.77928], [14541, -7.880997], [123576, -7.890263], [46, -7.897324], [40320, -7.928113], [936, -7.931472], [14419, -7.946445], [286, -7.98103], [262, -7.983858], [63, -8.029786], [15774, -8.032607], [15397, -8.043557], [4075, -8.094354], [94105, -8.108701], [766, -8.115301], [502, -8.129027], [622, -8.134083], [74493, -8.158922], [120675, -8.177338], [49430, -8.188891], [120001, -8.246622], [16581, -8.261017], [25079, -8.266165], [5274, -8.276525], [3688, -8.278866], [82275, -8.28912], [39, -8.348602], [1427, -8.36614], [52654, -8.371131], [121249, -8.377563], [119647, -8.384684], [60475, -8.385277], [2403, -8.396062], [799, -8.410208], [92, -8.429957], [21216, -8.469224], [33, -8.474568], [279, -8.485567], [94742, -8.497697], [122629, -8.509583], [14696, -8.522833], [102925, -8.554101], [34701, -8.582799], [1275, -8.591113], [4222, -8.645061], [82618, -8.658472], [123653, -8.689268], [22664, -8.693028], [120653, -8.700702], [11292, -8.729851], [94, -8.756616], [68037, -8.764663], [41086, -8.785319], [47, -8.813276], [90, -8.813975], [123302, -8.826958], [120078, -8.857582], [9518, -8.873755], [120719, -8.874072], [22984, -8.888097], [3167, -8.905986], [48752, -8.924466], [6391, -8.971745], [669, -8.97457], [44175, -8.979543], [4225, -8.981339], [26794, -8.984641], [120022, -9.000343]], "logprob_of_token": -0.152369, "top1_top2_margin": 4.122549, "top6_top7_margin": 0.070301}, {"gen_index": 18, "token": 116026, "top": [[116026, -0.142193], [34774, -4.289646], [14153, -5.254857], [83150, -6.13191], [14620, -6.165463], [125787, -6.21833], [127906, -6.420015], [949, -6.456233], [101051, -6.674968], [1921, -6.715364], [32, -6.732166], [116908, -6.773849], [42046, -6.922446], [14188, -6.923231], [34, -6.942303], [14179, -6.958304], [735, -6.979003], [42, -7.011169], [120007, -7.107255], [120625, -7.148418], [3786, -7.188019], [946, -7.331904], [63530, -7.338582], [121598, -7.384163], [941, -7.449509], [2125, -7.530574], [82765, -7.586312], [40301, -7.612845], [120293, -7.637973], [44, -7.739621], [120784, -7.784324], [32502, -7.806136], [14419, -7.825172], [123576, -7.843842], [40320, -7.875694], [123182, -7.890913], [46, -7.926907], [936, -7.956702], [14541, -7.998451], [49430, -8.030906], [262, -8.031491], [286, -8.033613], [63, -8.060375], [120675, -8.119977], [502, -8.139004], [4075, -8.164967], [766, -8.184855], [94105, -8.23663], [74493, -8.265882], [15397, -8.272606], [1427, -8.27887], [120001, -8.279852], [15774, -8.305017], [82275, -8.325669], [622, -8.326965], [121249, -8.3638], [52654, -8.407546], [39, -8.431228], [60475, -8.445251], [21216, -8.447296], [3688, -8.453978], [92, -8.479227], [25079, -8.48081], [279, -8.483622], [799, -8.491325], [5274, -8.496212], [119647, -8.506637], [82618, -8.540279], [2403, -8.552372], [122629, -8.559258], [14696, -8.574482], [33, -8.57535], [94742, -8.583499], [34701, -8.613795], [102925, -8.618735], [1275, -8.646051], [16581, -8.68256], [41086, -8.696239], [120719, -8.70348], [120653, -8.72219], [11292, -8.7245], [4222, -8.728806], [22664, -8.734874], [123653, -8.741099], [68037, -8.839435], [123302, -8.853905], [120078, -8.882239], [47, -8.909012], [4225, -8.911556], [22984, -8.92669], [3167, -8.928231], [94, -8.9354], [9518, -8.936834], [120022, -8.958754], [90, -8.985587], [7878, -8.998697], [24826, -9.036655], [923, -9.050272], [669, -9.051168], [44175, -9.067544]], "logprob_of_token": -0.142193, "top1_top2_margin": 4.147453, "top6_top7_margin": 0.201684}, {"gen_index": 19, "token": 116026, "top": [[116026, -0.126498], [34774, -4.313104], [14153, -5.353465], [14620, -6.000209], [83150, -6.310007], [125787, -6.386564], [949, -6.451238], [127906, -6.560059], [101051, -6.754798], [116908, -6.846919], [32, -6.864282], [1921, -6.909392], [14179, -6.958903], [42, -6.991379], [42046, -7.057988], [34, -7.065197], [120007, -7.099726], [14188, -7.163642], [120625, -7.252673], [735, -7.300404], [3786, -7.334966], [63530, -7.490418], [121598, -7.522704], [82765, -7.524332], [941, -7.531808], [946, -7.569512], [40301, -7.707245], [120293, -7.717054], [123576, -7.755363], [2125, -7.834015], [120784, -7.850014], [44, -7.864117], [40320, -7.881433], [32502, -7.920986], [14419, -7.930685], [49430, -8.054902], [46, -8.059236], [123182, -8.091801], [936, -8.166329], [14541, -8.171688], [262, -8.226515], [63, -8.290597], [286, -8.309169], [502, -8.338446], [766, -8.348783], [82275, -8.365588], [121249, -8.376371], [74493, -8.39522], [120675, -8.41199], [120001, -8.412475], [94105, -8.429527], [60475, -8.45929], [4075, -8.47189], [1427, -8.492436], [21216, -8.494996], [622, -8.506741], [25079, -8.50787], [15397, -8.527489], [52654, -8.563259], [120719, -8.564776], [799, -8.569982], [82618, -8.575916], [92, -8.577785], [41086, -8.583992], [39, -8.591224], [14696, -8.595445], [34701, -8.603103], [279, -8.607799], [33, -8.623853], [15774, -8.666995], [3688, -8.677548], [119647, -8.682105], [120653, -8.701314], [5274, -8.731882], [123653, -8.732711], [1275, -8.7409], [122629, -8.745379], [102925, -8.784736], [94742, -8.81775], [2403, -8.856299], [22664, -8.85778], [4222, -8.875079], [47, -8.913263], [68037, -8.923173], [120078, -8.930654], [4225, -8.936336], [11292, -8.945362], [90, -8.962595], [44175, -8.964981], [123302, -8.981098], [45, -9.007923], [94, -9.019457], [120256, -9.028193], [120022, -9.065812], [122532, -9.096122], [16581, -9.104202], [22984, -9.120055], [3167, -9.122559], [14926, -9.148409], [127604, -9.172231]], "logprob_of_token": -0.126498, "top1_top2_margin": 4.186606, "top6_top7_margin": 0.064674}, {"gen_index": 20, "token": 116026, "top": [[116026, -0.195596], [34774, -4.03717], [14153, -4.84715], [125787, -5.926567], [83150, -5.953283], [14620, -5.971854], [127906, -6.060036], [14179, -6.17169], [735, -6.355146], [34, -6.395843], [949, -6.406524], [1921, -6.420864], [32, -6.448002], [101051, -6.512183], [14188, -6.52714], [42, -6.55009], [3786, -6.805671], [116908, -6.819211], [120625, -6.824008], [42046, -6.874869], [120007, -6.95672], [121598, -7.180634], [63530, -7.281417], [46, -7.302742], [946, -7.358188], [44, -7.386756], [941, -7.428677], [2125, -7.465447], [82765, -7.490104], [32502, -7.495235], [120293, -7.522677], [123576, -7.593017], [936, -7.638214], [502, -7.653159], [123182, -7.705478], [40301, -7.713494], [262, -7.716771], [14419, -7.723327], [40320, -7.728017], [622, -7.75265], [799, -7.789109], [120001, -7.794744], [286, -7.794873], [5274, -7.817503], [120784, -7.817914], [766, -7.935887], [279, -7.960168], [49430, -8.007844], [39, -8.028397], [122629, -8.036665], [52654, -8.06601], [82275, -8.076307], [3688, -8.08111], [63, -8.103665], [4075, -8.103848], [15397, -8.107135], [14541, -8.117766], [60475, -8.139869], [119647, -8.187453], [92, -8.203039], [1427, -8.213416], [25079, -8.21943], [16581, -8.24774], [121249, -8.247995], [74493, -8.262182], [15774, -8.267008], [120675, -8.272364], [94105, -8.330621], [120078, -8.34166], [1275, -8.36269], [123653, -8.38555], [21216, -8.391235], [123302, -8.391259], [94742, -8.392521], [3711, -8.409871], [82618, -8.422091], [3167, -8.425933], [33, -8.438419], [4222, -8.443336], [41086, -8.443864], [102925, -8.447222], [2879, -8.451358], [4225, -8.483515], [2403, -8.500988], [45, -8.509733], [120653, -8.531696], [47, -8.549071], [120719, -8.57377], [48752, -8.581211], [22664, -8.58947], [11292, -8.592647], [120022, -8.618264], [310, -8.654917], [14696, -8.656757], [34701, -8.666756], [94, -8.681746], [669, -8.684937], [44175, -8.717509], [919, -8.734859], [36209, -8.7472]], "logprob_of_token": -0.195596, "top1_top2_margin": 3.841574, "top6_top7_margin": 0.088182}, {"gen_index": 21, "token": 116026, "top": [[116026, -0.191108], [34774, -4.167604], [14153, -5.154263], [125787, -5.624022], [83150, -5.941192], [127906, -5.970204], [14620, -6.013557], [14179, -6.268024], [101051, -6.268931], [34, -6.41264], [14188, -6.489748], [1921, -6.505914], [32, -6.51605], [949, -6.517841], [735, -6.521889], [120625, -6.64781], [42046, -6.654843], [42, -6.70844], [3786, -6.715792], [116908, -6.755687], [120007, -7.034777], [121598, -7.118275], [63530, -7.297564], [946, -7.305384], [941, -7.319293], [46, -7.359197], [44, -7.396214], [32502, -7.482085], [2125, -7.508289], [120293, -7.529387], [502, -7.576235], [82765, -7.587736], [123576, -7.59548], [14419, -7.612601], [936, -7.727608], [120784, -7.733665], [123182, -7.750037], [40301, -7.751842], [40320, -7.766616], [622, -7.766833], [286, -7.797152], [262, -7.818655], [120001, -7.837329], [5274, -7.866517], [799, -7.892658], [766, -7.946643], [39, -8.026426], [4075, -8.031723], [16581, -8.069618], [122629, -8.082245], [15397, -8.093249], [63, -8.104246], [119647, -8.110147], [279, -8.133491], [82275, -8.135022], [3688, -8.140743], [25079, -8.15345], [60475, -8.167991], [15774, -8.188311], [14541, -8.193791], [121249, -8.200974], [52654, -8.203834], [49430, -8.232627], [1427, -8.287755], [120675, -8.294007], [94105, -8.294439], [74493, -8.300707], [3711, -8.340146], [94742, -8.345109], [92, -8.34861], [120078, -8.348674], [123302, -8.389832], [41086, -8.390409], [33, -8.398527], [2403, -8.401525], [4222, -8.428964], [1275, -8.442758], [123653, -8.465267], [21216, -8.480763], [3167, -8.484465], [14696, -8.50135], [102925, -8.519616], [4225, -8.53403], [2879, -8.543259], [120719, -8.580686], [82618, -8.589832], [45, -8.625746], [669, -8.63549], [48752, -8.640676], [34701, -8.645106], [120022, -8.669292], [47, -8.66989], [44175, -8.682022], [9518, -8.716889], [11292, -8.722405], [36209, -8.726717], [22664, -8.739561], [2466, -8.763706], [94, -8.764923], [923, -8.786706]], "logprob_of_token": -0.191108, "top1_top2_margin": 3.976497, "top6_top7_margin": 0.043354}, {"gen_index": 22, "token": 116026, "top": [[116026, -0.180405], [34774, -4.097687], [14153, -5.167802], [125787, -5.568368], [83150, -5.999307], [127906, -6.006808], [14620, -6.168437], [14179, -6.268202], [101051, -6.331859], [735, -6.480398], [34, -6.485365], [14188, -6.490177], [949, -6.522426], [32, -6.540335], [42046, -6.605954], [120625, -6.613502], [1921, -6.620394], [42, -6.826808], [3786, -6.856777], [116908, -6.999727], [121598, -7.054582], [120007, -7.144252], [46, -7.313979], [63530, -7.361484], [941, -7.456605], [946, -7.462914], [44, -7.474168], [32502, -7.476533], [120293, -7.520643], [82765, -7.643452], [40301, -7.670441], [2125, -7.724146], [123576, -7.725327], [14419, -7.729486], [123182, -7.734674], [622, -7.774345], [120001, -7.812144], [936, -7.820897], [40320, -7.831423], [5274, -7.849821], [502, -7.865621], [16581, -7.893581], [262, -7.934151], [286, -7.937595], [799, -7.986242], [120784, -7.989116], [122629, -7.993741], [25079, -8.020644], [766, -8.049006], [15397, -8.080705], [39, -8.116207], [3711, -8.131471], [15774, -8.133654], [63, -8.13521], [4075, -8.149599], [82275, -8.161123], [1427, -8.185802], [279, -8.192131], [121249, -8.204651], [3688, -8.214843], [74493, -8.255307], [119647, -8.269047], [49430, -8.276531], [60475, -8.307394], [2403, -8.309956], [120675, -8.345469], [94105, -8.345614], [123653, -8.362789], [120078, -8.381483], [33, -8.397018], [52654, -8.410377], [94742, -8.412788], [14541, -8.420431], [1275, -8.434011], [14696, -8.459415], [123302, -8.482925], [102925, -8.486074], [41086, -8.486504], [4222, -8.489049], [92, -8.505838], [3167, -8.506795], [82618, -8.542295], [21216, -8.549814], [669, -8.615614], [34701, -8.625555], [2879, -8.630368], [45, -8.638694], [11292, -8.672718], [36209, -8.684008], [4225, -8.697239], [94, -8.704712], [44175, -8.70953], [310, -8.709738], [22664, -8.714885], [120719, -8.729008], [120022, -8.743458], [919, -8.753421], [68037, -8.773024], [48752, -8.821688], [90, -8.823117]], "logprob_of_token": -0.180405, "top1_top2_margin": 3.917282, "top6_top7_margin": 0.161629}, {"gen_index": 23, "token": 116026, "top": [[116026, -0.135986], [34774, -4.29864], [14153, -5.250825], [125787, -5.999073], [14620, -6.090496], [83150, -6.124857], [127906, -6.161064], [949, -6.62076], [101051, -6.699859], [34, -6.761175], [14179, -6.801813], [42, -6.804836], [32, -6.808363], [116908, -6.815207], [14188, -6.870326], [1921, -6.875344], [120007, -6.912887], [735, -6.939533], [120625, -7.033329], [42046, -7.064862], [121598, -7.217469], [63530, -7.266604], [941, -7.364903], [3786, -7.44771], [120293, -7.475764], [46, -7.625508], [946, -7.646959], [2125, -7.663634], [82765, -7.676491], [44, -7.678382], [14419, -7.74099], [32502, -7.775237], [40301, -7.784334], [120784, -7.815021], [14541, -7.919074], [936, -7.940833], [40320, -7.975269], [123576, -7.977068], [63, -8.005198], [123182, -8.069242], [120001, -8.162992], [262, -8.16881], [766, -8.18217], [286, -8.186735], [502, -8.2242], [49430, -8.276275], [121249, -8.285273], [33, -8.310965], [94105, -8.314224], [622, -8.332867], [120675, -8.335253], [15774, -8.336369], [15397, -8.33975], [5274, -8.350163], [74493, -8.391178], [92, -8.403331], [25079, -8.411236], [39, -8.416521], [16581, -8.421259], [279, -8.426571], [799, -8.438666], [82275, -8.495189], [60475, -8.495207], [94742, -8.510689], [1427, -8.515113], [52654, -8.51851], [119647, -8.520554], [4075, -8.523396], [122629, -8.556028], [3688, -8.565215], [120719, -8.621958], [4222, -8.663949], [102925, -8.665782], [123653, -8.676598], [21216, -8.694504], [120078, -8.696833], [1275, -8.710828], [4225, -8.726624], [41086, -8.741731], [3711, -8.747897], [14696, -8.750291], [82618, -8.761319], [34701, -8.775012], [2403, -8.819436], [94, -8.822382], [68037, -8.853624], [22664, -8.86022], [36209, -8.888797], [120022, -8.896025], [11292, -8.906728], [123302, -8.908776], [120653, -8.925526], [669, -8.95534], [47, -8.96547], [45, -8.973833], [90, -8.980844], [22984, -8.984171], [44175, -8.995293], [3167, -9.007079], [120410, -9.007702]], "logprob_of_token": -0.135986, "top1_top2_margin": 4.162654, "top6_top7_margin": 0.036207}, {"gen_index": 24, "token": 116026, "top": [[116026, -0.112955], [34774, -4.390644], [14153, -5.520161], [125787, -6.124608], [14620, -6.127542], [83150, -6.310405], [127906, -6.49539], [949, -6.598806], [101051, -6.803309], [116908, -6.847218], [32, -7.017406], [14179, -7.021517], [34, -7.051136], [120007, -7.083318], [1921, -7.090289], [42046, -7.12134], [42, -7.124259], [14188, -7.139764], [3786, -7.307479], [120625, -7.360085], [63530, -7.434021], [735, -7.438997], [121598, -7.484292], [941, -7.63727], [82765, -7.678082], [946, -7.682044], [120293, -7.714212], [14419, -7.783792], [40301, -7.846779], [2125, -7.919415], [46, -7.925772], [32502, -7.968143], [120784, -7.991833], [44, -8.002726], [40320, -8.032408], [123576, -8.071996], [936, -8.150747], [49430, -8.170221], [123182, -8.266526], [14541, -8.30583], [63, -8.318422], [262, -8.358374], [120675, -8.36977], [502, -8.398841], [120001, -8.413542], [286, -8.425405], [121249, -8.430535], [94105, -8.453655], [766, -8.48057], [74493, -8.498779], [82275, -8.507483], [33, -8.553076], [52654, -8.570406], [4075, -8.579327], [799, -8.614107], [15774, -8.623512], [1427, -8.633084], [622, -8.633666], [120719, -8.648167], [122629, -8.656332], [25079, -8.659949], [39, -8.66225], [60475, -8.67455], [82618, -8.681148], [15397, -8.691418], [21216, -8.693953], [119647, -8.708285], [5274, -8.711014], [92, -8.717793], [94742, -8.75407], [14696, -8.754784], [16581, -8.7611], [3688, -8.807093], [279, -8.809855], [1275, -8.852765], [22664, -8.895233], [102925, -8.906336], [41086, -8.909161], [123653, -8.911463], [68037, -8.92389], [120078, -8.940001], [34701, -8.967119], [2403, -8.985599], [11292, -8.988276], [4222, -8.989807], [120022, -9.026504], [120653, -9.040867], [123302, -9.046171], [4225, -9.065451], [3711, -9.066318], [44175, -9.093338], [90, -9.10371], [36209, -9.117451], [22984, -9.167246], [669, -9.175639], [94, -9.191253], [3167, -9.234373], [7510, -9.238198], [24826, -9.243174], [122532, -9.251611]], "logprob_of_token": -0.112955, "top1_top2_margin": 4.277689, "top6_top7_margin": 0.184985}, {"gen_index": 25, "token": 116026, "top": [[116026, -0.094652], [34774, -4.448398], [14153, -5.718497], [125787, -6.370509], [14620, -6.390882], [83150, -6.519943], [127906, -6.660604], [949, -6.862512], [116908, -6.889254], [101051, -6.946187], [120007, -7.179848], [14179, -7.186651], [32, -7.216547], [42046, -7.29084], [1921, -7.332041], [63530, -7.381352], [42, -7.397121], [34, -7.452437], [14188, -7.460842], [120625, -7.505394], [3786, -7.575601], [735, -7.719901], [121598, -7.725234], [941, -7.728462], [40301, -7.729652], [82765, -7.805763], [120293, -7.856996], [40320, -8.037522], [946, -8.042138], [123576, -8.062319], [2125, -8.079829], [120784, -8.100839], [14419, -8.110286], [936, -8.210246], [49430, -8.222174], [44, -8.229993], [32502, -8.264305], [46, -8.28396], [502, -8.327645], [120675, -8.380873], [262, -8.460421], [121249, -8.494249], [122629, -8.499471], [120719, -8.531606], [120001, -8.554366], [123182, -8.562717], [799, -8.567308], [14541, -8.573583], [74493, -8.635713], [286, -8.66063], [82275, -8.689493], [766, -8.694571], [1427, -8.709679], [21216, -8.713173], [63, -8.717473], [52654, -8.723891], [82618, -8.733148], [622, -8.747438], [14696, -8.769481], [94105, -8.831468], [60475, -8.837667], [92, -8.848806], [15397, -8.858941], [279, -8.880485], [33, -8.900714], [22664, -8.923544], [1275, -8.925175], [119647, -8.957413], [11292, -8.962569], [25079, -8.96724], [15774, -8.992027], [5274, -8.997903], [4075, -9.009888], [34701, -9.018012], [3688, -9.046572], [102925, -9.051837], [41086, -9.056266], [120022, -9.059991], [68037, -9.068782], [39, -9.097455], [44175, -9.116812], [4222, -9.119338], [16581, -9.125672], [94742, -9.160055], [2403, -9.190879], [22984, -9.196776], [4225, -9.24181], [123653, -9.308107], [120078, -9.314137], [94, -9.326371], [7510, -9.333745], [14794, -9.344583], [9518, -9.35171], [3711, -9.357466], [90, -9.413972], [24826, -9.426868], [1319, -9.429764], [14330, -9.43066], [123302, -9.444077], [120653, -9.451543]], "logprob_of_token": -0.094652, "top1_top2_margin": 4.353747, "top6_top7_margin": 0.140661}, {"gen_index": 26, "token": 116026, "top": [[116026, -0.107255], [34774, -4.398672], [14153, -5.476737], [14620, -6.217939], [125787, -6.3439], [83150, -6.354041], [127906, -6.579822], [949, -6.663146], [42046, -6.792686], [116908, -6.804129], [101051, -6.814703], [120007, -6.97676], [1921, -7.040008], [32, -7.048754], [34, -7.064774], [14179, -7.1806], [42, -7.209083], [3786, -7.212016], [14188, -7.260649], [735, -7.306459], [120625, -7.392094], [63530, -7.485167], [941, -7.58287], [946, -7.598833], [2125, -7.648682], [40301, -7.706605], [121598, -7.741004], [14419, -7.771817], [82765, -7.812902], [120293, -7.846112], [120784, -7.863575], [46, -7.942118], [32502, -7.942719], [44, -7.980669], [123576, -8.147135], [936, -8.158508], [40320, -8.180365], [286, -8.189631], [120675, -8.253635], [123182, -8.285171], [63, -8.307221], [49430, -8.318089], [502, -8.330613], [262, -8.420621], [122629, -8.442359], [622, -8.452368], [799, -8.458264], [121249, -8.474668], [120001, -8.475946], [33, -8.487119], [766, -8.517962], [92, -8.519418], [14541, -8.521537], [1275, -8.574883], [4075, -8.588668], [74493, -8.613387], [279, -8.631635], [21216, -8.664617], [82618, -8.667983], [15774, -8.67021], [25079, -8.724036], [39, -8.731412], [94105, -8.734674], [120719, -8.738094], [82275, -8.73957], [1427, -8.75341], [3688, -8.777651], [119647, -8.78125], [52654, -8.789073], [68037, -8.813659], [60475, -8.819032], [15397, -8.846934], [22664, -8.851371], [120022, -8.916608], [14696, -8.917785], [5274, -8.934996], [120078, -8.988723], [123302, -9.015767], [44175, -9.02415], [2403, -9.062136], [16581, -9.062273], [34701, -9.093567], [3711, -9.121911], [7510, -9.124351], [4222, -9.128119], [94742, -9.13064], [9518, -9.142926], [36209, -9.181558], [669, -9.182582], [3660, -9.188498], [318, -9.190403], [11292, -9.191403], [102925, -9.219937], [123653, -9.242134], [41086, -9.244033], [474, -9.24577], [2213, -9.269416], [120653, -9.276179], [1083, -9.284794], [919, -9.300258]], "logprob_of_token": -0.107255, "top1_top2_margin": 4.291417, "top6_top7_margin": 0.225781}, {"gen_index": 27, "token": 116026, "top": [[116026, -0.240798], [34774, -4.011719], [14153, -4.989996], [127906, -5.617486], [125787, -5.680673], [83150, -5.854718], [14620, -6.021101], [34, -6.021776], [14179, -6.070504], [735, -6.237357], [949, -6.252407], [1921, -6.271354], [14188, -6.323408], [101051, -6.331288], [32, -6.37021], [42, -6.426627], [116908, -6.496916], [120007, -6.558359], [3786, -6.595013], [120625, -6.713104], [42046, -6.782549], [46, -6.99009], [946, -7.028994], [121598, -7.080571], [941, -7.133629], [63530, -7.137708], [44, -7.238507], [799, -7.264427], [2125, -7.335487], [32502, -7.356976], [936, -7.359029], [120293, -7.366277], [502, -7.387234], [262, -7.416004], [14419, -7.474724], [622, -7.498729], [82765, -7.561441], [5274, -7.563543], [40320, -7.58485], [120001, -7.589708], [286, -7.663023], [3711, -7.674911], [123576, -7.703856], [123182, -7.721323], [766, -7.760699], [122629, -7.776834], [120784, -7.796655], [3688, -7.81124], [40301, -7.826327], [279, -7.846076], [39, -7.863592], [4075, -7.865695], [63, -7.896055], [16581, -7.964426], [119647, -7.964538], [1427, -8.006981], [92, -8.028075], [82275, -8.04471], [52654, -8.067266], [15397, -8.100995], [2879, -8.106201], [49430, -8.116137], [120078, -8.136147], [1275, -8.136681], [2403, -8.144622], [60475, -8.149389], [41, -8.150679], [33, -8.157525], [94742, -8.186089], [15774, -8.193841], [120675, -8.196778], [14541, -8.211941], [120022, -8.239929], [25079, -8.259505], [121249, -8.281766], [74493, -8.291376], [22664, -8.322069], [102925, -8.327111], [36209, -8.333755], [4225, -8.353365], [14696, -8.359244], [45, -8.374509], [94105, -8.375987], [123653, -8.379866], [2466, -8.382924], [4222, -8.390373], [47, -8.419291], [11292, -8.42447], [9518, -8.426694], [90, -8.437389], [21216, -8.439643], [120719, -8.441932], [919, -8.451272], [44175, -8.471034], [310, -8.492862], [41086, -8.500526], [3167, -8.504829], [94, -8.506001], [82618, -8.528225], [669, -8.53008]], "logprob_of_token": -0.240798, "top1_top2_margin": 3.770922, "top6_top7_margin": 0.166383}, {"gen_index": 28, "token": 116026, "top": [[116026, -0.215047], [34774, -4.012899], [14153, -5.024065], [125787, -5.562246], [127906, -5.631803], [83150, -5.847662], [34, -5.963132], [14620, -6.04681], [14179, -6.161354], [14188, -6.207224], [101051, -6.321721], [735, -6.331173], [1921, -6.403356], [32, -6.409155], [42, -6.426017], [949, -6.448093], [116908, -6.528375], [3786, -6.691319], [42046, -6.71735], [120007, -6.728256], [120625, -6.788155], [46, -6.914889], [121598, -7.059199], [946, -7.07413], [44, -7.224682], [63530, -7.228878], [941, -7.273012], [32502, -7.310369], [120293, -7.348989], [502, -7.424747], [2125, -7.43846], [799, -7.465019], [936, -7.498734], [622, -7.511268], [262, -7.556044], [14419, -7.564812], [5274, -7.594017], [120001, -7.600185], [82765, -7.614227], [3711, -7.682719], [286, -7.724151], [123576, -7.765541], [766, -7.781868], [40320, -7.80983], [123182, -7.815996], [120784, -7.832567], [16581, -7.85698], [4075, -7.869474], [39, -7.874359], [40301, -7.877445], [122629, -7.924607], [63, -7.926218], [3688, -7.933504], [279, -8.066029], [15774, -8.066758], [92, -8.084038], [1427, -8.09386], [119647, -8.127216], [120078, -8.129226], [82275, -8.1699], [33, -8.17117], [94742, -8.172344], [41, -8.178415], [60475, -8.193659], [15397, -8.193866], [25079, -8.204951], [52654, -8.207276], [1275, -8.220017], [49430, -8.220135], [120675, -8.247404], [2403, -8.253561], [2879, -8.256371], [121249, -8.297782], [36209, -8.302476], [74493, -8.311227], [14541, -8.333779], [120022, -8.382903], [2466, -8.42341], [94105, -8.428617], [102925, -8.460971], [123653, -8.463599], [4222, -8.46577], [22664, -8.476578], [4225, -8.477345], [90, -8.492002], [45, -8.507882], [14696, -8.52665], [669, -8.531547], [41086, -8.535635], [3167, -8.544045], [9518, -8.564059], [47, -8.57326], [11292, -8.591712], [3660, -8.60427], [30591, -8.605086], [123302, -8.605556], [94, -8.614219], [44175, -8.627807], [21216, -8.647723], [120719, -8.672511]], "logprob_of_token": -0.215047, "top1_top2_margin": 3.797853, "top6_top7_margin": 0.11547}, {"gen_index": 29, "token": 116026, "top": [[116026, -0.209233], [34774, -3.946184], [14153, -4.918225], [125787, -5.482661], [127906, -5.632333], [83150, -5.863402], [34, -6.025612], [14179, -6.042259], [14620, -6.131755], [14188, -6.161694], [735, -6.343286], [32, -6.391172], [1921, -6.448824], [101051, -6.46075], [42, -6.497237], [949, -6.503363], [120625, -6.714063], [42046, -6.756217], [116908, -6.797956], [120007, -6.816042], [3786, -6.869045], [46, -6.955276], [121598, -7.023832], [44, -7.201402], [63530, -7.254443], [946, -7.265741], [32502, -7.269105], [941, -7.334671], [120293, -7.37439], [2125, -7.522725], [799, -7.546788], [5274, -7.561147], [16581, -7.581609], [622, -7.586084], [936, -7.587739], [120001, -7.606971], [82765, -7.636352], [502, -7.686385], [262, -7.704094], [123182, -7.728216], [3711, -7.729296], [14419, -7.776845], [123576, -7.844293], [286, -7.847787], [40301, -7.857904], [766, -7.88094], [39, -7.889297], [40320, -7.905282], [63, -7.943151], [4075, -8.006957], [122629, -8.01229], [3688, -8.01333], [120784, -8.021529], [15397, -8.073683], [33, -8.128039], [82275, -8.143211], [15774, -8.143642], [94742, -8.148161], [119647, -8.165924], [279, -8.170459], [25079, -8.176644], [120078, -8.186496], [92, -8.188109], [121249, -8.251332], [1275, -8.252299], [74493, -8.261236], [36209, -8.277729], [41, -8.28002], [60475, -8.325459], [1427, -8.326856], [123653, -8.338087], [2403, -8.378046], [120675, -8.378124], [52654, -8.379923], [49430, -8.388796], [94105, -8.419692], [14541, -8.421474], [45, -8.434509], [90, -8.442785], [41086, -8.485336], [30591, -8.500099], [22664, -8.502742], [2879, -8.507318], [94, -8.526344], [102925, -8.52687], [120022, -8.537647], [2466, -8.547291], [68037, -8.550478], [3167, -8.575935], [44175, -8.58525], [4225, -8.600662], [123302, -8.604527], [14696, -8.611044], [669, -8.625223], [34701, -8.628972], [310, -8.641309], [4222, -8.651224], [120410, -8.658325], [82618, -8.67099], [10, -8.674802]], "logprob_of_token": -0.209233, "top1_top2_margin": 3.736951, "top6_top7_margin": 0.16221}, {"gen_index": 30, "token": 116026, "top": [[116026, -0.187156], [34774, -3.99317], [14153, -5.19964], [125787, -5.754674], [127906, -5.818665], [83150, -5.9544], [14620, -6.026567], [34, -6.159082], [14179, -6.252769], [14188, -6.364125], [735, -6.470119], [101051, -6.48258], [42, -6.539076], [1921, -6.568319], [949, -6.574884], [32, -6.587629], [116908, -6.779234], [3786, -6.798497], [120625, -6.845716], [120007, -6.90814], [42046, -6.913494], [46, -7.105327], [121598, -7.184875], [946, -7.29793], [32502, -7.330115], [44, -7.378779], [63530, -7.409159], [120293, -7.435295], [936, -7.49854], [941, -7.513786], [502, -7.553862], [799, -7.557127], [82765, -7.58314], [2125, -7.663548], [622, -7.713136], [5274, -7.724329], [14419, -7.798676], [262, -7.79935], [120001, -7.808749], [123576, -7.828268], [40320, -7.869943], [3711, -7.879512], [766, -7.94391], [123182, -7.94889], [286, -7.951833], [16581, -8.046754], [40301, -8.048589], [63, -8.053365], [120784, -8.065665], [39, -8.07116], [122629, -8.073999], [4075, -8.094135], [82275, -8.148512], [3688, -8.166982], [120078, -8.214414], [15774, -8.235763], [33, -8.243347], [92, -8.249674], [15397, -8.250196], [52654, -8.278305], [279, -8.314118], [94742, -8.320529], [49430, -8.320678], [119647, -8.333474], [25079, -8.338155], [121249, -8.341331], [120675, -8.357841], [1427, -8.3693], [1275, -8.387332], [74493, -8.390803], [60475, -8.400666], [36209, -8.408366], [2403, -8.414498], [41, -8.419433], [123653, -8.421893], [41086, -8.430177], [90, -8.471249], [2879, -8.479853], [14696, -8.514588], [4222, -8.550591], [94105, -8.550895], [120719, -8.561778], [14541, -8.562526], [4225, -8.566558], [120022, -8.593347], [82618, -8.615157], [102925, -8.618531], [22664, -8.62356], [2466, -8.640987], [34701, -8.642348], [44175, -8.655731], [11292, -8.664721], [669, -8.667044], [30591, -8.68967], [3167, -8.705312], [123302, -8.720635], [45, -8.723842], [94, -8.738241], [21216, -8.752561], [48752, -8.780336]], "logprob_of_token": -0.187156, "top1_top2_margin": 3.806014, "top6_top7_margin": 0.072167}, {"gen_index": 31, "token": 116026, "top": [[116026, -0.182865], [34774, -3.86253], [14153, -5.145757], [125787, -5.867766], [127906, -5.885834], [83150, -5.951503], [14620, -6.126605], [34, -6.219643], [14179, -6.224977], [735, -6.348487], [14188, -6.389215], [101051, -6.537416], [42, -6.550063], [949, -6.563502], [32, -6.631808], [1921, -6.695467], [120625, -6.805576], [120007, -6.951443], [42046, -6.961561], [3786, -6.969682], [116908, -7.004289], [46, -7.140774], [121598, -7.247478], [32502, -7.297105], [44, -7.413329], [63530, -7.467435], [946, -7.520487], [120293, -7.571053], [82765, -7.610601], [941, -7.621169], [936, -7.660517], [799, -7.690207], [622, -7.771014], [2125, -7.839725], [40320, -7.861406], [3711, -7.862206], [123182, -7.868979], [14419, -7.874366], [5274, -7.889568], [120001, -7.890736], [262, -7.895867], [123576, -7.901206], [502, -7.902144], [16581, -7.95719], [63, -7.997372], [40301, -8.018544], [39, -8.030474], [766, -8.045682], [286, -8.059999], [122629, -8.128685], [82275, -8.141319], [33, -8.164374], [15397, -8.202469], [3688, -8.221816], [120078, -8.232098], [123653, -8.26498], [25079, -8.268061], [15774, -8.290626], [120784, -8.291073], [4075, -8.295046], [279, -8.330322], [2403, -8.335723], [74493, -8.345571], [121249, -8.34868], [94742, -8.359484], [41086, -8.363267], [52654, -8.386881], [92, -8.393394], [1275, -8.40297], [119647, -8.425249], [36209, -8.436419], [94105, -8.453125], [41, -8.456711], [120675, -8.46174], [1427, -8.471277], [49430, -8.478813], [60475, -8.482554], [90, -8.488512], [34701, -8.493957], [14696, -8.494568], [22664, -8.532507], [45, -8.555682], [82618, -8.564349], [4225, -8.586823], [44175, -8.60005], [94, -8.607642], [102925, -8.623966], [669, -8.643373], [2879, -8.674733], [30591, -8.694347], [4222, -8.696713], [120022, -8.697029], [3167, -8.703895], [123302, -8.705222], [21216, -8.727275], [14541, -8.731094], [2466, -8.735884], [120719, -8.746994], [310, -8.753103], [48752, -8.761324]], "logprob_of_token": -0.182865, "top1_top2_margin": 3.679665, "top6_top7_margin": 0.175102}]}, {"prompt": "der Mond scheint hell \u00fcber den Bergen", "input_ids": [339, 39046, 19373, 19573, 1489, 1178, 35423], "generated_ids": [948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423, 948, 35423], "rows": [{"gen_index": 0, "token": 948, "top": [[948, -1.65594], [420, -1.859744], [46, -1.955116], [1178, -2.045219], [44, -2.938481], [346, -3.292462], [275, -3.412409], [1829, -3.957183], [826, -4.750793], [831, -4.874519], [913, -5.082882], [622, -5.214382], [1489, -5.287446], [2625, -5.295294], [518, -5.49917], [1200, -5.518711], [35423, -5.58669], [2125, -5.935601], [513, -5.945812], [127906, -5.950424], [10304, -5.962291], [23819, -6.053146], [861, -6.057868], [58, -6.122584], [21938, -6.162566], [115, -6.24315], [5643, -6.276726], [14594, -6.279521], [262, -6.319017], [46252, -6.399632], [3504, -6.400877], [3643, -6.448873], [5274, -6.517865], [92, -6.554599], [1233, -6.558595], [8141, -6.598678], [59, -6.682604], [845, -6.72296], [466, -6.81501], [263, -6.815928], [11265, -6.828115], [2459, -6.844843], [493, -6.919385], [120007, -7.108161], [63, -7.195643], [294, -7.211545], [34, -7.238572], [2260, -7.29891], [286, -7.327006], [939, -7.38917], [526, -7.394493], [1687, -7.438732], [19573, -7.46465], [31496, -7.464776], [14188, -7.473892], [7314, -7.488957], [766, -7.50535], [1117, -7.537018], [614, -7.582353], [377, -7.664596], [2150, -7.666919], [44455, -7.725984], [4561, -7.729044], [1409, -7.773903], [16683, -7.788182], [3417, -7.797512], [15476, -7.798806], [1195, -7.800025], [7357, -7.822298], [7640, -7.837302], [45, -7.906219], [39, -7.916605], [1046, -7.973638], [14154, -8.028769], [14215, -8.033872], [266, -8.105201], [7815, -8.136633], [1953, -8.173905], [22863, -8.184803], [1241, -8.184843], [1047, -8.193429], [4351, -8.20012], [125259, -8.227242], [2361, -8.231826], [4550, -8.234878], [12975, -8.235361], [4610, -8.25509], [946, -8.269015], [1921, -8.27632], [11397, -8.279099], [61432, -8.302708], [1803, -8.30339], [7616, -8.339629], [836, -8.351975], [1917, -8.354033], [36, -8.379484], [2156, -8.38003], [1410, -8.39312], [2342, -8.396134], [279, -8.397001]], "logprob_of_token": -1.65594, "top1_top2_margin": 0.203804, "top6_top7_margin": 0.119946}, {"gen_index": 1, "token": 35423, "top": [[35423, -1.136905], [46252, -1.139087], [948, -2.175403], [7616, -4.654821], [11397, -4.682821], [29394, -5.244864], [43492, -5.873023], [1178, -5.969798], [34654, -6.005474], [420, -6.025621], [22211, -6.402571], [55950, -6.524991], [66396, -6.761616], [2297, -6.771942], [3389, -6.935366], [346, -7.004312], [9702, -7.038393], [49541, -7.065762], [47607, -7.114076], [826, -7.139492], [103140, -7.152207], [52657, -7.152678], [34991, -7.20823], [26884, -7.248607], [21771, -7.292271], [66863, -7.345891], [80325, -7.453481], [48716, -7.456789], [127906, -7.464399], [28528, -7.478939], [38748, -7.492741], [46644, -7.506542], [6933, -7.526272], [43869, -7.553418], [12895, -7.562504], [28320, -7.592627], [1829, -7.638917], [53753, -7.643176], [21085, -7.652057], [11282, -7.664376], [8342, -7.674467], [19866, -7.695437], [36270, -7.728187], [5274, -7.74343], [46, -7.765998], [66360, -7.772136], [622, -7.794486], [24656, -7.850356], [15002, -7.850443], [78542, -7.854913], [845, -7.866642], [922, -7.914185], [60216, -7.9344], [8086, -7.93995], [100136, -7.95266], [339, -7.954942], [32533, -7.96725], [27300, -7.988195], [39229, -7.988412], [79493, -8.00399], [35009, -8.013159], [44, -8.016708], [840, -8.023356], [39077, -8.028454], [34560, -8.043055], [34748, -8.044768], [3395, -8.05859], [49848, -8.066907], [12163, -8.073489], [121167, -8.134031], [40202, -8.13698], [35091, -8.153726], [17485, -8.157074], [11789, -8.159834], [71890, -8.166971], [60147, -8.172666], [52553, -8.173855], [26451, -8.180286], [108251, -8.218671], [19089, -8.227318], [61827, -8.237209], [3417, -8.242928], [831, -8.250157], [33740, -8.256598], [58665, -8.258089], [51527, -8.267679], [8795, -8.274423], [43532, -8.276138], [108392, -8.296371], [1151, -8.317116], [5513, -8.318718], [33072, -8.320726], [32, -8.330267], [87462, -8.354807], [55998, -8.356791], [86354, -8.356894], [30778, -8.358923], [70201, -8.361137], [518, -8.36348], [262, -8.368948]], "logprob_of_token": -1.136905, "top1_top2_margin": 0.002182, "top6_top7_margin": 0.62816}, {"gen_index": 2, "token": 948, "top": [[948, -0.017007], [831, -6.676363], [420, -6.695712], [346, -6.804394], [35423, -6.905784], [339, -7.051366], [279, -7.105613], [46, -7.193281], [1178, -7.265254], [518, -8.161531], [44, -8.557957], [262, -8.767467], [826, -8.832377], [1829, -8.864812], [845, -8.996182], [127906, -9.295753], [275, -9.32693], [2459, -9.462752], [2297, -9.519208], [1200, -9.555494], [493, -9.676376], [115, -9.678226], [922, -9.845046], [622, -9.967896], [58, -9.988896], [7616, -10.021588], [1151, -10.102294], [913, -10.116126], [4733, -10.127441], [3504, -10.156885], [14154, -10.165103], [5274, -10.184172], [1409, -10.205832], [43492, -10.258601], [122693, -10.316993], [11397, -10.321041], [34, -10.340228], [2625, -10.388453], [589, -10.418489], [939, -10.502195], [46252, -10.511056], [8590, -10.542594], [6808, -10.554509], [286, -10.595484], [576, -10.630061], [120007, -10.637574], [56434, -10.638627], [63, -10.642997], [3643, -10.679624], [52387, -10.686302], [122883, -10.69418], [735, -10.719853], [1117, -10.761003], [266, -10.831192], [263, -10.847028], [466, -10.874083], [6443, -10.879457], [946, -10.895194], [314, -10.895581], [14168, -10.896192], [1195, -10.915874], [1921, -10.927864], [14188, -10.950624], [1469, -10.958672], [2260, -10.967856], [526, -10.99312], [32, -10.997632], [1450, -11.027862], [4561, -11.095591], [861, -11.113217], [4290, -11.170676], [294, -11.196009], [268, -11.22949], [66863, -11.232743], [9122, -11.238824], [766, -11.244797], [10, -11.247611], [47, -11.25034], [39077, -11.258677], [1233, -11.290013], [1687, -11.293313], [465, -11.295585], [59, -11.303914], [614, -11.334027], [3750, -11.339334], [1410, -11.347575], [5590, -11.34758], [278, -11.361251], [3417, -11.361789], [103140, -11.365131], [2120, -11.405079], [121167, -11.460969], [120015, -11.473393], [7314, -11.477896], [1047, -11.484336], [1489, -11.492911], [836, -11.493911], [679, -11.519238], [11158, -11.5209], [2125, -11.52151]], "logprob_of_token": -0.017007, "top1_top2_margin": 6.659357, "top6_top7_margin": 0.054247}, {"gen_index": 3, "token": 35423, "top": [[35423, -0.062435], [46252, -5.45203], [43492, -6.272994], [36270, -6.524741], [66863, -6.703104], [7616, -7.178102], [11397, -7.229268], [16754, -7.610052], [948, -7.86172], [1178, -7.886569], [420, -8.018817], [103140, -8.057749], [66396, -8.221669], [91252, -8.241833], [55950, -8.35489], [82856, -8.501991], [97543, -8.553028], [52918, -8.559061], [121167, -8.708572], [32533, -8.78462], [108392, -8.922232], [5274, -8.985349], [49848, -8.997986], [46, -9.070192], [96379, -9.070284], [25751, -9.087881], [119878, -9.087934], [127906, -9.14531], [52553, -9.194598], [60216, -9.225117], [346, -9.232725], [12559, -9.257879], [52217, -9.275084], [39077, -9.280115], [1537, -9.285167], [44, -9.305458], [55998, -9.318588], [114885, -9.319674], [826, -9.334906], [845, -9.361107], [26884, -9.364563], [125313, -9.392133], [60147, -9.41205], [51935, -9.485046], [29394, -9.527051], [120007, -9.532435], [7510, -9.535884], [21771, -9.542933], [4118, -9.580013], [34025, -9.622218], [286, -9.644537], [25205, -9.653306], [922, -9.658482], [19963, -9.673924], [96186, -9.696898], [32, -9.795622], [34991, -9.805524], [622, -9.807011], [97925, -9.818212], [24468, -9.847687], [74299, -9.853338], [1097, -9.856503], [88938, -9.88307], [16727, -9.883486], [1450, -9.883568], [117126, -9.883602], [24999, -9.898083], [109992, -9.907038], [107755, -9.911993], [42196, -9.927589], [23638, -9.945813], [74683, -9.952232], [48716, -9.955019], [66473, -9.962008], [48137, -9.968961], [35815, -9.970825], [104251, -9.979384], [77892, -9.98107], [116312, -9.985641], [4479, -9.992496], [1829, -10.000202], [735, -10.011083], [946, -10.021235], [78542, -10.028123], [105405, -10.058922], [406, -10.059386], [101938, -10.082756], [110404, -10.082915], [7640, -10.083421], [30778, -10.096962], [42454, -10.101667], [49541, -10.108878], [2459, -10.109953], [101757, -10.144297], [53753, -10.148985], [34, -10.157566], [44830, -10.173963], [9702, -10.176605], [55442, -10.187571], [25065, -10.187964]], "logprob_of_token": -0.062435, "top1_top2_margin": 5.389595, "top6_top7_margin": 0.051166}, {"gen_index": 4, "token": 948, "top": [[948, -0.007947], [346, -6.468032], [279, -7.585879], [420, -7.607677], [831, -7.634878], [262, -7.917514], [339, -8.078179], [2459, -8.254696], [518, -8.355668], [1178, -8.589068], [44, -9.001321], [735, -9.097533], [46, -9.305812], [127906, -9.363564], [922, -9.540053], [1921, -9.606494], [2297, -9.645387], [6443, -9.667921], [35423, -9.928052], [5274, -9.935399], [286, -9.976232], [32, -10.023435], [34, -10.173508], [845, -10.23706], [946, -10.309077], [939, -10.34288], [2125, -10.3658], [622, -10.436725], [120007, -10.525261], [493, -10.530647], [7467, -10.653117], [1409, -10.690351], [826, -10.711097], [14168, -10.764664], [576, -10.779468], [1829, -10.797363], [9122, -10.810698], [58, -10.816449], [14154, -10.945186], [7510, -11.074561], [275, -11.085822], [327, -11.137469], [968, -11.138988], [10664, -11.153147], [378, -11.15445], [95, -11.167548], [913, -11.187846], [3504, -11.194491], [589, -11.209263], [1469, -11.22097], [56434, -11.226207], [3417, -11.301741], [669, -11.31807], [8590, -11.340305], [2225, -11.425112], [1195, -11.428752], [941, -11.437346], [42, -11.445474], [766, -11.463488], [63, -11.47594], [120022, -11.509881], [614, -11.546084], [2260, -11.608295], [14188, -11.613429], [2625, -11.614736], [527, -11.6232], [836, -11.643954], [263, -11.682293], [716, -11.691409], [2120, -11.703925], [907, -11.710777], [353, -11.720366], [294, -11.727431], [10, -11.729483], [888, -11.743587], [739, -11.750608], [679, -11.767445], [43492, -11.825436], [39, -11.837623], [1151, -11.852679], [3643, -11.858771], [1765, -11.861837], [861, -11.872085], [39077, -11.890323], [4733, -11.895424], [1117, -11.91595], [10304, -11.917887], [965, -11.927046], [7616, -11.928768], [46252, -11.939335], [4561, -11.941989], [115, -11.943801], [379, -11.946612], [11265, -11.973956], [1200, -11.999998], [47, -12.028703], [1410, -12.033187], [919, -12.041905], [1047, -12.08402], [465, -12.118423]], "logprob_of_token": -0.007947, "top1_top2_margin": 6.460086, "top6_top7_margin": 0.160665}, {"gen_index": 5, "token": 35423, "top": [[35423, -0.04126], [46252, -5.153008], [43492, -6.464613], [66863, -6.976958], [36270, -7.029515], [7616, -7.257824], [11397, -7.367272], [420, -7.950217], [103140, -8.116261], [66396, -8.363324], [948, -8.410472], [16754, -8.425591], [91252, -8.550142], [55950, -8.630129], [5274, -8.901583], [82856, -8.903896], [1178, -8.905289], [48716, -8.950304], [29394, -9.169559], [97543, -9.408874], [96379, -9.423809], [12559, -9.431143], [32, -9.452203], [52217, -9.469418], [119878, -9.517702], [25751, -9.527275], [46, -9.559844], [121167, -9.573968], [44, -9.574028], [7510, -9.606842], [127906, -9.627791], [32533, -9.651975], [52918, -9.680096], [34025, -9.698608], [49848, -9.702337], [120007, -9.731013], [1829, -9.791102], [845, -9.808119], [88938, -9.829016], [346, -9.831271], [96186, -9.842422], [108392, -9.864267], [286, -9.870171], [52553, -9.906167], [4118, -9.919863], [25205, -9.944343], [26884, -9.944773], [71890, -9.958557], [49541, -9.968587], [60147, -9.969685], [114885, -9.996106], [922, -10.030738], [826, -10.059599], [34991, -10.060255], [60216, -10.06942], [406, -10.072696], [24468, -10.228367], [126141, -10.239412], [946, -10.254732], [107755, -10.267403], [55998, -10.271366], [74299, -10.277174], [97925, -10.278684], [39077, -10.289059], [125313, -10.307131], [118702, -10.32023], [117126, -10.321201], [104251, -10.344004], [108251, -10.360523], [116312, -10.386428], [24656, -10.405525], [19963, -10.412975], [109992, -10.413889], [735, -10.419586], [1097, -10.420649], [70201, -10.46195], [3417, -10.464334], [1921, -10.465137], [836, -10.474429], [90754, -10.483242], [17485, -10.499609], [101757, -10.506187], [49, -10.506935], [21771, -10.520136], [263, -10.524879], [16727, -10.525574], [92431, -10.53413], [2459, -10.542893], [78542, -10.546873], [90068, -10.550547], [69814, -10.564339], [28320, -10.577174], [51935, -10.598552], [110160, -10.613211], [76649, -10.615286], [36500, -10.623485], [53753, -10.625324], [766, -10.628798], [110404, -10.636343], [30778, -10.642647]], "logprob_of_token": -0.04126, "top1_top2_margin": 5.111748, "top6_top7_margin": 0.109448}, {"gen_index": 6, "token": 948, "top": [[948, -0.010813], [346, -5.766737], [279, -6.896678], [420, -7.242452], [262, -7.299593], [831, -7.319973], [339, -8.095181], [518, -8.153142], [2459, -8.286221], [735, -8.554355], [1178, -8.884897], [44, -8.93026], [46, -9.38011], [845, -9.466847], [1921, -9.530132], [127906, -9.56816], [35423, -9.594393], [6443, -9.943508], [32, -9.99602], [5274, -10.081312], [286, -10.202471], [922, -10.216033], [493, -10.238941], [2297, -10.244448], [946, -10.281747], [34, -10.377619], [58, -10.384641], [576, -10.411436], [2125, -10.527984], [826, -10.578585], [14168, -10.674126], [589, -10.683962], [1829, -10.70019], [622, -10.769964], [9122, -10.77928], [378, -10.80622], [3504, -10.821793], [115, -10.861065], [968, -10.889335], [1409, -10.901464], [2225, -10.909998], [4733, -10.982248], [14154, -10.99878], [913, -11.007403], [95, -11.032906], [1469, -11.163755], [7510, -11.165854], [120007, -11.175108], [275, -11.197761], [42, -11.235368], [10, -11.266102], [10664, -11.274009], [3417, -11.282099], [941, -11.28824], [7467, -11.303883], [263, -11.408789], [939, -11.41985], [14188, -11.438967], [2260, -11.45737], [63, -11.46575], [327, -11.46971], [527, -11.494077], [766, -11.508285], [836, -11.50879], [3643, -11.544125], [888, -11.553898], [543, -11.55699], [2120, -11.568469], [919, -11.568951], [353, -11.581885], [669, -11.598802], [1765, -11.601072], [4561, -11.631937], [43492, -11.659224], [614, -11.669214], [8590, -11.669857], [39, -11.679327], [3340, -11.700298], [1117, -11.70781], [120022, -11.726616], [4840, -11.780524], [47, -11.791591], [2625, -11.79407], [679, -11.807428], [716, -11.85408], [1047, -11.854502], [294, -11.858295], [7616, -11.875862], [465, -11.89622], [56434, -11.929545], [1195, -11.934911], [739, -11.953934], [14153, -11.95724], [10304, -11.963881], [1151, -11.97462], [122693, -11.979992], [14825, -12.013995], [1410, -12.016785], [1200, -12.033323], [861, -12.034549]], "logprob_of_token": -0.010813, "top1_top2_margin": 5.755924, "top6_top7_margin": 0.775208}, {"gen_index": 7, "token": 35423, "top": [[35423, -0.089295], [46252, -5.059877], [36270, -5.946158], [43492, -6.215271], [66863, -6.342783], [11397, -7.007117], [7616, -7.078213], [103140, -7.638999], [948, -7.666663], [66396, -7.701189], [16754, -7.707895], [55950, -7.737543], [1178, -8.175294], [82856, -8.196703], [420, -8.262736], [91252, -8.419953], [48716, -8.497018], [29394, -8.555869], [5274, -8.728423], [32533, -8.822743], [12559, -8.872384], [52217, -8.876595], [60216, -8.887889], [52553, -8.89457], [121167, -8.906949], [125313, -8.915132], [60147, -8.974059], [97543, -8.985385], [119878, -9.017054], [52918, -9.044401], [25751, -9.066206], [32, -9.073694], [96379, -9.083773], [108392, -9.091093], [88938, -9.104447], [46, -9.199542], [4118, -9.204268], [826, -9.218665], [127906, -9.224429], [104251, -9.240352], [346, -9.279635], [17485, -9.337466], [49848, -9.345627], [34025, -9.351493], [96186, -9.354653], [118702, -9.380838], [114885, -9.4002], [24468, -9.41114], [44, -9.442149], [55998, -9.454991], [26884, -9.466532], [70201, -9.47225], [78542, -9.477817], [71890, -9.483877], [7510, -9.486624], [946, -9.487072], [76649, -9.490634], [49541, -9.505844], [97925, -9.527223], [39077, -9.530408], [116312, -9.533051], [21771, -9.568997], [25205, -9.58739], [1537, -9.589789], [126141, -9.62876], [845, -9.629416], [74299, -9.629624], [97049, -9.644298], [51935, -9.648067], [101757, -9.669158], [34991, -9.671416], [16727, -9.672035], [52663, -9.690182], [53753, -9.691093], [92431, -9.704782], [30778, -9.713971], [1829, -9.725419], [12131, -9.729157], [4479, -9.729371], [66473, -9.731688], [28320, -9.764064], [82128, -9.765879], [3417, -9.766078], [24656, -9.773476], [117126, -9.782287], [107755, -9.797935], [58949, -9.863252], [74683, -9.873956], [110404, -9.879168], [69814, -9.883868], [52297, -9.894595], [34654, -9.900809], [100136, -9.929682], [36500, -9.930634], [95061, -9.931645], [72865, -9.965882], [109992, -9.970557], [67028, -9.975112], [94281, -9.984048], [101106, -9.987088]], "logprob_of_token": -0.089295, "top1_top2_margin": 4.970582, "top6_top7_margin": 0.071096}, {"gen_index": 8, "token": 948, "top": [[948, -0.010106], [279, -6.020691], [346, -6.443161], [831, -6.671188], [262, -7.58426], [339, -8.011243], [420, -8.317416], [518, -8.330314], [2459, -8.372693], [735, -8.550394], [1178, -8.710942], [44, -8.95435], [46, -9.650659], [1921, -9.658198], [493, -9.704171], [127906, -9.843222], [35423, -9.882871], [2297, -10.073314], [6443, -10.132655], [845, -10.202764], [286, -10.243862], [58, -10.386336], [922, -10.482327], [5274, -10.546699], [2125, -10.581248], [32, -10.585559], [622, -10.618526], [576, -10.637654], [826, -10.650409], [946, -10.66223], [378, -10.712088], [34, -10.76214], [14168, -10.857615], [9122, -10.924317], [115, -10.94128], [589, -11.007747], [968, -11.016365], [527, -11.051464], [4733, -11.145574], [95, -11.181367], [7467, -11.218225], [1409, -11.243927], [669, -11.295903], [10664, -11.317971], [10, -11.326121], [919, -11.365432], [939, -11.415536], [1200, -11.428603], [7510, -11.464426], [3417, -11.498239], [941, -11.500022], [1829, -11.515326], [4561, -11.522904], [275, -11.533551], [716, -11.544547], [3504, -11.545213], [913, -11.551015], [14154, -11.584931], [63, -11.603942], [8590, -11.624614], [42, -11.645284], [467, -11.65215], [1151, -11.667353], [56434, -11.705801], [1765, -11.715395], [327, -11.755909], [122883, -11.756319], [2225, -11.768689], [10304, -11.832319], [353, -11.851058], [14188, -11.882668], [2625, -11.882699], [836, -11.905654], [1469, -11.90917], [120007, -11.926648], [3643, -11.942598], [39077, -11.943522], [907, -11.944499], [1195, -11.959654], [465, -11.961737], [4840, -11.967764], [278, -11.98048], [122693, -11.989669], [614, -11.996175], [543, -11.997928], [263, -11.998373], [46252, -12.004888], [43492, -12.008147], [739, -12.016891], [2260, -12.021092], [120022, -12.022668], [766, -12.041251], [888, -12.041548], [679, -12.061334], [1826, -12.082131], [314, -12.117908], [39, -12.124118], [379, -12.134409], [1275, -12.142091], [568, -12.164512]], "logprob_of_token": -0.010106, "top1_top2_margin": 6.010585, "top6_top7_margin": 0.306173}, {"gen_index": 9, "token": 35423, "top": [[35423, -0.058269], [46252, -5.274625], [36270, -6.312867], [43492, -6.79656], [66863, -6.918274], [7616, -7.347601], [11397, -7.519506], [66396, -7.867814], [948, -7.943836], [55950, -8.006306], [103140, -8.139022], [16754, -8.225823], [1178, -8.254675], [420, -8.370694], [5274, -8.643643], [48716, -8.699914], [29394, -8.788877], [96379, -8.864033], [60216, -8.958586], [32533, -8.969121], [82856, -9.013383], [12559, -9.031651], [32, -9.077428], [52553, -9.091993], [91252, -9.112374], [52217, -9.192924], [108392, -9.266621], [46, -9.325463], [4118, -9.343143], [127906, -9.361676], [826, -9.393736], [121167, -9.395539], [26884, -9.401531], [49848, -9.412082], [119878, -9.424026], [104251, -9.425491], [52918, -9.448968], [49541, -9.509327], [346, -9.518184], [34991, -9.542434], [60147, -9.56898], [97543, -9.569991], [96186, -9.596659], [845, -9.598115], [44, -9.609664], [125313, -9.622026], [25751, -9.628398], [25205, -9.631968], [71890, -9.64944], [7510, -9.690269], [34025, -9.756271], [88938, -9.768824], [114885, -9.769502], [74299, -9.7698], [78542, -9.773542], [946, -9.782409], [24468, -9.784165], [922, -9.792813], [17485, -9.824314], [76649, -9.832178], [101757, -9.83239], [1537, -9.861655], [39077, -9.861974], [1097, -9.862813], [95061, -9.869232], [34654, -9.918578], [1829, -9.923241], [70201, -9.923651], [24656, -9.930033], [118702, -9.96948], [126141, -9.972892], [12131, -10.003295], [52663, -10.026538], [30778, -10.028294], [51935, -10.065088], [116312, -10.065312], [21771, -10.085177], [3417, -10.091044], [74683, -10.100826], [92431, -10.110948], [55998, -10.116474], [9702, -10.129423], [61184, -10.153788], [97049, -10.17426], [101106, -10.176675], [107755, -10.183795], [46667, -10.185014], [77651, -10.190794], [55442, -10.199365], [28320, -10.207824], [36500, -10.236956], [51527, -10.240969], [286, -10.241071], [10, -10.243544], [77623, -10.250962], [120007, -10.265561], [20283, -10.279712], [35009, -10.295123], [82128, -10.306561], [106822, -10.311465]], "logprob_of_token": -0.058269, "top1_top2_margin": 5.216357, "top6_top7_margin": 0.171905}, {"gen_index": 10, "token": 948, "top": [[948, -0.012289], [279, -5.75437], [346, -6.219283], [831, -6.725702], [262, -7.304384], [420, -7.87043], [518, -8.258957], [339, -8.315458], [2459, -8.383263], [1178, -8.619398], [735, -8.653182], [44, -8.770093], [1921, -8.771336], [46, -9.366659], [35423, -9.502765], [127906, -9.605448], [286, -9.652411], [493, -9.744934], [845, -9.828894], [5274, -9.840364], [6443, -9.847836], [2125, -9.896935], [2297, -10.053171], [922, -10.093822], [32, -10.12502], [58, -10.170651], [622, -10.186106], [576, -10.323793], [946, -10.333134], [34, -10.497192], [826, -10.522872], [378, -10.593273], [95, -10.665305], [10, -10.670016], [1409, -10.687358], [9122, -10.715023], [527, -10.734041], [14168, -10.773464], [1200, -10.88409], [669, -10.904696], [115, -11.06682], [3417, -11.080816], [1829, -11.091695], [10664, -11.094433], [968, -11.101987], [939, -11.11158], [941, -11.147147], [3504, -11.184798], [589, -11.209276], [7510, -11.20952], [913, -11.218929], [42, -11.220578], [4733, -11.247309], [467, -11.280293], [14154, -11.314589], [919, -11.342192], [14188, -11.356192], [275, -11.35688], [716, -11.364559], [120022, -11.392783], [353, -11.42603], [1151, -11.463493], [7467, -11.483373], [4561, -11.494199], [1765, -11.533613], [568, -11.548452], [1195, -11.549643], [39077, -11.559905], [4840, -11.561575], [10304, -11.562666], [14825, -11.573044], [63, -11.581493], [327, -11.585663], [3643, -11.60112], [263, -11.611083], [46252, -11.618634], [120007, -11.625284], [799, -11.684983], [314, -11.68507], [614, -11.700815], [836, -11.70417], [2225, -11.71037], [465, -11.721369], [1275, -11.731376], [1469, -11.753444], [543, -11.770294], [766, -11.773376], [739, -11.778214], [278, -11.820883], [122883, -11.827768], [379, -11.836515], [8590, -11.840624], [122693, -11.840851], [294, -11.875125], [888, -11.875634], [2120, -11.87612], [43492, -11.876705], [907, -11.877995], [2625, -11.893078], [14153, -11.909563]], "logprob_of_token": -0.012289, "top1_top2_margin": 5.742082, "top6_top7_margin": 0.388526}, {"gen_index": 11, "token": 35423, "top": [[35423, -0.053151], [46252, -5.485057], [36270, -6.456213], [66863, -7.013963], [43492, -7.12018], [7616, -7.234499], [11397, -7.85486], [420, -7.903615], [66396, -7.94774], [55950, -8.080044], [16754, -8.156383], [103140, -8.264574], [948, -8.318745], [48716, -8.329107], [5274, -8.378014], [1178, -8.420612], [32, -8.69224], [32533, -8.88975], [34991, -8.948301], [96379, -8.963722], [49541, -9.048262], [60216, -9.11289], [46, -9.114239], [49848, -9.141968], [127906, -9.16916], [52553, -9.195921], [29394, -9.21862], [12559, -9.249866], [7510, -9.341749], [108392, -9.343473], [26884, -9.361869], [82856, -9.417027], [52918, -9.441019], [286, -9.476102], [104251, -9.52422], [1537, -9.530725], [4118, -9.540445], [826, -9.568899], [946, -9.579002], [44, -9.584338], [52217, -9.613028], [96186, -9.632326], [10, -9.671364], [74299, -9.674201], [91252, -9.718166], [845, -9.725423], [25205, -9.752048], [101757, -9.755891], [922, -9.763485], [25751, -9.776288], [34654, -9.784867], [1921, -9.795221], [24656, -9.802019], [121167, -9.818794], [1829, -9.828403], [1097, -9.863054], [97543, -9.869925], [71890, -9.877028], [78542, -9.895988], [406, -9.91316], [346, -9.918449], [39077, -9.927635], [17485, -9.936855], [95061, -9.964898], [119878, -9.973903], [125313, -9.974878], [24468, -10.001124], [34025, -10.011967], [60147, -10.019032], [61184, -10.027666], [28320, -10.047073], [12131, -10.070246], [88938, -10.090163], [9702, -10.091362], [77623, -10.103565], [70201, -10.111527], [52663, -10.123371], [120007, -10.133632], [28097, -10.13737], [3417, -10.138511], [13229, -10.153894], [263, -10.154675], [25065, -10.168658], [75452, -10.17933], [34, -10.191443], [114885, -10.199627], [30778, -10.213024], [101106, -10.226621], [735, -10.255831], [21085, -10.256012], [92431, -10.262306], [49, -10.270648], [126141, -10.274513], [46667, -10.277748], [116312, -10.285013], [58949, -10.290546], [2125, -10.29289], [36500, -10.301803], [55998, -10.303543], [86195, -10.31649]], "logprob_of_token": -0.053151, "top1_top2_margin": 5.431907, "top6_top7_margin": 0.620361}, {"gen_index": 12, "token": 948, "top": [[948, -0.018658], [279, -5.125301], [346, -5.959042], [262, -6.351574], [831, -6.720358], [420, -7.331496], [1921, -7.783193], [518, -8.152273], [339, -8.286994], [1178, -8.341443], [735, -8.501345], [2459, -8.731423], [286, -8.816374], [44, -8.916018], [127906, -9.064602], [5274, -9.326125], [2125, -9.34602], [46, -9.495261], [845, -9.650211], [946, -9.752472], [922, -9.7531], [2297, -9.829105], [576, -9.840399], [493, -9.855103], [622, -9.891853], [6443, -9.955696], [32, -9.965141], [35423, -9.997101], [58, -10.102277], [95, -10.162462], [34, -10.185995], [1409, -10.228522], [10, -10.250861], [378, -10.292522], [941, -10.319131], [826, -10.343954], [527, -10.477694], [589, -10.516986], [9122, -10.597274], [115, -10.684714], [42, -10.700983], [3504, -10.72364], [14168, -10.734803], [3417, -10.817156], [467, -10.877354], [1829, -10.877628], [939, -10.900723], [669, -10.908316], [4733, -10.95781], [968, -10.978183], [1200, -10.986497], [919, -11.006398], [543, -11.033933], [739, -11.04195], [1765, -11.050126], [799, -11.052874], [716, -11.062504], [913, -11.069486], [14825, -11.069991], [327, -11.077594], [10664, -11.081505], [4840, -11.098101], [1151, -11.108279], [14154, -11.11209], [14188, -11.124673], [1195, -11.129932], [353, -11.135921], [568, -11.154947], [2362, -11.176647], [7467, -11.205941], [278, -11.273174], [275, -11.274303], [263, -11.283397], [39, -11.29808], [3643, -11.354638], [39077, -11.359096], [2225, -11.370728], [1275, -11.403242], [7510, -11.40414], [56434, -11.422792], [122693, -11.461006], [766, -11.470731], [4561, -11.503835], [120022, -11.510376], [294, -11.51137], [2120, -11.527246], [1469, -11.531019], [314, -11.550524], [836, -11.55682], [122883, -11.55759], [379, -11.560968], [8590, -11.585327], [1410, -11.596392], [92, -11.625608], [63, -11.633055], [1117, -11.668474], [614, -11.673064], [2625, -11.675253], [861, -11.682938], [936, -11.691124]], "logprob_of_token": -0.018658, "top1_top2_margin": 5.106644, "top6_top7_margin": 0.451696}, {"gen_index": 13, "token": 35423, "top": [[35423, -0.090496], [46252, -4.676392], [36270, -6.070704], [66863, -6.232024], [7616, -6.666371], [420, -6.770772], [43492, -6.842713], [11397, -7.415016], [948, -7.522968], [5274, -7.595144], [66396, -7.665767], [1178, -7.778488], [16754, -7.868306], [34991, -7.945523], [103140, -8.052782], [49541, -8.072098], [55950, -8.12484], [48716, -8.197368], [32, -8.312769], [46, -8.461538], [286, -8.551405], [127906, -8.566494], [82856, -8.612364], [946, -8.772433], [10, -8.792714], [826, -8.865664], [44, -8.883381], [49848, -8.940685], [32533, -8.988699], [26884, -9.015761], [1829, -9.020304], [346, -9.065926], [25751, -9.066378], [1921, -9.072368], [29394, -9.07761], [91252, -9.207043], [121167, -9.214072], [1537, -9.240682], [922, -9.249999], [60216, -9.25482], [125313, -9.256069], [39077, -9.25869], [96379, -9.268669], [97543, -9.291681], [7510, -9.300674], [52918, -9.302565], [12559, -9.325836], [52553, -9.334607], [845, -9.391027], [34, -9.434134], [58949, -9.443068], [3417, -9.458113], [1097, -9.519168], [262, -9.527003], [24468, -9.527569], [74299, -9.537215], [263, -9.564174], [836, -9.576691], [101757, -9.584185], [108392, -9.603405], [60147, -9.632645], [55998, -9.639974], [9702, -9.642746], [24656, -9.646706], [4118, -9.657038], [406, -9.685217], [49, -9.691871], [52217, -9.698324], [353, -9.710821], [766, -9.715408], [622, -9.715422], [735, -9.757257], [70201, -9.768603], [100136, -9.794857], [28320, -9.799749], [88938, -9.804877], [115205, -9.812125], [25205, -9.812871], [17485, -9.812905], [2125, -9.81596], [119878, -9.834793], [104251, -9.883355], [34025, -9.885329], [71890, -9.887029], [28097, -9.889151], [941, -9.894345], [114885, -9.903289], [294, -9.91845], [53753, -9.92412], [34654, -9.924704], [126141, -9.926111], [21085, -9.932535], [72865, -9.933831], [13229, -9.936291], [86195, -9.938468], [76649, -9.949352], [52663, -9.959879], [25065, -9.978712], [78542, -9.987737], [51935, -9.995948]], "logprob_of_token": -0.090496, "top1_top2_margin": 4.585896, "top6_top7_margin": 0.071942}, {"gen_index": 14, "token": 948, "top": [[948, -0.022052], [279, -5.026405], [346, -5.678197], [262, -6.21919], [831, -6.710714], [420, -7.32426], [1921, -7.506644], [1178, -7.824664], [518, -7.91552], [339, -8.156553], [286, -8.61209], [735, -8.67645], [44, -8.864944], [5274, -9.006598], [127906, -9.012994], [2459, -9.166381], [2125, -9.177706], [35423, -9.183545], [845, -9.41529], [946, -9.435298], [46, -9.476052], [493, -9.522989], [922, -9.576274], [2297, -9.634946], [622, -9.646947], [32, -9.71115], [576, -9.754189], [826, -9.950871], [58, -9.952417], [6443, -9.979434], [941, -10.102788], [95, -10.129583], [1409, -10.138627], [34, -10.170039], [10, -10.22551], [9122, -10.254503], [378, -10.256346], [42, -10.339742], [527, -10.390122], [467, -10.479083], [10664, -10.5286], [589, -10.556871], [3417, -10.566911], [115, -10.61053], [543, -10.649938], [1829, -10.664071], [14168, -10.72288], [2362, -10.739909], [14825, -10.749045], [3504, -10.75524], [4840, -10.776366], [913, -10.786649], [14188, -10.803782], [4733, -10.836886], [669, -10.845836], [1151, -10.902932], [716, -10.904603], [353, -10.947705], [1195, -11.000692], [739, -11.013317], [14154, -11.023549], [919, -11.030538], [7467, -11.032492], [1765, -11.063141], [568, -11.067893], [799, -11.076434], [1200, -11.094876], [939, -11.098825], [263, -11.102589], [968, -11.102697], [766, -11.109017], [39, -11.119582], [3643, -11.126317], [4561, -11.15579], [39077, -11.16326], [327, -11.166831], [1275, -11.177835], [7510, -11.194424], [836, -11.212057], [275, -11.242597], [278, -11.264675], [2225, -11.282306], [1047, -11.321316], [120022, -11.325822], [379, -11.341739], [294, -11.352858], [3340, -11.359278], [1469, -11.41056], [92, -11.414553], [122693, -11.420793], [614, -11.424525], [14139, -11.447228], [56434, -11.451503], [122883, -11.452538], [861, -11.454339], [10304, -11.467222], [1117, -11.473855], [2625, -11.510436], [2120, -11.522492], [2260, -11.537108]], "logprob_of_token": -0.022052, "top1_top2_margin": 5.004353, "top6_top7_margin": 0.182384}, {"gen_index": 15, "token": 35423, "top": [[35423, -0.087031], [46252, -4.96768], [66863, -6.203496], [36270, -6.277391], [420, -6.49001], [7616, -6.642731], [43492, -6.94203], [11397, -7.362784], [948, -7.478059], [5274, -7.661315], [66396, -7.751429], [55950, -8.003934], [48716, -8.047254], [1178, -8.133566], [16754, -8.254128], [103140, -8.256171], [32533, -8.380555], [32, -8.449365], [46, -8.461924], [286, -8.659391], [29394, -8.670959], [82856, -8.730249], [49541, -8.800075], [96379, -8.813523], [1829, -8.837915], [826, -8.854253], [34991, -8.868352], [12559, -8.875001], [346, -8.879989], [127906, -8.914193], [26884, -8.914731], [946, -8.921969], [60216, -8.933581], [52553, -8.977189], [25751, -8.982003], [49848, -9.004697], [44, -9.027826], [4118, -9.05105], [922, -9.099019], [121167, -9.149854], [91252, -9.180512], [52918, -9.199737], [52217, -9.203291], [3417, -9.221041], [10, -9.22752], [108392, -9.232555], [845, -9.240578], [7510, -9.245385], [25205, -9.248005], [104251, -9.306883], [74299, -9.336898], [1921, -9.349166], [1537, -9.352498], [119878, -9.380911], [17485, -9.395459], [1097, -9.456076], [96186, -9.456238], [97543, -9.460547], [9702, -9.462987], [24656, -9.48365], [34, -9.490454], [55998, -9.520861], [34025, -9.530216], [71890, -9.559158], [622, -9.60529], [49, -9.610945], [60147, -9.619476], [97049, -9.622956], [88938, -9.645764], [39077, -9.648724], [101757, -9.661889], [836, -9.675433], [28097, -9.685927], [76649, -9.720732], [70201, -9.739944], [52663, -9.742878], [34654, -9.748166], [78542, -9.753453], [58949, -9.76567], [67329, -9.776644], [353, -9.780813], [105405, -9.784443], [51935, -9.795877], [77623, -9.801814], [262, -9.807868], [74390, -9.819636], [30778, -9.830684], [111723, -9.83282], [82128, -9.834266], [86195, -9.856154], [766, -9.868861], [941, -9.877729], [111170, -9.878266], [294, -9.878775], [92431, -9.880156], [28320, -9.883878], [112200, -9.906106], [125313, -9.910548], [115205, -9.92588], [1917, -9.935241]], "logprob_of_token": -0.087031, "top1_top2_margin": 4.880649, "top6_top7_margin": 0.299299}, {"gen_index": 16, "token": 948, "top": [[948, -0.021059], [279, -5.022784], [346, -5.864919], [262, -5.941074], [831, -6.92907], [420, -7.35689], [1921, -7.482967], [518, -8.078432], [1178, -8.146351], [286, -8.375585], [339, -8.378663], [35423, -8.625134], [735, -8.75576], [44, -9.120512], [5274, -9.132976], [127906, -9.275328], [2125, -9.27972], [2459, -9.567361], [576, -9.608875], [845, -9.629532], [946, -9.694778], [46, -9.704258], [922, -9.709042], [622, -9.747186], [32, -9.809029], [2297, -9.825223], [941, -9.856188], [493, -9.863297], [6443, -10.150124], [10664, -10.183236], [826, -10.205384], [95, -10.220101], [58, -10.243738], [10, -10.310993], [527, -10.326302], [378, -10.381743], [1409, -10.388405], [9122, -10.413256], [115, -10.434334], [34, -10.470924], [467, -10.49052], [14188, -10.533077], [42, -10.540941], [589, -10.556705], [2362, -10.690811], [543, -10.721329], [3417, -10.725204], [669, -10.766108], [14825, -10.768291], [14168, -10.834294], [1829, -10.837814], [919, -10.962369], [1275, -11.019843], [4733, -11.02], [716, -11.027882], [913, -11.052828], [3504, -11.061861], [7510, -11.076037], [379, -11.080288], [7467, -11.083124], [739, -11.086388], [766, -11.117406], [14154, -11.123066], [1765, -11.149565], [799, -11.158877], [39077, -11.159022], [327, -11.188887], [353, -11.190427], [263, -11.200674], [1151, -11.207951], [4840, -11.221943], [568, -11.27532], [14419, -11.311969], [836, -11.327337], [1195, -11.328215], [3643, -11.387673], [275, -11.391245], [46252, -11.401387], [4561, -11.407628], [39, -11.419266], [14541, -11.430903], [120022, -11.449996], [1047, -11.463966], [1200, -11.490294], [968, -11.505591], [14153, -11.507721], [122883, -11.52602], [3340, -11.530942], [43492, -11.552229], [1410, -11.573513], [314, -11.583222], [970, -11.591631], [2625, -11.613867], [14139, -11.618624], [294, -11.626062], [92, -11.646549], [278, -11.660818], [3326, -11.67532], [939, -11.677029], [614, -11.689078]], "logprob_of_token": -0.021059, "top1_top2_margin": 5.001725, "top6_top7_margin": 0.126078}, {"gen_index": 17, "token": 35423, "top": [[35423, -0.055457], [948, -5.458436], [66863, -5.91864], [46252, -5.947107], [36270, -6.832779], [420, -6.897986], [346, -7.776965], [1178, -7.822876], [10, -7.993552], [826, -8.050973], [7616, -8.098945], [46, -8.220269], [26884, -8.419984], [922, -8.498759], [5274, -8.579279], [11397, -8.599883], [279, -8.854196], [48716, -8.877512], [60216, -8.87798], [28320, -8.902991], [32533, -8.919052], [120007, -9.035678], [43492, -9.055992], [913, -9.080525], [5422, -9.24819], [49541, -9.283416], [82856, -9.309377], [4118, -9.353598], [845, -9.375812], [44, -9.379289], [766, -9.38441], [518, -9.431645], [286, -9.441133], [622, -9.46392], [1195, -9.473594], [32, -9.494967], [1537, -9.51785], [1829, -9.524262], [20283, -9.538041], [1200, -9.559319], [16754, -9.5611], [34025, -9.563795], [831, -9.568034], [49848, -9.572845], [103140, -9.60167], [1151, -9.610775], [836, -9.611741], [582, -9.654222], [493, -9.662578], [939, -9.68611], [77262, -9.68784], [25751, -9.724355], [42454, -9.736119], [3504, -9.752512], [74683, -9.76555], [124, -9.767406], [1097, -9.787704], [30778, -9.7881], [11544, -9.824944], [12895, -9.847615], [55950, -9.856774], [294, -9.859794], [1982, -9.883478], [656, -9.891809], [52553, -9.893996], [22726, -9.909425], [52217, -9.919299], [699, -9.920615], [66396, -9.940743], [10304, -9.944058], [17485, -9.947578], [263, -9.948987], [14594, -9.952415], [44830, -9.957404], [77623, -9.962123], [861, -9.974335], [67329, -9.974511], [50240, -10.004916], [2625, -10.013995], [1117, -10.017406], [58, -10.021466], [2260, -10.031071], [29394, -10.032931], [34991, -10.041364], [614, -10.047978], [104251, -10.073898], [25205, -10.078452], [41769, -10.087731], [502, -10.134974], [119878, -10.135603], [66, -10.144889], [1687, -10.144964], [1469, -10.156878], [53753, -10.179543], [120831, -10.246944], [123801, -10.248708], [275, -10.249529], [14179, -10.25104], [19040, -10.253476], [112621, -10.25714]], "logprob_of_token": -0.055457, "top1_top2_margin": 5.402978, "top6_top7_margin": 0.878979}, {"gen_index": 18, "token": 948, "top": [[948, -0.006603], [35423, -6.233656], [346, -7.217196], [831, -7.426483], [1178, -7.53823], [279, -7.653049], [420, -8.627061], [46, -9.242404], [518, -9.292055], [44, -9.328915], [262, -9.493668], [58, -9.757515], [115, -9.773333], [826, -9.856831], [10, -9.899562], [339, -10.020614], [1921, -10.050114], [493, -10.087976], [622, -10.296444], [14188, -10.452319], [2297, -10.584425], [576, -10.851399], [32, -11.040653], [1829, -11.173958], [2459, -11.186457], [845, -11.269283], [263, -11.302296], [46252, -11.357045], [286, -11.374461], [42, -11.382791], [59, -11.382799], [14153, -11.437403], [922, -11.464714], [127906, -11.475224], [5274, -11.485706], [314, -11.623763], [2125, -11.673847], [275, -11.683133], [1200, -11.702236], [7510, -11.722463], [10664, -11.740229], [34, -11.78756], [7616, -11.793106], [3504, -11.812904], [1151, -11.828863], [6443, -11.832673], [39077, -11.854428], [36270, -11.871162], [913, -11.89229], [122883, -11.92324], [122693, -11.941923], [52387, -12.008767], [766, -12.011796], [14825, -12.019188], [941, -12.033342], [4561, -12.083036], [1117, -12.113601], [1409, -12.118699], [120022, -12.127532], [2625, -12.136678], [735, -12.15202], [3643, -12.153683], [614, -12.165039], [1233, -12.19952], [970, -12.226114], [582, -12.254272], [479, -12.280878], [379, -12.292753], [656, -12.32823], [10304, -12.339396], [95, -12.369967], [1049, -12.378523], [63, -12.392645], [4733, -12.43905], [3750, -12.442101], [6808, -12.44228], [836, -12.526112], [946, -12.53527], [861, -12.535788], [1047, -12.547083], [47, -12.562809], [527, -12.610161], [2362, -12.610715], [66863, -12.631357], [939, -12.652428], [120008, -12.65618], [9122, -12.677926], [965, -12.683668], [1687, -12.698414], [467, -12.753055], [968, -12.771634], [39, -12.788767], [103140, -12.805738], [3417, -12.825095], [24695, -12.826775], [8590, -12.835435], [589, -12.837481], [14168, -12.843739], [378, -12.850738], [1717, -12.851464]], "logprob_of_token": -0.006603, "top1_top2_margin": 6.227053, "top6_top7_margin": 0.974012}, {"gen_index": 19, "token": 35423, "top": [[35423, -0.010021], [46252, -6.072443], [66863, -6.408176], [36270, -6.45581], [7616, -7.306755], [11397, -9.009934], [43492, -9.690136], [55950, -9.852695], [82856, -9.977791], [103140, -10.05638], [16754, -10.244477], [1178, -10.454], [66396, -10.536432], [26884, -10.544231], [52918, -10.737821], [60216, -10.760213], [32, -10.774693], [52553, -10.843739], [125313, -10.852402], [48716, -10.864334], [55998, -10.885935], [52217, -10.913977], [39077, -10.961648], [948, -11.026007], [66473, -11.100473], [49541, -11.192737], [28320, -11.200187], [34991, -11.214796], [420, -11.220553], [25065, -11.268758], [49848, -11.281416], [74299, -11.309239], [114885, -11.313286], [97543, -11.340536], [32533, -11.396828], [91252, -11.40061], [25205, -11.449575], [25751, -11.516544], [60147, -11.553505], [53753, -11.605322], [121167, -11.627621], [44, -11.652946], [46, -11.671221], [96186, -11.679688], [826, -11.722632], [66, -11.725843], [34025, -11.730055], [5422, -11.807543], [92010, -11.807955], [29394, -11.811401], [4479, -11.820713], [622, -11.918768], [96379, -11.928776], [108392, -11.929876], [79262, -11.951504], [346, -11.98232], [20283, -11.990599], [12895, -11.992489], [263, -12.039795], [123801, -12.040263], [1537, -12.044145], [840, -12.045684], [87462, -12.050002], [10, -12.054552], [5274, -12.05504], [119878, -12.06963], [77262, -12.073217], [9986, -12.092145], [46667, -12.149411], [104251, -12.159215], [101757, -12.160249], [406, -12.160434], [22726, -12.186857], [95061, -12.202185], [36500, -12.230671], [17485, -12.244469], [42454, -12.260235], [1097, -12.272827], [922, -12.29693], [77623, -12.307505], [110404, -12.308695], [4118, -12.311579], [24468, -12.324151], [19040, -12.336558], [107755, -12.339922], [744, -12.362062], [50240, -12.383741], [58, -12.391386], [105405, -12.440646], [12559, -12.473037], [30778, -12.479704], [845, -12.499134], [101106, -12.503376], [120007, -12.506691], [444, -12.518179], [3209, -12.526313], [493, -12.529022], [97925, -12.535446], [68683, -12.541979], [44830, -12.546022]], "logprob_of_token": -0.010021, "top1_top2_margin": 6.062422, "top6_top7_margin": 0.680202}, {"gen_index": 20, "token": 948, "top": [[948, -0.002312], [346, -7.677886], [831, -8.129501], [279, -8.795275], [35423, -9.164421], [1178, -9.169239], [518, -9.503319], [420, -9.656118], [46, -10.162544], [339, -10.40827], [1921, -10.490519], [44, -10.498693], [2459, -10.562149], [10, -10.609898], [2297, -10.633166], [58, -10.766106], [32, -10.957432], [922, -11.000893], [115, -11.001685], [14188, -11.025196], [826, -11.05862], [622, -11.146259], [10664, -11.205563], [493, -11.333897], [262, -11.374653], [5274, -11.420796], [845, -11.471859], [6443, -11.551533], [127906, -11.554779], [1829, -11.796557], [576, -11.833873], [263, -11.864305], [122883, -11.96443], [614, -11.976585], [14153, -11.979594], [3340, -12.079226], [735, -12.094627], [479, -12.114376], [34, -12.164232], [2125, -12.232711], [378, -12.350533], [913, -12.371871], [46252, -12.383385], [946, -12.389055], [3504, -12.425947], [1151, -12.442966], [9122, -12.447059], [275, -12.481274], [120022, -12.487022], [122693, -12.493699], [314, -12.508516], [939, -12.508585], [39077, -12.527746], [970, -12.533193], [1409, -12.563396], [14168, -12.581675], [63, -12.59338], [4561, -12.593925], [14825, -12.598287], [59, -12.602257], [888, -12.602737], [1117, -12.607004], [14154, -12.641782], [861, -12.67457], [4840, -12.684725], [968, -12.686309], [3643, -12.698112], [1717, -12.733109], [286, -12.743484], [3750, -12.744994], [1687, -12.773795], [1233, -12.79722], [2625, -12.815989], [527, -12.816989], [42, -12.824368], [120008, -12.849533], [3417, -12.929845], [582, -12.955475], [6808, -12.964027], [766, -12.969913], [4733, -12.992189], [1200, -12.992546], [2225, -13.002303], [699, -13.035084], [669, -13.035748], [1521, -13.042818], [120001, -13.086142], [941, -13.10897], [1047, -13.120737], [56434, -13.123871], [379, -13.139452], [8590, -13.157228], [10304, -13.174412], [52387, -13.187569], [1049, -13.194521], [836, -13.206062], [7510, -13.207932], [1469, -13.259622], [14541, -13.261954], [2150, -13.26818]], "logprob_of_token": -0.002312, "top1_top2_margin": 7.675574, "top6_top7_margin": 0.33408}, {"gen_index": 21, "token": 35423, "top": [[35423, -0.018417], [46252, -5.574096], [36270, -6.068895], [66863, -6.199244], [7616, -7.091406], [11397, -8.410127], [43492, -9.225888], [103140, -9.269588], [26884, -9.334297], [55950, -9.400316], [82856, -9.498044], [1178, -9.546333], [16754, -9.670124], [420, -9.725719], [948, -9.7834], [32, -9.887906], [52553, -10.033882], [60216, -10.041698], [66396, -10.178735], [52217, -10.227228], [25205, -10.232702], [55998, -10.291061], [46, -10.295876], [52918, -10.298714], [826, -10.313667], [49541, -10.396739], [125313, -10.409876], [25751, -10.485153], [28320, -10.490723], [32533, -10.49347], [114885, -10.512624], [44, -10.512821], [39077, -10.513986], [49848, -10.564682], [48716, -10.566327], [34991, -10.586241], [91252, -10.626236], [77262, -10.721773], [346, -10.735561], [79262, -10.794988], [97543, -10.795677], [42454, -10.80079], [5274, -10.86858], [96379, -10.879443], [622, -10.88275], [22726, -10.927341], [121167, -10.949607], [53753, -10.959232], [74299, -10.969316], [60147, -10.972549], [12895, -10.985098], [34025, -10.988541], [96186, -11.003433], [20283, -11.041666], [5422, -11.043304], [66473, -11.067493], [4118, -11.106266], [12559, -11.122348], [66, -11.130337], [263, -11.145447], [1097, -11.17571], [58, -11.181014], [104251, -11.200813], [10, -11.220235], [493, -11.241851], [29394, -11.25615], [922, -11.256366], [74390, -11.29106], [4479, -11.310041], [108392, -11.314706], [840, -11.330317], [20593, -11.352511], [36500, -11.359198], [49, -11.365463], [25065, -11.388741], [87462, -11.415137], [59, -11.449816], [845, -11.460266], [77623, -11.486812], [46667, -11.489166], [3504, -11.4943], [39229, -11.496011], [353, -11.516924], [97346, -11.53184], [766, -11.538244], [120007, -11.546163], [19040, -11.548531], [9986, -11.557976], [101757, -11.572209], [12465, -11.58387], [1537, -11.592794], [2459, -11.594131], [10694, -11.600143], [115, -11.601957], [1829, -11.603776], [744, -11.615705], [286, -11.62211], [92431, -11.626751], [93940, -11.627456], [9702, -11.639423]], "logprob_of_token": -0.018417, "top1_top2_margin": 5.555678, "top6_top7_margin": 0.815762}, {"gen_index": 22, "token": 948, "top": [[948, -0.00208], [346, -7.708152], [831, -8.23362], [279, -9.198888], [518, -9.388824], [1178, -9.441731], [420, -9.707898], [35423, -10.009739], [46, -10.10255], [2459, -10.199477], [44, -10.530293], [1921, -10.530956], [10, -10.641068], [58, -10.643972], [339, -10.696118], [922, -10.839078], [32, -11.053736], [14188, -11.074655], [622, -11.113145], [2297, -11.223086], [115, -11.244992], [826, -11.277531], [5274, -11.394141], [10664, -11.398716], [6443, -11.456751], [493, -11.491298], [845, -11.543698], [127906, -11.573272], [614, -11.690802], [262, -11.702884], [263, -11.928952], [1829, -11.940643], [576, -11.954509], [735, -11.992879], [14153, -12.036729], [3340, -12.056399], [479, -12.173307], [120022, -12.175397], [122883, -12.191131], [3504, -12.269049], [913, -12.269547], [14168, -12.290275], [34, -12.308496], [1151, -12.328876], [378, -12.330631], [946, -12.367684], [14154, -12.396732], [1717, -12.430728], [861, -12.452247], [939, -12.460221], [1117, -12.461867], [314, -12.483579], [275, -12.488931], [63, -12.516184], [3643, -12.518639], [14825, -12.552113], [9122, -12.556403], [59, -12.559306], [968, -12.620262], [4561, -12.630221], [970, -12.63131], [39077, -12.640141], [2125, -12.650294], [888, -12.667852], [1233, -12.682361], [4840, -12.704762], [2625, -12.719411], [122693, -12.727259], [1687, -12.72735], [1409, -12.744954], [3750, -12.792871], [766, -12.886531], [527, -12.906021], [286, -12.916512], [42, -12.933099], [46252, -12.933729], [120008, -12.9378], [3417, -12.940244], [10304, -12.951062], [965, -12.973617], [1200, -12.975074], [2225, -12.992624], [699, -13.0158], [7470, -13.073892], [120001, -13.085589], [6808, -13.095092], [14541, -13.097157], [941, -13.105967], [4733, -13.110147], [379, -13.118167], [513, -13.123979], [120007, -13.162671], [836, -13.166729], [582, -13.200944], [1521, -13.205298], [669, -13.234919], [2150, -13.270118], [7510, -13.27279], [1469, -13.306561], [1195, -13.337987]], "logprob_of_token": -0.00208, "top1_top2_margin": 7.706072, "top6_top7_margin": 0.266167}, {"gen_index": 23, "token": 35423, "top": [[35423, -0.011202], [46252, -5.726727], [36270, -6.655426], [66863, -7.009681], [7616, -7.613799], [11397, -8.617946], [43492, -9.577766], [103140, -9.72909], [55950, -9.866292], [26884, -9.908529], [16754, -10.13805], [82856, -10.17572], [48716, -10.251266], [66396, -10.366039], [32, -10.432213], [52217, -10.445113], [60216, -10.460836], [52553, -10.500971], [1178, -10.558552], [948, -10.599632], [52918, -10.782633], [420, -10.803225], [55998, -10.807824], [125313, -10.846638], [28320, -10.886959], [114885, -10.961944], [39077, -10.965207], [91252, -10.972679], [34991, -11.030616], [49541, -11.050847], [66473, -11.053299], [25205, -11.0624], [74299, -11.074344], [44, -11.079885], [96186, -11.081624], [32533, -11.084192], [60147, -11.105919], [97543, -11.121641], [49848, -11.144547], [25751, -11.211819], [46, -11.227726], [121167, -11.235331], [96379, -11.283993], [826, -11.381353], [53753, -11.391478], [34025, -11.414626], [36500, -11.498594], [29394, -11.536555], [87462, -11.541176], [104251, -11.552167], [346, -11.597834], [622, -11.624317], [79262, -11.658009], [20283, -11.664226], [10, -11.679517], [12895, -11.704085], [108392, -11.710963], [12559, -11.743845], [263, -11.749516], [22726, -11.772837], [46667, -11.791802], [922, -11.796453], [4479, -11.796842], [1097, -11.810002], [5274, -11.816141], [4118, -11.818267], [101757, -11.82112], [120007, -11.826442], [77262, -11.861465], [42454, -11.867825], [25065, -11.870916], [123801, -11.873163], [119878, -11.883876], [1537, -11.908114], [93940, -11.915951], [66, -11.93408], [58, -11.934764], [107755, -11.946326], [117126, -11.981546], [110404, -11.983761], [74390, -12.04677], [76649, -12.080486], [50240, -12.08158], [39229, -12.093875], [19040, -12.112481], [77651, -12.113691], [78542, -12.126163], [105405, -12.134644], [30778, -12.139077], [95061, -12.145464], [77623, -12.155284], [63361, -12.171974], [845, -12.19763], [9702, -12.2026], [52663, -12.208471], [20593, -12.214828], [55442, -12.215658], [24468, -12.218173], [766, -12.236349], [101106, -12.242235]], "logprob_of_token": -0.011202, "top1_top2_margin": 5.715525, "top6_top7_margin": 0.959821}, {"gen_index": 24, "token": 948, "top": [[948, -0.002295], [346, -7.468822], [831, -8.377931], [518, -9.304068], [279, -9.493025], [2459, -9.534737], [46, -9.643812], [420, -9.679604], [1178, -10.113348], [10, -10.288314], [339, -10.390664], [1921, -10.428519], [44, -10.486156], [922, -10.51503], [58, -10.546041], [32, -10.60972], [14188, -10.765814], [127906, -10.869678], [5274, -10.988008], [6443, -11.018429], [2297, -11.051186], [115, -11.128989], [622, -11.262589], [10664, -11.264505], [614, -11.295488], [845, -11.501694], [263, -11.526093], [735, -11.529806], [262, -11.604649], [1829, -11.639208], [493, -11.64731], [576, -11.661139], [826, -11.677906], [34, -11.755294], [35423, -11.831766], [14168, -11.889248], [939, -11.947948], [946, -11.970054], [120022, -11.970842], [14153, -11.99448], [479, -12.052521], [378, -12.084149], [275, -12.12209], [314, -12.125673], [63, -12.135644], [14154, -12.165161], [3340, -12.193052], [2125, -12.213273], [3504, -12.223029], [888, -12.263298], [1117, -12.270066], [1151, -12.289101], [913, -12.306469], [59, -12.321472], [14825, -12.37672], [1717, -12.402653], [968, -12.416842], [120001, -12.426746], [122883, -12.4384], [9122, -12.514703], [861, -12.517527], [2225, -12.548158], [14541, -12.55108], [3643, -12.56747], [3417, -12.569427], [527, -12.58219], [120008, -12.61981], [766, -12.635136], [699, -12.638198], [4840, -12.646962], [3750, -12.727179], [669, -12.732909], [1687, -12.79341], [1409, -12.80654], [120007, -12.809438], [1233, -12.814648], [379, -12.834726], [122693, -12.839199], [582, -12.841338], [7470, -12.841475], [4561, -12.853964], [1200, -12.88835], [120006, -12.889447], [2625, -12.891281], [42, -12.8993], [465, -12.906199], [286, -12.931561], [941, -12.942904], [39077, -12.944694], [2790, -12.94741], [10304, -12.973625], [56434, -13.003527], [1826, -13.004765], [2120, -13.01806], [970, -13.055259], [4733, -13.075674], [14794, -13.097178], [1521, -13.10235], [525, -13.114637], [965, -13.133005]], "logprob_of_token": -0.002295, "top1_top2_margin": 7.466528, "top6_top7_margin": 0.109076}, {"gen_index": 25, "token": 35423, "top": [[35423, -0.018285], [46252, -5.836532], [36270, -6.048545], [66863, -6.157454], [7616, -7.68819], [11397, -8.766518], [948, -9.046479], [1178, -9.339169], [55950, -9.377085], [82856, -9.430161], [43492, -9.464632], [103140, -9.575012], [26884, -9.674365], [420, -9.712376], [60216, -9.770923], [52217, -9.918528], [52553, -9.95353], [66396, -10.076074], [52918, -10.086042], [46, -10.171714], [25205, -10.204042], [55998, -10.205439], [48716, -10.27127], [125313, -10.282957], [16754, -10.29186], [826, -10.31036], [114885, -10.366925], [25751, -10.376259], [44, -10.410677], [79262, -10.418036], [39077, -10.434447], [34991, -10.45327], [49541, -10.459074], [346, -10.47184], [32, -10.54129], [32533, -10.562699], [96379, -10.634188], [28320, -10.64908], [53753, -10.687963], [96186, -10.742037], [91252, -10.776643], [622, -10.784419], [121167, -10.787859], [97543, -10.835235], [922, -10.841924], [49848, -10.850199], [60147, -10.861726], [5274, -10.868128], [20283, -10.882337], [77262, -10.883617], [42454, -10.884942], [10, -10.915801], [4118, -10.916306], [74299, -10.948692], [12895, -10.955214], [34025, -10.993496], [46667, -11.001454], [5422, -11.005925], [104251, -11.021488], [263, -11.023799], [29394, -11.046772], [1097, -11.04885], [12559, -11.053668], [66473, -11.054037], [77623, -11.125818], [19040, -11.128692], [74390, -11.134182], [87462, -11.212029], [22726, -11.225204], [108392, -11.24007], [493, -11.252432], [36500, -11.288672], [4479, -11.292147], [58, -11.306816], [20593, -11.348053], [3504, -11.365192], [120007, -11.37363], [845, -11.382438], [59, -11.388672], [1537, -11.391837], [97346, -11.393297], [353, -11.403021], [93940, -11.408147], [30778, -11.422215], [1151, -11.432718], [39229, -11.447559], [24468, -11.456677], [12465, -11.45874], [116312, -11.472773], [123801, -11.480177], [101757, -11.482977], [76649, -11.485496], [67028, -11.489254], [107755, -11.494561], [49, -11.498644], [101106, -11.50408], [766, -11.51998], [10664, -11.523505], [699, -11.525998], [55442, -11.52758]], "logprob_of_token": -0.018285, "top1_top2_margin": 5.818247, "top6_top7_margin": 0.279962}, {"gen_index": 26, "token": 948, "top": [[948, -0.002647], [346, -7.29813], [831, -8.31129], [518, -9.03261], [46, -9.355142], [420, -9.372839], [279, -9.598863], [2459, -9.685118], [1178, -9.740997], [10, -10.231962], [44, -10.272499], [1921, -10.372836], [339, -10.384106], [58, -10.401386], [922, -10.421964], [32, -10.477022], [14188, -10.65387], [115, -10.815346], [5274, -10.888504], [127906, -10.91529], [6443, -11.004313], [622, -11.062391], [2297, -11.107656], [614, -11.146888], [10664, -11.175536], [826, -11.259354], [493, -11.402158], [263, -11.432734], [845, -11.462093], [262, -11.484909], [34, -11.566553], [120022, -11.569551], [1829, -11.58981], [479, -11.666917], [576, -11.686853], [735, -11.710395], [14168, -11.743308], [3340, -11.791037], [35423, -11.824324], [946, -11.827517], [939, -11.902536], [14154, -11.910341], [63, -11.912291], [1117, -11.942802], [275, -11.980151], [913, -12.035136], [3504, -12.039171], [314, -12.042259], [378, -12.053146], [59, -12.076591], [14153, -12.082822], [1151, -12.146242], [14825, -12.158674], [888, -12.161739], [120007, -12.18067], [120001, -12.182064], [2125, -12.255847], [9122, -12.277183], [14541, -12.297594], [1233, -12.30682], [766, -12.312644], [1717, -12.339855], [861, -12.385571], [3417, -12.393612], [122883, -12.402021], [3643, -12.418204], [4840, -12.434258], [1687, -12.475222], [968, -12.475883], [2225, -12.517301], [120008, -12.528988], [965, -12.564296], [3750, -12.577561], [699, -12.597939], [7470, -12.626556], [527, -12.653625], [1409, -12.661142], [42, -12.672211], [2625, -12.677334], [970, -12.681976], [4561, -12.711168], [379, -12.721018], [465, -12.782307], [582, -12.805267], [941, -12.820023], [120098, -12.824541], [286, -12.829748], [122693, -12.830165], [120006, -12.857911], [669, -12.865144], [1200, -12.866903], [1521, -12.879954], [10304, -12.891554], [513, -12.892959], [2120, -12.939813], [14794, -12.946829], [2790, -12.9639], [1195, -12.978304], [589, -13.022436], [4733, -13.05499]], "logprob_of_token": -0.002647, "top1_top2_margin": 7.295483, "top6_top7_margin": 0.226024}, {"gen_index": 27, "token": 35423, "top": [[35423, -0.010717], [46252, -6.025943], [36270, -6.311584], [66863, -7.172316], [7616, -8.202638], [11397, -8.898069], [103140, -9.448693], [43492, -9.487103], [55950, -9.977804], [48716, -10.059363], [32, -10.087628], [16754, -10.183931], [82856, -10.393481], [26884, -10.421384], [66396, -10.493148], [52217, -10.510406], [60216, -10.58005], [52553, -10.588475], [96186, -10.624923], [28320, -10.629009], [114885, -10.825897], [39077, -10.843287], [52918, -10.861183], [32533, -10.883529], [55998, -10.981311], [74299, -10.999448], [66473, -11.00015], [1178, -11.04376], [91252, -11.10602], [125313, -11.114853], [53753, -11.209188], [121167, -11.218378], [36500, -11.247152], [97543, -11.259658], [29394, -11.265579], [420, -11.302855], [60147, -11.314242], [948, -11.32157], [79262, -11.391152], [34991, -11.398364], [123801, -11.462692], [49848, -11.477599], [46667, -11.480371], [96379, -11.51127], [120007, -11.511676], [44, -11.514832], [22726, -11.515188], [5274, -11.529228], [104251, -11.532662], [87462, -11.533357], [25205, -11.555463], [25751, -11.564585], [93940, -11.57058], [20283, -11.595078], [826, -11.59658], [78542, -11.597384], [4118, -11.680947], [34025, -11.710457], [12559, -11.76582], [53404, -11.773589], [1097, -11.777173], [12895, -11.77724], [108392, -11.802501], [119878, -11.823428], [346, -11.834167], [49541, -11.844827], [922, -11.861366], [117126, -11.875798], [42454, -11.932652], [622, -11.955431], [4479, -11.955504], [12131, -11.963546], [74390, -11.991253], [25065, -11.993915], [12465, -11.997689], [97925, -12.004753], [76649, -12.006293], [41979, -12.007803], [77651, -12.011401], [97346, -12.014792], [1537, -12.023241], [10, -12.025143], [24468, -12.031957], [110404, -12.038156], [52663, -12.060589], [77262, -12.065743], [19040, -12.069492], [46, -12.072322], [66, -12.07658], [118043, -12.078603], [35815, -12.099901], [9986, -12.131696], [79631, -12.132782], [103975, -12.149922], [107755, -12.167619], [105405, -12.17164], [493, -12.185214], [77623, -12.196118], [353, -12.197362], [14794, -12.198529]], "logprob_of_token": -0.010717, "top1_top2_margin": 6.015226, "top6_top7_margin": 0.550624}, {"gen_index": 28, "token": 948, "top": [[948, -0.001783], [346, -7.725445], [831, -8.630694], [518, -9.497308], [46, -9.8764], [420, -10.026141], [2459, -10.150373], [279, -10.23919], [1178, -10.389712], [1921, -10.580537], [922, -10.660201], [44, -10.704036], [6443, -10.80107], [10, -10.836194], [32, -10.843991], [58, -10.905983], [339, -10.915527], [14188, -10.962142], [5274, -11.107094], [127906, -11.116183], [614, -11.370503], [493, -11.379502], [120022, -11.442698], [2297, -11.451014], [622, -11.618159], [115, -11.640948], [263, -11.677135], [479, -11.725142], [14168, -11.752377], [826, -11.841002], [576, -11.841496], [10664, -11.857371], [34, -11.862668], [946, -11.937865], [939, -12.007142], [262, -12.088088], [1829, -12.105256], [845, -12.152039], [1117, -12.173431], [14154, -12.207635], [120007, -12.220059], [9122, -12.260974], [913, -12.263843], [3340, -12.264622], [63, -12.328883], [275, -12.351844], [1151, -12.401284], [3504, -12.418956], [14153, -12.430008], [3417, -12.435049], [735, -12.437413], [120001, -12.450376], [888, -12.48933], [59, -12.521092], [14541, -12.525536], [2125, -12.557857], [14825, -12.577506], [766, -12.647559], [861, -12.660819], [965, -12.671797], [120098, -12.678776], [378, -12.689694], [3643, -12.694424], [7470, -12.695868], [1717, -12.699459], [2225, -12.72383], [669, -12.725049], [4561, -12.729259], [314, -12.749018], [120008, -12.777757], [1233, -12.784849], [122883, -12.785884], [527, -12.873734], [968, -12.886674], [699, -12.887737], [4840, -12.949643], [42, -12.967332], [56434, -12.98737], [2625, -12.987428], [120006, -12.988753], [11443, -13.048618], [3750, -13.073771], [465, -13.082295], [1687, -13.083152], [122693, -13.130781], [4733, -13.134611], [14794, -13.148695], [1409, -13.148953], [1195, -13.16035], [582, -13.183393], [35519, -13.193613], [1200, -13.193858], [39077, -13.219259], [1469, -13.235581], [1521, -13.251091], [513, -13.280566], [941, -13.28406], [10304, -13.287291], [7510, -13.289031], [2790, -13.297359]], "logprob_of_token": -0.001783, "top1_top2_margin": 7.723662, "top6_top7_margin": 0.124231}, {"gen_index": 29, "token": 35423, "top": [[35423, -0.015313], [46252, -5.279257], [36270, -6.334226], [66863, -6.799027], [7616, -8.022084], [11397, -8.401065], [48716, -9.313724], [103140, -9.463489], [43492, -9.488955], [82856, -9.518279], [26884, -9.653367], [55950, -9.673532], [16754, -10.023543], [52217, -10.04712], [66396, -10.067321], [32, -10.168932], [52553, -10.383835], [91252, -10.548594], [60216, -10.64142], [96186, -10.655112], [1178, -10.656535], [49541, -10.704011], [74299, -10.725738], [60147, -10.730045], [420, -10.746599], [36500, -10.750387], [125313, -10.873023], [34991, -10.881351], [52918, -10.886594], [87462, -10.900548], [28320, -10.937259], [96379, -10.939363], [66473, -11.001959], [44, -11.014849], [55998, -11.027645], [114885, -11.04024], [948, -11.079961], [25205, -11.090049], [39077, -11.122932], [53753, -11.124496], [32533, -11.152802], [25751, -11.15281], [121167, -11.216681], [29394, -11.218854], [49848, -11.272004], [120007, -11.293301], [101757, -11.306115], [34025, -11.349137], [119878, -11.362761], [104251, -11.36929], [826, -11.40356], [46, -11.410855], [78542, -11.451916], [12559, -11.463178], [97543, -11.465387], [79262, -11.482541], [4118, -11.4856], [1097, -11.503337], [5274, -11.534167], [5422, -11.550515], [76649, -11.58813], [12895, -11.594789], [922, -11.625606], [20283, -11.645556], [39229, -11.667059], [107755, -11.677577], [22726, -11.686561], [108392, -11.689612], [46667, -11.693202], [77651, -11.699046], [1537, -11.704493], [50240, -11.720178], [74390, -11.720449], [116312, -11.735028], [123801, -11.735626], [93940, -11.745411], [9702, -11.75236], [10, -11.76187], [110404, -11.780557], [4479, -11.788571], [75452, -11.792965], [117126, -11.796376], [103975, -11.801229], [24468, -11.814271], [34560, -11.818244], [104432, -11.832859], [86354, -11.833534], [53404, -11.843127], [52663, -11.844752], [79493, -11.864408], [622, -11.890048], [19040, -11.8904], [766, -11.892926], [34654, -11.898252], [35815, -11.907897], [66, -11.908216], [118043, -11.941617], [49, -11.942464], [97925, -11.944201], [346, -11.975239]], "logprob_of_token": -0.015313, "top1_top2_margin": 5.263944, "top6_top7_margin": 0.912659}, {"gen_index": 30, "token": 948, "top": [[948, -0.002636], [346, -7.23343], [831, -8.36969], [518, -8.950912], [46, -9.211587], [420, -9.416745], [2459, -9.899616], [44, -10.09852], [922, -10.118574], [1921, -10.198288], [1178, -10.220336], [10, -10.39782], [14188, -10.419541], [32, -10.480271], [279, -10.518975], [6443, -10.57198], [339, -10.673994], [58, -10.717769], [127906, -10.867889], [614, -10.876375], [5274, -10.973206], [115, -11.113384], [263, -11.136419], [120022, -11.238092], [493, -11.244499], [622, -11.302382], [2297, -11.360204], [1117, -11.549889], [14168, -11.554222], [576, -11.55895], [845, -11.617178], [34, -11.620197], [275, -11.652565], [826, -11.661758], [946, -11.669083], [1829, -11.669956], [3340, -11.70175], [1151, -11.710787], [479, -11.724752], [14154, -11.743599], [939, -11.781081], [9122, -11.809296], [262, -11.82002], [10664, -11.844822], [3504, -11.847619], [14541, -11.901381], [735, -11.91777], [913, -11.943568], [120001, -12.038493], [378, -12.055829], [14153, -12.065833], [59, -12.072813], [669, -12.100636], [120008, -12.110241], [3417, -12.126522], [120007, -12.129083], [14825, -12.176665], [3643, -12.180929], [766, -12.222389], [888, -12.227764], [861, -12.249754], [63, -12.265153], [7470, -12.278725], [314, -12.320408], [120098, -12.331927], [699, -12.339155], [4840, -12.373919], [2225, -12.397641], [1409, -12.440718], [120006, -12.534698], [1717, -12.552245], [3750, -12.569326], [527, -12.583364], [2125, -12.592219], [122693, -12.599898], [1687, -12.604277], [1233, -12.606115], [56434, -12.616916], [965, -12.619395], [1200, -12.624138], [4561, -12.646604], [968, -12.649077], [582, -12.663244], [1195, -12.721047], [122883, -12.760008], [2120, -12.78211], [836, -12.804399], [1521, -12.811363], [1469, -12.813257], [465, -12.815713], [35519, -12.837681], [2625, -12.844652], [4733, -12.86903], [10304, -12.890759], [7510, -12.938838], [379, -12.939635], [52387, -12.940371], [42, -12.947424], [286, -12.996774], [941, -13.042568]], "logprob_of_token": -0.002636, "top1_top2_margin": 7.230794, "top6_top7_margin": 0.482871}, {"gen_index": 31, "token": 35423, "top": [[35423, -0.018243], [46252, -5.24068], [36270, -5.932724], [66863, -6.881936], [7616, -7.860795], [11397, -8.303946], [48716, -8.899324], [103140, -9.078403], [43492, -9.3172], [55950, -9.422256], [26884, -9.563155], [82856, -9.708038], [32, -9.725649], [16754, -9.847098], [66396, -10.056418], [52217, -10.140581], [96186, -10.192101], [52553, -10.235834], [1178, -10.319197], [28320, -10.337502], [36500, -10.440455], [60216, -10.462173], [74299, -10.544147], [91252, -10.559484], [52918, -10.568012], [120007, -10.610749], [53753, -10.646282], [32533, -10.664715], [96379, -10.703205], [39077, -10.753263], [125313, -10.772463], [34991, -10.787748], [49848, -10.807611], [29394, -10.81203], [25205, -10.840401], [420, -10.878408], [60147, -10.901896], [66473, -10.909266], [49541, -10.913412], [104251, -10.935281], [948, -10.942847], [87462, -10.949505], [4118, -10.963218], [93940, -10.993431], [114885, -11.017948], [121167, -11.035833], [25751, -11.03982], [826, -11.061273], [34025, -11.067379], [5274, -11.084673], [55998, -11.095964], [123801, -11.15869], [78542, -11.190891], [76649, -11.21368], [9702, -11.234108], [1537, -11.264898], [1097, -11.275211], [101757, -11.283337], [44, -11.290336], [12559, -11.293892], [97543, -11.303239], [53404, -11.332707], [79262, -11.341978], [20283, -11.359328], [49, -11.405613], [103975, -11.413642], [12895, -11.418899], [46667, -11.426219], [74390, -11.429898], [19040, -11.43586], [39229, -11.443466], [11789, -11.451157], [4479, -11.470623], [94725, -11.48085], [77651, -11.485133], [66, -11.510356], [22726, -11.516262], [119878, -11.529516], [922, -11.534262], [5422, -11.539938], [97925, -11.552726], [52663, -11.576915], [118043, -11.590498], [12465, -11.591623], [108392, -11.597687], [86354, -11.627672], [12131, -11.629988], [10, -11.648542], [117126, -11.667721], [346, -11.668793], [406, -11.671368], [46, -11.68263], [41979, -11.707845], [24468, -11.708637], [108251, -11.71076], [34560, -11.71888], [35815, -11.725394], [75452, -11.725688], [840, -11.746078], [116312, -11.746967]], "logprob_of_token": -0.018243, "top1_top2_margin": 5.222437, "top6_top7_margin": 0.595378}]}, {"prompt": "The capital of Australia is", "input_ids": [325, 9255, 279, 5240, 735], "generated_ids": [75361, 46, 75361, 735, 262, 9255, 279, 5240, 46, 75361, 735, 7789, 622, 262, 7252, 13919, 37112, 46, 75361, 735, 262, 6980, 6547, 622, 262, 7252, 13919, 37112, 46, 75361, 735, 262], "rows": [{"gen_index": 0, "token": 75361, "top": [[75361, -0.106103], [20733, -2.49697], [23441, -6.110179], [120007, -6.277777], [262, -6.498446], [5274, -6.825605], [5240, -7.555398], [32, -7.585652], [502, -7.62844], [34122, -8.022045], [3960, -8.025498], [91515, -8.070083], [120022, -8.103549], [9255, -8.414601], [941, -8.440371], [476, -8.498549], [13919, -8.58509], [64119, -8.640576], [49123, -8.993575], [58209, -9.017131], [44573, -9.136701], [27565, -9.140844], [946, -9.161827], [762, -9.433983], [120016, -9.463002], [8546, -9.513971], [28872, -9.51467], [7252, -9.536365], [622, -9.55003], [93472, -9.566845], [63, -9.57282], [4361, -9.797003], [46, -9.799577], [5513, -9.814089], [745, -9.861514], [63585, -9.886218], [7789, -9.992709], [1410, -10.086102], [58, -10.119845], [1283, -10.168071], [120021, -10.178692], [28851, -10.191761], [4075, -10.204048], [5639, -10.225629], [1921, -10.23213], [2602, -10.315092], [36995, -10.351173], [393, -10.361515], [104792, -10.386243], [31055, -10.401322], [49146, -10.410806], [86627, -10.420785], [766, -10.480241], [9224, -10.489657], [16474, -10.536067], [735, -10.55169], [110874, -10.582237], [543, -10.631488], [327, -10.650859], [28234, -10.655528], [5672, -10.661296], [16545, -10.679351], [24507, -10.70013], [54977, -10.71109], [120410, -10.730481], [18677, -10.780387], [6030, -10.781026], [14188, -10.782546], [41875, -10.788893], [10, -10.831432], [67327, -10.848107], [67370, -10.884612], [799, -10.886731], [29296, -10.896161], [11533, -10.900737], [20758, -10.905276], [87056, -10.928323], [14052, -10.953179], [3327, -10.953391], [3660, -10.980504], [1043, -10.988743], [263, -11.001473], [2807, -11.002864], [20321, -11.096273], [459, -11.103785], [21690, -11.112456], [656, -11.113591], [523, -11.124379], [44, -11.125959], [30316, -11.133243], [16424, -11.13993], [2150, -11.174464], [20023, -11.176312], [2403, -11.200677], [2944, -11.229957], [48470, -11.230244], [76115, -11.251735], [120103, -11.2529], [120001, -11.306274], [2457, -11.345265]], "logprob_of_token": -0.106103, "top1_top2_margin": 2.390867, "top6_top7_margin": 0.729794}, {"gen_index": 1, "token": 46, "top": [[46, -0.627708], [275, -1.176136], [314, -2.461591], [44, -3.619084], [766, -3.864588], [59, -5.149523], [63, -5.923138], [120007, -6.220485], [14188, -6.357808], [1043, -6.741031], [120399, -7.240429], [1829, -7.541419], [120016, -7.542417], [735, -7.751037], [263, -7.852379], [10, -8.000595], [4137, -8.123127], [460, -8.143785], [405, -8.268641], [36209, -8.316492], [120230, -8.49476], [393, -8.7178], [120021, -8.741953], [286, -8.776192], [14153, -8.816912], [5240, -8.818169], [93457, -8.947159], [51880, -8.955561], [13594, -9.363817], [502, -9.380506], [120048, -9.386671], [12611, -9.398576], [120001, -9.420811], [120022, -9.475858], [58, -9.480394], [622, -9.515017], [327, -9.585511], [36198, -9.604198], [120000, -9.610703], [28872, -9.612015], [745, -9.684325], [120078, -9.710539], [30989, -9.805544], [34589, -9.852526], [75361, -9.865339], [120214, -9.962196], [120064, -10.011195], [33, -10.064598], [120002, -10.117779], [120360, -10.12271], [284, -10.12272], [988, -10.125371], [120347, -10.213411], [120099, -10.220205], [120241, -10.22461], [120140, -10.234927], [126123, -10.239473], [32, -10.315673], [595, -10.359055], [44176, -10.378721], [262, -10.431481], [2519, -10.445278], [6391, -10.46133], [34588, -10.485987], [40, -10.499953], [11861, -10.52261], [103784, -10.565125], [120969, -10.575756], [120173, -10.579065], [14179, -10.615974], [120003, -10.630545], [124455, -10.642416], [120008, -10.643372], [7252, -10.689405], [120068, -10.692015], [120410, -10.766786], [120028, -10.778166], [120359, -10.874361], [656, -10.889364], [120108, -10.904585], [85447, -10.914553], [20758, -10.931809], [33676, -10.977871], [120610, -10.980901], [10829, -10.997249], [9255, -11.017918], [44455, -11.021355], [378, -11.051597], [476, -11.058415], [669, -11.059634], [589, -11.063579], [50492, -11.082089], [74254, -11.085712], [120103, -11.100038], [310, -11.105599], [120110, -11.114468], [333, -11.115234], [120084, -11.120886], [936, -11.122843], [120018, -11.126722]], "logprob_of_token": -0.627708, "top1_top2_margin": 0.548428, "top6_top7_margin": 0.773615}, {"gen_index": 2, "token": 75361, "top": [[75361, -1.148155], [543, -1.250631], [1914, -3.43259], [3960, -3.491971], [14147, -3.769721], [669, -3.907615], [1231, -3.940628], [120014, -4.120836], [120004, -4.153692], [1336, -4.39814], [6372, -4.423134], [766, -4.492224], [1905, -4.670241], [1692, -4.692529], [611, -4.867074], [1741, -5.034249], [1194, -5.081388], [14161, -5.088249], [5240, -5.212332], [2560, -5.337593], [5775, -5.466409], [8067, -5.497171], [1689, -5.503261], [6693, -5.639168], [717, -5.649832], [14896, -5.672426], [3780, -5.914905], [4759, -6.079615], [7643, -6.120425], [32, -6.130647], [9980, -6.172831], [1988, -6.206212], [6455, -6.318773], [4246, -6.352855], [1010, -6.358126], [16545, -6.406363], [4001, -6.425065], [6814, -6.43179], [8009, -6.619592], [3375, -6.935407], [742, -6.956391], [2291, -7.078233], [7252, -7.087609], [10067, -7.098745], [120022, -7.175641], [15934, -7.275052], [2284, -7.277519], [13919, -7.312052], [3872, -7.35573], [7339, -7.378784], [7189, -7.380439], [14153, -7.439902], [14053, -7.444551], [11533, -7.462958], [3501, -7.516869], [2743, -7.53427], [523, -7.547092], [18757, -7.547572], [28872, -7.568805], [3463, -7.620456], [1957, -7.628409], [3832, -7.648821], [34122, -7.66164], [20733, -7.667161], [8266, -7.687647], [20456, -7.712985], [5274, -7.716092], [13389, -7.760061], [7302, -7.776509], [1962, -7.863756], [6131, -7.870025], [4031, -7.879546], [41390, -7.880903], [8337, -7.913152], [6391, -7.936646], [840, -7.945346], [6104, -7.974192], [76115, -7.978255], [2807, -7.987328], [28484, -7.992214], [8852, -8.004389], [9941, -8.013184], [4408, -8.028099], [15070, -8.033638], [476, -8.038117], [7679, -8.065031], [20321, -8.08386], [8781, -8.094188], [8758, -8.095125], [14984, -8.099372], [63585, -8.10698], [38009, -8.107844], [2865, -8.10789], [7510, -8.115277], [1254, -8.127662], [7924, -8.128651], [127906, -8.143677], [4888, -8.17519], [946, -8.206171], [29880, -8.222328]], "logprob_of_token": -1.148155, "top1_top2_margin": 0.102476, "top6_top7_margin": 0.033013}, {"gen_index": 3, "token": 735, "top": [[735, -0.331929], [378, -1.91456], [4278, -2.684932], [919, -3.874975], [44, -4.512024], [589, -4.992129], [46, -5.486988], [11201, -5.660077], [766, -6.239947], [52776, -6.600882], [21925, -6.900023], [14439, -6.938468], [1410, -7.105514], [476, -7.470593], [58, -7.552036], [10757, -7.807938], [75361, -7.872204], [7789, -7.982588], [13032, -8.095985], [262, -8.183058], [275, -8.308036], [7330, -8.30827], [4225, -8.473519], [4440, -8.48255], [14380, -8.505855], [622, -8.540207], [4617, -8.565274], [4088, -8.567205], [617, -8.610145], [16740, -8.647677], [14598, -8.712106], [8140, -8.724154], [120007, -8.758443], [976, -8.895727], [1275, -8.912897], [1958, -8.940596], [5240, -9.036345], [10471, -9.102546], [13308, -9.137014], [63, -9.169091], [830, -9.181324], [12195, -9.250653], [286, -9.257542], [18227, -9.266868], [1030, -9.292575], [20615, -9.305844], [20748, -9.31716], [1812, -9.383111], [14188, -9.407496], [9727, -9.424507], [14153, -9.436317], [6547, -9.473915], [8150, -9.485936], [824, -9.490178], [4384, -9.501166], [314, -9.501771], [2879, -9.502803], [263, -9.551177], [120022, -9.571827], [1270, -9.573593], [1829, -9.589509], [6581, -9.607583], [279, -9.612653], [11338, -9.659911], [10, -9.668082], [37296, -9.728727], [28872, -9.781649], [14052, -9.851533], [2807, -9.872153], [439, -9.878118], [20773, -9.901919], [14262, -9.94463], [11319, -9.963798], [4884, -9.965147], [32, -10.054002], [669, -10.069278], [6513, -10.079303], [2347, -10.117501], [13438, -10.146122], [17446, -10.148826], [17155, -10.166997], [9255, -10.172709], [393, -10.191768], [9169, -10.199856], [5598, -10.270081], [2459, -10.291102], [1656, -10.293176], [59, -10.318166], [13493, -10.323466], [11523, -10.349924], [6030, -10.355003], [11308, -10.35996], [3865, -10.363032], [502, -10.398369], [662, -10.407286], [11769, -10.41533], [3326, -10.493896], [37322, -10.50243], [19701, -10.566461], [12243, -10.579825]], "logprob_of_token": -0.331929, "top1_top2_margin": 1.582631, "top6_top7_margin": 0.494859}, {"gen_index": 4, "token": 262, "top": [[262, -0.700852], [7789, -1.376184], [941, -1.85588], [502, -3.690639], [1410, -4.212526], [15132, -4.777377], [5240, -4.799485], [622, -5.085109], [5407, -5.402536], [13438, -5.507686], [834, -5.935584], [2602, -6.067038], [2150, -6.082267], [6030, -6.902984], [14386, -7.127004], [799, -7.237372], [14052, -7.415844], [9255, -7.642775], [5639, -7.712229], [2403, -7.903582], [3892, -8.23383], [1739, -8.391411], [7252, -8.392576], [5874, -8.432338], [8255, -8.611733], [75361, -8.625588], [12511, -8.642002], [4080, -8.652556], [3893, -8.683486], [1075, -8.716693], [10301, -8.774436], [8784, -8.780351], [4191, -8.810496], [2457, -8.823949], [3379, -8.867724], [15967, -8.943904], [3327, -9.035268], [85056, -9.161405], [23132, -9.184123], [121222, -9.191953], [32, -9.199272], [1781, -9.305096], [3145, -9.356153], [1812, -9.434373], [15038, -9.434939], [2702, -9.474767], [37889, -9.504988], [923, -9.530846], [2288, -9.592011], [2642, -9.619357], [15684, -9.649755], [13969, -9.652184], [2769, -9.658835], [14380, -9.688556], [72062, -9.731582], [1127, -9.751437], [900, -9.758417], [3992, -9.78058], [3647, -9.785786], [33499, -9.793627], [7641, -9.793903], [26216, -9.821757], [54882, -9.841914], [327, -9.843869], [19952, -9.858157], [8254, -9.891617], [3660, -9.892802], [828, -9.937858], [5397, -9.963739], [15087, -9.96481], [82073, -9.981944], [3806, -9.985322], [4225, -9.989341], [318, -9.990586], [21393, -9.995071], [1744, -10.031897], [9169, -10.051917], [5220, -10.051984], [7411, -10.058757], [23373, -10.072803], [3437, -10.080752], [13636, -10.123435], [2048, -10.135055], [851, -10.193873], [2584, -10.206373], [27840, -10.246389], [31046, -10.24966], [946, -10.267531], [3166, -10.285964], [11234, -10.296362], [9662, -10.325132], [49484, -10.339658], [14197, -10.351418], [13074, -10.361389], [6131, -10.368973], [3326, -10.369294], [2417, -10.385162], [1436, -10.429019], [12386, -10.450786], [9344, -10.457411]], "logprob_of_token": -0.700852, "top1_top2_margin": 0.675332, "top6_top7_margin": 0.022108}, {"gen_index": 5, "token": 9255, "top": [[9255, -0.453025], [6980, -1.600735], [14390, -3.332731], [6662, -3.624898], [5397, -4.069798], [14232, -4.457481], [15967, -4.830958], [5763, -4.856422], [11818, -4.982932], [2322, -5.30998], [1444, -5.716962], [6547, -6.046112], [5516, -6.06708], [7252, -6.242582], [9669, -6.446844], [15038, -6.447952], [2929, -6.865599], [5032, -6.951992], [5481, -6.954216], [7771, -6.972985], [17295, -7.029527], [5432, -7.047341], [7792, -7.159201], [3515, -7.215187], [995, -7.260384], [2991, -7.405138], [5171, -7.513629], [9322, -7.6852], [479, -7.893386], [13919, -7.980861], [7296, -8.033038], [1133, -8.052311], [7278, -8.091324], [1161, -8.100793], [14386, -8.114719], [16605, -8.324546], [26604, -8.358386], [1840, -8.450502], [29350, -8.470932], [2420, -8.490762], [5501, -8.517118], [1995, -8.562325], [43035, -8.571141], [64315, -8.592808], [30488, -8.59895], [125920, -8.622326], [10828, -8.639579], [6634, -8.657728], [6014, -8.689887], [10699, -8.787727], [10636, -8.825954], [5987, -8.829325], [19829, -8.83124], [32, -8.899244], [23385, -8.90139], [121222, -8.904899], [5498, -8.953453], [1075, -8.953538], [26458, -8.955753], [26796, -8.956727], [22090, -8.964267], [3754, -8.977096], [37560, -8.991714], [14197, -9.004772], [4595, -9.03423], [40165, -9.052714], [19213, -9.054839], [22130, -9.095459], [1560, -9.119716], [54456, -9.18897], [16463, -9.198641], [75361, -9.207454], [726, -9.241526], [1735, -9.253541], [8658, -9.29629], [31663, -9.298276], [76213, -9.31087], [4711, -9.366444], [14600, -9.38161], [5240, -9.383649], [9593, -9.387799], [13331, -9.401351], [2932, -9.456634], [13438, -9.482332], [12999, -9.515734], [4222, -9.54304], [946, -9.625047], [14856, -9.634312], [24580, -9.639178], [23851, -9.650107], [26927, -9.650331], [24081, -9.652751], [1788, -9.685438], [15109, -9.70361], [52951, -9.712717], [1427, -9.724015], [6523, -9.726974], [54901, -9.729571], [28800, -9.738427], [9674, -9.746487]], "logprob_of_token": -0.453025, "top1_top2_margin": 1.14771, "top6_top7_margin": 0.373477}, {"gen_index": 6, "token": 279, "top": [[279, -0.71508], [6547, -0.78054], [46, -4.063272], [44, -4.503077], [286, -4.669266], [22130, -5.53514], [779, -5.999345], [275, -6.401587], [59, -6.435038], [3756, -7.504812], [936, -7.913919], [314, -8.24332], [9255, -8.880745], [474, -8.944555], [7252, -9.055679], [622, -9.074173], [5216, -9.146024], [327, -9.173954], [502, -9.213601], [124214, -9.244558], [75361, -9.24972], [14205, -9.32356], [5763, -9.337856], [43035, -9.557227], [834, -9.855959], [3547, -9.935441], [1444, -9.972139], [1366, -10.033831], [766, -10.140038], [14476, -10.157676], [14197, -10.184914], [393, -10.319265], [4338, -10.340881], [379, -10.386392], [14232, -10.455555], [1275, -10.472926], [5090, -10.509251], [1112, -10.530359], [5240, -10.595954], [120007, -10.619963], [63, -10.647787], [58, -10.731258], [735, -10.783608], [14188, -10.801004], [5481, -10.810803], [35038, -10.839157], [262, -10.855001], [36758, -10.937871], [589, -10.96596], [2322, -10.988468], [1790, -10.997534], [2930, -11.03325], [799, -11.051707], [14390, -11.054765], [2457, -11.115188], [37112, -11.148372], [1409, -11.220768], [318, -11.285501], [7789, -11.306367], [777, -11.320141], [3666, -11.35197], [2107, -11.357723], [4086, -11.368467], [2288, -11.407705], [739, -11.432996], [4711, -11.434898], [1829, -11.438376], [14346, -11.478787], [310, -11.481325], [1042, -11.547565], [5502, -11.560218], [42586, -11.566069], [4508, -11.586629], [467, -11.591032], [9598, -11.612255], [378, -11.647315], [7331, -11.650429], [4225, -11.686193], [121222, -11.689225], [33, -11.712229], [17111, -11.749612], [10, -11.776793], [527, -11.791609], [15437, -11.809526], [5501, -11.830532], [9669, -11.831446], [18060, -11.893906], [4191, -11.913678], [3158, -11.920236], [20076, -11.926641], [7532, -11.929934], [3395, -11.935465], [763, -11.955779], [28872, -11.989429], [12020, -11.991026], [32, -12.015432], [4743, -12.028493], [263, -12.075724], [1739, -12.087742], [14181, -12.095608]], "logprob_of_token": -0.71508, "top1_top2_margin": 0.065459, "top6_top7_margin": 0.464205}, {"gen_index": 7, "token": 5240, "top": [[5240, -0.103413], [262, -2.448614], [75361, -5.548091], [7252, -6.511384], [1739, -7.265347], [1283, -7.481599], [67370, -7.952134], [28872, -7.952202], [41875, -8.378457], [6131, -8.429], [99932, -8.776416], [16424, -8.879398], [6622, -8.938263], [941, -9.083352], [26103, -9.215962], [3465, -9.303943], [4955, -9.375484], [43425, -9.384121], [6619, -9.405803], [900, -9.467938], [21690, -9.831328], [3312, -10.029391], [20733, -10.145898], [393, -10.281021], [43662, -10.292312], [32, -10.353772], [6392, -10.398421], [2213, -10.419674], [120007, -10.594086], [9255, -10.600636], [3327, -10.624763], [54901, -10.690228], [1806, -10.726884], [597, -10.729979], [327, -10.742915], [4549, -10.763248], [468, -10.766613], [938, -10.872639], [13748, -10.901331], [3166, -10.939765], [1776, -10.983757], [543, -11.085427], [21110, -11.129707], [6905, -11.165732], [3871, -11.204778], [10347, -11.225425], [16694, -11.237335], [18462, -11.238007], [286, -11.300761], [17907, -11.319221], [23064, -11.320098], [37270, -11.349639], [22553, -11.353837], [762, -11.367608], [14856, -11.367694], [13131, -11.370782], [8546, -11.378445], [8207, -11.378807], [23670, -11.383334], [565, -11.387378], [1840, -11.40824], [2807, -11.429627], [106198, -11.44046], [2986, -11.447729], [17203, -11.465293], [2403, -11.473534], [2150, -11.48451], [17133, -11.512722], [622, -11.514108], [1436, -11.565006], [20624, -11.586084], [13182, -11.588716], [1862, -11.602981], [13919, -11.613998], [5481, -11.615813], [58630, -11.623746], [16474, -11.638766], [502, -11.642909], [3602, -11.65371], [23441, -11.667087], [5345, -11.667498], [54482, -11.674478], [25997, -11.683881], [4203, -11.714009], [966, -11.725661], [13668, -11.726064], [15368, -11.777748], [8784, -11.781322], [3326, -11.801558], [22804, -11.801704], [766, -11.802527], [2246, -11.847198], [47699, -11.848388], [103219, -11.862443], [5274, -11.873819], [44, -11.878554], [12813, -11.879056], [24328, -11.893048], [279, -11.8933], [120022, -11.930165]], "logprob_of_token": -0.103413, "top1_top2_margin": 2.3452, "top6_top7_margin": 0.470534}, {"gen_index": 8, "token": 46, "top": [[46, -0.561985], [286, -1.64692], [44, -2.052217], [275, -2.706178], [59, -4.411422], [314, -4.433134], [779, -5.114922], [7789, -6.133554], [936, -6.543835], [589, -6.648255], [3756, -6.954038], [766, -7.712215], [327, -7.72105], [63, -7.88865], [120007, -8.534723], [393, -8.594658], [799, -8.732182], [1275, -8.761672], [622, -8.766886], [834, -8.770813], [3326, -9.180076], [120399, -9.223872], [735, -9.38291], [739, -9.471678], [4137, -9.525374], [14188, -9.599762], [1043, -9.639759], [75361, -9.6769], [58, -9.677553], [1112, -9.69549], [617, -9.739224], [474, -9.820028], [36209, -9.924182], [263, -9.956186], [120016, -9.960289], [2930, -10.097622], [2457, -10.104116], [777, -10.104689], [33, -10.122313], [1231, -10.165809], [279, -10.175152], [310, -10.241596], [502, -10.348292], [3863, -10.373601], [5407, -10.417873], [262, -10.434399], [467, -10.4401], [4191, -10.460579], [120001, -10.550349], [10, -10.56588], [1829, -10.587547], [4086, -10.600005], [5090, -10.605799], [13636, -10.610629], [120230, -10.736481], [1409, -10.762778], [30989, -10.765597], [378, -10.864256], [379, -10.888261], [120064, -10.976927], [15132, -11.024956], [14153, -11.037397], [1765, -11.123601], [120000, -11.132307], [4265, -11.149238], [120003, -11.154159], [1444, -11.158309], [5240, -11.180011], [2051, -11.2176], [13594, -11.276391], [1988, -11.278913], [120022, -11.280931], [120068, -11.323788], [4508, -11.324719], [1790, -11.330712], [1972, -11.361025], [9169, -11.391394], [6000, -11.412563], [420, -11.41549], [4225, -11.42124], [405, -11.424152], [919, -11.471704], [527, -11.548656], [460, -11.549908], [669, -11.567587], [543, -11.57264], [14052, -11.588957], [7692, -11.629873], [9255, -11.647296], [120021, -11.669441], [270, -11.691643], [5639, -11.692446], [120048, -11.701632], [14386, -11.704647], [318, -11.749169], [120241, -11.767428], [476, -11.781639], [93457, -11.799293], [2519, -11.822102], [120008, -11.827379]], "logprob_of_token": -0.561985, "top1_top2_margin": 1.084935, "top6_top7_margin": 0.681788}, {"gen_index": 9, "token": 75361, "top": [[75361, -0.330794], [543, -2.490302], [1231, -2.675547], [1914, -3.537038], [5240, -3.696958], [120014, -4.473774], [3960, -4.90321], [9980, -4.987676], [669, -6.106763], [6693, -6.328364], [14896, -6.453751], [1336, -6.530527], [120004, -6.588944], [7252, -6.766805], [6372, -6.788564], [8337, -6.947662], [4759, -7.092023], [1692, -7.21181], [2560, -7.297591], [1905, -7.326832], [4246, -7.339848], [14161, -7.346677], [1194, -7.375393], [20733, -7.472387], [717, -7.518418], [611, -7.520134], [1988, -7.533963], [8067, -7.581788], [14147, -7.606058], [1741, -7.727067], [32, -7.778975], [6131, -7.802412], [1689, -7.85995], [3780, -8.012463], [4001, -8.086814], [766, -8.111879], [14053, -8.179264], [23251, -8.186982], [63585, -8.271531], [11533, -8.280759], [34122, -8.302513], [6814, -8.30926], [2284, -8.322184], [41390, -8.437506], [15934, -8.488297], [6455, -8.544859], [76115, -8.573792], [106198, -8.581412], [7339, -8.66223], [5775, -8.73502], [742, -8.749393], [3501, -8.753753], [26103, -8.774405], [3872, -8.821671], [28872, -8.844585], [7302, -8.926123], [3832, -8.98917], [23441, -9.022104], [8758, -9.130541], [18757, -9.134809], [6104, -9.137043], [4361, -9.138915], [1254, -9.155496], [17285, -9.194124], [8009, -9.221062], [5274, -9.226646], [7189, -9.233997], [127906, -9.268203], [6123, -9.323101], [20321, -9.325432], [37061, -9.344024], [97820, -9.347818], [7510, -9.356487], [1962, -9.362555], [104647, -9.382067], [2751, -9.39827], [13389, -9.423649], [5438, -9.431728], [67370, -9.441315], [7643, -9.455863], [1010, -9.46587], [10067, -9.474535], [2743, -9.475695], [476, -9.47599], [1409, -9.508503], [2807, -9.539639], [523, -9.548748], [1048, -9.57963], [4408, -9.581675], [1957, -9.581684], [20259, -9.591679], [7515, -9.600871], [8266, -9.621067], [2865, -9.634023], [5513, -9.642028], [4955, -9.670657], [3914, -9.671341], [4888, -9.678146], [58209, -9.685008], [784, -9.686929]], "logprob_of_token": -0.330794, "top1_top2_margin": 2.159509, "top6_top7_margin": 0.429436}, {"gen_index": 10, "token": 735, "top": [[735, -0.219205], [378, -2.036697], [4278, -3.786479], [919, -4.364099], [44, -4.676873], [589, -5.098885], [11201, -6.245733], [7789, -6.412693], [52776, -6.553286], [14439, -6.635589], [46, -7.133049], [1410, -7.779206], [286, -8.025517], [13032, -8.246965], [58, -8.427554], [476, -8.473445], [10757, -8.514091], [21925, -8.52384], [10471, -8.680556], [14598, -8.713969], [14380, -8.801311], [4088, -8.805634], [4617, -8.811979], [275, -8.8243], [1958, -8.863961], [262, -8.938731], [16740, -9.004532], [766, -9.015872], [37296, -9.110806], [622, -9.119406], [11319, -9.214488], [617, -9.283499], [439, -9.329768], [7330, -9.450791], [4440, -9.451134], [120007, -9.462228], [1270, -9.478841], [6547, -9.554334], [20615, -9.710402], [1812, -9.73921], [8140, -9.808389], [58415, -9.858621], [12195, -9.89763], [4884, -9.963778], [830, -9.977824], [75361, -9.990129], [4191, -10.031263], [4384, -10.082947], [976, -10.105815], [2347, -10.146055], [5240, -10.174912], [8150, -10.18671], [13438, -10.190219], [2879, -10.199672], [4225, -10.233608], [314, -10.271142], [1275, -10.282963], [14262, -10.284648], [9255, -10.353892], [13493, -10.355491], [1656, -10.381255], [19701, -10.396625], [14153, -10.441987], [1064, -10.452378], [9169, -10.460732], [6513, -10.519601], [576, -10.559234], [13636, -10.587112], [13308, -10.596813], [11338, -10.599349], [20748, -10.619008], [4032, -10.623607], [9669, -10.651837], [824, -10.679927], [26216, -10.68091], [14188, -10.702202], [38863, -10.719316], [279, -10.719562], [1030, -10.770797], [16404, -10.787869], [5598, -10.795121], [5216, -10.813144], [11265, -10.821488], [1829, -10.879926], [528, -10.896744], [662, -10.931463], [19661, -10.937507], [63, -10.958291], [17155, -10.958918], [120022, -10.963908], [9727, -11.009367], [37322, -11.074618], [18227, -11.080166], [5415, -11.102708], [11317, -11.103851], [3725, -11.180802], [2807, -11.199819], [87805, -11.227734], [20773, -11.229556], [11308, -11.236403]], "logprob_of_token": -0.219205, "top1_top2_margin": 1.817492, "top6_top7_margin": 1.146848}, {"gen_index": 11, "token": 7789, "top": [[7789, -0.684612], [941, -1.599159], [262, -1.835038], [1410, -2.580433], [622, -3.736016], [5407, -5.067179], [502, -5.069961], [15132, -5.618517], [2150, -6.000785], [13438, -6.290527], [834, -6.614531], [5639, -6.736056], [799, -7.145288], [5240, -7.463264], [75361, -7.625746], [2602, -7.773242], [14052, -7.906127], [1075, -8.12493], [2403, -8.186753], [6030, -8.194304], [9255, -8.314872], [10301, -8.646548], [3145, -8.760202], [14386, -8.867192], [2457, -8.915416], [1739, -8.916215], [4619, -9.015902], [4191, -9.075101], [23132, -9.131134], [85056, -9.197694], [2642, -9.373773], [15967, -9.374949], [3647, -9.38005], [1812, -9.405694], [2288, -9.477519], [1127, -9.506951], [8784, -9.515313], [82073, -9.52974], [32, -9.615773], [2769, -9.645915], [12511, -9.673898], [63248, -9.737432], [2584, -9.793955], [7252, -9.79516], [5874, -9.819519], [3379, -9.908824], [14380, -9.926026], [2702, -9.983067], [3892, -9.991901], [3327, -10.053874], [851, -10.089324], [1781, -10.10237], [13969, -10.114232], [3893, -10.126384], [121222, -10.15145], [72062, -10.171817], [2653, -10.189332], [33499, -10.223428], [15038, -10.224302], [923, -10.267611], [3660, -10.318112], [2048, -10.333398], [8255, -10.345508], [3137, -10.413495], [3992, -10.449654], [4518, -10.472276], [33807, -10.477554], [1436, -10.519239], [762, -10.528585], [26216, -10.540323], [3368, -10.544168], [1744, -10.544873], [5929, -10.569341], [9344, -10.578305], [3918, -10.606439], [7641, -10.61185], [19952, -10.627349], [18783, -10.644254], [15087, -10.646947], [17414, -10.65822], [900, -10.667041], [828, -10.676225], [2605, -10.698184], [13636, -10.707483], [3326, -10.707865], [7411, -10.728511], [6846, -10.743808], [8129, -10.761466], [19693, -10.769256], [11960, -10.807924], [1444, -10.812238], [4205, -10.815304], [327, -10.826606], [2575, -10.858451], [2249, -10.872497], [16330, -10.875974], [5220, -10.892258], [67873, -10.90363], [5445, -10.945974], [3096, -10.958429]], "logprob_of_token": -0.684612, "top1_top2_margin": 0.914547, "top6_top7_margin": 0.002782}, {"gen_index": 12, "token": 622, "top": [[622, -0.081199], [834, -2.674149], [2457, -5.034026], [2288, -6.970887], [121222, -8.16808], [2769, -8.772044], [120007, -9.207801], [3660, -9.305516], [6791, -9.559796], [467, -9.979779], [14667, -10.046049], [318, -10.172091], [16330, -10.234175], [799, -10.260322], [8255, -10.310628], [4529, -10.574616], [21393, -10.732066], [923, -10.850444], [1275, -10.966712], [120022, -10.978215], [4518, -11.007899], [7252, -11.15344], [4610, -11.288523], [46, -11.450892], [502, -11.490085], [14570, -11.784531], [15597, -11.844264], [279, -11.876306], [5675, -11.905231], [5240, -11.934945], [262, -11.941394], [29250, -11.950582], [1972, -11.959702], [15135, -12.045489], [1744, -12.052281], [745, -12.113886], [828, -12.1397], [3165, -12.151441], [310, -12.16527], [1444, -12.265283], [75361, -12.272948], [6846, -12.275611], [16383, -12.280131], [5146, -12.293351], [32, -12.317361], [1474, -12.393003], [15673, -12.416575], [3583, -12.507422], [4907, -12.537463], [3093, -12.582013], [379, -12.586169], [2025, -12.603328], [1155, -12.607933], [717, -12.609619], [900, -12.618231], [27246, -12.6282], [63, -12.642184], [1112, -12.686011], [120016, -12.710025], [7331, -12.721883], [2625, -12.754928], [474, -12.778224], [2046, -12.804442], [7789, -12.823552], [938, -12.831725], [941, -12.831839], [44, -12.863071], [393, -12.875703], [14942, -12.887321], [7641, -12.895741], [763, -12.945094], [28872, -12.946372], [90255, -12.959525], [9538, -12.970022], [3755, -13.014759], [11234, -13.015199], [762, -13.091859], [38925, -13.106898], [1790, -13.137941], [14856, -13.141197], [13658, -13.154571], [54482, -13.175246], [1637, -13.21213], [8975, -13.227082], [3919, -13.233582], [1093, -13.251739], [15132, -13.252883], [4080, -13.268268], [685, -13.276014], [120410, -13.277399], [735, -13.279238], [3977, -13.291705], [86955, -13.305513], [10617, -13.325518], [327, -13.344493], [12749, -13.358617], [8784, -13.366377], [42296, -13.375179], [4205, -13.376557], [6380, -13.39482]], "logprob_of_token": -0.081199, "top1_top2_margin": 2.59295, "top6_top7_margin": 0.435757}, {"gen_index": 13, "token": 262, "top": [[262, -0.032218], [7252, -3.916158], [5240, -5.529859], [1283, -5.699623], [75361, -6.326711], [54482, -7.023061], [14856, -8.966296], [67370, -8.967914], [16424, -9.067069], [834, -9.122808], [941, -9.297248], [3465, -9.833524], [27992, -9.841264], [43425, -10.151923], [762, -10.223411], [120007, -10.2604], [393, -10.817243], [13919, -10.829127], [41875, -10.875635], [14871, -10.962307], [28872, -10.97185], [29250, -11.047137], [938, -11.050964], [9255, -11.064034], [50394, -11.13161], [3312, -11.239491], [4881, -11.252122], [900, -11.259749], [2150, -11.307219], [8546, -11.30967], [89226, -11.406575], [14667, -11.429618], [17907, -11.443174], [8207, -11.458646], [543, -11.656326], [32, -11.691685], [54901, -11.782889], [63870, -11.8625], [56768, -11.945409], [22130, -12.070143], [5521, -12.078424], [8615, -12.085694], [37112, -12.100656], [6392, -12.167593], [19246, -12.196315], [12813, -12.238029], [26103, -12.243323], [597, -12.261962], [16474, -12.268764], [120022, -12.30576], [6622, -12.341861], [1133, -12.356371], [106198, -12.413762], [20733, -12.456165], [37270, -12.51625], [34140, -12.549863], [622, -12.603868], [3326, -12.622405], [4203, -12.62395], [1920, -12.628339], [4305, -12.71033], [261, -12.719274], [23441, -12.73405], [36758, -12.737844], [13748, -12.825034], [6866, -12.82767], [2403, -12.8362], [9593, -12.852697], [99932, -12.917884], [14197, -12.930595], [2986, -12.953436], [8960, -12.989228], [2288, -12.995418], [106433, -13.050319], [2420, -13.061571], [3327, -13.080255], [21690, -13.088061], [2246, -13.107353], [1389, -13.129104], [327, -13.149403], [49146, -13.193597], [2807, -13.202517], [24405, -13.204112], [21986, -13.218588], [2457, -13.220351], [1744, -13.227172], [6781, -13.234615], [1739, -13.249617], [8734, -13.279417], [4955, -13.283055], [18462, -13.309998], [745, -13.33259], [8255, -13.419127], [1862, -13.440911], [8382, -13.453963], [7940, -13.457442], [5274, -13.463747], [3096, -13.47432], [9071, -13.479206], [43035, -13.486978]], "logprob_of_token": -0.032218, "top1_top2_margin": 3.88394, "top6_top7_margin": 1.943235}, {"gen_index": 14, "token": 7252, "top": [[7252, -0.006369], [75361, -6.062605], [54482, -7.758632], [13919, -7.852929], [28872, -8.062071], [50394, -8.240054], [9255, -8.405437], [9593, -8.579066], [22130, -8.834402], [14856, -8.962554], [6187, -9.170347], [5240, -9.203398], [37112, -9.261868], [2420, -9.346598], [8615, -9.639709], [4338, -9.799621], [14871, -9.823389], [29250, -9.916059], [27992, -9.958142], [3465, -10.003529], [89226, -10.21031], [3312, -10.354309], [14232, -10.496313], [36758, -10.504616], [21690, -10.567795], [54901, -10.740583], [5763, -10.744778], [8382, -10.769047], [106433, -10.774292], [8207, -10.88294], [14667, -10.886154], [1366, -10.923141], [4881, -11.000575], [5481, -11.231987], [2107, -11.257513], [26758, -11.31856], [1920, -11.537284], [106198, -11.562925], [4305, -11.61462], [114279, -11.709215], [2962, -11.719433], [1283, -11.739771], [84803, -11.776974], [38337, -11.81414], [6662, -11.871828], [28999, -11.886459], [25001, -11.900155], [6209, -11.956268], [59342, -12.031871], [12813, -12.079443], [834, -12.08167], [17907, -12.093916], [10829, -12.101928], [5521, -12.222663], [65382, -12.223562], [20733, -12.242336], [8960, -12.257463], [23995, -12.258717], [9502, -12.28697], [34140, -12.307796], [5987, -12.310912], [3960, -12.332375], [24405, -12.357635], [11240, -12.38519], [7017, -12.387487], [19246, -12.407227], [2807, -12.427403], [68072, -12.439775], [43425, -12.51705], [56768, -12.566105], [63585, -12.599531], [13096, -12.606356], [41875, -12.624023], [121222, -12.676531], [1389, -12.682568], [4960, -12.706649], [23367, -12.715812], [67370, -12.718611], [23441, -12.724315], [16424, -12.758751], [63870, -12.762882], [14390, -12.844714], [28914, -12.857031], [1937, -12.870749], [48189, -12.88599], [5002, -12.91655], [2920, -12.923754], [8546, -12.930017], [23799, -12.937377], [476, -12.957217], [14181, -12.977108], [17111, -12.978869], [26103, -12.982622], [16474, -12.983522], [26835, -13.03471], [6480, -13.048028], [36398, -13.111868], [20065, -13.146713], [33029, -13.156436], [18028, -13.176661]], "logprob_of_token": -0.006369, "top1_top2_margin": 6.056236, "top6_top7_margin": 0.165383}, {"gen_index": 15, "token": 13919, "top": [[13919, -0.000654], [9255, -7.44448], [52684, -10.549218], [35330, -11.883224], [69505, -12.428955], [75361, -12.48586], [57501, -12.630986], [9593, -12.79371], [16399, -13.121492], [37112, -13.234026], [54901, -13.327229], [21690, -13.493184], [22130, -13.75499], [7252, -13.929621], [3336, -14.451688], [2420, -14.605719], [26114, -14.785373], [125920, -14.94616], [25001, -14.983277], [9728, -15.154286], [12813, -15.199094], [36758, -15.231019], [19617, -15.249805], [22090, -15.250341], [6480, -15.261954], [5002, -15.342459], [89128, -15.459461], [85056, -15.483596], [16474, -15.622999], [12342, -15.662761], [63442, -15.772398], [5690, -15.83208], [23799, -15.84489], [18945, -15.864811], [59342, -15.883245], [38337, -16.019627], [37748, -16.086576], [6146, -16.095613], [87340, -16.163054], [43014, -16.173538], [11094, -16.199728], [68907, -16.239643], [27992, -16.251709], [62453, -16.263477], [35358, -16.276569], [26411, -16.299051], [18363, -16.346106], [36618, -16.385084], [6209, -16.414492], [5481, -16.439135], [50774, -16.491236], [32019, -16.524935], [18669, -16.598471], [29617, -16.739466], [5898, -16.825731], [28872, -16.904226], [4711, -16.921366], [14871, -16.948521], [61473, -16.972553], [20291, -16.975241], [32731, -16.979662], [23280, -17.016462], [11710, -17.026293], [58949, -17.114706], [8615, -17.154243], [9502, -17.305552], [54482, -17.325527], [42629, -17.354933], [3808, -17.38509], [11240, -17.391062], [46120, -17.395887], [13247, -17.451094], [25019, -17.464821], [17003, -17.471258], [16409, -17.479605], [16424, -17.487041], [119822, -17.529413], [5156, -17.564352], [5234, -17.586676], [89226, -17.58824], [34140, -17.596626], [3960, -17.598034], [45419, -17.598488], [3465, -17.600847], [54983, -17.605026], [39909, -17.61064], [19412, -17.651382], [91617, -17.696507], [995, -17.710398], [27214, -17.723215], [25748, -17.728777], [9346, -17.734892], [55916, -17.738661], [8960, -17.741356], [14655, -17.742613], [6662, -17.756645], [13096, -17.757833], [6622, -17.774515], [49931, -17.789526], [2807, -17.81259]], "logprob_of_token": -0.000654, "top1_top2_margin": 7.443826, "top6_top7_margin": 0.145126}, {"gen_index": 16, "token": 37112, "top": [[37112, -3.4e-05], [59342, -12.163361], [22130, -12.394899], [6187, -12.458388], [63091, -12.820167], [72805, -13.22027], [55898, -13.659981], [72755, -13.715622], [50037, -13.932981], [109249, -14.051713], [18463, -14.501507], [60878, -14.559458], [13096, -14.684853], [3095, -14.757731], [41205, -14.902037], [53035, -14.953529], [34919, -15.03228], [36758, -15.214361], [39889, -15.240376], [5216, -15.442143], [11408, -15.566583], [24557, -15.575426], [11101, -15.577568], [114051, -15.623068], [80239, -15.652416], [35711, -15.697114], [120007, -15.738832], [19132, -15.747387], [54413, -15.75935], [2920, -15.779888], [22339, -15.851704], [12525, -15.909441], [9379, -15.921435], [11710, -15.971827], [9848, -15.974405], [13200, -16.01325], [8814, -16.056379], [13967, -16.065311], [98611, -16.110123], [27460, -16.215891], [64946, -16.310911], [39139, -16.354828], [76669, -16.366407], [17667, -16.537214], [14258, -16.544203], [47743, -16.596148], [15670, -16.635529], [16720, -16.65151], [21316, -16.651695], [50231, -16.659664], [59834, -16.719612], [4708, -16.722717], [21690, -16.72949], [23968, -16.768267], [27108, -16.800444], [29295, -16.812317], [13919, -16.847609], [79438, -16.875679], [25322, -16.88315], [13892, -16.964073], [5784, -16.971642], [23787, -16.979332], [38373, -17.025593], [75361, -17.060825], [119568, -17.095432], [115, -17.111919], [75508, -17.114799], [14115, -17.153601], [36728, -17.160606], [38130, -17.186548], [6209, -17.211229], [23987, -17.252163], [6624, -17.263727], [21437, -17.302721], [86759, -17.317791], [54260, -17.388996], [66095, -17.399906], [112912, -17.41638], [6146, -17.438459], [120022, -17.457211], [120016, -17.458069], [21822, -17.478739], [55905, -17.489792], [42397, -17.540316], [36223, -17.546967], [46, -17.575016], [112924, -17.587368], [279, -17.609121], [9736, -17.615211], [24426, -17.616512], [9593, -17.618896], [5418, -17.633621], [4519, -17.645382], [13205, -17.666571], [8615, -17.67338], [18669, -17.676205], [21126, -17.697628], [6597, -17.741692], [51897, -17.74666], [43035, -17.777624]], "logprob_of_token": -3.4e-05, "top1_top2_margin": 12.163327, "top6_top7_margin": 0.439711}, {"gen_index": 17, "token": 46, "top": [[46, -0.409737], [766, -1.318228], [275, -3.423332], [44, -3.901871], [314, -4.871673], [834, -5.114256], [622, -7.978035], [393, -8.214187], [279, -9.29985], [286, -9.410493], [63, -9.435526], [2457, -9.526763], [28872, -9.562424], [59, -9.611803], [120007, -9.728365], [7252, -10.015263], [120399, -10.207886], [4610, -10.469672], [523, -10.558105], [936, -10.806694], [120016, -10.846382], [25997, -10.96254], [2769, -11.008852], [14188, -11.094093], [1275, -11.116417], [48237, -11.141431], [58, -11.165668], [5240, -11.329068], [120001, -11.42698], [75361, -11.481241], [40, -11.512671], [10, -11.554943], [1829, -11.602734], [2288, -11.727124], [327, -11.781439], [4137, -11.855274], [67581, -11.931965], [10829, -11.933627], [6391, -11.966122], [36209, -11.970783], [263, -11.985733], [120230, -12.075304], [120021, -12.128565], [1112, -12.149445], [262, -12.16339], [14153, -12.179552], [799, -12.219305], [15135, -12.236975], [1043, -12.242985], [310, -12.288731], [122981, -12.442019], [33, -12.44976], [120048, -12.500832], [4529, -12.536886], [3688, -12.575705], [7789, -12.643744], [379, -12.678291], [36198, -12.681149], [120099, -12.691118], [589, -12.69297], [103219, -12.729868], [120360, -12.770521], [2807, -12.777622], [120241, -12.784452], [763, -12.791451], [51992, -12.818041], [18813, -12.826095], [120003, -12.835039], [1790, -12.844461], [12611, -12.880571], [13594, -12.901948], [120000, -12.91156], [120864, -12.954779], [121146, -13.021738], [81125, -13.02428], [69722, -13.028508], [120347, -13.053674], [126091, -13.054992], [12749, -13.056259], [779, -13.076214], [3863, -13.076595], [120022, -13.103804], [120338, -13.107584], [121172, -13.175844], [745, -13.186707], [543, -13.207809], [460, -13.212451], [44455, -13.217598], [405, -13.240474], [4518, -13.241262], [7510, -13.251345], [120667, -13.258392], [120885, -13.260647], [93457, -13.262383], [120068, -13.270742], [32, -13.31358], [1765, -13.31775], [43933, -13.329479], [120002, -13.350259], [318, -13.362963]], "logprob_of_token": -0.409737, "top1_top2_margin": 0.908491, "top6_top7_margin": 2.863779}, {"gen_index": 18, "token": 75361, "top": [[75361, -0.354432], [543, -1.30981], [7252, -5.469668], [5240, -5.716533], [1231, -6.181064], [3960, -6.268052], [120014, -6.518928], [1914, -6.988538], [6693, -7.917089], [1336, -8.232084], [717, -8.372187], [4759, -8.393498], [120004, -8.561172], [20733, -8.628208], [11533, -8.647464], [28872, -8.69558], [1194, -8.764383], [34122, -8.807099], [106198, -8.838367], [14896, -8.90362], [1689, -8.952531], [76115, -9.005057], [3780, -9.022393], [63585, -9.057117], [1988, -9.074322], [6131, -9.113564], [1905, -9.126602], [8067, -9.1428], [14161, -9.308856], [6455, -9.338395], [5775, -9.373487], [2560, -9.385671], [669, -9.396164], [32, -9.432487], [1692, -9.466593], [14147, -9.503986], [97820, -9.519245], [611, -9.552958], [8382, -9.694172], [23441, -9.738902], [6372, -9.773946], [15934, -9.788294], [26103, -9.842028], [4246, -9.852292], [2284, -9.904729], [9980, -9.958323], [104647, -9.973468], [476, -10.043531], [523, -10.045131], [325, -10.058216], [20321, -10.096782], [6123, -10.119417], [58209, -10.179067], [3312, -10.204653], [6104, -10.215321], [262, -10.241932], [5274, -10.25537], [5513, -10.265121], [3463, -10.268876], [766, -10.271358], [784, -10.278537], [21690, -10.319528], [2861, -10.328851], [3501, -10.333807], [41390, -10.337254], [7302, -10.369826], [1010, -10.374488], [6814, -10.391601], [127906, -10.392621], [4361, -10.396237], [7189, -10.450801], [7510, -10.462369], [742, -10.471768], [2743, -10.509068], [5438, -10.510469], [1254, -10.51769], [1048, -10.527755], [4001, -10.558039], [1741, -10.566579], [49123, -10.591776], [37061, -10.604453], [120022, -10.611667], [106433, -10.613538], [50394, -10.656048], [2291, -10.667088], [29296, -10.669747], [25808, -10.677715], [8546, -10.681751], [9830, -10.682813], [17285, -10.707097], [4408, -10.708782], [8758, -10.723485], [34140, -10.735704], [7643, -10.738448], [8265, -10.738869], [9093, -10.743989], [16545, -10.754014], [3832, -10.757837], [67370, -10.779483], [17299, -10.793012]], "logprob_of_token": -0.354432, "top1_top2_margin": 0.955378, "top6_top7_margin": 0.250875}, {"gen_index": 19, "token": 735, "top": [[735, -0.212378], [378, -1.790664], [919, -4.169396], [4278, -5.891399], [11201, -6.511592], [589, -6.664922], [44, -7.770714], [14598, -8.424616], [14439, -8.568264], [52776, -8.574988], [37296, -9.053484], [11319, -9.408178], [976, -9.62545], [286, -9.771168], [21925, -9.817799], [14380, -9.914948], [476, -9.947709], [16740, -9.962156], [46, -9.971795], [1958, -10.08847], [4617, -10.116938], [10471, -10.145821], [4088, -10.224075], [13032, -10.331398], [1270, -10.43933], [58, -10.446482], [622, -10.495633], [20615, -10.53212], [439, -10.589923], [34643, -10.644033], [2347, -10.69384], [4440, -10.700342], [7330, -10.782881], [830, -10.885467], [617, -10.909969], [4884, -10.939449], [18227, -11.026312], [13636, -11.071905], [8140, -11.112385], [1812, -11.114616], [1030, -11.155619], [66165, -11.157049], [19701, -11.173975], [766, -11.209532], [1656, -11.214891], [21884, -11.218781], [11317, -11.279842], [10852, -11.301952], [6117, -11.344929], [34705, -11.413031], [120007, -11.441857], [13493, -11.442324], [12195, -11.45756], [3865, -11.539478], [330, -11.541338], [10757, -11.552782], [662, -11.56281], [4032, -11.594964], [275, -11.608952], [13648, -11.625063], [10853, -11.644526], [2879, -11.67782], [17155, -11.688063], [6513, -11.706299], [5598, -11.724207], [9727, -11.729265], [32578, -11.737035], [60206, -11.739099], [6547, -11.747096], [13044, -11.757891], [11308, -11.760019], [9169, -11.786028], [824, -11.802654], [20748, -11.806024], [87805, -11.82363], [5240, -11.835684], [1220, -11.85683], [31445, -11.934439], [12745, -11.98546], [26216, -11.996979], [1819, -12.001878], [8944, -12.008246], [8150, -12.018134], [1309, -12.032422], [2286, -12.042894], [2459, -12.059592], [11035, -12.072046], [43019, -12.091436], [4225, -12.115221], [1064, -12.141088], [4384, -12.149761], [1275, -12.214677], [13569, -12.22402], [14896, -12.237539], [46222, -12.300307], [11338, -12.325955], [528, -12.327154], [23463, -12.340494], [17055, -12.344969], [15788, -12.36264]], "logprob_of_token": -0.212378, "top1_top2_margin": 1.578286, "top6_top7_margin": 1.105792}, {"gen_index": 20, "token": 262, "top": [[262, -0.984403], [941, -1.065291], [5407, -1.888355], [15132, -3.146835], [502, -3.819507], [622, -4.62986], [2602, -5.194711], [7789, -5.199215], [13438, -5.203771], [1410, -5.235518], [2769, -5.790538], [8255, -5.908439], [5240, -5.915622], [1075, -6.018554], [834, -6.050984], [923, -6.128013], [10301, -6.458002], [2457, -6.529399], [2403, -6.742166], [5639, -6.922976], [23132, -7.03643], [2150, -7.095931], [3145, -7.274498], [3892, -7.565602], [75361, -7.8716], [14570, -8.078152], [6846, -8.15414], [799, -8.406199], [14380, -8.498159], [2048, -8.559637], [14667, -8.648767], [32, -8.718623], [2288, -8.789021], [15967, -8.811241], [4191, -8.825964], [3660, -8.949367], [900, -8.97562], [7641, -9.005506], [121222, -9.055865], [3647, -9.062072], [17414, -9.111688], [9255, -9.13888], [14386, -9.260052], [21393, -9.381043], [2702, -9.425174], [1781, -9.49476], [2417, -9.582602], [5220, -9.585477], [1972, -9.598746], [22801, -9.610891], [2584, -9.696031], [851, -9.706664], [1127, -9.725511], [5675, -9.732993], [26216, -9.736107], [6131, -9.744576], [2642, -9.746077], [3379, -9.767634], [2575, -9.770226], [3893, -9.784886], [72062, -9.801934], [7252, -9.839988], [16383, -9.854535], [1444, -9.936688], [19952, -9.952907], [10059, -9.965276], [7456, -10.040387], [4205, -10.060973], [62476, -10.065171], [6030, -10.094871], [5065, -10.103269], [63248, -10.123057], [82073, -10.131711], [3437, -10.15802], [828, -10.18452], [1308, -10.186085], [7025, -10.188226], [18783, -10.192107], [4518, -10.198746], [2932, -10.214057], [15038, -10.239432], [7902, -10.243628], [85056, -10.251013], [14052, -10.259517], [4619, -10.270438], [33499, -10.297679], [7411, -10.350404], [5874, -10.351991], [3093, -10.424377], [8784, -10.424449], [15087, -10.426322], [3806, -10.44022], [1812, -10.45775], [1744, -10.475979], [28019, -10.494706], [3755, -10.498755], [318, -10.501259], [9662, -10.530381], [1918, -10.571799], [49484, -10.580457]], "logprob_of_token": -0.984403, "top1_top2_margin": 0.080888, "top6_top7_margin": 0.564851}, {"gen_index": 21, "token": 6980, "top": [[6980, -0.39496], [9255, -1.780419], [14390, -2.383105], [11818, -4.452945], [6662, -5.161774], [1444, -5.200858], [2991, -5.303867], [1840, -5.514607], [2322, -5.850384], [5397, -5.903284], [15967, -6.011439], [26458, -6.471815], [9322, -6.597424], [7771, -6.609281], [7278, -6.672338], [29350, -6.797248], [14232, -7.041832], [6547, -7.051476], [31663, -7.098048], [7252, -7.186527], [9669, -7.356025], [32, -7.358107], [5763, -7.434339], [10636, -7.445103], [13331, -7.469833], [40165, -7.688156], [5032, -7.93332], [6634, -7.9914], [64315, -8.038294], [5516, -8.039302], [5171, -8.198038], [1075, -8.287603], [8445, -8.359704], [37560, -8.412062], [6014, -8.45348], [48600, -8.594055], [7296, -8.686455], [15038, -8.740544], [5498, -8.784212], [8658, -8.815466], [26796, -8.83194], [1161, -8.969307], [5481, -8.972822], [75361, -9.108768], [69734, -9.144423], [1995, -9.164019], [26604, -9.188223], [86343, -9.204714], [28800, -9.207237], [125920, -9.226054], [14031, -9.290475], [64012, -9.379751], [4711, -9.382734], [19246, -9.388523], [5501, -9.390158], [995, -9.402854], [72733, -9.461972], [14856, -9.494097], [13919, -9.523202], [14600, -9.531092], [24081, -9.560127], [86972, -9.573587], [7792, -9.664782], [3754, -9.736822], [36217, -9.741436], [2420, -9.771696], [1819, -9.812759], [52951, -9.872839], [4595, -9.875267], [67089, -9.92732], [33680, -9.9505], [4063, -9.958806], [14386, -9.977421], [2929, -9.989138], [19829, -10.000397], [6917, -10.014797], [22090, -10.020117], [5240, -10.040899], [4259, -10.057371], [1560, -10.071747], [726, -10.089074], [54387, -10.160756], [68820, -10.180443], [92867, -10.208489], [1788, -10.210854], [10699, -10.216772], [27131, -10.22189], [3515, -10.225208], [15109, -10.238218], [8764, -10.260553], [32405, -10.264578], [9598, -10.289604], [16605, -10.304556], [5432, -10.312548], [19266, -10.315547], [2996, -10.315715], [12999, -10.349171], [14173, -10.380568], [14395, -10.385048], [28346, -10.389174]], "logprob_of_token": -0.39496, "top1_top2_margin": 1.385459, "top6_top7_margin": 0.103009}, {"gen_index": 22, "token": 6547, "top": [[6547, -0.001622], [121222, -7.229407], [9255, -9.022068], [9598, -9.459701], [14205, -9.589561], [286, -9.624021], [14346, -10.02611], [124214, -10.434138], [7252, -10.457505], [14476, -10.579583], [33029, -10.666707], [1819, -10.941691], [3547, -11.500896], [2322, -11.54901], [3395, -11.565221], [13085, -11.621345], [9431, -11.700809], [622, -11.716695], [75361, -11.769848], [5216, -11.79188], [25326, -11.848645], [5763, -11.915858], [279, -12.040136], [22130, -12.236167], [19664, -12.29412], [35038, -12.309829], [23162, -12.403289], [14232, -12.518264], [6662, -12.566419], [2329, -12.718736], [4098, -12.743533], [1874, -12.77184], [7847, -12.791244], [8658, -12.846805], [14197, -13.003641], [3688, -13.008497], [25019, -13.014445], [11793, -13.031287], [2107, -13.143697], [41079, -13.168423], [25127, -13.201944], [14514, -13.20477], [43035, -13.224275], [61645, -13.230577], [98459, -13.291195], [7532, -13.311041], [32331, -13.321253], [60145, -13.332086], [54901, -13.333795], [1827, -13.36833], [27705, -13.435789], [6837, -13.459917], [4711, -13.46013], [14603, -13.473168], [54787, -13.521182], [44, -13.523681], [8382, -13.552573], [15437, -13.560162], [3388, -13.577998], [15967, -13.599455], [262, -13.618171], [22257, -13.686652], [104888, -13.698615], [4103, -13.699205], [16328, -13.710855], [3300, -13.729022], [4551, -13.781121], [12958, -13.790152], [5323, -13.808969], [32878, -13.813269], [14781, -13.834163], [9547, -13.847442], [33018, -13.8518], [15364, -13.87741], [17926, -14.003835], [34568, -14.007756], [13015, -14.010945], [26836, -14.043517], [1995, -14.060199], [30191, -14.062062], [7367, -14.064292], [4536, -14.076213], [59686, -14.089949], [8734, -14.098969], [5501, -14.108308], [3819, -14.117222], [836, -14.128948], [17653, -14.136706], [16406, -14.152221], [9123, -14.154986], [17111, -14.155142], [8983, -14.186057], [2821, -14.202277], [127800, -14.2226], [6170, -14.242908], [43066, -14.250497], [6271, -14.255574], [6755, -14.260859], [3938, -14.263488], [19829, -14.2657]], "logprob_of_token": -0.001622, "top1_top2_margin": 7.227785, "top6_top7_margin": 0.402089}, {"gen_index": 23, "token": 622, "top": [[622, -0.001698], [2457, -6.949277], [279, -8.208735], [286, -9.005898], [2288, -9.673425], [6791, -10.520643], [834, -10.713753], [7789, -10.75165], [120007, -10.766848], [327, -10.855777], [63, -10.973066], [502, -11.445329], [766, -11.915065], [44, -12.064709], [47, -12.086419], [735, -12.279586], [467, -12.435549], [10406, -12.452138], [46, -12.504682], [4518, -12.640753], [3688, -12.849178], [310, -12.920697], [7692, -13.076327], [121222, -13.123612], [936, -13.262661], [262, -13.314804], [120022, -13.34907], [379, -13.364269], [8775, -13.541885], [2625, -13.580469], [717, -13.607463], [258, -13.622087], [1275, -13.677001], [45, -13.682507], [3583, -13.742102], [9255, -13.746156], [474, -13.78322], [13438, -13.850444], [5240, -13.941355], [32, -13.947886], [1155, -14.003068], [318, -14.006231], [393, -14.011643], [1225, -14.036661], [120016, -14.058891], [4529, -14.060169], [42102, -14.089718], [2769, -14.096539], [275, -14.153852], [739, -14.248017], [5639, -14.330166], [75361, -14.337173], [745, -14.349752], [1765, -14.442821], [58, -14.459646], [6030, -14.482654], [28872, -14.52174], [685, -14.525744], [6380, -14.632563], [1744, -14.642632], [7252, -14.736254], [59, -14.74074], [589, -14.750648], [23132, -14.776727], [307, -14.811818], [3660, -14.858339], [1444, -14.877596], [15132, -14.878365], [1043, -14.899142], [17831, -14.909927], [1790, -14.928993], [1112, -14.971479], [5274, -14.994326], [11234, -15.022379], [2602, -15.036076], [1921, -15.046885], [763, -15.115683], [1840, -15.151157], [938, -15.154653], [2362, -15.156153], [777, -15.184086], [799, -15.208321], [4080, -15.224688], [33748, -15.259319], [900, -15.279277], [115, -15.287391], [7060, -15.297465], [14153, -15.313663], [1210, -15.32309], [2642, -15.347225], [3756, -15.369913], [4257, -15.380077], [13019, -15.41452], [120410, -15.431918], [14667, -15.459031], [12158, -15.493287], [861, -15.500667], [7847, -15.502111], [1410, -15.513396], [14188, -15.53166]], "logprob_of_token": -0.001698, "top1_top2_margin": 6.947579, "top6_top7_margin": 0.19311}, {"gen_index": 24, "token": 262, "top": [[262, -0.027018], [5240, -3.699555], [28872, -7.581914], [7252, -8.273125], [67370, -8.309011], [327, -8.482334], [75361, -8.843413], [565, -10.053475], [938, -10.36882], [37270, -10.648089], [1283, -10.769108], [16424, -11.008794], [3327, -11.040519], [22130, -11.116619], [8615, -11.448766], [18462, -11.457025], [41875, -11.586907], [3465, -11.61123], [6131, -11.681367], [43425, -11.721244], [900, -11.855637], [941, -11.917171], [25997, -12.006572], [523, -12.107732], [26103, -12.121846], [4955, -12.128006], [3326, -12.207886], [597, -12.218455], [10829, -12.24451], [22225, -12.413134], [54901, -12.43524], [120007, -12.517032], [261, -12.545594], [947, -12.5682], [4283, -12.588119], [8207, -12.892196], [1977, -12.941074], [1862, -12.948531], [393, -12.979131], [6619, -12.981837], [37112, -13.020787], [43662, -13.045769], [22526, -13.066277], [1744, -13.094223], [13748, -13.096408], [54482, -13.119811], [543, -13.166317], [286, -13.177693], [24970, -13.192121], [36758, -13.231394], [468, -13.236625], [17203, -13.26073], [15368, -13.268726], [4549, -13.29708], [3312, -13.2981], [99932, -13.298705], [44, -13.305645], [19246, -13.350165], [8546, -13.355971], [1739, -13.374203], [2213, -13.395989], [4203, -13.469728], [2807, -13.492894], [8215, -13.514583], [17133, -13.519467], [23670, -13.520257], [762, -13.540525], [13447, -13.585046], [8574, -13.595654], [32, -13.663239], [103219, -13.663962], [20624, -13.70869], [966, -13.732388], [22804, -13.780855], [1776, -13.790257], [10416, -13.802893], [30460, -13.822875], [14856, -13.855854], [6392, -13.868314], [502, -13.875393], [1578, -13.878959], [58630, -13.889423], [24328, -13.900361], [59540, -13.920621], [113022, -13.921218], [9255, -13.927775], [9071, -14.004676], [120022, -14.016916], [2986, -14.026128], [5345, -14.043676], [10347, -14.050611], [6905, -14.081376], [14871, -14.092504], [16694, -14.094047], [6622, -14.117594], [1086, -14.12079], [29808, -14.132849], [45, -14.133484], [106198, -14.158202], [43035, -14.196762]], "logprob_of_token": -0.027018, "top1_top2_margin": 3.672537, "top6_top7_margin": 0.361079}, {"gen_index": 25, "token": 7252, "top": [[7252, -0.159213], [28872, -1.98572], [22130, -5.592571], [523, -7.477071], [37112, -7.584695], [5240, -7.775342], [36758, -8.06198], [8615, -8.245116], [25997, -8.43944], [8382, -8.804326], [22225, -8.833325], [75361, -8.859969], [2107, -8.959693], [1920, -9.046829], [13919, -9.273496], [9255, -9.317203], [10829, -9.318578], [50394, -9.480857], [2420, -9.702903], [8207, -9.801591], [59342, -9.836832], [113022, -9.965409], [21690, -10.006106], [26758, -10.075959], [3312, -10.150483], [5763, -10.19298], [114279, -10.509243], [43035, -10.540895], [103219, -10.559673], [2807, -10.561137], [38337, -10.574784], [4881, -10.702704], [106450, -10.790063], [23439, -10.796703], [3465, -10.836081], [85415, -10.876412], [106433, -10.901046], [14871, -10.922898], [106631, -10.937215], [5259, -10.957153], [18813, -10.983764], [4305, -10.993992], [1366, -11.035322], [54901, -11.059417], [37701, -11.080911], [61966, -11.180974], [89947, -11.222484], [14232, -11.232596], [48189, -11.236983], [2962, -11.242965], [69722, -11.277078], [1283, -11.279464], [1389, -11.295758], [11240, -11.307633], [9593, -11.328721], [83833, -11.392581], [3666, -11.397669], [6662, -11.406425], [119232, -11.406531], [126108, -11.407863], [6817, -11.433177], [51992, -11.495568], [13243, -11.566523], [22070, -11.594778], [43933, -11.61089], [84803, -11.634419], [35038, -11.650983], [30294, -11.654603], [67370, -11.664035], [121172, -11.671457], [106198, -11.679598], [41875, -11.699132], [1937, -11.705468], [48168, -11.770865], [5737, -11.775123], [14856, -11.791635], [14181, -11.805285], [52424, -11.809443], [12813, -11.830195], [126091, -11.833695], [72755, -11.838145], [18242, -11.860181], [5521, -11.920912], [4960, -11.936242], [23441, -11.94604], [11703, -11.963822], [123539, -11.96872], [11408, -11.985393], [34140, -11.986055], [81125, -12.002656], [12200, -12.005666], [16424, -12.02241], [17111, -12.023211], [20164, -12.026828], [30962, -12.082517], [122538, -12.117301], [1311, -12.135525], [947, -12.15144], [4338, -12.151721], [39017, -12.190726]], "logprob_of_token": -0.159213, "top1_top2_margin": 1.826507, "top6_top7_margin": 0.286638}, {"gen_index": 26, "token": 13919, "top": [[13919, -0.000335], [9255, -8.499598], [28872, -10.582454], [35330, -10.716779], [52684, -10.896177], [57501, -11.8436], [9728, -12.148711], [37112, -12.329112], [16399, -12.360234], [2807, -12.421378], [7252, -13.449159], [22130, -13.668357], [5002, -13.772264], [32019, -13.775424], [2420, -13.901881], [75361, -13.935414], [10259, -14.022222], [41669, -14.040374], [21690, -14.050071], [9593, -14.063621], [89128, -14.072176], [59342, -14.07879], [25997, -14.257514], [12924, -14.386155], [36758, -14.404061], [11094, -14.555675], [10829, -14.686269], [10884, -14.894309], [38337, -14.917313], [22090, -14.927858], [30332, -14.958726], [54901, -14.962808], [69505, -15.119686], [125920, -15.152133], [3336, -15.216359], [17003, -15.266724], [5690, -15.296078], [20291, -15.3466], [13232, -15.364227], [13892, -15.37623], [3960, -15.409727], [84483, -15.478715], [7943, -15.505242], [11710, -15.532954], [18363, -15.533458], [66111, -15.551078], [8615, -15.562274], [3465, -15.568936], [5234, -15.617749], [85056, -15.627158], [22212, -15.644412], [36618, -15.672553], [23280, -15.715954], [102982, -15.720491], [126055, -15.728054], [23688, -15.747524], [35358, -15.753743], [87340, -15.756429], [22070, -15.794318], [24952, -15.80808], [19412, -15.814931], [63442, -15.849627], [11742, -15.857837], [6993, -15.866549], [20669, -15.903045], [6480, -15.959331], [25001, -16.030897], [9379, -16.1374], [25748, -16.153793], [16299, -16.17178], [13243, -16.203255], [39017, -16.222851], [6226, -16.251202], [11240, -16.254385], [24776, -16.255611], [6209, -16.268167], [45590, -16.284178], [15646, -16.286283], [14406, -16.298782], [6017, -16.307215], [2911, -16.321896], [5240, -16.326576], [6622, -16.328503], [22642, -16.328686], [18113, -16.331825], [26650, -16.332506], [19311, -16.337214], [50774, -16.341303], [62453, -16.348515], [120007, -16.373075], [43014, -16.380831], [65180, -16.384476], [18204, -16.399487], [20223, -16.413906], [1920, -16.450451], [37061, -16.45356], [8382, -16.461777], [63304, -16.475655], [73338, -16.480446], [32731, -16.484371]], "logprob_of_token": -0.000335, "top1_top2_margin": 8.499263, "top6_top7_margin": 0.305111}, {"gen_index": 27, "token": 37112, "top": [[37112, -1.5e-05], [72805, -12.11073], [22130, -12.503775], [109249, -13.3401], [72755, -13.732169], [59342, -13.817771], [11408, -15.137649], [54413, -15.74544], [23787, -15.791463], [53035, -15.94461], [34919, -16.384672], [50037, -16.647619], [27460, -16.747555], [63091, -16.999565], [13205, -17.030241], [6187, -17.231956], [17667, -17.255592], [24426, -17.387903], [43035, -17.408123], [55898, -17.622698], [113900, -17.682796], [114051, -17.700626], [97600, -17.715569], [41205, -17.788658], [36758, -17.835899], [47689, -17.917263], [13967, -18.03764], [113375, -18.077473], [21822, -18.163099], [39139, -18.193462], [50231, -18.358009], [22339, -18.516893], [98611, -18.556192], [13200, -18.587143], [59834, -18.635983], [80239, -18.668867], [112912, -18.765959], [27108, -18.791515], [3095, -18.848133], [16720, -18.947525], [24557, -19.026665], [32831, -19.04446], [101432, -19.060226], [5418, -19.088505], [79438, -19.129604], [57429, -19.155787], [11101, -19.229753], [49581, -19.358335], [79648, -19.41769], [18463, -19.460123], [9854, -19.46402], [9848, -19.48987], [87762, -19.552534], [11710, -19.572847], [44162, -19.598862], [124921, -19.62886], [8814, -19.63644], [29134, -19.647345], [86759, -19.692398], [10791, -19.714844], [11988, -19.719805], [6209, -19.738321], [38626, -19.761066], [76669, -19.792612], [60878, -19.851826], [66036, -19.889151], [109534, -19.895468], [25903, -19.925209], [76816, -19.928579], [108859, -19.982498], [39889, -19.998062], [25322, -20.033957], [45597, -20.052963], [18400, -20.066578], [51177, -20.096533], [45493, -20.123793], [55905, -20.165739], [19132, -20.16901], [95123, -20.199005], [60120, -20.249727], [84414, -20.25172], [14115, -20.261194], [110537, -20.269566], [57716, -20.27121], [112924, -20.275581], [101306, -20.280781], [51897, -20.290861], [86251, -20.314598], [31698, -20.384811], [116762, -20.391512], [42397, -20.436619], [41571, -20.446991], [41057, -20.447769], [297, -20.455128], [33876, -20.461494], [27439, -20.570538], [28872, -20.575363], [32596, -20.578617], [25472, -20.618773], [23714, -20.628698]], "logprob_of_token": -1.5e-05, "top1_top2_margin": 12.110716, "top6_top7_margin": 1.319878}, {"gen_index": 28, "token": 46, "top": [[46, -0.076381], [275, -3.525598], [63, -3.595031], [314, -4.614439], [766, -6.248385], [286, -6.711029], [44, -6.935647], [120007, -7.163888], [936, -7.991559], [1043, -8.304433], [460, -9.104266], [467, -9.466165], [120016, -9.620677], [523, -9.658748], [59, -9.741765], [120399, -9.915866], [120022, -10.433227], [622, -10.537031], [735, -10.85402], [28872, -10.91433], [120021, -11.08657], [120002, -11.105659], [3863, -11.114292], [25997, -11.209675], [1275, -11.258006], [7252, -11.288951], [120018, -11.628458], [120001, -11.647561], [120739, -11.722815], [58, -11.742146], [120151, -11.808661], [33, -11.819861], [36209, -11.824731], [7510, -11.859605], [327, -11.950027], [103784, -11.969862], [4137, -11.973323], [67581, -12.010489], [103842, -12.080712], [745, -12.104064], [262, -12.124587], [6000, -12.13478], [5240, -12.180856], [10, -12.182884], [4375, -12.202439], [120230, -12.246426], [22278, -12.291635], [14188, -12.352029], [310, -12.390424], [263, -12.426787], [502, -12.477753], [1829, -12.482294], [1765, -12.509877], [120000, -12.523627], [279, -12.533175], [1112, -12.627165], [40, -12.654693], [1444, -12.678261], [48237, -12.731788], [20758, -12.744559], [14153, -12.760443], [393, -12.790112], [65, -12.798415], [75361, -12.850134], [120103, -12.857041], [589, -12.872944], [103219, -12.91553], [51992, -12.965167], [120099, -12.966618], [543, -12.998701], [120047, -13.07747], [18813, -13.106358], [32, -13.106952], [44455, -13.130267], [22225, -13.132434], [4731, -13.157666], [13594, -13.160571], [121146, -13.196625], [1366, -13.197], [47, -13.198676], [14825, -13.218054], [6391, -13.301357], [10829, -13.301417], [834, -13.337586], [1921, -13.374768], [123745, -13.410542], [2457, -13.435995], [7162, -13.446363], [22247, -13.446399], [1988, -13.455707], [120140, -13.457675], [18242, -13.458107], [33676, -13.47144], [1474, -13.495614], [34157, -13.502339], [4265, -13.504253], [799, -13.53861], [3688, -13.55418], [4529, -13.590953], [120048, -13.599177]], "logprob_of_token": -0.076381, "top1_top2_margin": 3.449217, "top6_top7_margin": 0.224619}, {"gen_index": 29, "token": 75361, "top": [[75361, -0.026837], [543, -4.501348], [3960, -6.070168], [120014, -6.842396], [14896, -7.239886], [20733, -7.613883], [6693, -7.701883], [1231, -7.736896], [1689, -7.747011], [1905, -7.815725], [1914, -8.146971], [717, -8.277392], [76115, -8.590307], [669, -8.596322], [5240, -8.607759], [34122, -8.780816], [5775, -8.81206], [8067, -8.900056], [611, -8.92734], [63585, -8.984167], [7252, -9.044082], [6455, -9.096286], [58209, -9.105193], [4759, -9.111259], [120004, -9.195861], [1194, -9.250171], [1336, -9.271703], [3780, -9.411791], [11533, -9.471109], [120022, -9.519171], [23441, -9.607635], [4361, -9.735032], [1988, -9.735995], [1692, -9.815139], [2560, -9.845079], [28872, -9.903437], [14161, -9.904933], [32, -9.912066], [8758, -10.027923], [15934, -10.032145], [5513, -10.068789], [476, -10.092566], [742, -10.094266], [3463, -10.095566], [6372, -10.116388], [7510, -10.215965], [97820, -10.332292], [766, -10.335542], [2284, -10.37451], [5274, -10.389588], [120103, -10.418763], [104647, -10.439211], [68029, -10.466613], [6814, -10.487346], [1010, -10.511128], [14147, -10.547552], [20321, -10.611609], [17299, -10.613188], [4408, -10.706813], [8009, -10.708966], [735, -10.764733], [127906, -10.769633], [4902, -10.781863], [64119, -10.788363], [4246, -10.820554], [6104, -10.825738], [24507, -10.832446], [16545, -10.832496], [29296, -10.838959], [2861, -10.861721], [4001, -10.876921], [106198, -10.896115], [7302, -10.900173], [523, -10.907712], [6131, -10.909053], [7643, -10.911454], [28484, -10.914317], [9980, -10.954038], [7433, -10.984343], [25808, -11.020165], [7339, -11.058854], [3872, -11.085088], [21051, -11.117802], [18757, -11.143999], [8546, -11.157207], [6123, -11.16057], [55034, -11.167664], [49123, -11.168297], [21690, -11.170562], [3516, -11.198656], [1283, -11.205004], [91515, -11.207016], [2865, -11.216135], [67370, -11.222722], [7189, -11.247763], [1254, -11.261437], [1048, -11.262242], [37061, -11.273623], [5686, -11.300697], [72735, -11.314891]], "logprob_of_token": -0.026837, "top1_top2_margin": 4.47451, "top6_top7_margin": 0.088}, {"gen_index": 30, "token": 735, "top": [[735, -0.083692], [919, -3.210581], [378, -3.327932], [589, -6.427649], [4278, -7.297641], [11201, -7.758871], [976, -9.119777], [1819, -9.614036], [37296, -9.739966], [44, -9.750373], [14598, -10.179275], [11319, -10.323264], [1270, -10.667279], [476, -10.709651], [10471, -10.735827], [52776, -10.834723], [120007, -10.837949], [617, -10.877792], [14380, -10.912902], [13032, -10.920392], [286, -10.938586], [4088, -11.025236], [2347, -11.262289], [58, -11.362119], [622, -11.412871], [16740, -11.431609], [662, -11.447762], [19701, -11.49449], [1656, -11.517272], [439, -11.561133], [766, -11.637403], [13636, -11.63869], [10852, -11.647842], [2459, -11.650371], [66165, -11.672027], [14439, -11.740077], [330, -11.794583], [1064, -11.813692], [1958, -11.894931], [13648, -11.913562], [1812, -11.916541], [4617, -11.917523], [528, -11.936535], [1309, -11.969158], [830, -12.011172], [7330, -12.11312], [529, -12.123429], [26216, -12.236199], [34643, -12.258256], [21925, -12.286657], [20615, -12.34106], [34705, -12.341094], [6117, -12.342561], [4440, -12.360866], [21884, -12.371665], [2286, -12.386168], [46, -12.433921], [568, -12.439473], [824, -12.440886], [4884, -12.462888], [9169, -12.46674], [18882, -12.517614], [39, -12.537242], [8140, -12.537441], [262, -12.618573], [13493, -12.624997], [1275, -12.663916], [14896, -12.680121], [11035, -12.692479], [120022, -12.696683], [4711, -12.705502], [8150, -12.723576], [8944, -12.729552], [1030, -12.731281], [2879, -12.734198], [4032, -12.750222], [24003, -12.774072], [120016, -12.779304], [11317, -12.780118], [31445, -12.793929], [6513, -12.859633], [5415, -12.883881], [1220, -12.912896], [6547, -12.934105], [12195, -12.956117], [20748, -12.956191], [9443, -12.957017], [63, -12.96012], [12745, -12.985286], [4384, -13.019094], [3865, -13.046405], [32578, -13.0684], [25005, -13.071739], [10757, -13.081594], [32, -13.116724], [18227, -13.119959], [60206, -13.142271], [13044, -13.1444], [279, -13.167918], [5598, -13.171693]], "logprob_of_token": -0.083692, "top1_top2_margin": 3.126889, "top6_top7_margin": 1.360906}, {"gen_index": 31, "token": 262, "top": [[262, -0.461457], [941, -2.140116], [5407, -2.216697], [1410, -3.075696], [1075, -3.72572], [502, -3.974135], [15132, -4.189561], [7789, -4.238105], [8255, -5.25043], [923, -5.313834], [2602, -6.171269], [10301, -6.637528], [622, -6.699822], [2769, -7.109544], [23132, -7.274148], [13438, -7.395045], [2403, -7.404218], [5240, -7.878238], [3145, -8.021234], [2150, -8.516517], [5639, -8.554418], [6846, -8.555785], [3647, -8.570692], [3892, -8.68559], [851, -8.713687], [32, -8.778859], [2457, -8.836761], [22801, -9.079389], [2048, -9.165551], [14380, -9.259123], [75361, -9.347662], [21393, -9.374171], [799, -9.460296], [834, -9.468421], [900, -9.478173], [828, -9.492436], [7641, -9.502351], [3093, -9.526565], [1918, -9.613688], [17414, -9.870351], [2288, -9.915908], [3660, -9.997436], [4205, -10.043805], [15967, -10.078624], [2417, -10.09094], [3437, -10.111588], [9255, -10.112836], [2702, -10.192813], [3893, -10.201307], [1819, -10.275624], [6030, -10.285622], [4619, -10.341154], [7411, -10.368905], [63248, -10.383309], [10059, -10.407329], [5406, -10.426751], [3992, -10.433719], [15087, -10.442859], [1972, -10.534446], [26216, -10.54572], [14390, -10.56893], [14667, -10.582719], [1444, -10.616876], [14570, -10.634917], [1283, -10.644109], [5220, -10.655326], [62476, -10.681909], [7456, -10.717798], [4191, -10.735781], [15397, -10.755965], [4518, -10.764391], [5874, -10.787096], [7025, -10.811778], [5675, -10.849196], [2944, -10.90179], [19952, -10.963992], [121222, -10.982543], [1637, -11.009561], [12511, -11.019343], [5065, -11.028832], [120608, -11.054262], [20733, -11.057722], [67873, -11.058032], [14364, -11.087619], [1127, -11.09398], [14553, -11.192699], [14052, -11.193076], [1308, -11.195051], [26399, -11.198527], [8254, -11.225595], [2575, -11.258762], [1739, -11.299098], [6170, -11.309947], [2642, -11.353305], [1781, -11.356271], [7252, -11.360718], [2584, -11.362119], [7199, -11.363739], [6131, -11.364511], [3379, -11.36904]], "logprob_of_token": -0.461457, "top1_top2_margin": 1.678658, "top6_top7_margin": 0.215425}]}, {"prompt": "Wissen ist Macht, aber Zeit ist Geld", "input_ids": [81623, 2459, 18680, 44, 3504, 2042, 2459, 4771], "generated_ids": [46, 4246, 44, 2042, 735, 2973, 44, 1409, 44, 1584, 735, 2973, 44, 1409, 44, 1584, 735, 2973, 44, 1409, 44, 1584, 735, 2973, 44, 1409, 44, 1584, 735, 2973, 44, 1409], "rows": [{"gen_index": 0, "token": 46, "top": [[46, -0.969948], [44, -0.993658], [275, -1.760141], [420, -3.400042], [4137, -4.742894], [314, -4.864251], [3504, -5.293204], [120007, -5.586457], [936, -6.088506], [26951, -6.126836], [263, -6.295341], [36209, -6.588855], [120016, -7.011125], [286, -7.238431], [10, -7.41888], [63, -7.66518], [7510, -7.696318], [59, -7.862969], [120347, -8.005505], [13594, -8.014665], [622, -8.08499], [120118, -8.138489], [4771, -8.251483], [1409, -8.265572], [2042, -8.487575], [93457, -8.59204], [122158, -8.663719], [1829, -8.87777], [120101, -8.980743], [33, -9.058076], [121238, -9.14394], [36040, -9.182314], [1043, -9.22278], [120068, -9.248308], [127906, -9.295287], [120015, -9.296039], [34, -9.456549], [766, -9.509624], [3078, -9.54542], [120099, -9.582774], [2459, -9.596053], [14153, -9.596915], [120407, -9.625007], [32, -9.662542], [120000, -9.69797], [5380, -9.711185], [14147, -9.731642], [1584, -9.789936], [120021, -9.790529], [120003, -9.791025], [779, -9.799248], [120022, -9.799251], [1410, -9.833593], [614, -9.862607], [2625, -9.898802], [2519, -9.920252], [2973, -10.020914], [1117, -10.079931], [735, -10.093134], [5274, -10.109854], [58, -10.129648], [120002, -10.211329], [120410, -10.247823], [120241, -10.280072], [20329, -10.350389], [6220, -10.415817], [939, -10.444715], [745, -10.445648], [346, -10.537645], [3356, -10.563265], [2773, -10.656718], [1917, -10.667419], [120132, -10.68181], [20486, -10.743215], [7496, -10.767593], [10694, -10.797241], [11158, -10.801651], [2120, -10.811426], [4299, -10.816339], [7450, -10.817986], [120935, -10.835657], [1853, -10.86731], [5275, -10.904857], [120001, -10.904915], [3643, -10.935256], [913, -10.962902], [513, -10.996117], [14188, -11.022495], [1195, -11.039251], [33676, -11.088379], [123440, -11.108126], [121205, -11.140244], [2225, -11.142121], [33481, -11.174257], [5496, -11.192333], [20758, -11.206296], [116957, -11.234197], [379, -11.239172], [120014, -11.253887], [44455, -11.262515]], "logprob_of_token": -0.969948, "top1_top2_margin": 0.02371, "top6_top7_margin": 0.428953}, {"gen_index": 1, "token": 4246, "top": [[4246, -2.334424], [2042, -2.777253], [5496, -2.814081], [28484, -3.119643], [120014, -3.202282], [1914, -3.232198], [1047, -3.608364], [1689, -3.61357], [1905, -3.783413], [10694, -3.920759], [2297, -4.227896], [6336, -4.263155], [127906, -4.419774], [32, -4.70089], [717, -4.706509], [7339, -4.877212], [14147, -4.937101], [1438, -4.961984], [5084, -5.245135], [543, -5.250448], [1496, -5.269388], [120004, -5.471832], [14923, -5.56934], [3463, -5.589981], [3780, -5.6126], [1194, -5.663474], [8067, -5.665687], [20142, -5.743081], [523, -5.810356], [2896, -5.866078], [4771, -5.913233], [14161, -5.920652], [29181, -5.922491], [669, -5.968094], [406, -5.991084], [16337, -6.00139], [1336, -6.026274], [1911, -6.199398], [4759, -6.232625], [6455, -6.243002], [14153, -6.245396], [20456, -6.255022], [2121, -6.258039], [766, -6.28274], [7865, -6.323747], [18757, -6.336686], [11935, -6.359748], [326, -6.393791], [3280, -6.435865], [9830, -6.437083], [18855, -6.441851], [21734, -6.471464], [11059, -6.479758], [4408, -6.483939], [946, -6.50127], [1231, -6.511703], [2560, -6.515842], [5775, -6.519359], [15369, -6.519875], [936, -6.531758], [5723, -6.537356], [1415, -6.572687], [9980, -6.611031], [16010, -6.621107], [3613, -6.633844], [840, -6.647146], [127908, -6.691299], [24895, -6.706263], [559, -6.73584], [5274, -6.782503], [6567, -6.797278], [1741, -6.814322], [1220, -6.822259], [1864, -6.824477], [2412, -6.829177], [3324, -6.883559], [7510, -6.883629], [457, -6.902637], [4001, -6.911088], [9031, -6.92652], [8972, -6.926953], [863, -6.927979], [1921, -6.928082], [784, -6.95002], [458, -6.977032], [705, -6.97935], [1196, -6.98758], [10438, -7.021613], [1048, -7.026283], [14896, -7.026452], [13274, -7.029881], [16573, -7.032065], [13495, -7.033027], [8971, -7.048767], [7643, -7.054031], [17320, -7.062501], [3417, -7.0632], [6391, -7.066808], [10755, -7.091181], [577, -7.103798]], "logprob_of_token": -2.334424, "top1_top2_margin": 0.442829, "top6_top7_margin": 0.376166}, {"gen_index": 2, "token": 44, "top": [[44, -2.738184], [1410, -2.740728], [2042, -2.844477], [94680, -3.063647], [353, -3.224506], [3754, -3.27684], [12629, -3.367055], [2790, -3.492308], [1584, -3.54508], [19239, -3.720957], [4771, -3.734951], [120007, -3.758406], [488, -3.790329], [70491, -3.862291], [7314, -3.89022], [1523, -3.973233], [836, -4.086775], [21545, -4.112719], [41672, -4.194186], [6326, -4.245938], [2093, -4.278549], [1213, -4.368668], [1592, -4.426614], [6443, -4.495652], [3654, -4.55477], [6190, -4.683594], [12378, -4.857392], [26992, -4.907596], [11401, -4.913013], [32, -5.1148], [527, -5.189974], [120895, -5.197505], [18625, -5.206243], [9916, -5.326788], [2973, -5.362578], [1044, -5.436369], [30230, -5.442472], [22182, -5.476003], [27084, -5.483392], [3384, -5.516566], [3565, -5.564393], [669, -5.567889], [825, -5.571354], [2459, -5.599298], [1409, -5.663372], [465, -5.782151], [4165, -5.880034], [6727, -5.932137], [2225, -5.968126], [5610, -6.033185], [1865, -6.069729], [10304, -6.111847], [18522, -6.11832], [3918, -6.161833], [50345, -6.179649], [4122, -6.188768], [24903, -6.203147], [965, -6.204878], [1064, -6.222486], [20812, -6.225089], [28758, -6.232221], [23100, -6.250176], [12094, -6.349276], [1626, -6.435416], [14794, -6.451655], [3974, -6.468572], [117246, -6.522134], [346, -6.544731], [3650, -6.572835], [18639, -6.583447], [99103, -6.651065], [14225, -6.658227], [5496, -6.661016], [1270, -6.675463], [29571, -6.726398], [622, -6.727809], [11698, -6.743321], [29353, -6.759208], [559, -6.784481], [39027, -6.803251], [1914, -6.811112], [56464, -6.819397], [27888, -6.851674], [74484, -6.870726], [4703, -6.926023], [9122, -6.931817], [18226, -6.946381], [81519, -6.988723], [58, -7.004019], [21597, -7.005795], [14154, -7.104929], [453, -7.151613], [120022, -7.156745], [36066, -7.160604], [25928, -7.171511], [6501, -7.198334], [44615, -7.230016], [4246, -7.247912], [12579, -7.265742], [34972, -7.294684]], "logprob_of_token": -2.738184, "top1_top2_margin": 0.002544, "top6_top7_margin": 0.090215}, {"gen_index": 3, "token": 2042, "top": [[2042, -1.766581], [1584, -2.320899], [1410, -2.808726], [353, -2.840713], [488, -3.099318], [2093, -3.12032], [2225, -3.122148], [836, -3.153423], [6443, -3.497368], [44, -3.920929], [669, -3.960948], [12629, -4.040778], [3754, -4.247813], [527, -4.286446], [4771, -4.407338], [1523, -4.497377], [1409, -4.532931], [8545, -4.545691], [7314, -4.807172], [3654, -4.875388], [2973, -5.041865], [1765, -5.069774], [26992, -5.234938], [94680, -5.258031], [7470, -5.275548], [9916, -5.277382], [465, -5.279887], [1044, -5.35916], [913, -5.407651], [1626, -5.455457], [23757, -5.491453], [3974, -5.570803], [1213, -5.623257], [3384, -5.748013], [3918, -5.786807], [19239, -5.874432], [825, -5.94144], [5496, -5.970578], [5879, -6.013121], [1592, -6.043901], [27084, -6.067341], [70491, -6.0819], [120895, -6.083868], [922, -6.115347], [840, -6.131431], [3117, -6.173829], [8503, -6.233734], [888, -6.272994], [6748, -6.281093], [2683, -6.327242], [117246, -6.34669], [777, -6.363535], [18625, -6.372174], [1917, -6.472484], [4057, -6.569954], [3368, -6.615017], [3650, -6.615878], [622, -6.64622], [2622, -6.648106], [378, -6.672365], [21545, -6.694267], [14168, -6.726192], [14412, -6.761856], [2625, -6.763178], [310, -6.776063], [12579, -6.813145], [41672, -6.830011], [11401, -6.873493], [11698, -6.901376], [6190, -6.911663], [20812, -7.038591], [20142, -7.108636], [4037, -7.117676], [525, -7.11833], [50345, -7.124829], [4619, -7.138667], [262, -7.141022], [32, -7.149869], [2468, -7.168305], [12848, -7.184027], [518, -7.184422], [12094, -7.202573], [946, -7.22857], [453, -7.238019], [5610, -7.244487], [1806, -7.310088], [3750, -7.311739], [346, -7.33211], [8764, -7.348254], [26805, -7.419288], [22026, -7.451757], [17117, -7.458014], [6835, -7.462961], [26562, -7.481733], [1633, -7.497134], [18176, -7.516148], [716, -7.520304], [5127, -7.533395], [763, -7.558222], [9173, -7.574237]], "logprob_of_token": -1.766581, "top1_top2_margin": 0.554319, "top6_top7_margin": 0.001828}, {"gen_index": 4, "token": 735, "top": [[735, -0.162877], [2459, -2.045914], [1679, -4.357117], [318, -6.869848], [576, -6.955207], [3527, -7.002783], [34858, -7.473354], [7826, -7.839483], [20787, -8.588899], [919, -9.300315], [907, -9.55433], [59405, -9.648099], [2973, -9.660784], [34719, -9.776534], [622, -9.806546], [513, -9.869106], [24408, -9.86918], [6727, -9.876462], [836, -9.927604], [286, -10.016419], [679, -10.052243], [20773, -10.104536], [8157, -10.117787], [29208, -10.138421], [22644, -10.144718], [21545, -10.153357], [346, -10.196698], [1204, -10.250533], [439, -10.281573], [14896, -10.285869], [1064, -10.297009], [44, -10.329166], [379, -10.398973], [59335, -10.425565], [589, -10.480775], [1410, -10.482438], [46, -10.508067], [102179, -10.548906], [54769, -10.604173], [18754, -10.612885], [4384, -10.632913], [25733, -10.669769], [7222, -10.693582], [14168, -10.70962], [922, -10.743093], [476, -10.781972], [1584, -10.80959], [4771, -10.812581], [1270, -10.831135], [502, -10.844245], [7770, -10.845655], [10244, -10.887755], [614, -10.905239], [61, -10.908005], [32, -10.954573], [824, -10.989194], [4088, -11.008136], [279, -11.05294], [9488, -11.079329], [420, -11.089393], [36533, -11.10336], [33, -11.119278], [56464, -11.145045], [378, -11.181288], [58, -11.182582], [79396, -11.18901], [120007, -11.198131], [41026, -11.247607], [1687, -11.258166], [12717, -11.258943], [968, -11.260406], [1213, -11.338956], [1826, -11.343206], [2625, -11.358275], [35257, -11.36468], [7080, -11.40138], [2286, -11.429946], [7732, -11.433543], [47923, -11.434978], [127650, -11.485475], [11308, -11.502725], [34324, -11.51109], [13728, -11.53668], [766, -11.551669], [121817, -11.554679], [32049, -11.561848], [11265, -11.584836], [2042, -11.59971], [12243, -11.618762], [29353, -11.634005], [35137, -11.644044], [115, -11.649251], [1200, -11.649424], [2790, -11.684892], [44615, -11.714738], [65197, -11.734768], [518, -11.738691], [5947, -11.757569], [14242, -11.773328], [1309, -11.788901]], "logprob_of_token": -0.162877, "top1_top2_margin": 1.883037, "top6_top7_margin": 0.470571}, {"gen_index": 5, "token": 2973, "top": [[2973, -0.235647], [20142, -2.648251], [1584, -3.569356], [4771, -3.880639], [279, -4.278219], [5496, -4.738937], [3647, -5.175553], [262, -5.273962], [1410, -5.719247], [2468, -5.894859], [3142, -5.979664], [941, -6.114785], [502, -6.170293], [12915, -6.501475], [18710, -6.582561], [6464, -6.718298], [14272, -7.233566], [3937, -7.571777], [2839, -7.584023], [1333, -7.597586], [9833, -7.696623], [762, -7.702713], [4205, -7.715235], [836, -7.768977], [2042, -7.8163], [8608, -7.891367], [3368, -7.897479], [44, -8.066649], [37690, -8.085648], [1840, -8.11059], [2613, -8.130696], [51770, -8.142291], [120007, -8.196644], [1319, -8.230567], [2302, -8.271921], [2213, -8.283481], [4621, -8.320737], [7116, -8.383247], [32, -8.447288], [1755, -8.52791], [84282, -8.55367], [2896, -8.560657], [766, -8.628952], [46, -8.64532], [2272, -8.652603], [41084, -8.685627], [41026, -8.687684], [1409, -8.752931], [68408, -8.76615], [4689, -8.802994], [2377, -8.832725], [3658, -8.836539], [110546, -8.873868], [22777, -8.892995], [48764, -8.921218], [19313, -8.925713], [1903, -8.931342], [735, -8.948665], [4700, -8.951221], [828, -8.968343], [5888, -8.989783], [8263, -9.005141], [3918, -9.046622], [3326, -9.057463], [4298, -9.116107], [120022, -9.153916], [8536, -9.161095], [89678, -9.211785], [119815, -9.226942], [7833, -9.236102], [622, -9.246502], [14052, -9.257989], [527, -9.259408], [117113, -9.280334], [116957, -9.288814], [113480, -9.29815], [15853, -9.304206], [2403, -9.344967], [3166, -9.356345], [318, -9.375694], [1972, -9.37778], [2157, -9.384273], [15117, -9.402706], [2690, -9.406161], [4315, -9.433694], [12107, -9.44445], [11698, -9.451476], [7270, -9.456808], [1627, -9.557395], [18965, -9.632065], [4917, -9.635239], [2150, -9.649658], [6030, -9.666654], [7411, -9.683631], [1688, -9.699094], [1591, -9.73458], [5062, -9.739421], [1662, -9.745667], [39, -9.748717], [2117, -9.75776]], "logprob_of_token": -0.235647, "top1_top2_margin": 2.412604, "top6_top7_margin": 0.436616}, {"gen_index": 6, "token": 44, "top": [[44, -0.597928], [46, -1.012313], [275, -3.426528], [33, -3.99276], [735, -4.38907], [1409, -5.451666], [314, -5.465394], [63, -5.68256], [286, -5.716377], [120007, -6.217464], [2519, -6.551296], [936, -7.499591], [4679, -8.198721], [779, -8.368361], [1410, -8.587236], [1043, -8.686703], [622, -8.744785], [1914, -8.779438], [1584, -8.8365], [58, -9.186533], [7331, -9.212805], [2973, -9.312796], [4384, -9.334089], [59, -9.815775], [420, -10.065134], [120000, -10.150703], [7148, -10.16136], [32, -10.190821], [766, -10.285496], [4137, -10.524317], [120016, -10.595957], [4412, -10.636847], [1988, -10.659859], [318, -10.682335], [263, -10.694633], [1829, -10.70425], [120022, -10.70632], [7510, -10.710972], [379, -10.805538], [4619, -10.812935], [393, -10.83206], [330, -10.839966], [74254, -10.848772], [460, -10.858995], [120001, -10.938873], [476, -10.949739], [14188, -10.966307], [10, -10.989372], [17870, -11.019421], [2459, -11.0807], [14153, -11.117182], [1275, -11.192631], [36209, -11.226543], [3688, -11.236155], [3368, -11.28307], [1765, -11.306726], [14052, -11.31151], [4554, -11.326761], [2362, -11.337858], [120003, -11.374763], [1333, -11.398256], [5496, -11.417063], [988, -11.444208], [745, -11.473192], [568, -11.505526], [18390, -11.529812], [327, -11.557272], [763, -11.558222], [30538, -11.566004], [120008, -11.599152], [589, -11.686701], [103784, -11.698473], [19078, -11.701941], [8279, -11.707584], [262, -11.716721], [19043, -11.739103], [4246, -11.754686], [123367, -11.765623], [14896, -11.809296], [8157, -11.816484], [836, -11.824839], [9980, -11.82501], [1407, -11.841949], [5071, -11.845404], [1656, -11.849554], [527, -11.877665], [120468, -11.877966], [120002, -11.88743], [467, -11.91346], [378, -11.924456], [120399, -11.981659], [106108, -12.02976], [5274, -12.032227], [1689, -12.033705], [3756, -12.044079], [34, -12.093416], [120021, -12.10194], [2773, -12.109203], [8545, -12.138271], [2042, -12.139544]], "logprob_of_token": -0.597928, "top1_top2_margin": 0.414386, "top6_top7_margin": 0.013727}, {"gen_index": 7, "token": 1409, "top": [[1409, -0.982262], [286, -1.21581], [936, -1.501334], [2973, -3.13168], [1584, -3.567844], [1410, -4.84373], [5496, -5.531023], [20142, -5.642239], [420, -5.923497], [779, -6.197579], [4619, -6.437805], [735, -6.774768], [11960, -7.336733], [393, -7.474145], [3504, -7.908827], [4771, -8.158006], [2042, -8.207852], [1914, -8.29747], [7510, -8.305395], [3688, -8.926594], [4743, -8.929813], [14792, -9.158172], [2362, -9.203736], [836, -9.235234], [8545, -9.25641], [1689, -9.324045], [1988, -9.332457], [1275, -9.347138], [502, -9.367034], [3756, -9.393298], [11158, -9.554272], [14729, -9.594663], [3658, -9.611703], [1333, -9.677955], [17117, -9.68653], [622, -9.723912], [327, -9.885886], [4383, -9.886436], [669, -9.908343], [476, -9.991931], [262, -10.090701], [32, -10.141245], [57125, -10.146298], [379, -10.171294], [4384, -10.18933], [9980, -10.191876], [6900, -10.202193], [20277, -10.225226], [3924, -10.236941], [453, -10.239314], [2374, -10.340018], [3340, -10.360751], [14052, -10.374528], [13789, -10.393834], [20196, -10.407027], [14419, -10.441873], [2117, -10.444285], [353, -10.451582], [1972, -10.561814], [488, -10.593755], [3117, -10.595745], [3326, -10.604161], [4508, -10.608277], [4731, -10.614032], [527, -10.640086], [7331, -10.644088], [2302, -10.68081], [825, -10.687251], [1324, -10.706793], [3918, -10.726987], [1093, -10.73883], [3467, -10.745599], [4246, -10.772214], [716, -10.793284], [2468, -10.801909], [2763, -10.827491], [941, -10.828513], [37690, -10.830317], [1765, -10.841468], [318, -10.876161], [28810, -10.905981], [766, -10.90858], [41084, -10.919264], [8279, -10.926867], [777, -10.927554], [1064, -10.928002], [63038, -10.951218], [14168, -10.970183], [2773, -10.974116], [21672, -11.028362], [1090, -11.03261], [10304, -11.042979], [6030, -11.088642], [14165, -11.110752], [2093, -11.114241], [1917, -11.117], [346, -11.128462], [2150, -11.143853], [11079, -11.151925], [3368, -11.157488]], "logprob_of_token": -0.982262, "top1_top2_margin": 0.233547, "top6_top7_margin": 0.687292}, {"gen_index": 8, "token": 44, "top": [[44, -0.513808], [527, -1.939202], [1584, -1.956355], [1523, -3.192963], [12629, -4.38946], [2973, -4.57015], [825, -4.747238], [5496, -5.637424], [8545, -5.655802], [9916, -5.73044], [669, -5.919326], [3117, -5.923891], [353, -6.253684], [1213, -6.379127], [1765, -6.781415], [2042, -6.792536], [453, -6.841718], [1592, -6.908116], [1806, -7.672348], [3326, -7.802923], [836, -7.850969], [2093, -7.874402], [4057, -7.958159], [488, -8.109987], [14412, -8.110666], [1633, -8.23389], [716, -8.238264], [3924, -8.278359], [3754, -8.278588], [20142, -8.36582], [14177, -8.400896], [46, -8.466253], [120007, -8.485133], [3594, -8.51294], [1626, -8.667697], [2219, -8.679406], [14015, -8.755486], [4037, -8.769373], [3384, -8.856633], [1409, -8.874821], [2468, -8.891196], [1736, -8.914444], [11935, -8.951829], [5888, -8.957587], [3611, -8.965787], [1435, -9.04079], [3368, -9.059341], [7615, -9.150912], [1026, -9.167274], [1064, -9.195797], [2622, -9.220486], [1333, -9.223554], [4194, -9.289065], [1679, -9.290523], [1128, -9.377024], [74484, -9.392194], [1324, -9.415811], [4731, -9.448685], [2157, -9.526813], [3737, -9.579377], [2799, -9.584409], [2213, -9.586896], [3671, -9.592376], [2773, -9.639949], [8206, -9.651317], [1194, -9.665016], [5610, -9.66606], [7770, -9.67727], [5879, -9.712979], [1812, -9.721559], [1744, -9.722973], [4771, -9.750668], [9628, -9.76539], [2218, -9.771837], [7753, -9.803197], [2246, -9.82809], [43660, -9.832692], [14792, -9.848506], [17393, -9.857041], [327, -9.862944], [762, -9.87669], [4700, -9.87708], [11689, -9.882195], [3974, -9.956939], [3129, -9.969975], [622, -9.978666], [318, -9.98099], [799, -9.984654], [2302, -9.99261], [3624, -9.996108], [4959, -9.99661], [1270, -10.003459], [763, -10.010354], [766, -10.022471], [16981, -10.059451], [529, -10.115966], [5402, -10.132306], [14529, -10.134097], [14242, -10.159974], [13789, -10.187131]], "logprob_of_token": -0.513808, "top1_top2_margin": 1.425393, "top6_top7_margin": 0.177088}, {"gen_index": 9, "token": 1584, "top": [[1584, -0.614546], [1523, -2.029403], [527, -2.59635], [1409, -2.996866], [2973, -3.244375], [12629, -3.592506], [9916, -4.336199], [825, -4.347458], [353, -4.673057], [5496, -4.691986], [3117, -4.85575], [1765, -4.978556], [8545, -5.225308], [2042, -5.449583], [836, -5.914474], [1213, -5.938504], [669, -6.096318], [453, -6.190367], [716, -6.204735], [1592, -6.333588], [1806, -6.48558], [2093, -6.565655], [20142, -6.593522], [3924, -6.747525], [1333, -7.186157], [1633, -7.188495], [44, -7.24298], [4057, -7.332568], [14412, -7.344956], [14177, -7.384977], [1026, -7.456431], [2219, -7.541957], [4037, -7.542773], [2468, -7.548197], [5888, -7.687289], [1064, -7.688343], [3756, -7.720514], [3754, -7.725903], [488, -7.792555], [14015, -7.861483], [2157, -7.870399], [1626, -7.913958], [4194, -7.947816], [3594, -7.953036], [5879, -8.020863], [936, -8.020968], [7615, -8.106138], [3368, -8.108815], [779, -8.169393], [3326, -8.241068], [17393, -8.241488], [763, -8.243351], [1736, -8.245523], [4771, -8.278409], [11935, -8.286813], [2799, -8.323988], [2213, -8.337154], [3384, -8.34774], [3611, -8.355723], [2218, -8.358596], [43660, -8.365197], [1812, -8.381531], [4700, -8.38884], [4619, -8.397038], [1270, -8.420096], [529, -8.421995], [4731, -8.423041], [1679, -8.44206], [3671, -8.467604], [622, -8.470876], [14242, -8.477523], [11689, -8.51613], [8206, -8.516873], [1410, -8.595901], [2622, -8.601464], [2302, -8.629595], [1324, -8.68643], [799, -8.714373], [286, -8.722232], [2246, -8.729411], [1435, -8.746407], [1744, -8.754473], [9628, -8.762661], [9173, -8.78008], [262, -8.823343], [14792, -8.846581], [7770, -8.85279], [14181, -8.877869], [1128, -8.881792], [318, -8.890781], [74484, -8.938946], [1914, -8.945524], [3974, -8.979126], [14529, -8.988068], [762, -8.99886], [1194, -9.033537], [3737, -9.045645], [3142, -9.077972], [7753, -9.086655], [4959, -9.112411]], "logprob_of_token": -0.614546, "top1_top2_margin": 1.414857, "top6_top7_margin": 0.743692}, {"gen_index": 10, "token": 735, "top": [[735, -0.017848], [589, -6.320194], [1679, -6.71851], [1064, -7.292925], [44, -7.387665], [7732, -7.504636], [2973, -8.088585], [1270, -8.468804], [20787, -8.646387], [919, -8.667753], [1584, -8.678312], [46, -8.691216], [34858, -8.820711], [476, -8.896261], [568, -8.969608], [22644, -9.05859], [318, -9.090445], [576, -9.166777], [9916, -9.184894], [120801, -9.196421], [1633, -9.305593], [59405, -9.329098], [622, -9.367081], [1213, -9.442757], [14177, -9.487005], [330, -9.497478], [8157, -9.5028], [7770, -9.547907], [1333, -9.553007], [836, -9.577489], [2459, -9.57846], [12195, -9.600199], [3924, -9.633655], [527, -9.63805], [41026, -9.692268], [61, -9.748308], [262, -9.76457], [4384, -9.768093], [18754, -9.816755], [617, -9.844201], [12243, -9.923793], [378, -9.954943], [120625, -9.958023], [3527, -9.984477], [35211, -10.014124], [286, -10.0151], [36533, -10.048065], [716, -10.049978], [12629, -10.115257], [14896, -10.136973], [72836, -10.157998], [57125, -10.173342], [824, -10.180651], [12717, -10.212545], [4037, -10.258436], [1656, -10.273015], [33417, -10.289755], [2362, -10.31481], [21681, -10.357414], [3671, -10.374383], [353, -10.374414], [3117, -10.381041], [14188, -10.381971], [120007, -10.390862], [32, -10.391398], [830, -10.405106], [2117, -10.417488], [52269, -10.453178], [10244, -10.475185], [6581, -10.49791], [528, -10.521381], [1409, -10.534764], [379, -10.535788], [120670, -10.55416], [14419, -10.559885], [1323, -10.574537], [40882, -10.603115], [11308, -10.627645], [766, -10.629689], [14847, -10.631833], [825, -10.637166], [20773, -10.647337], [23134, -10.689372], [73707, -10.713097], [54769, -10.731043], [58, -10.754845], [1829, -10.768806], [2213, -10.772499], [41399, -10.810034], [18126, -10.813229], [3679, -10.82264], [121817, -10.841072], [3326, -10.841288], [439, -10.858555], [4700, -10.866136], [33275, -10.882283], [2272, -10.886295], [1902, -10.907203], [25835, -10.939346], [502, -10.954397]], "logprob_of_token": -0.017848, "top1_top2_margin": 6.302346, "top6_top7_margin": 0.583949}, {"gen_index": 11, "token": 2973, "top": [[2973, -0.077282], [12915, -4.089171], [1584, -4.122693], [3647, -4.700113], [18710, -5.397539], [279, -5.617806], [2468, -6.624899], [14272, -6.706903], [2157, -6.961578], [4700, -6.984038], [262, -7.058962], [3142, -7.244162], [4621, -7.366251], [4205, -7.373131], [1755, -7.520979], [7116, -7.70481], [2302, -7.757176], [502, -7.854265], [41026, -8.061245], [22777, -8.216452], [20142, -8.323889], [3368, -8.334521], [1409, -8.411001], [7833, -8.437398], [8859, -8.44698], [4771, -8.501856], [1333, -8.59248], [4689, -8.648417], [2690, -8.709017], [3937, -8.71091], [9833, -8.759223], [44, -8.812503], [32, -8.88025], [19898, -8.931085], [941, -9.005392], [1319, -9.026977], [68408, -9.155603], [2839, -9.230462], [1410, -9.275763], [120007, -9.308083], [762, -9.33278], [5888, -9.335421], [48764, -9.350916], [7210, -9.353031], [113480, -9.396581], [18965, -9.425615], [1591, -9.427287], [13789, -9.4433], [7270, -9.451866], [2272, -9.482664], [15117, -9.494804], [17016, -9.583668], [1840, -9.590093], [3658, -9.598401], [11021, -9.626773], [2613, -9.654232], [46, -9.675926], [4315, -9.686724], [117113, -9.688146], [41084, -9.723778], [836, -9.742651], [923, -9.783698], [488, -9.787354], [2377, -9.805531], [1903, -9.837749], [5062, -9.845461], [10244, -9.855433], [2213, -9.869083], [4959, -9.898677], [4298, -9.953969], [31653, -9.959359], [828, -10.022188], [2117, -10.045054], [7770, -10.047014], [2457, -10.053905], [3918, -10.067595], [1662, -10.076391], [14231, -10.082122], [2878, -10.175572], [1093, -10.18364], [8858, -10.185132], [29344, -10.202774], [766, -10.217424], [1324, -10.217982], [15899, -10.243933], [2711, -10.288265], [27880, -10.304708], [622, -10.311057], [8263, -10.318252], [4372, -10.318367], [18967, -10.336944], [4314, -10.369154], [527, -10.392683], [8106, -10.423548], [8536, -10.428467], [3660, -10.429306], [1972, -10.429715], [20196, -10.450267], [119815, -10.484284], [3326, -10.489179]], "logprob_of_token": -0.077282, "top1_top2_margin": 4.01189, "top6_top7_margin": 1.007093}, {"gen_index": 12, "token": 44, "top": [[44, -0.030388], [46, -4.067344], [275, -4.75624], [1409, -7.272545], [735, -7.448352], [63, -7.484184], [120007, -7.869177], [314, -8.108793], [33, -8.790432], [286, -9.874984], [59, -10.037411], [2519, -10.061598], [3368, -10.108292], [1043, -10.119948], [7331, -10.173029], [120468, -10.238767], [4384, -10.310379], [779, -10.431067], [1275, -10.570656], [58, -10.573963], [120016, -10.611306], [1914, -10.632671], [5071, -10.660819], [14188, -10.676362], [1584, -10.786716], [766, -11.073023], [936, -11.104738], [988, -11.185365], [622, -11.195145], [14153, -11.234494], [120028, -11.238966], [263, -11.292836], [1765, -11.339989], [4137, -11.387716], [1829, -11.401772], [1410, -11.410024], [19078, -11.468971], [763, -11.527694], [379, -11.547375], [18390, -11.680248], [476, -11.70047], [120022, -11.707307], [589, -11.734548], [318, -11.774401], [4412, -11.775042], [327, -11.915678], [3918, -11.944445], [1407, -11.94644], [74254, -11.974019], [32, -12.002436], [745, -12.007937], [121119, -12.039589], [467, -12.048498], [120003, -12.053063], [10, -12.058466], [120008, -12.061779], [5696, -12.117102], [1064, -12.123817], [15853, -12.146551], [14052, -12.190544], [405, -12.200218], [26530, -12.229568], [120000, -12.310648], [527, -12.382307], [1656, -12.388036], [576, -12.483343], [4554, -12.526814], [262, -12.531622], [420, -12.580499], [528, -12.630216], [502, -12.688158], [279, -12.721321], [1333, -12.73223], [12243, -12.73702], [120409, -12.74468], [4679, -12.756374], [460, -12.781404], [36209, -12.798892], [101703, -12.8134], [8545, -12.848539], [2459, -12.901438], [7510, -12.904453], [4343, -12.916546], [3326, -12.943666], [20196, -12.962265], [393, -12.977526], [919, -13.001965], [1444, -13.023528], [2213, -13.02509], [4619, -13.03895], [8157, -13.050369], [4484, -13.050743], [836, -13.061836], [120021, -13.062082], [669, -13.06832], [14792, -13.076836], [1270, -13.103583], [9980, -13.116522], [20758, -13.140287], [330, -13.143399]], "logprob_of_token": -0.030388, "top1_top2_margin": 4.036956, "top6_top7_margin": 0.384993}, {"gen_index": 13, "token": 1409, "top": [[1409, -0.072348], [936, -3.549924], [1584, -3.770836], [286, -4.49071], [14792, -6.570284], [4619, -7.695175], [7510, -8.04124], [779, -8.248578], [327, -8.789584], [4743, -8.878166], [11960, -9.009123], [3368, -9.093684], [393, -9.103306], [2973, -9.222616], [2302, -9.383405], [20196, -9.420179], [1275, -9.439674], [1410, -9.547679], [5496, -9.574583], [1765, -9.649096], [57125, -9.706387], [3756, -9.846207], [3924, -9.848011], [8545, -10.025311], [669, -10.112656], [1333, -10.252092], [4383, -10.27726], [420, -10.292296], [3918, -10.327229], [565, -10.526796], [21672, -10.548353], [379, -10.652723], [2042, -10.659112], [7331, -10.702902], [3326, -10.713825], [716, -10.720906], [262, -10.724781], [1914, -10.727966], [2376, -10.736743], [2213, -10.741827], [20277, -10.776616], [63038, -10.79925], [502, -10.841307], [5071, -10.850137], [4384, -10.915104], [1407, -11.045795], [3827, -11.048002], [4731, -11.058676], [836, -11.144741], [777, -11.153249], [488, -11.174719], [851, -11.176685], [735, -11.239664], [476, -11.253088], [14052, -11.264242], [1064, -11.273423], [2982, -11.280098], [799, -11.291042], [527, -11.298495], [3688, -11.352707], [32, -11.359132], [825, -11.3636], [3550, -11.389589], [2246, -11.438747], [26530, -11.463977], [14419, -11.475906], [762, -11.482125], [622, -11.487003], [941, -11.520468], [7060, -11.532681], [1633, -11.54332], [1187, -11.54513], [938, -11.557824], [1806, -11.562609], [120022, -11.563999], [19078, -11.585417], [1435, -11.622038], [1093, -11.651535], [3117, -11.653409], [3504, -11.655694], [2468, -11.657043], [763, -11.662012], [17121, -11.665447], [534, -11.678504], [453, -11.69042], [6444, -11.691114], [2374, -11.691626], [467, -11.744377], [1323, -11.745209], [4484, -11.777657], [12629, -11.778132], [7833, -11.783586], [2403, -11.807604], [2272, -11.811437], [739, -11.826364], [766, -11.873727], [1436, -11.881762], [1972, -11.883931], [4205, -11.908052], [4037, -11.924224]], "logprob_of_token": -0.072348, "top1_top2_margin": 3.477576, "top6_top7_margin": 0.346065}, {"gen_index": 14, "token": 44, "top": [[44, -0.005469], [1584, -5.913205], [46, -8.217719], [120468, -8.271973], [120007, -8.356386], [120003, -9.74826], [5496, -9.871017], [527, -10.232157], [275, -10.394464], [2773, -10.543233], [59, -10.550352], [534, -10.694819], [2042, -10.716299], [121119, -10.81372], [3326, -10.831928], [120008, -10.86013], [3368, -10.921822], [1409, -11.026993], [988, -11.10903], [120028, -11.324149], [2973, -11.349579], [123367, -11.361564], [120409, -11.377043], [1765, -11.396342], [766, -11.499999], [8545, -11.509424], [2213, -11.572668], [286, -11.59124], [120022, -11.625789], [2468, -11.70293], [669, -11.726467], [14188, -11.732765], [120277, -11.763636], [314, -11.775572], [63, -11.776926], [405, -11.848799], [1633, -11.867551], [1333, -11.870154], [14792, -11.878956], [58, -11.881186], [120000, -11.902064], [327, -11.932261], [120501, -11.994857], [94365, -12.047237], [1410, -12.098398], [121083, -12.121067], [716, -12.139807], [4619, -12.143682], [5071, -12.149116], [745, -12.157365], [262, -12.166922], [32, -12.169418], [65268, -12.189858], [33, -12.19477], [453, -12.218905], [2302, -12.248846], [1523, -12.251144], [25945, -12.279987], [1744, -12.284737], [318, -12.302297], [8152, -12.317455], [8722, -12.32971], [2093, -12.349968], [825, -12.362711], [120016, -12.401613], [1972, -12.402463], [353, -12.46302], [120436, -12.464502], [936, -12.467979], [502, -12.496784], [120057, -12.504983], [120049, -12.588944], [941, -12.603337], [7768, -12.626371], [1435, -12.655085], [3924, -12.65522], [379, -12.665378], [1903, -12.687077], [3117, -12.703314], [29094, -12.755316], [5675, -12.770742], [21672, -12.775554], [763, -12.790457], [3918, -12.790874], [488, -12.814657], [1324, -12.840595], [4743, -12.852644], [122416, -12.862393], [735, -12.900735], [7510, -12.900835], [1806, -12.918455], [622, -12.919441], [14153, -12.923491], [18390, -12.926253], [25388, -12.927753], [2410, -12.942001], [3550, -12.969502], [4731, -12.972919], [10, -12.985322], [2403, -12.988164]], "logprob_of_token": -0.005469, "top1_top2_margin": 5.907736, "top6_top7_margin": 0.122758}, {"gen_index": 15, "token": 1584, "top": [[1584, -0.069989], [1409, -3.136204], [2973, -4.541639], [527, -6.59686], [5496, -7.341804], [1765, -7.523507], [669, -7.579337], [8545, -7.890803], [936, -8.256625], [12629, -8.270128], [1523, -8.278111], [453, -8.534217], [3326, -8.659473], [286, -8.700969], [825, -8.719925], [2042, -8.727307], [2468, -8.728145], [3924, -8.827718], [3368, -8.842116], [1333, -8.870664], [9916, -9.002924], [14792, -9.025018], [353, -9.125003], [3117, -9.158874], [1806, -9.216199], [1914, -9.23335], [2213, -9.261689], [488, -9.287347], [716, -9.318454], [20142, -9.338181], [2093, -9.349411], [262, -9.357442], [3918, -9.376731], [4619, -9.497546], [534, -9.559274], [1633, -9.629183], [7510, -9.776931], [3142, -9.818845], [622, -9.843956], [4037, -9.887506], [2302, -9.945531], [2219, -9.978257], [777, -9.989179], [763, -10.014812], [779, -10.020008], [836, -10.021508], [44, -10.038024], [120022, -10.044699], [1744, -10.081004], [1323, -10.152814], [7615, -10.163978], [4057, -10.176404], [3974, -10.200072], [1626, -10.210444], [3756, -10.328362], [1435, -10.331344], [4743, -10.394948], [14412, -10.420787], [3384, -10.445748], [3658, -10.454444], [8859, -10.467275], [379, -10.486363], [2799, -10.519984], [2157, -10.53107], [32, -10.531111], [1026, -10.535994], [3611, -10.537545], [799, -10.599171], [1410, -10.611178], [20196, -10.641776], [1275, -10.680157], [762, -10.690207], [3671, -10.695321], [2403, -10.704799], [4160, -10.730193], [318, -10.74134], [1972, -10.753485], [11960, -10.78387], [565, -10.802596], [1436, -10.826616], [120007, -10.839011], [393, -10.845698], [4731, -10.865954], [1592, -10.905257], [3737, -10.909492], [1427, -10.924294], [1578, -10.952384], [835, -10.974736], [57125, -10.975162], [766, -10.985267], [1064, -10.986069], [29094, -10.999609], [14272, -11.001638], [502, -11.022527], [13789, -11.027799], [941, -11.03723], [2246, -11.041302], [2511, -11.064191], [3594, -11.118149], [7833, -11.126637]], "logprob_of_token": -0.069989, "top1_top2_margin": 3.066215, "top6_top7_margin": 0.05583}, {"gen_index": 16, "token": 735, "top": [[735, -0.003706], [7732, -8.719553], [1064, -8.764236], [44, -9.162375], [2973, -9.167271], [286, -9.262997], [46, -9.318254], [120007, -9.589394], [919, -9.631523], [330, -9.886775], [589, -9.958114], [20787, -10.048776], [4384, -10.107173], [2459, -10.150812], [476, -10.196135], [1679, -10.247509], [22644, -10.326269], [1584, -10.32719], [59405, -10.328415], [34858, -10.425879], [18754, -10.434818], [576, -10.444056], [568, -10.48539], [32, -10.549128], [1270, -10.578986], [8157, -10.614291], [35211, -10.636539], [7770, -10.638905], [72836, -10.683107], [318, -10.754187], [378, -10.764071], [622, -10.84213], [120801, -10.851049], [527, -10.960745], [262, -10.965865], [12195, -11.022753], [11308, -11.06506], [12629, -11.094289], [120022, -11.135578], [1656, -11.219772], [41026, -11.277454], [275, -11.299481], [9916, -11.300825], [439, -11.310443], [33275, -11.313004], [14896, -11.313082], [12243, -11.314111], [14177, -11.332094], [1633, -11.334441], [62024, -11.357414], [36533, -11.374081], [14188, -11.375175], [58, -11.380583], [33417, -11.438541], [528, -11.444676], [61, -11.448948], [10244, -11.51289], [824, -11.513483], [52269, -11.529901], [830, -11.533796], [73707, -11.579762], [7080, -11.614026], [1409, -11.661859], [20773, -11.667888], [279, -11.696673], [3326, -11.72608], [63, -11.765203], [21681, -11.778738], [120625, -11.856962], [3924, -11.891459], [65197, -11.903212], [34324, -11.91274], [836, -11.917277], [120000, -11.950491], [766, -11.97324], [32049, -11.977913], [120670, -12.006866], [40882, -12.042277], [379, -12.097288], [113613, -12.09745], [14419, -12.119483], [6581, -12.151497], [102698, -12.152201], [3402, -12.163968], [18126, -12.16893], [1591, -12.172516], [12717, -12.181295], [716, -12.236234], [2362, -12.242338], [2213, -12.257143], [941, -12.263426], [3679, -12.301003], [120001, -12.305496], [314, -12.319466], [1309, -12.335411], [1213, -12.378453], [353, -12.383583], [502, -12.405249], [14153, -12.408706], [5888, -12.433907]], "logprob_of_token": -0.003706, "top1_top2_margin": 8.715847, "top6_top7_margin": 0.055258}, {"gen_index": 17, "token": 2973, "top": [[2973, -0.028469], [1584, -3.982863], [12915, -7.176819], [3647, -7.592798], [18710, -7.664031], [262, -7.805958], [3142, -7.936998], [14272, -8.333873], [20142, -8.375145], [502, -8.58672], [2468, -8.61052], [120007, -8.727776], [3368, -8.926491], [2302, -9.054514], [32, -9.207135], [44, -9.36359], [4205, -9.371592], [41084, -9.406263], [4771, -9.41073], [4689, -9.450537], [4700, -9.468276], [1409, -9.529093], [1755, -9.637209], [3918, -9.673656], [2157, -9.698488], [22777, -9.722189], [4621, -9.857746], [2690, -9.941943], [46, -9.950043], [41026, -9.955203], [4315, -10.017067], [1319, -10.034609], [7833, -10.044928], [279, -10.16328], [762, -10.265563], [9833, -10.299018], [3658, -10.320656], [120022, -10.337458], [7210, -10.346314], [37690, -10.37571], [1333, -10.39765], [941, -10.49169], [828, -10.505751], [1591, -10.511255], [8536, -10.568827], [3937, -10.578251], [1840, -10.591134], [1903, -10.620256], [8859, -10.623912], [2213, -10.627838], [2272, -10.679209], [2117, -10.709412], [2711, -10.714452], [923, -10.72559], [4959, -10.740792], [13789, -10.781096], [5496, -10.806052], [19898, -10.812186], [1410, -10.82308], [33274, -10.825384], [2839, -10.874628], [836, -10.922743], [19102, -10.994509], [1324, -11.003164], [113480, -11.024193], [527, -11.043082], [4314, -11.043368], [1662, -11.086781], [7770, -11.108425], [8263, -11.114516], [17016, -11.134934], [2155, -11.14534], [10244, -11.154288], [68408, -11.154895], [7208, -11.172148], [5888, -11.182382], [110546, -11.236372], [12107, -11.238323], [3467, -11.260659], [26530, -11.280807], [488, -11.302444], [11981, -11.30944], [766, -11.316472], [2377, -11.333248], [1436, -11.335098], [51770, -11.338358], [6563, -11.346292], [4647, -11.34732], [1972, -11.353254], [2608, -11.353323], [16000, -11.378966], [2944, -11.383547], [4372, -11.389561], [1688, -11.409492], [98621, -11.420111], [3166, -11.427809], [11021, -11.429881], [7116, -11.45097], [453, -11.467125], [48764, -11.47403]], "logprob_of_token": -0.028469, "top1_top2_margin": 3.954394, "top6_top7_margin": 0.13104}, {"gen_index": 18, "token": 44, "top": [[44, -0.10879], [275, -2.990793], [46, -3.084752], [120007, -5.836138], [314, -7.276059], [63, -7.282247], [33, -7.615205], [120016, -8.045359], [1409, -8.392349], [2519, -8.820807], [735, -9.121815], [59, -9.66051], [14188, -9.731679], [1043, -9.974463], [120022, -10.174067], [1914, -10.308564], [745, -10.3539], [120468, -10.415023], [286, -10.452434], [14153, -10.523174], [121119, -10.594933], [1829, -10.642021], [120028, -10.84736], [263, -10.861922], [4137, -10.864835], [7510, -10.938948], [405, -10.975476], [5071, -11.032621], [988, -11.042512], [120021, -11.050965], [120003, -11.063783], [766, -11.073359], [58, -11.10971], [74254, -11.111486], [3368, -11.181861], [120409, -11.220421], [120000, -11.221417], [779, -11.299489], [4412, -11.405934], [124969, -11.460533], [32, -11.728544], [120002, -11.765539], [622, -11.766822], [20758, -11.840095], [11861, -11.862003], [19078, -11.895619], [10, -12.006355], [1275, -12.008493], [18390, -12.032758], [26530, -12.037033], [122158, -12.048725], [4679, -12.275958], [33676, -12.308729], [467, -12.312291], [327, -12.336801], [7331, -12.343838], [120359, -12.362121], [936, -12.365218], [120103, -12.376334], [379, -12.39139], [1765, -12.401719], [589, -12.435584], [120008, -12.473985], [1407, -12.480652], [121083, -12.506371], [36209, -12.543858], [4554, -12.545173], [1584, -12.554027], [318, -12.555511], [4384, -12.570303], [121379, -12.578406], [15853, -12.595568], [120410, -12.627021], [2213, -12.631622], [527, -12.635281], [3918, -12.641297], [763, -12.670944], [420, -12.688696], [120277, -12.689355], [14179, -12.692083], [101703, -12.777452], [120893, -12.847388], [7496, -12.851079], [262, -12.861764], [576, -12.893866], [120001, -12.902688], [44455, -12.910438], [476, -12.942568], [120399, -12.949159], [17870, -12.952613], [4484, -12.99012], [20196, -12.992472], [4343, -12.992486], [103784, -13.018018], [120347, -13.021894], [30035, -13.026324], [1410, -13.069165], [127906, -13.074705], [120436, -13.124753], [460, -13.156419]], "logprob_of_token": -0.10879, "top1_top2_margin": 2.882003, "top6_top7_margin": 0.332958}, {"gen_index": 19, "token": 1409, "top": [[1409, -0.012669], [1584, -5.69842], [936, -6.132523], [7510, -6.213306], [286, -6.288713], [20196, -7.91821], [14792, -8.49811], [57125, -8.635749], [26530, -9.243044], [21600, -9.498125], [779, -9.555996], [120022, -9.593804], [14468, -9.646412], [57628, -9.657394], [1914, -9.746494], [669, -9.82947], [7331, -9.989738], [14165, -10.203452], [565, -10.291607], [86331, -10.437722], [2302, -10.547144], [10090, -10.582322], [5696, -10.59763], [5496, -10.610329], [63038, -10.621553], [5071, -10.700499], [3924, -10.747637], [1275, -10.77561], [3368, -10.794929], [32, -10.79764], [3326, -10.822761], [21672, -10.866383], [25071, -10.891478], [23138, -10.944882], [1410, -10.978055], [379, -10.994204], [327, -11.004986], [3918, -11.060678], [14192, -11.124046], [8545, -11.127209], [467, -11.205021], [2973, -11.207376], [1765, -11.237865], [527, -11.322932], [14791, -11.337481], [393, -11.341028], [766, -11.345584], [7615, -11.351522], [2213, -11.39827], [2042, -11.40193], [2982, -11.422712], [6858, -11.43191], [28810, -11.524832], [4731, -11.558403], [12913, -11.558592], [3756, -11.577193], [24122, -11.59656], [1407, -11.646209], [4743, -11.687783], [453, -11.699507], [262, -11.811095], [23395, -11.815037], [716, -11.834602], [420, -11.846489], [1333, -11.852831], [50888, -11.887692], [777, -11.892706], [65695, -11.923731], [24629, -11.93725], [16604, -12.000772], [35519, -12.008986], [27097, -12.024903], [7833, -12.04739], [14308, -12.073474], [941, -12.074564], [735, -12.1357], [120001, -12.164975], [19078, -12.204207], [836, -12.250283], [14362, -12.279439], [1323, -12.279456], [476, -12.297975], [4619, -12.359423], [3827, -12.366339], [17844, -12.381718], [22144, -12.388529], [120098, -12.403011], [828, -12.406614], [51770, -12.410049], [965, -12.412075], [1093, -12.429832], [3688, -12.437883], [1806, -12.438835], [27485, -12.459813], [7008, -12.476596], [2468, -12.482914], [739, -12.504287], [6444, -12.506414], [6391, -12.52695], [127227, -12.548439]], "logprob_of_token": -0.012669, "top1_top2_margin": 5.685751, "top6_top7_margin": 0.5799}, {"gen_index": 20, "token": 44, "top": [[44, -0.029325], [120007, -4.207463], [46, -5.833782], [1584, -5.887466], [120016, -6.05013], [275, -6.383191], [120022, -7.903996], [120021, -8.176575], [314, -8.455587], [745, -8.650787], [120468, -8.779144], [121119, -8.882395], [2457, -9.15859], [120000, -9.193219], [120028, -9.434644], [2773, -9.603767], [988, -9.782664], [124969, -9.821856], [120103, -9.833913], [20758, -9.929467], [534, -10.186805], [5496, -10.307718], [11861, -10.323873], [14188, -10.330394], [59, -10.335558], [263, -10.342526], [120409, -10.432083], [120003, -10.469365], [120002, -10.529546], [2042, -10.606917], [63, -10.652722], [10, -10.690732], [766, -10.698373], [69555, -10.836234], [33, -10.866614], [121379, -10.872451], [405, -10.956473], [7510, -11.022381], [58, -11.094573], [120410, -11.106106], [3326, -11.143297], [120087, -11.206218], [122158, -11.262399], [120277, -11.274487], [120359, -11.275243], [1043, -11.303346], [669, -11.3277], [121083, -11.426431], [1409, -11.468946], [25945, -11.483937], [65268, -11.513031], [2519, -11.533196], [262, -11.548366], [94365, -11.613819], [527, -11.615623], [327, -11.62535], [126545, -11.650717], [3368, -11.657557], [120844, -11.695152], [120001, -11.721506], [32, -11.731792], [8152, -11.750641], [286, -11.758723], [120008, -11.76413], [120302, -11.785069], [5675, -11.819397], [2302, -11.869851], [1410, -11.937334], [57125, -11.962346], [120214, -12.03439], [7833, -12.073817], [14153, -12.076867], [7768, -12.145495], [8722, -12.174124], [25071, -12.189637], [1062, -12.224926], [502, -12.229918], [29094, -12.236466], [8894, -12.241872], [2213, -12.24826], [20196, -12.261781], [14792, -12.271934], [126203, -12.27553], [41836, -12.316334], [1744, -12.337543], [123367, -12.380626], [14179, -12.426459], [900, -12.434463], [3924, -12.446972], [18390, -12.451275], [120098, -12.471867], [1829, -12.480425], [318, -12.488938], [26530, -12.500026], [120751, -12.500446], [1308, -12.518778], [1323, -12.568262], [936, -12.573318], [2973, -12.575427], [120501, -12.579642]], "logprob_of_token": -0.029325, "top1_top2_margin": 4.178138, "top6_top7_margin": 1.520805}, {"gen_index": 21, "token": 1584, "top": [[1584, -0.051839], [1409, -3.964655], [2973, -6.665714], [936, -7.100017], [2468, -7.161791], [534, -7.46805], [262, -7.574983], [120022, -7.693544], [3326, -7.716483], [1765, -7.90096], [527, -7.969175], [1410, -8.219376], [669, -8.24699], [3142, -8.39902], [2042, -8.434445], [120007, -8.468769], [3368, -8.471293], [7833, -8.48438], [453, -8.673843], [5496, -8.674499], [8545, -8.691535], [286, -8.704229], [777, -8.780583], [2155, -8.906766], [1427, -8.936087], [622, -8.993469], [318, -9.005795], [3924, -9.024774], [32, -9.024837], [2302, -9.037496], [1324, -9.048147], [488, -9.070991], [393, -9.134009], [4595, -9.144492], [502, -9.205498], [835, -9.207267], [565, -9.216714], [1333, -9.218775], [1319, -9.229804], [14792, -9.245651], [779, -9.258603], [3827, -9.279484], [1806, -9.293588], [766, -9.298094], [763, -9.305376], [379, -9.318215], [4484, -9.329246], [4383, -9.364478], [3737, -9.377823], [1436, -9.389134], [1523, -9.392962], [5062, -9.476909], [1914, -9.484845], [467, -9.509168], [8279, -9.537704], [7510, -9.53955], [2157, -9.55493], [12913, -9.561316], [2213, -9.563128], [4315, -9.581687], [1323, -9.608283], [873, -9.649197], [1903, -9.669641], [762, -9.69202], [1578, -9.714447], [63, -9.730936], [310, -9.735069], [4401, -9.746357], [8859, -9.747879], [44, -9.749937], [4205, -9.757577], [3467, -9.764447], [2773, -9.765265], [2093, -9.792229], [1275, -9.807797], [1026, -9.840271], [1744, -9.841804], [3702, -9.845418], [2483, -9.865479], [4731, -9.867904], [1112, -9.868855], [4160, -9.875394], [3515, -9.897971], [1972, -9.900136], [4314, -9.907335], [1963, -9.939026], [1788, -9.940004], [29094, -9.959443], [20196, -9.979627], [1840, -9.980255], [3974, -9.98733], [946, -10.028827], [3785, -10.029417], [3756, -10.033481], [13159, -10.040638], [4396, -10.0424], [1560, -10.043878], [1343, -10.049479], [8152, -10.056875], [4743, -10.060132]], "logprob_of_token": -0.051839, "top1_top2_margin": 3.912816, "top6_top7_margin": 0.106934}, {"gen_index": 22, "token": 735, "top": [[735, -0.002778], [120007, -7.879786], [46, -8.508558], [2973, -9.062181], [330, -9.354948], [120022, -9.524983], [44, -9.571858], [275, -9.696572], [7732, -10.406098], [2459, -10.407601], [622, -10.409759], [1064, -10.507012], [589, -10.535758], [32, -10.545038], [919, -10.657306], [63, -10.736837], [476, -10.866687], [568, -10.920923], [120016, -11.156331], [314, -11.201921], [262, -11.284799], [527, -11.292381], [14188, -11.309908], [286, -11.320714], [20787, -11.373973], [14896, -11.394029], [73707, -11.427216], [1584, -11.430253], [120000, -11.489278], [1656, -11.506048], [1409, -11.515779], [120625, -11.558627], [378, -11.562283], [263, -11.610286], [3326, -11.709582], [528, -11.712009], [120801, -11.734288], [8157, -11.745404], [58, -11.771191], [120670, -11.796178], [12243, -11.818906], [18754, -11.834173], [1270, -11.860218], [4384, -11.868739], [279, -11.913936], [14419, -11.958665], [824, -12.005404], [745, -12.045776], [20773, -12.049244], [14177, -12.070788], [318, -12.127468], [941, -12.139185], [11308, -12.141301], [439, -12.172559], [7770, -12.198979], [1309, -12.206539], [12195, -12.207373], [22644, -12.24481], [1043, -12.258372], [502, -12.261812], [35211, -12.264338], [41026, -12.301463], [18126, -12.304572], [20758, -12.305775], [120021, -12.310697], [669, -12.311523], [7510, -12.341449], [21681, -12.36413], [57125, -12.372352], [120001, -12.403273], [1333, -12.426471], [120410, -12.451828], [72836, -12.47025], [120098, -12.470935], [1679, -12.475316], [4771, -12.492156], [36533, -12.503969], [3402, -12.516322], [10, -12.574992], [379, -12.579064], [936, -12.593719], [836, -12.604081], [52269, -12.606948], [59405, -12.609531], [14153, -12.649615], [62024, -12.655185], [59, -12.70143], [766, -12.70168], [120002, -12.702625], [93, -12.714372], [120008, -12.723511], [2457, -12.735314], [34858, -12.736354], [10244, -12.739893], [576, -12.751241], [1436, -12.769563], [33275, -12.789283], [61, -12.814279], [2213, -12.827502], [103784, -12.844742]], "logprob_of_token": -0.002778, "top1_top2_margin": 7.877008, "top6_top7_margin": 0.046875}, {"gen_index": 23, "token": 2973, "top": [[2973, -0.039225], [1584, -3.564401], [1409, -6.550417], [120007, -7.285471], [44, -8.14054], [41084, -8.311318], [262, -8.369339], [120022, -8.55123], [263, -8.587457], [10, -8.588494], [735, -8.61235], [502, -8.786916], [3368, -9.181705], [4771, -9.445849], [3142, -9.525262], [2117, -9.699409], [32, -9.734819], [828, -9.828473], [836, -9.890281], [1410, -9.953305], [46, -9.964587], [1090, -9.987495], [12107, -10.030917], [120021, -10.042794], [2468, -10.047601], [4315, -10.081679], [1436, -10.170592], [7510, -10.239619], [20142, -10.242831], [120016, -10.258635], [1319, -10.267844], [823, -10.277209], [37690, -10.281783], [1333, -10.350423], [8345, -10.36099], [3918, -10.366763], [3658, -10.385983], [8536, -10.423538], [2302, -10.433469], [3467, -10.442697], [2213, -10.487235], [527, -10.53327], [110629, -10.558855], [2668, -10.562422], [14272, -10.62678], [120087, -10.633866], [941, -10.782374], [3702, -10.788784], [98621, -10.814003], [3924, -10.815053], [1972, -10.849172], [20758, -10.858916], [14188, -10.873698], [2042, -10.912599], [3737, -10.913196], [488, -10.949881], [2246, -10.964865], [94416, -10.968616], [1662, -10.969769], [1744, -10.993625], [110546, -11.002223], [762, -11.031805], [3326, -11.035708], [1324, -11.069905], [33274, -11.09656], [2374, -11.107125], [2711, -11.115046], [4273, -11.129827], [12973, -11.138911], [745, -11.140813], [9310, -11.162173], [534, -11.173646], [4959, -11.180785], [11981, -11.188096], [453, -11.231982], [314, -11.232162], [120000, -11.247339], [9474, -11.296969], [988, -11.307392], [4700, -11.315703], [4731, -11.31839], [4787, -11.324473], [3314, -11.354855], [398, -11.359184], [779, -11.364118], [6563, -11.38921], [57125, -11.431788], [8594, -11.435103], [15697, -11.437602], [7208, -11.450477], [1093, -11.450669], [2487, -11.452298], [4384, -11.452342], [10664, -11.460836], [20196, -11.461923], [127906, -11.480653], [1305, -11.507157], [286, -11.518854], [2157, -11.522756], [327, -11.524392]], "logprob_of_token": -0.039225, "top1_top2_margin": 3.525176, "top6_top7_margin": 0.058021}, {"gen_index": 24, "token": 44, "top": [[44, -0.05804], [275, -3.466556], [46, -4.055504], [120007, -5.942165], [314, -6.349172], [120016, -7.119812], [63, -8.297703], [263, -8.648309], [988, -8.851474], [120021, -9.011184], [33, -9.045419], [120022, -9.078936], [14188, -9.239408], [10, -9.504897], [2519, -9.551747], [120028, -9.669751], [120468, -9.957668], [121119, -9.963527], [735, -10.033869], [124969, -10.266543], [1409, -10.421771], [1043, -10.441224], [7510, -10.56682], [745, -10.635077], [59, -10.679851], [120103, -10.68688], [766, -10.751557], [120003, -10.889187], [4137, -10.893917], [120002, -10.937623], [127906, -10.950141], [1914, -11.018132], [11861, -11.02614], [405, -11.035085], [14153, -11.053549], [1829, -11.067439], [120008, -11.2147], [120409, -11.268316], [122158, -11.371438], [120000, -11.423079], [121379, -11.522806], [20758, -11.53791], [32, -11.581962], [58, -11.612253], [120359, -11.631248], [120410, -11.723045], [4679, -11.838414], [286, -11.859494], [4412, -11.954988], [120001, -12.044368], [120087, -12.105201], [36209, -12.136439], [74254, -12.181375], [120844, -12.284335], [120277, -12.304022], [121083, -12.306273], [30035, -12.339386], [120399, -12.344481], [69555, -12.371621], [120302, -12.395269], [126545, -12.408166], [120214, -12.412362], [779, -12.453847], [120489, -12.45618], [36040, -12.507412], [26530, -12.517536], [4343, -12.556182], [14179, -12.556442], [18390, -12.649291], [669, -12.667446], [120241, -12.693028], [460, -12.713909], [262, -12.742599], [589, -12.75739], [5071, -12.76303], [34, -12.809274], [622, -12.817669], [6391, -12.850637], [7496, -12.872315], [45507, -12.904716], [120751, -12.914697], [103784, -12.92802], [120173, -12.937755], [33676, -12.953465], [656, -12.964789], [467, -12.980111], [8894, -12.996827], [120230, -13.020609], [3290, -13.065844], [2459, -13.071408], [20196, -13.074309], [17870, -13.075665], [1275, -13.099313], [58965, -13.11255], [44455, -13.116017], [2410, -13.117623], [57628, -13.119016], [120101, -13.121126], [122226, -13.141204], [531, -13.145051]], "logprob_of_token": -0.05804, "top1_top2_margin": 3.408516, "top6_top7_margin": 1.177891}, {"gen_index": 25, "token": 1409, "top": [[1409, -0.002454], [7510, -7.138297], [286, -8.235518], [1584, -9.03072], [936, -9.153779], [120022, -9.358159], [1914, -9.450575], [20196, -10.088016], [57125, -10.22681], [669, -10.552613], [1407, -10.643981], [10090, -10.744252], [32, -10.960052], [120103, -11.077843], [14468, -11.085568], [57628, -11.180611], [120087, -11.235025], [127906, -11.436333], [14792, -11.454323], [766, -11.577878], [25071, -11.670594], [4412, -11.712894], [26530, -11.715508], [1323, -11.758182], [262, -11.768186], [2302, -11.834483], [1410, -11.892017], [86331, -11.903642], [3924, -12.03866], [779, -12.045426], [393, -12.055324], [263, -12.1125], [5696, -12.1516], [5496, -12.156348], [8545, -12.17572], [28810, -12.258163], [21600, -12.272336], [14192, -12.295499], [1275, -12.318932], [379, -12.319837], [2982, -12.340579], [941, -12.365728], [24122, -12.380099], [565, -12.403544], [120007, -12.452609], [50888, -12.478279], [420, -12.488093], [23395, -12.550271], [6858, -12.552743], [7615, -12.55397], [10, -12.574962], [63038, -12.590863], [12913, -12.60243], [23138, -12.606856], [120098, -12.627187], [120004, -12.630928], [120014, -12.702231], [7331, -12.704008], [527, -12.713472], [14794, -12.731444], [1333, -12.785698], [78130, -12.824058], [327, -12.835536], [7008, -12.859259], [14419, -12.866414], [120001, -12.90287], [6444, -12.904514], [4731, -12.911704], [5071, -12.93471], [2376, -12.95096], [2213, -13.004225], [73970, -13.012486], [777, -13.018379], [622, -13.041546], [16604, -13.050506], [4743, -13.063398], [14188, -13.128567], [476, -13.138523], [1765, -13.156926], [23790, -13.161794], [3368, -13.176175], [946, -13.251484], [3918, -13.293223], [6391, -13.302482], [467, -13.310671], [1972, -13.314061], [453, -13.332665], [5274, -13.390488], [120016, -13.425908], [35519, -13.438201], [44895, -13.46498], [828, -13.470891], [965, -13.478398], [3326, -13.484272], [735, -13.488977], [20758, -13.505558], [34242, -13.584459], [1026, -13.588613], [46, -13.601025], [3756, -13.605015]], "logprob_of_token": -0.002454, "top1_top2_margin": 7.135843, "top6_top7_margin": 0.092416}, {"gen_index": 26, "token": 44, "top": [[44, -0.016246], [1584, -4.762782], [120007, -6.274761], [46, -7.077208], [988, -7.640601], [10, -7.817922], [120016, -8.278234], [120021, -8.343671], [263, -8.358121], [275, -8.453708], [314, -8.482071], [120028, -8.880195], [120022, -9.446979], [534, -9.514729], [2773, -9.687295], [120000, -9.743567], [2457, -10.046502], [120468, -10.085823], [5496, -10.139529], [121119, -10.172753], [2042, -10.192204], [745, -10.298882], [262, -10.316318], [14188, -10.49904], [32, -10.650573], [1409, -10.830555], [766, -10.891477], [127906, -10.907202], [286, -10.911008], [33, -11.011549], [94365, -11.013632], [58, -11.018607], [120087, -11.051274], [121379, -11.086954], [669, -11.142286], [405, -11.217301], [59, -11.223828], [7510, -11.226969], [63, -11.241799], [124969, -11.319274], [120410, -11.377008], [20758, -11.382855], [25945, -11.418067], [120103, -11.449589], [120003, -11.451836], [120214, -11.467425], [65268, -11.476159], [120008, -11.500767], [8152, -11.529231], [126545, -11.555889], [327, -11.600661], [34, -11.677467], [7768, -11.690777], [527, -11.692978], [1410, -11.716333], [122226, -11.748693], [3326, -11.833378], [5675, -11.86184], [120001, -11.865129], [29094, -11.943787], [656, -11.948703], [122158, -11.96556], [2302, -11.968024], [25071, -12.023997], [941, -12.041671], [120002, -12.100404], [11861, -12.132397], [3368, -12.182744], [123367, -12.186799], [122046, -12.19386], [318, -12.25929], [1436, -12.264745], [1659, -12.313685], [120409, -12.336563], [117149, -12.341899], [120359, -12.390416], [379, -12.396777], [6391, -12.41687], [1829, -12.420623], [120277, -12.429283], [1744, -12.435914], [284, -12.442816], [121083, -12.454091], [26071, -12.458796], [69555, -12.472166], [1275, -12.478426], [49, -12.497969], [3924, -12.543332], [120098, -12.555038], [936, -12.56746], [2213, -12.58939], [14153, -12.592112], [1062, -12.594266], [57125, -12.599101], [900, -12.599715], [1914, -12.643507], [1043, -12.644256], [14139, -12.65978], [4679, -12.663368], [735, -12.668815]], "logprob_of_token": -0.016246, "top1_top2_margin": 4.746536, "top6_top7_margin": 0.460312}, {"gen_index": 27, "token": 1584, "top": [[1584, -0.006108], [1409, -5.526392], [5496, -8.660006], [534, -8.925632], [2042, -9.161226], [669, -9.527481], [120022, -9.609129], [262, -9.890963], [2973, -9.894641], [7510, -10.01058], [1914, -10.53425], [936, -10.674814], [3368, -10.690979], [3326, -10.791419], [1436, -11.013557], [3924, -11.096863], [29094, -11.150507], [14419, -11.227512], [286, -11.274934], [941, -11.314583], [8545, -11.363185], [1333, -11.413676], [32, -11.43707], [2773, -11.475763], [1765, -11.532476], [2213, -11.70187], [527, -11.711309], [393, -11.71921], [1410, -11.724436], [120087, -11.724548], [379, -11.762032], [120007, -11.824968], [263, -11.851364], [453, -11.871104], [20196, -11.913251], [120098, -11.973404], [51770, -11.978927], [762, -11.988292], [7833, -11.991811], [94365, -12.009191], [2457, -12.047855], [25945, -12.049276], [836, -12.06407], [1275, -12.072749], [14792, -12.075729], [2468, -12.097885], [26530, -12.136564], [2155, -12.137311], [14165, -12.151132], [33599, -12.187071], [4595, -12.190969], [63038, -12.212887], [127906, -12.226461], [2302, -12.25604], [565, -12.261418], [120103, -12.277353], [1744, -12.283049], [779, -12.308674], [7768, -12.326623], [622, -12.349154], [25071, -12.351787], [10, -12.38336], [873, -12.4147], [763, -12.434577], [1963, -12.472261], [766, -12.507338], [835, -12.508707], [1427, -12.513844], [8152, -12.520857], [4743, -12.5373], [28810, -12.560575], [120014, -12.586096], [965, -12.607329], [57125, -12.621338], [318, -12.636476], [5675, -12.673848], [2545, -12.704237], [8279, -12.712958], [1323, -12.713885], [3827, -12.749285], [799, -12.749674], [65268, -12.761137], [488, -12.794259], [1435, -12.7959], [777, -12.822968], [120004, -12.825569], [1407, -12.835773], [327, -12.8549], [120001, -12.862244], [1324, -12.875635], [6391, -12.880398], [3467, -12.898621], [2403, -12.904981], [4731, -12.908709], [14188, -12.90995], [1133, -12.927486], [2246, -12.941839], [1659, -12.959438], [2376, -12.982338], [946, -12.992195]], "logprob_of_token": -0.006108, "top1_top2_margin": 5.520285, "top6_top7_margin": 0.081648}, {"gen_index": 28, "token": 735, "top": [[735, -0.003883], [10, -7.424285], [263, -7.916348], [120007, -8.400033], [2459, -8.834937], [120022, -8.91986], [120021, -9.57484], [46, -9.614745], [120016, -9.945802], [127906, -10.078028], [120087, -10.145789], [314, -10.36906], [330, -10.372417], [44, -10.462987], [275, -10.572417], [2973, -10.588895], [589, -10.664644], [32, -10.788424], [919, -10.958355], [14896, -11.019507], [73707, -11.060391], [568, -11.123289], [120000, -11.176119], [262, -11.187696], [14419, -11.188294], [14188, -11.202434], [63, -11.295733], [120103, -11.308288], [18126, -11.311982], [1409, -11.364203], [622, -11.376697], [1064, -11.398451], [120214, -11.420929], [120098, -11.485888], [476, -11.516042], [120004, -11.584115], [120002, -11.647041], [527, -11.706705], [1584, -11.765229], [120670, -11.785624], [120410, -11.861609], [378, -11.919036], [120724, -11.928638], [988, -11.935668], [120038, -11.962122], [120625, -11.966022], [7732, -12.003499], [1656, -12.017213], [20758, -12.029961], [121407, -12.052191], [120302, -12.057563], [120001, -12.066485], [120489, -12.226137], [286, -12.251308], [58, -12.258109], [941, -12.263009], [528, -12.265367], [669, -12.268613], [14177, -12.27694], [576, -12.281138], [20773, -12.295156], [824, -12.317555], [3326, -12.321603], [1043, -12.327895], [122158, -12.349286], [279, -12.350334], [120014, -12.35649], [502, -12.368411], [127908, -12.37276], [120173, -12.409427], [120008, -12.430797], [120801, -12.476472], [745, -12.557845], [61, -12.576384], [122046, -12.609737], [318, -12.635027], [1309, -12.636849], [93, -12.640145], [439, -12.641196], [1270, -12.645881], [123745, -12.680655], [7510, -12.744163], [12195, -12.757871], [460, -12.777304], [1333, -12.778476], [1436, -12.784816], [6989, -12.856573], [46952, -12.889157], [4384, -12.896941], [1410, -12.898966], [57125, -12.904249], [49, -12.920158], [127393, -12.925481], [766, -12.930274], [830, -12.970482], [617, -12.971128], [120844, -13.003014], [37690, -13.007627], [103784, -13.01218], [3402, -13.012355]], "logprob_of_token": -0.003883, "top1_top2_margin": 7.420403, "top6_top7_margin": 0.65498}, {"gen_index": 29, "token": 2973, "top": [[2973, -0.017022], [1584, -4.59157], [1409, -7.029116], [120007, -7.59503], [263, -7.784834], [10, -7.967087], [262, -8.63885], [41084, -8.699019], [120022, -8.843251], [502, -9.209098], [735, -9.324258], [32, -9.713183], [44, -9.927121], [120021, -9.953107], [3368, -10.070463], [4771, -10.0715], [1090, -10.129255], [120016, -10.257934], [828, -10.316998], [3142, -10.355825], [2117, -10.359801], [12107, -10.45652], [1333, -10.467376], [4315, -10.48248], [20142, -10.583217], [8536, -10.617187], [120087, -10.645065], [1436, -10.667809], [1410, -10.684965], [37690, -10.773398], [8345, -10.794929], [110629, -10.795808], [1319, -10.81231], [2668, -10.88122], [836, -10.903696], [127906, -10.932978], [823, -10.957792], [2213, -11.006173], [3658, -11.064605], [3467, -11.068288], [527, -11.085507], [941, -11.096555], [3702, -11.145921], [14272, -11.211395], [110546, -11.24153], [46, -11.263062], [3918, -11.269635], [7510, -11.273326], [98621, -11.276338], [94416, -11.35295], [20758, -11.373137], [6563, -11.414178], [745, -11.417455], [14188, -11.43296], [9310, -11.434539], [33274, -11.442286], [2302, -11.454429], [762, -11.470278], [4273, -11.517341], [120410, -11.530742], [2246, -11.531917], [13798, -11.549967], [1972, -11.565635], [3314, -11.57048], [3924, -11.57918], [3326, -11.580617], [120004, -11.590269], [1744, -11.600883], [11981, -11.613984], [120103, -11.633353], [120098, -11.646996], [3737, -11.654716], [106570, -11.698765], [7208, -11.708857], [327, -11.711054], [453, -11.724067], [2711, -11.733174], [1093, -11.746325], [120000, -11.781591], [900, -11.794616], [1324, -11.797259], [2468, -11.831117], [565, -11.831584], [1930, -11.833558], [14419, -11.841971], [4731, -11.876021], [8594, -11.891666], [2487, -11.900419], [13789, -11.941228], [10664, -11.942228], [622, -11.948013], [7838, -11.961029], [1662, -11.963468], [122158, -11.965352], [121379, -11.969251], [2374, -11.977102], [4647, -11.978238], [120002, -12.003007], [12973, -12.007204], [2944, -12.00878]], "logprob_of_token": -0.017022, "top1_top2_margin": 4.574549, "top6_top7_margin": 0.671763}, {"gen_index": 30, "token": 44, "top": [[44, -0.055193], [275, -3.475779], [46, -4.470738], [314, -5.733935], [120007, -6.023149], [120016, -6.782587], [263, -7.306023], [988, -7.771289], [120021, -8.268553], [10, -8.295378], [120028, -8.581098], [63, -8.933051], [14188, -9.052765], [33, -9.14968], [120022, -9.277219], [2519, -9.343305], [120468, -9.499022], [121119, -9.618787], [124969, -9.745341], [127906, -9.810296], [4137, -9.93344], [735, -10.238001], [120003, -10.296152], [120103, -10.350797], [766, -10.393643], [7510, -10.446074], [120002, -10.566964], [120008, -10.587211], [1043, -10.616216], [122158, -10.645658], [11861, -10.697174], [745, -10.813455], [59, -10.834928], [405, -10.855535], [121379, -10.85561], [1409, -10.904165], [1829, -10.986424], [120359, -11.016164], [120000, -11.036668], [120410, -11.069457], [32, -11.072021], [36209, -11.088618], [4679, -11.131166], [14153, -11.171035], [1914, -11.270325], [126545, -11.327054], [120087, -11.413655], [120409, -11.427498], [120214, -11.450391], [58, -11.455455], [286, -11.599568], [120302, -11.685682], [120399, -11.712962], [20758, -11.727341], [4343, -11.791298], [120001, -11.807333], [4412, -11.807717], [120241, -11.817882], [30035, -11.862357], [14179, -11.88681], [34, -11.921994], [120844, -11.956148], [69555, -11.957915], [120277, -12.025536], [121083, -12.104815], [669, -12.121266], [120751, -12.134223], [13594, -12.150709], [120489, -12.195609], [36040, -12.218022], [622, -12.234605], [122226, -12.242534], [120173, -12.249513], [120230, -12.296068], [120347, -12.323832], [656, -12.334603], [120068, -12.338859], [18730, -12.363296], [262, -12.386878], [589, -12.395164], [44455, -12.401526], [127908, -12.414507], [779, -12.423532], [3078, -12.44578], [93457, -12.458518], [74254, -12.458695], [460, -12.479259], [467, -12.50139], [45507, -12.55906], [115, -12.562376], [122046, -12.573767], [120101, -12.578883], [120014, -12.580916], [20196, -12.593622], [8894, -12.611064], [531, -12.635453], [3290, -12.648434], [58965, -12.663826], [2410, -12.669455], [7496, -12.725207]], "logprob_of_token": -0.055193, "top1_top2_margin": 3.420586, "top6_top7_margin": 0.523436}, {"gen_index": 31, "token": 1409, "top": [[1409, -0.001882], [7510, -7.584198], [120022, -8.783382], [1584, -9.047001], [286, -9.115361], [936, -9.971603], [1914, -10.04245], [120103, -10.299085], [669, -10.483206], [1407, -10.606963], [127906, -10.656473], [120087, -10.699083], [10090, -11.292367], [263, -11.296149], [4412, -11.44814], [120007, -11.449866], [20196, -11.521083], [262, -11.530354], [32, -11.636278], [57125, -11.652368], [766, -11.732553], [10, -11.868886], [57628, -11.940978], [3924, -11.99348], [120098, -12.156069], [2982, -12.16998], [1410, -12.203025], [120014, -12.240924], [120016, -12.246405], [779, -12.260969], [14792, -12.34532], [1323, -12.389237], [28810, -12.396756], [73970, -12.419061], [26530, -12.425618], [86331, -12.450216], [8545, -12.469309], [14468, -12.471557], [420, -12.487946], [379, -12.503604], [565, -12.505903], [120004, -12.518929], [393, -12.542313], [6858, -12.557977], [5496, -12.585097], [24122, -12.591347], [941, -12.601378], [527, -12.650068], [25071, -12.689272], [1275, -12.731044], [12913, -12.813308], [120021, -12.813939], [14188, -12.827371], [120001, -12.927705], [5274, -12.928355], [7615, -12.939353], [1333, -12.948264], [5696, -12.973655], [127908, -12.997426], [622, -13.021344], [23395, -13.025968], [14419, -13.078998], [2302, -13.096817], [63038, -13.104448], [14192, -13.129443], [6444, -13.138347], [453, -13.154628], [78130, -13.156431], [120173, -13.165484], [7331, -13.173984], [1765, -13.195088], [23138, -13.206555], [120410, -13.208146], [1026, -13.20956], [21600, -13.259818], [327, -13.296514], [20758, -13.312709], [14794, -13.322383], [122719, -13.332857], [739, -13.338954], [476, -13.354408], [799, -13.382782], [275, -13.389358], [3326, -13.398563], [56700, -13.418357], [2376, -13.418451], [2213, -13.418724], [36040, -13.424407], [14153, -13.449345], [735, -13.460921], [6391, -13.462539], [46, -13.468122], [4731, -13.472589], [19555, -13.510125], [120383, -13.525091], [1972, -13.530288], [4743, -13.53032], [2042, -13.544456], [2246, -13.549275], [120008, -13.561221]], "logprob_of_token": -0.001882, "top1_top2_margin": 7.582316, "top6_top7_margin": 0.070847}]}, {"prompt": "x1 = 3, x2 = 7, x3 = 11, x4 =", "input_ids": [120, 49, 576, 32, 51, 44, 14169, 50, 576, 32, 55, 44, 14169, 51, 576, 32, 49, 49, 44, 14169, 52, 576], "generated_ids": [32, 49, 51, 44, 14169, 53, 576, 32, 49, 53, 44, 14169, 54, 576, 32, 49, 55, 44, 14169, 55, 576, 32, 49, 57, 44, 14169, 56, 576, 32, 50, 49, 44], "rows": [{"gen_index": 0, "token": 32, "top": [[32, -0.026733], [49, -6.134008], [120022, -6.455525], [14169, -7.01132], [14153, -7.201931], [622, -7.50798], [735, -7.702252], [262, -7.737743], [766, -7.861623], [1829, -8.132801], [5274, -8.155343], [120018, -8.382079], [502, -8.393432], [55, -8.515473], [263, -8.538724], [941, -8.564663], [946, -8.574819], [936, -8.626318], [3326, -8.645182], [565, -8.728118], [14188, -8.841568], [2403, -8.854323], [1410, -8.888513], [120007, -8.891307], [7510, -8.900639], [50, -8.915139], [46, -9.061361], [2457, -9.083184], [669, -9.087613], [52, -9.110706], [44, -9.278248], [122407, -9.329122], [318, -9.356044], [120383, -9.387219], [2213, -9.435948], [14179, -9.43735], [286, -9.479394], [393, -9.494914], [1427, -9.516999], [1688, -9.517705], [120008, -9.552297], [57, -9.556504], [63, -9.601671], [51, -9.602697], [8545, -9.626555], [6391, -9.628959], [120098, -9.632064], [54, -9.644209], [14172, -9.657336], [53, -9.671992], [120610, -9.695705], [1333, -9.698552], [310, -9.758916], [120103, -9.784977], [527, -9.810555], [120014, -9.813238], [919, -9.824616], [4330, -9.842487], [56, -9.866026], [1409, -9.938652], [3660, -9.948406], [1435, -10.011256], [576, -10.01847], [1073, -10.022607], [474, -10.034628], [467, -10.040812], [14439, -10.042274], [4743, -10.09531], [523, -10.100674], [20758, -10.126123], [120001, -10.130315], [297, -10.169644], [4869, -10.177444], [327, -10.193096], [13460, -10.201537], [528, -10.218133], [58, -10.243099], [103844, -10.291114], [48, -10.308389], [379, -10.35708], [14139, -10.369071], [3544, -10.3873], [18586, -10.417953], [2839, -10.421491], [1319, -10.431649], [439, -10.435027], [275, -10.43838], [582, -10.440818], [2246, -10.441494], [3402, -10.459996], [378, -10.476061], [762, -10.492336], [468, -10.513867], [1765, -10.516465], [8416, -10.520891], [59, -10.542718], [1776, -10.545979], [28851, -10.552381], [11035, -10.581464], [2125, -10.582673]], "logprob_of_token": -0.026733, "top1_top2_margin": 6.107275, "top6_top7_margin": 0.194272}, {"gen_index": 1, "token": 49, "top": [[49, -0.165499], [50, -2.757861], [55, -3.890499], [52, -3.970312], [53, -4.29491], [57, -4.560981], [51, -4.582895], [54, -4.991714], [56, -5.460793], [48, -7.409721], [32, -8.222566], [766, -10.46909], [14153, -10.521907], [120022, -11.154675], [63, -11.156735], [946, -11.193673], [622, -11.359455], [735, -11.44226], [263, -11.495331], [576, -11.514626], [936, -11.540946], [120007, -11.679756], [941, -11.691725], [669, -11.712594], [286, -11.72119], [46, -11.788096], [5274, -11.790101], [262, -11.853225], [20668, -11.853992], [1829, -11.873256], [7510, -11.893864], [2125, -11.901553], [310, -11.924864], [3326, -11.949176], [318, -11.960349], [44, -11.984156], [127906, -12.044783], [3688, -12.152179], [275, -12.169201], [3311, -12.195087], [379, -12.198141], [58, -12.201665], [523, -12.22239], [1688, -12.266849], [2457, -12.284023], [582, -12.329787], [20486, -12.406992], [1049, -12.408121], [297, -12.417706], [502, -12.419756], [1765, -12.444919], [119464, -12.450812], [1043, -12.453223], [14169, -12.476562], [95, -12.491493], [1319, -12.492311], [393, -12.496217], [6391, -12.497576], [1073, -12.498023], [327, -12.499253], [120018, -12.511057], [565, -12.517584], [94, -12.526927], [59, -12.5379], [3544, -12.542898], [1435, -12.569106], [14179, -12.590504], [14188, -12.59059], [467, -12.634999], [840, -12.676348], [10, -12.708184], [30981, -12.711591], [8545, -12.729887], [353, -12.735806], [377, -12.746437], [527, -12.749562], [61, -12.766393], [3167, -12.780804], [1427, -12.798525], [3660, -12.810001], [543, -12.81524], [405, -12.818727], [4396, -12.859531], [1083, -12.862012], [15543, -12.87312], [3780, -12.899728], [120436, -12.909137], [294, -12.919793], [120014, -12.926694], [120008, -12.988528], [1086, -12.994187], [29038, -12.995378], [14162, -13.003728], [1336, -13.014547], [1410, -13.01563], [120000, -13.018922], [528, -13.040354], [36209, -13.043527], [22984, -13.063074], [923, -13.064261]], "logprob_of_token": -0.165499, "top1_top2_margin": 2.592362, "top6_top7_margin": 0.021914}, {"gen_index": 2, "token": 51, "top": [[51, -0.759833], [53, -1.953462], [56, -2.181536], [54, -2.637465], [55, -2.889556], [52, -3.098016], [57, -3.407479], [50, -3.998603], [44, -4.606879], [49, -4.687778], [48, -4.7808], [46, -6.703824], [32, -6.931884], [766, -7.098828], [286, -7.462192], [263, -7.544831], [10, -7.68997], [318, -7.728132], [58, -7.869236], [59, -7.92673], [63, -8.017906], [467, -8.116012], [735, -8.257814], [3688, -8.309188], [377, -8.665214], [327, -8.670833], [275, -8.713737], [1829, -8.881338], [622, -9.021407], [279, -9.081656], [45, -9.082227], [576, -9.109378], [936, -9.215877], [14188, -9.474158], [379, -9.486947], [4869, -9.54033], [439, -9.615523], [14153, -9.620876], [5274, -9.621556], [393, -9.656272], [946, -9.67874], [120007, -9.69137], [310, -9.712754], [1765, -9.739863], [3660, -9.769869], [2457, -9.837865], [941, -9.848041], [14147, -9.858912], [919, -9.859832], [47, -9.922962], [127906, -9.983209], [294, -10.025172], [1917, -10.026102], [1410, -10.081617], [262, -10.087512], [1073, -10.127181], [14169, -10.13542], [34, -10.216481], [33, -10.236506], [502, -10.243852], [476, -10.247299], [3326, -10.247975], [43, -10.248331], [314, -10.252645], [656, -10.25683], [523, -10.269603], [1062, -10.270751], [1086, -10.278623], [565, -10.345294], [14139, -10.346889], [420, -10.369592], [120000, -10.372373], [474, -10.388], [1333, -10.391675], [65, -10.407471], [589, -10.463322], [1739, -10.576076], [120, -10.594771], [2342, -10.597578], [67, -10.611518], [4743, -10.641416], [2403, -10.662642], [3093, -10.667732], [834, -10.682474], [3402, -10.75777], [3301, -10.773029], [14161, -10.775792], [1049, -10.807877], [1064, -10.82086], [4895, -10.824666], [1275, -10.827489], [3003, -10.833984], [94, -10.840659], [669, -10.84956], [779, -10.849759], [14163, -10.852977], [5275, -10.869433], [4257, -10.870877], [2839, -10.906112], [316, -10.913389]], "logprob_of_token": -0.759833, "top1_top2_margin": 1.193628, "top6_top7_margin": 0.309464}, {"gen_index": 3, "token": 44, "top": [[44, -0.085712], [263, -3.636346], [46, -4.716066], [120007, -5.28509], [275, -5.797589], [10, -5.993475], [766, -6.0387], [58, -6.24261], [286, -6.582505], [1829, -6.8378], [59, -7.052978], [49, -7.096219], [120016, -7.230496], [63, -7.300761], [3688, -7.381109], [14188, -7.680315], [420, -7.777338], [7510, -7.861465], [120028, -7.86238], [32, -7.895322], [936, -7.89608], [14147, -7.900383], [622, -8.0235], [735, -8.22544], [14169, -8.304464], [52, -8.327024], [1765, -8.327968], [120022, -8.331402], [988, -8.336215], [377, -8.370954], [262, -8.373075], [48, -8.386602], [310, -8.438196], [121119, -8.534431], [120000, -8.537207], [50, -8.636056], [314, -8.657184], [745, -8.663306], [327, -8.683091], [576, -8.834968], [14161, -8.884634], [47, -8.893282], [120468, -8.914883], [318, -9.009291], [127906, -9.023466], [1062, -9.097943], [51, -9.119226], [467, -9.142782], [120409, -9.190217], [14153, -9.195309], [53, -9.205991], [36040, -9.212287], [121083, -9.222486], [57, -9.268477], [4743, -9.270553], [120008, -9.275237], [1117, -9.286896], [565, -9.350843], [379, -9.429242], [3660, -9.462256], [120038, -9.478675], [54, -9.501081], [1043, -9.513686], [1917, -9.539948], [55, -9.54312], [405, -9.572721], [1394, -9.606059], [5275, -9.645558], [3078, -9.65721], [20758, -9.671885], [946, -9.706409], [2459, -9.716537], [124969, -9.723184], [45, -9.732587], [56, -9.750115], [763, -9.754768], [120021, -9.78889], [2362, -9.793254], [393, -9.810243], [1073, -9.877757], [120, -9.892757], [3326, -9.907058], [33, -9.924706], [120014, -9.984626], [4508, -9.995443], [120003, -9.998909], [2342, -10.008307], [20486, -10.010208], [34, -10.022309], [11861, -10.092635], [474, -10.162673], [120002, -10.173755], [9635, -10.213187], [16604, -10.237554], [14179, -10.239481], [18092, -10.247454], [1474, -10.263603], [582, -10.278195], [913, -10.291225], [5274, -10.307341]], "logprob_of_token": -0.085712, "top1_top2_margin": 3.550634, "top6_top7_margin": 0.045224}, {"gen_index": 4, "token": 14169, "top": [[14169, -0.116961], [286, -3.952365], [7510, -4.103142], [262, -4.486613], [936, -4.588646], [32, -5.127793], [393, -6.101033], [120022, -6.115542], [565, -6.596114], [1776, -6.756018], [1409, -6.860757], [4743, -7.228199], [310, -7.360388], [2213, -7.80613], [3326, -7.807307], [669, -7.821028], [527, -7.833769], [120103, -7.983978], [14172, -8.003814], [3688, -8.180576], [941, -8.199311], [622, -8.248912], [120942, -8.382017], [946, -8.420063], [379, -8.426587], [120383, -8.441959], [1765, -8.443984], [766, -8.470486], [2150, -8.546096], [20758, -8.615839], [318, -8.621404], [5274, -8.641106], [327, -8.649114], [474, -8.671431], [1744, -8.73482], [8545, -8.808547], [120087, -8.825035], [20890, -8.871325], [799, -8.883206], [420, -8.886168], [346, -8.887103], [122629, -8.918565], [36040, -8.94632], [120098, -8.952689], [453, -8.95642], [49, -8.962695], [1688, -9.006474], [2839, -9.01338], [1333, -9.037194], [763, -9.037801], [739, -9.082856], [3504, -9.116012], [543, -9.122692], [948, -9.126023], [1862, -9.136753], [1275, -9.13763], [107274, -9.168642], [16604, -9.17422], [523, -9.200147], [120, -9.200192], [14541, -9.251413], [120014, -9.269242], [762, -9.270256], [14620, -9.294756], [18092, -9.360703], [3924, -9.442683], [124256, -9.442974], [1435, -9.458959], [14163, -9.48757], [576, -9.493812], [1436, -9.516544], [14162, -9.51855], [7162, -9.520917], [14159, -9.535157], [467, -9.579068], [735, -9.591306], [2362, -9.608275], [518, -9.641263], [2457, -9.644837], [3660, -9.646783], [263, -9.68645], [53, -9.699144], [120007, -9.700322], [779, -9.71408], [14792, -9.714664], [1086, -9.724447], [42298, -9.727395], [1917, -9.73665], [14729, -9.768563], [2548, -9.777927], [502, -9.780771], [1336, -9.786654], [1410, -9.787639], [459, -9.793425], [3368, -9.825334], [1806, -9.858259], [14188, -9.859953], [597, -9.861773], [468, -9.875591], [970, -9.904369]], "logprob_of_token": -0.116961, "top1_top2_margin": 3.835403, "top6_top7_margin": 0.97324}, {"gen_index": 5, "token": 53, "top": [[53, -0.037366], [49, -4.666469], [52, -5.481412], [51, -5.916451], [55, -6.184651], [50, -6.656289], [54, -6.940261], [56, -7.411177], [57, -7.756173], [576, -7.967408], [32, -8.651873], [48, -8.716862], [263, -8.950784], [4241, -9.455506], [10, -9.552073], [379, -9.787692], [46, -9.831085], [65, -9.990469], [44, -10.07023], [58, -10.282753], [63, -10.293619], [766, -10.30518], [120007, -10.328772], [73, -10.369864], [622, -10.404145], [735, -10.49604], [61, -10.535888], [318, -10.549545], [262, -10.59833], [13331, -10.627665], [127906, -10.63114], [95, -10.672569], [286, -10.773108], [1073, -10.779232], [79, -10.808292], [59, -10.825569], [84993, -10.840982], [7510, -10.861649], [5274, -10.887093], [439, -10.901343], [14153, -10.946262], [7294, -10.998628], [75, -11.048025], [325, -11.052744], [39, -11.05765], [275, -11.076612], [56280, -11.081075], [294, -11.09508], [110, -11.126066], [14169, -11.1428], [78, -11.153469], [589, -11.17541], [35, -11.196299], [2457, -11.223763], [67, -11.240276], [120016, -11.246829], [77, -11.260011], [85595, -11.302622], [14139, -11.303905], [936, -11.315481], [1275, -11.333298], [1829, -11.356594], [4396, -11.405934], [1606, -11.407999], [115, -11.446539], [52573, -11.488396], [97, -11.495075], [120, -11.497485], [68, -11.499292], [941, -11.50168], [127908, -11.543726], [279, -11.567385], [34, -11.56778], [70, -11.574216], [1319, -11.579662], [99, -11.579859], [327, -11.597102], [66, -11.618437], [1305, -11.621113], [523, -11.628169], [3688, -11.641688], [1112, -11.641804], [1776, -11.646037], [58077, -11.663973], [310, -11.667827], [476, -11.679739], [45, -11.700018], [669, -11.71054], [14163, -11.725885], [80, -11.750404], [4257, -11.773376], [467, -11.794713], [835, -11.802547], [40, -11.812279], [36, -11.814615], [2150, -11.817242], [94, -11.830731], [47, -11.833549], [834, -11.847123], [120022, -11.851425]], "logprob_of_token": -0.037366, "top1_top2_margin": 4.629103, "top6_top7_margin": 0.283972}, {"gen_index": 6, "token": 576, "top": [[576, -0.010168], [735, -6.641381], [32, -7.057438], [61, -7.173608], [286, -8.296378], [58, -8.348286], [1829, -8.35598], [318, -8.400919], [44, -8.579918], [46, -8.770277], [120007, -9.047634], [263, -9.125509], [14188, -9.266115], [476, -9.337988], [439, -9.352749], [622, -9.410049], [919, -9.451656], [120022, -9.481665], [1270, -9.505644], [528, -9.70458], [262, -9.802399], [766, -9.808215], [327, -9.83617], [568, -10.003807], [379, -10.023497], [936, -10.138011], [14153, -10.209963], [1064, -10.241203], [393, -10.264906], [310, -10.271847], [49, -10.286876], [1656, -10.293509], [2457, -10.406511], [275, -10.484517], [10, -10.561081], [279, -10.579016], [474, -10.585032], [824, -10.666525], [378, -10.676414], [527, -10.677297], [63, -10.678525], [1073, -10.70229], [1765, -10.708282], [120016, -10.738167], [4743, -10.756028], [2839, -10.76598], [7510, -10.825239], [1275, -10.839643], [589, -10.879717], [59, -10.914156], [502, -10.916275], [2459, -10.937373], [120091, -10.95612], [3688, -10.95682], [3167, -10.982674], [11577, -10.983594], [127797, -11.024922], [14169, -11.060106], [1444, -11.063826], [95, -11.095932], [830, -11.113616], [1309, -11.166245], [14713, -11.166573], [4869, -11.172432], [5274, -11.236278], [1972, -11.294239], [120103, -11.308033], [14139, -11.308887], [467, -11.318664], [8150, -11.337168], [3326, -11.378775], [1410, -11.381217], [20758, -11.399953], [34, -11.426485], [1409, -11.434425], [8055, -11.436113], [18092, -11.501408], [15703, -11.503149], [420, -11.504577], [48, -11.52959], [4088, -11.541138], [14417, -11.564962], [617, -11.582281], [4384, -11.611052], [47, -11.613817], [3402, -11.620524], [120006, -11.630068], [3660, -11.632854], [946, -11.638207], [297, -11.645268], [34324, -11.648681], [15239, -11.668622], [8954, -11.675987], [1427, -11.677197], [565, -11.680637], [4508, -11.683704], [120000, -11.690342], [115, -11.712122], [127906, -11.72261], [11308, -11.7278]], "logprob_of_token": -0.010168, "top1_top2_margin": 6.631213, "top6_top7_margin": 0.007694}, {"gen_index": 7, "token": 32, "top": [[32, -0.010157], [49, -6.918803], [318, -7.524134], [120022, -8.411795], [946, -8.554582], [5274, -8.598548], [1829, -8.72589], [14188, -9.001615], [14153, -9.007601], [327, -9.21234], [262, -9.254811], [3417, -9.307836], [120018, -9.511207], [502, -9.511933], [766, -9.51828], [3326, -9.584823], [735, -9.606971], [20195, -9.652133], [622, -9.720092], [286, -9.823689], [46, -9.854865], [941, -9.894671], [1765, -9.910903], [379, -9.967692], [936, -9.983247], [2213, -10.016858], [263, -10.026035], [1410, -10.074914], [2945, -10.097638], [393, -10.191768], [4075, -10.227559], [7510, -10.271989], [44, -10.377737], [1409, -10.381986], [527, -10.398206], [474, -10.415948], [1688, -10.4166], [120007, -10.419639], [4330, -10.423395], [2457, -10.540717], [297, -10.546029], [669, -10.632609], [923, -10.640993], [565, -10.642433], [58, -10.710406], [120383, -10.743737], [8545, -10.81956], [582, -10.860351], [122407, -10.861252], [1917, -10.869041], [20758, -10.908914], [1333, -10.911965], [439, -10.920548], [14169, -10.923402], [14541, -10.939999], [103844, -10.946581], [32099, -10.976068], [4743, -10.984385], [14139, -10.994608], [3544, -10.999175], [2051, -11.010278], [420, -11.086897], [4869, -11.125461], [120008, -11.12864], [2403, -11.129689], [1776, -11.146915], [120098, -11.147205], [3660, -11.168044], [310, -11.18891], [3688, -11.191136], [1270, -11.195093], [59, -11.197272], [120610, -11.211298], [18586, -11.238465], [50, -11.259078], [275, -11.260776], [543, -11.291932], [378, -11.297753], [14179, -11.298451], [476, -11.323666], [120103, -11.335242], [1435, -11.346279], [63, -11.352424], [53, -11.369563], [405, -11.396842], [1275, -11.400045], [2944, -11.433187], [14267, -11.443175], [55, -11.45114], [1578, -11.457586], [22984, -11.459327], [597, -11.459726], [1444, -11.4643], [3827, -11.472748], [4396, -11.48647], [5796, -11.500749], [13460, -11.505569], [346, -11.526381], [3678, -11.54144], [6391, -11.548618]], "logprob_of_token": -0.010157, "top1_top2_margin": 6.908646, "top6_top7_margin": 0.127342}, {"gen_index": 8, "token": 49, "top": [[49, -0.03329], [57, -5.61594], [50, -5.772367], [55, -6.069972], [53, -6.253333], [51, -6.522624], [56, -6.708572], [32, -6.949883], [54, -7.310229], [52, -7.47662], [48, -7.810314], [946, -9.122028], [766, -9.23528], [14153, -9.421279], [1829, -9.499951], [576, -9.581608], [5274, -9.58666], [327, -9.750481], [262, -9.814134], [622, -9.996481], [14188, -10.068368], [393, -10.100128], [127906, -10.148216], [286, -10.226872], [7510, -10.238601], [379, -10.255242], [20195, -10.272449], [3326, -10.308331], [318, -10.316527], [582, -10.423864], [120007, -10.457189], [297, -10.508983], [735, -10.522222], [2125, -10.553985], [120022, -10.575057], [58, -10.592058], [44, -10.619875], [669, -10.624187], [263, -10.632312], [3688, -10.674903], [6391, -10.729409], [941, -10.746078], [46, -10.76615], [1765, -10.796315], [1073, -10.821347], [1688, -10.855945], [936, -10.862404], [55332, -10.872432], [527, -10.923835], [3311, -10.942442], [63, -10.980107], [923, -11.038005], [405, -11.081932], [543, -11.122019], [294, -11.149571], [502, -11.156405], [565, -11.158277], [377, -11.159239], [10, -11.165616], [14179, -11.165754], [3544, -11.226291], [4396, -11.254423], [127907, -11.254624], [59, -11.260801], [275, -11.273074], [85713, -11.314041], [22984, -11.315202], [1435, -11.320476], [39, -11.324455], [1049, -11.337237], [1972, -11.347092], [14419, -11.350125], [120008, -11.350762], [4631, -11.379555], [310, -11.401132], [120000, -11.416689], [61, -11.431122], [1410, -11.44735], [14158, -11.473202], [2945, -11.478986], [3417, -11.497031], [14541, -11.500912], [14267, -11.525113], [127908, -11.525818], [439, -11.526935], [9, -11.560613], [14163, -11.575864], [4075, -11.581381], [1275, -11.5909], [3167, -11.595594], [14139, -11.59973], [420, -11.620644], [18586, -11.639709], [3660, -11.649592], [353, -11.650752], [745, -11.662321], [120018, -11.666294], [10664, -11.667976], [2560, -11.67353], [474, -11.676971]], "logprob_of_token": -0.03329, "top1_top2_margin": 5.58265, "top6_top7_margin": 0.185949}, {"gen_index": 9, "token": 53, "top": [[53, -0.107705], [55, -2.568122], [52, -4.895137], [49, -5.534876], [51, -5.790875], [54, -5.900092], [57, -6.185662], [56, -6.694687], [48, -7.429935], [50, -8.064353], [32, -8.956109], [44, -9.137658], [46, -9.458824], [318, -9.633429], [766, -10.139009], [10, -10.214343], [63, -10.74147], [263, -10.757082], [58, -10.813759], [735, -10.815581], [34, -11.132512], [576, -11.175061], [946, -11.191503], [59, -11.256763], [379, -11.274447], [275, -11.276652], [127906, -11.290805], [3688, -11.299581], [286, -11.316897], [622, -11.41453], [1765, -11.447105], [279, -11.462175], [327, -11.466146], [4241, -11.549953], [14153, -11.605018], [3326, -11.626442], [936, -11.699922], [120007, -11.757933], [7510, -11.776384], [262, -11.840824], [120000, -11.916297], [3660, -11.93094], [45, -11.966036], [2125, -11.994577], [669, -12.071933], [1275, -12.109426], [101, -12.147915], [14541, -12.152438], [310, -12.175299], [919, -12.2032], [1829, -12.219437], [14188, -12.24688], [5274, -12.281117], [52573, -12.284196], [314, -12.292107], [474, -12.294803], [377, -12.302488], [93, -12.351317], [1073, -12.362199], [543, -12.366703], [47, -12.388647], [947, -12.440785], [582, -12.471025], [439, -12.495611], [527, -12.505594], [294, -12.515159], [2839, -12.515712], [2114, -12.517953], [941, -12.52821], [1410, -12.537989], [43, -12.547013], [5398, -12.551518], [14139, -12.581503], [923, -12.589721], [589, -12.590281], [1744, -12.592486], [1409, -12.60102], [4895, -12.602347], [523, -12.606928], [393, -12.623755], [37, -12.628518], [577, -12.651212], [39, -12.659493], [61, -12.667253], [6391, -12.687166], [467, -12.708686], [1049, -12.717902], [14267, -12.721494], [14417, -12.722162], [420, -12.726016], [353, -12.731305], [530, -12.737598], [41, -12.747187], [4396, -12.77046], [4075, -12.77502], [3544, -12.78934], [502, -12.795407], [2342, -12.80911], [4743, -12.813128], [14147, -12.818851]], "logprob_of_token": -0.107705, "top1_top2_margin": 2.460417, "top6_top7_margin": 0.28557}, {"gen_index": 10, "token": 44, "top": [[44, -0.248119], [263, -2.426573], [275, -3.162819], [46, -3.388186], [10, -4.702243], [120007, -5.171977], [314, -5.749051], [120016, -6.025383], [1829, -6.15507], [766, -6.288589], [59, -6.630172], [14188, -6.637054], [58, -6.876138], [120028, -6.895717], [63, -7.164836], [988, -7.312323], [14147, -7.322253], [286, -7.33868], [127906, -7.534198], [32, -7.944901], [3688, -7.955015], [745, -7.956418], [11861, -8.051085], [121119, -8.182258], [14161, -8.217814], [1765, -8.262869], [124969, -8.352337], [120021, -8.376941], [14153, -8.383347], [120468, -8.452912], [120000, -8.560322], [120038, -8.675953], [622, -8.692131], [262, -8.711737], [735, -8.729124], [405, -8.816132], [7510, -8.849514], [7360, -8.857487], [420, -8.868992], [120022, -8.904708], [2519, -9.022955], [1043, -9.046155], [14169, -9.054331], [310, -9.065882], [121083, -9.097537], [120003, -9.112159], [318, -9.133831], [327, -9.16819], [936, -9.249022], [377, -9.268927], [1394, -9.297698], [33, -9.30884], [3078, -9.336418], [1062, -9.353168], [20758, -9.417125], [120014, -9.43957], [5275, -9.444214], [120409, -9.563478], [467, -9.623064], [120277, -9.632485], [47, -9.661554], [120008, -9.662305], [20486, -9.685582], [4137, -9.687029], [2342, -9.71713], [120002, -9.72746], [34, -9.745089], [14179, -9.796601], [379, -9.824164], [36040, -9.884645], [93, -9.885675], [120359, -9.887445], [120724, -9.903709], [45, -9.90743], [120103, -9.962134], [279, -9.964721], [595, -9.992577], [49, -9.997922], [1117, -10.008509], [11104, -10.063024], [393, -10.090213], [576, -10.091791], [474, -10.098383], [69555, -10.157639], [127908, -10.168547], [3326, -10.172831], [110441, -10.178502], [120375, -10.20515], [126203, -10.212092], [1275, -10.22226], [763, -10.228477], [543, -10.241637], [120399, -10.281493], [656, -10.284616], [565, -10.297112], [946, -10.304806], [121379, -10.335124], [5274, -10.361363], [47526, -10.364039], [779, -10.365658]], "logprob_of_token": -0.248119, "top1_top2_margin": 2.178454, "top6_top7_margin": 0.577074}, {"gen_index": 11, "token": 14169, "top": [[14169, -0.180882], [286, -3.636401], [936, -3.964738], [262, -4.031697], [7510, -4.295058], [1409, -5.190301], [32, -5.31678], [120022, -5.756862], [393, -5.892853], [565, -6.180532], [2213, -6.356252], [4743, -6.547014], [1776, -6.826391], [310, -6.994883], [3326, -7.075008], [120103, -7.236179], [941, -7.309784], [669, -7.513384], [453, -7.567089], [3688, -7.647483], [1765, -7.788379], [527, -7.794875], [420, -7.860664], [346, -7.866142], [3924, -7.961718], [946, -8.198228], [8545, -8.241121], [318, -8.292059], [14541, -8.302228], [1744, -8.303772], [622, -8.343209], [120087, -8.352201], [14172, -8.358421], [766, -8.379252], [120383, -8.427587], [379, -8.458335], [3504, -8.46947], [327, -8.47821], [14620, -8.536658], [20758, -8.54722], [36040, -8.557317], [3368, -8.5681], [5274, -8.57469], [1333, -8.599338], [122629, -8.600944], [2839, -8.613792], [1275, -8.622215], [799, -8.632907], [2150, -8.635991], [120098, -8.653173], [597, -8.655337], [120942, -8.667304], [16604, -8.673658], [763, -8.688045], [1862, -8.696276], [1806, -8.72564], [14792, -8.746262], [1435, -8.780721], [1410, -8.831117], [4401, -8.845881], [735, -8.876169], [762, -8.889218], [14729, -8.912314], [1688, -8.934501], [502, -8.939512], [1972, -8.946048], [474, -8.986222], [1917, -8.992743], [777, -8.998852], [543, -8.998975], [3327, -9.00021], [14791, -9.037866], [739, -9.040498], [518, -9.067257], [120014, -9.153935], [1427, -9.157837], [948, -9.158001], [7162, -9.1653], [523, -9.170195], [14419, -9.170565], [4907, -9.170986], [467, -9.208524], [120007, -9.242566], [12063, -9.243747], [2457, -9.245758], [2842, -9.251286], [13460, -9.278095], [4508, -9.314456], [3142, -9.323175], [14163, -9.358437], [25071, -9.375041], [121122, -9.392053], [20196, -9.402225], [3154, -9.433732], [1112, -9.436926], [107274, -9.473571], [1578, -9.490808], [1083, -9.49386], [263, -9.496322], [4731, -9.502955]], "logprob_of_token": -0.180882, "top1_top2_margin": 3.455519, "top6_top7_margin": 0.126479}, {"gen_index": 12, "token": 54, "top": [[54, -0.03363], [49, -4.172588], [53, -5.372095], [55, -6.377333], [50, -6.458109], [51, -6.505355], [52, -7.001744], [576, -7.732057], [56, -7.863202], [57, -8.076077], [48, -8.166525], [32, -9.19582], [63, -9.354131], [263, -9.926886], [120007, -9.940647], [95, -10.021466], [61, -10.385985], [294, -10.406947], [44, -10.443021], [110, -10.63737], [1606, -10.65296], [46, -10.723671], [379, -10.792694], [63960, -10.794092], [10, -10.857144], [14153, -10.890499], [58, -10.89227], [766, -10.917002], [589, -10.918438], [735, -10.9322], [73, -10.958624], [1073, -10.985779], [4573, -11.002878], [97, -11.028644], [1702, -11.257173], [94, -11.260267], [15085, -11.282684], [11088, -11.311886], [35, -11.327383], [12903, -11.33724], [286, -11.348423], [120016, -11.39742], [5274, -11.424908], [99, -11.446613], [42, -11.473983], [127906, -11.491298], [65, -11.500505], [7510, -11.522129], [318, -11.529991], [13380, -11.530066], [77, -11.54404], [14163, -11.606276], [75, -11.629893], [78, -11.662855], [79, -11.681045], [89, -11.694391], [13187, -11.725956], [101, -11.72621], [121, -11.744852], [2342, -11.753602], [8445, -11.758013], [40, -11.771486], [622, -11.788908], [38464, -11.812735], [1829, -11.815416], [120, -11.822762], [67, -11.822979], [43, -11.851918], [47, -11.875671], [14139, -11.909343], [100, -11.914306], [68, -11.922326], [53650, -11.95726], [109, -11.993785], [120018, -12.002136], [59, -12.046661], [4088, -12.052052], [275, -12.060006], [4396, -12.080992], [39, -12.092229], [3688, -12.103988], [34, -12.11355], [1275, -12.125736], [105, -12.151076], [120022, -12.160102], [14825, -12.173344], [5169, -12.1809], [80, -12.188207], [66085, -12.189863], [83, -12.205646], [14791, -12.211181], [33, -12.229601], [36, -12.241157], [88, -12.249005], [9635, -12.252522], [262, -12.252573], [26691, -12.252896], [45, -12.258134], [439, -12.261952], [26458, -12.266203]], "logprob_of_token": -0.03363, "top1_top2_margin": 4.138958, "top6_top7_margin": 0.496389}, {"gen_index": 13, "token": 576, "top": [[576, -0.008022], [735, -6.88334], [32, -6.967399], [61, -6.995432], [1829, -8.243021], [44, -8.383392], [58, -8.893761], [46, -8.90167], [286, -9.04417], [120007, -9.184325], [528, -9.440772], [318, -9.441831], [14188, -9.496231], [120022, -9.621435], [263, -9.632608], [63, -9.860776], [1270, -9.914723], [439, -10.05646], [919, -10.12721], [476, -10.127769], [49, -10.129282], [95, -10.155253], [14169, -10.21447], [14153, -10.348267], [1064, -10.418175], [120717, -10.478723], [622, -10.488028], [766, -10.581702], [275, -10.671245], [378, -10.721207], [127797, -10.813757], [20758, -10.82806], [824, -10.878222], [120016, -10.886416], [1656, -10.886822], [14417, -10.889872], [279, -10.988729], [830, -11.00268], [120000, -11.021369], [936, -11.024847], [59, -11.027061], [568, -11.047817], [3167, -11.06408], [2839, -11.069512], [1073, -11.09596], [262, -11.126517], [2459, -11.167544], [297, -11.174053], [4088, -11.188131], [14713, -11.192711], [48, -11.217114], [120001, -11.225625], [120091, -11.247295], [45, -11.278234], [379, -11.284664], [120018, -11.370888], [120006, -11.383032], [1765, -11.416584], [7510, -11.420545], [3402, -11.423314], [15397, -11.459217], [120103, -11.461229], [474, -11.471037], [11035, -11.485692], [377, -11.507347], [120, -11.513042], [745, -11.517839], [120008, -11.542301], [4743, -11.561662], [1309, -11.590137], [20773, -11.638008], [310, -11.664073], [3688, -11.665405], [54, -11.692], [10, -11.694418], [14139, -11.707429], [8055, -11.725937], [4508, -11.72781], [2457, -11.754468], [4384, -11.75794], [327, -11.771333], [467, -11.782799], [1275, -11.792638], [2125, -11.798319], [5274, -11.817411], [22241, -11.824068], [34259, -11.828997], [39, -11.841778], [34, -11.878426], [420, -11.899638], [38685, -11.936064], [8150, -11.957005], [18390, -11.965128], [1062, -11.987344], [120098, -11.993731], [18092, -12.001717], [120002, -12.022399], [502, -12.03513], [127906, -12.051066], [946, -12.055649]], "logprob_of_token": -0.008022, "top1_top2_margin": 6.875318, "top6_top7_margin": 0.510368}, {"gen_index": 14, "token": 32, "top": [[32, -0.006954], [49, -6.961304], [1829, -7.825834], [120022, -8.154613], [14153, -8.307761], [14188, -8.621851], [120018, -8.625505], [5274, -9.025939], [946, -9.385019], [766, -9.551846], [3417, -9.662664], [122407, -9.78642], [14169, -9.923276], [263, -10.157326], [941, -10.169277], [32099, -10.195238], [286, -10.303679], [120610, -10.371387], [120383, -10.389006], [120008, -10.403542], [20758, -10.421968], [936, -10.432934], [120103, -10.43563], [55, -10.494587], [14172, -10.535661], [2945, -10.554857], [7510, -10.587285], [297, -10.587706], [103844, -10.638514], [502, -10.653151], [4330, -10.656059], [576, -10.67033], [51, -10.678177], [44, -10.696711], [262, -10.698415], [120007, -10.725334], [1409, -10.743232], [57, -10.749609], [46, -10.750746], [318, -10.904911], [622, -10.905519], [735, -10.90588], [405, -10.907101], [120098, -10.941628], [120014, -10.966549], [439, -11.011752], [14139, -11.025448], [50, -11.104805], [63, -11.160824], [14179, -11.162014], [327, -11.219204], [2125, -11.307164], [54, -11.311281], [59, -11.323452], [346, -11.325817], [48, -11.337978], [377, -11.386276], [4075, -11.393418], [1688, -11.425396], [1410, -11.427454], [120029, -11.436775], [22168, -11.456174], [420, -11.50256], [1917, -11.506938], [8355, -11.510962], [2051, -11.511083], [565, -11.528669], [2213, -11.577784], [1333, -11.600912], [476, -11.612104], [379, -11.613253], [1765, -11.648602], [474, -11.659739], [527, -11.674475], [13460, -11.678443], [14541, -11.680557], [3326, -11.692688], [275, -11.723708], [14267, -11.739652], [18586, -11.770036], [120001, -11.774641], [127906, -11.823641], [56, -11.828803], [3678, -11.836812], [15397, -11.845448], [4508, -11.848372], [42613, -11.850783], [2403, -11.866287], [6391, -11.888492], [1073, -11.903531], [1064, -11.962961], [1178, -11.979351], [58, -11.986353], [8545, -11.993399], [4743, -12.03908], [2457, -12.042816], [14325, -12.049524], [75112, -12.052891], [4396, -12.062686], [4869, -12.086669]], "logprob_of_token": -0.006954, "top1_top2_margin": 6.95435, "top6_top7_margin": 0.003654}, {"gen_index": 15, "token": 49, "top": [[49, -0.047858], [57, -4.584245], [51, -4.664498], [55, -5.164598], [54, -5.734149], [50, -5.868979], [56, -6.68185], [32, -7.011839], [53, -7.158524], [48, -7.179264], [52, -7.513999], [14267, -7.942534], [2051, -8.675048], [119464, -9.052303], [766, -9.630231], [7368, -9.695404], [14153, -9.840762], [286, -9.848958], [44, -9.87494], [946, -9.926776], [1829, -9.943293], [576, -10.186996], [120007, -10.280366], [622, -10.483], [127906, -10.492814], [1073, -10.500338], [5274, -10.500381], [120022, -10.647016], [582, -10.68117], [63, -10.730998], [327, -10.802367], [48976, -10.822269], [7510, -10.825255], [3311, -10.826037], [262, -10.837585], [735, -10.873], [379, -10.903591], [14188, -10.929705], [46, -10.932283], [58, -10.944433], [1972, -10.957002], [81389, -10.965608], [59, -10.997108], [1765, -11.04071], [1209, -11.047394], [297, -11.048575], [941, -11.067468], [318, -11.094705], [294, -11.117423], [936, -11.119859], [263, -11.127149], [120000, -11.253425], [6617, -11.259436], [275, -11.264901], [1409, -11.298577], [377, -11.306606], [61, -11.340861], [2125, -11.371442], [12009, -11.419743], [14169, -11.422403], [3326, -11.441166], [106373, -11.445477], [7469, -11.473728], [93, -11.474108], [527, -11.483229], [1083, -11.502688], [1049, -11.512358], [1343, -11.513061], [6391, -11.527225], [474, -11.579203], [26767, -11.603389], [10, -11.671567], [14179, -11.738803], [14330, -11.755599], [20486, -11.764784], [393, -11.770586], [34387, -11.770666], [310, -11.773072], [2150, -11.780743], [502, -11.794421], [3301, -11.800445], [34, -11.804996], [3688, -11.810845], [5169, -11.819795], [405, -11.825736], [120061, -11.839864], [120008, -11.871892], [39, -11.8729], [43, -11.884631], [10767, -11.891341], [20668, -11.893661], [99187, -11.894855], [3516, -11.911269], [543, -11.927074], [408, -11.930718], [120098, -11.932155], [115856, -11.933081], [21746, -11.946445], [1064, -11.953647], [4284, -11.956365]], "logprob_of_token": -0.047858, "top1_top2_margin": 4.536386, "top6_top7_margin": 0.812871}, {"gen_index": 16, "token": 55, "top": [[55, -0.08338], [54, -3.346283], [53, -3.559853], [57, -5.582496], [56, -5.655877], [49, -5.769195], [51, -5.899771], [52, -7.722095], [48, -7.750207], [50, -8.167708], [44, -8.902111], [32, -10.151542], [46, -10.294256], [766, -10.491858], [10, -11.236279], [263, -11.298192], [93, -11.423811], [58, -11.452258], [63, -11.475854], [275, -11.934376], [127906, -11.964733], [946, -12.015903], [59, -12.046621], [76591, -12.049509], [420, -12.076997], [576, -12.085279], [47, -12.157237], [286, -12.157721], [45, -12.285634], [43, -12.294005], [14153, -12.34582], [120007, -12.34736], [735, -12.418164], [318, -12.476121], [294, -12.52775], [120000, -12.552951], [19827, -12.576522], [2125, -12.5855], [61, -12.693388], [1073, -12.708879], [377, -12.720615], [34, -12.752445], [5274, -12.762175], [379, -12.81283], [12843, -12.860652], [117101, -12.957011], [40, -12.982981], [101, -13.004194], [353, -13.005565], [279, -13.02955], [3688, -13.047842], [314, -13.053268], [41, -13.066259], [4869, -13.132014], [11104, -13.136175], [125, -13.142564], [14188, -13.149903], [2342, -13.185981], [941, -13.18896], [14139, -13.241227], [15543, -13.246941], [7510, -13.256679], [3003, -13.275044], [120, -13.332458], [4075, -13.33989], [37, -13.345582], [1829, -13.364968], [33, -13.37825], [1765, -13.389194], [36, -13.422925], [3326, -13.435635], [582, -13.467509], [4743, -13.47872], [7360, -13.485655], [3301, -13.486541], [262, -13.507276], [120107, -13.52434], [1410, -13.533221], [310, -13.534672], [1921, -13.539704], [936, -13.550407], [531, -13.5532], [5398, -13.556734], [589, -13.560493], [100, -13.56479], [3311, -13.570495], [95, -13.581049], [1049, -13.596291], [68, -13.604425], [11115, -13.605164], [120436, -13.6071], [115, -13.612268], [14147, -13.643357], [622, -13.64535], [68743, -13.65163], [3603, -13.67838], [94, -13.678554], [1043, -13.684521], [1409, -13.686564], [527, -13.690197]], "logprob_of_token": -0.08338, "top1_top2_margin": 3.262903, "top6_top7_margin": 0.130576}, {"gen_index": 17, "token": 44, "top": [[44, -0.023945], [263, -4.724777], [275, -6.316539], [46, -6.345425], [120007, -6.487103], [120016, -6.70361], [10, -7.097265], [766, -7.521585], [286, -8.260779], [1829, -8.517488], [121119, -8.561986], [120028, -8.592787], [63, -8.625182], [59, -8.69005], [14188, -8.839733], [124969, -8.975009], [735, -8.994333], [58, -9.005936], [314, -9.174148], [7510, -9.201258], [11861, -9.301832], [3688, -9.322693], [14169, -9.386008], [127906, -9.419817], [988, -9.424483], [120022, -9.526768], [745, -9.579551], [120468, -9.600505], [420, -9.680035], [120021, -9.73368], [120409, -9.837156], [36040, -9.842624], [120008, -9.880611], [120000, -9.968121], [622, -9.972694], [120375, -9.992766], [14147, -10.11189], [576, -10.118906], [32, -10.121881], [14153, -10.203657], [120103, -10.204837], [121083, -10.324887], [936, -10.326019], [327, -10.382303], [310, -10.388089], [1765, -10.437984], [14161, -10.470457], [467, -10.5757], [120, -10.593478], [120003, -10.668555], [377, -10.745445], [318, -10.776108], [1043, -10.783348], [20758, -10.786705], [120038, -10.80048], [262, -10.843763], [45, -10.858], [2931, -10.948395], [69555, -10.965984], [1394, -11.038187], [47, -11.038435], [122158, -11.055182], [120002, -11.086267], [1073, -11.195216], [393, -11.21207], [2410, -11.212955], [3078, -11.217096], [120436, -11.219918], [49, -11.224314], [120014, -11.226988], [405, -11.236585], [5275, -11.246319], [1062, -11.307747], [1117, -11.322096], [20486, -11.322493], [120107, -11.332504], [14179, -11.346548], [1275, -11.39922], [120724, -11.435526], [1409, -11.446304], [126545, -11.459655], [126203, -11.485119], [476, -11.506837], [568, -11.514712], [474, -11.523212], [4743, -11.544555], [2362, -11.557832], [120410, -11.575472], [3003, -11.61651], [379, -11.65357], [16604, -11.662577], [7419, -11.663157], [294, -11.68998], [5274, -11.708429], [8894, -11.741433], [120081, -11.748772], [48, -11.754724], [33, -11.760654], [3326, -11.764891], [47526, -11.788901]], "logprob_of_token": -0.023945, "top1_top2_margin": 4.700832, "top6_top7_margin": 0.393654}, {"gen_index": 18, "token": 14169, "top": [[14169, -0.051852], [7510, -4.547518], [936, -5.095267], [286, -5.604624], [120022, -6.196368], [262, -6.219029], [32, -6.607218], [393, -7.089095], [120103, -7.248299], [1409, -7.520977], [1776, -8.031895], [310, -8.152696], [120087, -8.478386], [120383, -8.504123], [4743, -8.539081], [565, -8.717746], [36040, -8.777016], [941, -8.864139], [3326, -8.872443], [2213, -8.892405], [14172, -8.946467], [120942, -9.057022], [318, -9.05881], [20758, -9.082761], [799, -9.161327], [14541, -9.187001], [3924, -9.188681], [1765, -9.200095], [16604, -9.212345], [346, -9.224874], [3688, -9.238832], [120, -9.307447], [122629, -9.474932], [1275, -9.529292], [669, -9.552202], [120014, -9.576245], [120098, -9.588584], [766, -9.59613], [946, -9.645147], [474, -9.675107], [14419, -9.709546], [7162, -9.715784], [739, -9.771984], [622, -9.778806], [5274, -9.806003], [14620, -9.807157], [527, -9.82034], [107274, -9.824746], [777, -9.827646], [263, -9.859062], [121122, -9.86138], [8545, -9.863412], [3504, -9.901285], [20890, -9.964402], [2839, -9.981675], [34259, -9.985894], [379, -9.990405], [120007, -9.999372], [327, -10.003058], [420, -10.015558], [1333, -10.019746], [453, -10.022265], [1744, -10.027808], [735, -10.039449], [2150, -10.052342], [120016, -10.06104], [467, -10.093528], [948, -10.111778], [502, -10.137932], [16897, -10.177186], [18092, -10.1847], [122208, -10.202947], [523, -10.208493], [120355, -10.223331], [121346, -10.234653], [69555, -10.239428], [1688, -10.275611], [763, -10.278298], [42298, -10.299424], [543, -10.365157], [762, -10.376464], [14153, -10.379411], [14188, -10.392736], [120081, -10.405578], [3368, -10.415275], [2931, -10.422199], [14159, -10.43343], [779, -10.440793], [120001, -10.442102], [14163, -10.454308], [2457, -10.485927], [124256, -10.49684], [35519, -10.502646], [125223, -10.53221], [3756, -10.541754], [576, -10.544994], [120489, -10.561558], [518, -10.57924], [2246, -10.582312], [126714, -10.589466]], "logprob_of_token": -0.051852, "top1_top2_margin": 4.495666, "top6_top7_margin": 0.388189}, {"gen_index": 19, "token": 55, "top": [[55, -0.010434], [56, -5.742158], [54, -6.576767], [49, -6.920684], [53, -7.243528], [51, -7.73319], [57, -8.172394], [52, -8.188691], [50, -9.050154], [48, -9.755982], [76591, -10.548486], [263, -10.648776], [12843, -11.03416], [117101, -11.108913], [576, -11.125775], [44, -11.257201], [68202, -11.435246], [127906, -11.449294], [19827, -11.503929], [35, -11.532299], [63, -11.537224], [294, -11.645364], [10, -11.737601], [32, -11.7651], [104223, -11.77072], [286, -11.822021], [120007, -11.839335], [46, -11.903332], [120016, -11.969352], [622, -11.982327], [95, -12.042735], [66032, -12.09085], [766, -12.112346], [58, -12.15557], [275, -12.204265], [135, -12.242903], [38336, -12.303416], [183, -12.303607], [6559, -12.310104], [61, -12.326262], [580, -12.369591], [39, -12.4554], [90236, -12.463662], [94, -12.465236], [2051, -12.522887], [26209, -12.537881], [42, -12.554835], [120, -12.562223], [14139, -12.602462], [65, -12.608119], [379, -12.658023], [1606, -12.664825], [110, -12.66911], [7510, -12.672344], [34, -12.714452], [5274, -12.718455], [59, -12.721253], [13380, -12.734362], [310, -12.748353], [115, -12.788231], [735, -12.798036], [40, -12.806694], [3990, -12.844112], [31663, -12.847974], [262, -12.857591], [120000, -12.86939], [96, -12.872947], [1112, -12.882868], [467, -12.893123], [279, -12.904304], [99, -12.930645], [123, -12.940262], [97, -12.957838], [318, -12.958669], [79, -12.968265], [4573, -12.975174], [68743, -12.983038], [78, -12.991233], [121, -13.001879], [1073, -13.025407], [589, -13.065693], [69, -13.082994], [127908, -13.088809], [36, -13.099743], [14153, -13.112022], [75, -13.146839], [4688, -13.150433], [101, -13.188072], [33, -13.200923], [60, -13.20094], [14825, -13.214023], [77, -13.215003], [276, -13.215674], [76, -13.217942], [4396, -13.219534], [5005, -13.225252], [297, -13.228888], [568, -13.235353], [1829, -13.239298], [7684, -13.252736]], "logprob_of_token": -0.010434, "top1_top2_margin": 5.731725, "top6_top7_margin": 0.439204}, {"gen_index": 20, "token": 576, "top": [[576, -0.003114], [61, -7.939677], [32, -8.212572], [735, -8.720762], [1829, -9.306396], [44, -9.63653], [58, -9.802591], [14188, -10.158043], [46, -10.194554], [120022, -10.59617], [286, -10.718393], [49, -11.003687], [318, -11.00821], [120007, -11.027847], [263, -11.03095], [14153, -11.11658], [622, -11.167803], [439, -11.277702], [476, -11.293882], [14169, -11.331873], [1073, -11.356035], [1270, -11.394651], [297, -11.424717], [919, -11.445899], [936, -11.462549], [528, -11.46959], [120006, -11.525209], [120091, -11.569466], [3167, -11.60922], [262, -11.610135], [127797, -11.670532], [1656, -11.698969], [766, -11.699713], [14417, -11.705223], [95, -11.761201], [59, -11.770879], [2459, -11.773805], [14713, -11.788223], [15397, -11.892762], [279, -11.91642], [120717, -11.998976], [120008, -12.032471], [378, -12.038393], [474, -12.055227], [10, -12.073717], [63, -12.084755], [275, -12.112566], [327, -12.135159], [568, -12.159831], [18092, -12.274041], [1064, -12.27601], [420, -12.326214], [20758, -12.327356], [8055, -12.333285], [5809, -12.336178], [1339, -12.351071], [379, -12.381254], [127906, -12.382036], [824, -12.410067], [120001, -12.414986], [2839, -12.44535], [5274, -12.44961], [15703, -12.451633], [4743, -12.463124], [120016, -12.491034], [393, -12.521978], [50, -12.560766], [14139, -12.575481], [1410, -12.592112], [14179, -12.592916], [120, -12.603876], [120103, -12.610092], [1275, -12.61398], [22241, -12.65338], [8150, -12.661038], [48, -12.672286], [38685, -12.706239], [7510, -12.735431], [3660, -12.740543], [310, -12.742], [34, -12.744232], [1409, -12.763598], [941, -12.764957], [745, -12.772028], [120000, -12.772316], [34259, -12.778335], [467, -12.784132], [582, -12.78563], [2362, -12.800594], [679, -12.80678], [2457, -12.846354], [4088, -12.869978], [120018, -12.881021], [1309, -12.895601], [18390, -12.926983], [527, -12.944879], [120098, -12.949606], [3688, -12.958386], [47, -12.965157], [1917, -12.981784]], "logprob_of_token": -0.003114, "top1_top2_margin": 7.936562, "top6_top7_margin": 0.166061}, {"gen_index": 21, "token": 32, "top": [[32, -0.00568], [14153, -7.874918], [49, -8.254919], [1829, -9.073245], [946, -9.292014], [14188, -9.384704], [5274, -9.68507], [120018, -9.685596], [3417, -9.875065], [122407, -9.888794], [4330, -10.017494], [120022, -10.04167], [1333, -10.124763], [2945, -10.152193], [286, -10.199798], [14169, -10.271252], [120008, -10.340534], [262, -10.453874], [32099, -10.509545], [13460, -10.584567], [766, -10.5923], [44, -10.699402], [318, -10.811255], [735, -10.889175], [4075, -10.918587], [120014, -11.012771], [14267, -11.134123], [622, -11.170324], [7510, -11.183022], [936, -11.197121], [420, -11.229694], [941, -11.268762], [14172, -11.2818], [120383, -11.282262], [1410, -11.296799], [3326, -11.306136], [2051, -11.343048], [263, -11.383215], [297, -11.402831], [3678, -11.453135], [22168, -11.554543], [327, -11.577388], [3688, -11.611191], [103844, -11.653675], [2125, -11.661604], [120004, -11.669611], [14139, -11.671368], [71599, -11.709211], [120029, -11.727736], [576, -11.755786], [523, -11.764193], [14179, -11.781436], [527, -11.781742], [120098, -11.842426], [127906, -11.856758], [543, -11.868956], [346, -11.898835], [120001, -11.926348], [565, -12.007838], [3301, -12.022005], [379, -12.029629], [20758, -12.034742], [46, -12.036016], [502, -12.050087], [8545, -12.058855], [2246, -12.079283], [1688, -12.093664], [1073, -12.133069], [122790, -12.134384], [97582, -12.134817], [57, -12.135733], [474, -12.151654], [1578, -12.164954], [2150, -12.171548], [59, -12.178574], [1427, -12.186411], [14541, -12.188712], [56097, -12.189001], [2457, -12.193571], [8355, -12.200274], [393, -12.20237], [4127, -12.240965], [50, -12.243865], [1254, -12.257675], [378, -12.31137], [1765, -12.335685], [120103, -12.336571], [939, -12.347348], [18586, -12.360736], [120610, -12.362514], [669, -12.366587], [8416, -12.374632], [4869, -12.389861], [45, -12.45393], [15397, -12.467519], [14419, -12.469141], [530, -12.472309], [2403, -12.477661], [405, -12.481906], [453, -12.483685]], "logprob_of_token": -0.00568, "top1_top2_margin": 7.869238, "top6_top7_margin": 0.300366}, {"gen_index": 22, "token": 49, "top": [[49, -0.012676], [50, -6.333052], [57, -6.371463], [51, -6.469691], [48, -7.108022], [55, -7.950715], [56, -8.104878], [32, -8.491845], [53, -8.617648], [52, -8.927205], [54, -9.081532], [127906, -9.089744], [127908, -9.842626], [1829, -9.900823], [263, -10.066948], [44, -10.132767], [120007, -10.352206], [10, -10.62913], [766, -10.692367], [14169, -10.728244], [5274, -10.889459], [14188, -10.908927], [14153, -10.927679], [576, -10.943489], [120000, -10.9678], [622, -10.980639], [63, -10.991983], [127907, -10.994706], [13684, -11.016974], [286, -11.033715], [7510, -11.118314], [294, -11.141526], [735, -11.225539], [120016, -11.248775], [745, -11.403643], [1073, -11.488396], [946, -11.505549], [318, -11.548789], [39, -11.56385], [46, -11.59738], [275, -11.621514], [120021, -11.634932], [377, -11.662302], [262, -11.691351], [26767, -11.756309], [120022, -11.883809], [58, -11.922648], [14825, -11.929892], [1336, -11.949755], [11685, -11.954066], [59, -12.019912], [3688, -12.074636], [941, -12.112267], [18092, -12.116261], [12009, -12.131984], [543, -12.135509], [3003, -12.157662], [1914, -12.163583], [120014, -12.176163], [582, -12.190891], [565, -12.204324], [3167, -12.206127], [83911, -12.231905], [531, -12.23706], [3311, -12.237448], [1409, -12.245439], [420, -12.251959], [379, -12.260959], [3523, -12.284677], [120, -12.291525], [327, -12.323603], [60, -12.324433], [11861, -12.356184], [6238, -12.372723], [120003, -12.376908], [314, -12.40119], [3326, -12.414468], [3350, -12.415751], [94, -12.415864], [1394, -12.417408], [14179, -12.432493], [647, -12.455026], [14165, -12.460142], [2459, -12.470411], [34, -12.471208], [22467, -12.487553], [1043, -12.500221], [3078, -12.514059], [717, -12.518999], [103784, -12.568123], [14147, -12.570961], [61, -12.573125], [120004, -12.587007], [2125, -12.594369], [405, -12.601974], [919, -12.616152], [467, -12.623209], [45, -12.658846], [36, -12.659763], [123, -12.664159]], "logprob_of_token": -0.012676, "top1_top2_margin": 6.320376, "top6_top7_margin": 0.154163}, {"gen_index": 23, "token": 57, "top": [[57, -0.022705], [56, -4.772058], [49, -5.493873], [53, -5.577604], [55, -6.176287], [51, -6.731209], [54, -8.120455], [52, -8.868246], [44, -8.979523], [48, -9.077155], [50, -9.15497], [766, -10.354946], [32, -10.47934], [46, -10.630586], [735, -10.686285], [10, -10.807644], [263, -10.856407], [318, -11.109199], [576, -11.190934], [120007, -11.26274], [58, -11.384756], [127906, -11.429544], [63, -11.679296], [275, -11.793053], [622, -11.857237], [262, -11.869263], [502, -11.916333], [286, -11.99261], [84797, -12.031448], [946, -12.067328], [34, -12.13961], [379, -12.234945], [3688, -12.237877], [1275, -12.249827], [59, -12.27384], [14395, -12.371971], [24677, -12.448944], [330, -12.449117], [420, -12.485309], [279, -12.515787], [936, -12.55312], [941, -12.624618], [101, -12.628275], [61, -12.649699], [565, -12.67779], [310, -12.686456], [314, -12.733327], [46160, -12.756935], [1765, -12.811548], [3326, -12.816907], [7510, -12.848936], [474, -12.852406], [294, -12.866318], [93, -12.911331], [327, -12.930524], [14153, -12.950613], [3660, -12.970016], [1410, -12.993793], [120000, -13.033432], [5274, -13.06622], [120016, -13.073667], [45, -13.079171], [70, -13.082404], [97, -13.152911], [919, -13.162125], [531, -13.16653], [878, -13.192359], [120021, -13.217883], [14188, -13.225129], [393, -13.233563], [47, -13.255148], [120022, -13.259661], [1829, -13.259874], [115, -13.283488], [3003, -13.290369], [40165, -13.319788], [33, -13.320538], [3078, -13.333871], [1073, -13.353699], [527, -13.355301], [439, -13.359389], [1115, -13.359917], [43, -13.382023], [137, -13.384756], [65, -13.386831], [467, -13.406745], [127908, -13.420862], [377, -13.42936], [120436, -13.437827], [120014, -13.439297], [1784, -13.464435], [100, -13.472766], [543, -13.474541], [40, -13.47877], [2125, -13.504352], [745, -13.512149], [4743, -13.539882], [1656, -13.540147], [120, -13.542278], [656, -13.554293]], "logprob_of_token": -0.022705, "top1_top2_margin": 4.749353, "top6_top7_margin": 1.389246}, {"gen_index": 24, "token": 44, "top": [[44, -0.007648], [263, -6.032911], [10, -7.104734], [120007, -7.559783], [120016, -8.033611], [275, -8.104013], [46, -8.202526], [766, -8.958744], [14188, -8.969307], [121119, -9.21511], [286, -9.281217], [59, -9.2926], [988, -9.301266], [58, -9.440238], [127906, -9.70636], [1829, -9.72678], [124969, -9.735494], [120028, -9.828032], [120468, -9.885421], [735, -10.144749], [14169, -10.184318], [120008, -10.379761], [63, -10.407042], [120021, -10.419876], [745, -10.433075], [11861, -10.433813], [32, -10.485638], [120375, -10.553404], [120, -10.740197], [120022, -10.744402], [314, -10.814638], [420, -10.83926], [3688, -10.902136], [7510, -10.968263], [120000, -10.984574], [120409, -11.046993], [576, -11.162737], [47, -11.21986], [120038, -11.228242], [262, -11.299661], [121083, -11.340878], [120103, -11.358617], [49, -11.383869], [622, -11.488607], [120003, -11.513226], [936, -11.587883], [14153, -11.596679], [531, -11.59839], [126545, -11.631656], [1765, -11.63769], [36040, -11.66176], [318, -11.734613], [3003, -11.77201], [69555, -11.784311], [45, -11.793864], [20758, -11.80444], [405, -11.939228], [2410, -11.997486], [126203, -12.006172], [2931, -12.017543], [310, -12.025114], [327, -12.045552], [122158, -12.048863], [467, -12.091794], [3290, -12.104339], [1073, -12.105461], [47526, -12.160843], [34, -12.165263], [4343, -12.165625], [120107, -12.216767], [377, -12.222298], [1275, -12.228514], [2313, -12.235641], [120410, -12.242375], [1394, -12.330093], [474, -12.36418], [5274, -12.463783], [82347, -12.489909], [14161, -12.53303], [568, -12.535986], [56294, -12.542534], [120436, -12.556645], [43, -12.560609], [279, -12.614394], [120014, -12.622648], [14147, -12.649133], [1409, -12.67976], [120081, -12.696939], [2342, -12.710281], [48, -12.717313], [1062, -12.738519], [294, -12.744236], [120023, -12.774689], [379, -12.778641], [3078, -12.783607], [125, -12.791871], [115, -12.794025], [669, -12.821321], [2362, -12.841681], [14139, -12.846125]], "logprob_of_token": -0.007648, "top1_top2_margin": 6.025263, "top6_top7_margin": 0.098513}, {"gen_index": 25, "token": 14169, "top": [[14169, -0.015824], [7510, -5.490372], [936, -6.871875], [286, -7.436156], [120103, -7.555599], [262, -7.596864], [120022, -7.6545], [32, -8.074599], [120087, -8.937801], [120016, -9.111136], [393, -9.173955], [36040, -9.237208], [120014, -9.2394], [120, -9.258358], [1409, -9.382451], [263, -9.514711], [3326, -9.533824], [127906, -9.541436], [941, -9.626434], [1776, -9.721416], [565, -9.759639], [669, -9.78849], [120007, -9.801973], [16604, -9.816497], [318, -10.075517], [69555, -10.092647], [1765, -10.191241], [5274, -10.225113], [120383, -10.239711], [735, -10.244374], [527, -10.286851], [310, -10.309909], [766, -10.39914], [20758, -10.41869], [18092, -10.446884], [14172, -10.448483], [16897, -10.45996], [14541, -10.482984], [4743, -10.486184], [3688, -10.521469], [120942, -10.530289], [622, -10.5506], [2213, -10.640896], [3924, -10.648655], [474, -10.654681], [14419, -10.751348], [346, -10.762518], [543, -10.768725], [453, -10.772074], [14188, -10.77409], [502, -10.813275], [120008, -10.813575], [120355, -10.850493], [107274, -10.880207], [1688, -10.888072], [121122, -10.888186], [739, -10.89078], [56, -10.915694], [120021, -10.945956], [8545, -10.957178], [34259, -10.966338], [1744, -10.967975], [327, -10.993184], [120001, -11.018586], [799, -11.04339], [467, -11.084826], [20890, -11.104781], [2931, -11.104861], [120081, -11.129391], [120004, -11.131499], [120098, -11.140326], [1275, -11.140932], [1333, -11.160885], [14158, -11.171482], [2150, -11.193512], [275, -11.208499], [120375, -11.21371], [946, -11.247307], [49, -11.258629], [122629, -11.264554], [1689, -11.317767], [523, -11.340688], [42298, -11.356736], [1785, -11.401177], [2457, -11.416076], [10, -11.431069], [120724, -11.459156], [1336, -11.467751], [3504, -11.47077], [14791, -11.485576], [35519, -11.50567], [14154, -11.509126], [576, -11.518517], [11861, -11.526871], [3078, -11.527714], [420, -11.52818], [1829, -11.53742], [1578, -11.54378], [1083, -11.548826], [18085, -11.556099]], "logprob_of_token": -0.015824, "top1_top2_margin": 5.474548, "top6_top7_margin": 0.057636}, {"gen_index": 26, "token": 56, "top": [[56, -0.001105], [57, -8.531166], [55, -8.652449], [53, -9.168521], [49, -9.298694], [51, -9.674884], [54, -9.879696], [50, -10.178618], [52, -10.252837], [263, -10.696631], [48, -10.76291], [10, -11.212996], [127906, -11.489306], [37720, -12.258239], [32, -12.542289], [14031, -12.606632], [115, -13.115453], [136, -13.226856], [120016, -13.296002], [73987, -13.357125], [120724, -13.544707], [127908, -13.548368], [10133, -13.557099], [576, -13.608098], [38555, -13.658334], [29350, -13.796453], [6238, -13.901033], [95, -13.903351], [120007, -13.924232], [1243, -13.946732], [40143, -13.990519], [63, -14.041874], [294, -14.077798], [7510, -14.105446], [120, -14.120578], [120038, -14.142478], [735, -14.197362], [34006, -14.225995], [27835, -14.253901], [72432, -14.408657], [101, -14.410447], [120021, -14.469454], [647, -14.491376], [44, -14.509092], [184, -14.52194], [110, -14.53506], [120014, -14.550318], [103, -14.558057], [3078, -14.601015], [2051, -14.601632], [125693, -14.664449], [122, -14.667579], [34, -14.67043], [46, -14.677598], [622, -14.70766], [72, -14.709517], [120000, -14.771556], [1606, -14.779063], [93710, -14.821453], [90879, -14.83726], [766, -14.851224], [77, -14.885144], [60, -14.894834], [1829, -14.903638], [65, -14.941231], [325, -14.951169], [286, -14.953794], [3688, -14.981523], [107, -14.993188], [5274, -15.03015], [936, -15.033553], [78, -15.049747], [580, -15.053141], [275, -15.053373], [4622, -15.059462], [262, -15.083135], [97, -15.093637], [589, -15.096791], [727, -15.099549], [120844, -15.101796], [96, -15.12641], [36, -15.133301], [946, -15.133588], [1043, -15.154232], [86374, -15.156211], [531, -15.172965], [113, -15.179875], [110441, -15.193781], [467, -15.206205], [582, -15.210835], [117, -15.2115], [104, -15.245049], [168, -15.24756], [4688, -15.254879], [7264, -15.26253], [61, -15.264073], [45, -15.296779], [94, -15.29753], [120002, -15.30323], [266, -15.305103]], "logprob_of_token": -0.001105, "top1_top2_margin": 8.530061, "top6_top7_margin": 0.204812}, {"gen_index": 27, "token": 576, "top": [[576, -0.002706], [263, -7.960163], [61, -8.518574], [10, -8.986053], [127906, -9.632462], [1829, -9.846473], [735, -9.864235], [120091, -9.868246], [32, -9.953769], [120103, -10.569967], [120016, -10.619359], [14188, -10.623259], [120022, -10.684517], [58, -10.712614], [120007, -11.064253], [14169, -11.087069], [44, -11.216478], [46, -11.366684], [3167, -11.375904], [49, -11.381742], [262, -11.409431], [297, -11.471371], [286, -11.482001], [14417, -11.625252], [120087, -11.715174], [275, -11.758137], [95, -11.836085], [63, -11.881414], [622, -11.950267], [1073, -12.025301], [34, -12.096516], [69555, -12.099577], [120724, -12.119729], [50, -12.14533], [48, -12.149405], [18092, -12.164354], [766, -12.167012], [120038, -12.178028], [127908, -12.184888], [528, -12.240895], [120021, -12.244031], [120001, -12.244222], [14153, -12.254406], [2457, -12.262525], [1270, -12.263317], [127797, -12.345699], [120006, -12.357876], [318, -12.373113], [1339, -12.412327], [5274, -12.43168], [120717, -12.434875], [439, -12.51969], [378, -12.527826], [19464, -12.557286], [11861, -12.562422], [14825, -12.566132], [120018, -12.587915], [941, -12.595746], [15397, -12.595808], [120014, -12.600962], [14713, -12.602647], [45, -12.64049], [120, -12.649381], [47, -12.658701], [20758, -12.659479], [2459, -12.660622], [6238, -12.694979], [669, -12.708477], [476, -12.720237], [120000, -12.761645], [8055, -12.786413], [34259, -12.787228], [327, -12.790514], [5809, -12.796501], [1656, -12.8351], [919, -12.83581], [314, -12.843717], [582, -12.858358], [936, -12.859561], [15703, -12.871337], [420, -12.893337], [22241, -12.930844], [527, -12.932657], [120835, -12.945266], [2125, -12.94981], [3660, -12.958406], [589, -12.961239], [474, -12.969873], [120173, -12.990195], [14139, -13.000275], [125, -13.016973], [381, -13.040966], [19166, -13.044457], [279, -13.074431], [13627, -13.09082], [18390, -13.102556], [120008, -13.110182], [36, -13.118053], [1275, -13.125622], [120098, -13.158578]], "logprob_of_token": -0.002706, "top1_top2_margin": 7.957456, "top6_top7_margin": 0.017762}, {"gen_index": 28, "token": 32, "top": [[32, -0.004505], [50, -9.118624], [263, -9.236519], [120022, -9.385974], [5274, -9.462116], [1829, -9.781265], [120014, -9.868161], [14153, -9.890202], [120103, -9.938662], [127906, -10.089113], [946, -10.209212], [941, -10.290291], [14188, -10.423774], [120018, -10.460911], [262, -10.474968], [286, -10.539347], [318, -10.591341], [3417, -10.758594], [1333, -10.77969], [766, -10.815245], [120004, -10.854465], [19969, -10.869248], [622, -10.914326], [7510, -10.950835], [10, -10.97381], [14139, -11.017414], [120087, -11.020187], [297, -11.107831], [20758, -11.262701], [936, -11.319393], [3326, -11.389054], [439, -11.528522], [44, -11.534733], [120610, -11.535048], [474, -11.537159], [923, -11.578432], [565, -11.579702], [14141, -11.607852], [120008, -11.666937], [63, -11.68863], [2945, -11.705965], [49, -11.722422], [2403, -11.774633], [46, -11.810074], [502, -11.826768], [103844, -11.843267], [120098, -11.855729], [2125, -11.873499], [4075, -11.885794], [14169, -11.888539], [32099, -11.90414], [294, -11.913549], [69555, -11.931877], [669, -11.943913], [2213, -11.995666], [97582, -12.002648], [1688, -12.032243], [1409, -12.056337], [120007, -12.065707], [527, -12.093903], [3166, -12.115719], [1311, -12.155958], [543, -12.173603], [3688, -12.192005], [327, -12.197683], [120016, -12.209982], [3252, -12.294577], [346, -12.299827], [120420, -12.324732], [275, -12.352161], [1254, -12.352571], [1578, -12.366033], [735, -12.385424], [120001, -12.409768], [2150, -12.413974], [393, -12.42795], [1073, -12.465647], [3678, -12.469819], [9, -12.47595], [122407, -12.484904], [14179, -12.485516], [922, -12.498652], [45, -12.516979], [58725, -12.532278], [2457, -12.54908], [75112, -12.552173], [1410, -12.581506], [5169, -12.61288], [19464, -12.632254], [58, -12.646471], [1042, -12.650194], [453, -12.657177], [13460, -12.672822], [18586, -12.673363], [1336, -12.683689], [1275, -12.699398], [14541, -12.714803], [34, -12.719608], [3167, -12.725938], [835, -12.733447]], "logprob_of_token": -0.004505, "top1_top2_margin": 9.114118, "top6_top7_margin": 0.086896}, {"gen_index": 29, "token": 50, "top": [[50, -0.053962], [49, -3.270574], [51, -6.075505], [32, -7.048511], [57, -7.463025], [14267, -7.870887], [14330, -8.238916], [55, -8.407892], [56, -8.41855], [53, -8.516536], [21746, -8.95164], [48, -8.960686], [263, -9.063192], [127906, -9.097478], [52, -9.203403], [766, -9.551704], [16422, -9.628661], [946, -9.678727], [1829, -9.680186], [2051, -9.768226], [120007, -9.801129], [54, -9.815436], [44, -9.816119], [7368, -9.821095], [12027, -9.887339], [10, -10.061456], [4823, -10.139864], [5274, -10.167918], [14153, -10.200663], [286, -10.212014], [120022, -10.247566], [262, -10.312748], [1972, -10.425014], [622, -10.471807], [63, -10.503623], [14188, -10.518218], [576, -10.555584], [19969, -10.586977], [474, -10.616488], [127907, -10.63236], [81389, -10.788027], [941, -10.790977], [1073, -10.833602], [294, -10.874171], [119464, -10.9047], [37943, -10.919869], [58, -10.940881], [48976, -10.95258], [14676, -10.968185], [3326, -10.97704], [59, -11.064357], [7510, -11.07056], [46, -11.081962], [936, -11.110611], [3544, -11.120746], [318, -11.123153], [379, -11.134719], [275, -11.142602], [1427, -11.15512], [120016, -11.182194], [327, -11.183372], [735, -11.254705], [1083, -11.310954], [12009, -11.348291], [120000, -11.369542], [93, -11.405679], [120103, -11.453389], [297, -11.493331], [34387, -11.498369], [14179, -11.536468], [1753, -11.568908], [3688, -11.570299], [565, -11.576304], [47, -11.581724], [39863, -11.584173], [127908, -11.58619], [72450, -11.603324], [3301, -11.606181], [582, -11.606367], [1765, -11.61456], [377, -11.621284], [6391, -11.647646], [14825, -11.651061], [34, -11.677256], [61, -11.690648], [120014, -11.695685], [527, -11.70509], [5169, -11.711034], [543, -11.739209], [493, -11.743222], [20486, -11.744425], [2125, -11.749254], [7360, -11.752011], [1311, -11.754672], [120061, -11.760051], [39, -11.822207], [7243, -11.841196], [3078, -11.856517], [669, -11.859004], [5275, -11.885716]], "logprob_of_token": -0.053962, "top1_top2_margin": 3.216612, "top6_top7_margin": 0.368029}, {"gen_index": 30, "token": 49, "top": [[49, -0.005677], [48, -6.056363], [51, -6.505764], [53, -8.146623], [50, -8.380777], [55, -8.755465], [263, -9.250937], [57, -9.629709], [52, -9.888516], [32, -10.069122], [44, -10.290421], [10, -10.348498], [127906, -10.601967], [120007, -10.647953], [54, -11.334322], [56, -11.48877], [46, -11.51945], [766, -11.631905], [120016, -11.701761], [63, -12.188993], [120022, -12.309443], [286, -12.313159], [58, -12.414072], [294, -12.446851], [318, -12.457818], [735, -12.46604], [275, -12.51207], [120021, -12.634344], [2125, -12.71249], [5274, -12.723989], [622, -12.750559], [120103, -12.873951], [941, -12.935979], [13684, -13.035994], [34, -13.046414], [88, -13.071856], [576, -13.203479], [61, -13.218512], [262, -13.22188], [120000, -13.241159], [353, -13.248598], [73, -13.332494], [11685, -13.366245], [120014, -13.367623], [59, -13.38224], [93, -13.416127], [327, -13.487514], [95, -13.488127], [120, -13.572681], [1073, -13.628311], [946, -13.633087], [105, -13.657639], [379, -13.68696], [107, -13.690407], [120038, -13.690897], [45, -13.691799], [43, -13.714781], [314, -13.71561], [439, -13.718969], [589, -13.745265], [40, -13.781923], [42, -13.783807], [39, -13.785118], [47, -13.852734], [115, -13.860372], [62, -13.871131], [310, -13.874444], [127908, -13.878903], [1062, -13.879103], [2342, -13.892406], [14141, -13.915973], [20486, -13.918303], [279, -13.93521], [120087, -13.959615], [97, -13.959641], [94, -13.997686], [36, -14.015066], [325, -14.025805], [297, -14.032877], [1829, -14.037131], [76, -14.04318], [120028, -14.045894], [2839, -14.056013], [123, -14.070573], [502, -14.075799], [3252, -14.080959], [14153, -14.085895], [266, -14.104448], [108, -14.117309], [125, -14.132843], [3326, -14.144985], [527, -14.157415], [377, -14.170059], [66, -14.196417], [14417, -14.208426], [4075, -14.209989], [467, -14.212951], [120410, -14.215199], [14188, -14.231628], [14139, -14.23545]], "logprob_of_token": -0.005677, "top1_top2_margin": 6.050686, "top6_top7_margin": 0.495472}, {"gen_index": 31, "token": 44, "top": [[44, -0.007281], [263, -5.868682], [10, -7.519058], [120016, -7.880107], [120007, -7.904433], [46, -8.051329], [275, -8.179124], [127906, -9.083883], [121119, -9.151305], [766, -9.268106], [124969, -9.329947], [286, -9.43434], [14188, -9.568325], [120028, -9.585633], [988, -9.723507], [58, -9.81655], [1829, -9.969787], [59, -10.189424], [11861, -10.265677], [120021, -10.297648], [735, -10.372816], [63, -10.395211], [314, -10.441733], [14169, -10.465978], [120468, -10.551015], [120008, -10.624606], [120022, -10.86855], [121083, -10.875363], [3688, -10.897791], [120000, -10.907241], [32, -10.926761], [7510, -10.968474], [745, -11.003383], [120003, -11.045812], [120103, -11.0957], [120038, -11.187399], [576, -11.196293], [36040, -11.412329], [120409, -11.461656], [47, -11.496081], [69555, -11.505514], [126545, -11.532633], [120375, -11.537716], [49, -11.632399], [936, -11.769757], [30035, -11.786819], [262, -11.829713], [420, -11.886479], [622, -11.890766], [122158, -11.994597], [20758, -12.018636], [318, -12.044368], [120, -12.063355], [126203, -12.070346], [310, -12.104878], [45, -12.129593], [3003, -12.133217], [47526, -12.174419], [377, -12.223377], [120002, -12.227564], [405, -12.231242], [120724, -12.265111], [1073, -12.281257], [1409, -12.285261], [327, -12.285773], [2410, -12.292197], [14153, -12.321989], [3290, -12.336371], [2313, -12.372366], [120410, -12.378213], [531, -12.40875], [120436, -12.472416], [4343, -12.502154], [8894, -12.504484], [120014, -12.516421], [120107, -12.528963], [14161, -12.564567], [3078, -12.57091], [467, -12.575057], [56294, -12.612088], [1765, -12.643193], [34, -12.680637], [476, -12.694651], [1394, -12.744017], [120302, -12.750894], [5274, -12.756975], [474, -12.776565], [1275, -12.782883], [127908, -12.826091], [1062, -12.848445], [6659, -12.881267], [14147, -12.916763], [565, -12.948405], [669, -12.963793], [1043, -12.969984], [2931, -12.985316], [14179, -12.987801], [379, -12.994521], [120359, -13.000039], [120087, -13.022857]], "logprob_of_token": -0.007281, "top1_top2_margin": 5.861401, "top6_top7_margin": 0.127795}]}, {"prompt": "Translation to German: the weather is beautiful today", "input_ids": [33607, 318, 4867, 58, 262, 5995, 735, 5445, 4484], "generated_ids": [46, 543, 5995, 735, 33341, 286, 262, 21499, 735, 5657, 46, 543, 5995, 735, 5445, 286, 262, 21499, 735, 5657, 46, 543, 5995, 735, 5445, 286, 262, 21499, 735, 5657, 46, 543], "rows": [{"gen_index": 0, "token": 46, "top": [[46, -0.891099], [275, -1.11564], [314, -2.914019], [33, -3.072019], [4484, -3.655938], [44, -4.045199], [2519, -4.078416], [262, -4.222149], [735, -5.309325], [4679, -5.455543], [59, -5.526917], [1829, -5.673591], [14188, -5.882936], [286, -6.176564], [58, -6.338013], [766, -6.478528], [263, -6.507309], [4137, -6.516523], [22648, -6.691981], [622, -6.775719], [36209, -6.866401], [1765, -6.888452], [10, -6.940696], [936, -6.981519], [14153, -7.045083], [405, -7.15169], [63, -7.153459], [12611, -7.288183], [5995, -7.318031], [763, -7.322148], [3737, -7.352829], [310, -7.36848], [5445, -7.491157], [15299, -7.528751], [120399, -7.574273], [120230, -7.576257], [14792, -7.591455], [779, -7.768426], [14052, -7.77138], [127906, -7.786103], [589, -7.851312], [44455, -7.911569], [669, -7.944863], [2213, -7.957191], [127655, -8.004772], [3326, -8.080948], [93457, -8.081835], [1275, -8.081952], [30538, -8.088139], [1043, -8.177995], [19043, -8.19062], [4101, -8.223311], [34, -8.238407], [3863, -8.263084], [1409, -8.420461], [3368, -8.482286], [13594, -8.487679], [8545, -8.517769], [120078, -8.560623], [120007, -8.619616], [543, -8.640268], [1790, -8.708013], [1112, -8.74511], [19078, -8.789408], [4869, -8.796114], [1921, -8.818951], [5071, -8.881738], [120347, -8.89376], [15096, -8.907216], [379, -8.912284], [2549, -8.917727], [777, -8.926638], [120099, -8.943666], [30989, -8.946688], [120031, -8.957072], [1739, -8.973245], [120241, -9.020879], [1042, -9.026499], [38183, -9.027109], [318, -9.033926], [120016, -9.034223], [1410, -9.046777], [565, -9.057456], [941, -9.057467], [6785, -9.08466], [1806, -9.088586], [17728, -9.121368], [18390, -9.128616], [900, -9.141712], [617, -9.164897], [325, -9.166422], [3660, -9.168536], [527, -9.169262], [32, -9.179933], [919, -9.186316], [946, -9.18868], [120108, -9.249413], [7510, -9.25129], [2544, -9.273991], [9093, -9.276181]], "logprob_of_token": -0.891099, "top1_top2_margin": 0.224541, "top6_top7_margin": 0.033217}, {"gen_index": 1, "token": 543, "top": [[543, -0.145512], [9093, -3.441448], [127906, -4.131752], [120014, -4.673546], [3780, -5.22365], [1336, -5.33517], [14161, -5.468826], [669, -5.533264], [1689, -5.567423], [14896, -5.646327], [1231, -5.693195], [14147, -5.819664], [120004, -5.881647], [4759, -6.000916], [262, -6.006805], [766, -6.087722], [1692, -6.463651], [4484, -6.506088], [8266, -6.849595], [1194, -6.862328], [127655, -6.912471], [24775, -7.024765], [7339, -7.081998], [1914, -7.087433], [1905, -7.218623], [611, -7.284514], [5775, -7.296972], [32, -7.394978], [23070, -7.474978], [2883, -7.66144], [6372, -7.718422], [6693, -7.742801], [717, -7.795691], [742, -7.796094], [1580, -7.843716], [12359, -7.880433], [2560, -7.917503], [20605, -7.977015], [14777, -8.155253], [5439, -8.193995], [2743, -8.234017], [29182, -8.292855], [5995, -8.294636], [3501, -8.43629], [735, -8.453921], [840, -8.457162], [9643, -8.480653], [1921, -8.496808], [8307, -8.531113], [8067, -8.536771], [7510, -8.568572], [4246, -8.615968], [21977, -8.62617], [14188, -8.64844], [1829, -8.663537], [1988, -8.805704], [4888, -8.824004], [6143, -8.865207], [10, -8.872268], [9830, -8.89512], [6814, -8.928959], [6859, -8.930213], [1254, -8.943537], [7098, -8.994928], [4703, -9.062832], [263, -9.070655], [15934, -9.072844], [13389, -9.081691], [19710, -9.134896], [6983, -9.153833], [4001, -9.179502], [946, -9.228742], [17285, -9.262969], [27775, -9.283801], [95245, -9.286881], [5274, -9.292295], [1962, -9.293163], [35088, -9.317153], [19313, -9.326938], [1047, -9.36629], [11185, -9.378953], [25250, -9.402661], [2865, -9.405732], [2291, -9.419892], [5438, -9.452628], [5445, -9.454215], [15980, -9.469839], [124489, -9.471993], [523, -9.495463], [3872, -9.509391], [127908, -9.511058], [39124, -9.517646], [7940, -9.526389], [44116, -9.527544], [7643, -9.575971], [14053, -9.614402], [14153, -9.629126], [6455, -9.655849], [53535, -9.69966], [1049, -9.715377]], "logprob_of_token": -0.145512, "top1_top2_margin": 3.295936, "top6_top7_margin": 0.133656}, {"gen_index": 2, "token": 5995, "top": [[5995, -0.039308], [14795, -4.285779], [21499, -4.838317], [8175, -6.564228], [5445, -7.145256], [543, -7.170849], [36836, -7.660544], [33341, -8.10768], [262, -8.283764], [24775, -8.529801], [4101, -8.553038], [1460, -8.618007], [14950, -8.682616], [1843, -8.718007], [3388, -8.890862], [17392, -8.986297], [5848, -9.070739], [5954, -9.13041], [14852, -9.204049], [30279, -9.242891], [11268, -9.359484], [14803, -9.438323], [2935, -9.544259], [18762, -9.55589], [9172, -9.608665], [6547, -9.618943], [47805, -9.624462], [4273, -9.655778], [8263, -9.66653], [7882, -9.712987], [34210, -9.740663], [25343, -9.872571], [1427, -9.928201], [5344, -9.993995], [14341, -9.994576], [5865, -10.030113], [7940, -10.075318], [28326, -10.09731], [15893, -10.106631], [18686, -10.190156], [4739, -10.194963], [6785, -10.196231], [11309, -10.205557], [32, -10.207414], [4595, -10.218458], [43211, -10.221492], [6700, -10.224919], [6339, -10.255992], [11053, -10.280996], [6074, -10.286704], [1788, -10.299537], [2059, -10.308496], [9089, -10.310739], [3515, -10.322419], [263, -10.323877], [10822, -10.327506], [5403, -10.334435], [61599, -10.335914], [735, -10.336432], [2550, -10.379592], [14321, -10.380043], [8275, -10.383511], [3519, -10.410687], [1324, -10.414292], [2302, -10.421796], [24244, -10.443414], [1584, -10.444279], [19898, -10.456586], [1652, -10.461365], [46, -10.470085], [766, -10.516699], [12913, -10.523244], [30084, -10.546771], [48683, -10.548379], [7852, -10.556016], [5657, -10.58616], [58, -10.590711], [3713, -10.612948], [5381, -10.614696], [14264, -10.619843], [946, -10.651798], [8358, -10.661538], [3917, -10.679132], [5061, -10.681634], [2838, -10.690798], [6344, -10.691329], [936, -10.693816], [4774, -10.708238], [4850, -10.710021], [353, -10.710109], [5032, -10.715653], [44, -10.716115], [6563, -10.731839], [4931, -10.756106], [7424, -10.757348], [19682, -10.770176], [2821, -10.775157], [14394, -10.777686], [29314, -10.785157], [6678, -10.788177]], "logprob_of_token": -0.039308, "top1_top2_margin": 4.246472, "top6_top7_margin": 0.489695}, {"gen_index": 3, "token": 735, "top": [[735, -0.00849], [4484, -5.359167], [14950, -7.382668], [622, -8.418117], [919, -8.502404], [18717, -8.642559], [5995, -8.801644], [439, -8.946842], [286, -9.129786], [378, -9.556973], [824, -9.838902], [589, -10.399006], [476, -10.438882], [5445, -10.455938], [22648, -10.46013], [766, -10.533749], [1503, -10.569736], [7222, -10.572897], [52075, -10.75016], [24348, -10.769269], [2459, -10.773989], [8175, -10.806322], [3368, -10.821025], [1309, -10.875891], [1656, -10.960897], [58, -10.965348], [1270, -11.009651], [3583, -11.033023], [44, -11.034181], [4225, -11.125182], [14795, -11.144992], [3881, -11.192483], [4703, -11.204041], [36836, -11.231606], [527, -11.241581], [9093, -11.321582], [33341, -11.330993], [4088, -11.382376], [1064, -11.401951], [8150, -11.411424], [528, -11.4175], [14060, -11.433296], [3992, -11.438871], [127655, -11.469978], [11577, -11.485546], [379, -11.521835], [15299, -11.562881], [279, -11.573214], [8157, -11.607226], [13032, -11.609744], [11317, -11.620223], [7499, -11.626669], [17714, -11.632713], [7732, -11.644861], [565, -11.649788], [9727, -11.675036], [568, -11.685213], [330, -11.694913], [14896, -11.704085], [11910, -11.707414], [23754, -11.733088], [46, -11.753225], [617, -11.768013], [60478, -11.824903], [21499, -11.844711], [53535, -11.899949], [38183, -11.905155], [18296, -11.916335], [27673, -11.983966], [49987, -12.007417], [45375, -12.024885], [1112, -12.066378], [1410, -12.067759], [32, -12.06958], [13255, -12.105615], [2286, -12.113121], [763, -12.130224], [12359, -12.140156], [2935, -12.14731], [8263, -12.154756], [4895, -12.248241], [2272, -12.264669], [9668, -12.273486], [5607, -12.313909], [20773, -12.313958], [2548, -12.367874], [3918, -12.36854], [12243, -12.376181], [15853, -12.377223], [24251, -12.398113], [3519, -12.40097], [1275, -12.423113], [104437, -12.428006], [22347, -12.460627], [2457, -12.477826], [6172, -12.488858], [24973, -12.514566], [262, -12.530125], [14353, -12.530229], [3363, -12.548619]], "logprob_of_token": -0.00849, "top1_top2_margin": 5.350677, "top6_top7_margin": 0.159085}, {"gen_index": 4, "token": 33341, "top": [[33341, -0.93653], [31642, -1.705778], [5445, -2.177392], [14394, -3.347187], [30632, -3.360044], [8358, -3.492799], [9162, -3.625623], [4205, -4.328379], [11966, -4.480388], [5190, -4.480456], [2302, -4.541544], [17602, -4.647563], [30631, -4.649642], [6642, -4.881272], [3713, -5.169396], [2272, -5.244067], [7176, -5.304407], [31946, -5.392758], [36836, -5.654938], [3918, -5.687973], [735, -5.786295], [35672, -5.953655], [502, -6.089996], [30775, -6.311362], [15411, -6.34767], [1410, -6.375691], [14780, -6.416119], [8003, -6.5797], [941, -6.612004], [72033, -6.615187], [7833, -6.667849], [8907, -6.692661], [15675, -6.716276], [13168, -6.785131], [5717, -6.968861], [6094, -7.031076], [1409, -7.035021], [9344, -7.045372], [14705, -7.051421], [3992, -7.058388], [4758, -7.148819], [7143, -7.161108], [17653, -7.165657], [41286, -7.253056], [5336, -7.318458], [4484, -7.353874], [6572, -7.372986], [5657, -7.38985], [20276, -7.420472], [18475, -7.432734], [851, -7.434324], [14052, -7.47822], [3368, -7.498752], [16191, -7.531987], [51988, -7.547265], [15114, -7.584765], [2944, -7.623877], [7107, -7.631806], [11964, -7.632914], [60928, -7.646999], [8851, -7.740263], [2377, -7.767529], [6044, -7.814176], [5678, -7.846639], [3550, -7.895735], [19679, -7.904902], [5596, -7.923943], [27169, -7.937298], [52045, -7.947951], [14876, -8.023646], [12566, -8.033124], [1972, -8.043029], [14795, -8.126616], [38183, -8.133406], [55978, -8.136623], [23988, -8.193942], [3437, -8.228662], [16924, -8.261321], [47576, -8.270535], [2878, -8.287385], [1093, -8.29302], [13078, -8.325667], [5061, -8.340858], [46400, -8.348357], [66242, -8.362111], [6030, -8.422079], [28039, -8.431968], [5995, -8.451233], [4540, -8.46533], [900, -8.471815], [10301, -8.484034], [14553, -8.499932], [53167, -8.534341], [30076, -8.539144], [19898, -8.542312], [74238, -8.544668], [15673, -8.57518], [13850, -8.607496], [1474, -8.630949], [6870, -8.643482]], "logprob_of_token": -0.93653, "top1_top2_margin": 0.769249, "top6_top7_margin": 0.132824}, {"gen_index": 5, "token": 286, "top": [[286, -0.629348], [4484, -1.053403], [46, -2.532125], [44, -4.684503], [310, -4.870762], [3368, -4.893592], [622, -6.456853], [22648, -6.874489], [275, -6.962801], [15853, -7.494205], [59, -7.550739], [936, -7.585606], [4101, -7.640152], [3583, -7.832888], [262, -7.956479], [763, -8.297314], [2213, -8.314793], [314, -8.446085], [15299, -8.50788], [3247, -8.555427], [1744, -8.731039], [4703, -8.750826], [36209, -8.912948], [5995, -8.956291], [33, -9.004742], [53535, -9.073616], [3992, -9.217636], [45375, -9.228757], [9093, -9.282146], [766, -9.368314], [120230, -9.374708], [1806, -9.399961], [33341, -9.442025], [1790, -9.469633], [5071, -9.517787], [4137, -9.532722], [543, -9.621378], [2548, -9.646482], [7510, -9.655183], [779, -9.670897], [4774, -9.70088], [3660, -9.823795], [1323, -9.890144], [1275, -9.897081], [318, -9.911959], [63, -9.936239], [6785, -9.940802], [467, -10.026123], [1829, -10.069937], [3519, -10.10659], [2403, -10.110605], [3688, -10.13446], [379, -10.136206], [2549, -10.17448], [420, -10.180208], [11966, -10.219788], [14188, -10.238058], [44455, -10.251818], [7060, -10.2845], [777, -10.347961], [1112, -10.35715], [21499, -10.371919], [1409, -10.389692], [5837, -10.391126], [2457, -10.433087], [2362, -10.435982], [12359, -10.468735], [3093, -10.487066], [58, -10.489781], [14052, -10.496696], [19078, -10.512755], [1765, -10.531448], [51577, -10.533064], [3863, -10.533959], [3755, -10.552635], [47, -10.573108], [4743, -10.635893], [735, -10.640244], [4508, -10.707313], [938, -10.780435], [799, -10.782387], [7331, -10.79521], [527, -10.800045], [3918, -10.816968], [3737, -10.830825], [1410, -10.844103], [120241, -10.845602], [1988, -10.851629], [474, -10.889205], [15849, -10.906346], [6803, -10.942747], [3827, -10.975069], [5445, -10.980077], [124489, -10.994538], [15984, -11.020796], [16330, -11.03524], [565, -11.037596], [405, -11.062851], [47805, -11.075747], [1739, -11.108139]], "logprob_of_token": -0.629348, "top1_top2_margin": 0.424055, "top6_top7_margin": 1.563261}, {"gen_index": 6, "token": 262, "top": [[262, -1.00002], [11966, -1.481254], [5445, -1.574401], [33341, -2.553836], [5190, -3.313147], [7176, -3.529919], [30631, -3.971715], [5657, -5.500236], [31642, -5.519835], [46400, -5.572252], [14394, -6.670561], [8358, -6.914248], [74238, -7.156984], [19898, -7.191484], [15114, -7.265474], [1744, -7.4073], [7107, -7.474488], [18475, -7.64525], [543, -7.862021], [52045, -7.86806], [30632, -7.881434], [3326, -7.960202], [19679, -8.012955], [15675, -8.032214], [8907, -8.035504], [40212, -8.134397], [17653, -8.145998], [35672, -8.167578], [30775, -8.171633], [7143, -8.302217], [4205, -8.317406], [20276, -8.400624], [27169, -8.504839], [8263, -8.506157], [9162, -8.567411], [2550, -8.761358], [2213, -8.7707], [36836, -8.838475], [4836, -8.848333], [6870, -8.873463], [4540, -8.880892], [41286, -8.885118], [51988, -8.889599], [4484, -8.916452], [53139, -8.975365], [10321, -8.990642], [14705, -9.044486], [116858, -9.071432], [13078, -9.114018], [10780, -9.161978], [38183, -9.188097], [53186, -9.219852], [51717, -9.231885], [11964, -9.239423], [48683, -9.263364], [16235, -9.268935], [900, -9.36119], [44211, -9.425099], [453, -9.504735], [5678, -9.53465], [14876, -9.552808], [2302, -9.573512], [15673, -9.575409], [77841, -9.603999], [79608, -9.605195], [5061, -9.630788], [735, -9.659816], [3737, -9.692447], [325, -9.720999], [4227, -9.739636], [34767, -9.745049], [5062, -9.768038], [29307, -9.791538], [4758, -9.796926], [30971, -9.802766], [14251, -9.809848], [28540, -9.822368], [286, -9.830617], [941, -9.853435], [6044, -9.879434], [14994, -9.909083], [8851, -9.938621], [44608, -9.996215], [1840, -10.000547], [3142, -10.006173], [938, -10.034616], [16924, -10.047894], [4258, -10.0566], [919, -10.081043], [669, -10.083454], [6572, -10.089065], [47811, -10.121353], [527, -10.128627], [43322, -10.138204], [31946, -10.148696], [5336, -10.166053], [3713, -10.167396], [502, -10.185668], [38839, -10.256848], [37291, -10.268099]], "logprob_of_token": -1.00002, "top1_top2_margin": 0.481234, "top6_top7_margin": 0.441796}, {"gen_index": 7, "token": 21499, "top": [[21499, -0.245728], [14795, -2.347845], [5995, -2.638182], [47805, -3.916231], [262, -5.54314], [48683, -5.874585], [1460, -6.290854], [36836, -6.373221], [4101, -6.536023], [14852, -7.21335], [4774, -7.28882], [5848, -7.462604], [4273, -7.463507], [18762, -7.687263], [5954, -7.702159], [16719, -7.84452], [11527, -7.927649], [14950, -7.980478], [8263, -8.080696], [33341, -8.184295], [1324, -8.25338], [17392, -8.433838], [15893, -8.455963], [19090, -8.641847], [5865, -8.721458], [26960, -8.88429], [6547, -8.904401], [22597, -8.913809], [9172, -8.915007], [6785, -9.025251], [34210, -9.038118], [4484, -9.117641], [4836, -9.127687], [43211, -9.228873], [2935, -9.229781], [24627, -9.237854], [5657, -9.306422], [7852, -9.311352], [2550, -9.33394], [23015, -9.400381], [84254, -9.415545], [5344, -9.418151], [3917, -9.437815], [14257, -9.536533], [10822, -9.537861], [40540, -9.568956], [286, -9.57106], [14803, -9.572139], [3881, -9.5835], [14805, -9.59336], [9089, -9.612351], [3388, -9.618453], [20726, -9.672692], [24244, -9.696976], [50359, -9.749046], [41436, -9.756979], [16320, -9.886045], [19866, -9.892223], [13729, -9.903175], [543, -9.917597], [33611, -9.961378], [90637, -9.963575], [6803, -10.006267], [11966, -10.006758], [8175, -10.010692], [33340, -10.023771], [24775, -10.031529], [3583, -10.054306], [32537, -10.05587], [1843, -10.064761], [14341, -10.089081], [30279, -10.148177], [4850, -10.148976], [5381, -10.159932], [20341, -10.160351], [2468, -10.209899], [6678, -10.246997], [8275, -10.254433], [46098, -10.255405], [84272, -10.278751], [735, -10.283897], [30486, -10.308683], [15984, -10.332491], [14211, -10.3379], [1584, -10.345781], [1427, -10.358708], [12747, -10.362564], [11309, -10.367115], [121428, -10.368812], [3016, -10.39002], [27673, -10.391653], [10703, -10.398303], [52075, -10.409916], [5445, -10.426081], [15708, -10.445121], [12290, -10.451839], [10725, -10.477627], [2376, -10.487493], [14841, -10.499363], [19783, -10.50742]], "logprob_of_token": -0.245728, "top1_top2_margin": 2.102117, "top6_top7_margin": 0.416269}, {"gen_index": 8, "token": 735, "top": [[735, -0.000119], [18717, -10.223605], [21499, -10.643851], [919, -11.802328], [568, -12.042781], [5657, -12.394917], [2459, -12.899189], [330, -13.252137], [286, -13.614993], [439, -13.623286], [589, -13.714908], [476, -13.716376], [11910, -13.727812], [18126, -13.850289], [14896, -13.996683], [24348, -14.083926], [378, -14.148496], [7222, -14.166883], [4769, -14.340482], [11527, -14.347107], [4895, -14.352411], [44, -14.40286], [115, -14.408577], [11966, -14.449651], [766, -14.503495], [5445, -14.618451], [8157, -14.638307], [824, -14.685102], [1309, -14.802804], [528, -14.845071], [1270, -14.866431], [32, -14.928828], [60478, -14.931735], [58, -15.010205], [46, -15.132352], [262, -15.146963], [830, -15.191897], [1656, -15.232949], [11577, -15.281039], [4484, -15.285856], [48683, -15.365153], [18854, -15.410139], [617, -15.427829], [18296, -15.434531], [10794, -15.452432], [5995, -15.492291], [47805, -15.577868], [622, -15.593749], [37159, -15.632667], [7732, -15.643258], [1829, -15.68897], [34643, -15.697007], [576, -15.77737], [8263, -15.788438], [9727, -15.800197], [310, -15.822009], [17714, -15.865454], [13032, -15.90235], [127655, -15.926948], [4836, -15.940643], [1064, -15.950796], [8175, -15.977422], [279, -15.985823], [14188, -16.001448], [12243, -16.023949], [2492, -16.120596], [20869, -16.143772], [11035, -16.187092], [379, -16.2363], [12195, -16.2374], [543, -16.255529], [275, -16.264547], [19317, -16.288254], [263, -16.340248], [4088, -16.348986], [2347, -16.351231], [35099, -16.372915], [15762, -16.375807], [527, -16.382822], [3688, -16.399836], [53186, -16.423178], [31445, -16.436251], [6172, -16.452526], [20726, -16.478962], [7017, -16.503708], [941, -16.508623], [25982, -16.509283], [20773, -16.543818], [26116, -16.576191], [14153, -16.579283], [405, -16.583469], [11308, -16.585699], [16719, -16.629232], [5415, -16.629868], [23754, -16.654238], [4384, -16.659689], [2952, -16.66955], [1275, -16.67865], [936, -16.715727], [31752, -16.732349]], "logprob_of_token": -0.000119, "top1_top2_margin": 10.223486, "top6_top7_margin": 0.504272}, {"gen_index": 9, "token": 5657, "top": [[5657, -0.95753], [5190, -1.223819], [11966, -1.711389], [5445, -2.045162], [33341, -6.082949], [31642, -7.28509], [4227, -7.423254], [2550, -7.890889], [74238, -7.893759], [19679, -8.083648], [19898, -8.2347], [4836, -8.270299], [14394, -8.289799], [21499, -8.389759], [8358, -8.510286], [3155, -8.639058], [2932, -8.662282], [2478, -8.669641], [27169, -8.787936], [127274, -8.843822], [4205, -8.914881], [8263, -8.923781], [6572, -8.951305], [941, -9.12832], [14905, -9.225164], [8907, -9.249154], [17653, -9.277914], [38183, -9.36464], [16235, -9.367658], [7107, -9.393235], [3668, -9.449532], [4758, -9.471652], [12248, -9.499021], [6044, -9.526767], [34074, -9.593441], [51988, -9.615294], [7176, -9.68344], [26116, -9.718411], [46400, -9.798379], [53139, -9.82097], [7017, -9.827134], [17211, -9.831946], [1095, -9.886802], [13248, -9.929954], [30631, -10.056816], [9162, -10.105185], [18475, -10.121872], [502, -10.1582], [19897, -10.175429], [1451, -10.197993], [77841, -10.200727], [4769, -10.221372], [10321, -10.260983], [53186, -10.285433], [735, -10.293107], [3918, -10.308805], [3713, -10.346807], [48683, -10.38639], [15675, -10.392385], [2575, -10.394999], [52798, -10.400266], [57456, -10.418861], [26654, -10.490852], [851, -10.596908], [30632, -10.616176], [15411, -10.636281], [3548, -10.662263], [13078, -10.682898], [14590, -10.721276], [11242, -10.804798], [53796, -10.829947], [83582, -10.832901], [57352, -10.837581], [44102, -10.858241], [52045, -10.866361], [31752, -10.893054], [4678, -10.902672], [17959, -10.941378], [8640, -10.954958], [79608, -10.981742], [6870, -10.982937], [8175, -10.992806], [35672, -11.011186], [36836, -11.033383], [18642, -11.037427], [1410, -11.064557], [39523, -11.073334], [15673, -11.075841], [44211, -11.133451], [60605, -11.152287], [10780, -11.166171], [76301, -11.168962], [30971, -11.187093], [14553, -11.193362], [70982, -11.198972], [12683, -11.233074], [24248, -11.243575], [3550, -11.260022], [32, -11.275678], [20276, -11.299567]], "logprob_of_token": -0.95753, "top1_top2_margin": 0.26629, "top6_top7_margin": 0.138164}, {"gen_index": 10, "token": 46, "top": [[46, -0.110995], [286, -2.630671], [4484, -3.733052], [275, -5.501427], [44, -6.581279], [310, -6.782663], [59, -6.975863], [314, -7.926473], [120230, -9.301323], [936, -9.576622], [5657, -9.590313], [543, -9.629744], [15853, -9.860529], [9093, -9.98673], [622, -10.346078], [4703, -10.432033], [36209, -10.496865], [4769, -10.582569], [12359, -10.797702], [3368, -10.962284], [44455, -10.984102], [262, -10.988481], [4137, -11.158761], [5071, -11.211206], [1829, -11.232498], [763, -11.410226], [120241, -11.436728], [120099, -11.487683], [63, -11.496412], [7510, -11.550388], [53535, -11.557548], [21499, -11.587038], [33, -11.693331], [766, -11.742839], [2213, -11.786394], [14188, -11.876081], [1275, -11.879318], [325, -11.916512], [1409, -11.926752], [58, -11.984758], [3583, -12.02545], [735, -12.056214], [379, -12.213766], [120007, -12.242397], [120078, -12.275911], [120001, -12.298982], [1765, -12.344795], [12611, -12.3967], [779, -12.40743], [44102, -12.421178], [22648, -12.432432], [474, -12.481955], [3093, -12.509933], [3247, -12.521599], [5445, -12.538025], [2403, -12.551475], [3519, -12.562349], [120064, -12.579002], [799, -12.655075], [120140, -12.725362], [467, -12.771364], [45375, -12.820949], [120399, -12.869146], [1988, -12.887592], [14153, -12.888972], [38183, -12.90101], [263, -12.902808], [1744, -12.905797], [15299, -12.915881], [16554, -12.950048], [393, -12.956352], [318, -12.957569], [32, -13.000902], [3992, -13.028578], [24973, -13.031326], [93457, -13.062383], [270, -13.071299], [3755, -13.078798], [13594, -13.083506], [25250, -13.088589], [420, -13.116091], [777, -13.121558], [405, -13.140539], [127906, -13.148209], [2549, -13.158475], [5995, -13.171716], [3660, -13.199978], [120031, -13.210592], [2457, -13.22984], [127655, -13.24107], [80867, -13.253175], [4743, -13.262854], [1806, -13.268217], [2550, -13.27804], [8175, -13.28045], [28336, -13.287636], [120003, -13.307856], [9289, -13.353929], [1410, -13.364929], [120260, -13.436023]], "logprob_of_token": -0.110995, "top1_top2_margin": 2.519676, "top6_top7_margin": 0.1932}, {"gen_index": 11, "token": 543, "top": [[543, -0.010093], [1231, -5.214143], [6693, -7.468807], [9093, -7.492473], [1689, -7.871705], [669, -8.235894], [1194, -8.383426], [1336, -8.519485], [120014, -9.28448], [4759, -9.329263], [717, -9.383651], [1988, -9.533183], [7098, -9.667239], [3780, -9.723118], [1692, -9.760345], [14896, -9.813236], [1914, -10.011817], [1580, -10.019071], [766, -10.078431], [1905, -10.115725], [2883, -10.156249], [127906, -10.201314], [3501, -10.299779], [2560, -10.312845], [2743, -10.340291], [24775, -10.369178], [611, -10.410213], [6814, -10.441303], [262, -10.461228], [19313, -10.581364], [6143, -10.630303], [20605, -10.65955], [5438, -10.679822], [7339, -10.726366], [8266, -10.791617], [5775, -10.799703], [29182, -10.874991], [523, -10.876506], [14147, -10.956663], [120004, -10.956906], [14161, -10.959091], [9830, -10.959222], [9643, -11.038721], [742, -11.076428], [8067, -11.218043], [1047, -11.293318], [4246, -11.300483], [14777, -11.348401], [2284, -11.369224], [325, -11.390289], [15934, -11.442451], [8009, -11.523729], [2291, -11.536661], [4484, -11.542126], [4433, -11.544962], [2865, -11.616148], [7510, -11.629542], [127655, -11.653144], [840, -11.659381], [17285, -11.675033], [946, -11.704085], [1254, -11.735475], [3463, -11.736926], [32, -11.754427], [58742, -11.805612], [1921, -11.844954], [6455, -11.848894], [8265, -11.873641], [6859, -11.908223], [19710, -11.941424], [27775, -11.952346], [3209, -11.969125], [9557, -12.027698], [5274, -12.027715], [35909, -12.031241], [23070, -12.035743], [8852, -12.153856], [7189, -12.177943], [5439, -12.181287], [6372, -12.183889], [44116, -12.201948], [5949, -12.247649], [41390, -12.253598], [1048, -12.266841], [1829, -12.268023], [4001, -12.271779], [8307, -12.275373], [11185, -12.282231], [7679, -12.28944], [6530, -12.343608], [3958, -12.401058], [9717, -12.40213], [7515, -12.415025], [4954, -12.425732], [6391, -12.450953], [22438, -12.508214], [14188, -12.50998], [33341, -12.514329], [2388, -12.526116], [5084, -12.549121]], "logprob_of_token": -0.010093, "top1_top2_margin": 5.20405, "top6_top7_margin": 0.147532}, {"gen_index": 12, "token": 5995, "top": [[5995, -0.108271], [21499, -3.152625], [14795, -3.358634], [5954, -6.24494], [4101, -6.423045], [14950, -7.232922], [24775, -7.311191], [1460, -7.538984], [4273, -7.678601], [36836, -7.769209], [17392, -7.837456], [5848, -7.910648], [9172, -8.114643], [33341, -8.313398], [6785, -8.421978], [14852, -8.585295], [15893, -8.624051], [2935, -8.706716], [34210, -8.79081], [3388, -8.792937], [47805, -8.815495], [30279, -8.822436], [11268, -8.910887], [48683, -8.957216], [4774, -9.040056], [5344, -9.182162], [9089, -9.259183], [5865, -9.278779], [6547, -9.280697], [14341, -9.307753], [8263, -9.338381], [1843, -9.346606], [43211, -9.403008], [6074, -9.40683], [4836, -9.444273], [1305, -9.447478], [10822, -9.453055], [8275, -9.534337], [14264, -9.550219], [3363, -9.551234], [14803, -9.573782], [2550, -9.613554], [15708, -9.625565], [7424, -9.63698], [4850, -9.65835], [1427, -9.662843], [262, -9.665202], [3515, -9.704049], [56635, -9.71152], [22847, -9.743023], [6339, -9.745946], [2554, -9.760118], [4907, -9.777681], [3519, -9.796921], [543, -9.799161], [15984, -9.806241], [16719, -9.812653], [65177, -9.819706], [14470, -9.85091], [5657, -9.869473], [2722, -9.880409], [8175, -9.9002], [16673, -9.913055], [18686, -9.941074], [4931, -9.956687], [3143, -9.963017], [7940, -9.966804], [41801, -10.006419], [10461, -10.028028], [1963, -10.031372], [11309, -10.032146], [7193, -10.050357], [18762, -10.053286], [11527, -10.072591], [4206, -10.074106], [12913, -10.096469], [1324, -10.106005], [3917, -10.124763], [25343, -10.125259], [4739, -10.139438], [18794, -10.145914], [38753, -10.162416], [32, -10.209494], [1584, -10.211623], [6700, -10.224269], [4484, -10.226144], [3881, -10.238412], [6803, -10.26701], [40540, -10.269228], [22597, -10.277981], [6900, -10.294065], [24244, -10.327196], [5381, -10.336779], [14233, -10.366829], [30084, -10.376995], [7898, -10.388308], [11046, -10.413242], [1970, -10.417366], [5032, -10.421224], [20341, -10.432813]], "logprob_of_token": -0.108271, "top1_top2_margin": 3.044354, "top6_top7_margin": 0.078269}, {"gen_index": 13, "token": 735, "top": [[735, -0.001293], [14950, -7.85755], [4484, -9.388145], [1503, -9.923906], [919, -10.129281], [286, -10.167208], [439, -10.408743], [2722, -10.596453], [18717, -10.666798], [476, -10.783141], [824, -10.797758], [9668, -10.846349], [3881, -10.996243], [5995, -11.08161], [622, -11.156872], [33341, -11.216421], [1309, -11.312424], [14060, -11.419355], [5607, -11.545023], [1656, -11.573121], [378, -11.580584], [2459, -11.619555], [11577, -11.64678], [5445, -11.663441], [330, -11.884466], [7222, -11.935713], [52075, -11.951836], [14353, -12.005262], [4895, -12.064143], [8157, -12.09913], [24348, -12.281452], [4088, -12.37503], [5865, -12.379765], [13255, -12.399447], [17714, -12.479866], [589, -12.542959], [1064, -12.640274], [7732, -12.683182], [11317, -12.692237], [11910, -12.713467], [528, -12.731421], [1270, -12.742918], [3363, -12.767262], [1041, -12.918516], [9727, -12.965572], [5344, -12.990269], [568, -13.007624], [14896, -13.027813], [127655, -13.060462], [15762, -13.085592], [766, -13.102989], [58, -13.132675], [20787, -13.137371], [8175, -13.179123], [13032, -13.196542], [44, -13.219079], [2584, -13.238157], [7499, -13.250742], [5954, -13.297343], [23754, -13.327076], [38997, -13.334839], [576, -13.339531], [527, -13.339849], [75248, -13.377481], [14795, -13.460894], [10794, -13.476329], [11035, -13.492342], [18126, -13.496981], [18296, -13.511071], [8150, -13.524374], [2286, -13.528517], [5415, -13.55324], [22347, -13.582805], [49987, -13.590656], [36836, -13.591219], [20028, -13.62042], [32, -13.651399], [16874, -13.661019], [11308, -13.695002], [22648, -13.714041], [379, -13.73251], [6344, -13.745528], [12243, -13.754619], [34643, -13.756039], [27673, -13.762567], [9471, -13.785898], [16514, -13.789084], [4384, -13.804888], [26040, -13.815926], [46, -13.859179], [1843, -13.865363], [32578, -13.867017], [2463, -13.868434], [6172, -13.889134], [2374, -13.911824], [3583, -13.916919], [24356, -13.922924], [617, -13.923256], [279, -13.947927], [44886, -13.9587]], "logprob_of_token": -0.001293, "top1_top2_margin": 7.856256, "top6_top7_margin": 0.241535}, {"gen_index": 14, "token": 5445, "top": [[5445, -0.818104], [33341, -1.110188], [14394, -3.149824], [30631, -3.397946], [31642, -3.623652], [7176, -3.780802], [5190, -3.807047], [8358, -4.282266], [11966, -4.741291], [2302, -5.255219], [30632, -5.650681], [9162, -5.899667], [3918, -5.9037], [7143, -6.039272], [15114, -6.075452], [3713, -6.234501], [74238, -6.382009], [5657, -6.538925], [51717, -6.585407], [7833, -6.64537], [4205, -7.170425], [17653, -7.220783], [15675, -7.238495], [5061, -7.529489], [116858, -7.548711], [46400, -7.594726], [1410, -7.624573], [19898, -7.6676], [502, -7.68117], [20276, -7.776548], [14876, -7.866979], [7107, -8.018026], [8907, -8.070184], [31946, -8.096463], [30775, -8.106061], [35672, -8.125886], [36836, -8.154709], [5336, -8.217744], [14705, -8.266665], [941, -8.401994], [19679, -8.444052], [29307, -8.455367], [17602, -8.483138], [15673, -8.534073], [118445, -8.595787], [2550, -8.599502], [58742, -8.611926], [51988, -8.613442], [16235, -8.640751], [97792, -8.678251], [2272, -8.699458], [16650, -8.701508], [5995, -8.745265], [100763, -8.780011], [5717, -8.803671], [11964, -8.830263], [851, -8.830629], [2944, -8.865562], [12319, -8.897214], [14994, -8.913887], [10780, -8.920086], [52045, -8.927704], [8851, -8.929211], [15411, -8.969369], [6870, -9.058942], [53139, -9.073475], [6094, -9.088795], [57230, -9.101864], [2584, -9.129826], [72033, -9.173861], [10301, -9.205034], [38183, -9.220798], [5678, -9.242439], [6885, -9.265479], [118918, -9.268886], [14349, -9.294825], [3550, -9.320901], [6044, -9.332481], [41286, -9.355832], [2928, -9.364517], [14780, -9.439421], [14251, -9.442021], [27169, -9.460396], [38839, -9.474798], [8254, -9.479609], [13078, -9.517414], [30536, -9.524546], [2377, -9.542498], [16191, -9.551907], [6642, -9.563166], [900, -9.581202], [12248, -9.618244], [18686, -9.631701], [5062, -9.652363], [4540, -9.655022], [29314, -9.680359], [3437, -9.685787], [79608, -9.692507], [17086, -9.716217], [18475, -9.734835]], "logprob_of_token": -0.818104, "top1_top2_margin": 0.292084, "top6_top7_margin": 0.026245}, {"gen_index": 15, "token": 286, "top": [[286, -0.146789], [4484, -2.020483], [46, -7.157006], [310, -7.727454], [15853, -8.236414], [4101, -8.59523], [936, -8.610106], [622, -8.916761], [9093, -9.130299], [22648, -9.239267], [53535, -9.247725], [5071, -9.567804], [275, -9.613066], [12359, -9.650244], [4703, -9.70677], [44, -9.768444], [763, -9.77179], [2213, -10.061003], [3583, -10.291998], [3368, -10.575577], [318, -10.601265], [3519, -10.698069], [45375, -10.712847], [33341, -10.736349], [420, -10.786703], [5995, -10.888449], [3247, -10.958054], [1806, -10.965963], [3093, -11.152706], [314, -11.194067], [5445, -11.224392], [1275, -11.230427], [779, -11.230795], [15299, -11.277016], [3755, -11.292606], [59, -11.322195], [735, -11.325062], [467, -11.351093], [3918, -11.422199], [379, -11.583364], [2457, -11.607391], [1409, -11.609077], [36836, -11.657108], [262, -11.737534], [58, -11.788906], [4272, -11.807051], [270, -11.861816], [36209, -11.889603], [3737, -11.907581], [8175, -11.911467], [14795, -11.934345], [2549, -11.982683], [1790, -11.986124], [65560, -12.017536], [2403, -12.055532], [766, -12.118759], [59099, -12.135544], [1739, -12.176069], [1744, -12.197958], [25250, -12.255398], [4774, -12.291145], [5657, -12.318766], [393, -12.345066], [33, -12.351276], [7510, -12.358923], [3688, -12.379021], [29009, -12.38282], [4769, -12.384848], [2051, -12.39728], [1765, -12.400888], [26530, -12.403509], [4529, -12.420408], [2362, -12.433023], [1988, -12.455084], [4137, -12.463818], [80867, -12.465984], [900, -12.471968], [19078, -12.508005], [7557, -12.508911], [41514, -12.511072], [34, -12.519819], [474, -12.552454], [4638, -12.566437], [16554, -12.584305], [6785, -12.587112], [1410, -12.659451], [1776, -12.689129], [12742, -12.689976], [1840, -12.694599], [799, -12.705589], [6803, -12.714458], [3863, -12.730213], [3660, -12.751123], [279, -12.756426], [1093, -12.796091], [502, -12.830484], [1155, -12.852617], [4375, -12.859903], [5978, -12.864393], [2548, -12.870228]], "logprob_of_token": -0.146789, "top1_top2_margin": 1.873693, "top6_top7_margin": 0.014875}, {"gen_index": 16, "token": 262, "top": [[262, -0.004666], [33341, -6.163236], [3326, -7.642644], [3142, -7.739138], [2213, -8.378668], [5445, -8.551197], [11966, -8.577517], [1744, -9.292624], [3737, -9.679481], [543, -9.763458], [27169, -9.854124], [7176, -10.021487], [4484, -10.264813], [31642, -10.526308], [5657, -10.562776], [30631, -11.079019], [453, -11.087369], [36836, -11.138868], [46400, -11.236541], [669, -11.313083], [4758, -11.403651], [5190, -11.442576], [325, -11.492307], [17653, -11.526943], [19898, -11.549965], [8358, -11.824053], [527, -11.916333], [15853, -11.922427], [9162, -11.975789], [1435, -12.053441], [286, -12.068754], [18475, -12.208642], [14394, -12.225236], [41286, -12.277423], [5678, -12.293176], [1739, -12.298499], [565, -12.312724], [261, -12.325816], [7107, -12.368207], [14705, -12.374104], [1324, -12.389729], [15675, -12.451483], [3519, -12.483626], [597, -12.494452], [735, -12.503739], [58742, -12.524705], [851, -12.534334], [13078, -12.605491], [14876, -12.614833], [20276, -12.656281], [4205, -12.666933], [1436, -12.707089], [2468, -12.724515], [11964, -12.825935], [39523, -12.826495], [74238, -12.875529], [2932, -12.878971], [27446, -12.881076], [1776, -12.891677], [4227, -12.92936], [51988, -12.943102], [30076, -12.952418], [47811, -12.958823], [40212, -12.980475], [919, -13.015928], [13190, -13.062462], [4219, -13.06294], [18829, -13.077994], [1806, -13.095363], [18762, -13.095393], [3327, -13.122976], [19319, -13.127454], [3918, -13.148502], [6870, -13.162043], [47576, -13.197268], [30632, -13.205473], [900, -13.218082], [3550, -13.272836], [12566, -13.291051], [4743, -13.308784], [44211, -13.31753], [30971, -13.318197], [6044, -13.328231], [68028, -13.329766], [52045, -13.360211], [19679, -13.386996], [74606, -13.393348], [53139, -13.463744], [6564, -13.469799], [941, -13.477782], [2503, -13.490985], [10321, -13.496345], [1840, -13.506951], [4540, -13.513712], [2575, -13.520055], [43322, -13.523759], [98066, -13.536618], [57352, -13.569604], [2403, -13.588391], [1862, -13.591443]], "logprob_of_token": -0.004666, "top1_top2_margin": 6.15857, "top6_top7_margin": 0.02632}, {"gen_index": 17, "token": 21499, "top": [[21499, -0.179775], [14795, -2.099828], [1460, -4.298104], [5995, -5.182648], [18762, -6.101748], [48683, -6.156179], [36836, -6.635488], [4101, -6.709068], [4273, -7.176691], [9172, -7.513237], [47805, -7.696018], [5848, -7.702865], [14852, -7.729881], [11527, -7.7588], [4850, -7.84735], [34210, -7.930644], [14341, -7.997159], [11309, -8.03898], [4774, -8.08606], [14470, -8.107532], [4836, -8.125602], [22597, -8.334905], [20726, -8.352764], [17392, -8.391364], [30084, -8.39712], [9089, -8.463983], [7882, -8.512749], [7193, -8.747679], [30971, -8.916942], [43211, -9.01017], [8263, -9.067103], [33341, -9.074758], [15893, -9.134238], [19090, -9.135205], [10822, -9.172565], [14321, -9.248176], [6547, -9.261629], [6785, -9.277379], [84254, -9.307396], [24244, -9.315787], [16719, -9.358526], [6339, -9.376235], [1324, -9.387912], [5954, -9.462556], [5657, -9.488084], [46098, -9.50142], [14233, -9.515015], [3388, -9.51545], [40952, -9.526805], [14257, -9.570981], [15708, -9.576402], [19089, -9.781607], [14803, -9.797065], [84272, -9.86487], [3016, -9.866523], [5381, -9.881571], [14950, -9.954211], [10703, -9.986018], [14841, -9.988129], [3519, -10.006688], [7852, -10.056439], [10461, -10.105828], [34991, -10.111219], [6564, -10.112222], [2550, -10.129792], [24627, -10.138816], [13729, -10.207374], [7936, -10.229887], [90637, -10.255441], [3197, -10.306794], [3881, -10.310306], [9616, -10.349939], [8175, -10.352095], [2468, -10.36699], [3363, -10.369742], [14344, -10.382061], [26960, -10.454986], [6900, -10.455455], [2866, -10.456988], [25343, -10.466578], [10725, -10.475827], [5865, -10.480244], [41287, -10.495538], [23015, -10.537217], [15227, -10.546107], [19866, -10.585216], [14362, -10.604968], [13758, -10.610072], [9501, -10.624023], [40540, -10.62659], [45175, -10.635379], [33611, -10.639306], [4931, -10.649493], [10262, -10.663243], [48201, -10.685391], [1625, -10.686484], [7424, -10.718944], [14312, -10.767531], [20325, -10.780985], [6678, -10.782928]], "logprob_of_token": -0.179775, "top1_top2_margin": 1.920053, "top6_top7_margin": 0.479309}, {"gen_index": 18, "token": 735, "top": [[735, -4e-05], [18717, -11.702826], [21499, -12.345528], [330, -12.957219], [568, -13.298789], [2459, -13.387648], [919, -13.410952], [7222, -14.016492], [5657, -14.022766], [439, -14.077453], [1270, -14.156395], [476, -14.167964], [18126, -14.239024], [10794, -14.253213], [286, -14.310712], [1656, -14.482203], [24348, -14.553462], [8157, -14.658386], [1309, -14.686717], [378, -14.747432], [14896, -14.863866], [824, -15.189502], [589, -15.257119], [528, -15.291738], [18296, -15.350146], [37159, -15.370952], [44, -15.436506], [17714, -15.510865], [11910, -15.532534], [1064, -15.556058], [46, -15.581216], [310, -15.693192], [32, -15.714732], [4769, -15.805437], [8150, -15.816793], [11577, -15.832305], [4895, -15.866566], [622, -15.879367], [766, -15.906247], [830, -15.962396], [31445, -15.968889], [115, -15.988035], [11527, -16.138552], [4088, -16.166941], [4484, -16.181295], [279, -16.323263], [576, -16.334667], [60478, -16.334751], [7732, -16.341169], [9727, -16.422464], [120007, -16.461296], [73707, -16.487045], [318, -16.555668], [379, -16.580435], [34643, -16.605272], [527, -16.605875], [1275, -16.666258], [58, -16.713083], [617, -16.726982], [7499, -16.76512], [6172, -16.768501], [11317, -16.822479], [262, -16.84605], [25288, -16.856049], [7017, -16.861517], [63, -16.869732], [49987, -16.897211], [1409, -16.90484], [19317, -16.907595], [20773, -16.915007], [18854, -16.92527], [47805, -16.936079], [936, -16.951941], [12195, -16.954565], [35099, -17.027849], [5445, -17.067266], [4384, -17.13608], [20726, -17.141361], [44102, -17.144625], [5995, -17.160109], [127655, -17.189833], [941, -17.22279], [467, -17.225674], [275, -17.226261], [2347, -17.253588], [120670, -17.26955], [5415, -17.286793], [9668, -17.317945], [11308, -17.331831], [13308, -17.332865], [1829, -17.346933], [12243, -17.347355], [47, -17.363503], [8954, -17.364836], [2286, -17.365934], [35269, -17.394239], [20615, -17.39957], [13032, -17.400515], [48683, -17.405527], [4836, -17.452471]], "logprob_of_token": -4e-05, "top1_top2_margin": 11.702787, "top6_top7_margin": 0.023304}, {"gen_index": 19, "token": 5657, "top": [[5657, -0.56362], [5190, -1.093581], [5445, -3.150923], [11966, -3.955041], [33341, -4.976999], [21499, -6.080514], [31642, -6.352404], [14394, -6.827363], [8358, -6.85809], [10321, -6.936112], [127274, -7.007692], [1410, -7.253953], [4836, -7.274108], [2550, -7.300872], [27169, -7.409881], [74238, -7.492866], [19898, -7.499891], [3918, -7.523164], [6044, -7.751631], [3155, -7.901996], [4227, -8.043162], [2478, -8.162763], [8640, -8.179051], [3668, -8.206236], [17653, -8.34414], [502, -8.379107], [3713, -8.424553], [16235, -8.432962], [9162, -8.50137], [4205, -8.503837], [15675, -8.522622], [53139, -8.596106], [941, -8.655387], [3548, -8.67405], [2932, -8.707683], [30632, -8.749432], [4758, -8.792472], [19679, -8.812264], [6572, -8.821668], [26654, -8.822086], [8907, -8.823917], [12248, -8.829021], [19897, -8.85819], [53796, -9.010361], [2944, -9.064263], [7176, -9.064388], [7833, -9.081668], [15411, -9.092264], [1095, -9.093554], [13248, -9.177091], [14590, -9.231078], [14905, -9.288198], [7017, -9.298313], [51988, -9.308026], [17602, -9.322331], [2302, -9.372781], [24248, -9.412967], [17211, -9.419179], [30971, -9.43694], [52013, -9.450031], [7107, -9.489976], [18475, -9.534121], [14705, -9.585469], [26116, -9.619977], [47576, -9.646951], [1903, -9.65108], [4769, -9.715128], [36836, -9.732551], [46400, -9.744958], [2575, -9.797966], [8263, -9.815131], [735, -9.818393], [18829, -9.834891], [262, -9.836649], [34074, -9.864982], [57456, -9.866608], [5061, -9.874061], [13078, -9.878346], [851, -9.920646], [14553, -9.927478], [20151, -9.927822], [44211, -9.937209], [1451, -9.959785], [3550, -9.968114], [18642, -9.96831], [15853, -9.970601], [57352, -9.989405], [20276, -10.087862], [30631, -10.093398], [14251, -10.093957], [52045, -10.128449], [17959, -10.14232], [38183, -10.151372], [48683, -10.162314], [11242, -10.19828], [6870, -10.207372], [52798, -10.292825], [32, -10.339474], [25039, -10.365396], [30076, -10.414945]], "logprob_of_token": -0.56362, "top1_top2_margin": 0.529961, "top6_top7_margin": 0.27189}, {"gen_index": 20, "token": 46, "top": [[46, -0.002199], [275, -6.48788], [286, -7.818186], [314, -9.395445], [4484, -9.669877], [44, -11.049353], [21499, -11.236504], [310, -11.373882], [120230, -11.954325], [63, -12.025702], [735, -12.136086], [936, -12.408206], [5071, -12.44426], [15853, -12.877079], [36209, -12.983709], [543, -13.047163], [59, -13.471971], [262, -13.501512], [120099, -13.510275], [44455, -13.549326], [5995, -13.645756], [33, -13.740287], [622, -13.756252], [325, -13.860394], [766, -13.931439], [2213, -14.002349], [47805, -14.105788], [4137, -14.170736], [120007, -14.185312], [12359, -14.308498], [120241, -14.357845], [120078, -14.429171], [7510, -14.57986], [58, -14.581145], [3368, -14.63511], [763, -14.645616], [3545, -14.659801], [1275, -14.664821], [11527, -14.705334], [120140, -14.711908], [1765, -14.756016], [7331, -14.878613], [9093, -14.889677], [379, -14.904238], [19078, -15.043083], [1409, -15.071673], [1829, -15.074867], [5657, -15.139532], [420, -15.178018], [779, -15.206593], [4703, -15.278855], [32, -15.27965], [1806, -15.294771], [467, -15.381007], [14188, -15.384209], [120031, -15.478556], [120118, -15.483377], [1112, -15.492033], [120001, -15.5021], [93457, -15.53862], [4769, -15.611164], [10725, -15.627708], [127906, -15.653113], [3688, -15.722355], [120399, -15.740436], [568, -15.801724], [474, -15.802731], [3918, -15.816193], [589, -15.828884], [3247, -15.832016], [120015, -15.837022], [9289, -15.839408], [318, -15.945796], [120020, -15.953819], [327, -15.957517], [1460, -15.965846], [120100, -15.984279], [263, -15.997331], [125874, -16.00746], [2457, -16.012526], [919, -16.023941], [12611, -16.029583], [10, -16.040146], [120054, -16.044065], [4101, -16.049671], [3711, -16.05607], [1988, -16.064087], [120347, -16.067755], [878, -16.094831], [47, -16.100544], [799, -16.130692], [5445, -16.137249], [110358, -16.138645], [3326, -16.143854], [26530, -16.154137], [1776, -16.20578], [1225, -16.20657], [375, -16.223886], [120618, -16.225468], [120110, -16.246704]], "logprob_of_token": -0.002199, "top1_top2_margin": 6.485681, "top6_top7_margin": 0.187151}, {"gen_index": 21, "token": 543, "top": [[543, -0.000443], [1231, -10.153419], [1580, -10.31118], [6693, -10.535975], [325, -10.680668], [669, -10.925138], [1689, -10.931017], [1336, -10.974169], [262, -11.349856], [127906, -11.474535], [1194, -11.561191], [120014, -11.609707], [1692, -11.644417], [3780, -11.909334], [717, -11.915279], [1914, -11.966056], [611, -12.01317], [7098, -12.133589], [766, -12.151709], [1988, -12.199463], [9093, -12.262495], [1047, -12.349199], [8009, -12.486107], [1905, -12.494154], [14147, -12.680637], [2560, -12.921743], [523, -12.966692], [32, -13.011036], [5438, -13.021275], [19313, -13.032914], [24775, -13.052296], [3501, -13.131064], [7510, -13.163118], [14161, -13.216938], [4954, -13.226411], [14896, -13.244681], [29182, -13.272324], [2284, -13.366683], [4433, -13.406023], [742, -13.427763], [4246, -13.453102], [4759, -13.482882], [20605, -13.48971], [9830, -13.495691], [6143, -13.506731], [120004, -13.536198], [5775, -13.539789], [6814, -13.549332], [3463, -13.608907], [7189, -13.646313], [2865, -13.651476], [8265, -13.655656], [6391, -13.672483], [9643, -13.765741], [2743, -13.792757], [15934, -13.831058], [1048, -13.861378], [8852, -13.924232], [8266, -13.943678], [7339, -13.955258], [8307, -14.006563], [8067, -14.021551], [5274, -14.072541], [9557, -14.073914], [13450, -14.090424], [19019, -14.103751], [1921, -14.105257], [14188, -14.11516], [11185, -14.117125], [127655, -14.171202], [2297, -14.182049], [13382, -14.188205], [14153, -14.208798], [2883, -14.208977], [1829, -14.211704], [9717, -14.241556], [1433, -14.243444], [2291, -14.276803], [946, -14.304009], [7302, -14.314291], [7924, -14.373152], [11935, -14.388017], [120022, -14.392385], [3958, -14.43015], [37650, -14.48966], [6455, -14.495495], [4562, -14.503849], [4888, -14.515038], [58742, -14.533419], [8758, -14.554386], [6530, -14.615173], [1254, -14.655537], [28484, -14.665287], [6372, -14.665624], [1438, -14.692431], [41390, -14.70857], [121026, -14.717137], [263, -14.729103], [14275, -14.743248], [6859, -14.755991]], "logprob_of_token": -0.000443, "top1_top2_margin": 10.152977, "top6_top7_margin": 0.005879}, {"gen_index": 22, "token": 5995, "top": [[5995, -0.637452], [21499, -3.621179], [24775, -5.523089], [30279, -5.927743], [11268, -5.999994], [14795, -6.449523], [41801, -6.607731], [262, -6.744582], [527, -6.781271], [16719, -6.852619], [1460, -6.912944], [11527, -7.025633], [47805, -7.095088], [32, -7.307505], [3515, -7.312119], [2554, -7.549482], [851, -7.567487], [543, -7.589352], [7852, -7.622581], [4273, -7.624371], [10461, -7.635229], [5344, -7.702524], [5865, -7.764968], [5954, -7.769378], [2376, -7.784396], [7510, -7.827051], [61599, -7.8336], [17392, -7.907233], [3143, -7.91281], [5660, -7.925948], [3388, -7.928878], [735, -7.950524], [1843, -8.02692], [782, -8.031203], [33341, -8.070897], [1305, -8.074779], [2711, -8.087731], [1343, -8.098489], [1427, -8.101234], [3917, -8.105211], [873, -8.151636], [4595, -8.155272], [3142, -8.161979], [4206, -8.17483], [6785, -8.193226], [7940, -8.207927], [82241, -8.213275], [669, -8.258534], [36836, -8.272629], [1194, -8.28041], [14805, -8.286402], [14950, -8.287202], [8175, -8.291979], [6547, -8.323811], [3353, -8.338384], [1523, -8.339063], [4101, -8.34028], [125884, -8.341638], [14803, -8.34376], [28326, -8.347872], [6700, -8.365545], [10301, -8.369096], [10054, -8.374244], [3937, -8.384246], [286, -8.386235], [1324, -8.392272], [12042, -8.395968], [26040, -8.396635], [2645, -8.399856], [936, -8.40816], [13709, -8.410023], [4205, -8.415855], [59199, -8.416508], [16320, -8.420601], [1788, -8.435788], [2821, -8.437945], [34210, -8.442715], [1309, -8.446719], [44, -8.447287], [3335, -8.449456], [11053, -8.479711], [5032, -8.479876], [46, -8.482149], [6900, -8.488134], [5714, -8.489196], [1963, -8.493345], [11443, -8.494866], [10262, -8.4982], [4758, -8.498832], [9172, -8.499509], [2887, -8.506958], [12913, -8.514952], [6563, -8.521408], [2302, -8.521975], [1970, -8.522189], [1806, -8.52778], [1744, -8.533669], [7292, -8.539164], [2213, -8.541726], [2935, -8.546612]], "logprob_of_token": -0.637452, "top1_top2_margin": 2.983727, "top6_top7_margin": 0.158208}, {"gen_index": 23, "token": 735, "top": [[735, -0.000296], [5995, -10.711704], [286, -11.285948], [33341, -11.326376], [5445, -11.382284], [14950, -11.620565], [476, -11.934462], [824, -11.946546], [919, -11.96563], [330, -11.975466], [439, -11.979695], [622, -12.097425], [568, -12.102963], [378, -12.383644], [2459, -12.423973], [1309, -12.587411], [18717, -12.595185], [115, -12.841959], [44, -12.873516], [14896, -12.916054], [1656, -12.92004], [17714, -12.923203], [3881, -13.097565], [14795, -13.158061], [1270, -13.162758], [36836, -13.243942], [11577, -13.271037], [1064, -13.351048], [13255, -13.394403], [58, -13.44611], [18126, -13.520124], [528, -13.539515], [263, -13.731546], [127655, -13.747753], [4484, -13.756786], [120007, -13.770779], [589, -13.785105], [310, -13.786531], [527, -13.818244], [7222, -13.839808], [2722, -13.861526], [14353, -13.895564], [2286, -13.905005], [3363, -13.924397], [379, -13.950838], [279, -13.962806], [7510, -13.990452], [8175, -13.993948], [46, -14.141771], [766, -14.166695], [21499, -14.175414], [10, -14.204933], [20773, -14.219027], [9668, -14.248521], [8150, -14.258849], [4088, -14.261278], [5607, -14.269305], [20787, -14.270023], [24348, -14.278309], [262, -14.332031], [9727, -14.340635], [1503, -14.346954], [2302, -14.350395], [31642, -14.435909], [502, -14.498615], [936, -14.500317], [11317, -14.505851], [124489, -14.586973], [851, -14.609159], [32, -14.632874], [120670, -14.641141], [45375, -14.665857], [14188, -14.707782], [58742, -14.766768], [3660, -14.806809], [1041, -14.819302], [10794, -14.834856], [4895, -14.874771], [830, -14.888761], [73707, -14.892719], [5865, -14.895401], [49987, -14.929046], [669, -14.937972], [2457, -14.957781], [12243, -14.960608], [1052, -14.961985], [14153, -14.966994], [2213, -14.986558], [3402, -14.999552], [127906, -15.001204], [63, -15.006436], [60478, -15.008143], [8263, -15.017633], [79211, -15.041321], [3326, -15.067559], [7499, -15.071026], [6339, -15.071734], [6344, -15.075139], [75248, -15.120611], [11910, -15.121941]], "logprob_of_token": -0.000296, "top1_top2_margin": 10.711408, "top6_top7_margin": 0.313896}, {"gen_index": 24, "token": 5445, "top": [[5445, -0.581226], [33341, -0.915858], [31642, -4.908766], [14394, -5.162221], [9162, -6.166904], [7176, -6.284065], [30632, -6.391708], [2302, -6.400339], [11966, -6.429961], [8358, -6.680681], [36836, -7.546929], [30631, -7.557707], [3713, -7.608449], [7143, -7.768305], [5657, -7.773816], [4205, -7.790435], [5190, -7.837837], [7107, -7.89054], [3918, -8.055162], [17602, -8.078672], [51717, -8.238429], [941, -8.353398], [7833, -8.361658], [58742, -8.465663], [74238, -8.485191], [17653, -8.563827], [19898, -8.58844], [502, -8.596493], [51988, -8.874968], [8907, -8.886032], [14705, -8.930769], [38183, -9.039155], [35672, -9.045871], [116858, -9.100092], [6094, -9.173069], [10301, -9.208694], [3550, -9.21213], [100763, -9.3133], [47576, -9.329587], [1410, -9.374834], [5995, -9.38789], [20276, -9.410172], [79608, -9.433283], [12248, -9.4379], [19679, -9.468023], [46400, -9.493942], [15675, -9.536338], [851, -9.577587], [11964, -9.597084], [262, -9.617773], [118445, -9.630562], [13078, -9.6364], [55978, -9.647448], [6885, -9.710311], [44211, -9.715162], [29307, -9.717102], [31946, -9.724789], [30536, -9.725012], [5717, -9.728611], [5678, -9.737539], [14780, -9.813316], [22721, -9.835405], [12319, -9.838655], [14994, -9.854069], [53167, -9.867119], [8175, -9.882664], [2272, -9.90213], [2550, -9.903269], [6992, -9.90651], [52045, -10.008455], [6394, -10.014921], [14876, -10.021652], [41286, -10.065584], [30076, -10.070969], [27169, -10.084372], [5336, -10.118984], [37671, -10.155558], [16235, -10.203534], [6642, -10.252657], [6044, -10.264922], [2575, -10.284069], [5061, -10.323109], [2377, -10.355163], [41287, -10.355593], [3548, -10.359004], [15114, -10.360025], [28064, -10.406712], [7881, -10.41327], [2944, -10.448353], [14251, -10.457836], [29182, -10.464999], [14795, -10.466637], [15411, -10.475149], [38839, -10.478822], [12566, -10.511162], [39523, -10.518403], [30775, -10.520922], [4758, -10.52339], [5062, -10.524328], [34210, -10.571228]], "logprob_of_token": -0.581226, "top1_top2_margin": 0.334632, "top6_top7_margin": 0.107643}, {"gen_index": 25, "token": 286, "top": [[286, -0.007592], [46, -5.714468], [4484, -5.796437], [936, -7.522622], [275, -8.884477], [44, -9.984604], [310, -9.997713], [15853, -10.412168], [622, -10.509851], [314, -10.777287], [5995, -10.984014], [1806, -11.323054], [420, -11.388614], [12359, -11.592196], [735, -11.644284], [1275, -11.721915], [59, -11.725139], [9093, -11.87627], [4101, -11.931368], [318, -11.998119], [2213, -12.058166], [5071, -12.199771], [53535, -12.238868], [7510, -12.262465], [120007, -12.264262], [379, -12.428018], [63, -12.464749], [263, -12.464978], [36209, -12.476985], [3688, -12.491115], [1093, -12.552854], [45375, -12.61769], [763, -12.623879], [58, -12.645106], [22648, -12.647149], [766, -12.648086], [270, -12.651539], [467, -12.768554], [1409, -12.773486], [4703, -12.79217], [3583, -12.865324], [779, -12.916926], [34, -12.934347], [262, -12.94526], [33, -12.980205], [2457, -13.005055], [127655, -13.017054], [4137, -13.128022], [10, -13.185051], [21499, -13.185855], [2403, -13.312976], [3368, -13.335217], [1829, -13.354956], [474, -13.382497], [33341, -13.393357], [36836, -13.454322], [279, -13.499018], [120078, -13.503289], [3093, -13.508827], [32, -13.518666], [3247, -13.521163], [3918, -13.531864], [24973, -13.535296], [1225, -13.581536], [327, -13.588862], [2051, -13.658046], [2549, -13.670478], [120230, -13.746309], [3737, -13.751225], [1739, -13.799058], [14153, -13.800477], [799, -13.853587], [4638, -13.853894], [6785, -13.863893], [502, -13.875424], [1988, -13.904507], [12742, -13.934235], [7557, -13.949253], [26530, -13.957962], [120015, -13.973931], [120410, -14.000308], [127906, -14.034412], [1410, -14.037742], [900, -14.043211], [47, -14.052735], [4375, -14.107499], [923, -14.125753], [120001, -14.152622], [41514, -14.153921], [7331, -14.213807], [120099, -14.235914], [93457, -14.236806], [1744, -14.251618], [14188, -14.273541], [3755, -14.276635], [375, -14.319951], [2376, -14.366118], [777, -14.387081], [6000, -14.394408], [1776, -14.400055]], "logprob_of_token": -0.007592, "top1_top2_margin": 5.706876, "top6_top7_margin": 0.013109}, {"gen_index": 26, "token": 262, "top": [[262, -0.000332], [1744, -10.250504], [3326, -10.416061], [3142, -10.476535], [2213, -10.586518], [5445, -10.807884], [3737, -10.964205], [33341, -11.055441], [527, -11.540526], [669, -11.656471], [261, -11.93043], [5657, -12.080867], [15853, -12.611569], [735, -12.651155], [120007, -12.686261], [1435, -12.736035], [4484, -12.90521], [453, -12.92443], [1436, -12.998297], [11966, -13.079196], [21499, -13.103275], [900, -13.15242], [1806, -13.160625], [543, -13.432938], [1409, -13.4952], [2302, -13.51762], [1776, -13.525661], [1739, -13.558434], [4315, -13.565963], [565, -13.618238], [31642, -13.633467], [3918, -13.704093], [941, -13.708189], [7176, -13.818616], [1319, -13.833625], [120022, -13.867086], [938, -13.92234], [1862, -13.937051], [622, -13.986523], [1324, -14.00525], [3166, -14.008249], [286, -14.017695], [327, -14.079438], [762, -14.081373], [4205, -14.123055], [3327, -14.153416], [1656, -14.205815], [325, -14.217351], [27169, -14.299761], [2503, -14.355556], [346, -14.367556], [4731, -14.368434], [476, -14.374924], [597, -14.394842], [120410, -14.43155], [14394, -14.437273], [58742, -14.451761], [5190, -14.456274], [36836, -14.478687], [379, -14.525461], [1333, -14.587743], [919, -14.602093], [2403, -14.641985], [3713, -14.654872], [502, -14.666105], [468, -14.715642], [32, -14.716816], [851, -14.748112], [4743, -14.776916], [9162, -14.783995], [763, -14.785393], [1410, -14.806585], [19898, -14.814277], [18717, -14.960815], [936, -14.962659], [4314, -14.963636], [318, -14.965231], [9474, -14.967804], [8358, -14.993191], [1578, -15.010487], [310, -15.036821], [44, -15.052792], [120016, -15.061527], [8545, -15.070007], [2895, -15.075274], [2246, -15.079583], [279, -15.086285], [3550, -15.087855], [946, -15.088772], [115, -15.094633], [1275, -15.117778], [7510, -15.131003], [3892, -15.143993], [39523, -15.151962], [1765, -15.159872], [2307, -15.177582], [6564, -15.180078], [7107, -15.233571], [5071, -15.241325], [51988, -15.2507]], "logprob_of_token": -0.000332, "top1_top2_margin": 10.250172, "top6_top7_margin": 0.156321}, {"gen_index": 27, "token": 21499, "top": [[21499, -0.161431], [5995, -3.144601], [11527, -4.772936], [14795, -5.633736], [1460, -6.597935], [16719, -6.80688], [19866, -6.835342], [47805, -7.21894], [17392, -7.625453], [59199, -7.67903], [7852, -7.75895], [84254, -7.869611], [262, -7.967792], [10262, -8.04614], [33341, -8.112196], [4273, -8.167416], [3388, -8.181457], [5848, -8.187233], [11268, -8.22752], [527, -8.253678], [6900, -8.354233], [851, -8.355465], [36836, -8.440089], [34210, -8.449109], [4836, -8.454555], [8794, -8.45827], [6785, -8.460042], [2376, -8.462503], [5657, -8.462875], [9172, -8.532219], [3515, -8.545558], [115, -8.564672], [941, -8.600199], [15708, -8.642804], [9616, -8.654075], [14341, -8.664304], [14852, -8.665351], [6547, -8.681073], [286, -8.685421], [32, -8.687572], [41801, -8.707945], [6700, -8.71654], [8263, -8.728206], [873, -8.741951], [43211, -8.769014], [936, -8.793284], [12006, -8.797935], [4101, -8.842233], [30279, -8.867486], [18686, -8.871324], [735, -8.872411], [4205, -8.963887], [9501, -8.97128], [10461, -8.97575], [9089, -9.0213], [24775, -9.024251], [120007, -9.02506], [14321, -9.030232], [10520, -9.039544], [14805, -9.043835], [11309, -9.05542], [5032, -9.067198], [5274, -9.092039], [19898, -9.101989], [3713, -9.132246], [1305, -9.137036], [8506, -9.141533], [18174, -9.145569], [61599, -9.192534], [14803, -9.192669], [1409, -9.222824], [1427, -9.239773], [3937, -9.246563], [16785, -9.252905], [7193, -9.256972], [4850, -9.269237], [16320, -9.272704], [1625, -9.277338], [14233, -9.286445], [6789, -9.302695], [14950, -9.312095], [766, -9.31785], [14244, -9.351583], [622, -9.357487], [5660, -9.36086], [41436, -9.378044], [52634, -9.381986], [2377, -9.383421], [8275, -9.386442], [52331, -9.39026], [30971, -9.395218], [63, -9.409514], [14197, -9.418225], [26925, -9.423607], [124524, -9.442706], [7304, -9.450048], [46, -9.458162], [4758, -9.474906], [33611, -9.486169], [45089, -9.490994]], "logprob_of_token": -0.161431, "top1_top2_margin": 2.98317, "top6_top7_margin": 0.028462}, {"gen_index": 28, "token": 735, "top": [[735, -0.000173], [330, -11.274178], [5657, -11.325265], [824, -11.801607], [120007, -11.896514], [568, -11.958755], [18717, -12.08986], [1656, -12.261598], [476, -12.33791], [919, -12.448577], [439, -12.530341], [2459, -12.575373], [1309, -12.642815], [46, -13.022457], [18126, -13.052214], [1270, -13.082121], [622, -13.237507], [44, -13.289177], [8150, -13.489351], [63, -13.562681], [14896, -13.599108], [11577, -13.819056], [263, -13.840144], [286, -13.925182], [10794, -13.971255], [378, -14.009668], [73707, -14.043222], [58, -14.081894], [589, -14.101796], [7222, -14.123255], [127906, -14.191148], [21499, -14.214801], [20773, -14.251752], [13255, -14.300685], [115, -14.337698], [44102, -14.365219], [17714, -14.374102], [1064, -14.406422], [10, -14.407627], [120022, -14.416302], [528, -14.458139], [279, -14.486596], [32, -14.508068], [7017, -14.511034], [7510, -14.517679], [120410, -14.524203], [2286, -14.544166], [745, -14.546094], [49987, -14.58378], [18296, -14.585141], [1409, -14.585676], [310, -14.594172], [120670, -14.620046], [936, -14.66234], [7499, -14.666057], [766, -14.724558], [13248, -14.774594], [120000, -14.825272], [527, -14.838761], [617, -14.839295], [576, -14.841743], [11317, -14.854171], [502, -14.886253], [59, -14.924753], [120016, -14.953526], [4769, -14.964959], [20498, -14.972818], [34, -15.026774], [275, -15.03765], [4688, -15.0461], [1829, -15.10559], [14188, -15.123792], [37159, -15.14716], [379, -15.174538], [127655, -15.185168], [60478, -15.196148], [24348, -15.216785], [6172, -15.260079], [318, -15.288505], [4731, -15.323485], [405, -15.325943], [8157, -15.328023], [11910, -15.361813], [31445, -15.394416], [2492, -15.41197], [120625, -15.435493], [1275, -15.487127], [262, -15.497807], [5445, -15.50185], [4895, -15.512287], [20787, -15.520149], [1765, -15.524451], [2376, -15.528009], [25288, -15.529468], [1637, -15.568764], [941, -15.58042], [938, -15.592715], [49, -15.602564], [46952, -15.655052], [3311, -15.664387]], "logprob_of_token": -0.000173, "top1_top2_margin": 11.274004, "top6_top7_margin": 0.131104}, {"gen_index": 29, "token": 5657, "top": [[5657, -0.221017], [5445, -1.665033], [263, -7.613937], [11966, -7.787716], [502, -7.823319], [3548, -7.963493], [8640, -8.143938], [13248, -8.306778], [5190, -8.523151], [7017, -8.646082], [10321, -8.701418], [14394, -8.774284], [10, -8.797546], [2550, -8.954334], [3918, -9.092308], [735, -9.101685], [1410, -9.32111], [19898, -9.387529], [32, -9.390411], [10633, -9.400515], [26116, -9.412966], [70982, -9.58123], [2575, -9.582108], [38183, -9.672724], [79608, -9.710423], [21499, -9.712284], [31642, -9.78618], [4227, -9.806824], [8175, -9.837057], [262, -9.890079], [86466, -9.958317], [103838, -9.986004], [14905, -10.013926], [2944, -10.036682], [60605, -10.046923], [12248, -10.112612], [76301, -10.221704], [29182, -10.261051], [53796, -10.271994], [6044, -10.289526], [127274, -10.387896], [31752, -10.399794], [1095, -10.429352], [19897, -10.433479], [125789, -10.456581], [27169, -10.500231], [14705, -10.502169], [14994, -10.521412], [127906, -10.526493], [44102, -10.52775], [9162, -10.529167], [14590, -10.571005], [16235, -10.605043], [20151, -10.68111], [44, -10.689863], [4205, -10.694666], [3550, -10.71666], [17653, -10.740582], [33341, -10.772888], [7687, -10.783476], [120007, -10.793959], [1090, -10.816851], [2932, -10.832333], [7176, -10.836657], [7143, -10.844759], [10301, -10.847891], [3668, -10.898905], [120022, -10.950306], [1781, -10.961884], [900, -11.006893], [10787, -11.013735], [953, -11.018452], [8358, -11.092237], [2392, -11.09787], [5336, -11.126698], [51455, -11.132788], [30971, -11.134022], [19679, -11.156134], [2213, -11.16493], [13078, -11.198153], [18642, -11.208307], [2534, -11.253344], [2302, -11.285202], [10390, -11.291307], [1093, -11.291595], [24248, -11.292122], [4258, -11.311136], [1578, -11.317907], [6758, -11.33363], [949, -11.344088], [28943, -11.378927], [29307, -11.399315], [2478, -11.403992], [1409, -11.425863], [120016, -11.437214], [47576, -11.440575], [41964, -11.445683], [936, -11.445715], [941, -11.455162], [851, -11.462818]], "logprob_of_token": -0.221017, "top1_top2_margin": 1.444016, "top6_top7_margin": 0.180445}, {"gen_index": 30, "token": 46, "top": [[46, -0.001788], [275, -6.662164], [314, -7.949977], [286, -9.777364], [36209, -11.579667], [44, -11.782876], [63, -12.227355], [33, -12.471418], [4137, -12.568925], [10, -12.662465], [120007, -12.712359], [120230, -12.810319], [120099, -13.197602], [263, -13.234548], [120000, -13.405762], [543, -13.430453], [58, -13.484319], [59, -13.498656], [120001, -13.657731], [936, -13.667012], [120241, -13.83148], [766, -13.861428], [13594, -13.938046], [120078, -13.973308], [120399, -14.046866], [120016, -14.100991], [3545, -14.153104], [325, -14.169223], [44455, -14.171335], [49, -14.222725], [7510, -14.231425], [262, -14.331332], [1829, -14.359507], [93457, -14.392824], [120118, -14.481668], [310, -14.495028], [120002, -14.521994], [622, -14.56957], [5071, -14.623041], [120140, -14.759817], [420, -14.858506], [120050, -14.907453], [735, -14.935651], [1275, -14.945662], [127906, -14.963662], [327, -14.969914], [48, -15.001975], [32, -15.006348], [2213, -15.026246], [50, -15.087935], [120003, -15.130947], [745, -15.131133], [120020, -15.133807], [51, -15.150299], [120015, -15.169835], [120618, -15.172265], [26951, -15.201838], [379, -15.210129], [120068, -15.213779], [15853, -15.22409], [14188, -15.228167], [120021, -15.330884], [120100, -15.367555], [120064, -15.435543], [1093, -15.483558], [120347, -15.503757], [9289, -15.527464], [52, -15.547643], [121066, -15.63732], [123440, -15.641953], [279, -15.658511], [120031, -15.659191], [3711, -15.683629], [120063, -15.696572], [120360, -15.703006], [120277, -15.73327], [12611, -15.739552], [121617, -15.76333], [53, -15.771123], [779, -15.775773], [120048, -15.785165], [474, -15.791422], [467, -15.853632], [120208, -15.875531], [270, -15.927598], [120463, -15.969141], [318, -15.991498], [110358, -16.056229], [1776, -16.059881], [57, -16.151527], [121238, -16.158131], [120080, -16.165159], [120110, -16.227989], [763, -16.24295], [120059, -16.251234], [120214, -16.259441], [34, -16.25976], [11861, -16.262339], [1988, -16.26527], [47, -16.267679]], "logprob_of_token": -0.001788, "top1_top2_margin": 6.660375, "top6_top7_margin": 0.444479}, {"gen_index": 31, "token": 543, "top": [[543, -0.000246], [1047, -10.728359], [669, -10.905735], [1689, -11.057968], [766, -11.185217], [127906, -11.303445], [6693, -11.390425], [1580, -11.504668], [1231, -11.514707], [325, -12.051758], [1194, -12.324965], [120014, -12.352905], [717, -12.393972], [1336, -12.539038], [262, -12.604728], [611, -12.73678], [1438, -12.79294], [4759, -12.904186], [3780, -12.962028], [24775, -12.966686], [1988, -12.999019], [4954, -13.040632], [1914, -13.089991], [32, -13.101526], [2297, -13.288057], [2560, -13.296453], [1905, -13.368576], [5775, -13.391291], [7339, -13.487076], [523, -13.538457], [1692, -13.612604], [14161, -13.759092], [7098, -13.812542], [9643, -13.835907], [7510, -13.880877], [2284, -13.920401], [4246, -13.924631], [5438, -13.925035], [1829, -13.958096], [14188, -13.96154], [14896, -14.129124], [8009, -14.136985], [742, -14.271709], [127908, -14.282906], [8266, -14.299456], [120022, -14.334156], [120103, -14.345961], [4433, -14.353147], [6391, -14.47975], [576, -14.50267], [8067, -14.511127], [263, -14.580763], [1048, -14.588011], [13132, -14.593929], [15934, -14.619205], [14153, -14.632375], [19313, -14.656477], [8265, -14.658224], [5274, -14.662138], [1254, -14.697429], [120004, -14.753437], [6372, -14.788528], [13382, -14.794876], [6814, -14.836903], [14147, -14.838515], [3501, -14.847144], [9830, -14.87357], [9093, -14.949847], [6455, -15.015631], [42410, -15.03723], [7924, -15.053349], [28484, -15.073414], [7189, -15.076298], [127655, -15.08007], [5439, -15.091864], [5995, -15.099112], [2883, -15.130501], [3958, -15.136225], [946, -15.146676], [6336, -15.151854], [4888, -15.152682], [6143, -15.158997], [8307, -15.192928], [1433, -15.196672], [20486, -15.198519], [2865, -15.202285], [58965, -15.255779], [11935, -15.305027], [120001, -15.314173], [1220, -15.316712], [9485, -15.327307], [3463, -15.335249], [2291, -15.34629], [25071, -15.360898], [7302, -15.366965], [6530, -15.369392], [11268, -15.379597], [19710, -15.394955], [120087, -15.404325], [2743, -15.424038]], "logprob_of_token": -0.000246, "top1_top2_margin": 10.728113, "top6_top7_margin": 0.08698}]}, {"prompt": "Ein gutes Buch liest man am besten", "input_ids": [1113, 29597, 4363, 51092, 836, 10304, 9798], "generated_ids": [30135, 420, 30134, 46, 1496, 29597, 4363, 2459, 888, 922, 20263, 11794, 58, 5084, 46696, 7640, 13111, 14225, 1687, 45455, 2042, 46, 1496, 29597, 4363, 2459, 888, 922, 20263, 11794, 58, 5084], "rows": [{"gen_index": 0, "token": 30135, "top": [[30135, -1.095977], [622, -1.274363], [913, -2.290061], [44, -2.804624], [120007, -3.293723], [2150, -3.92182], [8066, -4.407973], [46, -4.482898], [939, -4.498896], [1233, -4.504972], [4299, -4.525717], [1409, -4.677046], [24439, -5.000513], [52970, -5.048901], [2625, -5.077458], [45623, -5.732415], [6216, -5.785768], [861, -5.802293], [7314, -6.016885], [2361, -6.067248], [275, -6.078217], [493, -6.110979], [39721, -6.11132], [1687, -6.193512], [63, -6.202098], [31985, -6.249182], [65702, -6.250835], [120016, -6.258525], [120022, -6.336586], [513, -6.541144], [30623, -6.600361], [10304, -6.639008], [5590, -6.702229], [5680, -6.762909], [745, -6.774389], [20758, -6.854609], [8077, -6.903383], [45594, -6.932104], [4610, -6.942875], [58, -6.997452], [14581, -7.070366], [2944, -7.137825], [29126, -7.13845], [120021, -7.178442], [15303, -7.203821], [1829, -7.234784], [55190, -7.259652], [3234, -7.266423], [32, -7.303702], [888, -7.309735], [314, -7.312848], [2424, -7.419675], [10666, -7.422512], [38033, -7.453313], [86066, -7.526815], [59, -7.580769], [2225, -7.6297], [3643, -7.647224], [1717, -7.7076], [28155, -7.71522], [15356, -7.72757], [11861, -7.766462], [9506, -7.783934], [26562, -7.803351], [5291, -7.813847], [30134, -7.828741], [2102, -7.852345], [14460, -7.865558], [5274, -7.878443], [10895, -7.890263], [14351, -7.979634], [1489, -8.022499], [420, -8.063095], [54183, -8.180265], [41537, -8.208409], [5632, -8.212258], [1803, -8.264033], [4336, -8.281566], [48802, -8.315744], [10, -8.322993], [11178, -8.375121], [14265, -8.411204], [9881, -8.499557], [1953, -8.510067], [3154, -8.514455], [104824, -8.519185], [30512, -8.533842], [614, -8.566948], [14218, -8.594951], [263, -8.651512], [4561, -8.667869], [1573, -8.681085], [922, -8.686469], [1521, -8.757503], [4703, -8.758882], [74166, -8.786904], [14188, -8.810697], [120103, -8.81321], [15205, -8.813236], [46738, -8.876863]], "logprob_of_token": -1.095977, "top1_top2_margin": 0.178386, "top6_top7_margin": 0.486154}, {"gen_index": 1, "token": 420, "top": [[420, -0.962737], [46, -1.247078], [44, -1.92484], [275, -2.806192], [1829, -3.182425], [314, -3.457553], [58, -4.233252], [120007, -4.707757], [14188, -5.119944], [59, -5.713776], [10, -6.261904], [263, -6.461124], [120016, -6.693883], [913, -6.717936], [63, -6.987771], [14153, -7.037428], [861, -7.547585], [120022, -7.550669], [766, -7.566208], [120021, -7.599588], [120000, -7.798491], [20758, -7.810828], [745, -7.859394], [21667, -7.958926], [656, -8.201205], [988, -8.39982], [21689, -8.611911], [1117, -8.6374], [121304, -8.65424], [70765, -8.83712], [11861, -8.841568], [1687, -9.021617], [1062, -9.032655], [2361, -9.044473], [622, -9.088885], [51092, -9.104468], [33, -9.192324], [493, -9.205699], [30135, -9.298703], [1043, -9.394218], [27532, -9.423079], [2102, -9.429207], [120103, -9.48034], [14576, -9.50854], [120008, -9.518607], [3504, -9.548125], [120001, -9.616343], [7865, -9.636804], [32, -9.644347], [120214, -9.71872], [2150, -9.719224], [36209, -9.751494], [121638, -9.756188], [120410, -9.760619], [1521, -9.763063], [69555, -9.76647], [14179, -9.858643], [120359, -9.882184], [120468, -9.957381], [120002, -10.021763], [405, -10.05022], [45, -10.056709], [120087, -10.07655], [1953, -10.201591], [15943, -10.217083], [2625, -10.230882], [4137, -10.234394], [120028, -10.247343], [576, -10.256538], [2362, -10.292278], [614, -10.344115], [513, -10.36044], [12698, -10.374075], [114168, -10.41831], [120003, -10.48744], [34, -10.499825], [120118, -10.517191], [460, -10.537616], [3643, -10.557865], [64337, -10.558483], [10304, -10.578429], [122158, -10.652462], [922, -10.670662], [120004, -10.720384], [26071, -10.740788], [2519, -10.780941], [286, -10.802365], [284, -10.822195], [7314, -10.908513], [4299, -10.911361], [120098, -10.919667], [5274, -10.938386], [2156, -10.938663], [8066, -10.96992], [346, -11.000545], [120006, -11.010551], [30134, -11.023417], [47, -11.036601], [121119, -11.03992], [1489, -11.099401]], "logprob_of_token": -0.962737, "top1_top2_margin": 0.284341, "top6_top7_margin": 0.775699}, {"gen_index": 2, "token": 30134, "top": [[30134, -0.745654], [913, -1.172468], [622, -3.120382], [29126, -3.14241], [4299, -4.205833], [68909, -4.43649], [14515, -4.638491], [63061, -4.662918], [41537, -4.969621], [26562, -5.302606], [114838, -5.32542], [7314, -5.415207], [107920, -5.575412], [55480, -5.594761], [61212, -6.018938], [9352, -6.068929], [75682, -6.230556], [353, -6.391031], [30135, -6.391475], [45623, -6.410056], [8066, -6.410898], [15205, -6.456719], [36702, -6.474905], [32, -6.48095], [11178, -6.517113], [31985, -6.681143], [45202, -6.769794], [53260, -6.810641], [30623, -6.973631], [41196, -7.056591], [37720, -7.233751], [23976, -7.255596], [19987, -7.262597], [108423, -7.294765], [939, -7.391852], [45594, -7.459248], [6501, -7.468733], [1826, -7.549867], [1489, -7.674898], [968, -7.749874], [55108, -7.754801], [112499, -7.766417], [26735, -7.789839], [39721, -7.804242], [104824, -7.940208], [30864, -7.956793], [861, -7.964502], [73037, -7.985775], [1687, -8.109283], [2150, -8.162006], [2156, -8.174589], [20311, -8.345003], [19375, -8.446258], [2459, -8.459691], [12518, -8.470226], [113959, -8.509378], [65702, -8.521518], [5222, -8.573462], [2944, -8.607385], [2120, -8.693065], [14462, -8.702819], [2225, -8.711423], [18262, -8.712778], [77285, -8.724541], [15298, -8.728124], [37795, -8.729095], [614, -8.746898], [9881, -8.75851], [10304, -8.799562], [112546, -8.826451], [5680, -8.827155], [2424, -8.866404], [32608, -8.949064], [14154, -8.971725], [24439, -8.984419], [14581, -9.024217], [30003, -9.062599], [41226, -9.087575], [112600, -9.113244], [1233, -9.145164], [41655, -9.147129], [94773, -9.153733], [120007, -9.170974], [40015, -9.176293], [33743, -9.195548], [836, -9.201264], [3234, -9.201955], [14671, -9.203361], [16992, -9.215307], [34291, -9.239197], [8647, -9.285951], [9115, -9.306393], [57529, -9.309856], [34678, -9.342995], [50345, -9.401433], [124493, -9.413932], [102800, -9.445622], [16069, -9.449704], [29740, -9.470911], [27112, -9.479239]], "logprob_of_token": -0.745654, "top1_top2_margin": 0.426814, "top6_top7_margin": 0.202001}, {"gen_index": 3, "token": 46, "top": [[46, -0.4349], [44, -1.891773], [275, -2.259102], [1829, -3.451126], [314, -3.491108], [59, -4.126435], [420, -5.540307], [14188, -5.739197], [120007, -5.939264], [58, -6.495338], [913, -7.238969], [14153, -7.659995], [120016, -7.689079], [63, -7.802982], [10, -7.840199], [263, -8.033867], [120000, -8.266062], [493, -8.295033], [766, -8.692103], [37206, -8.960269], [513, -9.063416], [120021, -9.089893], [21667, -9.178754], [30134, -9.303999], [10367, -9.312901], [745, -9.415676], [120022, -9.442802], [27532, -9.467371], [861, -9.467947], [622, -9.476933], [988, -9.48889], [20758, -9.511724], [21689, -9.529412], [51092, -9.652673], [2625, -9.706623], [70765, -9.832382], [14179, -9.906012], [121304, -9.956984], [11861, -10.067728], [1521, -10.128384], [120359, -10.179683], [4370, -10.213028], [656, -10.222526], [4299, -10.269875], [1117, -10.277211], [36209, -10.305061], [4137, -10.310011], [120001, -10.438995], [33, -10.448646], [10304, -10.510117], [121638, -10.51013], [32, -10.513639], [120214, -10.518519], [1062, -10.523718], [1043, -10.551711], [115, -10.55287], [888, -10.569989], [45, -10.626106], [284, -10.675795], [346, -10.722039], [120002, -10.77736], [120008, -10.785135], [405, -10.789238], [120103, -10.793452], [69555, -10.83531], [4561, -10.841749], [1917, -10.890496], [1687, -10.908632], [614, -10.92153], [2150, -10.927708], [3643, -10.931911], [92487, -10.961007], [120118, -11.016187], [8066, -11.094816], [120468, -11.096346], [6606, -11.133101], [120410, -11.144974], [30135, -11.145298], [125259, -11.151721], [7314, -11.167946], [120028, -11.178536], [114168, -11.198744], [120003, -11.208096], [922, -11.269411], [2156, -11.368828], [2361, -11.381771], [2459, -11.395027], [2225, -11.396015], [122158, -11.421413], [26951, -11.429073], [120399, -11.433134], [121119, -11.459498], [1233, -11.513424], [4336, -11.515671], [518, -11.518625], [5632, -11.589138], [14576, -11.610405], [2102, -11.62196], [576, -11.665497], [13594, -11.67434]], "logprob_of_token": -0.4349, "top1_top2_margin": 1.456873, "top6_top7_margin": 1.413872}, {"gen_index": 4, "token": 1496, "top": [[1496, -1.647903], [3280, -1.851398], [2896, -1.946246], [5084, -2.559806], [5289, -2.767016], [6336, -3.210677], [10694, -3.499802], [2297, -3.578717], [33573, -3.668561], [1438, -3.861048], [1220, -4.04422], [16242, -4.206123], [120014, -4.480597], [2121, -4.51034], [15369, -4.701328], [44871, -4.770893], [1047, -4.829368], [30421, -4.96323], [10438, -5.130864], [29181, -5.225635], [27532, -5.428893], [97170, -5.51454], [9783, -5.614985], [34121, -5.785444], [16335, -5.866526], [38985, -5.912925], [18855, -5.993757], [1911, -6.120588], [26225, -6.145827], [30762, -6.28264], [120004, -6.344352], [61335, -6.408159], [10755, -6.426934], [717, -6.437939], [9961, -6.474111], [2447, -6.52393], [15650, -6.536714], [7779, -6.537868], [20974, -6.571005], [50551, -6.620936], [3343, -6.637429], [19787, -6.68306], [15794, -6.726147], [7227, -6.734504], [20658, -6.735072], [21734, -6.770688], [7865, -6.771328], [9103, -6.775355], [1864, -6.896739], [1914, -6.93759], [3365, -6.958948], [96740, -6.984174], [69439, -6.987113], [4246, -7.024675], [54076, -7.037253], [3417, -7.066768], [32, -7.079255], [31155, -7.087885], [946, -7.16528], [32816, -7.171048], [43298, -7.205885], [14147, -7.281569], [13819, -7.313893], [127713, -7.315182], [28484, -7.315265], [24742, -7.35654], [33246, -7.399084], [11541, -7.405299], [1829, -7.428818], [12698, -7.509892], [60135, -7.546284], [4363, -7.560776], [2186, -7.564201], [75443, -7.571694], [110090, -7.612044], [5274, -7.639031], [559, -7.66216], [47985, -7.749974], [118988, -7.774036], [3613, -7.798379], [10881, -7.799725], [83644, -7.813408], [766, -7.850106], [28870, -7.868853], [9031, -7.892705], [46037, -7.935701], [125525, -8.082211], [120103, -8.083577], [17632, -8.087243], [13420, -8.135818], [25637, -8.140253], [1196, -8.218022], [2412, -8.227761], [36735, -8.260882], [9149, -8.274545], [953, -8.287226], [44682, -8.291342], [120022, -8.304805], [5412, -8.343743], [89905, -8.349555]], "logprob_of_token": -1.647903, "top1_top2_margin": 0.203495, "top6_top7_margin": 0.289125}, {"gen_index": 5, "token": 29597, "top": [[29597, -1.003155], [4363, -1.859575], [6290, -1.95083], [20263, -2.231907], [126713, -3.438337], [125733, -4.247484], [76183, -4.52026], [11556, -4.837044], [64544, -4.844225], [29566, -4.963085], [69939, -5.010189], [71506, -5.117755], [37669, -5.383876], [4835, -5.49349], [112499, -5.691274], [48692, -5.861094], [66604, -5.916255], [8747, -6.096979], [9115, -6.121302], [104683, -6.140302], [65813, -6.220593], [69735, -6.278316], [94773, -6.439561], [115531, -6.499222], [9024, -6.522823], [61082, -6.620897], [39940, -6.648187], [37857, -6.664644], [69191, -6.718293], [76298, -6.718989], [46885, -6.739883], [13819, -6.755569], [35119, -6.759105], [90098, -6.762591], [73771, -6.792257], [69370, -6.793601], [79104, -6.826068], [28882, -6.826214], [5162, -6.874111], [5222, -6.897767], [51321, -6.918651], [56937, -6.938007], [32, -6.960243], [15298, -7.002226], [96154, -7.013963], [52088, -7.074734], [48802, -7.142735], [27693, -7.182985], [35126, -7.204577], [23174, -7.214475], [107837, -7.257336], [10824, -7.258661], [24665, -7.259681], [17632, -7.261616], [37091, -7.278415], [55507, -7.296672], [5052, -7.325676], [39040, -7.326445], [29553, -7.351401], [44197, -7.410518], [9710, -7.411767], [13663, -7.468954], [81335, -7.519211], [29065, -7.536311], [8066, -7.55358], [9683, -7.564167], [26258, -7.626759], [6776, -7.635656], [22745, -7.659539], [32655, -7.699799], [16952, -7.704478], [70710, -7.710032], [18118, -7.714606], [122907, -7.71901], [35146, -7.721009], [70223, -7.72302], [2150, -7.730566], [66539, -7.745065], [99697, -7.778178], [56155, -7.785148], [7668, -7.789792], [38275, -7.804867], [32768, -7.805635], [2114, -7.830246], [23306, -7.833156], [68924, -7.836571], [18799, -7.861916], [40670, -7.890602], [90112, -7.909009], [20478, -7.913088], [73232, -7.919178], [19228, -7.937355], [861, -7.938525], [36509, -7.967567], [37670, -7.991481], [96507, -8.032086], [4858, -8.035556], [1409, -8.035941], [49992, -8.036847], [3891, -8.101069]], "logprob_of_token": -1.003155, "top1_top2_margin": 0.85642, "top6_top7_margin": 0.272777}, {"gen_index": 6, "token": 4363, "top": [[4363, -0.08655], [6896, -3.506411], [22580, -4.491693], [65813, -4.810146], [37669, -5.14441], [35774, -6.549375], [1618, -6.638445], [107837, -6.758437], [29597, -6.81607], [9515, -6.965611], [3891, -7.012058], [27532, -7.22574], [3717, -7.229148], [5052, -7.488514], [58951, -7.582225], [69191, -7.643059], [7430, -7.65884], [73137, -7.691411], [12324, -7.749296], [9024, -7.752974], [5474, -7.901827], [34001, -7.93392], [33070, -8.046401], [8165, -8.071503], [15209, -8.137447], [18470, -8.206135], [11794, -8.247843], [5622, -8.310506], [31155, -8.370565], [63656, -8.418972], [11090, -8.446548], [13663, -8.50808], [118565, -8.670633], [61341, -8.750781], [59324, -8.771904], [36158, -8.791714], [17632, -8.804823], [1252, -8.820932], [15061, -8.837817], [12496, -8.843361], [104600, -8.855021], [13819, -8.885955], [43792, -8.88847], [82265, -8.896252], [18162, -8.973089], [3577, -9.034433], [6423, -9.04184], [15162, -9.075128], [12698, -9.08184], [42157, -9.108498], [19647, -9.123013], [66250, -9.150492], [48299, -9.157389], [9386, -9.162943], [17899, -9.20475], [10326, -9.233181], [37665, -9.23557], [33154, -9.243013], [32139, -9.363365], [34197, -9.403566], [8854, -9.40395], [79344, -9.416666], [16242, -9.438028], [104683, -9.449177], [41400, -9.454185], [93687, -9.461478], [7588, -9.496246], [24434, -9.49859], [4668, -9.498631], [15018, -9.519405], [10580, -9.622665], [47279, -9.623371], [82880, -9.660231], [41074, -9.66149], [3241, -9.683452], [51216, -9.694366], [22547, -9.704797], [31032, -9.712427], [20263, -9.730931], [29124, -9.731092], [15955, -9.741477], [44, -9.744148], [87144, -9.781429], [2294, -9.786917], [19903, -9.793648], [45255, -9.798769], [5710, -9.821697], [16377, -9.834958], [37247, -9.838386], [40670, -9.843147], [60456, -9.852891], [6290, -9.878948], [8429, -9.88571], [16391, -9.92263], [24229, -9.962151], [43892, -10.015808], [23413, -10.034671], [8326, -10.042313], [114910, -10.074397], [5721, -10.107721]], "logprob_of_token": -0.08655, "top1_top2_margin": 3.419861, "top6_top7_margin": 0.08907}, {"gen_index": 7, "token": 2459, "top": [[2459, -2.121226], [51092, -2.152787], [2790, -2.341031], [14515, -2.974497], [1826, -2.988943], [12364, -3.028864], [2941, -3.315791], [48551, -3.392516], [24699, -3.467221], [6501, -3.476771], [98839, -3.742655], [968, -3.814537], [6326, -3.840745], [23097, -4.069673], [27076, -4.470532], [28757, -4.505568], [11757, -4.687408], [54545, -4.709166], [6727, -4.727701], [2156, -4.774419], [77285, -4.780273], [24113, -4.787522], [14016, -4.888543], [16069, -4.960803], [2621, -4.96081], [18988, -5.139403], [12518, -5.158359], [26735, -5.222494], [21794, -5.27023], [20507, -5.306735], [27112, -5.317592], [44, -5.35903], [118595, -5.402412], [41655, -5.405298], [62157, -5.441409], [57529, -5.446063], [18579, -5.457566], [679, -5.45967], [513, -5.461878], [439, -5.479018], [96010, -5.488993], [76399, -5.595085], [38305, -5.658336], [75606, -5.703524], [23976, -5.76652], [126879, -5.772161], [53031, -5.79626], [24413, -5.969572], [16637, -5.978812], [46696, -6.036295], [16253, -6.048282], [39027, -6.090031], [11554, -6.116039], [53260, -6.157956], [47923, -6.169513], [79317, -6.2154], [24309, -6.229316], [41951, -6.250577], [54795, -6.279808], [117620, -6.282283], [44615, -6.410974], [13634, -6.509372], [56277, -6.511134], [13891, -6.538949], [1863, -6.597764], [21962, -6.605454], [41835, -6.611261], [53013, -6.689778], [5057, -6.715676], [36525, -6.730193], [7315, -6.763094], [85982, -6.817228], [76048, -6.872025], [34517, -6.872934], [37342, -6.889933], [38362, -6.921849], [24717, -7.008697], [102469, -7.145662], [20761, -7.180074], [32, -7.194703], [14878, -7.256186], [20584, -7.263376], [19500, -7.272357], [11942, -7.3173], [36101, -7.325222], [91658, -7.354865], [75682, -7.379338], [19779, -7.476268], [16169, -7.514962], [71781, -7.560069], [71214, -7.567148], [18134, -7.575715], [93946, -7.642347], [18915, -7.660599], [67612, -7.668633], [14977, -7.680858], [23215, -7.687738], [6596, -7.689103], [50345, -7.697804], [70048, -7.701063]], "logprob_of_token": -2.121226, "top1_top2_margin": 0.031561, "top6_top7_margin": 0.286926}, {"gen_index": 8, "token": 888, "top": [[888, -0.381317], [922, -1.925264], [939, -3.494348], [699, -3.623163], [41769, -3.827056], [18830, -4.520531], [6843, -4.747281], [7314, -4.965014], [614, -5.250383], [14581, -5.261433], [21034, -5.681751], [9277, -5.69166], [1195, -5.826718], [5222, -5.978801], [1409, -6.091503], [1006, -6.142214], [3504, -6.241872], [3514, -6.255967], [5276, -6.33311], [14154, -6.428274], [518, -6.614161], [346, -6.64727], [10304, -6.75604], [6606, -6.948063], [75642, -6.999283], [44, -7.016587], [3234, -7.067177], [14357, -7.175082], [622, -7.289648], [37206, -7.364714], [8032, -7.428127], [1627, -7.497541], [17090, -7.527143], [948, -7.578169], [61212, -7.585539], [14240, -7.615104], [1410, -7.642193], [28724, -7.713514], [836, -7.761442], [17117, -7.785048], [18324, -7.79677], [39685, -7.866988], [5680, -7.942415], [14543, -7.966054], [14649, -7.99361], [14573, -8.092916], [14542, -8.128722], [1151, -8.135589], [26562, -8.202007], [1803, -8.21316], [14276, -8.299313], [2361, -8.376549], [861, -8.459255], [46203, -8.46713], [7799, -8.609875], [36821, -8.644732], [34402, -8.664827], [4245, -8.745512], [30560, -8.751253], [7226, -8.758679], [18967, -8.792314], [6105, -8.812414], [8747, -8.89355], [13560, -8.902718], [12579, -8.908656], [2625, -8.921312], [18198, -8.97011], [33990, -8.98805], [17424, -9.023256], [23474, -9.026087], [47581, -9.042898], [2120, -9.100317], [14225, -9.185544], [5152, -9.211409], [3502, -9.248068], [8077, -9.263435], [15845, -9.314996], [1853, -9.344068], [58343, -9.351704], [14994, -9.356717], [14625, -9.357643], [30135, -9.367378], [13638, -9.368075], [36624, -9.394409], [51380, -9.397545], [1097, -9.437202], [3916, -9.477219], [14566, -9.501823], [29331, -9.528187], [20812, -9.53214], [31985, -9.540401], [6587, -9.54904], [9881, -9.554495], [6089, -9.57963], [37857, -9.585746], [20458, -9.66928], [4703, -9.67953], [65702, -9.696516], [120007, -9.701499], [15900, -9.72886]], "logprob_of_token": -0.381317, "top1_top2_margin": 1.543946, "top6_top7_margin": 0.22675}, {"gen_index": 9, "token": 922, "top": [[922, -0.029767], [699, -3.583387], [14286, -8.140334], [29597, -8.572018], [346, -8.689567], [518, -8.75328], [3717, -8.768528], [20263, -9.727784], [948, -9.937635], [120007, -10.435138], [1241, -10.48592], [12567, -11.160611], [3090, -11.163033], [5222, -11.178633], [11536, -11.182128], [25406, -11.414458], [888, -11.452197], [11794, -11.626412], [32139, -11.640414], [8032, -11.660736], [22676, -11.84195], [16925, -11.854927], [6843, -11.965053], [9067, -12.246316], [13902, -12.348298], [31511, -12.354247], [23419, -12.411916], [18582, -12.538609], [16838, -12.561433], [120016, -12.716726], [1195, -12.721418], [52114, -12.732425], [120022, -12.771779], [2042, -12.816875], [7629, -12.835875], [622, -12.840697], [4771, -12.841296], [11090, -12.897716], [12905, -12.928029], [26421, -13.03405], [22580, -13.044446], [120410, -13.059275], [1151, -13.09036], [8608, -13.123496], [22188, -13.123797], [13732, -13.144933], [40203, -13.157226], [29481, -13.235478], [20421, -13.299833], [21262, -13.316266], [3579, -13.330071], [7072, -13.338128], [4657, -13.394596], [32816, -13.397824], [43773, -13.399363], [4269, -13.407557], [11637, -13.437005], [1097, -13.447757], [15955, -13.458704], [1496, -13.474055], [65702, -13.494254], [4938, -13.553746], [4254, -13.570165], [41769, -13.583627], [10492, -13.599068], [2260, -13.623279], [11226, -13.635888], [14783, -13.65227], [61335, -13.656844], [6896, -13.663171], [27430, -13.676242], [33415, -13.71861], [745, -13.76747], [2625, -13.848481], [7462, -13.849159], [17647, -13.888915], [614, -13.945992], [75716, -13.949145], [836, -13.982105], [9726, -13.985124], [16479, -13.985188], [31991, -13.998877], [84260, -14.008458], [10447, -14.010449], [1044, -14.021307], [3514, -14.084533], [2796, -14.09534], [13635, -14.125492], [62499, -14.128919], [16377, -14.135137], [14462, -14.141804], [1953, -14.149407], [1233, -14.14991], [26805, -14.154052], [7799, -14.15742], [9277, -14.162564], [15343, -14.171361], [18908, -14.177507], [16220, -14.208036], [3916, -14.211696]], "logprob_of_token": -0.029767, "top1_top2_margin": 3.553619, "top6_top7_margin": 0.015248}, {"gen_index": 10, "token": 20263, "top": [[20263, -0.401089], [9067, -2.464873], [29597, -2.556331], [8846, -3.366534], [6896, -3.818623], [65685, -4.151031], [11869, -4.350523], [23419, -4.578087], [26421, -5.034663], [33415, -5.122456], [30758, -5.492136], [94846, -5.950931], [49992, -5.962269], [21832, -5.990944], [11090, -6.050263], [15209, -6.118112], [63714, -6.388236], [24736, -6.418622], [56937, -6.606737], [52088, -6.616362], [87755, -6.723071], [2944, -6.808259], [5222, -6.955326], [3364, -6.964981], [9273, -7.02555], [48802, -7.172678], [92748, -7.198825], [118960, -7.238575], [11794, -7.3566], [64544, -7.490603], [14286, -7.624446], [25948, -7.674336], [13844, -7.694614], [17899, -7.812967], [22676, -7.863671], [115531, -7.879945], [15550, -7.893044], [23052, -7.89964], [47099, -8.016408], [12184, -8.180265], [110792, -8.192472], [17512, -8.196272], [21496, -8.229117], [29824, -8.268132], [93872, -8.309026], [91469, -8.405702], [33225, -8.439262], [38275, -8.461267], [11208, -8.48847], [3717, -8.505651], [38605, -8.56156], [24653, -8.606769], [112499, -8.615411], [14462, -8.617083], [41400, -8.619579], [105126, -8.629592], [108281, -8.646397], [63656, -8.656755], [19903, -8.748654], [91660, -8.754964], [116336, -8.759203], [50240, -8.769053], [1618, -8.79081], [25406, -8.817908], [22745, -8.820524], [37670, -8.834371], [71154, -8.838597], [16486, -8.867933], [36286, -8.916132], [15388, -8.92475], [4835, -8.930327], [37669, -8.952745], [87612, -8.977345], [43773, -8.992618], [63547, -9.030184], [48079, -9.047049], [35774, -9.069813], [69370, -9.072288], [84419, -9.082523], [22188, -9.08585], [26805, -9.106219], [17471, -9.117957], [5052, -9.136263], [11041, -9.142405], [47704, -9.190782], [56336, -9.191287], [15482, -9.2349], [75382, -9.242383], [14847, -9.244827], [10975, -9.251249], [26562, -9.25169], [29331, -9.255779], [7879, -9.268621], [31212, -9.285069], [68307, -9.299664], [4846, -9.347058], [69724, -9.37373], [61082, -9.389463], [50665, -9.392276], [96463, -9.401981]], "logprob_of_token": -0.401089, "top1_top2_margin": 2.063784, "top6_top7_margin": 0.199492}, {"gen_index": 11, "token": 11794, "top": [[11794, -0.728322], [9067, -0.753716], [8846, -4.67305], [63714, -4.863142], [5052, -5.651232], [30758, -5.885561], [15955, -5.911885], [9273, -6.20465], [29824, -6.337206], [37670, -6.507321], [24736, -6.602197], [11869, -6.92179], [15388, -6.993217], [17512, -7.012269], [19903, -7.033822], [6896, -7.341524], [63656, -7.710388], [26421, -7.784844], [25948, -8.037474], [55397, -8.077099], [12184, -8.161999], [13844, -8.216717], [2578, -8.409142], [18448, -8.583849], [21774, -8.62681], [74169, -8.755516], [16952, -8.840433], [16236, -8.891947], [6003, -8.900288], [17718, -8.967741], [12567, -9.036501], [35449, -9.074371], [31212, -9.110792], [23053, -9.161333], [20263, -9.166857], [16811, -9.338146], [12909, -9.349407], [4846, -9.353313], [32164, -9.367567], [18011, -9.424488], [68291, -9.454617], [3717, -9.553185], [14742, -9.557217], [28089, -9.576956], [2171, -9.5788], [15162, -9.637184], [57729, -9.673372], [27644, -9.685804], [5213, -9.762238], [18797, -9.76495], [30069, -9.825085], [62303, -9.842861], [6565, -9.871721], [32645, -9.8811], [96011, -9.907522], [7181, -9.908842], [51341, -9.943001], [10975, -9.944645], [5906, -9.956795], [23052, -9.968605], [72053, -9.980213], [83885, -9.986486], [933, -9.999699], [32104, -10.015123], [20688, -10.06505], [93872, -10.20134], [3364, -10.230515], [25406, -10.285999], [50773, -10.29114], [73185, -10.358814], [43537, -10.378729], [17382, -10.378885], [34427, -10.382229], [22580, -10.462563], [17485, -10.501652], [28277, -10.504496], [91660, -10.509295], [45609, -10.512047], [15508, -10.607559], [18203, -10.658518], [83726, -10.669918], [5928, -10.677567], [40794, -10.68354], [59543, -10.764009], [16695, -10.789375], [6363, -10.803175], [73333, -10.815918], [49544, -10.842119], [9710, -10.843111], [90378, -10.853888], [2975, -10.862986], [11041, -10.866434], [4254, -10.888269], [117147, -10.908791], [32001, -10.914633], [22676, -10.916952], [27921, -10.926985], [11208, -10.949465], [11059, -10.954052], [25651, -11.016712]], "logprob_of_token": -0.728322, "top1_top2_margin": 0.025394, "top6_top7_margin": 0.026323}, {"gen_index": 12, "token": 58, "top": [[58, -0.232321], [1829, -2.182384], [44, -2.743615], [14188, -4.387433], [46, -5.634895], [59, -5.720618], [120007, -6.168305], [14153, -6.247333], [63, -6.466192], [1117, -6.649099], [275, -8.511683], [420, -8.536703], [405, -8.673689], [10304, -8.744548], [30989, -8.817015], [51248, -8.953009], [120022, -9.046625], [14179, -9.403498], [32, -9.44696], [922, -9.570946], [745, -9.657503], [5222, -9.740574], [14154, -9.744739], [2459, -9.768078], [20758, -9.77538], [1953, -9.818668], [314, -9.854715], [120006, -10.067347], [766, -10.071653], [913, -10.218999], [120016, -10.317225], [939, -10.408873], [14168, -10.502896], [377, -10.537881], [679, -10.658561], [836, -10.669073], [92603, -10.715641], [18988, -10.743482], [699, -10.766381], [45, -10.76815], [656, -10.779909], [1826, -10.86095], [1803, -10.895798], [1062, -10.914345], [2625, -11.018644], [518, -11.022766], [95033, -11.065636], [948, -11.067597], [65067, -11.112482], [614, -11.137815], [87495, -11.139036], [346, -11.164425], [55480, -11.213001], [30135, -11.226889], [622, -11.291597], [8066, -11.295417], [120021, -11.30014], [1195, -11.35843], [120008, -11.376724], [33, -11.411173], [46696, -11.424526], [1043, -11.435728], [63696, -11.463456], [32099, -11.46747], [125259, -11.511457], [24646, -11.519764], [968, -11.540302], [41769, -11.548237], [12960, -11.553968], [2120, -11.653227], [21034, -11.707278], [120410, -11.709895], [10, -11.720373], [6326, -11.721422], [24113, -11.798289], [7314, -11.803454], [18830, -11.819918], [40490, -11.85782], [3288, -11.865427], [120018, -11.90113], [31650, -11.906934], [263, -11.915865], [34589, -11.928545], [50492, -11.99461], [109147, -12.001974], [1233, -12.011515], [2790, -12.015713], [4835, -12.017475], [8747, -12.022186], [3688, -12.037947], [732, -12.046597], [36225, -12.051924], [12518, -12.057602], [41047, -12.10103], [1231, -12.108198], [2338, -12.167266], [24866, -12.19991], [2256, -12.207172], [46789, -12.23217], [20263, -12.244329]], "logprob_of_token": -0.232321, "top1_top2_margin": 1.950063, "top6_top7_margin": 0.447687}, {"gen_index": 13, "token": 5084, "top": [[5084, -0.718953], [14154, -1.524572], [2896, -1.897486], [836, -2.137821], [1415, -5.273301], [13166, -5.780679], [3280, -5.794703], [14168, -6.458515], [3408, -6.551497], [5289, -6.587763], [15357, -6.811207], [2225, -7.438234], [17912, -7.473056], [85539, -7.771545], [525, -7.796344], [922, -7.849111], [2297, -7.945866], [1047, -7.975468], [34121, -7.998033], [1496, -8.110212], [5222, -8.35535], [85490, -8.484239], [44871, -8.509044], [559, -8.576813], [14225, -8.76023], [1911, -9.038361], [10304, -9.10171], [346, -9.176974], [32, -9.184031], [31438, -9.273981], [2445, -9.297935], [20974, -9.34453], [30135, -9.372329], [35212, -9.404912], [2260, -9.416005], [13638, -9.464326], [1438, -9.481704], [4299, -9.5033], [12609, -9.530478], [18571, -9.578092], [2796, -9.599239], [21734, -9.648567], [6567, -9.651675], [20658, -9.65582], [948, -9.705773], [15123, -9.770509], [16335, -9.896616], [46789, -10.01098], [36821, -10.035293], [518, -10.09164], [23053, -10.106712], [939, -10.107762], [1195, -10.108295], [913, -10.129411], [120022, -10.151912], [2120, -10.214314], [6336, -10.279822], [17600, -10.337846], [840, -10.374592], [2042, -10.402865], [20812, -10.475987], [41769, -10.481806], [1864, -10.505528], [1220, -10.552341], [699, -10.563695], [9031, -10.609652], [14357, -10.615087], [717, -10.616099], [1829, -10.61669], [11541, -10.662256], [12960, -10.663004], [20758, -10.679306], [43159, -10.723488], [2121, -10.728526], [11794, -10.744933], [49127, -10.750789], [2256, -10.804411], [14649, -10.812652], [32816, -10.832141], [33573, -10.841095], [2186, -10.862519], [18830, -10.87181], [18967, -10.887834], [21034, -10.904416], [3239, -10.908046], [4336, -10.944114], [1231, -10.962577], [2625, -10.963156], [15369, -11.050808], [3417, -11.071238], [1687, -11.087625], [43298, -11.16376], [91226, -11.194156], [120007, -11.216234], [60135, -11.232865], [39685, -11.271544], [1803, -11.276546], [26562, -11.293953], [2150, -11.331381], [78199, -11.348055]], "logprob_of_token": -0.718953, "top1_top2_margin": 0.805618, "top6_top7_margin": 0.014025}, {"gen_index": 14, "token": 46696, "top": [[46696, -0.346976], [18988, -2.075233], [679, -3.326423], [6326, -3.933477], [732, -4.100457], [2790, -4.558942], [968, -4.605765], [1826, -4.918945], [54545, -4.958014], [51248, -5.139386], [44615, -5.274722], [96010, -5.296481], [14429, -5.424921], [24113, -5.463495], [2941, -6.048947], [35852, -6.236918], [13634, -6.309664], [56277, -6.32164], [14515, -6.344773], [2621, -6.426322], [18579, -6.897731], [16253, -6.981083], [2459, -7.085072], [2156, -7.147279], [12364, -7.203263], [24309, -7.258891], [11398, -7.299664], [117620, -7.365222], [6501, -7.375101], [12518, -7.3798], [118595, -7.390042], [28217, -7.527434], [36525, -7.530571], [32, -7.541907], [1863, -7.54346], [24528, -7.62752], [40490, -7.757901], [13891, -7.776787], [55480, -7.783665], [19500, -7.796619], [36712, -7.925073], [39010, -7.997241], [27112, -8.10646], [19026, -8.150097], [15550, -8.255803], [14878, -8.287951], [439, -8.291592], [41951, -8.371119], [46010, -8.373363], [24699, -8.562672], [36101, -8.565111], [98839, -8.567136], [24474, -8.61236], [23976, -8.622941], [20584, -8.644555], [14168, -8.769165], [92603, -8.77479], [20633, -8.794371], [15072, -8.822456], [31071, -8.832818], [75682, -8.851522], [39027, -8.873567], [24413, -8.886551], [6727, -8.890263], [59570, -8.89908], [40990, -8.909349], [41047, -8.939219], [14403, -8.949552], [17424, -8.954856], [53260, -8.958464], [100177, -9.008292], [38305, -9.066932], [19300, -9.070855], [18599, -9.139555], [53031, -9.141142], [20124, -9.166229], [34517, -9.208073], [87495, -9.216361], [20761, -9.309145], [102469, -9.310218], [45443, -9.336548], [120403, -9.345892], [28935, -9.415789], [5057, -9.442488], [72723, -9.542343], [11179, -9.575374], [1030, -9.619428], [102179, -9.759646], [14163, -9.802564], [17173, -9.805444], [9488, -9.824911], [31650, -9.827703], [14977, -9.873194], [87004, -9.886023], [38055, -9.906675], [24408, -9.91976], [18915, -9.930841], [94392, -9.941113], [58487, -9.953364], [34855, -10.005653]], "logprob_of_token": -0.346976, "top1_top2_margin": 1.728257, "top6_top7_margin": 0.046823}, {"gen_index": 15, "token": 7640, "top": [[7640, -0.773958], [845, -1.186258], [2796, -1.752149], [2260, -2.996244], [14225, -5.189879], [913, -6.744457], [2120, -8.134019], [1241, -8.278204], [1687, -8.467825], [46110, -8.614205], [4336, -8.855491], [922, -8.905143], [30135, -8.942358], [1178, -9.324749], [13111, -9.59484], [4550, -9.69687], [43918, -9.827217], [622, -9.874967], [1233, -9.910886], [699, -9.931006], [518, -10.040015], [3327, -10.097082], [8032, -10.13146], [10304, -10.229668], [2625, -10.269954], [7314, -10.291275], [41769, -10.305095], [1489, -10.490314], [46696, -10.49748], [8066, -10.562922], [40052, -10.673248], [2228, -10.7273], [31438, -10.887248], [43530, -10.905262], [21034, -10.90897], [18571, -10.996814], [346, -11.013728], [420, -11.017291], [4657, -11.048835], [836, -11.056735], [1195, -11.090394], [9506, -11.12688], [7073, -11.168797], [14612, -11.208288], [1006, -11.299489], [47354, -11.327794], [4391, -11.399071], [7108, -11.47997], [41390, -11.498984], [62264, -11.513291], [2042, -11.523108], [7799, -11.582159], [59299, -11.592341], [5680, -11.64832], [861, -11.671189], [2764, -11.683698], [28625, -11.733655], [22579, -11.751386], [45304, -11.758269], [3408, -11.779487], [38605, -11.789476], [3154, -11.794124], [939, -11.82183], [42099, -11.849147], [14573, -11.853979], [766, -11.877362], [6003, -11.939347], [1573, -11.953382], [6606, -11.957664], [2424, -12.001058], [2361, -12.025479], [75138, -12.046008], [13635, -12.066066], [2445, -12.093289], [12238, -12.100026], [8850, -12.106235], [47984, -12.124055], [52389, -12.150075], [1521, -12.162395], [11178, -12.183614], [4733, -12.192668], [39010, -12.227822], [9115, -12.242842], [11698, -12.249049], [5632, -12.274122], [9746, -12.295472], [9006, -12.320451], [34473, -12.417109], [3916, -12.447227], [14168, -12.457091], [614, -12.460149], [10917, -12.487403], [493, -12.493474], [2270, -12.500686], [2767, -12.511964], [888, -12.530122], [10003, -12.572233], [44, -12.573823], [32, -12.606207], [41129, -12.615698]], "logprob_of_token": -0.773958, "top1_top2_margin": 0.4123, "top6_top7_margin": 1.389562}, {"gen_index": 16, "token": 13111, "top": [[13111, -1.143013], [47354, -1.212277], [50155, -1.659656], [9272, -2.80649], [8273, -3.415032], [54690, -3.664811], [20387, -3.970941], [38832, -4.224764], [22596, -4.638675], [38533, -5.47916], [23053, -5.683983], [31212, -6.168798], [29828, -6.226485], [10683, -6.319178], [8066, -6.345372], [6592, -6.64936], [18203, -7.138251], [26239, -7.160492], [62264, -7.170595], [36646, -7.194018], [14573, -7.289692], [9798, -7.302194], [21208, -7.402], [58498, -7.895586], [40052, -7.908313], [27244, -7.918155], [21034, -7.963401], [24945, -8.0051], [20699, -8.062571], [34043, -8.373808], [31549, -8.421694], [43918, -8.444746], [59391, -8.444822], [42099, -8.457418], [9636, -8.48357], [863, -8.569492], [11516, -8.590548], [75319, -8.598654], [22188, -8.66963], [44052, -9.018436], [12831, -9.132973], [23879, -9.15587], [56372, -9.283703], [37707, -9.307894], [4758, -9.308254], [49679, -9.464949], [47984, -9.554111], [96708, -9.588818], [15489, -9.624386], [34473, -9.635864], [12474, -9.66474], [32875, -9.672468], [46110, -9.714479], [5289, -9.716103], [30069, -9.735502], [114378, -9.829899], [8000, -9.834717], [105110, -10.029634], [33302, -10.143339], [115302, -10.184969], [77711, -10.195747], [49127, -10.222565], [24333, -10.230436], [112608, -10.249805], [46983, -10.268587], [15843, -10.305487], [38120, -10.310888], [32, -10.32423], [51124, -10.325563], [5314, -10.381212], [11270, -10.407131], [50613, -10.426537], [95930, -10.452456], [59115, -10.465082], [17424, -10.500967], [28065, -10.504053], [101670, -10.525875], [24423, -10.527208], [27921, -10.538485], [43013, -10.541126], [7883, -10.543842], [1788, -10.546852], [23735, -10.562983], [7281, -10.573845], [29257, -10.57501], [74263, -10.575012], [72822, -10.597446], [31987, -10.603554], [6003, -10.621466], [91226, -10.623737], [16246, -10.631725], [82898, -10.662388], [22909, -10.675331], [60592, -10.678537], [33415, -10.758938], [60981, -10.775061], [32104, -10.801136], [45434, -10.838657], [40202, -10.839134], [72618, -10.851236]], "logprob_of_token": -1.143013, "top1_top2_margin": 0.069263, "top6_top7_margin": 0.30613}, {"gen_index": 17, "token": 14225, "top": [[14225, -0.162617], [44, -2.967338], [10304, -3.593747], [913, -4.781754], [2120, -4.895789], [622, -4.930826], [4336, -4.945183], [75138, -5.096225], [30135, -5.098756], [1687, -5.338537], [420, -5.533622], [2625, -5.572346], [10003, -5.602428], [43530, -5.958136], [7314, -6.006598], [1489, -6.790282], [45304, -7.320917], [1195, -7.428388], [3408, -7.669514], [8066, -7.675573], [1233, -7.913021], [861, -8.021398], [8747, -8.023287], [939, -8.111345], [46696, -8.54245], [41769, -8.686464], [18262, -8.972136], [14573, -9.175884], [8429, -9.327925], [5680, -9.394903], [7799, -9.55265], [21034, -9.677332], [14612, -9.710723], [1521, -9.725961], [20812, -9.762212], [46, -9.805061], [35723, -9.893479], [2225, -10.000814], [2361, -10.020465], [1597, -10.187845], [766, -10.19051], [11178, -10.220654], [1409, -10.324265], [493, -10.404999], [9115, -10.455576], [26345, -10.476897], [7470, -10.583534], [25901, -10.583956], [1573, -10.601216], [39010, -10.886617], [845, -10.894973], [1829, -11.023253], [1006, -11.097113], [5906, -11.133606], [346, -11.193149], [103601, -11.281782], [15298, -11.316899], [40158, -11.356718], [81502, -11.386108], [5224, -11.416018], [14543, -11.425423], [2424, -11.430571], [10913, -11.498274], [9798, -11.508875], [74045, -11.515554], [14282, -11.575115], [2042, -11.57791], [3916, -11.582479], [6003, -11.597919], [1788, -11.598858], [31248, -11.619392], [19375, -11.629197], [614, -11.643423], [61212, -11.648561], [7226, -11.649561], [5222, -11.700694], [101482, -11.701358], [120007, -11.704065], [14794, -11.721189], [1803, -11.750507], [5276, -11.754004], [948, -11.775209], [14581, -11.777392], [48802, -11.812862], [2150, -11.833933], [513, -11.837488], [2502, -11.857338], [31677, -11.88328], [275, -11.901022], [1117, -11.923617], [28049, -11.926216], [59, -11.927382], [12549, -11.93597], [47803, -11.950638], [22863, -11.981972], [24903, -11.991364], [8715, -12.046532], [19474, -12.063497], [6452, -12.092873], [40052, -12.139238]], "logprob_of_token": -0.162617, "top1_top2_margin": 2.804721, "top6_top7_margin": 0.014357}, {"gen_index": 18, "token": 1687, "top": [[1687, -0.594456], [4336, -2.010006], [44, -2.100199], [913, -2.140459], [1233, -3.447], [43530, -4.444692], [2625, -4.691565], [30135, -4.693572], [15298, -5.56096], [1521, -6.327411], [1489, -6.403811], [5680, -6.540462], [2225, -7.343359], [622, -7.372563], [8066, -7.635849], [861, -8.213824], [10304, -8.664717], [30512, -8.677881], [1409, -8.95603], [2424, -9.545979], [1597, -9.797928], [9115, -10.227728], [45304, -10.291443], [6986, -10.387041], [2042, -10.411453], [10003, -10.431645], [14125, -10.466675], [1803, -10.582447], [5989, -10.725707], [763, -10.764944], [49571, -10.951128], [1112, -11.017123], [84173, -11.032043], [46696, -11.057253], [18262, -11.291626], [513, -11.33078], [1717, -11.476599], [8429, -11.496816], [122975, -11.497635], [3408, -11.525888], [5019, -11.552536], [61212, -11.572745], [10895, -11.575354], [2361, -11.713539], [346, -11.898458], [4494, -11.958789], [420, -12.036163], [14573, -12.043233], [3654, -12.0818], [15339, -12.104156], [6606, -12.154339], [7314, -12.213969], [35723, -12.221944], [26099, -12.252493], [4835, -12.329787], [2150, -12.40136], [1573, -12.466543], [14424, -12.469562], [22747, -12.475424], [614, -12.506608], [14460, -12.509048], [1195, -12.525771], [948, -12.526043], [12549, -12.562304], [20302, -12.610177], [8032, -12.629299], [310, -12.646019], [3916, -12.733923], [101482, -12.776079], [3643, -12.80383], [10666, -12.809772], [46, -12.813211], [48802, -12.817309], [69370, -12.821337], [75138, -12.826579], [4299, -12.830338], [120025, -12.841879], [33599, -12.860669], [8747, -12.889021], [14612, -12.894074], [7470, -12.902255], [845, -12.905048], [922, -12.925615], [14168, -12.952974], [39010, -12.985037], [699, -12.99785], [11178, -13.016719], [4490, -13.018425], [120008, -13.052637], [1006, -13.073978], [41537, -13.08156], [14225, -13.110671], [6452, -13.183796], [766, -13.188576], [5222, -13.195663], [32, -13.200144], [26562, -13.21215], [939, -13.239542], [21447, -13.268651], [1953, -13.291386]], "logprob_of_token": -0.594456, "top1_top2_margin": 1.41555, "top6_top7_margin": 0.246873}, {"gen_index": 19, "token": 45455, "top": [[45455, -0.659997], [420, -0.797217], [1151, -4.548782], [922, -5.066894], [18230, -5.303678], [948, -6.257881], [8032, -6.479885], [87890, -6.809682], [32816, -7.10022], [16925, -7.586485], [2042, -7.648482], [61212, -7.690225], [101081, -7.711104], [4118, -8.032248], [59825, -8.244035], [20016, -8.435534], [15128, -8.667115], [9914, -8.794647], [57318, -9.021534], [118196, -9.103385], [19820, -9.218504], [71797, -9.301412], [9702, -9.400955], [109147, -9.50629], [41296, -9.698466], [45044, -9.810431], [19987, -9.923373], [32, -9.93039], [826, -10.069448], [6838, -10.098034], [20263, -10.177068], [12559, -10.210312], [20990, -10.328297], [12465, -10.371725], [49992, -10.426713], [112022, -10.458076], [14576, -10.463377], [4490, -10.49922], [11128, -10.535933], [48802, -10.582122], [61810, -10.637181], [20311, -10.679992], [84124, -10.818511], [1006, -10.833453], [398, -10.873555], [1097, -10.894204], [938, -10.95469], [35146, -11.013206], [7365, -11.088309], [3916, -11.095719], [18118, -11.111466], [285, -11.111558], [17799, -11.192854], [26562, -11.209317], [1178, -11.341968], [699, -11.435855], [21034, -11.436613], [3750, -11.478084], [70322, -11.520032], [6709, -11.543689], [68701, -11.618544], [11775, -11.62435], [112499, -11.662126], [51676, -11.685482], [55161, -11.691956], [74584, -11.695938], [123979, -11.709471], [29707, -11.711917], [7865, -11.717223], [41160, -11.719459], [11178, -11.739496], [63061, -11.841969], [37796, -11.862771], [56787, -11.870059], [16312, -11.890168], [49127, -11.898959], [353, -11.902442], [16486, -11.904284], [4733, -11.967404], [61882, -11.986566], [286, -11.995252], [44736, -12.044892], [840, -12.054038], [6586, -12.067111], [10881, -12.084779], [57606, -12.090055], [25576, -12.100703], [29968, -12.127542], [62164, -12.130388], [19040, -12.130845], [23053, -12.139449], [41537, -12.142246], [125574, -12.150988], [15298, -12.153866], [40074, -12.174643], [84027, -12.218579], [18262, -12.245086], [4290, -12.370515], [64130, -12.387639], [6986, -12.413299]], "logprob_of_token": -0.659997, "top1_top2_margin": 0.13722, "top6_top7_margin": 0.222004}, {"gen_index": 20, "token": 2042, "top": [[2042, -0.0075], [16925, -5.941203], [61882, -6.456072], [49127, -7.077179], [32816, -7.469297], [19820, -7.740849], [45670, -8.664527], [31972, -9.151473], [49686, -9.37642], [12753, -9.561909], [46191, -9.74974], [10881, -9.862464], [1584, -9.888097], [65408, -10.027055], [45209, -10.047279], [91226, -10.415361], [21196, -10.465967], [74584, -10.818545], [398, -10.822482], [6769, -11.070341], [25945, -11.277721], [840, -11.317114], [52114, -11.429027], [53516, -11.52337], [30990, -11.531671], [31568, -11.551924], [23788, -11.695974], [9726, -11.705076], [25571, -11.740955], [1864, -11.776394], [21018, -11.809502], [36262, -11.890867], [19624, -11.920568], [49293, -11.94416], [55460, -11.989717], [17119, -12.10767], [63398, -12.180198], [2041, -12.18725], [34816, -12.191057], [34095, -12.225569], [74724, -12.283683], [10366, -12.339998], [3741, -12.359169], [91114, -12.374445], [21950, -12.381516], [70562, -12.421934], [1659, -12.433155], [62756, -12.477831], [12671, -12.495756], [19383, -12.499038], [50137, -12.507393], [949, -12.551401], [54275, -12.586887], [44428, -12.606628], [35368, -12.612481], [34468, -12.655333], [72709, -12.684477], [93909, -12.711989], [28625, -12.714842], [89157, -12.753809], [30555, -12.761799], [58146, -12.768007], [6838, -12.824347], [9364, -12.840576], [32688, -12.858128], [99429, -12.858641], [25667, -12.877939], [31482, -12.903809], [100155, -12.955397], [1496, -12.963858], [93409, -12.968002], [59750, -12.982075], [61369, -13.010761], [32, -13.023988], [96449, -13.052713], [15508, -13.066382], [5958, -13.076655], [43694, -13.084965], [23362, -13.097084], [31702, -13.097868], [44895, -13.101137], [7229, -13.132612], [37899, -13.154124], [33505, -13.159624], [73962, -13.173134], [7926, -13.188858], [863, -13.19404], [49992, -13.198488], [13846, -13.24467], [28058, -13.260141], [40814, -13.271969], [104545, -13.274428], [4691, -13.332147], [45604, -13.357583], [17872, -13.367363], [3272, -13.368273], [27497, -13.376305], [44994, -13.402905], [63061, -13.426903], [54495, -13.439426]], "logprob_of_token": -0.0075, "top1_top2_margin": 5.933704, "top6_top7_margin": 0.923678}, {"gen_index": 21, "token": 46, "top": [[46, -0.59219], [420, -1.252396], [44, -2.870475], [275, -3.10016], [831, -3.664372], [948, -4.004464], [314, -4.528088], [2625, -6.476591], [622, -7.733393], [4336, -8.102182], [59, -8.362863], [1829, -8.402657], [10304, -9.35877], [21034, -9.476341], [1803, -9.583899], [63, -9.621771], [120007, -9.650074], [913, -9.79337], [46696, -9.972647], [15298, -10.02547], [32, -10.085414], [36209, -10.365002], [766, -10.50087], [1117, -10.506661], [120399, -10.755289], [7314, -10.78187], [346, -10.824252], [513, -10.917296], [58, -10.924222], [33, -10.956301], [4137, -10.96771], [2150, -11.020933], [1233, -11.112953], [286, -11.142893], [8066, -11.146888], [28795, -11.17511], [10, -11.200428], [263, -11.312005], [9115, -11.341558], [120118, -11.397927], [18262, -11.399637], [16925, -11.439484], [23053, -11.465122], [37796, -11.471714], [14573, -11.522032], [30135, -11.567683], [39010, -11.601602], [14188, -11.60281], [861, -11.683432], [614, -11.690466], [826, -11.714128], [1717, -11.744234], [120016, -11.752666], [32816, -11.792332], [120099, -11.833033], [15049, -11.876296], [61882, -11.90168], [120000, -11.913271], [19820, -11.939415], [32727, -11.950034], [939, -11.956224], [10881, -11.969946], [7865, -11.970606], [31972, -11.987447], [1687, -11.994602], [8051, -12.007195], [45044, -12.019642], [4370, -12.038237], [1178, -12.041157], [5632, -12.05001], [53516, -12.052926], [61212, -12.059086], [120001, -12.083316], [120003, -12.093163], [493, -12.114585], [65408, -12.168401], [26562, -12.212822], [43530, -12.236515], [4561, -12.293947], [120347, -12.366377], [12297, -12.378593], [988, -12.385384], [2156, -12.4045], [24697, -12.410039], [26951, -12.417892], [12753, -12.418904], [14657, -12.433664], [120140, -12.439433], [13594, -12.474379], [19375, -12.499793], [1195, -12.536276], [3643, -12.542374], [9277, -12.563324], [14153, -12.58757], [922, -12.616929], [120030, -12.632668], [93457, -12.666933], [9726, -12.685687], [2297, -12.686145], [14225, -12.706658]], "logprob_of_token": -0.59219, "top1_top2_margin": 0.660207, "top6_top7_margin": 0.523623}, {"gen_index": 22, "token": 1496, "top": [[1496, -0.373257], [2896, -3.375738], [3280, -3.550262], [10694, -3.793982], [18855, -3.810345], [5289, -4.052853], [7865, -4.40871], [6336, -4.413398], [4246, -4.413778], [5084, -4.494774], [33573, -4.507741], [1438, -4.748306], [44871, -4.822532], [120014, -4.906309], [16242, -4.985143], [1914, -5.112113], [61335, -5.289789], [2447, -5.41885], [2297, -5.434684], [1220, -5.451108], [1047, -5.547502], [15369, -5.578103], [11794, -5.708546], [30762, -5.730671], [2121, -6.060763], [28484, -6.194808], [34121, -6.325793], [10438, -6.502467], [21654, -6.52809], [21734, -6.538298], [3239, -6.579199], [766, -6.750405], [116769, -6.755044], [3343, -6.871943], [1864, -6.878542], [32816, -6.912011], [32, -7.001352], [10755, -7.034295], [120004, -7.12093], [29181, -7.167126], [118988, -7.318945], [36957, -7.319799], [50982, -7.36747], [27532, -7.413547], [523, -7.54928], [4363, -7.555969], [38985, -7.679127], [19787, -7.70344], [43298, -7.720198], [20974, -7.78305], [3417, -7.811176], [97170, -7.814731], [13819, -7.823115], [16335, -7.827225], [3365, -7.835938], [63173, -7.864439], [9789, -7.882057], [3613, -7.89521], [20658, -8.085273], [11541, -8.133079], [1829, -8.150926], [946, -8.175886], [9103, -8.220084], [9031, -8.2345], [3579, -8.278609], [14188, -8.338658], [14147, -8.345283], [30421, -8.347696], [127906, -8.352883], [7339, -8.420242], [30171, -8.430823], [6567, -8.431693], [717, -8.442645], [83644, -8.447814], [16010, -8.459508], [120022, -8.47635], [48169, -8.488694], [114797, -8.492574], [13420, -8.497108], [16337, -8.514611], [559, -8.539975], [15650, -8.568051], [2042, -8.577873], [26225, -8.583832], [77439, -8.627254], [28870, -8.63586], [69439, -8.682946], [110139, -8.755021], [28275, -8.760526], [14153, -8.771759], [9961, -8.772666], [1911, -8.815411], [65408, -8.824315], [38171, -8.833277], [705, -8.849448], [5274, -8.864336], [7227, -8.887938], [8800, -8.898509], [59023, -8.93135], [33246, -8.934138]], "logprob_of_token": -0.373257, "top1_top2_margin": 3.002481, "top6_top7_margin": 0.355857}, {"gen_index": 23, "token": 29597, "top": [[29597, -0.208825], [20263, -2.428285], [4363, -2.728029], [125733, -4.801091], [6290, -5.254883], [13819, -6.758399], [64544, -7.009707], [11556, -7.345553], [5222, -7.365604], [51321, -7.657734], [29566, -7.723682], [48692, -7.766337], [71506, -7.867004], [66604, -7.947249], [56937, -7.94884], [4835, -7.953991], [5162, -8.037929], [115531, -8.05379], [16242, -8.158712], [37669, -8.168109], [9115, -8.256407], [37091, -8.353375], [20478, -8.556908], [39940, -8.60971], [69735, -8.612975], [126713, -8.639235], [65813, -8.814506], [66539, -8.832043], [111168, -8.845231], [15298, -8.855998], [9683, -8.939013], [9024, -8.953852], [122907, -8.959869], [16952, -8.961068], [71154, -8.969481], [8747, -8.971556], [32768, -9.017674], [22745, -9.084902], [27693, -9.094728], [9067, -9.094733], [81335, -9.110406], [13844, -9.154658], [61082, -9.167871], [18118, -9.194441], [94773, -9.198947], [14286, -9.212008], [69939, -9.220098], [27923, -9.226995], [46885, -9.228404], [23306, -9.230134], [73771, -9.246588], [5213, -9.255649], [112499, -9.256405], [32, -9.28135], [70223, -9.297526], [44197, -9.358371], [31155, -9.453002], [107837, -9.508665], [18799, -9.557272], [70765, -9.643629], [35146, -9.709653], [79104, -9.730679], [80935, -9.764382], [115560, -9.811381], [24665, -9.820474], [40670, -9.847877], [2302, -9.853373], [2150, -9.874425], [11794, -9.881167], [36750, -9.886826], [13663, -9.892041], [42701, -9.903228], [96220, -9.904092], [76298, -9.959342], [47046, -9.981645], [9515, -10.014634], [69191, -10.0151], [61335, -10.015371], [124248, -10.015552], [6776, -10.036211], [104683, -10.042331], [56155, -10.048408], [58890, -10.061142], [35757, -10.078616], [35126, -10.084833], [59446, -10.091786], [5052, -10.092961], [35119, -10.099907], [119607, -10.103902], [87755, -10.108921], [10824, -10.126735], [26412, -10.137736], [91718, -10.144994], [1604, -10.148394], [22188, -10.178351], [100103, -10.179217], [52088, -10.183555], [4858, -10.20853], [21832, -10.212624], [17632, -10.22515]], "logprob_of_token": -0.208825, "top1_top2_margin": 2.21946, "top6_top7_margin": 0.251308}, {"gen_index": 24, "token": 4363, "top": [[4363, -0.002044], [9515, -8.4213], [11794, -8.700597], [6896, -8.711642], [37669, -8.749579], [35774, -9.323425], [1618, -9.508029], [22580, -9.880249], [34001, -9.986506], [107837, -10.072543], [9024, -10.175728], [65813, -10.272527], [3891, -10.402678], [29597, -10.414603], [16242, -10.455573], [73137, -10.699624], [8165, -10.859289], [3717, -10.8623], [82880, -11.113642], [5474, -11.160344], [32139, -11.194347], [63790, -11.22459], [5052, -11.27142], [17632, -11.29696], [7430, -11.485681], [6290, -11.493077], [55617, -11.678386], [27532, -11.711094], [66250, -11.717852], [48299, -11.787565], [3364, -11.874212], [8854, -11.886886], [12324, -11.937373], [18470, -11.94015], [15209, -11.950261], [11090, -11.963399], [43792, -11.96579], [3577, -11.969772], [44, -12.01612], [10564, -12.028306], [15018, -12.039839], [5622, -12.144734], [8429, -12.15141], [1252, -12.198717], [963, -12.203115], [5710, -12.22168], [70463, -12.238594], [61341, -12.239902], [31155, -12.242034], [10516, -12.246817], [21752, -12.276429], [51216, -12.29435], [16391, -12.299109], [15162, -12.323865], [15061, -12.329504], [59324, -12.337733], [9386, -12.360375], [12496, -12.408976], [7879, -12.411275], [2294, -12.465081], [13663, -12.465604], [7588, -12.492364], [58951, -12.527264], [69191, -12.559419], [16994, -12.5832], [29284, -12.589501], [5515, -12.609222], [60456, -12.652833], [19903, -12.666544], [23419, -12.671866], [43892, -12.678014], [87144, -12.735686], [16377, -12.743585], [1604, -12.755594], [4027, -12.764907], [4668, -12.780507], [118565, -12.793796], [17899, -12.798019], [6423, -12.814042], [4166, -12.852276], [19178, -12.854434], [40670, -12.875601], [33573, -12.900189], [104683, -12.905157], [36158, -12.909875], [32245, -12.951142], [72053, -12.982781], [12698, -12.989278], [23413, -12.997146], [104600, -13.001367], [12718, -13.008109], [125257, -13.021294], [33154, -13.103776], [24093, -13.108689], [34197, -13.112493], [64125, -13.128667], [20263, -13.16006], [71772, -13.166957], [112380, -13.172318], [18162, -13.179622]], "logprob_of_token": -0.002044, "top1_top2_margin": 8.419256, "top6_top7_margin": 0.184604}, {"gen_index": 25, "token": 2459, "top": [[2459, -0.945902], [1826, -2.499767], [968, -2.738057], [2790, -3.143406], [2941, -3.395063], [6501, -3.409199], [48551, -3.596119], [6727, -3.717512], [24699, -3.746235], [98839, -3.897846], [14515, -3.909194], [12364, -3.932747], [23097, -4.186146], [44, -4.767653], [20507, -4.904565], [51092, -4.910746], [14016, -5.014375], [76399, -5.16823], [96010, -5.273929], [6326, -5.311829], [18988, -5.347953], [679, -5.367391], [13634, -5.391031], [513, -5.394928], [11554, -5.435268], [5057, -5.471334], [75606, -5.513097], [126879, -5.538567], [23976, -5.556134], [24113, -5.633479], [12518, -5.707182], [16069, -5.812054], [11757, -5.884304], [38362, -5.895105], [2621, -5.947037], [21794, -5.969036], [28757, -5.973866], [118595, -5.974203], [1863, -5.987657], [54545, -6.007539], [24413, -6.010801], [2156, -6.078216], [53031, -6.146396], [39027, -6.246642], [19500, -6.286121], [41951, -6.300775], [76048, -6.357911], [44615, -6.389534], [18579, -6.455124], [62157, -6.466796], [77285, -6.470589], [41835, -6.491642], [7315, -6.592078], [26735, -6.597009], [54795, -6.623444], [41655, -6.683594], [16637, -6.702399], [439, -6.710112], [14906, -6.744939], [53260, -6.837448], [85982, -6.84522], [34517, -6.852667], [24717, -6.864941], [27076, -6.869388], [31806, -6.919964], [11179, -6.949712], [56277, -6.9513], [27112, -6.960778], [102469, -7.074417], [91658, -7.164521], [20584, -7.188224], [16253, -7.225163], [13791, -7.271887], [37342, -7.29871], [18599, -7.313797], [13728, -7.317671], [47923, -7.355674], [13891, -7.356904], [14977, -7.370837], [36101, -7.403511], [20044, -7.456748], [11942, -7.464727], [1803, -7.47731], [38305, -7.558864], [48499, -7.571229], [24309, -7.597011], [1489, -7.607301], [18134, -7.650943], [32, -7.654716], [79317, -7.662119], [7115, -7.690944], [117620, -7.709664], [16194, -7.719073], [24636, -7.911106], [1829, -7.913826], [12975, -7.953094], [57529, -7.956948], [16432, -7.959106], [14878, -7.980444], [40490, -8.016261]], "logprob_of_token": -0.945902, "top1_top2_margin": 1.553864, "top6_top7_margin": 0.18692}, {"gen_index": 26, "token": 888, "top": [[888, -0.335629], [1195, -1.502206], [922, -3.813314], [17090, -5.067742], [699, -5.249539], [1410, -5.443803], [939, -5.481812], [14581, -5.923679], [7314, -6.148438], [21034, -6.191732], [18324, -6.480092], [3504, -6.899707], [41769, -7.271003], [6843, -7.364983], [18830, -7.565119], [518, -7.729427], [346, -7.798421], [5222, -7.823941], [28724, -8.189003], [3234, -8.243899], [614, -8.373855], [3514, -8.599005], [61212, -8.700886], [948, -9.130066], [39685, -9.135577], [2361, -9.164165], [14994, -9.169636], [14542, -9.173732], [1409, -9.173732], [18967, -9.328268], [19191, -9.339069], [17117, -9.365457], [8032, -9.367941], [51380, -9.387942], [2120, -9.396077], [37206, -9.466689], [34162, -9.486549], [7450, -9.498757], [4835, -9.539186], [861, -9.541496], [622, -9.558196], [14276, -9.564687], [24026, -9.609189], [14573, -9.634576], [14649, -9.689275], [36821, -9.742694], [1627, -9.790102], [36624, -9.865756], [17424, -9.874009], [7799, -9.874094], [9115, -9.897478], [120007, -9.929085], [33990, -9.944127], [9277, -10.04322], [38868, -10.075654], [27899, -10.103267], [76616, -10.159822], [63635, -10.160698], [20812, -10.211484], [44, -10.222404], [1853, -10.229228], [61082, -10.229931], [7226, -10.231303], [913, -10.26532], [58343, -10.267537], [8747, -10.273014], [29331, -10.273125], [14357, -10.285061], [1006, -10.31216], [93825, -10.314251], [14154, -10.331051], [14864, -10.350059], [5152, -10.353518], [34402, -10.357459], [4299, -10.369969], [38905, -10.396064], [1803, -10.408055], [70574, -10.419663], [16488, -10.483323], [10304, -10.527442], [4938, -10.561208], [19474, -10.565421], [14566, -10.569593], [23474, -10.588332], [493, -10.603154], [12220, -10.617921], [65702, -10.62931], [14543, -10.637221], [6606, -10.64294], [55992, -10.644617], [11698, -10.674788], [4657, -10.677262], [26848, -10.694212], [420, -10.711858], [3916, -10.712811], [51638, -10.720255], [11178, -10.731019], [1489, -10.811208], [10909, -10.816759], [12420, -10.819704]], "logprob_of_token": -0.335629, "top1_top2_margin": 1.166576, "top6_top7_margin": 0.038009}, {"gen_index": 27, "token": 922, "top": [[922, -0.07861], [699, -2.617978], [14286, -7.082593], [3717, -7.341501], [29597, -7.95048], [346, -8.645336], [20263, -8.868498], [518, -9.374082], [948, -10.329077], [1241, -10.795142], [5222, -11.086827], [7629, -11.203286], [22676, -11.330684], [7072, -11.45964], [120007, -11.573537], [25406, -11.592789], [8032, -11.735804], [3090, -11.956546], [11536, -11.988458], [29481, -12.077376], [1195, -12.109078], [84260, -12.259465], [4771, -12.280951], [6843, -12.347226], [4657, -12.443138], [11794, -12.46271], [29307, -12.65324], [22188, -12.664401], [16925, -12.684729], [20421, -12.768086], [32816, -12.792699], [18582, -12.894566], [26761, -12.914136], [8608, -12.953111], [27430, -13.026135], [12567, -13.108068], [1618, -13.207448], [32139, -13.302084], [20075, -13.387254], [2042, -13.43784], [52088, -13.472354], [13732, -13.475715], [4938, -13.490066], [1044, -13.502382], [23127, -13.519534], [3579, -13.537015], [45396, -13.574503], [120022, -13.614762], [11691, -13.616158], [27497, -13.627684], [4269, -13.628392], [9726, -13.641922], [21262, -13.650142], [6674, -13.668374], [3514, -13.674443], [11226, -13.700717], [58343, -13.702971], [52114, -13.721275], [11698, -13.774007], [5617, -13.777236], [15955, -13.797875], [1151, -13.801398], [31991, -13.809564], [11090, -13.819131], [61335, -13.861817], [622, -13.87387], [64544, -13.876929], [941, -13.908395], [13902, -13.913115], [10917, -13.932963], [46773, -13.954988], [5845, -13.957457], [8846, -13.985634], [621, -13.988254], [3916, -13.998337], [17485, -14.019641], [8326, -14.036315], [32, -14.037402], [78424, -14.049814], [26805, -14.060843], [888, -14.077447], [3750, -14.111192], [1496, -14.135206], [18400, -14.146664], [21627, -14.148015], [17902, -14.151431], [58228, -14.15828], [75716, -14.181406], [120410, -14.239636], [9277, -14.26702], [33573, -14.267739], [2260, -14.270289], [836, -14.276858], [51446, -14.284619], [36158, -14.284865], [3691, -14.334268], [15343, -14.349216], [22580, -14.355457], [14576, -14.383464], [23597, -14.403735]], "logprob_of_token": -0.07861, "top1_top2_margin": 2.539368, "top6_top7_margin": 0.223162}, {"gen_index": 28, "token": 20263, "top": [[20263, -0.120432], [29597, -2.866827], [9067, -4.432018], [26421, -4.866663], [8846, -5.104492], [11869, -5.121602], [6896, -5.881386], [65685, -6.079451], [52088, -6.940335], [30758, -7.066039], [3717, -7.101633], [33415, -7.409599], [37669, -7.49687], [11090, -7.580323], [35774, -7.652678], [94846, -7.659531], [23419, -7.808871], [49992, -8.050231], [3364, -8.135012], [41400, -8.15017], [64544, -8.260504], [33225, -8.290954], [5222, -8.356237], [110792, -8.397222], [25948, -8.430055], [1618, -8.488814], [11208, -8.544269], [13844, -8.588429], [15209, -8.658808], [38060, -8.698668], [36572, -8.730799], [14286, -8.793973], [22676, -8.830424], [23052, -8.887156], [9024, -8.910595], [17899, -8.924405], [84419, -8.929075], [16486, -8.970013], [5052, -9.072498], [87755, -9.075884], [25406, -9.100603], [59825, -9.115516], [35757, -9.157829], [11794, -9.273745], [45994, -9.277754], [18162, -9.314251], [21832, -9.318976], [20688, -9.320335], [118960, -9.334919], [19356, -9.434397], [10975, -9.467144], [40670, -9.468345], [112499, -9.485428], [61082, -9.539345], [92748, -9.541582], [15113, -9.568161], [3891, -9.575852], [4835, -9.582384], [5622, -9.624878], [63714, -9.676485], [64729, -9.676706], [22745, -9.696841], [46918, -9.711126], [22188, -9.732381], [108281, -9.759096], [102011, -9.780166], [48802, -9.787956], [115531, -9.805896], [28888, -9.818657], [69724, -9.822031], [58951, -9.839945], [9683, -9.859652], [16172, -9.864403], [13498, -9.867802], [12095, -9.870984], [47099, -9.889927], [56937, -9.922205], [26682, -9.955122], [36286, -10.001293], [5213, -10.039154], [37670, -10.095177], [9273, -10.109457], [43892, -10.13392], [34361, -10.157568], [18625, -10.173097], [15550, -10.238226], [2944, -10.239304], [86104, -10.241622], [122907, -10.24437], [29824, -10.256102], [8429, -10.264029], [116336, -10.278431], [11397, -10.304621], [124853, -10.34176], [67554, -10.348824], [16811, -10.354904], [21034, -10.362411], [61212, -10.369173], [77235, -10.371058], [14462, -10.402905]], "logprob_of_token": -0.120432, "top1_top2_margin": 2.746394, "top6_top7_margin": 0.759785}, {"gen_index": 29, "token": 11794, "top": [[11794, -0.316754], [9067, -1.775329], [8846, -3.293809], [5052, -4.659969], [30758, -5.141192], [15955, -5.505701], [11869, -5.918591], [31212, -6.02032], [17718, -6.203708], [37670, -6.369678], [9273, -6.497211], [74169, -6.515788], [17512, -6.548759], [5213, -6.563462], [63714, -6.611856], [16811, -6.799329], [32164, -6.918801], [16695, -6.919803], [6290, -6.934331], [13844, -7.093852], [20688, -7.120498], [29824, -7.136732], [26421, -7.274745], [24736, -7.356839], [72053, -7.385395], [2578, -7.452957], [3717, -7.514504], [10975, -7.516563], [6565, -7.588583], [19903, -7.622547], [16236, -7.782527], [17485, -7.787778], [25948, -7.839972], [28089, -7.843554], [55397, -8.043535], [18582, -8.133887], [15162, -8.197969], [12184, -8.304032], [6896, -8.42615], [69939, -8.446361], [30069, -8.463446], [6003, -8.473725], [18448, -8.576644], [11208, -8.586208], [15388, -8.602887], [33415, -8.676488], [7181, -8.69391], [18797, -8.710898], [39046, -8.711283], [11397, -8.766511], [43773, -8.827897], [16952, -8.84545], [44531, -8.897618], [7617, -8.900104], [18011, -8.99867], [36924, -9.009578], [23052, -9.011823], [23053, -9.030049], [25651, -9.037468], [12909, -9.053192], [32104, -9.094033], [18203, -9.11807], [96011, -9.139009], [32001, -9.21045], [25867, -9.218876], [22676, -9.23046], [49544, -9.234315], [27643, -9.237247], [69724, -9.23819], [4916, -9.256984], [62303, -9.261854], [17902, -9.266811], [87692, -9.307334], [14742, -9.307755], [19866, -9.322505], [50912, -9.344628], [22163, -9.346189], [61903, -9.356807], [3364, -9.447297], [63656, -9.536057], [68291, -9.538117], [51341, -9.579579], [11041, -9.585078], [35081, -9.600443], [93872, -9.60522], [22861, -9.617701], [20607, -9.620011], [27644, -9.644084], [7988, -9.648755], [63483, -9.658576], [63731, -9.692508], [32949, -9.773463], [21774, -9.778532], [12567, -9.782626], [23788, -9.793164], [16438, -9.796735], [53924, -9.798846], [35449, -9.827094], [106061, -9.827841], [40794, -9.844074]], "logprob_of_token": -0.316754, "top1_top2_margin": 1.458574, "top6_top7_margin": 0.41289}, {"gen_index": 30, "token": 58, "top": [[58, -0.031356], [44, -3.950403], [46, -5.11312], [120007, -6.418305], [1829, -6.724092], [14188, -7.624938], [63, -7.772154], [59, -8.328586], [275, -8.729378], [1117, -8.801158], [420, -8.999053], [314, -9.153933], [1195, -9.490907], [745, -9.550362], [939, -9.961013], [913, -10.202643], [120022, -10.292064], [95033, -10.526761], [2120, -10.584213], [1953, -10.621493], [14153, -10.62519], [20758, -10.678588], [33, -10.685931], [656, -11.117558], [32, -11.2114], [120006, -11.222192], [622, -11.291568], [120016, -11.320414], [2625, -11.543889], [2459, -11.567286], [2016, -11.771301], [766, -11.94478], [3825, -12.061394], [46319, -12.062644], [120021, -12.091881], [1062, -12.099127], [1410, -12.143977], [10304, -12.20682], [107, -12.265023], [10, -12.269174], [263, -12.31632], [316, -12.345248], [755, -12.34983], [948, -12.353834], [861, -12.416206], [268, -12.468986], [120059, -12.498647], [405, -12.502086], [4299, -12.622247], [14179, -12.657449], [888, -12.663993], [1233, -12.710488], [614, -12.746605], [45, -12.775008], [346, -12.837678], [32913, -12.851034], [3504, -12.879891], [5594, -12.908708], [7314, -12.965598], [19601, -13.007787], [31651, -13.034724], [8066, -13.039819], [122823, -13.059074], [3288, -13.075534], [1687, -13.098375], [2260, -13.099818], [120410, -13.11678], [44279, -13.168582], [1043, -13.19469], [2424, -13.22877], [2636, -13.268397], [15907, -13.298685], [11861, -13.307549], [35135, -13.347486], [120468, -13.359052], [18308, -13.3729], [6276, -13.426711], [7450, -13.44352], [8243, -13.461782], [2256, -13.480023], [513, -13.490937], [59160, -13.516452], [6277, -13.563978], [115, -13.572658], [51248, -13.575662], [121119, -13.581829], [47, -13.605261], [51380, -13.607882], [4915, -13.616107], [518, -13.638816], [34, -13.643013], [296, -13.643992], [28734, -13.64682], [377, -13.670879], [7799, -13.67092], [775, -13.688649], [6875, -13.705642], [922, -13.70908], [15760, -13.710345], [70724, -13.736264]], "logprob_of_token": -0.031356, "top1_top2_margin": 3.919047, "top6_top7_margin": 0.147217}, {"gen_index": 31, "token": 5084, "top": [[5084, -0.014038], [2896, -5.218096], [1415, -5.561729], [120022, -7.195337], [2297, -7.416693], [3280, -7.752773], [10694, -8.653553], [1047, -8.83368], [14154, -9.027754], [1496, -9.076744], [31438, -9.290086], [6567, -9.295556], [1438, -9.3854], [20658, -9.550516], [20758, -9.68397], [559, -9.703074], [44871, -9.749358], [1231, -9.850883], [16335, -9.859771], [1220, -9.912754], [32, -9.997583], [2412, -10.055207], [6336, -10.075258], [34121, -10.094968], [705, -10.219174], [120007, -10.235647], [120103, -10.300814], [35212, -10.439709], [18571, -10.49851], [10438, -10.504223], [5274, -10.627274], [5289, -10.629151], [11541, -10.720576], [2447, -10.785812], [120087, -10.843039], [69439, -10.855199], [744, -10.862471], [15123, -10.912815], [1864, -10.969068], [10755, -11.038518], [28484, -11.058324], [41027, -11.090275], [120098, -11.163806], [7865, -11.173334], [3417, -11.175617], [126368, -11.202394], [5412, -11.204195], [2121, -11.233164], [15369, -11.269192], [15650, -11.343422], [26225, -11.392549], [9103, -11.496683], [34725, -11.503742], [120014, -11.628624], [13166, -11.665465], [13420, -11.737385], [4246, -11.745036], [8800, -11.766872], [21734, -11.779805], [9961, -11.824821], [21661, -11.836923], [60135, -11.888478], [62264, -11.964092], [836, -11.96492], [3418, -11.974259], [30421, -11.988852], [32816, -12.07118], [31131, -12.100525], [52448, -12.124938], [19787, -12.140947], [120004, -12.174704], [127125, -12.195143], [43298, -12.200169], [94329, -12.207771], [840, -12.223202], [120383, -12.250429], [939, -12.260921], [1911, -12.267376], [83644, -12.281321], [1469, -12.296097], [20974, -12.297081], [766, -12.359394], [17827, -12.384567], [14225, -12.389958], [38171, -12.421062], [2186, -12.423813], [13111, -12.45342], [1829, -12.475272], [1915, -12.476926], [523, -12.539127], [18855, -12.581014], [10485, -12.588093], [16573, -12.620502], [1914, -12.640572], [8143, -12.641058], [9031, -12.656418], [11794, -12.659544], [44682, -12.694733], [717, -12.69789], [116401, -12.703181]], "logprob_of_token": -0.014038, "top1_top2_margin": 5.204058, "top6_top7_margin": 0.90078}]}, {"prompt": "counting: one two three four five six seven", "input_ids": [586, 259, 58, 2403, 1311, 2467, 2555, 4241, 8445, 12843], "generated_ids": [12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843, 12843], "rows": [{"gen_index": 0, "token": 12843, "top": [[12843, -0.815395], [8445, -1.540498], [14031, -1.669002], [2403, -3.630401], [58, -4.216987], [30877, -4.826238], [19827, -5.003707], [14188, -5.922303], [2555, -6.005994], [55333, -6.034135], [37720, -6.084331], [44, -6.306763], [10133, -6.31306], [6559, -6.38477], [8206, -6.51736], [31663, -6.612529], [14395, -6.621855], [46, -6.639769], [8435, -6.652195], [735, -6.71067], [46612, -6.723635], [55, -6.864413], [16363, -6.890546], [59, -7.007078], [286, -7.012008], [262, -7.042014], [1932, -7.214604], [29350, -7.251261], [1204, -7.264328], [90236, -7.34958], [56, -7.400673], [26209, -7.429516], [1311, -7.495175], [1829, -7.518827], [32, -7.561996], [941, -7.602576], [1275, -7.614415], [263, -7.665797], [94021, -7.68912], [405, -7.704704], [42613, -7.715331], [766, -7.757552], [28346, -7.79815], [38555, -7.854369], [76591, -7.856811], [127906, -7.890366], [622, -7.938189], [946, -8.058021], [1702, -8.060067], [4401, -8.082618], [527, -8.123175], [5274, -8.218606], [55332, -8.272053], [54, -8.338875], [310, -8.346809], [63, -8.347288], [4241, -8.36349], [90879, -8.377305], [122545, -8.382167], [936, -8.385848], [43032, -8.442967], [120006, -8.445748], [120007, -8.448193], [73987, -8.590486], [63487, -8.61248], [43605, -8.641831], [4595, -8.647016], [275, -8.651028], [68743, -8.66401], [120022, -8.74776], [56097, -8.753196], [1333, -8.75927], [5951, -8.782698], [53650, -8.826706], [816, -8.841438], [66032, -8.854041], [75282, -8.860878], [379, -8.867151], [33335, -8.87059], [1409, -8.946554], [4758, -8.947641], [353, -8.954741], [80764, -8.963527], [23556, -8.989081], [78308, -8.997004], [1343, -9.014752], [2376, -9.017049], [9156, -9.035531], [5218, -9.080675], [318, -9.104599], [2467, -9.118965], [15533, -9.121716], [7510, -9.132402], [70341, -9.141969], [108744, -9.152862], [121080, -9.162307], [72714, -9.165308], [900, -9.18942], [26458, -9.19828], [3084, -9.207273]], "logprob_of_token": -0.815395, "top1_top2_margin": 0.725103, "top6_top7_margin": 0.177469}, {"gen_index": 1, "token": 12843, "top": [[12843, -0.166266], [14031, -2.393613], [19827, -4.765736], [2403, -4.884791], [8445, -5.890542], [55333, -5.943286], [58, -6.195442], [31663, -6.369451], [6559, -6.645507], [37720, -6.906727], [26209, -6.961033], [44, -6.963228], [14395, -7.011555], [14188, -7.304338], [55, -7.493507], [90236, -7.497094], [46, -7.551224], [59, -7.587005], [29350, -7.673464], [286, -7.693159], [1204, -7.841482], [1932, -7.969646], [55332, -7.986974], [76591, -7.99811], [10133, -8.029291], [80764, -8.157786], [4401, -8.185964], [2555, -8.191562], [1275, -8.219628], [735, -8.249954], [941, -8.346663], [262, -8.364902], [38336, -8.532698], [38555, -8.562325], [94021, -8.62275], [30877, -8.645925], [68743, -8.707938], [405, -8.786031], [1829, -8.817154], [263, -8.836511], [66032, -8.838078], [5274, -8.85884], [1311, -8.880809], [946, -8.899854], [33335, -8.903583], [766, -8.908214], [127906, -9.031907], [1409, -9.05866], [32, -9.117917], [5951, -9.150284], [2376, -9.163886], [56, -9.171168], [4241, -9.238438], [120007, -9.262518], [63, -9.309419], [527, -9.316241], [108744, -9.320111], [34210, -9.344142], [121080, -9.3576], [622, -9.371846], [936, -9.416379], [28346, -9.424067], [75282, -9.427621], [275, -9.432176], [70341, -9.432443], [43605, -9.475667], [310, -9.491101], [4758, -9.504027], [120022, -9.514313], [33274, -9.697495], [4739, -9.724751], [2944, -9.725242], [4595, -9.791749], [919, -9.795205], [19898, -9.825653], [2213, -9.874503], [2467, -9.877059], [1333, -9.893994], [7510, -9.922871], [5637, -9.926346], [4205, -9.952669], [90879, -9.984698], [900, -10.016593], [72714, -10.022722], [1739, -10.046653], [4850, -10.07013], [125745, -10.076541], [117101, -10.100403], [2503, -10.103732], [318, -10.115525], [73987, -10.141782], [5218, -10.150476], [1848, -10.173195], [8206, -10.180095], [3326, -10.189062], [966, -10.210956], [1433, -10.210975], [120006, -10.213344], [68987, -10.215072], [43032, -10.232515]], "logprob_of_token": -0.166266, "top1_top2_margin": 2.227347, "top6_top7_margin": 0.252156}, {"gen_index": 2, "token": 12843, "top": [[12843, -0.09775], [14031, -3.623824], [2403, -4.586133], [19827, -4.589899], [55333, -5.6545], [58, -6.123263], [31663, -6.404834], [6559, -6.450133], [44, -6.637889], [26209, -6.680522], [14395, -6.693928], [8445, -7.008032], [14188, -7.089682], [286, -7.132187], [55, -7.204679], [46, -7.250264], [90236, -7.278174], [59, -7.384793], [37720, -7.821185], [30877, -7.832809], [80764, -7.899472], [38336, -8.133911], [735, -8.208008], [1932, -8.257859], [55332, -8.274179], [5951, -8.288465], [76591, -8.388725], [33335, -8.483534], [2555, -8.519253], [1829, -8.533293], [262, -8.542514], [66032, -8.54538], [68743, -8.57522], [405, -8.63201], [1275, -8.647912], [29350, -8.662336], [263, -8.67579], [127906, -8.742529], [4401, -8.752678], [94021, -8.785027], [946, -8.818512], [1311, -8.830317], [941, -8.83374], [120007, -8.851587], [766, -8.880778], [5274, -8.889924], [10133, -8.914769], [622, -8.999316], [63, -9.004223], [43605, -9.023951], [4241, -9.077174], [32, -9.082569], [120022, -9.093428], [1409, -9.148939], [121080, -9.192871], [4739, -9.284155], [108744, -9.32695], [275, -9.331852], [527, -9.399481], [72714, -9.406867], [4758, -9.422032], [38555, -9.441982], [2376, -9.445433], [310, -9.448391], [117101, -9.482132], [8206, -9.488209], [2467, -9.611491], [2944, -9.623853], [936, -9.627282], [28346, -9.64735], [4205, -9.701674], [125745, -9.730861], [12456, -9.734976], [34210, -9.74978], [2213, -9.758024], [5071, -9.763238], [1204, -9.867937], [56, -9.883375], [5218, -9.884083], [919, -9.901881], [11292, -9.915584], [17736, -9.938639], [120006, -9.991737], [318, -10.068918], [1333, -10.074128], [70341, -10.079792], [5637, -10.092794], [900, -10.102575], [75282, -10.131375], [4731, -10.149862], [33274, -10.157258], [7510, -10.162196], [8265, -10.169571], [777, -10.179652], [120008, -10.187579], [4850, -10.188632], [13460, -10.194212], [33, -10.22067], [14147, -10.253658], [19898, -10.263314]], "logprob_of_token": -0.09775, "top1_top2_margin": 3.526075, "top6_top7_margin": 0.281571}, {"gen_index": 3, "token": 12843, "top": [[12843, -0.161755], [14031, -3.230798], [2403, -4.186324], [19827, -4.543851], [58, -5.409203], [44, -5.529599], [6559, -5.575794], [55333, -5.697674], [30877, -5.814146], [26209, -6.105219], [14188, -6.178917], [31663, -6.404621], [14395, -6.442501], [8445, -6.444872], [46, -6.484912], [90236, -6.626428], [59, -6.825016], [55, -7.17079], [37720, -7.423167], [10133, -7.439329], [1829, -7.525312], [286, -7.594337], [80764, -7.616508], [405, -7.779074], [29350, -7.780748], [94021, -7.874374], [66032, -7.908918], [263, -7.960694], [127906, -7.962029], [68743, -7.967648], [63, -8.008668], [76591, -8.01946], [5951, -8.032857], [262, -8.058355], [946, -8.143443], [4241, -8.189334], [1932, -8.197228], [735, -8.219212], [622, -8.245505], [8206, -8.27356], [43605, -8.313395], [55332, -8.395797], [33335, -8.421618], [38336, -8.422572], [72714, -8.559697], [2555, -8.56511], [275, -8.565269], [120007, -8.578795], [12456, -8.588951], [941, -8.589017], [5274, -8.598216], [28346, -8.610558], [766, -8.675718], [90879, -8.718284], [38555, -8.745723], [117101, -8.768267], [32, -8.770608], [120022, -8.845534], [1275, -8.849909], [4739, -8.953115], [310, -9.059498], [1311, -9.069706], [120006, -9.134956], [527, -9.166131], [33, -9.187304], [1409, -9.206038], [40506, -9.226737], [2467, -9.269604], [936, -9.279021], [2376, -9.303294], [17736, -9.306752], [259, -9.343557], [80524, -9.377192], [56, -9.388541], [8265, -9.411028], [14147, -9.426938], [12611, -9.435065], [4401, -9.447707], [75282, -9.454332], [1204, -9.468745], [2944, -9.469329], [121080, -9.477219], [5071, -9.478002], [2213, -9.482675], [125745, -9.494514], [14161, -9.507496], [816, -9.523767], [1433, -9.53839], [14179, -9.538813], [318, -9.547511], [120008, -9.554282], [19969, -9.567267], [5218, -9.599072], [669, -9.623395], [108744, -9.64506], [122545, -9.648713], [17308, -9.699698], [4688, -9.707589], [7449, -9.721807], [763, -9.722293]], "logprob_of_token": -0.161755, "top1_top2_margin": 3.069042, "top6_top7_margin": 0.046196}, {"gen_index": 4, "token": 12843, "top": [[12843, -0.118376], [14031, -4.083147], [19827, -4.454775], [8445, -4.697456], [2403, -4.721086], [55333, -5.71385], [26209, -5.837894], [6559, -5.872963], [31663, -6.062454], [44, -6.61413], [14395, -6.924112], [30877, -7.030813], [90236, -7.305811], [58, -7.330418], [14188, -7.379669], [55, -7.406588], [28346, -7.595141], [286, -7.603053], [1311, -7.687927], [4241, -7.705192], [59, -7.742961], [5951, -7.846578], [66032, -7.851225], [80764, -7.856721], [68743, -7.870645], [46, -7.90783], [33335, -7.945145], [55332, -7.950677], [43605, -8.177483], [946, -8.184325], [37720, -8.192404], [1932, -8.214965], [38336, -8.25041], [76591, -8.250735], [262, -8.344554], [735, -8.413358], [8206, -8.43531], [10133, -8.580844], [29350, -8.619245], [32, -8.620975], [63, -8.706014], [941, -8.715142], [1275, -8.722739], [94021, -8.742986], [622, -8.74932], [46612, -8.768043], [2467, -8.771679], [1829, -8.883129], [405, -8.899597], [2555, -8.909862], [5274, -8.917181], [125745, -8.963363], [766, -8.966052], [1409, -8.987988], [127906, -9.000597], [120007, -9.026182], [12456, -9.065296], [4739, -9.077064], [2213, -9.081182], [121080, -9.090709], [117101, -9.128282], [310, -9.194459], [2376, -9.253292], [936, -9.295256], [263, -9.31096], [38555, -9.341197], [120022, -9.341655], [8435, -9.358871], [318, -9.369052], [2944, -9.372294], [43032, -9.403301], [40506, -9.40442], [4401, -9.419543], [108744, -9.422904], [900, -9.463866], [16363, -9.489789], [72714, -9.50663], [20665, -9.514513], [527, -9.557254], [33445, -9.576827], [1781, -9.620035], [275, -9.657113], [42613, -9.672861], [1204, -9.688278], [19969, -9.69706], [2503, -9.708385], [4758, -9.718093], [17736, -9.724555], [3688, -9.749498], [4869, -9.785883], [565, -9.792805], [122545, -9.811637], [1410, -9.817038], [11292, -9.833003], [75112, -9.848931], [14729, -9.894923], [919, -9.895709], [1270, -9.913898], [4205, -9.919282], [33274, -9.928302]], "logprob_of_token": -0.118376, "top1_top2_margin": 3.96477, "top6_top7_margin": 0.124044}, {"gen_index": 5, "token": 12843, "top": [[12843, -0.148157], [14031, -3.141271], [2403, -4.473216], [19827, -4.52387], [8445, -4.713568], [55333, -5.448925], [26209, -5.987475], [6559, -6.055719], [31663, -6.476735], [30877, -6.769867], [44, -6.815725], [37720, -7.109514], [90236, -7.21115], [14188, -7.223661], [286, -7.298899], [58, -7.351489], [55, -7.422726], [59, -7.51274], [14395, -7.610473], [55332, -7.611509], [46, -7.676079], [8206, -7.711915], [10133, -7.816278], [68743, -7.855288], [5951, -7.931669], [1932, -7.958672], [735, -7.959657], [80764, -7.980254], [66032, -7.983788], [94021, -7.98825], [946, -8.035486], [1311, -8.059583], [28346, -8.078008], [4241, -8.103733], [76591, -8.190335], [29350, -8.274047], [262, -8.312328], [63, -8.384716], [1275, -8.429363], [38555, -8.453364], [2467, -8.48849], [46612, -8.509933], [2503, -8.580413], [33335, -8.599777], [941, -8.607937], [1829, -8.613335], [405, -8.619934], [5274, -8.64663], [32, -8.676417], [2555, -8.683132], [766, -8.720088], [120022, -8.806864], [120007, -8.815013], [622, -8.834818], [1204, -8.838284], [318, -8.844009], [121080, -8.844994], [127906, -8.899634], [43605, -8.952471], [12456, -8.960286], [263, -9.01294], [4401, -9.014696], [38336, -9.042856], [1409, -9.072663], [527, -9.088127], [900, -9.105124], [310, -9.157398], [2944, -9.23], [936, -9.275841], [43032, -9.293344], [108744, -9.321049], [4739, -9.35729], [42613, -9.359642], [1270, -9.400793], [275, -9.405462], [2376, -9.417276], [919, -9.439978], [125745, -9.45361], [90879, -9.478014], [56, -9.478138], [40506, -9.486799], [16363, -9.562101], [1781, -9.566938], [1840, -9.594667], [117101, -9.597611], [72714, -9.617335], [11292, -9.624122], [1410, -9.628925], [8435, -9.651666], [2213, -9.654076], [476, -9.660046], [75282, -9.679291], [17736, -9.681112], [970, -9.682896], [1776, -9.687408], [20665, -9.702909], [4758, -9.709142], [3688, -9.76266], [19969, -9.79134], [8265, -9.794106]], "logprob_of_token": -0.148157, "top1_top2_margin": 2.993113, "top6_top7_margin": 0.53855}, {"gen_index": 6, "token": 12843, "top": [[12843, -0.125249], [2403, -3.532024], [19827, -4.256833], [14031, -4.600856], [55333, -5.378962], [8445, -5.885662], [6559, -5.926008], [26209, -6.117514], [31663, -6.279401], [30877, -6.46485], [58, -6.720351], [55332, -6.985964], [44, -7.112034], [286, -7.189442], [90236, -7.221461], [55, -7.356144], [80764, -7.436442], [59, -7.478818], [46, -7.481127], [14188, -7.48597], [8206, -7.539181], [735, -7.81646], [68743, -7.885255], [14395, -7.889966], [2555, -7.931814], [66032, -7.939871], [76591, -8.03778], [1932, -8.263576], [37720, -8.270656], [1275, -8.314405], [63, -8.337449], [121080, -8.393661], [262, -8.417233], [1829, -8.466295], [941, -8.540645], [946, -8.561099], [38336, -8.578038], [622, -8.719813], [4241, -8.743234], [5951, -8.758028], [127906, -8.758671], [766, -8.8599], [405, -8.879807], [2503, -8.892644], [10133, -8.908781], [263, -8.931373], [120022, -8.961569], [2944, -8.96164], [8265, -8.962398], [94021, -8.97314], [108744, -8.988617], [72714, -8.991632], [43032, -8.996504], [1204, -9.014156], [120007, -9.017617], [527, -9.032709], [1409, -9.036456], [5274, -9.053566], [816, -9.054068], [2467, -9.070039], [275, -9.156013], [33335, -9.157632], [125745, -9.158876], [32, -9.185127], [310, -9.196172], [28346, -9.236694], [43605, -9.271611], [63487, -9.272458], [4401, -9.288451], [900, -9.32149], [40506, -9.37193], [919, -9.37774], [29350, -9.389543], [46612, -9.394786], [1311, -9.395631], [117101, -9.484473], [4739, -9.509217], [1848, -9.543195], [318, -9.560234], [1333, -9.592783], [936, -9.650223], [2376, -9.697442], [1319, -9.698263], [20195, -9.699102], [33445, -9.720056], [378, -9.734843], [5071, -9.780023], [70341, -9.788655], [1776, -9.790099], [17736, -9.793707], [122545, -9.801742], [42613, -9.838901], [1270, -9.841573], [835, -9.872487], [1309, -9.875401], [120006, -9.875894], [4731, -9.880535], [3924, -9.886447], [33417, -9.889342], [38555, -9.895646]], "logprob_of_token": -0.125249, "top1_top2_margin": 3.406775, "top6_top7_margin": 0.040346}, {"gen_index": 7, "token": 12843, "top": [[12843, -0.110007], [2403, -3.648125], [14031, -4.550103], [19827, -4.60081], [55333, -5.182156], [6559, -5.876659], [55332, -6.028842], [26209, -6.477029], [31663, -6.496632], [44, -6.782563], [55, -6.878343], [8445, -6.908375], [58, -7.053852], [59, -7.08255], [90236, -7.218184], [80764, -7.276705], [2555, -7.533314], [14188, -7.573152], [286, -7.581415], [46, -7.698027], [76591, -7.702788], [14395, -7.712135], [735, -7.76984], [30877, -8.020029], [66032, -8.113227], [121080, -8.16238], [1932, -8.171261], [127906, -8.308064], [43032, -8.318046], [5951, -8.337913], [38336, -8.363286], [946, -8.367223], [68743, -8.437228], [941, -8.470565], [37720, -8.492429], [1829, -8.493668], [63, -8.497565], [262, -8.645125], [10133, -8.650266], [263, -8.667756], [622, -8.706218], [94021, -8.715645], [405, -8.719129], [43605, -8.749041], [108744, -8.782028], [1275, -8.805271], [4241, -8.809773], [20195, -8.816184], [527, -8.860979], [8206, -8.867959], [2944, -8.932891], [766, -8.964429], [33335, -8.990596], [63487, -9.060546], [120022, -9.078399], [72714, -9.080157], [5274, -9.140571], [816, -9.142187], [117101, -9.182261], [275, -9.190673], [120007, -9.210129], [1409, -9.232091], [42613, -9.252349], [919, -9.259724], [4739, -9.27997], [310, -9.296786], [32, -9.305657], [28346, -9.330504], [900, -9.350593], [8265, -9.427784], [4401, -9.454216], [125745, -9.469367], [1311, -9.505349], [12456, -9.542244], [936, -9.565593], [29350, -9.598933], [4595, -9.61309], [70341, -9.624286], [33445, -9.679223], [1204, -9.687274], [2467, -9.705395], [2376, -9.729529], [378, -9.732944], [37033, -9.818749], [4758, -9.843778], [318, -9.894875], [5071, -9.912962], [4731, -9.938973], [14147, -9.977767], [279, -9.989217], [1270, -10.013791], [8545, -10.016013], [38555, -10.016254], [1333, -10.023243], [19969, -10.031216], [1776, -10.035701], [2213, -10.035993], [1309, -10.046216], [379, -10.046219], [5637, -10.04893]], "logprob_of_token": -0.110007, "top1_top2_margin": 3.538117, "top6_top7_margin": 0.152183}, {"gen_index": 8, "token": 12843, "top": [[12843, -0.084679], [2403, -3.884549], [14031, -4.516746], [19827, -4.848345], [55333, -5.26974], [6559, -6.407638], [26209, -6.509662], [55332, -6.535925], [31663, -6.748278], [44, -6.839641], [14395, -6.842545], [55, -7.145283], [59, -7.179792], [58, -7.214432], [90236, -7.500954], [80764, -7.55827], [286, -7.590541], [14188, -7.698604], [8445, -7.779981], [46, -7.809248], [76591, -8.264267], [2555, -8.297916], [735, -8.41046], [946, -8.426487], [68743, -8.489218], [4241, -8.496346], [66032, -8.531189], [127906, -8.621296], [38336, -8.637303], [94021, -8.653432], [37720, -8.666465], [121080, -8.674755], [941, -8.710802], [1829, -8.812157], [5951, -8.831608], [1932, -8.882337], [43605, -8.891141], [262, -8.903419], [10133, -8.90353], [263, -8.995731], [43032, -9.01256], [20195, -9.058151], [33335, -9.058569], [1275, -9.09729], [405, -9.159302], [63, -9.219293], [622, -9.260939], [108744, -9.293215], [1311, -9.302612], [527, -9.33381], [5274, -9.365512], [766, -9.387581], [117101, -9.403025], [72714, -9.44142], [310, -9.456414], [120022, -9.466812], [275, -9.511368], [4739, -9.516109], [1409, -9.566742], [63487, -9.573917], [8265, -9.582186], [29350, -9.603811], [900, -9.612534], [2944, -9.632729], [919, -9.666136], [28346, -9.699339], [816, -9.736446], [32, -9.743376], [120007, -9.758896], [125745, -9.772614], [30877, -9.780905], [2467, -9.898903], [4595, -9.943512], [2376, -9.973351], [8206, -9.990768], [19969, -9.993971], [378, -10.00802], [38555, -10.021883], [1204, -10.03149], [12456, -10.055656], [936, -10.077654], [4758, -10.107235], [4401, -10.122109], [318, -10.142959], [4205, -10.213256], [42613, -10.218616], [14825, -10.241626], [17736, -10.242275], [14147, -10.26193], [2213, -10.271339], [70341, -10.272193], [14729, -10.28854], [439, -10.327106], [379, -10.332065], [279, -10.357734], [5071, -10.361767], [474, -10.371235], [1848, -10.387472], [777, -10.413454], [5637, -10.414948]], "logprob_of_token": -0.084679, "top1_top2_margin": 3.79987, "top6_top7_margin": 0.102024}, {"gen_index": 9, "token": 12843, "top": [[12843, -0.145011], [14031, -3.279888], [2403, -3.796991], [19827, -4.816258], [55333, -5.552557], [44, -5.826604], [1311, -5.857767], [8445, -5.9424], [26209, -6.060638], [59, -6.146777], [46, -6.444537], [14395, -6.468999], [6559, -6.631058], [58, -6.745364], [31663, -6.784735], [14188, -6.821221], [55, -7.066834], [286, -7.382678], [55332, -7.483642], [946, -7.590862], [90236, -7.735914], [37720, -7.752428], [4241, -7.788081], [80764, -7.833899], [735, -7.925186], [127906, -7.944681], [1829, -7.9698], [94021, -7.991643], [43605, -7.991927], [2555, -7.998034], [263, -8.096999], [33335, -8.153525], [63, -8.193088], [10133, -8.29988], [1932, -8.300344], [941, -8.347803], [68743, -8.389915], [66032, -8.401933], [262, -8.417357], [5951, -8.444232], [76591, -8.466368], [527, -8.486199], [38336, -8.519975], [29350, -8.526111], [28346, -8.531484], [275, -8.53516], [5274, -8.585376], [766, -8.63482], [405, -8.667059], [120022, -8.708666], [32, -8.770736], [1275, -8.779098], [318, -8.798455], [622, -8.805419], [121080, -8.82749], [2467, -8.896665], [38555, -8.961994], [1409, -8.969097], [43032, -9.039921], [120007, -9.057257], [900, -9.07899], [8265, -9.10775], [72714, -9.123171], [936, -9.129951], [310, -9.144545], [1204, -9.162578], [19969, -9.271392], [7510, -9.302377], [8206, -9.36891], [12456, -9.425941], [14161, -9.448207], [30877, -9.448274], [2376, -9.457032], [14147, -9.473571], [125745, -9.481254], [56, -9.49303], [4739, -9.494494], [2944, -9.52579], [439, -9.57753], [716, -9.598451], [1270, -9.609834], [14825, -9.623513], [5218, -9.632844], [33, -9.634531], [2213, -9.639581], [117101, -9.654365], [20195, -9.659673], [1410, -9.66688], [75282, -9.667994], [14729, -9.677161], [476, -9.678519], [108744, -9.682148], [120014, -9.693113], [4401, -9.698239], [531, -9.729308], [4758, -9.76871], [63487, -9.771554], [46612, -9.777075], [3688, -9.778743], [1781, -9.779843]], "logprob_of_token": -0.145011, "top1_top2_margin": 3.134877, "top6_top7_margin": 0.031163}, {"gen_index": 10, "token": 12843, "top": [[12843, -0.250067], [14031, -2.908847], [2403, -3.420883], [1311, -4.400662], [19827, -4.503201], [55333, -5.269587], [8445, -5.604636], [44, -5.743447], [26209, -5.790687], [59, -5.794238], [946, -6.184695], [31663, -6.201623], [46, -6.266025], [14395, -6.314613], [14188, -6.400184], [55, -6.565038], [286, -6.571421], [63, -6.843802], [6559, -6.883597], [37720, -7.06582], [55332, -7.078272], [58, -7.081702], [318, -7.228042], [90236, -7.316137], [120022, -7.343711], [766, -7.428054], [1829, -7.445779], [94021, -7.462596], [127906, -7.557623], [1932, -7.568333], [262, -7.576609], [120007, -7.600095], [735, -7.604349], [33335, -7.605775], [527, -7.647993], [405, -7.65859], [43605, -7.702718], [29350, -7.720928], [32, -7.743239], [1275, -7.778856], [622, -7.846674], [263, -7.851091], [80764, -7.864675], [5951, -7.889118], [38555, -8.063897], [1409, -8.073785], [941, -8.084898], [121080, -8.129688], [5274, -8.137559], [4401, -8.146802], [68743, -8.149592], [28346, -8.159022], [76591, -8.173636], [2555, -8.175003], [936, -8.181355], [4241, -8.187543], [19969, -8.242276], [7510, -8.281139], [10133, -8.293954], [275, -8.306977], [2376, -8.348042], [66032, -8.366564], [8265, -8.480217], [2467, -8.520208], [56, -8.534163], [310, -8.591505], [4595, -8.630851], [1204, -8.655375], [1410, -8.669477], [14177, -8.674253], [900, -8.674754], [72714, -8.685914], [2944, -8.702825], [1781, -8.727155], [38336, -8.768067], [716, -8.864602], [14825, -8.897633], [919, -8.915126], [46612, -8.949293], [4731, -8.950477], [4739, -8.970296], [30877, -8.976629], [125745, -8.989443], [439, -8.99904], [3688, -8.999606], [12456, -9.00015], [4758, -9.014333], [3394, -9.021129], [33, -9.035515], [8206, -9.035989], [1840, -9.036187], [1305, -9.061888], [14792, -9.076912], [5218, -9.081979], [1270, -9.082674], [2213, -9.082787], [379, -9.102544], [3368, -9.113687], [378, -9.119404], [3924, -9.124645]], "logprob_of_token": -0.250067, "top1_top2_margin": 2.65878, "top6_top7_margin": 0.335049}, {"gen_index": 11, "token": 12843, "top": [[12843, -0.200057], [14031, -2.538481], [2403, -4.224605], [19827, -4.611159], [55333, -5.023101], [8445, -6.178604], [26209, -6.224174], [31663, -6.566052], [44, -6.599555], [1311, -6.63255], [37720, -6.718376], [6559, -6.788961], [14395, -6.810611], [55332, -6.852025], [59, -6.951281], [946, -6.988882], [14188, -6.998437], [55, -7.026042], [46, -7.069701], [286, -7.183759], [94021, -7.291121], [1932, -7.371749], [90236, -7.375775], [58, -7.412359], [2555, -7.631014], [10133, -7.749166], [29350, -7.873283], [262, -7.907352], [76591, -7.923961], [38555, -7.967308], [80764, -7.979764], [120022, -8.005896], [30877, -8.007817], [63, -8.011665], [1829, -8.037468], [735, -8.110402], [941, -8.139785], [405, -8.190042], [127906, -8.251942], [32, -8.252015], [68743, -8.256976], [43032, -8.274531], [43605, -8.295086], [120007, -8.297716], [28346, -8.298275], [622, -8.315168], [527, -8.339838], [318, -8.35353], [2467, -8.401983], [263, -8.418225], [5274, -8.437228], [121080, -8.442309], [766, -8.450847], [66032, -8.475228], [1275, -8.475828], [1409, -8.495396], [33335, -8.548005], [4401, -8.587606], [5951, -8.596431], [4241, -8.601482], [900, -8.629715], [8206, -8.644187], [38336, -8.655768], [56, -8.696362], [1204, -8.77939], [19969, -8.781283], [310, -8.908973], [63487, -8.976803], [275, -8.98453], [919, -9.000073], [936, -9.013358], [7510, -9.014368], [20195, -9.070522], [72714, -9.075967], [12456, -9.080632], [108744, -9.083633], [2944, -9.100727], [4595, -9.232628], [42613, -9.256228], [33274, -9.265031], [1806, -9.320713], [379, -9.323339], [2213, -9.341737], [8265, -9.367509], [46612, -9.380265], [75282, -9.393016], [2503, -9.406996], [3688, -9.408962], [1343, -9.422656], [4205, -9.462663], [2376, -9.475015], [5218, -9.488572], [125745, -9.498189], [17736, -9.503219], [33445, -9.529905], [14825, -9.531748], [2457, -9.542926], [565, -9.570203], [529, -9.584189], [16147, -9.585752]], "logprob_of_token": -0.200057, "top1_top2_margin": 2.338424, "top6_top7_margin": 0.045571}, {"gen_index": 12, "token": 12843, "top": [[12843, -0.115972], [2403, -3.936986], [14031, -4.106618], [19827, -4.535508], [55333, -4.902473], [26209, -6.09319], [6559, -6.366802], [31663, -6.399648], [55332, -6.551434], [44, -6.891788], [8445, -6.946733], [59, -6.956622], [286, -6.993724], [55, -7.004461], [14188, -7.118436], [58, -7.168076], [90236, -7.318169], [14395, -7.366148], [46, -7.393741], [2555, -7.510241], [80764, -7.520123], [946, -7.647804], [76591, -7.736794], [1932, -7.87329], [68743, -7.882811], [120022, -7.884765], [120007, -7.995493], [37720, -8.009822], [1829, -8.107691], [63, -8.125895], [127906, -8.168295], [66032, -8.285516], [121080, -8.292705], [263, -8.359376], [262, -8.365179], [94021, -8.365199], [735, -8.394037], [405, -8.404481], [1275, -8.460585], [941, -8.534126], [38336, -8.539062], [30877, -8.576651], [43032, -8.635002], [4241, -8.641935], [10133, -8.718207], [622, -8.745403], [63487, -8.794222], [33335, -8.821509], [527, -8.841147], [766, -8.855946], [5274, -8.862374], [43605, -8.887792], [5951, -8.894007], [108744, -8.929458], [1409, -8.935953], [72714, -8.979591], [1204, -9.002679], [8206, -9.033458], [4401, -9.037924], [32, -9.052138], [29350, -9.068878], [2944, -9.079404], [7510, -9.096005], [275, -9.128984], [8265, -9.205516], [20195, -9.205997], [310, -9.20966], [1311, -9.306004], [900, -9.326715], [936, -9.334106], [125745, -9.336893], [38555, -9.339331], [28346, -9.415693], [919, -9.41824], [4739, -9.438153], [318, -9.44178], [2467, -9.519276], [4595, -9.565392], [2376, -9.605525], [379, -9.606122], [19969, -9.606422], [117101, -9.634617], [14825, -9.659922], [14161, -9.670731], [12456, -9.680807], [17736, -9.74416], [2457, -9.77231], [33274, -9.782969], [4205, -9.7882], [14147, -9.795746], [1848, -9.811453], [120014, -9.819965], [1333, -9.820471], [2213, -9.828262], [3688, -9.840626], [42613, -9.885096], [12611, -9.886331], [119747, -9.887373], [70341, -9.896538], [2503, -9.907218]], "logprob_of_token": -0.115972, "top1_top2_margin": 3.821013, "top6_top7_margin": 0.273612}, {"gen_index": 13, "token": 12843, "top": [[12843, -0.094339], [2403, -4.215338], [14031, -4.427439], [19827, -4.527095], [55333, -4.814873], [26209, -6.11969], [6559, -6.369989], [31663, -6.468896], [55332, -6.627021], [55, -6.917965], [14395, -7.052605], [59, -7.129756], [44, -7.178986], [90236, -7.290728], [8445, -7.333644], [80764, -7.376491], [286, -7.460896], [14188, -7.725491], [68743, -7.792401], [58, -7.822892], [46, -7.823303], [76591, -7.959035], [946, -8.13344], [2555, -8.143377], [66032, -8.195721], [1932, -8.224432], [37720, -8.272615], [121080, -8.321037], [127906, -8.356818], [94021, -8.443625], [38336, -8.455111], [120022, -8.543483], [43605, -8.675223], [735, -8.706013], [1829, -8.713355], [63, -8.748913], [120007, -8.767937], [33335, -8.7696], [941, -8.799482], [262, -8.802719], [4241, -8.838729], [5951, -8.852807], [1275, -8.86259], [10133, -8.900302], [405, -8.911387], [263, -8.961846], [527, -8.996706], [622, -9.059749], [108744, -9.059931], [5274, -9.132832], [1311, -9.135503], [43032, -9.154441], [72714, -9.212456], [63487, -9.226627], [117101, -9.254541], [2944, -9.327973], [125745, -9.356137], [29350, -9.359075], [310, -9.366516], [7510, -9.408205], [32, -9.423302], [4739, -9.427838], [766, -9.436869], [20195, -9.48452], [8265, -9.485902], [1409, -9.486464], [28346, -9.539341], [1204, -9.565504], [30877, -9.575946], [19969, -9.576241], [919, -9.621154], [38555, -9.622889], [275, -9.65554], [8206, -9.692188], [900, -9.702726], [2376, -9.761952], [936, -9.787894], [4401, -9.804819], [2467, -9.840059], [12456, -9.850127], [318, -9.851113], [119747, -9.875521], [378, -9.914173], [4595, -9.93258], [816, -9.93434], [14161, -9.949858], [379, -9.975449], [4205, -9.977152], [70341, -9.984785], [17736, -10.048116], [14147, -10.049898], [14825, -10.131507], [2457, -10.133408], [2213, -10.137331], [4731, -10.148273], [1806, -10.177438], [120014, -10.183887], [3688, -10.198937], [46612, -10.22821], [474, -10.230176]], "logprob_of_token": -0.094339, "top1_top2_margin": 4.120998, "top6_top7_margin": 0.250299}, {"gen_index": 14, "token": 12843, "top": [[12843, -0.14766], [14031, -3.664807], [2403, -4.200065], [55333, -4.413767], [19827, -4.482469], [26209, -5.944407], [44, -6.080669], [59, -6.184213], [6559, -6.184876], [55, -6.385059], [31663, -6.389256], [55332, -6.622128], [14395, -6.66429], [46, -6.735123], [14188, -6.823491], [8445, -7.018827], [946, -7.026486], [90236, -7.109144], [80764, -7.224241], [94021, -7.371033], [58, -7.392742], [286, -7.413547], [37720, -7.530222], [1932, -7.664546], [127906, -7.692761], [120022, -7.763176], [76591, -7.80575], [1829, -7.849675], [68743, -7.867537], [735, -7.884965], [63, -7.899797], [43605, -7.956202], [66032, -7.968228], [10133, -8.008354], [405, -8.043716], [120007, -8.09885], [121080, -8.126295], [1311, -8.160532], [5951, -8.17666], [263, -8.224949], [38336, -8.23698], [2555, -8.251101], [33335, -8.270161], [527, -8.388596], [262, -8.398005], [5274, -8.452644], [766, -8.485184], [1275, -8.533318], [622, -8.547536], [29350, -8.557166], [941, -8.611272], [72714, -8.652208], [32, -8.689312], [4241, -8.713777], [8206, -8.737672], [117101, -8.743506], [43032, -8.794317], [19969, -8.804273], [7510, -8.809299], [275, -8.811338], [28346, -8.827547], [63487, -8.829506], [108744, -8.846002], [38555, -8.908112], [310, -8.943575], [4739, -9.012667], [125745, -9.033621], [12456, -9.059408], [1409, -9.107224], [30877, -9.110974], [936, -9.124268], [318, -9.13808], [2944, -9.157495], [56, -9.16735], [20195, -9.186401], [1204, -9.190851], [14161, -9.192729], [119747, -9.206754], [900, -9.209241], [919, -9.238104], [8265, -9.254221], [5218, -9.289964], [378, -9.314629], [14147, -9.327562], [4401, -9.337305], [46612, -9.388394], [2376, -9.404959], [2467, -9.428667], [12611, -9.454967], [70341, -9.48314], [582, -9.493052], [17736, -9.497162], [75282, -9.508023], [379, -9.509078], [120014, -9.522372], [4205, -9.535508], [2213, -9.536934], [14825, -9.538694], [279, -9.602112], [33, -9.607386]], "logprob_of_token": -0.14766, "top1_top2_margin": 3.517147, "top6_top7_margin": 0.136261}, {"gen_index": 15, "token": 12843, "top": [[12843, -0.16218], [14031, -3.486134], [2403, -4.078034], [19827, -4.537114], [55333, -4.827373], [44, -5.734944], [59, -5.893452], [26209, -6.046065], [46, -6.345705], [6559, -6.489926], [8445, -6.492896], [31663, -6.541966], [14188, -6.558928], [55, -6.608861], [14395, -6.713758], [946, -6.883789], [55332, -6.94493], [58, -7.007803], [286, -7.099735], [1311, -7.222782], [90236, -7.227705], [1932, -7.371099], [63, -7.375696], [120022, -7.491559], [37720, -7.497785], [94021, -7.51459], [735, -7.525789], [127906, -7.543835], [80764, -7.546128], [1829, -7.632735], [5951, -7.641905], [120007, -7.892493], [2555, -7.976612], [263, -7.981925], [43605, -7.986559], [68743, -7.999782], [76591, -8.02457], [405, -8.046114], [4241, -8.079769], [527, -8.105114], [10133, -8.142316], [66032, -8.167477], [1275, -8.190554], [121080, -8.192881], [262, -8.209818], [766, -8.218157], [5274, -8.253793], [38336, -8.301159], [33335, -8.313774], [622, -8.34531], [7510, -8.371423], [29350, -8.397778], [32, -8.415041], [275, -8.428271], [941, -8.463881], [8206, -8.529073], [318, -8.536888], [12456, -8.669477], [28346, -8.716869], [936, -8.779762], [72714, -8.807873], [5218, -8.810101], [2467, -8.81028], [4401, -8.812091], [19969, -8.845753], [1409, -8.858437], [310, -8.874244], [900, -8.888352], [1204, -8.901609], [14161, -8.911762], [38555, -9.004043], [919, -9.010091], [108744, -9.017543], [125745, -9.020656], [63487, -9.049531], [117101, -9.09663], [14825, -9.135747], [56, -9.146649], [30877, -9.162155], [378, -9.179804], [4739, -9.186631], [582, -9.187917], [2944, -9.198969], [2376, -9.200495], [14147, -9.200724], [43032, -9.252765], [120014, -9.26674], [8265, -9.313305], [2213, -9.328184], [4205, -9.352089], [379, -9.357884], [120008, -9.369862], [17736, -9.381149], [33, -9.387], [70341, -9.399051], [46612, -9.411427], [33445, -9.424812], [20195, -9.431216], [439, -9.432783], [12611, -9.439928]], "logprob_of_token": -0.16218, "top1_top2_margin": 3.323955, "top6_top7_margin": 0.158507}, {"gen_index": 16, "token": 12843, "top": [[12843, -0.20502], [14031, -2.933274], [2403, -4.019503], [19827, -4.513413], [55333, -4.626474], [26209, -5.8908], [59, -6.090323], [44, -6.169318], [946, -6.28213], [31663, -6.293376], [8445, -6.293777], [46, -6.476558], [14188, -6.615485], [55, -6.630625], [286, -6.68367], [94021, -6.771517], [6559, -6.807194], [37720, -6.832378], [55332, -6.879329], [14395, -6.898961], [63, -6.921424], [1311, -7.114775], [1932, -7.16132], [90236, -7.23663], [5951, -7.270622], [120022, -7.353018], [58, -7.388897], [735, -7.431756], [127906, -7.467666], [29350, -7.585847], [1829, -7.683813], [80764, -7.745478], [405, -7.763305], [120007, -7.818556], [10133, -7.829126], [121080, -7.899896], [1275, -7.927901], [766, -7.963334], [2555, -8.012285], [38555, -8.014405], [68743, -8.019081], [262, -8.034961], [263, -8.088357], [527, -8.101976], [32, -8.132021], [76591, -8.144865], [4241, -8.164701], [43605, -8.165139], [5274, -8.166705], [622, -8.192849], [7510, -8.199932], [318, -8.211867], [33335, -8.266436], [8206, -8.304289], [66032, -8.36387], [941, -8.443], [936, -8.451209], [1409, -8.48201], [275, -8.510544], [30877, -8.511395], [56, -8.538613], [19969, -8.5669], [4401, -8.668497], [12456, -8.685027], [5218, -8.730802], [2467, -8.756337], [310, -8.759751], [2944, -8.764747], [38336, -8.805862], [1204, -8.816459], [28346, -8.819614], [378, -8.857812], [72714, -8.863358], [8265, -8.8739], [46612, -8.876724], [63487, -8.917254], [1781, -8.920146], [900, -8.926528], [2376, -8.94168], [108744, -8.946452], [919, -8.950505], [43032, -8.978173], [125745, -8.982819], [14161, -9.037291], [14825, -9.040307], [1410, -9.115708], [1840, -9.120778], [379, -9.123698], [4595, -9.137572], [5060, -9.142315], [75282, -9.152007], [4739, -9.156232], [582, -9.199484], [17736, -9.201623], [20195, -9.210294], [120014, -9.217436], [4758, -9.222345], [439, -9.266845], [2213, -9.269078], [12611, -9.274442]], "logprob_of_token": -0.20502, "top1_top2_margin": 2.728253, "top6_top7_margin": 0.199523}, {"gen_index": 17, "token": 12843, "top": [[12843, -0.175224], [14031, -3.031421], [2403, -4.232296], [19827, -4.504908], [55333, -4.68363], [26209, -6.145706], [44, -6.41989], [31663, -6.428841], [8445, -6.541143], [46, -6.637979], [55, -6.662473], [55332, -6.711078], [6559, -6.722103], [59, -6.724761], [14188, -6.778906], [946, -6.979898], [37720, -6.98461], [90236, -7.029956], [94021, -7.081637], [14395, -7.093663], [1932, -7.225844], [286, -7.244574], [58, -7.281334], [735, -7.28899], [1311, -7.377495], [63, -7.485225], [76591, -7.67987], [80764, -7.735771], [127906, -7.762589], [10133, -7.815133], [1829, -7.821814], [120022, -7.859233], [29350, -7.960652], [30877, -7.982231], [5951, -7.999508], [527, -8.000555], [405, -8.045472], [68743, -8.057493], [2555, -8.093158], [766, -8.093431], [262, -8.093854], [121080, -8.131889], [8206, -8.163642], [1275, -8.211381], [120007, -8.212158], [5274, -8.226374], [622, -8.254563], [38555, -8.274304], [263, -8.290077], [66032, -8.313758], [43605, -8.368755], [38336, -8.485787], [43032, -8.488032], [941, -8.524256], [32, -8.558806], [919, -8.592785], [2467, -8.661093], [4241, -8.676216], [56, -8.682126], [310, -8.693885], [275, -8.745476], [19969, -8.749791], [318, -8.769573], [378, -8.840288], [936, -8.931972], [72714, -8.948449], [1409, -8.952823], [108744, -8.976066], [7510, -8.989174], [4401, -8.991974], [900, -9.024384], [33335, -9.044565], [5218, -9.046901], [28346, -9.051335], [12456, -9.053971], [46612, -9.058641], [63487, -9.061813], [117101, -9.076356], [1204, -9.080116], [2944, -9.120424], [379, -9.156188], [20195, -9.183875], [8265, -9.214828], [125745, -9.270954], [14161, -9.283476], [1840, -9.287311], [33445, -9.333394], [439, -9.33911], [75282, -9.347353], [12611, -9.348932], [1064, -9.353317], [17736, -9.403708], [1309, -9.405308], [2376, -9.412591], [2213, -9.428274], [2457, -9.430655], [1410, -9.465341], [33274, -9.474124], [1343, -9.483577], [16147, -9.491582]], "logprob_of_token": -0.175224, "top1_top2_margin": 2.856196, "top6_top7_margin": 0.274184}, {"gen_index": 18, "token": 12843, "top": [[12843, -0.165102], [14031, -3.074993], [2403, -4.179349], [55333, -4.519988], [19827, -4.659892], [44, -6.278743], [26209, -6.324092], [46, -6.426998], [31663, -6.500042], [14188, -6.513262], [59, -6.569556], [58, -6.573135], [8445, -6.591124], [6559, -6.694628], [55332, -6.773273], [55, -6.78775], [90236, -6.930378], [946, -7.020452], [37720, -7.141565], [94021, -7.142463], [14395, -7.278873], [286, -7.460659], [735, -7.545033], [63, -7.556275], [1932, -7.566387], [76591, -7.725132], [1829, -7.758219], [10133, -7.781486], [80764, -7.797867], [127906, -7.834485], [1275, -7.93103], [120022, -7.931807], [2555, -7.94704], [1311, -8.028717], [405, -8.037008], [766, -8.051194], [263, -8.088871], [29350, -8.120917], [121080, -8.147825], [262, -8.251416], [527, -8.279775], [68743, -8.290343], [30877, -8.294237], [941, -8.359165], [5274, -8.384442], [120007, -8.398616], [66032, -8.402666], [622, -8.402719], [38555, -8.44347], [5951, -8.489693], [32, -8.495234], [8206, -8.510683], [919, -8.549888], [38336, -8.585526], [43605, -8.604372], [43032, -8.661037], [275, -8.666267], [4241, -8.81656], [108744, -8.846291], [56, -8.849408], [310, -8.862186], [2467, -8.956679], [63487, -8.963446], [7510, -8.986492], [72714, -8.995192], [936, -8.996107], [318, -9.008313], [19969, -9.016517], [46612, -9.051596], [33335, -9.058323], [28346, -9.110078], [900, -9.116981], [2944, -9.123417], [1409, -9.125816], [117101, -9.155449], [4401, -9.156652], [378, -9.156727], [379, -9.171275], [4595, -9.220737], [1204, -9.233006], [12611, -9.25195], [14161, -9.285986], [12456, -9.303224], [4739, -9.361205], [20195, -9.405769], [33445, -9.413158], [5218, -9.416069], [75282, -9.423404], [125745, -9.439547], [8265, -9.442478], [17736, -9.471697], [90879, -9.475451], [14147, -9.500075], [4758, -9.507563], [1840, -9.5141], [33, -9.524155], [2457, -9.543189], [1806, -9.558894], [33274, -9.56208], [529, -9.571707]], "logprob_of_token": -0.165102, "top1_top2_margin": 2.909891, "top6_top7_margin": 0.045349}, {"gen_index": 19, "token": 12843, "top": [[12843, -0.195545], [14031, -3.346319], [2403, -3.644821], [55333, -4.214867], [19827, -4.618723], [59, -6.019478], [26209, -6.089339], [44, -6.166478], [31663, -6.235827], [946, -6.312256], [55, -6.428728], [46, -6.475902], [6559, -6.52153], [8445, -6.547847], [55332, -6.572919], [14188, -6.585105], [58, -6.623749], [286, -6.961462], [94021, -6.979184], [14395, -7.004608], [63, -7.016805], [90236, -7.145025], [1932, -7.187735], [37720, -7.231791], [120022, -7.24069], [127906, -7.403225], [735, -7.511386], [80764, -7.552589], [1275, -7.588429], [120007, -7.616137], [766, -7.620137], [1829, -7.629442], [405, -7.672167], [121080, -7.749829], [76591, -7.823881], [263, -7.849413], [10133, -7.859712], [262, -7.89225], [30877, -7.947739], [8206, -7.94927], [29350, -7.972518], [941, -7.975502], [527, -8.007], [2555, -8.06931], [5951, -8.078568], [68743, -8.198454], [622, -8.200045], [66032, -8.209559], [5274, -8.252019], [7510, -8.340233], [1311, -8.43231], [32, -8.440166], [38555, -8.486344], [33335, -8.508152], [275, -8.551303], [2944, -8.559967], [936, -8.565393], [310, -8.570133], [318, -8.576783], [1409, -8.589211], [43605, -8.597102], [4241, -8.600706], [4595, -8.61652], [38336, -8.658539], [108744, -8.672853], [63487, -8.675874], [72714, -8.703027], [56, -8.714499], [4401, -8.758569], [46612, -8.766536], [19969, -8.786251], [919, -8.786755], [4739, -8.829839], [379, -8.878226], [8265, -8.887169], [1204, -8.893966], [43032, -8.956028], [2376, -8.961943], [900, -8.962471], [378, -8.994474], [125745, -9.055921], [1781, -9.092295], [1840, -9.111786], [12611, -9.117937], [4731, -9.120657], [20195, -9.121464], [14161, -9.131202], [117101, -9.16462], [16147, -9.176737], [12456, -9.181034], [120014, -9.193119], [119747, -9.19342], [14825, -9.195489], [14792, -9.228971], [5060, -9.252142], [2457, -9.254925], [2467, -9.255683], [33, -9.275503], [4205, -9.282792], [75282, -9.295497]], "logprob_of_token": -0.195545, "top1_top2_margin": 3.150774, "top6_top7_margin": 0.069861}, {"gen_index": 20, "token": 12843, "top": [[12843, -0.168808], [14031, -3.553237], [2403, -3.598616], [55333, -4.368864], [19827, -4.596746], [26209, -6.061943], [44, -6.127974], [59, -6.14887], [46, -6.209271], [6559, -6.436604], [31663, -6.52933], [55, -6.546843], [58, -6.594088], [14188, -6.682376], [8445, -6.719226], [55332, -6.791615], [14395, -6.864579], [946, -7.052495], [120022, -7.143551], [94021, -7.165531], [90236, -7.216768], [286, -7.250043], [63, -7.255512], [127906, -7.307765], [120007, -7.333428], [37720, -7.42639], [80764, -7.474651], [735, -7.565714], [1829, -7.688179], [1932, -7.705553], [2555, -7.83511], [76591, -7.863245], [405, -7.878962], [121080, -7.882945], [263, -7.922814], [10133, -8.007729], [68743, -8.038868], [5274, -8.170925], [527, -8.173018], [262, -8.216372], [66032, -8.219365], [38336, -8.232974], [766, -8.250146], [1275, -8.257981], [941, -8.281166], [29350, -8.470112], [275, -8.47245], [622, -8.488515], [5951, -8.499063], [43605, -8.541912], [32, -8.553919], [1311, -8.556061], [72714, -8.56502], [4241, -8.617614], [8206, -8.635103], [7510, -8.652568], [63487, -8.670224], [30877, -8.689914], [108744, -8.731886], [8265, -8.738487], [38555, -8.757349], [33335, -8.80541], [14161, -8.846436], [310, -8.892506], [900, -8.899542], [919, -8.94026], [43032, -8.959262], [1409, -8.985924], [936, -8.986556], [378, -8.989667], [2944, -9.035841], [1204, -9.039052], [19969, -9.083481], [56, -9.100946], [2467, -9.106488], [33, -9.130455], [318, -9.155834], [117101, -9.160081], [125745, -9.177712], [2213, -9.185432], [46612, -9.201972], [120014, -9.207338], [4739, -9.229483], [119747, -9.234272], [14147, -9.253111], [12611, -9.285046], [379, -9.298546], [20195, -9.33718], [2457, -9.338212], [12456, -9.340987], [816, -9.368947], [17736, -9.374952], [5218, -9.380211], [28346, -9.382196], [582, -9.428004], [14825, -9.430096], [4401, -9.453993], [75282, -9.473562], [5060, -9.481209], [1840, -9.530845]], "logprob_of_token": -0.168808, "top1_top2_margin": 3.384429, "top6_top7_margin": 0.066031}, {"gen_index": 21, "token": 12843, "top": [[12843, -0.162187], [14031, -3.47818], [2403, -3.665802], [55333, -4.606608], [19827, -4.643154], [26209, -6.053372], [59, -6.062214], [44, -6.131867], [46, -6.482021], [31663, -6.520673], [6559, -6.583216], [8445, -6.672561], [55, -6.702342], [946, -6.735197], [14188, -6.739111], [58, -6.806054], [14395, -6.948155], [55332, -6.973753], [120022, -7.114511], [63, -7.213449], [286, -7.215565], [90236, -7.316166], [94021, -7.332858], [127906, -7.378776], [120007, -7.426714], [37720, -7.485385], [80764, -7.618716], [735, -7.688106], [1932, -7.742031], [1829, -7.796272], [1311, -7.832893], [2555, -7.975831], [405, -8.00573], [121080, -8.034089], [76591, -8.035913], [5274, -8.079766], [68743, -8.123229], [263, -8.126077], [10133, -8.1368], [262, -8.211946], [1275, -8.294143], [527, -8.321743], [38336, -8.334815], [43605, -8.357802], [941, -8.365685], [4241, -8.368511], [32, -8.371751], [66032, -8.37474], [29350, -8.394279], [766, -8.427348], [5951, -8.496698], [7510, -8.499454], [33335, -8.636921], [622, -8.640903], [275, -8.662158], [72714, -8.698918], [8206, -8.820749], [63487, -8.867657], [8265, -8.869517], [38555, -8.880429], [108744, -8.923362], [14161, -8.932145], [30877, -8.94346], [936, -8.961702], [378, -8.972193], [318, -8.981511], [2467, -8.981897], [310, -8.986236], [19969, -9.009696], [1409, -9.012748], [1204, -9.023034], [900, -9.078469], [919, -9.131249], [28346, -9.220561], [14825, -9.226379], [56, -9.244144], [14147, -9.262389], [117101, -9.262395], [43032, -9.26691], [125745, -9.272591], [120014, -9.273791], [4739, -9.274179], [5218, -9.293479], [2944, -9.317693], [379, -9.33994], [12611, -9.342521], [46612, -9.350358], [582, -9.353492], [17736, -9.354821], [33, -9.360394], [119747, -9.402133], [4401, -9.407231], [20195, -9.410355], [12456, -9.414081], [2213, -9.42157], [5060, -9.461276], [70341, -9.492137], [2457, -9.537065], [16147, -9.540545], [3688, -9.565486]], "logprob_of_token": -0.162187, "top1_top2_margin": 3.315993, "top6_top7_margin": 0.008842}, {"gen_index": 22, "token": 12843, "top": [[12843, -0.231678], [14031, -3.066586], [2403, -3.383929], [19827, -4.509361], [55333, -4.554258], [59, -5.644147], [44, -5.757606], [26209, -5.83217], [946, -6.031779], [14188, -6.185181], [31663, -6.254896], [46, -6.266712], [8445, -6.466387], [286, -6.52808], [55, -6.616777], [63, -6.627348], [14395, -6.724739], [120022, -6.738626], [6559, -6.76056], [58, -6.82455], [94021, -6.883327], [37720, -6.902185], [55332, -6.920349], [127906, -7.121677], [735, -7.159125], [120007, -7.213637], [90236, -7.235098], [1311, -7.2804], [1829, -7.318393], [1932, -7.379997], [29350, -7.606372], [405, -7.641244], [80764, -7.662586], [121080, -7.690382], [5274, -7.723448], [262, -7.838724], [527, -7.839323], [263, -7.842319], [10133, -7.843239], [766, -7.881514], [1275, -7.8877], [2555, -7.907422], [68743, -7.915319], [5951, -7.915887], [76591, -7.955658], [32, -8.042118], [7510, -8.056598], [941, -8.098696], [4241, -8.139703], [38555, -8.195605], [622, -8.314793], [936, -8.32481], [8265, -8.344677], [275, -8.361892], [43605, -8.367491], [66032, -8.377719], [72714, -8.379108], [8206, -8.397917], [33335, -8.404576], [378, -8.427027], [318, -8.433357], [2467, -8.494223], [1409, -8.510523], [1204, -8.572405], [30877, -8.577973], [310, -8.603912], [2944, -8.622961], [38336, -8.627263], [919, -8.640288], [14161, -8.659116], [56, -8.710474], [19969, -8.734032], [4401, -8.773853], [120014, -8.817728], [63487, -8.837133], [12611, -8.849426], [14825, -8.918982], [46612, -8.955392], [108744, -8.960961], [900, -8.963783], [5060, -8.985977], [379, -9.013673], [125745, -9.015961], [582, -9.023068], [5218, -9.025277], [4739, -9.043837], [1840, -9.050674], [17736, -9.052027], [2376, -9.065804], [14147, -9.080089], [1781, -9.083227], [28346, -9.085837], [12456, -9.105622], [120018, -9.136099], [119747, -9.145722], [127750, -9.158314], [117101, -9.159964], [439, -9.166036], [4595, -9.166859], [33, -9.167038]], "logprob_of_token": -0.231678, "top1_top2_margin": 2.834908, "top6_top7_margin": 0.113459}, {"gen_index": 23, "token": 12843, "top": [[12843, -0.247178], [14031, -2.894381], [2403, -3.596329], [55333, -4.344783], [19827, -4.558344], [59, -5.814743], [44, -5.83988], [26209, -5.863685], [31663, -6.044907], [946, -6.167519], [8445, -6.308944], [46, -6.371175], [14188, -6.429442], [94021, -6.546793], [63, -6.552769], [14395, -6.559606], [286, -6.617087], [55, -6.678557], [120022, -6.697958], [37720, -6.704596], [55332, -6.70652], [6559, -6.846324], [120007, -7.091007], [1932, -7.184164], [127906, -7.192007], [90236, -7.196934], [735, -7.273976], [58, -7.290267], [29350, -7.312097], [1311, -7.400771], [1829, -7.478912], [121080, -7.519267], [405, -7.559875], [527, -7.566903], [2555, -7.629349], [262, -7.633383], [1275, -7.750726], [80764, -7.755519], [5951, -7.783235], [5274, -7.820912], [10133, -7.834523], [76591, -7.856649], [38555, -7.884761], [766, -7.899975], [68743, -7.919326], [32, -7.978245], [263, -8.015826], [941, -8.01827], [7510, -8.052755], [33335, -8.115278], [622, -8.116375], [8206, -8.118303], [43605, -8.134266], [30877, -8.177786], [4241, -8.183728], [936, -8.278031], [66032, -8.286176], [318, -8.290782], [1409, -8.298084], [63487, -8.3598], [19969, -8.383883], [1204, -8.392466], [2467, -8.430198], [275, -8.438963], [378, -8.475672], [310, -8.490854], [8265, -8.504934], [919, -8.520378], [72714, -8.555634], [1840, -8.59571], [56, -8.631297], [46612, -8.645494], [38336, -8.673792], [4401, -8.705512], [28346, -8.733958], [108744, -8.746327], [2944, -8.766979], [4595, -8.782487], [379, -8.810635], [4739, -8.816564], [12611, -8.839658], [16147, -8.851091], [1781, -8.85414], [900, -8.880723], [5060, -8.886621], [43032, -8.89701], [14161, -8.903631], [20195, -8.903665], [125745, -8.910796], [5218, -8.922383], [14825, -8.936117], [12456, -8.946314], [120014, -8.961105], [2376, -8.992735], [119747, -9.009559], [1427, -9.029793], [17736, -9.066164], [582, -9.087365], [2213, -9.093674], [117101, -9.097491]], "logprob_of_token": -0.247178, "top1_top2_margin": 2.647202, "top6_top7_margin": 0.025137}, {"gen_index": 24, "token": 12843, "top": [[12843, -0.214128], [14031, -3.13718], [2403, -3.344204], [55333, -4.18485], [19827, -4.666062], [26209, -6.024407], [31663, -6.263214], [44, -6.276526], [59, -6.301949], [946, -6.345513], [46, -6.603945], [8445, -6.626819], [94021, -6.627418], [14188, -6.627666], [55332, -6.68739], [14395, -6.767965], [286, -6.773085], [6559, -6.833801], [120022, -6.849443], [63, -6.86543], [55, -6.982706], [37720, -7.007823], [58, -7.20089], [120007, -7.260379], [127906, -7.336646], [90236, -7.350343], [735, -7.533154], [1932, -7.544291], [2555, -7.566051], [1829, -7.632478], [29350, -7.721925], [121080, -7.753932], [80764, -7.782591], [405, -7.824081], [527, -7.832716], [262, -7.88799], [76591, -7.95132], [1275, -7.953814], [10133, -7.968113], [68743, -7.989076], [263, -8.045527], [5274, -8.051754], [5951, -8.057956], [941, -8.138403], [63487, -8.229829], [38555, -8.241015], [766, -8.241325], [1311, -8.273466], [4241, -8.32418], [43605, -8.349545], [66032, -8.371353], [32, -8.371366], [622, -8.373793], [7510, -8.413348], [8265, -8.437603], [1409, -8.497266], [33335, -8.515022], [1204, -8.556646], [72714, -8.610078], [275, -8.610948], [310, -8.635417], [38336, -8.640149], [318, -8.655889], [8206, -8.667795], [378, -8.681098], [2467, -8.71556], [108744, -8.731432], [30877, -8.733162], [19969, -8.752335], [46612, -8.768429], [900, -8.772006], [936, -8.780198], [919, -8.78518], [43032, -8.849567], [28346, -8.889101], [14161, -8.954941], [379, -8.964194], [1840, -8.976694], [120014, -8.986562], [119747, -8.993921], [4595, -9.000901], [20195, -9.010467], [4739, -9.01749], [16147, -9.03238], [14825, -9.041385], [12611, -9.096968], [2944, -9.142255], [12456, -9.145741], [125745, -9.170257], [56, -9.180331], [4401, -9.183774], [5218, -9.227721], [14179, -9.247002], [117101, -9.264717], [1427, -9.290437], [5060, -9.292928], [582, -9.297487], [2213, -9.311987], [33445, -9.316487], [75282, -9.318141]], "logprob_of_token": -0.214128, "top1_top2_margin": 2.923052, "top6_top7_margin": 0.238807}, {"gen_index": 25, "token": 12843, "top": [[12843, -0.265538], [2403, -3.034591], [14031, -3.04766], [55333, -4.04865], [19827, -4.693202], [59, -5.798028], [26209, -5.969791], [31663, -6.014322], [44, -6.037302], [946, -6.038788], [94021, -6.300242], [63, -6.307936], [14188, -6.414771], [46, -6.42212], [8445, -6.461873], [55332, -6.520382], [120022, -6.593705], [55, -6.611568], [14395, -6.77273], [286, -6.784053], [6559, -6.833415], [120007, -6.861824], [37720, -6.881299], [58, -6.933025], [127906, -6.99512], [90236, -7.223176], [735, -7.25436], [29350, -7.351194], [1829, -7.370909], [121080, -7.391142], [1932, -7.391394], [1275, -7.421654], [405, -7.439493], [2555, -7.518685], [80764, -7.678687], [10133, -7.729819], [5951, -7.743013], [262, -7.767571], [766, -7.849842], [76591, -7.866899], [263, -7.892126], [38555, -7.904615], [8265, -7.90542], [5274, -7.917984], [527, -7.919462], [7510, -7.930688], [1311, -7.972456], [941, -8.024473], [63487, -8.056098], [622, -8.065503], [68743, -8.125014], [4241, -8.248845], [378, -8.268532], [43605, -8.275629], [72714, -8.283207], [8206, -8.289446], [32, -8.30131], [33335, -8.321535], [19969, -8.351715], [1409, -8.385988], [66032, -8.395956], [46612, -8.416202], [936, -8.432033], [919, -8.460439], [275, -8.487218], [310, -8.487979], [38336, -8.556888], [4595, -8.604559], [318, -8.6186], [56, -8.635536], [108744, -8.650685], [1840, -8.701834], [379, -8.718692], [2467, -8.721201], [30877, -8.734978], [4401, -8.742085], [1204, -8.742996], [4739, -8.74372], [2944, -8.753919], [12611, -8.767654], [119747, -8.773736], [16147, -8.776005], [43032, -8.78505], [900, -8.836712], [1781, -8.926825], [20195, -8.943761], [33, -8.971169], [120014, -8.9816], [14825, -8.985274], [14792, -9.005939], [1427, -9.024648], [14161, -9.025707], [2376, -9.030956], [125745, -9.050224], [5060, -9.06274], [582, -9.071758], [2457, -9.073089], [75282, -9.084445], [5218, -9.087105], [12456, -9.095039]], "logprob_of_token": -0.265538, "top1_top2_margin": 2.769054, "top6_top7_margin": 0.171764}, {"gen_index": 26, "token": 12843, "top": [[12843, -0.244526], [14031, -2.945174], [2403, -3.139876], [55333, -4.280517], [19827, -4.724515], [59, -5.86404], [44, -5.90944], [26209, -6.160082], [31663, -6.224309], [46, -6.228725], [14188, -6.3938], [946, -6.456692], [58, -6.518472], [8445, -6.538554], [63, -6.561436], [94021, -6.589547], [14395, -6.63392], [120022, -6.717846], [55, -6.797238], [55332, -6.804806], [286, -6.846394], [6559, -6.868908], [37720, -6.962018], [120007, -6.972814], [127906, -7.088172], [735, -7.31505], [90236, -7.371045], [1829, -7.376753], [2555, -7.490581], [29350, -7.534894], [1932, -7.545044], [121080, -7.587615], [405, -7.602117], [80764, -7.669091], [1275, -7.774324], [262, -7.803401], [10133, -7.815508], [1311, -7.859831], [527, -7.983593], [263, -8.000064], [76591, -8.002363], [7510, -8.028229], [941, -8.048061], [766, -8.091551], [5274, -8.095888], [38555, -8.182014], [622, -8.199647], [5951, -8.246529], [68743, -8.251456], [43605, -8.319472], [72714, -8.323129], [1409, -8.323631], [4241, -8.339842], [32, -8.340359], [8265, -8.355734], [900, -8.358541], [63487, -8.403412], [66032, -8.463915], [275, -8.463961], [33335, -8.482094], [38336, -8.501804], [936, -8.530813], [310, -8.540668], [378, -8.574956], [318, -8.616444], [2467, -8.67275], [919, -8.683719], [1204, -8.684638], [19969, -8.756735], [56, -8.776701], [8206, -8.776998], [108744, -8.793671], [14161, -8.864737], [379, -8.885551], [2944, -8.886848], [1840, -8.888523], [33, -8.914837], [4401, -8.945367], [12611, -8.956553], [46612, -8.958999], [28346, -9.008137], [120014, -9.01659], [1781, -9.065075], [4595, -9.069915], [43032, -9.074493], [14825, -9.089511], [30877, -9.091777], [2213, -9.091803], [14792, -9.094147], [4739, -9.121354], [125745, -9.126401], [5218, -9.127823], [14147, -9.151147], [16147, -9.151303], [2376, -9.165552], [119747, -9.16869], [4205, -9.172631], [582, -9.179202], [75282, -9.200432], [2457, -9.203175]], "logprob_of_token": -0.244526, "top1_top2_margin": 2.700648, "top6_top7_margin": 0.0454}, {"gen_index": 27, "token": 12843, "top": [[12843, -0.183944], [14031, -3.184249], [2403, -3.339851], [55333, -4.386891], [19827, -4.790474], [26209, -6.160634], [31663, -6.314657], [59, -6.39459], [44, -6.527627], [46, -6.761196], [55332, -6.832662], [55, -6.838218], [6559, -6.838928], [8445, -6.881375], [14188, -6.899031], [94021, -6.921711], [946, -6.93587], [14395, -6.960927], [58, -6.96507], [120022, -7.025362], [63, -7.171122], [127906, -7.29099], [37720, -7.300254], [286, -7.34022], [120007, -7.361512], [90236, -7.421232], [80764, -7.534492], [735, -7.623866], [2555, -7.733676], [1932, -7.743862], [121080, -7.785328], [1311, -7.885311], [29350, -7.916457], [1829, -7.933031], [76591, -7.999571], [405, -8.061645], [10133, -8.120887], [5274, -8.208388], [262, -8.240246], [527, -8.249656], [1275, -8.256458], [68743, -8.280129], [263, -8.314248], [43605, -8.347807], [72714, -8.429239], [32, -8.434343], [941, -8.447298], [66032, -8.476849], [7510, -8.489903], [38555, -8.507332], [8265, -8.518031], [38336, -8.528805], [5951, -8.559157], [622, -8.607018], [63487, -8.680891], [766, -8.684597], [1409, -8.71366], [378, -8.739038], [4241, -8.741406], [2467, -8.755868], [900, -8.780688], [33335, -8.83185], [936, -8.892642], [919, -8.921653], [310, -8.93756], [108744, -8.95075], [318, -8.962337], [275, -9.009591], [14161, -9.046756], [43032, -9.053792], [19969, -9.099152], [56, -9.11528], [1204, -9.133259], [28346, -9.158978], [125745, -9.213873], [5218, -9.217986], [14177, -9.255486], [119747, -9.276383], [12611, -9.334506], [14147, -9.345155], [2213, -9.358212], [4739, -9.371733], [12456, -9.381187], [33, -9.388857], [117101, -9.394965], [379, -9.401965], [14825, -9.404847], [1848, -9.414029], [46612, -9.421662], [439, -9.42772], [120014, -9.431458], [16147, -9.467169], [816, -9.482255], [835, -9.487323], [582, -9.504294], [1270, -9.506345], [2944, -9.510465], [75282, -9.530055], [8206, -9.548236], [14179, -9.559552]], "logprob_of_token": -0.183944, "top1_top2_margin": 3.000305, "top6_top7_margin": 0.154024}, {"gen_index": 28, "token": 12843, "top": [[12843, -0.155874], [14031, -3.375538], [2403, -3.736369], [55333, -4.471072], [19827, -4.561987], [26209, -6.12228], [31663, -6.306095], [59, -6.744856], [946, -6.787422], [55332, -6.85201], [44, -6.888877], [55, -6.897931], [120022, -6.905454], [6559, -6.943297], [8445, -6.953818], [14395, -6.986226], [46, -7.012233], [14188, -7.102303], [58, -7.128098], [94021, -7.174055], [286, -7.383577], [37720, -7.38862], [127906, -7.399092], [63, -7.409299], [120007, -7.447428], [90236, -7.463384], [1932, -7.680939], [80764, -7.686966], [121080, -7.711813], [1311, -7.73983], [2555, -7.762376], [735, -7.885885], [76591, -8.02421], [5274, -8.084112], [29350, -8.11275], [1829, -8.17134], [68743, -8.173409], [32, -8.295465], [405, -8.323586], [10133, -8.397623], [527, -8.401861], [262, -8.463905], [263, -8.476694], [7510, -8.480103], [5951, -8.528247], [941, -8.540053], [4241, -8.597131], [43605, -8.616352], [66032, -8.630198], [1275, -8.644266], [2467, -8.657372], [38336, -8.681179], [38555, -8.710576], [8265, -8.764619], [378, -8.794606], [72714, -8.811528], [63487, -8.821247], [766, -8.864806], [33335, -8.879791], [1409, -8.880199], [622, -8.932009], [318, -9.030338], [919, -9.068467], [108744, -9.069478], [14161, -9.074523], [900, -9.121707], [19969, -9.12275], [936, -9.145757], [1204, -9.145953], [5218, -9.157815], [310, -9.162601], [125745, -9.187737], [43032, -9.199777], [275, -9.225994], [28346, -9.257968], [119747, -9.286115], [14147, -9.325942], [12456, -9.366677], [14825, -9.378336], [56, -9.3883], [439, -9.411826], [120014, -9.472853], [4739, -9.478938], [379, -9.490264], [2944, -9.504521], [117101, -9.521692], [70341, -9.530246], [12611, -9.531035], [4401, -9.539997], [16147, -9.551395], [582, -9.565123], [46612, -9.573638], [33, -9.590926], [1270, -9.644382], [5060, -9.654759], [2376, -9.657252], [4205, -9.662873], [14179, -9.673566], [1836, -9.678427], [17736, -9.680973]], "logprob_of_token": -0.155874, "top1_top2_margin": 3.219665, "top6_top7_margin": 0.183815}, {"gen_index": 29, "token": 12843, "top": [[12843, -0.200363], [2403, -3.462614], [14031, -3.462834], [55333, -4.220222], [19827, -4.585575], [31663, -5.839258], [26209, -5.892839], [946, -6.19641], [120022, -6.225583], [59, -6.362056], [55332, -6.536539], [44, -6.683349], [55, -6.693326], [8445, -6.748756], [63, -6.793344], [286, -6.829645], [94021, -6.841571], [14188, -6.847879], [14395, -6.873939], [120007, -6.888911], [46, -7.071371], [127906, -7.094482], [121080, -7.186486], [6559, -7.189363], [1311, -7.270302], [37720, -7.314288], [90236, -7.319341], [1932, -7.331357], [5274, -7.609352], [29350, -7.65892], [80764, -7.702688], [735, -7.720404], [58, -7.722038], [405, -7.795843], [2555, -7.797513], [1829, -7.801564], [32, -7.802414], [76591, -7.879306], [5951, -7.935671], [262, -7.979897], [7510, -8.007263], [527, -8.040891], [1275, -8.043516], [68743, -8.053074], [263, -8.150662], [4241, -8.248102], [378, -8.25905], [941, -8.296516], [8265, -8.321211], [766, -8.373769], [38555, -8.386849], [43605, -8.395038], [1409, -8.425322], [19969, -8.438965], [33335, -8.441006], [2467, -8.442286], [936, -8.523866], [4595, -8.551066], [622, -8.575383], [38336, -8.575856], [66032, -8.599195], [72714, -8.661364], [1204, -8.674089], [318, -8.68252], [919, -8.702512], [63487, -8.708706], [2944, -8.732581], [10133, -8.735268], [310, -8.76297], [1840, -8.789398], [108744, -8.858873], [4739, -8.894016], [125745, -8.903896], [2376, -8.916641], [119747, -8.957715], [5218, -8.998535], [1427, -9.003344], [14792, -9.02766], [46612, -9.052646], [4401, -9.059917], [12456, -9.070772], [275, -9.072979], [4205, -9.090795], [12611, -9.100568], [5060, -9.10985], [14161, -9.110985], [120014, -9.115482], [379, -9.12307], [43032, -9.137392], [4731, -9.157755], [14825, -9.164999], [1836, -9.176372], [56, -9.190271], [20195, -9.198586], [900, -9.210082], [14153, -9.217043], [439, -9.221121], [1848, -9.224588], [16147, -9.225458], [14147, -9.231767]], "logprob_of_token": -0.200363, "top1_top2_margin": 3.262251, "top6_top7_margin": 0.053582}, {"gen_index": 30, "token": 12843, "top": [[12843, -0.203416], [14031, -2.941558], [2403, -3.911496], [55333, -4.286592], [19827, -4.493407], [26209, -6.209076], [31663, -6.258585], [59, -6.36902], [44, -6.391716], [14188, -6.47758], [55332, -6.491922], [46, -6.622794], [8445, -6.672137], [94021, -6.693477], [946, -6.717226], [37720, -6.779004], [55, -6.830685], [14395, -6.86359], [120022, -6.884349], [6559, -6.935833], [63, -6.950726], [286, -7.123561], [1311, -7.264499], [120007, -7.302782], [90236, -7.329062], [127906, -7.359162], [58, -7.430628], [1932, -7.435064], [121080, -7.470266], [735, -7.560138], [29350, -7.651911], [80764, -7.718251], [76591, -7.749419], [1829, -7.772657], [2555, -7.796728], [405, -7.83355], [5274, -7.892382], [10133, -7.906152], [1275, -8.012774], [527, -8.024633], [262, -8.050371], [32, -8.07859], [43605, -8.143138], [38555, -8.145509], [68743, -8.166533], [5951, -8.272088], [622, -8.295722], [941, -8.299162], [378, -8.318688], [2467, -8.323562], [919, -8.365564], [7510, -8.365973], [66032, -8.466352], [4241, -8.479696], [263, -8.500422], [19969, -8.554983], [72714, -8.563099], [936, -8.579988], [38336, -8.587337], [766, -8.621472], [33335, -8.648625], [63487, -8.708103], [43032, -8.720751], [310, -8.738504], [108744, -8.799365], [1409, -8.807184], [56, -8.821589], [8265, -8.880153], [12611, -8.895183], [318, -8.9105], [379, -8.952929], [5218, -8.975418], [1204, -8.977339], [14179, -8.98379], [28346, -9.009271], [275, -9.029426], [17736, -9.037602], [900, -9.062423], [46612, -9.063193], [4739, -9.106833], [12456, -9.112885], [8206, -9.119933], [33, -9.130063], [1840, -9.136298], [2944, -9.137265], [125745, -9.138093], [117101, -9.138774], [439, -9.165845], [4595, -9.175396], [14147, -9.197707], [14153, -9.207583], [14161, -9.219347], [119747, -9.243661], [20195, -9.248713], [75282, -9.326109], [1836, -9.33256], [33445, -9.337289], [16147, -9.37337], [127750, -9.398942], [1270, -9.418251]], "logprob_of_token": -0.203416, "top1_top2_margin": 2.738142, "top6_top7_margin": 0.049509}, {"gen_index": 31, "token": 12843, "top": [[12843, -0.26098], [14031, -3.004704], [2403, -3.43276], [55333, -4.081604], [19827, -4.684087], [59, -5.790812], [31663, -5.936701], [120022, -5.942966], [946, -5.944984], [26209, -6.043612], [63, -6.102397], [44, -6.276176], [94021, -6.311699], [286, -6.394808], [8445, -6.451169], [14188, -6.513712], [120007, -6.519024], [55332, -6.564755], [14395, -6.609175], [55, -6.642487], [46, -6.650524], [127906, -6.841175], [37720, -6.879431], [121080, -7.119556], [1932, -7.242862], [6559, -7.27414], [29350, -7.302037], [5274, -7.348013], [1829, -7.39842], [405, -7.405219], [1275, -7.439125], [1311, -7.453202], [90236, -7.491661], [5951, -7.513103], [2555, -7.529513], [735, -7.545623], [262, -7.560679], [7510, -7.615386], [32, -7.61588], [58, -7.67394], [527, -7.689357], [263, -7.715962], [80764, -7.750494], [941, -7.88305], [76591, -7.897067], [766, -7.975237], [38555, -8.004452], [936, -8.017632], [622, -8.024179], [378, -8.049563], [1409, -8.091339], [4241, -8.14861], [43605, -8.157961], [68743, -8.161113], [4595, -8.192659], [33335, -8.221985], [19969, -8.243501], [1840, -8.255536], [2944, -8.273627], [63487, -8.282874], [310, -8.323641], [10133, -8.339299], [8265, -8.390898], [318, -8.391265], [2467, -8.410624], [4739, -8.456206], [72714, -8.490463], [2376, -8.492093], [919, -8.502818], [1836, -8.518168], [66032, -8.519608], [1427, -8.525457], [1204, -8.541756], [14792, -8.638603], [379, -8.666764], [275, -8.669807], [900, -8.680267], [12611, -8.683937], [38336, -8.688877], [56, -8.699487], [46612, -8.718937], [108744, -8.740242], [1781, -8.75069], [12456, -8.753936], [5218, -8.800529], [125745, -8.802252], [14161, -8.817887], [14825, -8.818756], [4205, -8.83536], [120014, -8.836081], [5060, -8.854899], [33, -8.889721], [1410, -8.906679], [14179, -8.913319], [4401, -8.919413], [502, -8.919857], [16147, -8.928661], [14153, -8.939322], [120018, -8.952315], [119747, -8.960005]], "logprob_of_token": -0.26098, "top1_top2_margin": 2.743724, "top6_top7_margin": 0.14589}]}]} From 15d98f7e63124c6f5dc3d237a0f4be383d780b46 Mon Sep 17 00:00:00 2001 From: Luca Barbato Date: Tue, 20 Oct 2026 17:48:41 +0200 Subject: [PATCH 2/2] chore: retrigger the commit-protocol-tag lane after the body fix The lane read the pull request body before the protocol paragraph was corrected; the body now validates (agent-pr-body.py exit 0). No tree change. FOLLOWING_AGENTS_PROTOCOL Following-Agents-Protocol: true AI-Assisted: true Assisted-by: AGENT:zai/glm-5.3-flash [maki]