Skip to content

data(soc): replace placeholder release dates with sourced ones - #149

Merged
Seungpyo1007 merged 2 commits into
developfrom
data/soc-release-dates
Aug 5, 2026
Merged

data(soc): replace placeholder release dates with sourced ones#149
Seungpyo1007 merged 2 commits into
developfrom
data/soc-release-dates

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Aug 5, 2026

Copy link
Copy Markdown
Member

Why

1,954 of the 2,104 SoC records (92.9%) carry a YYYY-01-01 release date. It was invented at import time from the year of a device that used the chip, so it runs late and is precise to nothing — the placeholder, not the chip, is what date-based checks have been measuring.

What changed

113 Qualcomm Snapdragon records now carry the announcement date Wikipedia's Snapdragon SoC list states for that exact model, and cite the page.

year shift (sourced − placeholder) records
−3 7
−2 15
−1 40
0 (day/month gained, year was right) 51

Spot-checked against the real announcements: 600/800 → 2013-01-08 (CES 2013), 801 → 2014-02-24 (MWC), 820 → 2015-03-02, 855 → 2018-12-05 (Snapdragon Summit), 630 → 2017-05-08, 665 → 2019-04-09.

What was deliberately not done

  • Only placeholder dates are touched. A record whose date has a real month and day came from somewhere and is left alone.
  • Matching is whole-token. Snapdragon 8 never claims the 8 Gen 2; a record naming two vendors (mediatek mt6752qualcomm snapdragon 410) is skipped as a mangled import.
  • Exynos, Kirin and the MediaTek list were dropped for want of the data, not the parsing — between them they mention 202/127/594 models and carry 7/6/1 dates on the whole page.
  • The Apple silicon page was dropped after inspection. It has dates, but a row block mixes the launch dates of every product a chip shipped in, so the block's one date is often not the chip's: it dated the A15 Bionic to 2022-11-04 (really 2021-09) and the A18 Pro to 2026-03-04.
  • Files were not moved between year folders. Doing so reorders seed insertion and shifted the public id of ~164 records whose data had not changed; the tidier filing was not worth churning published identifiers.

Dump refreshed for socs at the pinned engine (897cc01): 151 pages — 113 record indexes, 38 score pages. Collection counts are unchanged so the manifest is untouched. python -m app.validate passes.

Closes #1

113 Qualcomm Snapdragon records carried a "YYYY-01-01" date invented at
import time from the year of a device that used the chip, so it ran
late and was precise to nothing. Each now carries the announcement date
Wikipedia's Snapdragon SoC list states for that exact model, and cites
the page.

Only the model's own designation is matched, whole-token: "Snapdragon 8"
never claims the 8 Gen 2, and a record naming two vendors is skipped as
a mangled import. Sourced dates land 1-3 years earlier than the
placeholder for 62 of the 113.

Exynos, Kirin and the MediaTek list were dropped for want of the data,
not the parsing: they mention 202/127/594 models between them and carry
7/6/1 dates. The Apple silicon page has dates but a row block mixes the
launch dates of every product a chip shipped in, which dated the A15
Bionic to 2022-11 (really 2021-09), so it is not trusted either.

Refs #1
@TechEngineBot

Copy link
Copy Markdown
Member

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

Changed records in this PR

6531 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 6341
    "Yellow" : 190
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
soc 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 113 23 90 0 20.4%
smartphone 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨 5763 5761 2 0 100.0%
tablet 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 44 44 0 0 100.0%
watch 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 7 7 0 0 100.0%
pda 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 39 39 0 0 100.0%
gpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟨 481 419 62 0 87.1%
cpu 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 84 48 36 0 57.1%
All 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨 6531 6341 190 0 97.1%

Full-dataset baseline

105742 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 21110
    "Yellow" : 83431
    "Red" : 1201
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 207 24 183 0 11.6%
soc 🟩🟨🟨🟨🟨🟨🟥🟥🟥🟥🟥🟥 2104 146 844 1114 6.9%
smartphone 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 93396 17382 75934 80 18.6%
tablet 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 3455 218 3236 1 6.3%
watch 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 433 18 410 5 4.2%
pda 🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨🟨 140 66 74 0 47.1%
gpu 🟩🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨 2030 664 1366 0 32.7%
cpu 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟥 3977 2592 1384 1 65.2%
All 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 105742 21110 83431 1201 20.0%

Hard violations (forced red):

Count Check
1 !boost_ge_base

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007
Seungpyo1007 merged commit 23d0bc6 into develop Aug 5, 2026
5 checks passed
@Seungpyo1007
Seungpyo1007 deleted the data/soc-release-dates branch August 5, 2026 07:15
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Aug 5, 2026
@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
python integrity_check.py TechAPI/data --strict PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 113 0 0 0 0
smartphone 0 5763 0 0 0 0
tablet 0 44 0 0 0 0
watch 0 7 0 0 0 0
pda 0 39 0 0 0 0
gpu 0 481 0 0 0 0
cpu 0 84 0 0 0 0

Changed record examples

soc modified

  • soc/qualcomm/2013/qualcomm-apq8064-snapdragon-600.json - Qualcomm APQ8064 Snapdragon 600
  • soc/qualcomm/2013/qualcomm-apq8064t-snapdragon-600.json - Qualcomm APQ8064T Snapdragon 600
  • soc/qualcomm/2013/qualcomm-msm8274-or-msm8974-snapdragon-800.json - Qualcomm MSM8274 or MSM8974 Snapdragon 800
  • soc/qualcomm/2013/qualcomm-msm8274-snapdragon-800.json - Qualcomm MSM8274 Snapdragon 800
  • soc/qualcomm/2013/qualcomm-msm8974-snapdragon-800.json - Qualcomm MSM8974 Snapdragon 800
  • soc/qualcomm/2013/qualcomm-snapdragon-600-apq8064t.json - Qualcomm Snapdragon 600 APQ8064T
  • soc/qualcomm/2013/qualcomm-snapdragon-800-msm8274ab-v2.json - Qualcomm Snapdragon 800 MSM8274AB V2
  • soc/qualcomm/2014/qualcomm-apq8064-pro-snapdragon-600.json - Qualcomm APQ8064 Pro Snapdragon 600
  • soc/qualcomm/2014/qualcomm-apq8074ab-snapdragon-801.json - Qualcomm APQ8074AB Snapdragon 801
  • soc/qualcomm/2014/qualcomm-apq8084-snapdragon-805.json - Qualcomm APQ8084 Snapdragon 805
  • soc/qualcomm/2014/qualcomm-msm8274ab-snapdragon-800.json - Qualcomm MSM8274AB Snapdragon 800
  • soc/qualcomm/2014/qualcomm-msm8674-1-snapdragon-800.json - Qualcomm MSM8674-1 Snapdragon 800
  • soc/qualcomm/2014/qualcomm-msm8974aa-snapdragon-801.json - Qualcomm MSM8974AA Snapdragon 801
  • soc/qualcomm/2014/qualcomm-msm8974ab-msm8974ac-snapdragon-801.json - Qualcomm MSM8974AB/ MSM8974AC Snapdragon 801
  • soc/qualcomm/2014/qualcomm-msm8974ab-snapdragon-801.json - Qualcomm MSM8974AB Snapdragon 801
  • ... 98 more

smartphone modified

  • smartphone/acer/2009/dx650/acer-dx650-beridzeg45-3564-1gb.json - Acer DX650
  • smartphone/acer/2012/acer-cloudmobile-s500.json - Acer CloudMobile S500
  • smartphone/acer/2012/acer-liquid-z110-duo-z1-dual-sim.json - Acer Liquid Z110 Duo / Z1 Dual SIM
  • smartphone/acer/2012/acer-liquid-z110-z1.json - Acer Liquid Z110 Z1
  • smartphone/acer/2012/cloudmobile-s500/acer-cloudmobile-s500-beridzeg45-3863-1gb.json - Acer CloudMobile S500
  • smartphone/acer/2013/acer-liquid-e2-duo-v370.json - Acer Liquid E2 Duo V370
  • smartphone/acer/2013/acer-liquid-e2-v370.json - Acer Liquid E2 V370
  • smartphone/acer/2013/acer-liquid-s2-s520-acer-hamingway.json - Acer Liquid S2 S520 (Acer Hamingway)
  • smartphone/acer/2013/acer-liquid-z130-duo-z3-dual-sim.json - Acer Liquid Z130 Duo / Z3 Dual SIM
  • smartphone/acer/2013/acer-liquid-z130-z3.json - Acer Liquid Z130 Z3
  • smartphone/acer/2013/liquid-e2/acer-liquid-e2-beridzeg45-3946-1gb.json - Acer Liquid E2
  • smartphone/acer/2013/liquid-s1/acer-liquid-s1-beridzeg45-6365-1gb.json - Acer Liquid S1
  • smartphone/acer/2014/acer-liquid-e600.json - Acer Liquid E600
  • smartphone/acer/2014/liquid-e600/acer-liquid-e600-beridzeg45-334-1gb.json - Acer Liquid E600
  • smartphone/acer/2015/acer-liquid-z530-lte-16gb-t02.json - Acer Liquid Z530 LTE 16GB T02
  • ... 5748 more

tablet modified

  • tablet/alcatel/2014/pop-8s/alcatel-pop-8s-beridzeg45-3173-1gb.json - alcatel Pop 8S
  • tablet/amazon/2013/kindle-fire-hdx/amazon-kindle-fire-hdx-beridzeg45-1801-2gb.json - Amazon Kindle Fire HDX
  • tablet/archos/2010/archos-28-internet-tablet/archos-28-internet-tablet-4gb.json - Archos 28 Internet Tablet 4GB
  • tablet/archos/2010/archos-28-internet-tablet/archos-28-internet-tablet-8gb.json - Archos 28 Internet Tablet 8GB
  • tablet/archos/2010/archos-32-internet-tablet/archos-32-internet-tablet-8gb.json - Archos 32 Internet Tablet 8GB
  • tablet/archos/2010/archos-43-internet-tablet/archos-43-internet-tablet-16gb.json - Archos 43 Internet Tablet 16GB
  • tablet/archos/2010/archos-43-internet-tablet/archos-43-internet-tablet-8gb.json - Archos 43 Internet Tablet 8GB
  • tablet/asus/2012/padfone/asus-padfone-beridzeg45-2941-1gb.json - Asus PadFone
  • tablet/asus/2013/padfone-infinity-2/asus-padfone-infinity-2-beridzeg45-1851-2gb.json - Asus PadFone Infinity 2
  • tablet/blackberry/2010/playbook/blackberry-playbook-beridzeg45-1267-1gb.json - BlackBerry Playbook
  • tablet/dell/2013/venue-7/dell-venue-7-beridzeg45-6128-2gb.json - Dell Venue 7
  • tablet/dell/2013/venue-8/dell-venue-8-beridzeg45-98-2gb.json - Dell Venue 8
  • tablet/honor/2018/8x-max/honor-8x-max-beridzeg45-1592-4gb.json - Honor 8X Max
  • tablet/htc/2011/flyer-wi-fi/htc-flyer-wi-fi-beridzeg45-6806-1gb.json - HTC Flyer Wi-Fi
  • tablet/htc/2011/flyer/htc-flyer-beridzeg45-5913-1gb.json - HTC Flyer
  • ... 29 more

watch modified

  • watch/samsung/2014/gear-s/samsung-gear-s-beridzeg45-1268-0-5gb.json - Samsung Gear S
  • watch/samsung/2015/gear-s2-classic/samsung-gear-s2-classic-beridzeg45-690-0-5gb.json - Samsung Gear S2 classic
  • watch/samsung/2015/gear-s2/samsung-gear-s2-beridzeg45-1626-0-5gb.json - Samsung Gear S2
  • watch/samsung/2016/gear-s2-classic-3g/samsung-gear-s2-classic-3g-beridzeg45-490-0-5gb.json - Samsung Gear S2 classic 3G
  • watch/samsung/2016/gear-s3-classic/samsung-gear-s3-classic-beridzeg45-2767-0-75gb.json - Samsung Gear S3 classic
  • watch/samsung/2016/gear-s3-frontier-lte/samsung-gear-s3-frontier-lte-beridzeg45-5013-0-75gb.json - Samsung Gear S3 frontier LTE
  • watch/samsung/2016/gear-s3-frontier/samsung-gear-s3-frontier-beridzeg45-2426-0-75gb.json - Samsung Gear S3 frontier

pda modified

  • pda/dell/2002/dell-axim-x5-advanced/dell-axim-x5-advanced.json - Dell Axim X5 Advanced
  • pda/dell/2002/dell-axim-x5-basic/dell-axim-x5-basic.json - Dell Axim X5 Basic
  • pda/fujitsu-siemens/2006/fujitsu-siemens-rpda-n520c/fujitsu-siemens-rpda-n520c.json - Fujitsu-Siemens RPDA N520c
  • pda/fujitsu-siemens/2006/fujitsu-siemens-rpda-n520p/fujitsu-siemens-rpda-n520p.json - Fujitsu-Siemens RPDA N520p
  • pda/fujitsu-siemens/2006/fujitsu-siemens-rpda-n560c/fujitsu-siemens-rpda-n560c.json - Fujitsu-Siemens RPDA N560c
  • pda/fujitsu-siemens/2006/fujitsu-siemens-rpda-n560e/fujitsu-siemens-rpda-n560e.json - Fujitsu-Siemens RPDA N560e
  • pda/fujitsu-siemens/2006/fujitsu-siemens-rpda-n560p/fujitsu-siemens-rpda-n560p.json - Fujitsu-Siemens RPDA N560p
  • pda/i-mate/2006/i-mate-pda-l-techfaith-pda-l/i-mate-pda-l-techfaith-pda-l.json - I-Mate PDA-L (TechFaith PDA-L)
  • pda/i-mate/2006/i-mate-pda-n-htc-galaxy-100/i-mate-pda-n-htc-galaxy-100.json - I-Mate PDA-N (HTC Galaxy 100)
  • pda/palm/2000/palm-iiic/palm-iiic.json - Palm IIIc
  • pda/palm/2000/palm-iiixe/palm-iiixe.json - Palm IIIxe
  • pda/palm/2000/palm-m100/palm-m100.json - Palm m100
  • pda/palm/2000/palm-viix/palm-viix.json - Palm VIIx
  • pda/palm/2001/palm-m105/palm-m105.json - Palm m105
  • pda/palm/2001/palm-m125/palm-m125.json - Palm m125
  • ... 24 more

gpu modified

  • gpu/amd/2011/enterprise/firepro-2270.json - FirePro 2270
  • gpu/amd/2012/enterprise/firepro-s10000-passive.json - FirePro S10000 Passive
  • gpu/amd/2012/enterprise/firepro-s10000.json - FirePro S10000
  • gpu/amd/2016/enterprise/firepro-s9300-x2.json - FirePro S9300 X2
  • gpu/ati/2003/consumer/radeon-9100.json - Radeon 9100
  • gpu/ati/2004/consumer/radeon-x600-se.json - Radeon X600 SE
  • gpu/ati/2004/consumer/radeon-x600.json - Radeon X600
  • gpu/ati/2004/consumer/radeon-x700.json - Radeon X700
  • gpu/ati/2005/consumer/radeon-x1800-crossfire-edition.json - Radeon X1800 CrossFire Edition
  • gpu/ati/2010/enterprise/firepro-2460-multi-view.json - FirePro 2460 Multi-View
  • gpu/nvidia/1995/consumer/stg-2000.json - STG-2000
  • gpu/nvidia/2000/consumer/geforce2-go.json - GeForce2 Go
  • gpu/nvidia/2001/consumer/geforce2-go-100.json - GeForce2 Go 100
  • gpu/nvidia/2001/consumer/geforce2-go-200.json - GeForce2 Go 200
  • gpu/nvidia/2003/consumer/geforce-fx-5700-ultra.json - GeForce FX 5700 Ultra
  • ... 466 more

cpu modified

  • cpu/amd/2009/consumer/amd-athlon-7450-dual-core.json - AMD Athlon 7450 Dual-Core
  • cpu/amd/2009/consumer/amd-athlon-7550-dual-core.json - AMD Athlon 7550 Dual-Core
  • cpu/amd/2009/consumer/amd-athlon-7750-dual-core.json - AMD Athlon 7750 Dual-Core
  • cpu/amd/2009/consumer/amd-athlon-7850-dual-core.json - AMD Athlon 7850 Dual-Core
  • cpu/amd/2009/consumer/amd-athlon-dual-core-4050e.json - AMD Athlon Dual Core 4050e
  • cpu/amd/2009/consumer/amd-athlon-dual-core-4450b.json - AMD Athlon Dual Core 4450B
  • cpu/amd/2009/consumer/amd-athlon-dual-core-4450e.json - AMD Athlon Dual Core 4450e
  • cpu/amd/2009/consumer/amd-athlon-dual-core-4850e.json - AMD Athlon Dual Core 4850e
  • cpu/amd/2009/consumer/amd-athlon-dual-core-5000b.json - AMD Athlon Dual Core 5000B
  • cpu/amd/2009/consumer/amd-athlon-dual-core-5050e.json - AMD Athlon Dual Core 5050e
  • cpu/amd/2009/consumer/amd-athlon-dual-core-5200b.json - AMD Athlon Dual Core 5200B
  • cpu/amd/2009/consumer/amd-athlon-dual-core-5400b.json - AMD Athlon Dual Core 5400B
  • cpu/amd/2009/consumer/amd-athlon-ii-x2-215.json - AMD Athlon II X2 215
  • cpu/amd/2009/consumer/amd-athlon-ii-x2-235e.json - AMD Athlon II X2 235e
  • cpu/amd/2009/consumer/amd-athlon-ii-x2-240.json - AMD Athlon II X2 240
  • ... 69 more

Heuristic review

  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 24 183 0 207 11.6%
soc 2104 123 1981 0 2104 5.8%
smartphone 93396 17365 76031 0 93396 18.6%
tablet 3455 218 3237 0 3455 6.3%
watch 433 18 415 0 433 4.2%
pda 140 66 74 0 140 47.1%
gpu 2030 663 1367 0 2030 32.7%
cpu 3977 2586 1391 0 3977 65.0%
all 105742 21063 84679 0 105742 19.9%

Warning

Tracked verified coverage is below 50% for watch 4.2% (18/433), soc 5.8% (123/2104), tablet 6.3% (218/3455), brand 11.6% (24/207), smartphone 18.6% (17365/93396), all 19.9% (21063/105742), gpu 32.7% (663/2030), pda 47.1% (66/140).
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py --strict
loaded CPU=3977 GPU=2030
✅ integrity gate: no hard anomalies.
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 152
GPU cross-source ratio outliers + sanity 18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Massive dataset rebuild: CPU + brand + GPU + smartphone + SoC (1989-2026)

2 participants