{"id":3643,"date":"2026-11-17T13:30:47","date_gmt":"2026-11-17T20:30:47","guid":{"rendered":"https:\/\/yyc.ninja\/?p=3643"},"modified":"2026-11-17T13:30:47","modified_gmt":"2026-11-17T20:30:47","slug":"gpu-mods","status":"publish","type":"post","link":"https:\/\/yyc.ninja\/index.php\/2026\/11\/17\/gpu-mods\/","title":{"rendered":"Gpu Mods"},"content":{"rendered":"<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1200\" height=\"630\" src=\"https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover.png\" alt=\"Gpu Mods\" class=\"wp-image-3642\" sizes=\"auto, (max-width: 1200px) 100vw, 1200px\" srcset=\"https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover.png 1200w, https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-300x158.png 300w, https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-1024x538.png 1024w, https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-768x403.png 768w, https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-100x53.png 100w\" \/><\/figure>\n<p class=\"wp-block-paragraph\"><strong>You can enable more Tensor Core power on your GeForce card, but don\u2019t expect to double your AI performance.<\/strong><\/p>\n<p class=\"wp-block-paragraph\">By now you\u2019ve probably seen the posts, the microbenchmarks, and the \u201cRTX 4090 now hits 330 TFLOPS\u201d screenshots. The software locks that kept consumer cards at roughly half the matrix-multiply rate of their professional counterparts on certain FP16\/BF16 (and related TF32) Tensor Core paths have been cracked. On RTX 20-, 30-, and 40-series cards the enables work, they are temporary (reset on reboot), they don\u2019t require VBIOS flashing in the main projects, and the peak numbers are real.<\/p>\n<p class=\"wp-block-paragraph\">What those peak numbers do <strong>not<\/strong> tell you is how much faster your actual AI workloads will run.<\/p>\n<h4 class=\"wp-block-heading\">What the enable actually delivers<\/h4>\n<p class=\"wp-block-paragraph\">In pure instruction throughput the gains look dramatic:<\/p>\n<ul class=\"wp-block-list\">\n<li>RTX 3090 Ti: BF16 matrix multiply roughly 87.5 \u2192 157 TFLOPS (~80 % increase). Similar jumps on TF32.<\/li>\n<li>RTX 4090: FP16\/BF16 Tensor Core peaks essentially double (e.g. ~166 \u2192 332 TFLOPS).<\/li>\n<li>Turing cards (2080 Ti and friends) and many Ampere\/Ada parts show comparable microbenchmark doublings.<\/li>\n<\/ul>\n<p class=\"wp-block-paragraph\">These are the numbers that travel well on social media. They measure how fast the Tensor Cores can chew through the specific matrix operations that were previously rate-limited. Once the software throttle is removed, the silicon is capable of the higher rate, until something else becomes the bottleneck.<\/p>\n<h4 class=\"wp-block-heading\">Why real applications don\u2019t double<\/h4>\n<p class=\"wp-block-paragraph\">Most local AI work is not pure Tensor Core instruction throughput.<\/p>\n<p class=\"wp-block-paragraph\"><strong>Prompt \/ prefill processing<\/strong> (the compute-heavy phase of LLMs) is the part that benefits most. Independent reports commonly show 14-36 % faster prefill, occasionally a bit more depending on model size, batch size, and precision. That is a solid, measurable improvement (especially on longer contexts) but it is nowhere near a 2\u00d7 wall-clock speedup.<\/p>\n<p class=\"wp-block-paragraph\"><strong>Token generation (decode)<\/strong> is almost always limited by memory bandwidth and KV-cache movement. Enabling extra Tensor Core FLOPS does almost nothing here. If your daily use is interactive chat or continuous generation, the practical gain is often in the single-digit percentages or flat.<\/p>\n<p class=\"wp-block-paragraph\">Image-generation and fine-tuning workloads sit somewhere in between: they see useful but still sub-linear improvements, and they still run into the card\u2019s power and thermal limits. The enable does not raise the TDP or the power-delivery ceiling. Once the card hits its power wall or thermal throttle, the extra theoretical FLOPS stay theoretical.<\/p>\n<p class=\"wp-block-paragraph\">Gaming performance is unaffected, which is expected, the paths being enabled are the AI\/compute matrix routes, not the graphics pipelines.<\/p>\n<h4 class=\"wp-block-heading\">Practical realities<\/h4>\n<ul class=\"wp-block-list\">\n<li>The tools (gpu-enable and its Ada\/Turing variants) are primarily Linux kernel-module or pre-driver approaches. Windows\/UEFI paths exist but are less mature. Support is most solid on the 30-series; 20- and 40-series work is still more experimental.<\/li>\n<li>Changes are not permanent. A reboot returns the card to stock behavior.<\/li>\n<li>Stability, boot reliability, and long-term risk are on you. These are unofficial modifications. Warranty implications exist.<\/li>\n<li>Power and cooling still matter. A card that was already near its limit will simply hit that limit sooner at the higher clock\/throughput.<\/li>\n<\/ul>\n<h4 class=\"wp-block-heading\">Setting the right expectation<\/h4>\n<p class=\"wp-block-paragraph\">If your workload is heavily prefill- or training-bound and you are already on Linux, the enable can give a worthwhile free performance bump, think \u201cnoticeably faster prompt processing\u201d rather than \u201ctwice as fast overall.\u201d If most of your time is spent generating tokens, or if you are bandwidth-starved, the difference will be modest to negligible.<\/p>\n<p class=\"wp-block-paragraph\">The silicon was always capable of more on those Tensor Core paths. NVIDIA simply software-limited the consumer parts. Removing that limit restores the missing throughput, but it does not magically remove memory-bandwidth walls, power limits, or the fact that real models are not pure GEMM microbenchmarks.<\/p>\n<p class=\"wp-block-paragraph\">So yes, you can improve your card\u2019s AI output. Just don\u2019t plan your hardware decisions around the doubled peak TFLOPS figures. The realistic gains are real, useful for the right workloads, and still well short of a full doubling of end-to-end performance.<\/p>\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">Get the next one in your inbox<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Enjoyed this? I write about local AI, self-hosting, and cloud cost ninjutsu. Join the Ninja Dispatch for occasional, high-signal notes. No fluff.<\/p>\n\n\n\n\t\t\t<form id=\"sib_signup_form_2\" method=\"post\" class=\"sib_signup_form\">\n\t\t\t\t<div class=\"sib_loader\" style=\"display:none;\"><img\n\t\t\t\t\t\t\tsrc=\"https:\/\/yyc.ninja\/wp-includes\/images\/spinner.gif\" alt=\"loader\"><\/div>\n\t\t\t\t<input type=\"hidden\" name=\"sib_form_action\" value=\"subscribe_form_submit\">\n\t\t\t\t<input type=\"hidden\" name=\"sib_form_id\" value=\"2\">\n                <input type=\"hidden\" name=\"sib_form_alert_notice\" value=\"Please fill out all required fields.\">\n                <input type=\"hidden\" name=\"sib_form_invalid_email_notice\" value=\"Please enter a valid email address.\">\n                <input type=\"hidden\" name=\"sib_security\" value=\"ec07c95cd0\">\n\t\t\t\t<div class=\"sib_signup_box_inside_2\">\n\t\t\t\t\t<div style=\"\/*display:none*\/\" class=\"sib_msg_disp\">\n\t\t\t\t\t<\/div>\n                    \t\t\t\t\t<p class=\"sib-email-area\">\n    <input type=\"email\" class=\"sib-email-area\" name=\"email\" placeholder=\"you@example.com\" required=\"required\">\n<\/p>\n<p class=\"sib-FIRSTNAME-area\">\n    <input type=\"text\" class=\"sib-FIRSTNAME-area\" name=\"FIRSTNAME\" placeholder=\"First name (optional)\">\n<\/p>\n<input type=\"hidden\" class=\"sib-SOURCE_DOMAIN-area\" name=\"SOURCE_DOMAIN\" value=\"yyc.ninja\">\n<input type=\"hidden\" class=\"sib-SIGNUP_SOURCE-area\" name=\"SIGNUP_SOURCE\" value=\"post\">\n<p>\n    <input type=\"submit\" class=\"sib-default-btn\" value=\"Join the Ninja Dispatch\">\n<\/p>\n<p class=\"ninja-fineprint\">No spam. Unsubscribe anytime.<\/p>\t\t\t\t<\/div>\n\t\t\t<\/form>\n\t\t\t<style>\n\t\t\t\tform#sib_signup_form_2{background:#192a3d;border-radius:10px;padding:16px;font-family:inherit}form#sib_signup_form_2 input[type=text],form#sib_signup_form_2 input[type=email],form#sib_signup_form_2 select{width:100%;box-sizing:border-box;margin:0 0 10px 0;padding:10px 12px;border:1px solid #33465c;border-radius:8px;background:#0f1c29;color:#e8eef5;font-size:14px}form#sib_signup_form_2 input::placeholder{color:#8a9bb0}form#sib_signup_form_2 .sib-default-btn{width:100%;margin:2px 0 0 0;padding:11px 14px;background:#e63946;color:#ffffff;border:0;border-radius:8px;font-size:15px;font-weight:600;cursor:pointer}form#sib_signup_form_2 .sib-default-btn:hover{background:#d02f3c}form#sib_signup_form_2 p{margin:0 0 10px 0}form#sib_signup_form_2 .ninja-fineprint{margin:8px 0 0;font-size:11px;color:#8a9bb0;text-align:center}form#sib_signup_form_2 p.sib-alert-message {\n    padding: 6px 12px;\n    margin-bottom: 20px;\n    border: 1px solid transparent;\n    border-radius: 4px;\n    -webkit-box-sizing: border-box;\n    -moz-box-sizing: border-box;\n    box-sizing: border-box;\n}\nform#sib_signup_form_2 p.sib-alert-message-error {\n    background-color: #f2dede;\n    border-color: #ebccd1;\n    color: #a94442;\n}\nform#sib_signup_form_2 p.sib-alert-message-success {\n    background-color: #dff0d8;\n    border-color: #d6e9c6;\n    color: #3c763d;\n}\nform#sib_signup_form_2 p.sib-alert-message-warning {\n    background-color: #fcf8e3;\n    border-color: #faebcc;\n    color: #8a6d3b;\n}\n\t\t\t<\/style>\n\t\t\t\n","protected":false},"excerpt":{"rendered":"<p>By now you\u2019ve probably seen the posts, the microbenchmarks, and the \u201cRTX 4090 now hits 330 TFLOPS\u201d screenshots. The software locks that kept consumer cards at roughly half the matrix-multiply rate of their professional counterparts on certain FP16\/BF16 (and related TF32) Tensor Core paths have been\u2026<\/p>\n","protected":false},"author":1,"featured_media":3642,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[],"class_list":["post-3643","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-how-to"],"featured_image_urls_v2":{"full":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover.png",1200,630,false],"thumbnail":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-150x150.png",150,150,true],"medium":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-300x158.png",300,158,true],"medium_large":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-768x403.png",768,403,true],"large":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-1024x538.png",1024,538,true],"RoboGalleryMansoryImagesCenter":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-600x630.png",600,630,true],"RoboGalleryPreload":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover-100x53.png",100,53,true],"1536x1536":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover.png",1200,630,false],"2048x2048":["https:\/\/yyc.ninja\/wp-content\/uploads\/2026\/11\/cg-gpu-mods-cover.png",1200,630,false]},"post_excerpt_stackable_v2":"<p>By now you\u2019ve probably seen the posts, the microbenchmarks, and the \u201cRTX 4090 now hits 330 TFLOPS\u201d screenshots. The software locks that kept consumer cards at roughly half the matrix-multiply rate of their professional counterparts on certain FP16\/BF16 (and related TF32) Tensor Core paths have been\u2026<\/p>\n","category_list_v2":"<a href=\"https:\/\/yyc.ninja\/index.php\/category\/how-to\/\" rel=\"category tag\">How To Ninja<\/a>","author_info_v2":{"name":"YYC Ninja","url":"https:\/\/yyc.ninja\/index.php\/author\/admin\/"},"comments_num_v2":"0 comments","_links":{"self":[{"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/posts\/3643","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/comments?post=3643"}],"version-history":[{"count":1,"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/posts\/3643\/revisions"}],"predecessor-version":[{"id":3650,"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/posts\/3643\/revisions\/3650"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/media\/3642"}],"wp:attachment":[{"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/media?parent=3643"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/categories?post=3643"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/yyc.ninja\/index.php\/wp-json\/wp\/v2\/tags?post=3643"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}