{"id":138,"date":"2025-01-10T01:15:23","date_gmt":"2025-01-10T01:15:23","guid":{"rendered":"https:\/\/synthint.ai\/?p=138"},"modified":"2025-01-10T02:26:06","modified_gmt":"2025-01-10T02:26:06","slug":"embedded-ai-at-the-edge","status":"publish","type":"post","link":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/","title":{"rendered":"Embedded AI at the Edge"},"content":{"rendered":"\n

October 3, 2024<\/em><\/em><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Today I gave a presentation on Embedded AI at the Edge to the Akron Linux Users Group. The focus of the discussion centered around the use of Large Language Models in embedded systems. We delved into how LLMs work through the use of the Transformer Architecture, as seen on the left. A demo of a working LLM running on a microcontroller was shared with the group.<\/p>\n\n\n\n

Here is a link<\/a> to the presentation.<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

October 3, 2024 Today I gave a presentation on Embedded AI at the Edge to the Akron Linux Users Group. The focus of the discussion centered around the use of Large Language Models in embedded systems. We delved into how LLMs work through the use of the Transformer Architecture, as seen on the left. A […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17],"tags":[11,15],"class_list":["post-138","post","type-post","status-publish","format-standard","hentry","category-embedded-systems","tag-ai","tag-edge-computing"],"yoast_head":"\nEmbedded AI at the Edge - SynthInt<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Embedded AI at the Edge - SynthInt\" \/>\n<meta property=\"og:description\" content=\"October 3, 2024 Today I gave a presentation on Embedded AI at the Edge to the Akron Linux Users Group. The focus of the discussion centered around the use of Large Language Models in embedded systems. We delved into how LLMs work through the use of the Transformer Architecture, as seen on the left. A […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/\" \/>\n<meta property=\"og:site_name\" content=\"SynthInt\" \/>\n<meta property=\"article:published_time\" content=\"2025-01-10T01:15:23+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-01-10T02:26:06+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/synthint.ai\/wp-content\/uploads\/2024\/11\/image.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1259\" \/>\n\t<meta property=\"og:image:height\" content=\"1846\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"chris\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@synthintai\" \/>\n<meta name=\"twitter:site\" content=\"@synthintai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"chris\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/\"},\"author\":{\"name\":\"chris\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/#\\\/schema\\\/person\\\/f2fd1274f7fdb33f7f3081ef3e81007a\"},\"headline\":\"Embedded AI at the Edge\",\"datePublished\":\"2025-01-10T01:15:23+00:00\",\"dateModified\":\"2025-01-10T02:26:06+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/\"},\"wordCount\":79,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/synthint.ai\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/image-698x1024.png\",\"keywords\":[\"AI\",\"Edge Computing\"],\"articleSection\":[\"Embedded Systems\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/\",\"url\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/\",\"name\":\"Embedded AI at the Edge - SynthInt\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/synthint.ai\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/image-698x1024.png\",\"datePublished\":\"2025-01-10T01:15:23+00:00\",\"dateModified\":\"2025-01-10T02:26:06+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/#primaryimage\",\"url\":\"https:\\\/\\\/synthint.ai\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/image.png\",\"contentUrl\":\"https:\\\/\\\/synthint.ai\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/image.png\",\"width\":1259,\"height\":1846},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/2025\\\/01\\\/10\\\/embedded-ai-at-the-edge\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/synthint.ai\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Embedded AI at the Edge\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/#website\",\"url\":\"https:\\\/\\\/synthint.ai\\\/\",\"name\":\"SynthInt\",\"description\":\"Embedded Machine Learning for Intelligent Devices\",\"publisher\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/synthint.ai\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/#organization\",\"name\":\"SynthInt Technologies, LLC\",\"url\":\"https:\\\/\\\/synthint.ai\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/synthint.ai\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/cropped-logo-1.png\",\"contentUrl\":\"https:\\\/\\\/synthint.ai\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/cropped-logo-1.png\",\"width\":512,\"height\":512,\"caption\":\"SynthInt Technologies, LLC\"},\"image\":{\"@id\":\"https:\\\/\\\/synthint.ai\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/synthintai\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/synthint.ai\\\/#\\\/schema\\\/person\\\/f2fd1274f7fdb33f7f3081ef3e81007a\",\"name\":\"chris\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8c3175e19ecbdbbaab4b7d614ac3b41ef9565771957a4383affdc0145870efdf?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8c3175e19ecbdbbaab4b7d614ac3b41ef9565771957a4383affdc0145870efdf?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8c3175e19ecbdbbaab4b7d614ac3b41ef9565771957a4383affdc0145870efdf?s=96&d=mm&r=g\",\"caption\":\"chris\"},\"sameAs\":[\"https:\\\/\\\/synthint.ai\"],\"url\":\"https:\\\/\\\/synthint.ai\\\/index.php\\\/author\\\/chris\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Embedded AI at the Edge - SynthInt","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/","og_locale":"en_US","og_type":"article","og_title":"Embedded AI at the Edge - SynthInt","og_description":"October 3, 2024 Today I gave a presentation on Embedded AI at the Edge to the Akron Linux Users Group. The focus of the discussion centered around the use of Large Language Models in embedded systems. We delved into how LLMs work through the use of the Transformer Architecture, as seen on the left. A […]","og_url":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/","og_site_name":"SynthInt","article_published_time":"2025-01-10T01:15:23+00:00","article_modified_time":"2025-01-10T02:26:06+00:00","og_image":[{"width":1259,"height":1846,"url":"https:\/\/synthint.ai\/wp-content\/uploads\/2024\/11\/image.png","type":"image\/png"}],"author":"chris","twitter_card":"summary_large_image","twitter_creator":"@synthintai","twitter_site":"@synthintai","twitter_misc":{"Written by":"chris","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/#article","isPartOf":{"@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/"},"author":{"name":"chris","@id":"https:\/\/synthint.ai\/#\/schema\/person\/f2fd1274f7fdb33f7f3081ef3e81007a"},"headline":"Embedded AI at the Edge","datePublished":"2025-01-10T01:15:23+00:00","dateModified":"2025-01-10T02:26:06+00:00","mainEntityOfPage":{"@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/"},"wordCount":79,"commentCount":0,"publisher":{"@id":"https:\/\/synthint.ai\/#organization"},"image":{"@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/#primaryimage"},"thumbnailUrl":"https:\/\/synthint.ai\/wp-content\/uploads\/2024\/11\/image-698x1024.png","keywords":["AI","Edge Computing"],"articleSection":["Embedded Systems"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/","url":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/","name":"Embedded AI at the Edge - SynthInt","isPartOf":{"@id":"https:\/\/synthint.ai\/#website"},"primaryImageOfPage":{"@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/#primaryimage"},"image":{"@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/#primaryimage"},"thumbnailUrl":"https:\/\/synthint.ai\/wp-content\/uploads\/2024\/11\/image-698x1024.png","datePublished":"2025-01-10T01:15:23+00:00","dateModified":"2025-01-10T02:26:06+00:00","breadcrumb":{"@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/#primaryimage","url":"https:\/\/synthint.ai\/wp-content\/uploads\/2024\/11\/image.png","contentUrl":"https:\/\/synthint.ai\/wp-content\/uploads\/2024\/11\/image.png","width":1259,"height":1846},{"@type":"BreadcrumbList","@id":"https:\/\/synthint.ai\/index.php\/2025\/01\/10\/embedded-ai-at-the-edge\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/synthint.ai\/"},{"@type":"ListItem","position":2,"name":"Embedded AI at the Edge"}]},{"@type":"WebSite","@id":"https:\/\/synthint.ai\/#website","url":"https:\/\/synthint.ai\/","name":"SynthInt","description":"Embedded Machine Learning for Intelligent Devices","publisher":{"@id":"https:\/\/synthint.ai\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/synthint.ai\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/synthint.ai\/#organization","name":"SynthInt Technologies, LLC","url":"https:\/\/synthint.ai\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/synthint.ai\/#\/schema\/logo\/image\/","url":"https:\/\/synthint.ai\/wp-content\/uploads\/2024\/05\/cropped-logo-1.png","contentUrl":"https:\/\/synthint.ai\/wp-content\/uploads\/2024\/05\/cropped-logo-1.png","width":512,"height":512,"caption":"SynthInt Technologies, LLC"},"image":{"@id":"https:\/\/synthint.ai\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/synthintai"]},{"@type":"Person","@id":"https:\/\/synthint.ai\/#\/schema\/person\/f2fd1274f7fdb33f7f3081ef3e81007a","name":"chris","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/8c3175e19ecbdbbaab4b7d614ac3b41ef9565771957a4383affdc0145870efdf?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/8c3175e19ecbdbbaab4b7d614ac3b41ef9565771957a4383affdc0145870efdf?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8c3175e19ecbdbbaab4b7d614ac3b41ef9565771957a4383affdc0145870efdf?s=96&d=mm&r=g","caption":"chris"},"sameAs":["https:\/\/synthint.ai"],"url":"https:\/\/synthint.ai\/index.php\/author\/chris\/"}]}},"_links":{"self":[{"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/posts\/138","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/comments?post=138"}],"version-history":[{"count":3,"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/posts\/138\/revisions"}],"predecessor-version":[{"id":167,"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/posts\/138\/revisions\/167"}],"wp:attachment":[{"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/media?parent=138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/categories?post=138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/synthint.ai\/index.php\/wp-json\/wp\/v2\/tags?post=138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}