SynthInt Tech Blog

Machine Learning in Compact, Low-Power Devices

November 8, 2024

This morning, I delivered a presentation on “Machine Learning in Compact, Low-Power Devices” at the College of Business at the University of Akron. The discussion focused on exploring embedded applications where machine learning significantly enhances device capabilities. We examined how embedded systems are increasingly performing sophisticated tasks by leveraging key AI technologies such as convolutional neural networks and large language models. Specific use cases in medical and industrial applications were also discussed.

Here is a link to the presentation.

Embedded AI at the Edge

October 3, 2024

Today I gave a presentation on Embedded AI at the Edge to the Akron Linux Users Group. The focus of the discussion centered around the use of Large Language Models in embedded systems. We delved into how LLMs work through the use of the Transformer Architecture, as seen on the left. A demo of a working LLM running on a microcontroller was shared with the group.

Here is a link to the presentation.

Running LLMs on Microcontrollers

July 19, 2024

I had a fantastic time discussing Edge AI with Cliff Brake and Khem Raj on the TmpDir podcast, where we delved into how microcontrollers can effectively support machine learning in embedded systems.

Here is a link to the podcast.