MicroPy-5M: Reliable Code Synthesis via Recursive Error-Feedback (REF) in 5.6M Parameter Models for Edge Intelligence

Read full text Summarise with VIRAT
Authors: Rohith Yarramala
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Abstract—Deployinglanguagemodelsonedgehardwareisfundamentallyconstrainedbymemorybudgetsthatprecludebillion-parameterarchitectures.ThispaperintroducesMicroPy-5M,adecoder-onlyTransformercomprisingonly5.6Mparam-eters,designedexclusivelyforlocalisedPythonscriptsynthesisonmicrocontroller-classdevices.Ourcentralfindingisthat,atthisextremesub-10M-parameterscale,conventionalprobabilisticone-shotdecodingproducesunacceptablyhighratesofstructuralerrors;reliabilityisinsteadachievablethroughaclosed-loopRecursiveError-Feedback(REF)mechanismthattreatsthePythoncompile()bytecodecompilerasanobjective,externalverificationoracle.Within1–2feedbackiterationsthemodelself-correctssyntaxfaultsandachieves100%convergenceonacuratedsuiteofaxiomaticprogrammingtasks,whileoccupyingan11.2MBon-diskfootprint(FP16)andapproximately42MBofRAMatinferencetime.TheseresultsestablishanewoperatingpointforwhatwetermLogic-GatedMicro-Intelligence:compact,formallyverified,andsuitablefordeploymentondevicespreviouslyconsideredincompatiblewithon-deviceAI.IndexTerms—EdgeAI,TinyML,codegeneration,Transformer,formalverification,recursiveself-correction,IoT,microcontroller

Fields of Study & Subjects

Software Engineering Research Topic Modeling IoT and Edge/Fog Computing

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
22 March 2026
Language
EN