PeterJohn PassOver Llama

llama-cpp-python ( LLM, Large Language Model ) on the Edge Device. You have an Assistant on your Palm. ****[PreParation];; 0) if you have Already Had the model file "tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf", Please Put it into "On My iPhone/PeterJohn PassOver Llama/TutorialSeason002/images/". Even if you haveNot Had the model file yet, DoNot worry it. in this App, it will be downloaded. **** When you'd like to use the other model *.gguf file, by Customizing the Python Script "s000llamaCpp.py" at "EditScript" View, it is Available. 'cause this is a kind of "llama-cpp-python" on iPhone. After you downloaded and put the model file into the model folder, ****[Basic Usage];; Very Simple; 1) Enter Prompt and then Touch "Kira Kira Spark" , so that you will get a response from your Assistant. 2) Result shows 2.1) the time how long it took until you got the result 2.2) the Content from your Assistant. 3) Check the result whether it includes all or Not 'cause the Result for your Assistant is Limited up to 8,192 Characters. ****[Advanced Usage]; 4) you can Customize in the almost Same form of 'llama-cli'( Command Line interface ) Option Format. from the 'EditScript' View. Please Google 'llama-cli option'. 5) you can Check the Buffer Size on Both CPU_Model and GPU_Model from 'Show logStdErr' from the Bottom of 'EditScript' View, by Searching the keyword 'buffer'. 6) you can also Check Both Prompt Eval Time ( Tokens per second ) and Eval Time ( Tokens per second ) from 'Show logStdErr' from the Bottom of 'EditScript' View by Searching the keyword 'tokens per'. [CAUTION] we recommend that you Terminate some of Heavy Apps such as Safari, LINE, PyTorch, Transformer and so on Before Using this app "PeterJohn PassOver Llama" 'cause, for example, Safari suddenly Tries to Open 62 Tabs which might be corresponding to 62GBytes of RAM and VRAM. ****Why did we name this "PassOver Llama"?; We named this from the "PassOver Lamb" in "1st Corinthians 5:7". But "PassOver Llama" isNot Perfect such as "PassOver Lamb". "PassOver Llama" is inferior to "PassOver Lamb". if you Ask the Llama, he will Answer to you, "No, I'm Not the PassOver Lamb, I'm just the PassOver Llama. He who is coming after me is mightier than I, whose sandals I am not worthy to carry." ( from "Matthew 3:11" ) LLM( Large Language Model ) or AI are just the Assistant of you. ****1st Corinthians 5:6-8, ESV; 5:6 Your boasting is not good. Do you not know that a little leaven leavens the whole lump? 5:7 Cleanse out the old leaven that you may be a new lump, as you really are unleavened. For Christ, our Passover lamb, has been sacrificed. 5:8 Let us therefore celebrate the festival, not with the old leaven, the leaven of malice and evil, but with the unleavened bread of sincerity and truth. ****Matthew 3:9-12, ESV; 3:9 And do not presume to say to yourselves, ‘We have Abraham as our father,’ for I tell you, God is able from these stones to raise up children for Abraham. 3:10 Even now the axe is laid to the root of the trees. Every tree therefore that does not bear good fruit is cut down and thrown into the fire. 3:11 “I baptize you with water for repentance, but he who is coming after me is mightier than I, whose sandals I am not worthy to carry. He will baptize you with the Holy Spirit and fire. 3:12 His winnowing fork is in his hand, and he will clear his threshing floor and gather his wheat into the barn, but the chaff he will burn with unquenchable fire.” Best Regards, --Yasushi Yassun Obata