A simple and straight forward installation and execution: After accepting a few settings point the browser to: and see the dashboard: The computer hardware was described in my previous blog post. The screen capture below describes in brief the system: The measured throughput is 6.8K token/minute. Then I asked Openclaw to “write a RISC-V assembly …
Author Archives: gtelzur
Running a 30B LLM Locally: Nemotron-3-nano on a Laptop
In this short report I summarize my first impressions of using the new Nemotron-3-nano:30b on my laptop. System specifications Installation telzur@TUF:~/science/nemotron-3-nano$ ollama pull nemotron-3-nano:30b pulling manifest pulling a70437c41b3b: 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 24 GB pulling bca58c750377: 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 10 KB pulling 12e88b2a8727: 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 28 B pulling 12bee8c08a36: 100% ▕████████████████████████████████████████████████████████████████████████████████████████████████▏ 488 B verifying sha256 digest writing manifest …
Continue reading “Running a 30B LLM Locally: Nemotron-3-nano on a Laptop”
Embarrassingly Parallel Computations with Ray
Ray is an excellent framework for large-scale distributed computations in Python. In this blog post, I demonstrate a simple example of Ray’s capability to perform Embarrassingly Parallel Computation with minimal and straightforward source code. It is well known that if we randomly throw dots inside a square enclosing a circle, the ratio of the number …
Continue reading “Embarrassingly Parallel Computations with Ray”
How to convert a VirtualBox image to an AWS AMI?
Guy Tel-Zur, March 26, 2024 During the pandemic, when isolation took place, I was challenged how to keep my students practicing parallel processing programming in my “Introduction to Parallel Processing” course. The students couldn’t meet at the computer lab and so I developed a VirtualBox image with all the tools I needed for my course …
Continue reading “How to convert a VirtualBox image to an AWS AMI?”
The Roofline model
Guy Tel-Zur, March 20, 2024 In this blog post I will explain what is the roofline model, its importance and how to measure the achieved performance of a computer program, and how it is compared to the peak theoretical performance of the computer. According to this model we measure the performance of a computer program …
IoT Project: Temperature measuremnts using Arduino, Raspberrypi, MQTT, Python, Influxdb and Grafana
Goal: Practice the model of IoT (Edge) data streaming and its remote analysis (Cloud). This work was inspired by works of others, in particular [1] and [2]. The system schematic diagram is as follows: Equipment: Arduino Uno. Arduino EthernetSheild. LM35 temperature sensor (datasheet). Raspberrypi-3, serving as an MQTT broker. Another computer (my laptop) for visualization. …
Protected: LMFIT
There is no excerpt because this is a protected post.
Protected: Fitting – a simple test
There is no excerpt because this is a protected post.
Protected: First code
There is no excerpt because this is a protected post.
Protected: Visit #2 at Weizmann
There is no excerpt because this is a protected post.