Pages

▼
Showing posts with label Docker. Show all posts
Showing posts with label Docker. Show all posts
Saturday, April 20, 2024

Hugging Face - Part5 - Deploy your LLM app on Kubernetes

›
In our previous blog post, we explored the process of containerizing the Large Language Model (LLM) from Hugging Face using FastAPI and Dock...
Sunday, March 31, 2024

Hugging Face - Part4 - Containerize your LLM app using Python, FastAPI, and Docker

›
In this exercise, our objective is to integrate an API endpoint for the Large Language Model (LLM) provided by Hugging Face using FastAPI. A...
Saturday, February 24, 2024

Hugging Face - Part3 - Inference with Code Llama using LangChain

›
In the field of understanding and working with human language (NLP), Hugging Face is a key platform that provides many pre-trained models fo...
Wednesday, February 21, 2024

Hugging Face - Part2 - Code generation with Code Llama - Instruct

›
Code Llama , an impressive publicly available machine learning model, is a specialised version of Llama 2 that was created by further traini...
Monday, February 19, 2024

Hugging Face - Part1 - Getting started

›
This blog series will help you get started with Hugging Face, including: Downloading and using Hugging Face models locally via the Python Tr...
Monday, January 15, 2024

Ollama - Part1 - Deploy Ollama on Kubernetes

›
Docker published GenAI stack around Oct 2023 which consists of large language models (LLMs) from Ollama, vector and graph databases from Ne...
Sunday, December 3, 2023

Kubernetes mini project

›
In this mini project, we are going to learn the following: Deploy a simple Python based web application on a Kubernetes cluster. We will use...
Sunday, October 29, 2023

Kubernetes 101 - Part12 - Debug pod

›
When it comes to troubleshooting application connectivity and name resolution issues in Kubernetes, having the right tools at your disposal ...
Friday, July 16, 2021

Docker 101 - Part5 - Push container image to docker hub repository

›
Saturday, January 23, 2021

Benchmarking Kubernetes infrastructure using K-Bench

›
K-Bench  is a framework to benchmark the control and data plane aspects of a Kubernetes cluster. More details are available at  https://gith...
Sunday, September 27, 2020

Monitoring Tanzu Kubernetes cluster using Prometheus and Grafana

›
Updated: June 26, 2021 In this post, we will see how to deploy Prometheus and Grafana using Helm and Prometheus Operator to monitor Tanzu Ku...
Saturday, August 15, 2020

Visualize your Kubernetes clusters and workloads using Octant

›
In this article, I will explain how to visualize your Kubernetes clusters and workload using Octant.    Download Octant You can download the...
Thursday, July 9, 2020

Tanzu Kubernetes Grid (TKG) on vSphere 6.7 U3 - Part3

›
In this blog, I will explain how to deploy an FIO application pod with persistent storage on your Tanzu Kubernetes workload cluster. Step 1...
Wednesday, June 24, 2020

Tanzu Kubernetes Grid (TKG) on vSphere 6.7 U3 - Part2

›
In this post, I will explain how to deploy and manage multiple Kubernetes workload clusters using TKG CLI. To view the management cluste...
Tuesday, June 23, 2020

Tanzu Kubernetes Grid (TKG) on vSphere 6.7 U3 - Part1

›
TKG is an enterprise-ready Kubernetes runtime which  provides a consistent, upstream-compatible implementation of Kubernetes, that is teste...
Saturday, February 15, 2020

Kubernetes 101 - Part1 - Create K8s cluster with kubeadm

›
Deploy 3 CentOS 7 VMs. One will be the master and the other two will be workers/ slaves. Master is "m1" and workers are ...