Blog

 

Keyboard shortcuts on Mac

setup
Keyboard shortcuts on mac
Jun 12, 2024

Attention

ML
1165 rows × 1 columns
May 30, 2024
Nipun Batra

Forecasting

ML 
import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline
%config InlineBackend.figure_format = 'retina'
import torch
import torch.nn as nn
import torch.nn.funct…
May 30, 2024
Nipun Batra

RNN

ML
1165 rows × 1 columns
May 30, 2024
Nipun Batra

Attention in Sequence to Sequence

ML 
import torch
import torch.nn as nn
import torch.optim as optim
from torch.utils.data import DataLoader, TensorDataset
import numpy as np
import matplotlib.pyplot as plt
May 17, 2024
Nipun Batra

Sample

ML 
import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline
%config InlineBackend.figure_format = 'retina'
import torch
import torch.nn as nn
import torch.nn.funct…
May 7, 2024
Nipun Batra

Object detection

ML 
from ultralytics import YOLO, checks, hub
import pandas as pd
May 1, 2024
Nipun Batra

Mixture of Experts

ML 
import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline
%config InlineBackend.figure_format = 'retina'
import torch
import torch.nn as nn
import torch.nn.funct…
Jan 18, 2024
Nipun Batra

Logo

ML 
import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline
%config InlineBackend.figure_format = 'retina'
Jan 2, 2024
Nipun Batra

Basic Neural Process

ML 
import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline
import torch
import torch.nn as nn
import torch.nn.functional as F
%config InlineBackend.figure_format =…
Dec 28, 2023
Nipun Batra

Using a neural network as a covariance function

ML 
import torch
import torch.nn as nn
import matplotlib.pyplot as plt
import numpy as np
# Retina mode
%config InlineBackend.figure_format = 'retina'
# Create training and…
Dec 22, 2023
Nipun Batra

 

Towards transformers

ML 
import tiktoken
encoding = tiktoken.get_encoding("cl100k_base")
encoding.encode("Hello World! This is a simple notebook")
[9906, 4435, 0, 1115, 374, 264, 4382, 38266]
…
Dec 21, 2023
Nipun Batra

Naive implementation of Strassen’s algorithm

ML 
import numpy as np 
import time
import matplotlib.pyplot as plt
import pandas as pd
# Retina display
%config InlineBackend.figure_format = 'retina'
log_size = 8
size = 2…
Dec 20, 2023
Nipun Batra

 

YouTube video to transcript using openAI whisper and summary using OLLama

ML
References
Dec 18, 2023
Nipun Batra

Reinforcement Learning

ML
Reference
Dec 11, 2023
Nipun Batra

Super Resolution using U-Net like architecture

ML 
import matplotlib.pyplot as plt
import torch

%matplotlib inline
%config InlineBackend.figure_format='retina'
# Download some MNIST to demonstrate super-resolution
from …
Jul 12, 2023
Nipun Batra

Trees using NetworkX

ML 
import networkx as nx
import numpy as np
import matplotlib.pyplot as plt
import pandas as pd

%matplotlib inline

# Retina display
%config InlineBackend.figure_format = 'ret…
Jun 12, 2023
Nipun Batra

Positional Encoding

ML 
import numpy as np
import matplotlib.pyplot as plt
import torch
import seaborn as sns
import pandas as pd

dist =torch.distributions

sns.reset_defaults()
sns.set_context(…
Jun 9, 2023
Nipun Batra

Bayesian Active Learning with Disagreement (BALD)

ML 
import numpy as np
import matplotlib.pyplot as plt
import torch
import seaborn as sns
import pandas as pd

dist =torch.distributions

sns.reset_defaults()
sns.set_context(…
May 26, 2023
Nipun Batra

Gradient wrt input for a simple model for adversarial attacks

ML
Main idea:
May 5, 2023
Nipun Batra

PINN

ML
PINNs are a class of neural networks for solving partial differential equations. They are trained to minimize the residual of the differential equation, and the boundary and…
May 5, 2023
Nipun Batra

SIREN paper implementation

ML

Reconstruction from ReLU

Reconstruction from Sine
Apr 28, 2023
Nipun Batra

SIREN paper

ML
In this post, I’m noting some observations from the SIREN paper.
Apr 27, 2023
Nipun Batra

Heteroskedastic and Homoskedastic MLPs in PyTorch for regression

ML
Dataset
Apr 10, 2023
Nipun Batra

Tensorboard

ML 
import torch
import torch.nn as nn
import torch.nn.functional as F
import torch.optim as optim

import numpy as np
import matplotlib.pyplot as plt

from torch.utils.data imp…
Mar 21, 2023
Nipun Batra

Residual Connections in PyTorch

ML 
import torch
import torch.nn as nn
import torch.nn.functional as F
import torch.optim as optim

import numpy as np
import matplotlib.pyplot as plt

from torch.utils.data imp…
Mar 18, 2023
Nipun Batra

AutoML PyTorch

ML
In this post, we look at AutoPyTorch, a framework for automated machine learning.
Feb 25, 2023
Nipun Batra

 

Stacking (Meta Learning)

ML
Feb 22, 2023
Nipun Batra

Stacking (Ensemble Learning)

ML
In this post, we study a simple meta learning technique called Stacking
Feb 21, 2023
Nipun Batra

Multivariate Taylor Series

ML
Second order Taylor series expansion of a function f around a point (x0, y0) is given by (when using the vector notation)
Feb 20, 2023
Nipun Batra

Comparing GP libraries

ML
In this notebook, we will show how to compare different GP libraries to give the same loss for a simple GP regression problem.
Feb 6, 2023
Nipun Batra

SVD

ML 
from jax import vmap, jit, grad, vmap
import jax.numpy as jnp

# Enable 64-bit mode
from jax.config import config
config.update("jax_enable_x64", True)
import matplotlib.pyp…
Feb 1, 2023
Nipun Batra

Conformal Prediction

ML
This is a work in progress. I will be adding more content to this post in the coming days.
Jan 19, 2023
Nipun Batra

 

VSCode Settings and Tips

ML
vscode
Shortcut Action
Cmd + Shift + P Open command palette
Ctrl + ` Toggle terminal
Cmd + B Toggle sidebar
Cmd + Ctrl + F Toggle full screen
Jan 17, 2023
Nipun Batra

Binomial and Poisson distribution

ML 
import jax.numpy as jnp
import jax
from jax import random
import tensorflow_probability.substrates.jax as tfp
tfd = tfp.distributions
import pandas as pd

import matplotlib.…
Nov 20, 2022
Nipun Batra

 

Some useful tidibts in sympy

ML
Some useful tidibts in sympy
Nov 9, 2022
Nipun Batra

Autoencoders in JAX

ML
A programming introduction to Autoencoders in JAX
Nov 4, 2022
Nipun Batra

Calibration

ml
Probability Calibration
Oct 27, 2022
Nipun Batra

Multi-output Gaussian Process

ml
Multi-output Gaussian Process
Oct 25, 2022
Nipun Batra

Welcome To My Blog

news
This is the first post in a Quarto blog. Welcome!
Sep 14, 2022
Tristan O’Malley

Audio Filtering

ML 
import numpy as np
import matplotlib.pyplot as plt
import torch
import seaborn as sns
from functools import partial

sns.reset_defaults()
sns.set_context(context="talk"…
Feb 24, 2022
Nipun Batra

Coordinate descent failure example

ML
Fix x2 = 2
Feb 21, 2022
Nipun Batra

Pyro Conditioning

ML 
import numpy as np
import matplotlib.pyplot as plt
import torch
import seaborn as sns
import pandas as pd
import pyro

dist =pyro.distributions

sns.reset_defaults()
sns.s…
Feb 20, 2022
Nipun Batra

Probabilstic PCA using PyTorch distributions

ML 
import numpy as np
import matplotlib.pyplot as plt
import torch
import seaborn as sns
import pandas as pd

dist =torch.distributions

sns.reset_defaults()
sns.set_context(…
Feb 17, 2022
Nipun Batra

Linear Regression using Pyro

ML 
import numpy as np
import matplotlib.pyplot as plt
import torch
import seaborn as sns
import pandas as pd

t_dist =torch.distributions

sns.reset_defaults()
sns.set_contex…
Feb 17, 2022
Nipun Batra

Drawing graphical models

ML
References
Feb 15, 2022
Nipun Batra

GMM learning

ML 
import torch
dist = torch.distributions
import matplotlib.pyplot as plt
import seaborn as sns
import numpy as np
%matplotlib inline
Feb 14, 2022
Nipun Batra

Logistic Regression using PyTorch distributions

ML 
import numpy as np
import matplotlib.pyplot as plt
import torch
import seaborn as sns
import pandas as pd

dist =torch.distributions

sns.reset_defaults()
sns.set_context(…
Feb 14, 2022
Nipun Batra

Variational Inference

ML
Let us first look at G1. Look at the illustration below. We have a normal distribution \(p\) and two other normal distributions \(q_1\) and \(q_2\). Which of \(q_1\) and \(q_…
Feb 12, 2022
Nipun Batra

Maximum A-Posteriori (MAP) for parameters of univariate and multivariate normal distribution in PyTorch

ML
PyTorch
\(\hat{\theta}_{MAP}=\dfrac{n}{n+\sigma^{2}} \bar{x}+\dfrac{\sigma^{2}}{n+\sigma^{2}} \mu\)
Feb 11, 2022
Nipun Batra

Matrix as transformation and interpreting low rank matrix

ML
LA
Multiplying a matrix A with a vector x transforms x
Feb 11, 2022
Nipun Batra

Maximum Likelihood Estimation (MLE) for parameters of univariate and multivariate normal distribution in PyTorch

ML
PyTorch
Let us generate some normally distributed data and see if we can learn the mean.
Feb 9, 2022
Nipun Batra

 

Autograd in JAX and PyTorch

ML
JAX
PyTorch 
import torch
from jax import grad
import jax.numpy as jnp
Feb 9, 2022
Nipun Batra

Coin Toss (MLE, MAP, Fully Bayesian) in TF Probability

ML
TFP
TF
We will be studying the problem of coin tosses. I will not go into derivations but mostly deal with automatic gradient computation in TF Probability.
Feb 7, 2022
Nipun Batra

Simple Directed Graphical Models in TF Probability

ML
TFP
TF
References
Feb 5, 2022
Nipun Batra

Linear Regression in TF Probability using JointDistributionCoroutineAutoBatched

ML
TFP
TF
TODO
Feb 5, 2022
Nipun Batra

Sampling from univariate and multivariate normal distributions using Box-Muller transform

ML
In this notebook I’ll talk about sampling from univariate and multivariate normal distributions. I’ll mostly directly write the code and show the output. The excellent…
Feb 4, 2022
Nipun Batra

Understanding KL-Divergence

ML
Let us first look at G1. Look at the illustration below. We have a normal distribution \(p\) and two other normal distributions \(q_1\) and \(q_2\). Which of \(q_1\) and \(q_…
Jan 29, 2022
Nipun Batra

Linear Regression in Tensorflow Probability

ML
Good reference https://tensorchiefs.github.io/bbs/files/21052019-bbs-Beate-uncertainty.pdf
Jan 28, 2022
Nipun Batra

Testing out some distributions in Tensorflow Probability

ML
Let us generate some normally distributed data and see if we can learn the mean.
Jan 26, 2022
Nipun Batra

Learning Gaussian Process regression parameters using mini-batch stochastic gradient descent

ML
How to learn the parameters of a GP
Sep 3, 2021
Nipun Batra

Linear Regression from scratch in Julia

ML 
using Plots
theme(:default)

using LinearAlgebra
using LaTeXStrings
Sep 1, 2021
Nipun Batra

Probabilistic Programming in Pyro

ML
In this post, I will look at a simple application:
Aug 20, 2021
Nipun Batra

Blurring an image selectively using Affinity Photo

setup
Blurring an image selectively using Affinity Photo
Jun 19, 2021

Audio Filtering on the command line and Python

ML
In this post I will look into some filters for audio processing in ffmpeg, sox, and Python. I have recorded a small 6 second audio clip where for the first couple of seconds…
Jun 18, 2021
Nipun Batra

Running Python scripts on server over ssh and getting back content

setup
Running Python scripts on server over ssh and getting back content
Jun 17, 2021

Some of my shortcuts on the iPad

setup
Some of my shortcuts on the iPad
Jun 16, 2021

My iPad Setup

setup
My iPad computing setup
Jun 14, 2021

My Mac Setup

setup
My Mac Setup
Jun 12, 2021

A programming introduction to GANs

ML
This is a post about Generative Adversarial Networks (GANs). This post is very heavily influenced and borrows code from:
May 31, 2021
Nipun Batra

 

Understanding Kernels in Gaussian Processes Regression

ML
Using GPy and some interactive visualisations for understanding GPR and applying on a real world data set
Jun 26, 2020
Nipun Batra

Sampling from common distributions

ML
From the ground up!
Apr 16, 2020
Nipun Batra

 

Learning Gaussian Process regression parameters using gradient descent

ML
How to learn the parameters of a GP
Mar 29, 2020
Nipun Batra

Active Learning with Bayesian Linear Regression

ML
A programming introduction to Active Learning with Bayesian Linear Regression.
Mar 28, 2020
Zeel Patel & Nipun Batra

Some experiments in Gaussian Processes Regression

ML
Using GPy and some interactive visualisations for understanding GPR and applying on a real world data set
Mar 26, 2020
Nipun Batra

Some Neural Network Classification

ML
A programming introduction to NNs.
Mar 8, 2020
Nipun Batra

Neural Networks from scratch

ML
Simple scripts for downloading weather data
Mar 2, 2020
Nipun Batra

Learning neural network for XOR

ML
Excellent, now let us start from random weight initialisations and use backprop to come to our result
Feb 28, 2020
Nipun Batra

Bayesian Linear Regression

ML
A programming introduction to Bayesian Linear Regression.
Feb 20, 2020
Nipun Batra

An Example Markdown Post

markdown
A minimal example of using markdown with fastpages.
Jan 14, 2020

Gaussian Processes

ML
A programming introduction to Gaussian Processes.
Aug 20, 2019
Nipun Batra

Placement-Preparation-2018-1-HashMap

academia
HashMaps for programming interviews
Aug 18, 2018
Nipun Batra

 

Visualising Electricity Access Over Space and Time

sustainability
How is the world changing over the years!
Jun 26, 2018
Nipun Batra

 

Mapping location of air quality sensing in India

air quality
AQ sensing in India
Jun 21, 2018
Nipun Batra

Active Learning

ML
A programming introduction to query by committee strategy for active learning
Jun 16, 2018
Nipun Batra

 

Signal denoising using RNNs in PyTorch

ML
Denoising
Jan 13, 2018
Nipun Batra

CS Ph.D. lessons to my younger self

academia
Some personal reflections..
Jan 7, 2018
Nipun Batra

 

Neural Networks for Collaborative Filtering

ML
Neural networks to learn the embeddings! and how to combine them
Dec 29, 2017
Nipun Batra

Recommender Systems in Keras

ML
A programming introduction to recommender systems using Keras!
Dec 18, 2017
Nipun Batra

Adagrad based matrix factorization

ML
Adagrad optimizer for matrix factorisation
Aug 13, 2017
Nipun Batra

Programatically understanding Adagrad

ML
In this post, I’ll be using Adagrad for solving linear regression. As usual, the purpose of this post is educational. This link gives a good overview of Adagrad alongwith…
Aug 12, 2017
Nipun Batra

 

Top 50 ggplot2 Visualizations in Python - Part 1

visualisation
Same graphic using different libraries!
Aug 2, 2017
Nipun Batra

Linear regression with prior (using gradient descent)

ML
What if we start from some prior!
Jun 15, 2017
Nipun Batra

 

Data exploration using widgets in Matplotlib

visualisation
Exploring data in Matplotlib
Jun 14, 2017
Nipun Batra

 

Constrained Non-negative matrix factorisation using CVXPY

ML
Constrained NMF using CVXPY!
Apr 21, 2017
Nipun Batra

 

Out of Tensor factorisation

ML
Out of tensor factorisation
Apr 20, 2017
Nipun Batra

 

Out of matrix non-negative matrix factorisation

ML
What if we to predict for entries not within the matrix?!
Apr 19, 2017
Nipun Batra

Coin tosses and MCMC

ML
MCMC simulations for coin tosses!
Jul 1, 2014
Nipun Batra

Latexify Matplotlib

visualisation
Towards amazing plots in research papers!
Jun 2, 2014
Nipun Batra

Programatically understanding Expectation Maximization

ML
Maximize based on what you know, re-estimate!
Jun 1, 2014
Nipun Batra

Programatically understanding dynamic time warping (DTW)

ML
Signal processing for unequal time series!
May 1, 2014
Nipun Batra

Gibbs sampling

ML
Programmatic introduction
May 1, 2014
Nipun Batra

Denoising using Least Squares

ML
How the simple least squares can be used in more ways than you thought!
Sep 1, 2013
Nipun Batra

HMM Simulation for Continuous HMM

ML
Simulating a continuous HMM
Jul 1, 2013
Nipun Batra

HMM Simulation for Unfair Casino Problem

ML
A programming introduction to HMMs for unfair casino problem
Jun 1, 2013
Nipun Batra

Aggregation in Timeseries using Pandas

visualisation
Pandas excellence in timeseries!
May 1, 2013
Nipun Batra

Downloading weather data

visualisation
Simple scripts for downloading weather data
Apr 1, 2013
Nipun Batra
No matching items