The repository consists of the experiments done in the Machine Learning for Signal Processing Laboratory performed during the Spring Semester 2024-25 at Department of Electrical Engineering, Indian Institute of Technology Kharagpur. All the codes are written from scratch without using any in-built functions for the task. The experiments conducted are in the following order:
- Lossy Compression: Principal Component Analysis, Singular Value Decomposition
- Lossless Compression: Huffman coding, Lossless image compression and compressed file structure
- Bayesian Classification: Maximum Liklihood Estimation for Audio Classification
- Decision Trees and Random Forests: Building a decision tree, Bagging, and visualization of decision boundaries
- Regression and Classification: Linear SVMs (Soft and Hard Margin), Kernel SVMs, Regular and Distributed Least Square Regression, Stochastic Gradient Descent, Accelerated Gradient Descent, Convex Optimization
- Polynomial Regression: Solutions using normal equations and gradient descent approaches
- Kernel Density Estimation: Gaussian Kenrels and Mixture Models
- Neural Networks: Fully connected networks in pytorch
- Speech Gender Recognition: Application of NNs in classifying audio inputs as male/female using Mel and MFCC features
The folders contains code, detailed LaTex report and experiment manual. External datasets wherever required are cited in the manual itself.