AiN

• Disclaimer: Part or all of this repo may be wrong

NN

Example

    graph LR
    
    I(Input)
    O(Output)

    HL1_F1(Func)
    HL1_F2(Func)

    HL2_F1(Func)
    HL2_F2(Func)

    HL3_F1(Func)
    HL3_F2(Func)

    I --> HL1_F1
    I --> HL1_F2

    HL1_F1 --> HL2_F1
    HL1_F1 --> HL2_F2

    HL1_F2 --> HL2_F1
    HL1_F2 --> HL2_F2

    HL2_F1 --> HL3_F1
    HL2_F2 --> HL3_F2

    HL2_F1 --> HL3_F2
    HL2_F2 --> HL3_F1

    HL3_F1 --> O
    HL3_F2 --> O

Steps

1. Init
   1. Number of input/outpur nodes
   2. Hidden layers
   3. Neurons in each layer
2. Forward Propagation
3. Activation Function
   1. sigmoid
   2. tanh
   3. ReLU
4. Backward Propagation
5. Training NN
6. Testing NN

GAN

Flowchart

    flowchart LR
    Random_Input --> Genrator --> Sample_ --> Discriminator --> Discriminator_Loss
    Discriminator --> Generator_Loss
    Real_Image --> Sample --> Discriminator

Steps

1. Define Generator
   1. Create a function to generate random noise
2. Define Discriminator
   1. Create a function to distinguishes between real and generated data
3. Generate fake data
4. Define a traning loop
   1. Discriminator learns to distinguish between fake and real data
   2. Generator learns to create data that fools the Discriminator
   3. Each one tries to learn to outdo the other
5. Evaluate the GAN

---

AI

AI Domains

1. ML _{Machine learning}
   1. Supervised Learning Algorithms
   2. Unsupervised Learning Algorithms
   3. Reinforcement Learning Algorithms
      1. Model-based
         1. Value Iteration
         2. Model Iteration
         3. Dyna-Q
      2. Model-free
         1. QLearning
         2. SARSA
         3. TD(λ)
2. NLP _{Natrual Language Processing}
   1. Sentence Representation
   2. Graphical Topic Models
   3. Training with Classification Models
3. Vision

   To understand visual data

   1. CNN _{Convolutional Neural Networks}

      Image recognition, classification and object detection

   2. RNN _{Recurrent Neural Networks}

      Image captioning, scene description and video analysis

   3. YOLO _{You Only Look Once}

      Real time object detection algorithm

   4. Mask R-CNN

      Extension of R-CNN

   5. GANs _{Generative Adversarial Networks}

      To create material such as image, music, text, ...

   6. Siamese Networks

      Image classification and similarity learning

   7. CPMs _{Convolutional Pos Machines}

      Human Pos estimation; location and orientation of joints

4. Speech
5. Robotics
6. Expert System
   1. Forward Chaining
   2. Backward Chaining
   3. Certainty Factor
   4. Case-based Reasoning
   5. Fuzzy Logic
   6. Bayesian Networks
   7. Decision Trees
7. Learning Curve Algorithms Is this in correct category??
   1. Methahuristic Algorithms
   2. Constrained Heuristic
   3. Hybrid Combination
8. Neural Network
   1. CNN
   2. DNN
   3. RNN

AI Types

1. Self-Aware
2. Limited Memory
3. Theory of Mind
4. Reactive Machines
5. Artificial General Intelligence
6. Artificial Narrow Intelligence (ANI)
7. Artificial Super Intelligence (ASI)

ML

• Supervised Learning
  1. Regression
     • Linear
     • Polynominal
  2. Classification
     • KNN
     • SVM
     • NaiveBayse
     • Decision Tree
• Unsupervised Learning
  1. Clustering
     • KMeans
     • DBScan
     • MeanShift
     • FuzzyCMean
     • Hierarchical
     • Agglomerative
     • Knowledge-based
  2. Dimension Reduction (Generalization)
     • LDA
     • PCA
     • SVD
     • LSA
     • TSNE
  3. Pattern Search
     • Apriori
     • FPGrowth
• Ensemble Methods
  1. Bagging
     • RandomForest
  2. Stacking
  3. Boosting
• Reinforcment Learning
  1. A3C

  [!WARNING] Is this in correct category??

  1. SARSA
  2. QLearning
  3. GeneticAlgorithm

  [!WARNING] Is this in correct category??

  1. DeepQNetwork (DQN)

AI Usage

1. Online shopping
2. Fraud prevention
3. Autonomous vehicles
4. Facial recognition
5. Hiring
6. Gaming
7. Social media
8. Travel

ML/AI Engines

ML/AI Tools

1. TensorFlow
2. PyTorch
3. Keras
4. Chain
5. Theano
6. Auto-WEKA
7. KNIME
8. BigML
9. Scikit-learn
10. Accord.NET
11. Google Cloud AutoML
12. Azure Machine Learning Studio
13. Amazon Machine Learning (AML)

ML/AI Plugins

ML/AI Apps

• Perplexity

Useful links

• https://www.w3schools.com/python/python_ml_getting_started.asp
• https://www.springboard.com/blog/data-science/how-to-learn-machine-learning/
• https://www.enjoyalgorithms.com/blog/coding-ml-from-scratch/
• https://github.com/eriklindernoren/ML-From-Scratch
• https://www.kdnuggets.com/2022/02/7-steps-mastering-machine-learning-python.html
• https://www.analyticsvidhya.com/blog/2021/10/implementing-artificial-neural-networkclassification-in-python-from-scratch/
• https://www.learndatasci.com/tutorials/reinforcement-q-learning-scratch-python-openai-gym/
• https://dafriedman97.github.io/mlbook/content/introduction.html
• https://www.geeksforgeeks.org/machine-learning-with-python/
• https://www.kaggle.com/code/milan400/machine-learning-algorithms-from-scratch
• Generative Adversarial Networks
• Simpelest GAN Possible
• Simple GAN Model
• Develope a 1D GAN Model
• NN for Dummies