Useful Optimizer is a dedicated set of optimization algorithms for numeric problems. It's designed to provide a comprehensive collection of optimization techniques that can be easily used and integrated into any project.
The current version of Useful Optimizer is 0.1.0.
- A wide range of optimization algorithms.
- Easy to use and integrate.
- Suitable for various numeric problems.
- Having fun to play with the algorithms
To install Useful Optimizer, you can use pip:
pip install git+https://github.com/Anselmoo/useful-optimizerHere's a basic example of how to use Useful Optimizer:
from opt.benchmark import CrossEntropyMethod
from opt.benchmark.functions import shifted_ackley
optimizer = CrossEntropyMethod(
func=shifted_ackley,
dim=2,
lower_bound=-12.768,
upper_bound=+12.768,
population_size=100,
max_iter=1000,
)
best_solution, best_fitness = optimizer.search()
print(f"Best solution: {best_solution}")
print(f"Best fitness: {best_fitness}")The current version of Useful Optimizer includes a wide range of optimization algorithms, each implemented as a separate module. Here's a brief overview of the implemented optimizers:
Sure, here's a brief description of each optimizer:
-
Adadelta, Adagrad, and Adaptive Moment Estimation: These are gradient-based optimization algorithms commonly used in machine learning and deep learning.
-
Ant Colony Optimization: This is a nature-inspired algorithm that mimics the behavior of ants to solve optimization problems.
-
Artificial Fish Swarm Algorithm: This algorithm simulates the behavior of fish in nature to perform global optimization.
-
Augmented Lagrangian Method: This is a method to solve constrained optimization problems. It combines the objective function and the constraints into a single function using Lagrange multipliers.
-
Bat Algorithm: This is a metaheuristic optimization algorithm inspired by the echolocation behavior of microbats.
-
Bee Algorithm: This is a population-based search algorithm inspired by the food foraging behavior of honey bee colonies.
-
Cat Swarm Optimization: This algorithm is based on the behavior of cats and distinguishes between two forms of behavior in cats: seeking mode and tracing mode.
-
CMA-ES (Covariance Matrix Adaptation Evolution Strategy): This is an evolutionary algorithm for difficult non-linear non-convex optimization problems in continuous domain.
-
Colliding Bodies Optimization: This is a physics-inspired optimization method, based on the collision and explosion of bodies.
-
Cross Entropy Method: This is a Monte Carlo method for importance sampling and optimization.
-
Cuckoo Search: This is a nature-inspired metaheuristic optimization algorithm, which is based on the obligate brood parasitism of some cuckoo species.
-
Cultural Algorithm: This is a type of evolutionary algorithm that is based on the concept of culture, or shared information and knowledge.
-
Differential Evolution: This is a population-based metaheuristic algorithm, which uses mechanisms inspired by biological evolution, such as reproduction, mutation, recombination, and selection.
-
Eagle Strategy: This is a metaheuristic optimization algorithm inspired by the hunting behavior of eagles.
-
Estimation of Distribution Algorithm: This is a stochastic optimization algorithm that uses a probabilistic model of candidate solutions.
-
Firefly Algorithm: This is a nature-inspired metaheuristic optimization algorithm, based on the flashing behavior of fireflies.
-
Genetic Algorithm: This is a search heuristic that is inspired by Charles Darwin’s theory of natural evolution.
-
Glowworm Swarm Optimization: This is a nature-inspired optimization algorithm based on the behavior of glowworms.
-
Grey Wolf Optimizer: This is a metaheuristic optimization algorithm inspired by grey wolves.
-
Harmony Search: This is a music-inspired metaheuristic optimization algorithm.
-
Hessian Free Optimization: This is a second-order optimization algorithm that uses information from the Hessian matrix to guide the search.
-
Hill Climbing: This is a mathematical optimization technique which belongs to the family of local search.
-
Imperialist Competitive Algorithm: This is a socio-politically motivated global search strategy, which is based on the imperialistic competition.
-
Linear Discriminant Analysis: This is a method used in statistics, pattern recognition, and machine learning to find a linear combination of features that characterizes or separates two or more classes of objects or events.
-
Particle Filter: This is a statistical filter technique used to estimate the state of a system where the state model and the measurements are both nonlinear.
-
Particle Swarm Optimization: This is a computational method that optimizes a problem by iteratively trying to improve a candidate solution with regard to a given measure of quality, mimicking the social behavior of bird flocking or fish schooling.
-
Parzen Tree Estimator: This is a non-parametric method to estimate the density function of random variables.
-
Shuffled Frog Leaping Algorithm: This is a metaheuristic optimization algorithm inspired by the memetic evolution of a group of frogs when searching for food.
-
Simulated Annealing: This is a probabilistic technique for approximating the global optimum of a given function, mimicking the process of heating a material and then slowly lowering the temperature to decrease defects, thus minimizing the system energy.
-
Sine Cosine Algorithm: This is a new population-based meta-heuristic algorithm, inspired by the mathematical sine and cosine functions.
-
Squirrel Search Algorithm: This is a new nature-inspired metaheuristic optimization algorithm, inspired by the caching behavior of squirrels.
-
Stochastic Diffusion Search: This is a population-based search algorithm, based on the behavior of ants when searching for food.
-
Stochastic Fractal Search: This is a metaheuristic search algorithm inspired by the natural phenomenon of fractal shapes and Brownian motion.
-
Successive Linear Programming: This is an optimization method for nonlinear optimization problems.
-
Tabu Search: This is a metaheuristic search method employing local search methods used for mathematical optimization.
-
Variable Depth Search: This is a search algorithm that explores the search space by variable-depth first search and backtracking.
-
Variable Neighbourhood Search: This is a metaheuristic search method for discrete optimization problems.
-
Very Large Scale Neighborhood Search: This is a search method that explores very large neighborhoods with an efficient algorithm.
-
Whale Optimization Algorithm: This is a new bio-inspired optimization algorithm, which simulates the social behavior of humpback whales.
Note
Please note that not all of these algorithms are suitable for all types of optimization problems. Some are better suited for continuous optimization problems, some for discrete optimization problems, and others for specific types of problems like quadratic programming or linear discriminant analysis.
Contributions to Useful Optimizer are welcome! Please read the contributing guidelines before getting started.
Warning
This project was generated with GitHub Copilot and may not be completely verified. Please use with caution and feel free to report any issues you encounter. Thank you!
Warning
Some parts still contain the legacy np.random.rand call. See also: https://docs.astral.sh/ruff/rules/numpy-legacy-random/