C# Class Accord.MachineLearning.RouletteWheelExploration

Roulette wheel exploration policy.

The class implements roulette whell exploration policy. Acording to the policy, action a at state s is selected with the next probability:

Q( s, a ) p( s, a ) = ------------------ SUM( Q( s, b ) ) b

where Q(s, a) is action's a estimation (usefulness) at state s.

The exploration policy may be applied only in cases, when action estimates (usefulness) are represented with positive value greater then 0.

Inheritance: IExplorationPolicy

Exibir arquivo Open project: accord-net/framework

Public Methods

Method	Description
ChooseAction ( double actionEstimates ) : int	Choose an action. The method chooses an action depending on the provided estimates. The estimates can be any sort of estimate, which values usefulness of the action (expected summary reward, discounted reward, etc).
RouletteWheelExploration ( ) : System	Initializes a new instance of the RouletteWheelExploration class.

Method Details

ChooseAction() public method

Choose an action.

The method chooses an action depending on the provided estimates. The estimates can be any sort of estimate, which values usefulness of the action (expected summary reward, discounted reward, etc).

public ChooseAction ( double actionEstimates ) : int
actionEstimates	double	Action estimates.
return	int

RouletteWheelExploration() public method

Initializes a new instance of the RouletteWheelExploration class.

public RouletteWheelExploration ( ) : System
return	System