Module core.evaluator

Functions

def load_website_in_driver(driver, html, viewport_size, action)
def normalize_xpath(xpath: str)
def parse_viewport_size(vsize)
def parse_yaml(action)
def validate_action(action)

Classes

class Evaluator

Helper class that provides a standard way to create an ABC using inheritance.

Ancestors

  • abc.ABC

Subclasses

Methods

def compare(self, results: Dict[str, pandas.core.frame.DataFrame], metrics: list) ‑> matplotlib.figure.Figure
def evaluate(self) ‑> pandas.core.frame.DataFrame
class NavigationEngineEvaluator

Helper class that provides a standard way to create an ABC using inheritance.

Ancestors

Methods

def compare(self,
results: Dict[str, pandas.core.frame.DataFrame],
metrics: list = ['recall', 'correct_action', 'correct_xpath', 'time']) ‑> matplotlib.figure.Figure
def evaluate(self,
navigation_engine: lavague.core.navigation.NavigationEngine,
dataset: pandas.core.frame.DataFrame,
navigation_engine_name='') ‑> pandas.core.frame.DataFrame
class RetrieverEvaluator

Helper class that provides a standard way to create an ABC using inheritance.

Ancestors

Methods

def compare(self,
results: Dict[str, pandas.core.frame.DataFrame],
metrics: list = ['recall', 'output_size', 'time']) ‑> matplotlib.figure.Figure
def evaluate(self,
retriever: lavague.core.retrievers.BaseHtmlRetriever,
dataset: pandas.core.frame.DataFrame,
driver: lavague.drivers.selenium.base.SeleniumDriver = None,
retriever_name: str = '',
wait_for_scroll: int = 1) ‑> pandas.core.frame.DataFrame