Skip to main content

Configuring logging

See details in Apache Spark documentation.

The table below could help you in selection of appropriate log level:

OFFThe highest possible rank and is intended to turn off logging.
FATALDesignates very severe error events that will presumably lead the application to abort.
ERRORDesignates error events that might still allow the application to continue running.
WARNDesignates potentially harmful situations.
INFODesignates informational messages that highlight the progress of the application at coarse-grained level.
DEBUGDesignates fine-grained informational events that are most useful to debug an application.
TRACEDesignates finer-grained informational events than the DEBUG.
ALLAll levels including custom levels.