An approach for Logging in Spark jobs


Spark website provides three options for using a custom log4j configuration for logging. Here I am explaining about the 3rd option

Read More An approach for Logging in Spark jobs

Advertisements

Java Debugging Tools


   Listing out some of the useful Java debugging tools jinfo prints the system properties or the command line flags that were used to start the VM.   /opt/sun/jdk/java/bin/jinfo   jinfo jinfo Link: http://java.sun.com/j2se/1.5.0/docs/tooldocs/share/jinfo.html     jmap prints memory related statistics for a running VM or core file   /opt/sun/jdk/java/bin/jmap                 jmap -heap… Read More Java Debugging Tools