Posts

Showing posts from October, 2018

Observability of the Java Virtual Machine

-
Image
The JVM is one of the most observable runtimes. It provides us lots of tools for troubleshooting a JVM application in production. 1. Thread observability Threads are how the JVM actually does work. When something is wrong in production, the symptom is almost always a thread: stopped, blocked, leaking etc. Thread dumps work on any JVM with no  instrumentation, no agents, no restarts. <Example project link with /threaddump endpoint>         // (1) Deadlock — two threads grab the same pair of locks in opposite order.         new Thread(() -> grab(LOCK_A, LOCK_B), "deadlock-A-then-B").start();         new Thread(() -> grab(LOCK_B, LOCK_A), "deadlock-B-then-A").start(); http://localhost:8080/actuator/threaddump To list the JVMS, we can use the command below. PS C:\observe-jvm> jps -lv 25296 jdk.jcmd/sun.tools.jps.Jps -Dapplication.home=C:\Program Files\Microsoft\jdk-21.0.3.9-hotspot -Xms8m -Djdk.module.main=...
Post a Comment
Read more

Dynamic Connectivity Problem and the Union-Find Algorithm

-
Lets say we need to connect some objects and query if some objects are connected or not. Below is an example test: @Test     public void testConnectivity() {         MyConnectionDb connectDb = new MyConnectionDb();         connectDb.connect(4, 3);         connectDb.connect(3, 8);         connectDb.connect(6, 5);         connectDb.connect(9, 4);         connectDb.connect(2, 1);         assertTrue(connectDb.isConnected(8, 9));         assertFalse(connectDb.isConnected(5, 4));         connectDb.connect(5, 0);         connectDb.connect(7, 2);         connectDb.connect(6, 1);         connectDb.connect(7, 3);         assertTrue(connectDb.isConnected(5, 3));     } So whe...
Post a Comment
Read more

DEVOPS

-
Image
This table shows imporant aspects of DEVOPS and related software products. The ones that I have used in the past are painted in red. I think this is a very nice table to look at alternative solutions to use for new projects. Of course some of them are essential: Version control. (Subversion,  Git, ..) Build tool. (Maven, Gradle, ..) Testing. Unit Test, Stress Test, UI TEst. (JUnit, JMeter, Selenium) Continuous Integration. (Bamboo, Continuum, ..) The others seem to depend on the size of the organization and the project. Some use AWS, others manage their own servers. 
Post a Comment
Read more

Do you speak MATLAB?

-
MATLAB is a programming platform designed specifically for engineers and scientists. I first used it for a masters degree course on image processing. And now, I'm looking at it for the purpose of machine learning. Now lets remember what we can do with it: Matlab has a command line and also you can save your scripts as .m files. You should define your functions and save them as .m files. Note: If you put a semicolon to the end of the expression, the output is not shown in the console. Lets create a 3 x 3 matrix: A = [1, 2, 3; 0, 0, 0; -1, -1, -1] Lets create a vector: V = [2, 3, 6, 7] Lets create a column vector: V = [2; 3; 4; 5] Lets draw a diagram with some values: X = [1,2,3,4,5]; Y= [0,-1,3,4,8]; plot(X,Y) How to define a function? function y = myFunction(x)     y = x^2 + x + 1; end From command line: result = myFunction(6); Lets create a uniformly spaced vector.  V1 = 1:10 V2 = 1:10 plot(V1, V2) We can also specify the int...
Post a Comment
Read more

Popular posts from this blog

The WeakReference class, monitoring memory leak and garbage collection in a Java application

-
Image
 Below is a Stack implementation that uses an internal resizeable array structure.  public class MyStack< T > implements Stack< T > { private static final int CAPACITY = 100 ; private Object[] array ; private int pos = 0 ; public MyStack () { this . array = new Object[ CAPACITY ] ; } @Override public void push ( T item) { if ( pos >= array . length / 2 ) { Object[] newArray = new Object[ pos * 2 ] ; System. arraycopy ( array , 0 , newArray , 0 , array . length ) ; array = newArray ; } array [ pos ++] = item ; } @Override public T pop () { if (isEmpty()) { throw new RuntimeException( "empty stack" ) ; } @SuppressWarnings ( "unchecked" ) T item = ( T ) array [ pos - 1 ] ; pos -= 1 ; return item ; } @Override @SuppressWarnings ( "unchecked" ) public T peek...
Read more

Simplescalar Simulator - Part 2: sim-outorder.c

-
sim-outorder implements a very detailed out-of-order issue superscalar processor with a two-level memory system and speculative execution support. This simulator is a performance simulator, tracking the latency of all pipeline operations. Let's have a look at SimpleScalar simulator's code related to iTLB. (Instruction Translation Lookaside Buffer) First, there are simulator options related to iTLB: /* register simulator-specific options */ void sim_reg_options(struct opt_odb_t *odb) { /* TLB options */ opt_reg_string(odb, "-tlb:itlb", "instruction TLB config, i.e., { |none}", &itlb_opt, "itlb:16:4096:4:l", /* print */TRUE, NULL); opt_reg_int(odb, "-tlb:lat", "inst/data TLB miss latency (in cycles)", &tlb_miss_lat, /* default */30, /* print */TRUE, /* format */NULL); } /* check simulator-specific option values */ void  sim_check_options(... ) { /* sim-outorder.c  line: 1098*/   /* u...
Read more

Notes on Java Performance

-
Performance monitoring, performance profiling and performance tuning are different activities. For example, monitoring is not an intrusive action but profiling is. Because it may be changing the responsiveness of the running application. User CPU utilization vs Kernel CPU utilization: The ideal situation is when Kernel CPU utilization is 0%. So ideally, all the CPU cycles must be spent on our application code. JVM just in time compiler performs dynamic optimizations. So it makes decisions while the program is running and generates native code with better performance. Java 1.0 was completely interpreted but beginning with Java 1.1.8, there was a just-in-time compiler. It was 8 times faster. After that, paralellizing the garbage collector was a huge improvement. There are hundreds of Java tuning flags. https://github.com/ScottOaks/JavaPerformanceTuning Boolean flags use this syntax: -XX:+FlagName enables the flag, and -XX:-FlagName disables the flag. 32 BIT VS 64 BIT Fr...
Read more