Welcome!

Linux Containers Authors: Elizabeth White, Liz McMillan, Stackify Blog, Pat Romanski, Kevin Benedict

Related Topics: Java IoT, Weblogic, Linux Containers

Java IoT: Article

Java Basics: Introduction to Java Threads, Part 2

Internet Portals Like Yahoo, CNN, or Your Bank's Web Site Use Them

In the previous lesson www.sys-con.com/story/?storyid=46096&de=1 I've explained the basics of Java threads. This time we'll talk about using threads for creating a little more advanced programs.

I'm sure each of you have visited some of the major Internet portals like Yahoo, CNN or your bank's Web site. These portals usually display different types of information like News, Weather, Stock Market quotes, etc. Each of these info pieces appears on the screen instantaneously even though it's coming to the portal from different servers, i.e. the News server may be located in Washington and the stock market data come from New York (see Figure 1 below).

Let's say it takes 4 seconds to receive the news and 3 seconds to get the stock prices. If your program will do it in a sequence, it'll take you 7 seconds total, but why not do this in parallel and reduce the total time to 4 seconds? After all these servers have their own processors that can work in independently from each other! We are not going to discuss Web technologies here, but I'll show you how to spawn parallel processing using multi-threading, collect the returned data and display the results to the user in one shot.

Our program will consist of the following classes:

  • MyPortal that will spawn the threads and collect their returns in an ArrayList of strings. It'll print entire content of this array when all threads complete.
  • NewsServer that will run for 4 seconds and return a message "We have good and bad news";
  • StockServer that will run for 3 seconds and return a message "The stock market is on the rise!".
These threads do not contain any code that actually gets some news or market data. My goal is to show you how threads can communicate with other classes, and after this part works, it wont be difficult to replace the line that prints a static message with a method call that actually connects to the Internet and gets the data as it was explained in the lesson on getting data from the Internet:.

The class in Listing 1 creates and starts two threads (news and stocks) and goes to sleep for 10 seconds just to keep the program alive for a while. Please note that the class MyPortal also passes to each thread a reference to its instance so the threads know were to return the results. After each thread completes, it returns the result to MyPortal by calling its method submitResult(). Each of the resulting strings is being added to the ArrayList dataToDisplay, and when its size grows to two elements MyPortal prints the content of content the collection dataToDisplay. A little later I'll explain why such use of an ArrayList may not be the best solution for this example.

Listing 1. The source code of the class MyPortal


import java.util.ArrayList;
public class MyPortal {
	ArrayList dataToDisplay = new ArrayList();
    public static void main(String args[]){
    	MyPortal mp =new MyPortal();
    	// Spawn the threads and pass them the referennce
    	// to the instance of MyPortal
    	NewsServer myNews = new NewsServer(mp);
    	Thread newsThread = new Thread(myNews);

    	StockServer myStocks = new StockServer(mp);
    	Thread stockThread = new Thread(myStocks);

    	//Start the threads
    	newsThread.start();
    	stockThread.start();

    	try {
    		System.out.println("MyPortal is sleeping...!");
			Thread.sleep(10000); // wait for 10 sec 
		} catch (InterruptedException e) {
			e.printStackTrace();
		}

		System.out.println("Good bye!");
	}

    // Add the data returned by a thread to collection
    public void submitResult(String data){
    	dataToDisplay.add(data);

    	// Print the data if both threads have submitted the data
    	// (a buggy version)
    	if (dataToDisplay.size()==2){
        	System.out.println(dataToDisplay);
    	}
    }
}

The output of this program looks as follows:

MyPortal is sleeping...
[The stock market is on the rise!, We have good and bad news]
Good bye!

The first line will be printed almost immediately, the second line in 4 seconds and the third one in 10 seconds.

Listing 2. The source code of the class StockServer


public class StockServer implements Runnable {
    MyPortal papa;
    // Constructor
    StockServer(MyPortal parent){
       	papa=parent;
    }

    public void run() {
	// Sleep for 3 seconds to emulate some processing
	// and return a string with the market data to the parent
 	try {
		Thread.sleep(3000);
		papa.submitResult("The stock market is on the rise!");
	} catch (InterruptedException e) {
			e.printStackTrace();
	}
    }
}

Listing 3. The source code of the class NewsServer


public class NewsServer implements Runnable {
    MyPortal papa;

    // Constructor
    NewsServer(MyPortal parent){
       	papa=parent;
    }

	public void run() {
	// Sleep for 4 seconds to emulate some processing
	// and return a string with the news to the parent

		try {
			Thread.sleep(4000);
			papa.submitResult("We have  good and bad news");
		} catch (InterruptedException e) {
			e.printStackTrace();
		}
	}
}

The thread classes from Listing 2 and Listing 3 store the references to the parent class MyPortal in the variable papa. Each of the threads just sleeps for a specified number of seconds, wakes up and passes an appropriate text to papa.

Please note, that even on a single processor's machine the total execution time of our example is just a little more than 4 seconds. The reason is that our threads where "sleeping in parallel" and did not compete for the processor's time. But if you replace the sleeping part with a loop that performs some calculations, the timing will be different on a single processor machine: the program will run about 7 seconds. If you have a dual processor machine, you'll cut the processing time to 4 seconds again.

Thread Synchronization. A Race Condition.

When you write a multithreaded application you should consider possibility of a so-called race condition. This is a situation when you may get unpredictable results because multiple threads access a resource (i.e. a variable) at the same time. In our example two threads are calling the same method submitResult() which in turn accesses the variable dataToDisplay to add some data to it and check the size of this collection. Imagine that two or more threads finish their work at the same time. Let's look at a possible sequence of events:

  1. The NewsServer calls the method submitResult(). The size of dataToDisplay is 0.
  2. The StockServer calls the method submitResult() a split second later. The size of dataToDisplay is 0.
  3. The NewsServer grabs a zero-element dataToDisplay and starts adding its string there as a first element.
  4. The StockServer grabs a zero-element dataToDisplay (because the NewsServer has not finished adding its first the element yet) and starts adding its string there as a first element.
  5. After both threads are done, the dataToDisplay may wind up with having one element because the first thread's string has been overwritten by the second one. In this is the case, the size of the dataToDisplay will remain one and MyPortal will never print the news and stock data.
Since the probability of this situation is really small, your program may work properly for years and all of a sudden produce unexpected results. Bugs like this one are not easy to discover.

To avoid race conditions, the code that needs to access a "sensitive" variable must be locked (become unavailable for other threads) for the time when one thread works with it. When the first thread completes, the lock is released and another thread can get a hold of this variable/resource. You can arrange such locking either by using a Java keyword synchronized, or by using Java objects that are internally synchronized.

In our portal example, you can simply use the class Vector instead of ArrayList:

Vector dataToDisplay = new Vector();

Vector objects are internally synchronized in Java, and the second thread won't be able to add a string to the dataToDisplay collection until the first thread is done. Obviously, there is a price to pay for this convenience: synchronized objects are a little bit slower than non-synchronized ones.

The other solution is to put an explicit lock for a piece of code that must be completed without any interruption by other threads. For example, if you'll add the keyword synchronized to the signature of the method submitResult(), the second thread will not be able to call this method, if the first one is still executing it:

public synchronized void submitResult(String data){?}

You can also say that a lock is placed on the entire method submitResult().

You should try to minimize the locking time to avoid slowing down your programs. Java allows you to synchronize just a small portion of the code, which is more preferable than synchronizing an entire method.:


    public void submitResult(String data){
 
    	synchronized (this){
    	  dataToDisplay.add(data);
    	}

    	if (dataToDisplay.size()==2){
        	System.out.println(dataToDisplay);
    	}
    }

When a synchronized block is executed, the object in parenthesis is locked and cannot be used by any other thread until the lock is released.

Each Java thread has its own memory and the JVM copies there variables from the main program memory. The keyword synchronize means to synch up the content of the main and thread's portions of memory. This ensures that each thread works with the most current value of the resource (in our case its dataToDisplay).

If you spot a group of Java programmers in a bar, after a couple of beers they may start using some mysterious words: monitor and mutex.

A monitor is just a piece of a synchronized code. We can say that one of our threads can enter a monitor and safely modify the variable dataToDisplay. While the first thread is working, another thread(s) may start waiting for this monitor.

Mutex means mutually exclusive, and this term also refers to the fact that threads may take turns accessing some program variable(s).

In this lesson you've learned one of the ways of treating more than one thread as a group, but this is not the only way. Java has a class java.lang.ThreadGroup that allows you to create and start a group of threads, control the threads within the group and check which threads are still active. You may also consider the method join() of the class Thread if one thread needs to wait for completion of another.

Threads can communicate with other Java objects using special methods wait(), notify() and notifyAll(), but this is going to be a topic of another lesson. Meanwhile, you can read more about threads in the Java Tutorial over here: http://java.sun.com/docs/books/tutorial/essential/threads/

More Stories By Yakov Fain

Yakov Fain is a Java Champion and a co-founder of the IT consultancy Farata Systems and the product company SuranceBay. He wrote a thousand blogs (http://yakovfain.com) and several books about software development. Yakov authored and co-authored such books as "Angular 2 Development with TypeScript", "Java 24-Hour Trainer", and "Enterprise Web Development". His Twitter tag is @yfain

Comments (3) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
Slava Pestov 02/18/05 07:57:05 PM EST

Yakov, your last threads example has a race condition.

Consider this:

thread 1 executes: synchronized (this){ dataToDisplay.add(data); }.

then thread 2 executes: synchronized (this){ dataToDisplay.add(data); }.

then thread 1 executes: if (dataToDisplay.size()==2){ System.out.println(dataToDisplay); }

then thread 2 executes: if (dataToDisplay.size()==2){ System.out.println(dataToDisplay); }

That last System.out.println(dataToDisplay); executes twice, which is not what you intended.

Yakov Fain 02/04/05 11:41:26 AM EST

Yes, J2EE spec does not recommend it, but if you do it right everything works fine. Here's how this could be done

To control threads in a J2EE container use a thread pool (it's a singleton) and get threads from there. If you use J2SE 5.0, use the package java.util.concurrent (in particular, ThreadPoolExecutor). In J2SE 1.4 and below use an excellent concurrent package created by Doug Lea.

Disclaimer: It's just my personal opinion based on my prior experience with a pretty serious financial application. But I do not recommend you to violate J2EE spec.

Feldhacker 02/04/05 08:35:41 AM EST

Is a J2EE version of this example available? Since J2EE forbids explicit thread management, how would this be done on a web server?

@ThingsExpo Stories
"We're a cybersecurity firm that specializes in engineering security solutions both at the software and hardware level. Security cannot be an after-the-fact afterthought, which is what it's become," stated Richard Blech, Chief Executive Officer at Secure Channels, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Consumers increasingly expect their electronic "things" to be connected to smart phones, tablets and the Internet. When that thing happens to be a medical device, the risks and benefits of connectivity must be carefully weighed. Once the decision is made that connecting the device is beneficial, medical device manufacturers must design their products to maintain patient safety and prevent compromised personal health information in the face of cybersecurity threats. In his session at @ThingsExpo...
SYS-CON Events announced today that Grape Up will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct. 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company specializing in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the U.S. and Europe, Grape Up works with a variety of customers from emergi...
Detecting internal user threats in the Big Data eco-system is challenging and cumbersome. Many organizations monitor internal usage of the Big Data eco-system using a set of alerts. This is not a scalable process given the increase in the number of alerts with the accelerating growth in data volume and user base. Organizations are increasingly leveraging machine learning to monitor only those data elements that are sensitive and critical, autonomously establish monitoring policies, and to detect...
SYS-CON Events announced today that Massive Networks will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Massive Networks mission is simple. To help your business operate seamlessly with fast, reliable, and secure internet and network solutions. Improve your customer's experience with outstanding connections to your cloud.
Everything run by electricity will eventually be connected to the Internet. Get ahead of the Internet of Things revolution and join Akvelon expert and IoT industry leader, Sergey Grebnov, in his session at @ThingsExpo, for an educational dive into the world of managing your home, workplace and all the devices they contain with the power of machine-based AI and intelligent Bot services for a completely streamlined experience.
Because IoT devices are deployed in mission-critical environments more than ever before, it’s increasingly imperative they be truly smart. IoT sensors simply stockpiling data isn’t useful. IoT must be artificially and naturally intelligent in order to provide more value In his session at @ThingsExpo, John Crupi, Vice President and Engineering System Architect at Greenwave Systems, will discuss how IoT artificial intelligence (AI) can be carried out via edge analytics and machine learning techn...
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, will examine the regulations and provide insight on how it affects technology, challenges the established rules and will usher in new levels of diligence a...
In the enterprise today, connected IoT devices are everywhere – both inside and outside corporate environments. The need to identify, manage, control and secure a quickly growing web of connections and outside devices is making the already challenging task of security even more important, and onerous. In his session at @ThingsExpo, Rich Boyer, CISO and Chief Architect for Security at NTT i3, discussed new ways of thinking and the approaches needed to address the emerging challenges of security i...
SYS-CON Events announced today that Datera, that offers a radically new data management architecture, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera is transforming the traditional datacenter model through modern cloud simplicity. The technology industry is at another major inflection point. The rise of mobile, the Internet of Things, data storage and Big...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics ...
SYS-CON Events announced today that Datera will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera offers a radically new approach to data management, where innovative software makes data infrastructure invisible, elastic and able to perform at the highest level. It eliminates hardware lock-in and gives IT organizations the choice to source x86 server nodes, with business model option...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, Cloud Expo and @ThingsExpo are two of the most important technology events of the year. Since its launch over eight years ago, Cloud Expo and @ThingsExpo have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, I provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading the...
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
From 2013, NTT Communications has been providing cPaaS service, SkyWay. Its customer’s expectations for leveraging WebRTC technology are not only typical real-time communication use cases such as Web conference, remote education, but also IoT use cases such as remote camera monitoring, smart-glass, and robotic. Because of this, NTT Communications has numerous IoT business use-cases that its customers are developing on top of PaaS. WebRTC will lead IoT businesses to be more innovative and address...
In his opening keynote at 20th Cloud Expo, Michael Maximilien, Research Scientist, Architect, and Engineer at IBM, discussed the full potential of the cloud and social data requires artificial intelligence. By mixing Cloud Foundry and the rich set of Watson services, IBM's Bluemix is the best cloud operating system for enterprises today, providing rapid development and deployment of applications that can take advantage of the rich catalog of Watson services to help drive insights from the vast t...
SYS-CON Events announced today that Elastifile will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Elastifile Cloud File System (ECFS) is software-defined data infrastructure designed for seamless and efficient management of dynamic workloads across heterogeneous environments. Elastifile provides the architecture needed to optimize your hybrid cloud environment, by facilitating efficient...