TimeSeriesChat null value

This does not need to bein JfreeChart manual or among itsfeatiures - it should be done before - when you prepare data - just ignorer identical data and not ad dthem

If I do this, I get NPE

If you remember, when I start this question https://www.experts-exchange.com/questions/27385500/Ignoring-repeating-results.html
I suppose that dataset has to be filled.

The dataset should have at least something - if you remove duplicates it still wil have something - this is the issue which has nothing to do wwith JFreeChart - it has to do with hiw you create dataset.

We already went through ignorung the same data - and this is the way to create dataset ignoring duplcate records

If you see NPE you ahould catch the exception and print ex.printStackTrace() and locate exact line and snalyze why it happens. If it happens beacuse of bad data - you need to go to the place where data is collected and find the reason of bad or missing data. in such case JfreeChart has nothing to do with iut - it can only draw if we provide valid data

I don't understand what data has to be insert into dataset. Any value will be wrong. If we put zero "0", chart will jump down to zero value, if we put null, we have NPE.
I work already two days on this question and still not understand how to avoid renderer from drawing any data on the chart.
It should be some option like if bb0 == bb, setSeriesVisible(false)

You definitely don't put null into data - that makes no sense. If you need to shoiw valuye zero then you put zero into data. You should not nix it in your mind with JFreeeChart. You should uinderatand your busines requirement and crete data correctly - make a table of ytour data and forgewt about any JfreeChart - make sure youir tablke printout is cortect

I suggest that you first forget about any chart drawing - that sidetracks the thought.Just at the point where you beklive you have accumulated the data for
drawing - print it out in the form of two columns and inspect it.
If it has something which you don't wnat it to have zeroes, nulls, etc. then think how to weed it out
while accumulating it.

You don't understand the question. Means, you understood it wrong.
I don't have problem with data, data is correct. My problem is performing of this data.
If you will open screenshot .tiff you will see red and green LINES, these data have not to be performed on this chart like now. It has to be performed ONLY as  a DOT, at the moment when this data changed to the new value.
I try to use this construction

public void doEvent(double bpx, double bb, double bs) {

        System.out.println("    doEvent  >>>>>>>   bpx = " + bpx +
                           "   bb = " + bb + "   bs = " + bs);

        sc1++;
        sc2++;
        sc3++;
        
          for (int j = 2; j > 0; j--) {

              cbb[j] = cbb[j - 1];
              cbs[j] = cbs[j - 1];
          } 
          
              cbb[j] = bb;
              cbs[j] = bs;

.................


public class TimeSeriesEURUSD extends JFrame {

    public static final TimeSeriesEURUSD INSTANCE = new TimeSeriesEURUSD();

    /**
     * @return
     */
    public static TimeSeriesEURUSD getInstance() {
        return INSTANCE;
    }


    public TimeSeriesEURUSD() {

        setContentPane(chartPanel);
        setSize(1800, 800);
        setVisible(true);
    }

    TimeSeries s1 = new TimeSeries("s1");
    TimeSeries s2 = new TimeSeries("s2");
    TimeSeries s3 = new TimeSeries("s3");


    int sc1 = 0;
    int sc2 = 0;
    int sc3 = 0;
    
    double[] cbb = new double[3];
    double[] cbs = new double[3];
    int j;

    public void doEvent(double bpx, double bb, double bs) {

        System.out.println("    doEvent  >>>>>>>   bpx = " + bpx +
                           "   bb = " + bb + "   bs = " + bs);

        sc1++;
        sc2++;
        sc3++;
        
          for (int j = 2; j > 0; j--) {

              cbb[j] = cbb[j - 1];
              cbs[j] = cbs[j - 1];
          } 
          
              cbb[j] = bb;
              cbs[j] = bs;
          
              
      System.out.println("    doEvent  >>>>>>>   cbb[0] = " + cbb[0] +
                         "   cbb[1] = " + cbb[1] + "    cbs[0] = " + cbs[0]  + "   cbs[1] = " + cbs[1]);

        s1.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bpx));
        s2.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bb));
        s3.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bs));
        
        if (sc1 > 1800) {
            s1.delete(0, 0);
        }

        if (sc2 > 100) {
            s2.delete(0, 0);
        }

        if (sc3 > 100) {
            s3.delete(0, 0);
        }
    }


    private JFreeChart createChart(XYDataset dataset) {

        JFreeChart chart =
            ChartFactory.createTimeSeriesChart("EUR/USD", // title
              ...
        XYLineAndShapeRenderer renderer = new XYLineAndShapeRenderer();
        renderer.setSeriesLinesVisible(0, true);
        renderer.setSeriesShapesVisible(0, false);
        
        
        if (cbb[0] == cbb[1])
        {
        renderer.setSeriesLinesVisible(1, false);
        renderer.setSeriesShapesVisible(1, false);
        }
        
        else {
            renderer.setSeriesLinesVisible(1, false);
            renderer.setSeriesShapesVisible(1, true);
        }

        if (cbs[0] == cbs[1])
        {
        renderer.setSeriesLinesVisible(2, false);
        renderer.setSeriesShapesVisible(2, false);
        }
        
      else {
        renderer.setSeriesLinesVisible(2, false);
        renderer.setSeriesShapesVisible(2, true);
      }
        plot.setRenderer(renderer);

Select allOpen in new window

but it doesn't work. Just remove these two timeseries from chart.

So, this chart has to look like blue line chart, which present current rate and red and green dots on this blue line which mark(show) bot signals to buy or to sell.
This is my final target.

I don't see any screenshot.

BotStatistics.tiff attached to initial question

Buy and Sell are just points in time - correct?

Where od you want to put the dots in terms of the second coordinate?
Do you want them to sit on the blue line itsels?

If so - you take the set of  buy time coordinates  - then assign the second corrdinate for each time as the values of the second coordinate
for this time in your blue data and then you get dataset - you add this series in normal way
but then say
 renderer.setSeriesLinesVisible(num_of_series, false);
so it will not connect these dots but just draw them as separate dots like in this examples:
http://www.java2s.com/Code/Java/Chart/JFreeChartLineChartDemo6.htm

This is dynamic chart, so all performances have to be arranged automatically.
I'll try to use XYDotRenderer, maybe this can help.

don't understand what you mean by "performances"
but once you supply data, and let her darw the cahrt it wll draw it;
you got new data, recreated the charts - it will show new data.
If your data are changing asay once a few seconds I think it will keep up.
If the data are changing many times a second it may be a problem,
as JFreeChart (like actually almost any Java component) redraws the whole panel every time

>>>you got new data, recreated the charts - it will show new data.
I don't want to see new data, if it's similar to previous.
Performances, I mean drawing this useless, garbage data on the chart.
I need only signal value presented on this chart, but not this permanent "noise" data, this "noise" data has to be filtered.

again, we return to the same thing.
you know what you consider to be noise data, JFreeChart - does not, each point is just a point to JFreChart.
So if there is some data which you believe is noise - analyze it before you add to dataset
and don't add it to dataset if this point is a noise

Noise, I mean repeated data, this data was actual at the moment when it was issued, next second it starts to be "noise"

at each mioment before drawing edit (or re-create) dataset - whatever you consider garbage at the moment of editing - remove it,
whatever you consider good at the moment of editing will be drawn

>>> whatever you consider garbage at the moment of editing - remove it,
when I remove it ==>>>>NPE

Again, check - find the line where you have NPE - and understand why it happens - it does not happen just because you removed some point
from your data - maybe you added some null or something - but be reasonable - whta maeans - "when I remlove it - NPE" - that's why I'm saying -
find the line, print the data in the plain text before putting them into dataset - either you put null in the data or it maybe some other issue just coincidence with you removing it is a matter of normal debugging - just because you removed any point from the data you cannot get error

I repeat. Whatever data I'll put in dataset NEXT SECOND after real data coning, is the wrong. The question not in the data, question is printing(drawing) data only ONCE. The table which you suggest has to look like this:
bb = 1.37011;
bb = null;
bb = null;
bb = null;
bb = null;
bb = null;
bb = null;
bb = 1.37035;
bb = null;
bb = null;
bb = null;
But this table generates NPE

and this table:

bb = 1.37011;
bb = 1.37011;
bb = 1.37011;
bb = 1.37011;
bb = 1.37011;
bb = 1.37035;
bb = 1.37035;
bb = 1.37035;
bb = 1.37035;
bb = 1.37035;

generate noise

Before every drawing you should create again the series
and add only those points which are meaningful:

something like that:

double bb0 = -1.0;

  TimeSeries s2 = new TimeSeries("s2");

loop through all points:
    if(bb == bb0) continue;
    s2.add(new FixedMillisecond(new Date().getTime()),
                       new Float(bb));
    bb0 = bb;
end of loop

thank you, I'll try tomorrow

well, good night and good luck (tomorrow)!

         if(bb == bb0) continue; >>>>>>>>>>>Error(94, 25): continue outside of loop
         
          s2.add(new FixedMillisecond(new Date().getTime()),
                             new Float(bb));
          bb0 = bb;

Look, but not put continue outside the loop

loop through all points:  <---- this is loop throuugh all points - I don't know what particular loop it is , but you need to go through all points
    if(bb == bb0) continue;
    s2.add(new FixedMillisecond(new Date().getTime()),
                       new Float(bb));
    bb0 = bb;
end of loop  <---- this is edn of loop through the points

Please explain what you mean
>>loop through all points:  <---- this is loop throuugh all points - I don't know what particular loop it is , but you need to go through all points

For this particular case I have only bb incoming data, when I compare with previous case

for (DataBuy data : dataList) {

                String s;
                Timestamp tsb;
                String bot_buy;
               
                s = data.getSymbol();
                tsb = data.getTs();  
                bot_buy = data.getBuyPx();

                    if (tsb.equals(tsb0) &&
                        bot_buy.equals(bot_buy0))
                        
                    continue;

                tsb0 = tsb;
                bot_buy0 = bot_buy;

Select allOpen in new window

I don't see any difference.

public void doEvent(double bpx, double bb, double bs) {

        System.out.println("    doEvent  >>>>>>>   bpx = " + bpx +
                           "   bb = " + bb + "   bs = " + bs);

        sc1++;
        sc2++;
        sc3++;
        
//          for (int j = 2; j > 0; j--) {
//
//              cbb[j] = cbb[j - 1];
//              cbs[j] = cbs[j - 1];
//          } 
//          
//              cbb[j] = bb;
//              cbs[j] = bs;
//          
//              
//      System.out.println("    doEvent  >>>>>>>   cbb[0] = " + cbb[0] +
//                         "   cbb[1] = " + cbb[1] + "    cbs[0] = " + cbs[0]  + "   cbs[1] = " + cbs[1]);

        s1.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bpx));
        
        double bb0 = -1.0;

        TimeSeries s2 = new TimeSeries("s2");

        if(bb == bb0) {
              
              continue;
          
          s2.add(new FixedMillisecond(new Date().getTime()),
                             new Float(bb));
          bb0 = bb;
        }

//        double bs0 = -1.0;

//        TimeSeries s3 = new TimeSeries("s3");

//        if (bs == bs0)
//            continue;
        s3.add(new FixedMillisecond(new Date().getTime()), new Float(bs));
//        bs0 = bs;

Select allOpen in new window

Please explain what you mean
>> but you need to go through all points

Before each drawing of the plot you need to craete dataset, add series and then draw the plot. When you are creating data set you are adding oounts tio dataset. Adding points to dataset is the loop where youi are going through points and adding them. In the proces of doing it - yiu should comparer current point with the previouis one using the ideology which I showed yiu above and if current point is identical with the previous one or if current ppoint reperesents any other ttype of junk - just skip it.

What means loop?
As I understand from your statement, loop for this parameter 'bb' starts after
if (bb == bb0)

and finished at bb0 = bb;
Please advice

Loop is what is inside

while{

}

or

for (...) {


}

 

Please, post the place where you populate the dataset
for drawing the plot

public class XYChartEURUSD extends JFrame {

    private String title;

    public static final XYChartEURUSD INSTANCE = new XYChartEURUSD();


    public static XYChartEURUSD getInstance() {
        return INSTANCE;
    }

    public XYChartEURUSD() {
        //        super(title);
        setContentPane(chartPanel);
        setSize(1200, 800);
        setVisible(true);
    }
 
    TimeSeries s1;
    TimeSeries s2;
    TimeSeries s3;

    int sc1 = 0;
    int sc2 = 0;
    int sc3 = 0;
    
//  double bb0 = -1.0;
//  double bs0 = -1.0;

    public void doEvent(double bpx, double bb, double bs) {

        sc1++;
        sc2++;
        sc3++;
        
        if (bb != 0 && bs != 0){
            
    s1 = new TimeSeries("s1");
    
    s2 = new TimeSeries("s2");
    
    double bb0 = -1.0;  
                

        s1.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bpx));
        
//        if (bb == bb0){
                    


        s2.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bb));
       
//            bb0 = bb;
            
//        }
        
         s3 = new TimeSeries("s3");
           double bs0 = -1.0;
        
//        if (bs == bs0){

        

        s3.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bs));

//            bs0 = bs;
//        }
            
        System.out.println("    doEvent  >>>>>>>   bpx = " + bpx + "   bb = " +
                           bb + "   bs = " + bs);
      System.out.println();

        }

        if (sc1 > 1800) {
            s1.delete(0, 0);
        }
        else if (sc2 > 1800){
            s2.delete(0, 0);
        }
        else if (sc3 > 1800){
         s3.delete(0, 0);
        }
    }

//    transient XYItemRenderer r;

        private JFreeChart createChart(XYDataset dataset) {

        JFreeChart chart =
            ChartFactory.createTimeSeriesChart("EUR/USD", // title
                "Time", // x-axis label
                "EUR/USD", // y-axis label
                dataset, // data
                true, // create legend?
                true, // generate tooltips?
                false); // generate URLs?

        chart.setBackgroundPaint(Color.yellow);
        chart.addSubtitle(new TextTitle("Bot Statistics for EUR/USD"));

        XYPlot plot = chart.getXYPlot();


        plot.setBackgroundPaint(Color.white);
        plot.setDomainGridlinePaint(Color.blue);
        plot.setRangeGridlinePaint(Color.blue);

        plot.setAxisOffset(new RectangleInsets(5.0, 5.0, 5.0, 5.0));
        plot.setRangeAxisLocation(0, AxisLocation.BOTTOM_OR_RIGHT);

        XYItemRenderer renderer = plot.getRendererForDataset(dataset);
        
        renderer.setBaseSeriesVisible(true);
        renderer.setSeriesPaint(0, Color. blue);

        DateAxis axis = (DateAxis)plot.getDomainAxis();
        axis.setDateFormatOverride(new SimpleDateFormat("hh:mm:ss"));

        // Dataset2

        XYDataset dataset2 = createDataset2();

        plot.setDataset(1, dataset2);
        plot.mapDatasetToRangeAxis(0, 1);
        XYItemRenderer renderer2 = new XYLineAndShapeRenderer();
        renderer2.setSeriesPaint(0, Color.green);
        plot.setRenderer(1, renderer2);

        // Dataset3

        XYDataset dataset3 = createDataset3();

        plot.setDataset(2, dataset3);
        plot.mapDatasetToRangeAxis(0, 2);
        XYItemRenderer renderer3 = new XYLineAndShapeRenderer();
        renderer3.setSeriesPaint(0, Color.red);
        plot.setRenderer(2, renderer3);

        return chart;
    }

    private XYDataset createDataset() {

        TimeSeriesCollection dataset = new TimeSeriesCollection();

        dataset.addSeries(s1);

        return dataset;
    }

    private XYDataset createDataset2() {

        TimeSeriesCollection dataset2 = new TimeSeriesCollection();

        dataset2.addSeries(s2);

        return dataset2;
    }

    private XYDataset createDataset3() {

        TimeSeriesCollection dataset3 = new TimeSeriesCollection();

        dataset3.addSeries(s3);

        return dataset3;
    }

    public JPanel createDemoPanel() {
        JFreeChart chart = createChart(createDataset());
        ChartPanel panel = new ChartPanel(chart);
        panel.setFillZoomRectangle(true);
        panel.setMouseWheelEnabled(true);

        return panel;
    }
    ChartPanel chartPanel = (ChartPanel)createDemoPanel();

}

Select allOpen in new window

I'm sorry, I can't understand.

Well, you do not know who or what calls doEvent() method
but as I understadn doEvent() is called each time you add a new point to each of the three series.
Is it so?

If so, then why  you create the series themselves
with these kind of operations
 s1 = new TimeSeries("s1");
every time doEvent() is called?

These data come from previous solved question

public SelectData() throws SQLException, ClassNotFoundException,
                               IllegalAccessException, InstantiationException,
                               Exception {
        conn = new ConnectDB();
    }

    public void run() {
        try {
            List<DataStream> dataList =
                conn.selectStream("SELECT * FROM EURUSD where timest = ( select max( timest ) from EURUSD ) and rownum = 1 "); //union all " +

            for (DataStream data : dataList) {

                String s;
               
                Timestamp tst;

                s = data.getSymbol();
                bpx = data.getOpenBid();
                tst = data.getTimest();

                if (s.equals("EUR/USD")) {

                    symbol[0] = s;
                    openBid[0] = bpx;

                    XYChartEURUSD.getInstance().doEvent(bpx, bb, bs);

                    timest[0] = tst;
...............

        try {


            List<DataBuy> dataList =
                conn.selectBuy("SELECT * FROM EURUSD_BOT_BUY where ts = ( select max( ts ) from EURUSD_BOT_BUY ) and rownum = 1 "); //union all " +

            for (DataBuy data : dataList) {

                String s;
                Timestamp tsb;
                String bot_buy;
               
                s = data.getSymbol();
                tsb = data.getTs();  
                bot_buy = data.getBuyPx();

                    if (tsb.equals(tsb0) &&
                        bot_buy.equals(bot_buy0))
                        
                    continue;

                tsb0 = tsb;
                bot_buy0 = bot_buy; 
                             
                bb = Double.parseDouble(bot_buy);

                if (s.equals("EUR/USD"))
                {

                    symbol[0] = s;
                    buy_px[0] = bb;

                    XYChartEURUSD.getInstance().doEvent(bpx, bb, bs);

                    ts_buy[0] = tsb;
.................

        try {

            List<DataSell> dataList =
                conn.selectSell("SELECT * FROM EURUSD_BOT_SELL where ts = ( select max( ts ) from EURUSD_BOT_SELL ) and rownum = 1 "); //union all " +
      
            for (DataSell data : dataList) {

                String s;
                Timestamp tss;
                String bot_sell;

                s = data.getSymbol();
                tss = data.getTs();
                bot_sell = data.getSellPx();

                if (tss.equals(tss0) && bot_sell.equals(bot_sell0))
                    continue;

                tss0 = tss;
                bot_sell0 = bot_sell;
                
                bs = Double.parseDouble(bot_sell);

                if (s.equals("EUR/USD")) {


                    symbol[0] = s;
                    sell_px[0] = bs;

                    XYChartEURUSD.getInstance().doEvent(bpx, bb, bs);

                    ts_sell[0] = tss;

Select allOpen in new window

dut how often does doEvent() execute?
does it exceute once for every point in the series?

TimeSeries as I understand is the whole set of points.

If so, I can't understand, how it can run

 s1 = new TimeSeries("s1");
   
 every time you have non-zero values.

We need to understand bigger picture of your application.
 

SelectData class collect data from DB  

public static void main(String[] args) throws Exception {

        chartControl = new ChartControl();
        callSelect();
    }


    /**
     * @throws Exception
     */
    public static void callSelect() throws Exception {
        try {
            timer = new Timer();
            timer.schedule(new SelectData(), 10000, 1000);

Select allOpen in new window

When data selected they separated by currency pairs, even create an array is unnecessary, because we need only bb value and we filter it by symbol, so it may look like this:
 

if (s.equals("EUR/USD")) {

                    XYChartEURUSD.getInstance().doEvent(bpx, bb, bs);

Select allOpen in new window

Before it was one dataset with three data series, but in view that we have to play with each one separately, I split them on three different datasets, but place them on one plot with one axis for all of them.
That's all.
Now I need put only changed data to each dataset, but if dataset will be empty, it may generate NPE.
OK, 's1' always has fresh data, so we don't need to touch it, but 's2' and 's3' most of the time has identical data, because data chained only when bot generate buy or sell signal, but this may happened ones of 60 seconds and more, so SelectData send to XYChart.doEvent every second identical data which are displayed as a straight horizontal line with dots. So, most of the time I have one real time line chart which shows every second changed real rate and two horizontal line which show last time changed value of 'bb' and 'bs'.
And when bb or bs again changed, line jump to the new level and continue with this value.

but why do you create new series every call to doEvent() ?
I think series should be created once and befiore and when you call doEvent you just accumulate points
so then when you create series you set these bb0 to -1;
and then add only those bb0 whiche are not zero and not equal to the previous one.
But when the series is created every time so I lose understanding

originally I create them once, in sample which I publish I move them down into doEvent method, this is normal view

public class XYChartEURUSD extends JFrame {

    public static final XYChartEURUSD INSTANCE = new XYChartEURUSD();

    public static XYChartEURUSD getInstance() {
        return INSTANCE;
    }

        public XYChartEURUSD() {
        setContentPane(chartPanel);
        setSize(1200, 800);
        setVisible(true);
    }

    TimeSeries s1 = new TimeSeries("s1");
    TimeSeries s2 = new TimeSeries("s2");
    TimeSeries s3 = new TimeSeries("s3");

    int sc1 = 0;
    int sc2 = 0;
    int sc3 = 0;

    public void doEvent(double bpx, double bb, double bs) {

        sc1++;
        sc2++;
        sc3++;
        
        if (bb != 0 && bs != 0){

        s1.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bpx));

        s2.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bb));

        s3.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bs));

        System.out.println("    doEvent  >>>>>>>   bpx = " + bpx + "   bb = " +
                           bb + "   bs = " + bs);

Select allOpen in new window

This part I'm don't understand completely. If bb value is definitely positive, it's impossible bb == bb0, if bb0 = -1.0
Maybe it's need come counter which will keep value of bb0, so we can compare these two values.

Thank a lot. This code works

public void doEvent(double bpx, double bb, double bs) {

        s1.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bpx));
        
      for (int j = 2; j > 0; j--) {
      
                    cbb[j] = cbb[j - 1];
                    cbs[j] = cbs[j - 1];
                } 
                
                    cbb[j] = bb;
                    cbs[j] = bs;
            
          if (bb != 0 && cbb[0] != cbb[1]){

        s2.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bb));
          }
       if (bs != 0  && cbs[0] != cbs[1]){

        s3.addOrUpdate(new FixedMillisecond(new Date().getTime()),
                       new Float(bs));
        }

Select allOpen in new window

Great!

Thank you for you help!

You are always welcome.

As always I have new question, as an extension of previous.

Don't see where is that?

I just now prepare it "Client-server transforming"