Raw data as input (non-process mining ready)

Let's say we have a certain file that we want to consider for processing using Beamline but this file does not meet any of the sources already implemented. Then, this example shows how to process such a file using Beamline.

For the sake of simplicity let's consider a file where each line refers to one event but, within the line, the first 3 characters identify the case id, while the rest is the activity name. This is an example of such a file (where 001 and 002 are the case ids, and ActA, B and Act_C are the activity names):

1
2
3
4
5
6

002ActA
001ActA
002B
002Act_C
001B
001Act_C

To accomplish our goal, we need first to define a source capable of processing the file:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13

BeamlineAbstractSource customSource = new BeamlineAbstractSource() {
   @Override
   public void run(SourceContext<BEvent> ctx) throws Exception {
      Files.lines(Path.of(logFile)).forEach(line -> {
         String caseId = line.substring(0, 3);
         String activityName = line.substring(3);

         try {
            ctx.collect(BEvent.create("my-process-name", caseId, activityName));
         } catch (EventException e) { }
      });
   }
};

Now, a stream of BEvents is available and can be processed with any miner available, for example, using the Trivial discovery miner:

21
22
23
24
25
26
27
28
29
30
31
32

StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
env
   .addSource(customSource)
   .keyBy(BEvent::getProcessName)
   .flatMap(new DirectlyFollowsDependencyDiscoveryMiner().setModelRefreshRate(1).setMinDependency(0.1))
   .addSink(new SinkFunction<ProcessMap>() {
      @Override
      public void invoke(ProcessMap value, Context context) throws Exception {
         value.generateDot().exportToSvg(new File("src/main/resources/output/output.svg"));
      };
   });
env.execute();

In this case, we configured the miner to consume all events and, once the stream is completed (in this case we do know that the stream will terminate) we dump the result of the miner into a file output.svg which will contain the following model:

The complete code of this example is available in the GitHub repository https://github.com/beamline/examples/tree/master/src/main/java/beamline/examples/rawData.