Experiments on Datalog rewriting

1. Oxford ontology library experiments
2. Blown up ontologies experiments

This page concerns experiments for saturation algorithms,

over the Oxford ontology library,
over higher-arity Guarded TGDs derived from these ontologies.

In the paper, we give only a summary of conclusions concerning the relative performance of different methods on these datasets, which averages over many inputs. Here we give the full output.

In the following, we explore the statistics outputted by the experiments on Simple, Existential-based, Skolem and hyper-resolution Datalog rewriting compared with KAON2. The rewriting times are in miliseconds in the columns SSAT_TIME, Exb_TIME, SK_TIME, HYPER_TIME and KAON2_TIME respectively. The columns NFTGD and FTGD respectively contain the number of non full and Datalog rule in the input, AXIOM is the number of axioms used in the input for KAON2. The columns OUTPUT contain the number of Datalog rules in the output rewriting. Each row contain the values of the execution on the ontology whose name is in column NAME. The timeout is 10 minutes.

1. Oxford ontology library experiments

1.1. Statistics on the input ontologies

We keep for the experiments only the ontologies which contains both Datalog and non-full TGDs and removing the redundant ontologies, so the number of remaining ontologies is:

Among the remaining ontologies the minimal ontology contains the following number of TGDs:

while the maximal one contains the following number of TGDs:

Among the remaining ontologies the average number of Datalog TGDs is:

11030.072429906542

the median number of Datalog TGDs is:

788.5

The minimum number of Datalog TGDs is:

The maximum number of Datalog TGDs is:

While, the average number of non-full TGDs is:

5255.429906542056

the average number of non-full TGDs is:

282.5

The average proportion of Datalog TGDs in the remaining ontologies is:

0.6928617493946536

1.2. Times Comparison

Cactus plot of the times

<AxesSubplot:>

1.3. Timeout analysis

1.3.1. All the algorithm reach the timeout

The following table contains the rows where all the algorithm executions reach the timeout sorted by the input size. Their number:

NAME	NFTGD	FTGD	SSAT_TIME	Exb_TIME	SK_TIME	HYPER_TIME	KAON2_TIME
26	23858	30697	TIMEOUT	ERROR	TIMEOUT	TIMEOUT	TIMEOUT
27	23858	31647	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
33	12339	9462	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
34	12339	9364	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
36	12329	9456	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
37	12323	9445	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
38	12339	9457	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
40	50790	103042	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
41	21197	68508	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
42	22295	72365	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
43	25490	116974	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
44	21197	68471	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
45	49531	100829	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
46	22297	70404	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
47	21309	68696	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
378	21423	58442	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
379	38615	90926	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
383	17881	65883	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
395	24648	62478	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
483	34035	116906	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
484	37999	102008	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
487	17153	65521	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
533	32907	61414	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
541	11973	28600	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
658	11957	16680	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
660	9040	14988	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
760	57692	171905	TIMEOUT	TIMEOUT	TIMEOUT	ERROR	TIMEOUT
761	5598	13151	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
778	42054	113187	TIMEOUT	TIMEOUT	TIMEOUT	ERROR	TIMEOUT
787	45442	61046	TIMEOUT	TIMEOUT	TIMEOUT	ERROR	TIMEOUT
792	27875	42590	TIMEOUT	ERROR	TIMEOUT	TIMEOUT	TIMEOUT
795	47412	65392	TIMEOUT	TIMEOUT	TIMEOUT	ERROR	TIMEOUT

1.3.2. Timeout summary

The number of ontologies on which two algorithms reach the timeout simultaneously

	SSAT	Exb	SK	HYPER	KAON2
SSAT	173	26	19	14	34
Exb	26	29	1	3	5
SK	19	1	19	11	15
HYPER	14	3	11	14	14
KAON2	34	5	15	14	34

1.3.3. Existential-based DR timeout

The following table contains the rows where the Gsat execution reaches the timeout, while another algorithm is not, sorted by the input size.

NAME	NFTGD	FTGD	SSAT_TIME	Exb_TIME	SK_TIME	HYPER_TIME	KAON2_TIME
343	4	97	299	TIMEOUT	111	97	257
783	187	241	TIMEOUT	TIMEOUT	298	343	352
781	187	243	TIMEOUT	TIMEOUT	315	325	347
319	187	243	TIMEOUT	TIMEOUT	302	332	344
511	345	276	TIMEOUT	TIMEOUT	508	473	394
775	59	331	TIMEOUT	ERROR	499	828	360
479	323	566	TIMEOUT	TIMEOUT	1225	1863	562
480	327	663	TIMEOUT	TIMEOUT	1293	1848	610
624	98	915	12410	TIMEOUT	296	314	442
701	861	982	TIMEOUT	ERROR	10592	9787	62168
21	110	1206	TIMEOUT	TIMEOUT	504	546	447
703	1160	1210	TIMEOUT	ERROR	19120	18527	286437
284	84	1237	TIMEOUT	TIMEOUT	435	881	457
20	83	1326	TIMEOUT	TIMEOUT	434	583	459
410	476	1340	119314	TIMEOUT	2960	2107	1838
24	139	1551	TIMEOUT	TIMEOUT	596	919	582
14	139	1551	TIMEOUT	TIMEOUT	622	845	535
4	16705	2107	TIMEOUT	TIMEOUT	138622	TIMEOUT	TIMEOUT
3	16709	2159	TIMEOUT	TIMEOUT	151215	TIMEOUT	TIMEOUT
350	942	3062	TIMEOUT	TIMEOUT	3251	3664	3685
174	1776	3626	TIMEOUT	ERROR	17052	14447	4980
30	2096	3626	TIMEOUT	ERROR	23714	15284	6904
29	1776	4040	TIMEOUT	ERROR	19376	13514	6984
32	2096	4040	TIMEOUT	ERROR	25878	15852	10678
354	1501	4839	TIMEOUT	TIMEOUT	18866	14525	20487
39	2437	4936	TIMEOUT	ERROR	16362	21924	11060
285	66179	46602	TIMEOUT	TIMEOUT	267422	TIMEOUT	TIMEOUT
675	25194	67697	TIMEOUT	TIMEOUT	TIMEOUT	404336	TIMEOUT
553	50453	90333	TIMEOUT	ERROR	584786	159387	TIMEOUT

1.3.4. Skolem DR timeout

The following table contains the rows where the SkolemDR executions reach the timeout, while another algorithm is not, sorted by the input size.

NAME	NFTGD	FTGD	SSAT_TIME	Exb_TIME	SK_TIME	HYPER_TIME	KAON2_TIME
393	776	1552	TIMEOUT	7785	TIMEOUT	15258	10515
438	1512	3024	TIMEOUT	27164	TIMEOUT	55197	23576
535	8479	4621	TIMEOUT	34441	TIMEOUT	125087	442660
485	2593	5291	TIMEOUT	15645	TIMEOUT	33195	547530
380	3141	6000	TIMEOUT	15112	TIMEOUT	33197	TIMEOUT
381	3216	6053	TIMEOUT	18370	TIMEOUT	39550	TIMEOUT
762	2508	6825	TIMEOUT	127334	TIMEOUT	TIMEOUT	TIMEOUT
518	11036	9363	TIMEOUT	152414	TIMEOUT	TIMEOUT	TIMEOUT
463	9433	10352	TIMEOUT	582183	TIMEOUT	TIMEOUT	TIMEOUT
462	11474	15066	TIMEOUT	574268	TIMEOUT	TIMEOUT	TIMEOUT
391	11754	41534	TIMEOUT	147432	TIMEOUT	TIMEOUT	TIMEOUT
488	11187	46969	TIMEOUT	268813	TIMEOUT	TIMEOUT	TIMEOUT
486	11187	46982	TIMEOUT	264926	TIMEOUT	TIMEOUT	TIMEOUT
382	11806	47304	TIMEOUT	285408	TIMEOUT	TIMEOUT	TIMEOUT
489	13640	52447	TIMEOUT	555145	TIMEOUT	TIMEOUT	TIMEOUT
675	25194	67697	TIMEOUT	TIMEOUT	TIMEOUT	404336	TIMEOUT
437	44247	91145	TIMEOUT	124104	TIMEOUT	109220	TIMEOUT
554	74235	106867	TIMEOUT	326395	TIMEOUT	TIMEOUT	TIMEOUT
786	76401	109114	TIMEOUT	331225	TIMEOUT	ERROR	TIMEOUT

1.3.5. HyperDR timeout

The following table contains the rows where the HyperDR executions reach the timeout, while another algorithm is not, sorted by the input size.

NAME	NFTGD	FTGD	SSAT_TIME	Exb_TIME	SK_TIME	HYPER_TIME	KAON2_TIME
4	16705	2107	TIMEOUT	TIMEOUT	138622	TIMEOUT	TIMEOUT
3	16709	2159	TIMEOUT	TIMEOUT	151215	TIMEOUT	TIMEOUT
762	2508	6825	TIMEOUT	127334	TIMEOUT	TIMEOUT	TIMEOUT
518	11036	9363	TIMEOUT	152414	TIMEOUT	TIMEOUT	TIMEOUT
463	9433	10352	TIMEOUT	582183	TIMEOUT	TIMEOUT	TIMEOUT
462	11474	15066	TIMEOUT	574268	TIMEOUT	TIMEOUT	TIMEOUT
391	11754	41534	TIMEOUT	147432	TIMEOUT	TIMEOUT	TIMEOUT
285	66179	46602	TIMEOUT	TIMEOUT	267422	TIMEOUT	TIMEOUT
488	11187	46969	TIMEOUT	268813	TIMEOUT	TIMEOUT	TIMEOUT
486	11187	46982	TIMEOUT	264926	TIMEOUT	TIMEOUT	TIMEOUT
382	11806	47304	TIMEOUT	285408	TIMEOUT	TIMEOUT	TIMEOUT
489	13640	52447	TIMEOUT	555145	TIMEOUT	TIMEOUT	TIMEOUT
554	74235	106867	TIMEOUT	326395	TIMEOUT	TIMEOUT	TIMEOUT
786	76401	109114	TIMEOUT	331225	TIMEOUT	ERROR	TIMEOUT

1.3.6. KAON2 timeouts

The following table contains the rows where KAON2 executions reach the timeout of 10min, while another algorithm is not, sorted by the input size.

NAME	NFTGD	FTGD	SSAT_TIME	Exb_TIME	SK_TIME	HYPER_TIME	KAON2_TIME
4	16705	2107	TIMEOUT	TIMEOUT	138622	TIMEOUT	TIMEOUT
3	16709	2159	TIMEOUT	TIMEOUT	151215	TIMEOUT	TIMEOUT
380	3141	6000	TIMEOUT	15112	TIMEOUT	33197	TIMEOUT
381	3216	6053	TIMEOUT	18370	TIMEOUT	39550	TIMEOUT
762	2508	6825	TIMEOUT	127334	TIMEOUT	TIMEOUT	TIMEOUT
518	11036	9363	TIMEOUT	152414	TIMEOUT	TIMEOUT	TIMEOUT
463	9433	10352	TIMEOUT	582183	TIMEOUT	TIMEOUT	TIMEOUT
477	156743	10606	TIMEOUT	7972	14393	16686	TIMEOUT
462	11474	15066	TIMEOUT	574268	TIMEOUT	TIMEOUT	TIMEOUT
390	7265	26905	TIMEOUT	71855	536336	97988	TIMEOUT
394	9163	31483	TIMEOUT	34910	230353	60083	TIMEOUT
536	6762	36439	TIMEOUT	14175	25968	12115	TIMEOUT
391	11754	41534	TIMEOUT	147432	TIMEOUT	TIMEOUT	TIMEOUT
387	12083	44583	TIMEOUT	27186	74510	28685	TIMEOUT
375	12633	45611	TIMEOUT	192410	226470	53828	TIMEOUT
285	66179	46602	TIMEOUT	TIMEOUT	267422	TIMEOUT	TIMEOUT
488	11187	46969	TIMEOUT	268813	TIMEOUT	TIMEOUT	TIMEOUT
486	11187	46982	TIMEOUT	264926	TIMEOUT	TIMEOUT	TIMEOUT
382	11806	47304	TIMEOUT	285408	TIMEOUT	TIMEOUT	TIMEOUT
537	11089	51964	TIMEOUT	24657	56793	18967	TIMEOUT
489	13640	52447	TIMEOUT	555145	TIMEOUT	TIMEOUT	TIMEOUT
572	19651	57494	TIMEOUT	70344	30051	19052	TIMEOUT
684	12683	62377	TIMEOUT	23589	42202	17352	TIMEOUT
675	25194	67697	TIMEOUT	TIMEOUT	TIMEOUT	404336	TIMEOUT
472	44414	75146	TIMEOUT	65642	23768	31809	TIMEOUT
470	44414	75146	TIMEOUT	64611	23433	31249	TIMEOUT
473	42734	78977	TIMEOUT	41970	20823	28714	TIMEOUT
471	42734	78977	TIMEOUT	42394	20825	28307	TIMEOUT
553	50453	90333	TIMEOUT	ERROR	584786	159387	TIMEOUT
437	44247	91145	TIMEOUT	124104	TIMEOUT	109220	TIMEOUT
573	36922	91847	TIMEOUT	211769	146914	59636	TIMEOUT
686	36894	106605	TIMEOUT	199740	38444	39435	TIMEOUT
554	74235	106867	TIMEOUT	326395	TIMEOUT	TIMEOUT	TIMEOUT
786	76401	109114	TIMEOUT	331225	TIMEOUT	ERROR	TIMEOUT

1.4. Winning Algorithms

In the following, we show the ontologies on which an algorithm "wins" over another meaning that:

the slower algorithm requires more than 500ms to compute the saturation,
the faster algorithm requires 50% less time than the lowest.

1.4.1. ExbDR vs SkolemDR

Ontologies on which ExbDR wins over SkolemDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	SK_OUTPUT	Exb_OUTPUT	SK_TIME	Exb_TIME	TIME_FACTOR
392	608	1213	1216	1213	9492	9492	405177	6587	61.5
418	202	395	404	395	397	397	40274	977	41.2
500	1622	1990	3242	1988	4369	4369	216717	7648	28.3
397	1494	2922	2988	2922	8721	8721	196197	6987	28.1
685	394	755	788	754	1197	1197	55971	2241	25
534	315	630	630	630	630	630	17393	1007	17.3
417	176	343	352	343	343	343	12170	820	14.8
679	260	472	518	472	1293	1293	17084	1202	14.2
574	535	736	956	736	2462	2462	27004	1973	13.7
575	479	700	958	700	2255	2255	25045	2001	12.5
676	1921	1662	3842	1662	4756	4756	64556	5285	12.2
677	1608	1283	3214	1282	3926	3926	46498	4220	11
421	717	1274	1432	1273	4651	4649	34551	3377	10.2
373	668	1298	1336	1297	1486	1486	12441	1470	8.5
396	597	1153	1194	1153	1772	1772	14571	1744	8.4
390	7265	26905	14058	26439	41085	41085	536336	71855	7.5
394	9163	31483	18142	31193	33135	33135	230353	34910	6.6
476	1834	2713	3668	2687	5016	5016	41907	6565	6.4
401	423	786	846	786	1256	1256	4392	860	5.1
372	557	1078	1114	1077	1253	1253	5277	1048	5
436	2308	24788	4616	24014	52853	52853	352469	71249	4.9
657	1732	2654	3284	2580	3405	3405	31145	6663	4.7
422	420	672	840	672	1051	1051	6318	1374	4.6
399	512	991	1024	991	1113	1113	4776	1052	4.5
419	1636	4806	2992	4470	9785	9783	211531	47627	4.4
540	1744	13345	3308	13265	14090	14090	26414	7138	3.7
376	694	1286	1388	1286	8301	8301	8094	2191	3.7
377	570	1006	1140	1006	7382	7382	6215	1784	3.5
539	104	208	208	208	210	210	835	278	3
389	100	200	200	200	200	200	842	289	2.9
387	12083	44583	24050	44320	63422	63422	74510	27186	2.7
538	102	204	204	204	204	204	801	294	2.7
424	786	1507	1456	1463	2119	2119	5560	2294	2.4
537	11089	51964	22178	51961	52125	52125	56793	24657	2.3
388	106	212	212	212	244	244	599	261	2.3
569	966	1750	1830	1701	2442	2442	5995	2709	2.2
384	732	548	1464	548	1196	1196	1563	715	2.2
385	834	574	1658	573	1737	1737	1988	936	2.1
632	500	1895	1000	1895	2190	2190	3060	1462	2.1

Ontologies on which SkolemDR wins over ExbDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	SK_OUTPUT	Exb_OUTPUT	SK_TIME	Exb_TIME	TIME_FACTOR
18	85	1145	171	1130	1255	1253	393	310205	789.3
283	86	972	173	961	1089	1087	391	308514	789
13	76	1279	157	1267	1374	1370	371	285892	770.6
19	68	1092	141	1079	1170	1168	387	246233	636.3
282	66	893	137	884	975	973	354	220349	622.5
16	65	1069	135	1056	1144	1142	348	173139	497.5
17	65	1191	135	1178	1266	1264	359	167261	465.9
788	13	2289	22	2289	2296	2296	254	88957	350.2
789	13	2342	24	2342	2351	2351	231	72609	314.3
790	10	2550	18	2550	2556	2556	254	60863	239.6
151	48	263	51	263	292	292	217	15376	70.9
772	6	653	12	653	656	656	207	13006	62.8
1	254	2476	462	2468	2523	2523	517	27380	53
426	24421	44891	48842	44891	44891	44891	19425	165061	8.5
590	16	605	26	605	613	613	227	1738	7.7
754	932	973	3742	973	1604	1604	11531	85279	7.4
23	13	440	26	429	440	440	159	1140	7.2
425	11625	26750	23250	26750	26750	26750	8501	58616	6.9
448	24892	49657	49694	49406	67986	67986	30027	184427	6.1
682	24701	50202	49402	50011	68461	68461	28609	169379	5.9
22	13	433	26	425	436	436	161	909	5.6
737	227	228	854	228	228	228	1355	7103	5.2
172	108	190	216	190	216	216	378	1973	5.2
686	36894	106605	73788	106414	124846	124846	38444	199740	5.2
532	11943	38053	23886	38045	38093	38093	12980	65243	5
15	13	353	26	345	356	356	175	851	4.9
281	13	353	26	345	356	356	170	810	4.8
712	502	681	1924	681	993	993	4430	13792	3.1
556	499	1532	1144	1549	1976	1924	914	2737	3
472	44414	75146	88828	75146	75146	75146	23768	65642	2.8
470	44414	75146	88828	75146	75146	75146	23433	64611	2.8
369	10978	39919	21956	39919	39919	39919	5826	15897	2.7
370	12070	56379	24140	56379	56379	56379	6859	17780	2.6
368	6657	25628	13314	25628	25628	25628	3623	9102	2.5
566	2505	49988	4990	49983	50011	50009	5105	12017	2.4
572	19651	57494	39188	57494	60197	60197	30051	70344	2.3
412	919	3532	1838	3532	3532	3532	695	1617	2.3
773	55	590	103	577	620	620	226	509	2.3
460	9023	10382	18046	10382	11064	11064	4391	9788	2.2
512	458	800	669	800	1057	1057	606	1310	2.2
747	419	437	1822	437	437	437	4103	8850	2.2
750	209	283	872	283	283	283	1033	2197	2.1
728	728	881	2774	881	1357	1357	7168	14911	2.1
471	42734	78977	85468	78977	78977	78977	20825	42394	2
473	42734	78977	85468	78977	78977	78977	20823	41970	2

1.4.2. ExbDR vs HyperDR

Ontologies on which ExbDR wins over HyperDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	HYPER_OUTPUT	Exb_OUTPUT	HYPER_TIME	Exb_TIME	TIME_FACTOR
535	8479	4621	16958	4621	7057	7057	125087	34441	3.6
676	1921	1662	3842	1662	4756	4756	17088	5285	3.2
677	1608	1283	3214	1282	3926	3926	12410	4220	2.9
380	3141	6000	6282	6000	6302	6302	33197	15112	2.2
381	3216	6053	6432	6053	6587	6587	39550	18370	2.2
485	2593	5291	5186	5291	5451	5451	33195	15645	2.1
477	156743	10606	313486	10606	10606	10606	16686	7972	2.1
438	1512	3024	3024	3024	22410	22410	55197	27164	2

Ontologies on which HyperDR wins over ExbDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	HYPER_OUTPUT	Exb_OUTPUT	HYPER_TIME	Exb_TIME	TIME_FACTOR
18	85	1145	171	1130	1255	1253	525	310205	590.9
13	76	1279	157	1267	1374	1370	524	285892	545.6
19	68	1092	141	1079	1170	1168	460	246233	535.3
788	13	2289	22	2289	2296	2296	225	88957	395.4
16	65	1069	135	1056	1144	1142	459	173139	377.2
283	86	972	173	961	1089	1087	830	308514	371.7
282	66	893	137	884	975	973	700	220349	314.8
789	13	2342	24	2342	2351	2351	240	72609	302.5
17	65	1191	135	1178	1266	1264	672	167261	248.9
790	10	2550	18	2550	2556	2556	261	60863	233.2
772	6	653	12	653	656	656	188	13006	69.2
151	48	263	51	263	292	292	317	15376	48.5
1	254	2476	462	2468	2523	2523	663	27380	41.3
590	16	605	26	605	613	613	213	1738	8.2
23	13	440	26	429	440	440	153	1140	7.5
754	932	973	3742	973	1604	1604	12315	85279	6.9
426	24421	44891	48842	44891	44891	44891	25044	165061	6.6
448	24892	49657	49694	49406	67986	67986	28836	184427	6.4
682	24701	50202	49402	50011	68461	68461	29142	169379	5.8
425	11625	26750	23250	26750	26750	26750	10692	58616	5.5
22	13	433	26	425	436	436	168	909	5.4
737	227	228	854	228	228	228	1399	7103	5.1
15	13	353	26	345	356	356	168	851	5.1
686	36894	106605	73788	106414	124846	124846	39435	199740	5.1
532	11943	38053	23886	38045	38093	38093	13691	65243	4.8
281	13	353	26	345	356	356	190	810	4.3
172	108	190	216	190	216	216	483	1973	4.1
572	19651	57494	39188	57494	60197	60197	19052	70344	3.7
375	12633	45611	25264	45457	51973	51973	53828	192410	3.6
573	36922	91847	73728	91611	113959	113959	59636	211769	3.6
712	502	681	1924	681	993	993	4270	13792	3.2
556	499	1532	1144	1549	1976	1924	995	2737	2.8
747	419	437	1822	437	437	437	3264	8850	2.7
566	2505	49988	4990	49983	50011	50009	4540	12017	2.6
374	8270	30508	16540	30220	37537	37537	35747	91689	2.6
773	55	590	103	577	620	620	214	509	2.4
369	10978	39919	21956	39919	39919	39919	6884	15897	2.3
370	12070	56379	24140	56379	56379	56379	8249	17780	2.2
368	6657	25628	13314	25628	25628	25628	4389	9102	2.1
470	44414	75146	88828	75146	75146	75146	31249	64611	2.1
472	44414	75146	88828	75146	75146	75146	31809	65642	2.1
512	458	800	669	800	1057	1057	635	1310	2.1
412	919	3532	1838	3532	3532	3532	804	1617	2

1.4.3. ExbDR vs KAON2

Comparison of skolemSat and KAON2.

Ontologies on which ExbDR wins over KAON2

NAME	AXIOM	NFTGD	FTGD	Exb_OUTPUT	KAON2_OUTPUT	Exb_TIME	KAON2_TIME	TIME_FACTOR
485	5291	2593	5291	5451	5574	15645	547530	35
416	68844	12272	56774	56681	61313	19351	528612	27.3
370	68449	12070	56379	56379	61030	17780	293995	16.5
415	47687	7755	40108	40014	43156	10605	152674	14.4
535	4622	8479	4621	7057	10681	34441	442660	12.9
369	50897	10978	39919	39919	43718	15897	168651	10.6
398	34778	7419	27882	28188	30587	15429	162384	10.5
700	2076	1053	1025	1025	3304	18719	196634	10.5
371	34865	7464	27969	28375	30720	16812	173985	10.3
397	2922	1494	2922	8721	3447	6987	67569	9.7
400	37576	7999	30008	30603	33314	14880	134038	9
678	18511	7558	11408	30739	15734	6727	51963	7.7
386	36044	7559	28602	28607	31677	9584	71333	7.4
733	1376	702	676	676	2255	7141	48402	6.8
368	32285	6657	25628	25628	28051	9102	59153	6.5
521	10916	7276	3640	3640	10908	1009	6222	6.2
286	46940	13961	32979	39388	47422	11047	65637	5.9
702	1561	774	789	789	2279	6753	39945	5.9
566	52406	2505	49988	50009	50883	12017	59487	5
498	8339	8316	23	23	7540	649	3204	4.9
497	8339	8316	23	23	7540	681	3145	4.6
741	1472	752	722	722	2561	10537	47264	4.5
52	28997	3764	25233	25233	27911	5252	22027	4.2
540	14906	1744	13345	14090	14833	7138	26228	3.7
752	1558	772	788	788	2426	11758	42816	3.6
715	1016	567	451	451	1572	6213	22348	3.6
716	1243	640	605	605	2028	9421	33399	3.5
532	49670	11943	38053	38093	43913	65243	229069	3.5
724	1773	828	947	947	2600	11487	39899	3.5
436	25552	2308	24788	52853	27170	71249	246549	3.5
727	1816	833	985	985	2965	13858	47935	3.5
756	1173	578	597	597	1784	6126	21153	3.5
531	11846	7	11839	11839	11840	524	1737	3.3
435	9082	1	9081	9081	9075	395	1308	3.3
530	10612	3	10609	10609	10611	469	1491	3.2
719	907	488	421	421	1527	4978	14449	2.9
523	4402	4233	169	169	4082	420	1184	2.8
522	4402	4233	169	169	4082	426	1198	2.8
426	69312	24421	44891	44891	56626	165061	451350	2.7
373	1298	668	1298	1486	1457	1470	3840	2.6
670	12772	7079	5693	5693	9688	3234	8182	2.5
682	74647	24701	50202	68461	61964	169379	428424	2.5
448	74255	24892	49657	67986	61495	184427	455440	2.5
676	1662	1921	1662	4756	3277	5285	12814	2.4
728	1586	728	881	1357	2593	14911	35063	2.4
374	38075	8270	30508	37537	33926	91689	210567	2.3
372	1078	557	1078	1253	1252	1048	2364	2.3
680	18167	7414	11064	29305	15144	5915	13137	2.2
746	956	490	468	468	1605	6185	13520	2.2
399	991	512	991	1113	1126	1052	2276	2.2
500	1988	1622	1990	4369	3375	7648	16479	2.2
403	6373	2479	3894	3894	5629	665	1411	2.1
755	928	459	471	471	1454	3985	8433	2.1

Ontologies on which KAON2 wins over ExbDR:

NAME	AXIOM	NFTGD	FTGD	Exb_OUTPUT	KAON2_OUTPUT	Exb_TIME	KAON2_TIME	TIME_FACTOR
283	926	86	972	1087	1097	308514	424	727.6
18	1075	85	1145	1253	1258	310205	451	687.8
13	1188	76	1279	1370	1371	285892	435	657.2
282	839	66	893	973	980	220349	387	569.4
19	1013	68	1092	1168	1171	246233	441	558.4
16	991	65	1069	1142	1146	173139	413	419.2
17	1098	65	1191	1264	1273	167261	421	397.3
788	2294	13	2289	2296	2355	88957	499	178.3
789	2347	13	2342	2351	2416	72609	522	139.1
790	2554	10	2550	2556	2627	60863	523	116.4
151	304	48	263	292	335	15376	302	50.9
1	2615	254	2476	2523	2612	27380	752	36.4
772	619	6	653	656	669	13006	361	36
352	3458	221	3447	21688	3449	5584	603	9.3
353	3437	221	3426	21667	3425	5917	648	9.1
766	2057	218	2036	20181	2034	3948	557	7.1
666	2418	269	2346	20971	2346	3704	545	6.8
595	2918	219	2894	21135	2897	3844	566	6.8
597	2961	223	2933	21174	2934	3809	592	6.4
172	290	108	190	216	327	1973	307	6.4
665	3270	299	3166	21407	3186	4222	664	6.4
737	453	227	228	228	673	7103	1525	4.7
590	614	16	605	613	669	1738	376	4.6
556	1948	499	1532	1924	2297	2737	668	4.1
23	401	13	440	440	440	1140	312	3.7
22	396	13	433	436	436	909	308	3
15	326	13	353	356	353	851	304	2.8
281	326	13	353	356	355	810	294	2.8
512	823	458	800	1057	1288	1310	485	2.7
392	1213	608	1213	9492	1841	6587	2540	2.6
454	416	69	416	3343	420	774	329	2.4
750	490	209	283	283	671	2197	956	2.3
720	442	190	254	254	587	1780	782	2.3
574	736	535	736	2462	1178	1973	960	2.1
770	5196	2532	2666	2754	4787	2511	1247	2

1.4.4. SkolemDR vs HyperDR

Ontologies on which SkolemDR wins over HyperDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	SK_OUTPUT	HYPER_OUTPUT	SK_TIME	HYPER_TIME	TIME_FACTOR
283	86	972	173	961	1089	1089	391	830	2.1
284	84	1237	175	1224	1349	1349	435	881	2

Ontologies on which HyperDR wins over SkolemDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	SK_OUTPUT	HYPER_OUTPUT	SK_TIME	HYPER_TIME	TIME_FACTOR
392	608	1213	1216	1213	9492	9492	405177	8692	46.6
418	202	395	404	395	397	397	40274	1628	24.7
685	394	755	788	754	1197	1197	55971	3422	16.4
397	1494	2922	2988	2922	8721	8721	196197	12694	15.5
500	1622	1990	3242	1988	4369	4369	216717	15184	14.3
534	315	630	630	630	630	630	17393	1518	11.5
417	176	343	352	343	343	343	12170	1094	11.1
574	535	736	956	736	2462	2462	27004	2821	9.6
679	260	472	518	472	1293	1293	17084	2003	8.5
575	479	700	958	700	2255	2255	25045	3257	7.7
421	717	1274	1432	1273	4651	4651	34551	4957	7
436	2308	24788	4616	24014	52853	52853	352469	54473	6.5
396	597	1153	1194	1153	1772	1772	14571	2554	5.7
390	7265	26905	14058	26439	41085	41085	536336	97988	5.5
419	1636	4806	2992	4470	9785	9785	211531	40191	5.3
373	668	1298	1336	1297	1486	1486	12441	2400	5.2
657	1732	2654	3284	2580	3405	3405	31145	6692	4.7
476	1834	2713	3668	2687	5016	5016	41907	9090	4.6
375	12633	45611	25264	45457	51973	51973	226470	53828	4.2
374	8270	30508	16540	30220	37537	37537	142960	35747	4
394	9163	31483	18142	31193	33135	33135	230353	60083	3.8
676	1921	1662	3842	1662	4756	4756	64556	17088	3.8
677	1608	1283	3214	1282	3926	3926	46498	12410	3.7
540	1744	13345	3308	13265	14090	14090	26414	7149	3.7
553	50453	90333	100906	90333	115244	115244	584786	159387	3.7
399	512	991	1024	991	1113	1113	4776	1333	3.6
372	557	1078	1114	1077	1253	1253	5277	1507	3.5
376	694	1286	1388	1286	8301	8301	8094	2546	3.2
401	423	786	846	786	1256	1256	4392	1390	3.2
422	420	672	840	672	1051	1051	6318	2023	3.1
377	570	1006	1140	1006	7382	7382	6215	2047	3
537	11089	51964	22178	51961	52125	52125	56793	18967	3
387	12083	44583	24050	44320	63422	63422	74510	28685	2.6
573	36922	91847	73728	91611	113959	113959	146914	59636	2.5
684	12683	62377	25366	62185	81553	81553	42202	17352	2.4
424	786	1507	1456	1463	2119	2119	5560	2450	2.3
538	102	204	204	204	204	204	801	356	2.2
539	104	208	208	208	210	210	835	378	2.2
569	966	1750	1830	1701	2442	2442	5995	2717	2.2
536	6762	36439	13524	36438	36572	36572	25968	12115	2.1
389	100	200	200	200	200	200	842	401	2.1
388	106	212	212	212	244	244	599	291	2.1
632	500	1895	1000	1895	2190	2190	3060	1490	2.1

1.4.5. SkolemDR vs KAON2

Comparison of skolemSat and KAON2.

Ontologies on which SkolemDR wins over KAON2:

NAME	AXIOM	SK_NFTGD	SK_FTGD	SK_OUTPUT	KAON2_OUTPUT	SK_TIME	KAON2_TIME	TIME_FACTOR
416	68844	24538	56650	56681	61313	10832	528612	48.8
370	68449	24140	56379	56379	61030	6859	293995	42.9
369	50897	21956	39919	39919	43718	5826	168651	28.9
415	47687	15504	39986	40014	43156	6481	152674	23.6
426	69312	48842	44891	44891	56626	19425	451350	23.2
532	49670	23886	38045	38093	43913	12980	229069	17.6
368	32285	13314	25628	25628	28051	3623	59153	16.3
448	74255	49694	49406	67986	61495	30027	455440	15.2
703	2347	4906	1210	2004	4297	19120	286437	15
682	74647	49402	50011	68461	61964	28609	428424	15
386	36044	15118	28570	28607	31677	5051	71333	14.1
398	34778	14838	27696	28188	30587	12911	162384	12.6
566	52406	4990	49983	50011	50883	5105	59487	11.7
371	34865	14928	27758	28375	30720	15391	173985	11.3
700	2076	4350	1025	1025	3304	17420	196634	11.3
286	46940	27922	32979	39388	47422	5927	65637	11.1
754	1882	3742	973	1604	3396	11531	114856	10
400	37576	15998	29907	30603	33314	13836	134038	9.7
52	28997	7528	25233	25233	27911	2663	22027	8.3
425	38375	23250	26750	26750	32586	8501	67656	8
701	1820	3944	982	1589	3462	10592	62168	5.9
702	1561	3050	789	789	2279	7231	39945	5.5
741	1472	3424	722	722	2561	9129	47264	5.2
521	10916	14552	3640	3640	10908	1222	6222	5.1
752	1558	3346	788	788	2426	8487	42816	5
733	1376	2992	676	676	2255	9810	48402	4.9
728	1586	2774	881	1357	2593	7168	35063	4.9
727	1816	3922	985	985	2965	10096	47935	4.7
716	1243	2602	605	605	2028	7440	33399	4.5
724	1773	3650	947	947	2600	9362	39899	4.3
715	1016	2080	451	451	1572	5385	22348	4.2
678	18511	15114	11217	30739	15734	12801	51963	4.1
670	12772	14158	5693	5693	9688	2196	8182	3.7
756	1173	2356	597	597	1784	6112	21153	3.5
497	8339	16632	23	23	7540	1005	3145	3.1
719	907	1938	421	421	1527	4637	14449	3.1
531	11846	14	11839	11839	11840	567	1737	3.1
498	8339	16632	23	23	7540	1074	3204	3
712	1160	1924	681	993	1971	4430	12518	2.8
530	10612	6	10609	10609	10611	528	1491	2.8
460	19402	18046	10382	11064	18007	4391	12197	2.8
713	878	2056	425	425	1504	4626	12841	2.8
746	956	2130	468	468	1605	4896	13520	2.8
435	9082	2	9081	9081	9075	477	1308	2.7
789	2347	24	2342	2351	2416	231	522	2.3
743	1667	2868	961	961	2152	4908	11060	2.3
755	928	1794	471	471	1454	4063	8433	2.1
790	2554	18	2550	2556	2627	254	523	2.1
403	6373	4958	3894	3894	5629	693	1411	2
768	8283	5064	5752	5840	7825	1266	2569	2
669	8410	7060	4880	4880	8261	984	1987	2

Ontologies on which KAON2 wins over SkolemDR:

NAME	AXIOM	SK_NFTGD	SK_FTGD	SK_OUTPUT	KAON2_OUTPUT	SK_TIME	KAON2_TIME	TIME_FACTOR
392	1213	1216	1213	9492	1841	405177	2540	159.5
418	395	404	395	397	399	40274	1295	31.1
574	736	956	736	2462	1178	27004	960	28.1
575	700	958	700	2255	1124	25045	1004	24.9
679	472	518	472	1293	751	17084	698	24.5
685	755	788	754	1197	1046	55971	2451	22.8
417	343	352	343	343	343	12170	917	13.3
500	1988	3242	1988	4369	3375	216717	16479	13.2
766	2057	436	1845	20181	2034	5902	557	10.6
666	2418	538	2153	20971	2346	5699	545	10.5
595	2918	438	2703	21135	2897	5917	566	10.5
597	2961	446	2742	21174	2934	6044	592	10.2
421	1282	1432	1273	4651	1845	34551	3413	10.1
534	630	630	630	630	630	17393	1788	9.7
665	3270	598	2975	21407	3186	6324	664	9.5
352	3458	442	3256	21688	3449	4922	603	8.2
353	3437	442	3235	21667	3425	5035	648	7.8
677	1282	3214	1282	3926	2670	46498	6127	7.6
676	1662	3842	1662	4756	3277	64556	12814	5
476	2811	3668	2687	5016	4082	41907	8755	4.8
396	1153	1194	1153	1772	1449	14571	3067	4.8
657	4223	3284	2580	3405	4142	31145	6764	4.6
454	416	138	347	3343	420	1334	329	4.1
422	674	840	672	1051	942	6318	1682	3.8
30	4736	5586	3717	6188	5559	23714	6904	3.4
174	4495	4884	3712	6176	5412	17052	4980	3.4
373	1298	1336	1297	1486	1457	12441	3840	3.2
401	789	846	786	1256	907	4392	1406	3.1
377	1006	1140	1006	7382	1196	6215	2005	3.1
376	1288	1388	1286	8301	1610	8094	2705	3
419	5733	2992	4470	9785	6236	211531	71784	2.9
397	2922	2988	2922	8721	3447	196197	67569	2.9
29	4702	4884	4125	6589	5825	19376	6984	2.8
424	2235	1456	1463	2119	2209	5560	2033	2.7
385	574	1658	573	1737	1240	1988	777	2.6
632	2185	1000	1895	2190	2271	3060	1233	2.5
569	2652	1830	1701	2442	2520	5995	2444	2.5
32	4943	5586	4130	6601	5974	25878	10678	2.4
372	1078	1114	1077	1253	1252	5277	2364	2.2
479	811	645	566	681	745	1225	562	2.2
384	548	1464	548	1196	1129	1563	731	2.1
480	918	653	663	728	830	1293	610	2.1
399	991	1024	991	1113	1126	4776	2276	2.1
539	208	208	208	210	211	835	401	2.1
389	200	200	200	200	200	842	413	2

1.4.6. HyperDR vs KAON2

Comparison of HyperDR and KAON2.

Ontologies on which HyperDR wins over KAON2:

NAME	AXIOM	SK_NFTGD	SK_FTGD	HYPER_OUTPUT	KAON2_OUTPUT	HYPER_TIME	KAON2_TIME	TIME_FACTOR
416	68844	24538	56650	56681	61313	10945	528612	48.3
370	68449	24140	56379	56379	61030	8249	293995	35.6
369	50897	21956	39919	39919	43718	6884	168651	24.5
415	47687	15504	39986	40014	43156	6927	152674	22
426	69312	48842	44891	44891	56626	25044	451350	18
532	49670	23886	38045	38093	43913	13691	229069	16.7
485	5291	5186	5291	5451	5574	33195	547530	16.5
448	74255	49694	49406	67986	61495	28836	455440	15.8
703	2347	4906	1210	2004	4297	18527	286437	15.5
682	74647	49402	50011	68461	61964	29142	428424	14.7
700	2076	4350	1025	1025	3304	13814	196634	14.2
368	32285	13314	25628	25628	28051	4389	59153	13.5
566	52406	4990	49983	50011	50883	4540	59487	13.1
371	34865	14928	27758	28375	30720	13918	173985	12.5
398	34778	14838	27696	28188	30587	13463	162384	12.1
400	37576	15998	29907	30603	33314	12031	134038	11.1
286	46940	27922	32979	39388	47422	6970	65637	9.4
386	36044	15118	28570	28607	31677	7599	71333	9.4
754	1882	3742	973	1604	3396	12315	114856	9.3
678	18511	15114	11217	30739	15734	7116	51963	7.3
733	1376	2992	676	676	2255	6819	48402	7.1
741	1472	3424	722	722	2561	7191	47264	6.6
701	1820	3944	982	1589	3462	9787	62168	6.4
425	38375	23250	26750	26750	32586	10692	67656	6.3
374	38075	16540	30220	37537	33926	35747	210567	5.9
727	1816	3922	985	985	2965	8326	47935	5.8
716	1243	2602	605	605	2028	6033	33399	5.5
752	1558	3346	788	788	2426	7840	42816	5.5
397	2922	2988	2922	8721	3447	12694	67569	5.3
702	1561	3050	789	789	2279	7510	39945	5.3
715	1016	2080	451	451	1572	4580	22348	4.9
52	28997	7528	25233	25233	27911	4617	22027	4.8
728	1586	2774	881	1357	2593	7690	35063	4.6
724	1773	3650	947	947	2600	8786	39899	4.5
436	25552	4616	24014	52853	27170	54473	246549	4.5
521	10916	14552	3640	3640	10908	1506	6222	4.1
756	1173	2356	597	597	1784	5480	21153	3.9
719	907	1938	421	421	1527	3832	14449	3.8
540	14906	3308	13265	14090	14833	7149	26228	3.7
535	4622	16958	4621	7057	10681	125087	442660	3.5
746	956	2130	468	468	1605	3892	13520	3.5
670	12772	14158	5693	5693	9688	2448	8182	3.3
713	878	2056	425	425	1504	3843	12841	3.3
497	8339	16632	23	23	7540	988	3145	3.2
531	11846	14	11839	11839	11840	554	1737	3.1
498	8339	16632	23	23	7540	1035	3204	3.1
712	1160	1924	681	993	1971	4270	12518	2.9
435	9082	2	9081	9081	9075	477	1308	2.7
530	10612	6	10609	10609	10611	585	1491	2.5
747	854	1822	437	437	1350	3264	8061	2.5
755	928	1794	471	471	1454	3480	8433	2.4
680	18167	14828	10873	29305	15144	5570	13137	2.4
460	19402	18046	10382	11064	18007	5316	12197	2.3
749	984	1802	517	517	1426	3200	7112	2.2
591	2598	138	2529	2529	2565	226	502	2.2
420	6384	2960	5169	6074	6528	6506	14172	2.2
789	2347	24	2342	2351	2416	240	522	2.2
669	8410	7060	4880	4880	8261	969	1987	2.1
790	2554	18	2550	2556	2627	261	523	2

Ontologies on which KAON2 wins over HyperDR:

NAME	AXIOM	SK_NFTGD	SK_FTGD	HYPER_OUTPUT	KAON2_OUTPUT	HYPER_TIME	KAON2_TIME	TIME_FACTOR
766	2057	436	1845	20181	2034	3775	557	6.8
666	2418	538	2153	20971	2346	3637	545	6.7
595	2918	438	2703	21135	2897	3689	566	6.5
597	2961	446	2742	21174	2934	3702	592	6.3
665	3270	598	2975	21407	3186	4045	664	6.1
352	3458	442	3256	21688	3449	3610	603	6
353	3437	442	3235	21667	3425	3650	648	5.6
392	1213	1216	1213	9492	1841	8692	2540	3.4
479	811	645	566	681	745	1863	562	3.3
575	700	958	700	2255	1124	3257	1004	3.2
480	918	653	663	728	830	1848	610	3
574	736	956	736	2462	1178	2821	960	2.9
174	4495	4884	3712	6186	5412	14447	4980	2.9
679	472	518	472	1293	751	2003	698	2.9
438	3024	3024	3024	22410	4677	55197	23576	2.3
454	416	138	347	3343	420	770	329	2.3
775	298	209	330	548	497	828	360	2.3
30	4736	5586	3717	6198	5559	15284	6904	2.2
677	1282	3214	1282	3926	2670	12410	6127	2

1.4.7. Winning case summary

A table showing the number of ontologies on which the algorithm on the row is winning against the column algorithm by a factor 2:

	SSAT	Exb	SK	HYPER	KAON2
SSAT	nan	5	0	0	10
Exb	254	nan	52	14	77
SK	288	72	nan	5	68
HYPER	301	68	50	nan	78
KAON2	252	59	47	19	nan

The same with a factor 5:

	SSAT	Exb	SK	HYPER	KAON2
SSAT	nan	4	0	0	1
Exb	206	nan	26	0	32
SK	232	49	nan	0	36
HYPER	246	48	22	nan	48
KAON2	190	44	21	7	nan

The same with a factor 10 (one order of magnitude). This table is in the article:

	SSAT	Exb	SK	HYPER	KAON2
SSAT	nan	2	0	0	0
Exb	172	nan	19	0	19
SK	205	37	nan	0	26
HYPER	221	37	12	nan	31
KAON2	164	35	15	0	nan

The number of ontologies on which HyperDR wins with an order of magnitude against another algorithm (except SimpleDR):

The same with a factor 100 (two orders of magnitude):

	SSAT	Exb	SK	HYPER	KAON2
SSAT	nan	1	0	0	0
Exb	90	nan	0	0	0
SK	106	26	nan	0	0
HYPER	117	26	0	nan	0
KAON2	108	27	1	0	nan

The number of ontologies on which ExbDR loses with two orders of magnitude against another algorithm:

Times corresponding to the table with a factor 10 (except SimpleDR)

1.5. Times vs input size

1.5.1. ExbDR

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs

1.5.2. SkolemDR

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs (full and non-full after skolemization)

1.5.3. HyperDR

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs (full and non-full after skolemization)

1.5.4. KAON2

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs (full and non-full after skolemization)

1.5.5. Comparison

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs (full and non-full for ExbDR)

<AxesSubplot:xlabel='INPUT', ylabel='TIME'>

1.6. Output Analysis

1.6.1. Output summary

The following statistics are performed on the ontologies where no algorithm reaches the timeout. Their number is:

The number of ontologies with a trivial rewriting:

The maximal number of atoms in the body among all the Datalog rewriting rules on every ontology:

Exb	SK	HYPER	KAON2
4	4	4	4

The same including the ontology where some algorithms reach the timeout.

Exb	SK	HYPER	KAON2
34	7	7	4

The average number of atoms in the body among all the Datalog rewriting rules on every ontology:

Exb	SK	HYPER	KAON2
2	2	2	2

The maximal number of atoms in the head among all the output rules on every ontology:

Exb	SK	HYPER	KAON2
1	1	1	1

The average number of atoms in the head among all the Datalog rewriting rules on every ontology:

Exb	SK	HYPER	KAON2
1	1	1	1

The maximal number of Datalog rules in the rewriting of every ontology:

Exb	SK	HYPER	KAON2
68461	68461	68461	61964

The same including the ontology where some algorithms reach the timeout.

Exb	SK	HYPER	KAON2
309978	170887	135961	61964

The average number of Datalog rules in the rewriting of every ontology:

Exb	SK	HYPER	KAON2
4095.78	4096.2	4096.2	4069.2

The median of the number of Datalog rules in the rewriting of every ontology:

Exb	SK	HYPER	KAON2
438.5	438.5	438.5	877.5

The maximal number of new derived Datalog rules in the outputted rules on every ontology:

Exb	SK	HYPER
28839	28839	28839

The average number of newly derived Datalog rules on every ontology:

Exb	SK	HYPER
954.111	954.401	954.401

The average of new output rules on every ontology with no trivial rewriting:

Exb	SK	HYPER
2396.04	2396.77	2396.77

The median of new output rules on every ontology with no trivial rewriting:

Exb	SK	HYPER
98	98	98

1.6.2. Output size comparison

Below we compare the number of the outputted full Datalog rules of the different algorithm, we remove from this number of Datalog rules in the input without transformation.

Between ExbDR and SkolemDR

Cases where ExbDR output is larger than the one of SkolemDR

NAME NFTGD FTGD Exb_NEW_OUTPUT SK_NEW_OUTPUT SIZE_FACTOR Exb_TIME SK_TIME

Cases where SkolemDR output is larger than the one of ExbDR

NAME NFTGD FTGD SK_NEW_OUTPUT Exb_NEW_OUTPUT SIZE_FACTOR SK_TIME Exb_TIME

496 10238 3219 1 0 inf 2706 3521

582 154 620 91 28 3.2 420 385
Between ExbDR and HyperDR

Cases where ExbDR output is larger

NAME NFTGD FTGD Exb_NEW_OUTPUT HYPER_NEW_OUTPUT SIZE_FACTOR Exb_TIME HYPER_TIME

Cases where HyperDR output is larger

NAME NFTGD FTGD HYPER_NEW_OUTPUT Exb_NEW_OUTPUT SIZE_FACTOR HYPER_TIME Exb_TIME

496 10238 3219 1 0 inf 2785 3521

582 154 620 91 28 3.2 406 385

NAME	NFTGD	FTGD	SK_NEW_OUTPUT	Exb_NEW_OUTPUT	SIZE_FACTOR	SK_TIME	Exb_TIME
496	10238	3219	1	0	inf	2706	3521
582	154	620	91	28	3.2	420	385

NAME	NFTGD	FTGD	HYPER_NEW_OUTPUT	Exb_NEW_OUTPUT	SIZE_FACTOR	HYPER_TIME	Exb_TIME
496	10238	3219	1	0	inf	2785	3521
582	154	620	91	28	3.2	406	385

Between ExbDR and KAON2

Cases where ExbDR output is larger

NAME	NFTGD	FTGD	Exb_NEW_OUTPUT	KAON2_NEW_OUTPUT	SIZE_FACTOR	Exb_TIME	KAON2_TIME
666	269	2153	18818	193	97.5	3704	545
353	221	3235	18432	190	97	5917	648
766	218	1845	18336	189	97	3948	557
597	223	2742	18432	192	96	3809	592
352	221	3256	18432	193	95.5	5584	603
595	219	2703	18432	194	95	3844	566
665	299	2975	18432	211	87.4	4222	664
454	69	347	2996	73	41	774	329
377	570	1006	6376	190	33.6	1784	2005
376	694	1286	7015	324	21.7	2191	2705
392	608	1213	8279	628	13.2	6587	2540
438	1512	3024	19386	1653	11.7	27164	23576
397	1494	2922	5799	525	11	6987	67569
436	2308	24014	28839	3156	9.1	71249	246549
393	776	1552	5597	808	6.9	7785	10515
421	716	1271	3378	574	5.9	3377	3413
678	7557	11217	19522	4517	4.3	6727	51963
680	7414	10873	18432	4271	4.3	5915	13137
574	478	736	1726	442	3.9	1973	960
401	423	786	470	121	3.9	860	1406
78	43	715	330	88	3.8	318	357
575	479	700	1555	424	3.7	2001	1004
419	1496	4468	5315	1768	3	47627	71784
679	259	472	821	279	2.9	1202	698
348	20	159	63	29	2.2	158	286
396	597	1153	619	296	2.1	1744	3067

Cases where KAON2 output is larger

NAME	NFTGD	FTGD	KAON2_NEW_OUTPUT	Exb_NEW_OUTPUT	SIZE_FACTOR	KAON2_TIME	Exb_TIME
426	24421	44891	11735	0	inf	451350	165061
496	10238	3219	9545	0	inf	4415	3521
497	8316	23	7517	0	inf	3145	681
498	8316	23	7517	0	inf	3204	649
521	7276	3640	7268	0	inf	6222	1009
695	7708	2842	6856	0	inf	2303	1879
425	11625	26750	5836	0	inf	67656	58616
545	6276	3351	5726	0	inf	4294	3539
694	6207	1624	5563	0	inf	1519	1256
544	5972	3271	5426	0	inf	3505	3463
370	12070	56379	4651	0	inf	293995	17780
670	7079	5693	3995	0	inf	8182	3234
522	4233	169	3913	0	inf	1198	426
523	4233	169	3913	0	inf	1184	420
369	10978	39919	3799	0	inf	168651	15897
669	3530	4880	3381	0	inf	1987	1028
452	3163	4116	2704	0	inf	1545	2424
52	3764	25233	2678	0	inf	22027	5252
368	6657	25628	2423	0	inf	59153	9102
700	1053	1025	2279	0	inf	196634	18719
451	2257	2862	2117	0	inf	945	1678
646	2532	2301	2042	0	inf	1087	1481
769	2532	2653	2042	0	inf	1226	1855
727	833	985	1980	0	inf	47935	13858
741	752	722	1839	0	inf	47264	10537
403	2479	3894	1735	0	inf	1411	665
546	1952	775	1712	0	inf	650	710
547	1952	780	1710	0	inf	662	666
645	2091	1594	1675	0	inf	901	1036
724	828	947	1653	0	inf	39899	11487
357	1794	1981	1651	0	inf	813	489
752	772	788	1638	0	inf	42816	11758
733	702	676	1579	0	inf	48402	7141
356	1719	1901	1577	0	inf	759	447
702	774	789	1490	0	inf	39945	6753
716	640	605	1423	0	inf	33399	9421
743	708	961	1191	0	inf	11060	8831
756	578	597	1187	0	inf	21153	6126
746	490	468	1137	0	inf	13520	6185
715	567	451	1121	0	inf	22348	6213
719	488	421	1106	0	inf	14449	4978
402	1627	2230	1102	0	inf	854	444
713	455	425	1079	0	inf	12841	6873
667	1181	506	1062	0	inf	509	523
6	1075	165	1048	0	inf	490	159
690	1291	975	1041	0	inf	603	550
755	459	471	983	0	inf	8433	3985
705	380	337	965	0	inf	6190	3805
360	1059	1616	946	0	inf	582	570
747	419	437	913	0	inf	8061	8850
749	469	517	909	0	inf	7112	4068
413	1085	4625	849	0	inf	1100	1654
689	1054	451	839	0	inf	489	314
732	402	391	837	0	inf	5515	3351
722	411	490	786	0	inf	4561	3468
515	870	2366	739	0	inf	640	697
412	919	3532	720	0	inf	854	1617
745	329	335	702	0	inf	3754	2865
704	355	419	694	0	inf	4177	4246
706	342	336	657	0	inf	4304	3107
293	16	2083	645	0	inf	478	188
735	290	287	628	0	inf	2321	1971
649	663	284	620	0	inf	403	411
740	289	316	614	0	inf	2256	1864
726	283	388	551	0	inf	1595	2488
707	257	280	519	0	inf	1969	2196
710	240	235	510	0	inf	1940	1919
423	619	714	508	0	inf	460	322
723	225	249	508	0	inf	1515	2296
527	502	4	495	0	inf	349	119
739	234	271	494	0	inf	1301	1584
751	248	253	490	0	inf	1781	2615
359	515	181	476	0	inf	377	168
711	245	289	476	0	inf	1640	1625
721	222	213	457	0	inf	1256	1900
744	228	303	456	0	inf	1327	1886
714	193	195	449	0	inf	1245	1784
737	227	228	445	0	inf	1525	7103
753	207	221	438	0	inf	1247	1947
748	223	271	427	0	inf	1102	1525
750	209	283	388	0	inf	956	2197
742	191	198	373	0	inf	989	1507
627	572	2221	351	0	inf	600	620
640	408	394	342	0	inf	383	205
731	148	173	338	0	inf	780	1325
720	190	254	333	0	inf	782	1780
639	353	254	314	0	inf	351	175
738	159	211	299	0	inf	751	1084
430	359	178	295	0	inf	342	219
708	125	159	272	0	inf	644	925
709	130	145	256	0	inf	630	835
465	282	132	214	0	inf	336	238
718	97	127	184	0	inf	420	608
734	78	114	174	0	inf	390	529
433	242	137	158	0	inf	320	240
596	181	2022	158	0	inf	484	270
432	238	137	157	0	inf	328	230
594	177	1984	156	0	inf	477	262
600	177	1983	156	0	inf	448	248
687	184	92	156	0	inf	298	98
464	229	6	145	0	inf	300	96
411	250	1199	140	0	inf	444	484
593	192	2049	123	0	inf	478	255
729	54	94	116	0	inf	335	331
681	116	57	90	0	inf	293	123
673	115	1929	87	0	inf	481	250
358	101	267	83	0	inf	314	275
445	120	1222	81	0	inf	436	242
548	93	4361	80	0	inf	607	397
563	75	983	63	0	inf	392	207
562	57	710	54	0	inf	380	169
520	76	91	53	0	inf	269	94
519	73	93	50	0	inf	270	95
457	80	1604	49	0	inf	456	299
589	112	939	49	0	inf	391	224
469	53	878	45	0	inf	371	180
591	69	2529	36	0	inf	502	288
571	39	1357	31	0	inf	401	205
570	38	1102	28	0	inf	394	191
592	106	3414	27	0	inf	592	472
153	24	186	26	0	inf	286	114
513	38	309	22	0	inf	308	187
514	38	309	22	0	inf	299	185
366	40	96	16	0	inf	272	150
736	7	48	14	0	inf	248	119
725	5	44	12	0	inf	241	115
296	16	66	11	0	inf	245	114
475	22	83	10	0	inf	250	120
113	12	24	8	0	inf	266	70
505	9	151	8	0	inf	252	91
580	8	272	8	0	inf	275	104
605	84	650	8	0	inf	351	258
717	5	43	8	0	inf	242	109
222	5	51	7	0	inf	236	87
210	6	19	6	0	inf	223	74
730	3	42	6	0	inf	233	98
170	9	120	5	0	inf	254	93
581	5	316	5	0	inf	288	109
7	22	168	4	0	inf	271	121
169	22	168	4	0	inf	269	114
214	11	21	4	0	inf	240	93
215	7	10	4	0	inf	224	73
242	5	16	4	0	inf	223	67
468	5	720	4	0	inf	357	122
209	18	27	3	0	inf	241	83
221	1	16	3	0	inf	224	67
223	4	8	3	0	inf	216	65
238	5	14	3	0	inf	222	89
279	26	168	3	0	inf	276	109
474	16	72	3	0	inf	267	101
12	13	277	2	0	inf	290	120
68	2	33	2	0	inf	223	67
79	2	29	2	0	inf	221	66
301	3	129	2	0	inf	253	86
405	4	49	2	0	inf	236	85
407	4	97	2	0	inf	248	94
530	3	10609	2	0	inf	1491	469
598	4	1	2	0	inf	230	50
648	4	232	2	0	inf	293	99
81	93	679	1	0	inf	347	158
531	7	11839	1	0	inf	1737	524
502	1878	1924	1722	2	861	789	1370
416	12269	56650	4663	31	150.4	528612	19351
532	11943	38045	5868	48	122.2	229069	65243
415	7752	39986	3170	28	113.2	152674	10605
386	7559	28570	3107	37	84	71333	9584
110	177	244	64	1	64	366	245
82	200	263	79	2	39.5	348	262
526	193	280	70	2	35	342	271
566	2505	49982	901	27	33.4	59487	12017
759	2532	5317	2138	88	24.3	2260	2455
770	2532	2666	2121	88	24.1	1247	2511
768	2532	5752	2073	88	23.6	2569	2484
790	10	2550	77	6	12.8	523	60863
460	9023	10382	7625	682	11.2	12197	9788
788	13	2289	66	7	9.4	499	88957
55	23	212	18	2	9	283	137
789	13	2342	74	9	8.2	522	72609
590	16	605	64	8	8	376	1738
459	4013	6900	3198	430	7.4	6745	5262
398	7419	27696	2891	492	5.9	162384	15429
636	1652	939	1807	343	5.3	758	1117
172	108	190	137	26	5.3	307	1973
772	6	653	16	3	5.3	361	13006
167	12	451	5	1	5	311	148
400	7999	29907	3407	696	4.9	134038	14880
371	7464	27758	2962	617	4.8	173985	16812
582	154	620	123	28	4.4	404	385
173	120	98	126	29	4.3	293	262
712	502	681	1290	312	4.1	12518	13792
754	932	973	2423	631	3.8	114856	85279
728	728	881	1712	476	3.6	35063	14911
120	10	53	10	3	3.3	242	110
164	3	31	3	1	3	231	70
683	61	68	47	17	2.8	293	156
1	254	2468	144	55	2.6	752	27380
535	8479	4621	6060	2436	2.5	442660	34441
151	48	263	72	29	2.5	302	15376
286	13961	32979	14443	6409	2.3	65637	11047
626	500	1931	614	264	2.3	1443	1616
508	50	267	39	18	2.2	310	255
2	432	941	340	161	2.1	787	739
793	159	135	202	98	2.1	347	619
631	572	2452	711	350	2	1742	1788

Between SkolemDR and KAON2

Cases where SkolemDR output is larger

NAME	NFTGD	FTGD	SK_NEW_OUTPUT	KAON2_NEW_OUTPUT	SIZE_FACTOR	SK_TIME	KAON2_TIME
666	269	2153	18818	193	97.5	5699	545
353	221	3235	18432	190	97	5035	648
766	218	1845	18336	189	97	5902	557
597	223	2742	18432	192	96	6044	592
352	221	3256	18432	193	95.5	4922	603
595	219	2703	18432	194	95	5917	566
665	299	2975	18432	211	87.4	6324	664
454	69	347	2996	73	41	1334	329
377	570	1006	6376	190	33.6	6215	2005
376	694	1286	7015	324	21.7	8094	2705
354	1501	4648	18857	1128	16.7	18866	20487
392	608	1213	8279	628	13.2	405177	2540
397	1494	2922	5799	525	11	196197	67569
436	2308	24014	28839	3156	9.1	352469	246549
421	716	1271	3380	574	5.9	34551	3413
678	7557	11217	19522	4517	4.3	12801	51963
680	7414	10873	18432	4271	4.3	6952	13137
574	478	736	1726	442	3.9	27004	960
401	423	786	470	121	3.9	4392	1406
78	43	715	330	88	3.8	192	357
575	479	700	1555	424	3.7	25045	1004
419	1496	4468	5317	1768	3	211531	71784
679	259	472	821	279	2.9	17084	698
348	20	159	63	29	2.2	144	286
396	597	1153	619	296	2.1	14571	3067

Cases where KAON2 output is larger

NAME	NFTGD	FTGD	KAON2_NEW_OUTPUT	SK_NEW_OUTPUT	SIZE_FACTOR	KAON2_TIME	SK_TIME
426	24421	44891	11735	0	inf	451350	19425
497	8316	23	7517	0	inf	3145	1005
498	8316	23	7517	0	inf	3204	1074
521	7276	3640	7268	0	inf	6222	1222
695	7708	2842	6856	0	inf	2303	1543
425	11625	26750	5836	0	inf	67656	8501
545	6276	3351	5726	0	inf	4294	2353
694	6207	1624	5563	0	inf	1519	1219
544	5972	3271	5426	0	inf	3505	2258
370	12070	56379	4651	0	inf	293995	6859
670	7079	5693	3995	0	inf	8182	2196
522	4233	169	3913	0	inf	1198	658
523	4233	169	3913	0	inf	1184	642
369	10978	39919	3799	0	inf	168651	5826
669	3530	4880	3381	0	inf	1987	984
452	3163	4116	2704	0	inf	1545	1464
52	3764	25233	2678	0	inf	22027	2663
368	6657	25628	2423	0	inf	59153	3623
700	1053	1025	2279	0	inf	196634	17420
451	2257	2862	2117	0	inf	945	1058
646	2532	2301	2042	0	inf	1087	985
769	2532	2653	2042	0	inf	1226	1038
727	833	985	1980	0	inf	47935	10096
741	752	722	1839	0	inf	47264	9129
403	2479	3894	1735	0	inf	1411	693
546	1952	775	1712	0	inf	650	612
547	1952	780	1710	0	inf	662	612
645	2091	1594	1675	0	inf	901	806
724	828	947	1653	0	inf	39899	9362
357	1794	1981	1651	0	inf	813	532
752	772	788	1638	0	inf	42816	8487
733	702	676	1579	0	inf	48402	9810
356	1719	1901	1577	0	inf	759	546
702	774	789	1490	0	inf	39945	7231
716	640	605	1423	0	inf	33399	7440
743	708	961	1191	0	inf	11060	4908
756	578	597	1187	0	inf	21153	6112
746	490	468	1137	0	inf	13520	4896
715	567	451	1121	0	inf	22348	5385
719	488	421	1106	0	inf	14449	4637
402	1627	2230	1102	0	inf	854	476
713	455	425	1079	0	inf	12841	4626
667	1181	506	1062	0	inf	509	432
6	1075	165	1048	0	inf	490	283
690	1291	975	1041	0	inf	603	530
755	459	471	983	0	inf	8433	4063
705	380	337	965	0	inf	6190	3207
360	1059	1616	946	0	inf	582	484
747	419	437	913	0	inf	8061	4103
749	469	517	909	0	inf	7112	3587
413	1085	4625	849	0	inf	1100	889
689	1054	451	839	0	inf	489	355
732	402	391	837	0	inf	5515	2761
722	411	490	786	0	inf	4561	2869
515	870	2366	739	0	inf	640	535
412	919	3532	720	0	inf	854	695
745	329	335	702	0	inf	3754	2418
704	355	419	694	0	inf	4177	3043
706	342	336	657	0	inf	4304	2760
293	16	2083	645	0	inf	478	185
735	290	287	628	0	inf	2321	2089
649	663	284	620	0	inf	403	313
740	289	316	614	0	inf	2256	2044
726	283	388	551	0	inf	1595	1848
707	257	280	519	0	inf	1969	1835
710	240	235	510	0	inf	1940	1698
423	619	714	508	0	inf	460	291
723	225	249	508	0	inf	1515	1573
527	502	4	495	0	inf	349	190
739	234	271	494	0	inf	1301	1362
751	248	253	490	0	inf	1781	1587
359	515	181	476	0	inf	377	225
711	245	289	476	0	inf	1640	1535
721	222	213	457	0	inf	1256	1181
744	228	303	456	0	inf	1327	1333
714	193	195	449	0	inf	1245	1115
737	227	228	445	0	inf	1525	1355
753	207	221	438	0	inf	1247	1209
748	223	271	427	0	inf	1102	1255
750	209	283	388	0	inf	956	1033
742	191	198	373	0	inf	989	857
627	572	2221	351	0	inf	600	465
640	408	394	342	0	inf	383	212
731	148	173	338	0	inf	780	827
720	190	254	333	0	inf	782	959
639	353	254	314	0	inf	351	202
738	159	211	299	0	inf	751	768
430	359	178	295	0	inf	342	235
708	125	159	272	0	inf	644	664
709	130	145	256	0	inf	630	650
465	282	132	214	0	inf	336	198
718	97	127	184	0	inf	420	429
734	78	114	174	0	inf	390	372
433	242	137	158	0	inf	320	187
596	181	2022	158	0	inf	484	266
432	238	137	157	0	inf	328	194
594	177	1984	156	0	inf	477	256
600	177	1983	156	0	inf	448	244
687	184	92	156	0	inf	298	132
464	229	6	145	0	inf	300	140
411	250	1199	140	0	inf	444	316
593	192	2049	123	0	inf	478	277
729	54	94	116	0	inf	335	266
681	116	57	90	0	inf	293	165
673	115	1929	87	0	inf	481	238
358	101	267	83	0	inf	314	209
445	120	1222	81	0	inf	436	218
548	93	4361	80	0	inf	607	356
563	75	983	63	0	inf	392	192
562	57	710	54	0	inf	380	156
520	76	91	53	0	inf	269	108
519	73	93	50	0	inf	270	103
457	80	1604	49	0	inf	456	224
589	112	939	49	0	inf	391	211
469	53	878	45	0	inf	371	162
591	69	2529	36	0	inf	502	263
571	39	1357	31	0	inf	401	188
570	38	1102	28	0	inf	394	173
592	106	3414	27	0	inf	592	316
153	24	186	26	0	inf	286	129
513	38	309	22	0	inf	308	168
514	38	309	22	0	inf	299	148
366	40	96	16	0	inf	272	116
736	7	48	14	0	inf	248	100
725	5	44	12	0	inf	241	91
296	16	66	11	0	inf	245	113
475	22	83	10	0	inf	250	113
113	12	24	8	0	inf	266	65
505	9	151	8	0	inf	252	86
580	8	272	8	0	inf	275	105
605	84	650	8	0	inf	351	182
717	5	43	8	0	inf	242	89
222	5	51	7	0	inf	236	83
210	6	19	6	0	inf	223	67
730	3	42	6	0	inf	233	81
170	9	120	5	0	inf	254	94
581	5	316	5	0	inf	288	120
7	22	168	4	0	inf	271	107
169	22	168	4	0	inf	269	104
214	11	21	4	0	inf	240	69
215	7	10	4	0	inf	224	64
242	5	16	4	0	inf	223	63
468	5	720	4	0	inf	357	132
209	18	27	3	0	inf	241	77
221	1	16	3	0	inf	224	53
223	4	8	3	0	inf	216	60
238	5	14	3	0	inf	222	65
279	26	168	3	0	inf	276	109
474	16	72	3	0	inf	267	102
12	13	277	2	0	inf	290	107
68	2	33	2	0	inf	223	65
79	2	29	2	0	inf	221	61
301	3	129	2	0	inf	253	88
405	4	49	2	0	inf	236	80
407	4	97	2	0	inf	248	87
530	3	10609	2	0	inf	1491	528
598	4	1	2	0	inf	230	50
648	4	232	2	0	inf	293	101
81	93	679	1	0	inf	347	148
531	7	11839	1	0	inf	1737	567
496	10238	3219	9545	1	9545	4415	2706
502	1878	1924	1722	2	861	789	1363
416	12269	56650	4663	31	150.4	528612	10832
532	11943	38045	5868	48	122.2	229069	12980
415	7752	39986	3170	28	113.2	152674	6481
386	7559	28570	3107	37	84	71333	5051
110	177	244	64	1	64	366	185
82	200	263	79	2	39.5	348	203
526	193	280	70	2	35	342	212
566	2505	49982	901	29	31.1	59487	5105
759	2532	5317	2138	88	24.3	2260	1343
770	2532	2666	2121	88	24.1	1247	1275
768	2532	5752	2073	88	23.6	2569	1266
790	10	2550	77	6	12.8	523	254
460	9023	10382	7625	682	11.2	12197	4391
788	13	2289	66	7	9.4	499	254
55	23	212	18	2	9	283	121
789	13	2342	74	9	8.2	522	231
590	16	605	64	8	8	376	227
459	4013	6900	3198	430	7.4	6745	5189
398	7419	27696	2891	492	5.9	162384	12911
636	1652	939	1807	343	5.3	758	817
172	108	190	137	26	5.3	307	378
772	6	653	16	3	5.3	361	207
167	12	451	5	1	5	311	124
400	7999	29907	3407	696	4.9	134038	13836
371	7464	27758	2962	617	4.8	173985	15391
173	120	98	126	29	4.3	293	224
712	502	681	1290	312	4.1	12518	4430
754	932	973	2423	631	3.8	114856	11531
728	728	881	1712	476	3.6	35063	7168
120	10	53	10	3	3.3	242	97
164	3	31	3	1	3	231	55
683	61	68	47	17	2.8	293	208
480	327	663	167	65	2.6	610	1293
1	254	2468	144	55	2.6	752	517
151	48	263	72	29	2.5	302	217
286	13961	32979	14443	6409	2.3	65637	5927
626	500	1931	614	264	2.3	1443	2310
508	50	267	39	18	2.2	310	170
2	432	941	340	161	2.1	787	467
793	159	135	202	98	2.1	347	379
624	98	915	53	25	2.1	442	296
631	572	2452	711	350	2	1742	2940

1.7. All Statistics

All the statistics:

NAME	NFTGD	FTGD	SSAT_OUTPUT	SSAT_TIME	Exb_OUTPUT	Exb_TIME	SK_NFTGD	SK_FTGD	SK_OUTPUT	SK_TIME	HYPER_OUTPUT	HYPER_TIME	AXIOM	KAON2_OUTPUT	KAON2_TIME
1	254	2476	10609	87146	2523	27380	462	2468	2523	517	2523	663	2615	2612	752
2	432	941	2939	22195	1102	739	834	941	1102	467	1102	695	1367	1281	787
3	16709	2159	69335	TIMEOUT	2159	TIMEOUT	33588	2159	2159	151215	2159	TIMEOUT	18866	0	TIMEOUT
4	16705	2107	88513	TIMEOUT	2107	TIMEOUT	33580	2107	2107	138622	2107	TIMEOUT	18810	0	TIMEOUT
6	1075	165	165	1147	165	159	2150	165	165	283	165	275	1230	1213	490
7	22	168	397	766	168	121	23	168	168	107	168	100	190	172	271
12	13	279	473	807	277	120	13	277	277	107	277	100	291	279	290
13	76	1279	483073	TIMEOUT	1370	285892	157	1267	1374	371	1374	524	1188	1371	435
14	139	1551	657904	TIMEOUT	1627	TIMEOUT	278	1537	1742	622	1742	845	1468	1791	535
15	13	353	367507	TIMEOUT	356	851	26	345	356	175	356	168	326	353	304
16	65	1069	683242	TIMEOUT	1142	173139	135	1056	1144	348	1144	459	991	1146	413
17	65	1191	491848	TIMEOUT	1264	167261	135	1178	1266	359	1266	672	1098	1273	421
18	85	1145	687612	TIMEOUT	1253	310205	171	1130	1255	393	1255	525	1075	1258	451
19	68	1092	531099	TIMEOUT	1168	246233	141	1079	1170	387	1170	460	1013	1171	441
20	83	1326	461074	TIMEOUT	1379	TIMEOUT	173	1312	1434	434	1434	583	1226	1441	459
21	110	1206	618814	TIMEOUT	1341	TIMEOUT	218	1192	1344	504	1344	546	1143	1376	447
22	13	433	435365	TIMEOUT	436	909	26	425	436	161	436	168	396	436	308
23	13	440	364339	TIMEOUT	440	1140	26	429	440	159	440	153	401	440	312
24	139	1551	650453	TIMEOUT	1734	TIMEOUT	278	1537	1742	596	1742	919	1468	1790	582
25	68	997	1891	3389	1011	385	116	987	1011	223	1011	242	937	1010	387
26	23858	30697	88456	TIMEOUT	nan	ERROR	59236	30697	30697	TIMEOUT	64900	TIMEOUT	42924	0	TIMEOUT
27	23858	31647	84532	TIMEOUT	31653	TIMEOUT	59236	31647	31647	TIMEOUT	61420	TIMEOUT	43399	0	TIMEOUT
29	1776	4040	289760	TIMEOUT	nan	ERROR	4884	4125	6589	19376	6599	13514	4702	5825	6984
30	2096	3626	342805	TIMEOUT	nan	ERROR	5586	3717	6188	23714	6198	15284	4736	5559	6904
32	2096	4040	295563	TIMEOUT	nan	ERROR	5586	4130	6601	25878	6611	15852	4943	5974	10678
33	12339	9462	255756	TIMEOUT	9463	TIMEOUT	26956	9462	9462	TIMEOUT	23173	TIMEOUT	17540	0	TIMEOUT
34	12339	9364	255901	TIMEOUT	54570	TIMEOUT	26956	9364	15056	TIMEOUT	23407	TIMEOUT	17491	0	TIMEOUT
36	12329	9456	255200	TIMEOUT	9457	TIMEOUT	26932	9456	9517	TIMEOUT	23189	TIMEOUT	17530	0	TIMEOUT
37	12323	9445	258666	TIMEOUT	9446	TIMEOUT	26916	9445	9485	TIMEOUT	23177	TIMEOUT	17518	0	TIMEOUT
38	12339	9457	256434	TIMEOUT	9458	TIMEOUT	26966	9457	9913	TIMEOUT	23214	TIMEOUT	17533	0	TIMEOUT
39	2437	4936	266973	TIMEOUT	nan	ERROR	6858	4826	8155	16362	8155	21924	6076	7278	11060
40	50790	103042	100787	TIMEOUT	100787	TIMEOUT	87244	100788	101164	TIMEOUT	102939	TIMEOUT	140874	0	TIMEOUT
41	21197	68508	99482	TIMEOUT	67864	TIMEOUT	28638	67437	67437	TIMEOUT	77338	TIMEOUT	82156	0	TIMEOUT
42	22295	72365	102403	TIMEOUT	71895	TIMEOUT	30834	71082	71468	TIMEOUT	81532	TIMEOUT	86438	0	TIMEOUT
43	25490	116974	115810	TIMEOUT	116300	TIMEOUT	37224	115810	115810	TIMEOUT	125473	TIMEOUT	130622	0	TIMEOUT
44	21197	68471	101146	TIMEOUT	67827	TIMEOUT	28638	67400	67400	TIMEOUT	77136	TIMEOUT	82119	0	TIMEOUT
45	49531	100829	98673	TIMEOUT	98963	TIMEOUT	84860	98674	99061	TIMEOUT	100895	TIMEOUT	137671	0	TIMEOUT
46	22297	70404	99347	TIMEOUT	69680	TIMEOUT	30704	69253	69253	TIMEOUT	78926	TIMEOUT	84985	0	TIMEOUT
47	21309	68696	105425	TIMEOUT	67972	TIMEOUT	28865	67547	67547	TIMEOUT	77431	TIMEOUT	82338	0	TIMEOUT
49	15	51	169	603	59	159	30	51	59	126	59	180	62	67	248
52	3764	25233	31244	TIMEOUT	25233	5252	7528	25233	25233	2663	25233	4617	28997	27911	22027
55	23	212	5318	16061	214	137	46	212	214	121	214	231	227	230	283
57	3	11	18	100	11	73	3	11	11	54	11	121	14	11	214
58	3	7	11	94	7	64	3	7	7	58	7	57	10	7	220
59	5	47	52	130	47	80	5	47	47	66	47	76	52	47	226
60	9	72	88	202	72	90	9	72	72	86	72	78	81	72	233
62	11	72	76	169	72	86	11	72	72	89	72	168	83	72	238
63	12	61	69	172	61	86	12	61	61	80	61	148	73	61	234
65	3	12	15	107	12	73	3	12	12	63	12	112	13	12	218
66	1	20	21	97	20	63	1	20	20	60	20	85	21	20	221
68	2	33	33	95	33	67	2	33	33	65	33	63	33	35	223
69	1	8	9	87	8	62	1	8	8	56	8	64	9	8	217
71	1	14	15	91	14	63	1	14	14	67	14	47	15	14	209
72	1	31	32	103	31	66	1	31	31	61	31	68	28	31	218
73	6	77	81	170	78	85	6	77	78	129	78	67	82	78	235
75	2	125	141	179	126	87	2	125	126	84	126	100	127	126	257
78	43	715	842	889	1045	318	43	715	1045	192	1045	234	758	803	357
79	2	29	29	93	29	66	2	29	29	61	29	59	31	31	221
81	93	679	763	1574	679	158	93	679	679	148	679	183	773	680	347
82	200	263	602	1638	265	262	356	263	265	203	265	270	463	342	348
94	17	138	180	321	149	107	17	138	149	100	149	202	155	150	256
106	4	43	49	141	43	83	4	43	43	86	43	79	46	43	226
110	177	244	550	1477	245	245	317	244	245	185	245	265	421	308	366
112	20	115	97064	TIMEOUT	124	123	20	113	124	112	124	167	123	130	274
113	12	24	24	110	24	70	12	24	24	65	24	69	36	32	266
114	24	25	413915	TIMEOUT	78	169	42	25	78	147	78	329	26	57	240
116	11	31	106	330	45	101	13	30	45	89	45	87	37	46	236
118	19	89	467759	TIMEOUT	106	191	39	89	106	129	106	155	83	113	270
120	10	53	284	1352	56	110	17	53	56	97	56	91	56	63	242
151	48	263	849	1665	292	15376	51	263	292	217	292	317	304	335	302
153	24	186	119849	TIMEOUT	186	114	48	186	186	129	186	134	210	212	286
164	3	31	35	127	32	70	3	31	32	55	32	65	34	34	231
167	12	451	8296	14342	452	148	12	451	452	124	452	149	463	456	311
169	22	168	395	748	168	114	23	168	168	104	168	254	190	172	269
170	9	120	134	183	120	93	9	120	120	94	120	108	129	125	254
171	12	61	84	223	61	100	12	61	61	89	61	87	67	61	235
172	108	190	2776	22381	216	1973	216	190	216	378	216	483	290	327	307
173	120	98	3423	17615	127	262	240	98	127	224	127	311	216	224	293
174	1776	3626	383973	TIMEOUT	nan	ERROR	4884	3712	6176	17052	6186	14447	4495	5412	4980
176	30	70	205640	TIMEOUT	94	134	50	70	94	119	94	128	72	95	271
209	18	27	78	187	27	83	18	27	27	77	27	117	45	30	241
210	6	19	40	132	19	74	6	19	19	67	19	72	25	25	223
212	2	3	3	81	3	61	2	3	3	55	3	52	5	3	224
213	2	3	3	86	3	62	2	3	3	55	3	55	5	3	214
214	11	21	48	170	21	93	11	21	21	69	21	174	32	25	240
215	7	10	77	186	10	73	7	10	10	64	10	102	17	14	224
217	1	8	8	82	8	62	1	8	8	64	8	56	9	8	219
218	6	8	32	134	8	70	6	8	8	64	8	52	14	8	219
220	2	3	9	95	3	61	2	3	3	59	3	51	5	3	216
221	1	16	68	175	16	67	1	16	16	53	16	62	17	19	224
222	5	51	517	485	51	87	5	51	51	83	51	73	56	58	236
223	4	8	8	85	8	65	4	8	8	60	8	66	12	11	216
224	2	7	14	96	7	67	2	7	7	60	7	52	9	7	217
229	2	36	49	146	36	80	2	36	36	71	36	65	38	36	230
230	2	5	5	81	5	62	2	5	5	58	5	101	7	5	217
233	1	3	18	130	3	60	1	3	3	61	3	54	4	3	210
235	6	18	184	245	18	71	6	18	18	66	18	74	24	18	230
236	6	22	28	127	22	71	6	22	22	60	22	88	28	22	226
237	1	2	2	78	2	61	1	2	2	56	2	114	3	2	213
238	5	14	207	1019	14	89	5	14	14	65	14	95	19	17	222
241	1	28	30	107	28	72	1	28	28	74	28	57	25	28	223
242	5	16	31	134	16	67	5	16	16	63	16	56	21	20	223
267	4	7	7	86	7	64	4	7	7	57	7	53	11	7	218
279	26	168	230	435	168	109	26	168	168	109	168	175	194	171	276
281	13	353	290589	TIMEOUT	356	810	26	345	356	170	356	190	326	355	294
282	66	893	583671	TIMEOUT	973	220349	137	884	975	354	975	700	839	980	387
283	86	972	584136	TIMEOUT	1087	308514	173	961	1089	391	1089	830	926	1097	424
284	84	1237	491253	TIMEOUT	1345	TIMEOUT	175	1224	1349	435	1349	881	1149	1357	457
285	66179	46602	68487	TIMEOUT	47410	TIMEOUT	132358	46602	72358	267422	61083	TIMEOUT	111183	0	TIMEOUT
286	13961	32979	39438	TIMEOUT	39388	11047	27922	32979	39388	5927	39388	6970	46940	47422	65637
290	7	149	30423	TIMEOUT	136	113	12	136	136	104	136	87	139	136	269
293	16	2083	2087	1302	2083	188	16	2083	2083	185	2083	185	2743	2728	478
296	16	66	92	283	66	114	19	66	66	113	66	87	75	77	245
301	3	129	143	190	129	86	3	129	129	88	129	79	131	131	253
316	1	43	42	98	42	67	1	42	42	67	42	49	43	42	234
319	187	243	65297	TIMEOUT	254	TIMEOUT	188	243	553	302	553	332	373	439	344
320	124	146	58686	TIMEOUT	329	303	125	146	329	237	329	248	213	274	311
332	9	228	246	263	230	109	9	228	230	117	230	91	223	230	271
333	5	66	71	137	67	91	5	66	67	84	67	65	66	67	234
339	4	93	102	156	94	89	4	93	94	95	94	61	91	94	243
341	2	33	37	114	36	80	2	33	36	58	36	48	37	39	234
343	4	97	237	299	98	TIMEOUT	4	97	98	111	98	97	101	98	257
347	8	98	21837	TIMEOUT	104	115	16	98	104	103	104	90	98	103	252
348	20	159	101402	TIMEOUT	222	158	30	159	222	144	222	117	159	188	286
349	8	98	21889	TIMEOUT	104	114	16	98	104	100	104	88	98	102	252
350	942	3062	466591	TIMEOUT	3020	TIMEOUT	2209	3019	4057	3251	4057	3664	3862	4415	3685
352	221	3447	60139	TIMEOUT	21688	5584	442	3256	21688	4922	21688	3610	3458	3449	603
353	221	3426	71266	TIMEOUT	21667	5917	442	3235	21667	5035	21667	3650	3437	3425	648
354	1501	4839	45962	TIMEOUT	4648	TIMEOUT	3001	4648	23505	18866	23505	14525	6122	5776	20487
356	1719	1901	2170	37128	1901	447	3438	1901	1901	546	1901	488	3620	3478	759
357	1794	1981	2310	39177	1981	489	3588	1981	1981	532	1981	516	3775	3632	813
358	101	267	494	1505	267	275	202	267	267	209	267	191	368	350	314
359	515	181	191	1246	181	168	1030	181	181	225	181	191	696	657	377
360	1059	1616	2226	27377	1616	570	2118	1616	1616	484	1616	523	2675	2562	582
366	40	96	160	451	96	150	80	96	96	116	96	114	135	112	272
368	6657	25628	29534	TIMEOUT	25628	9102	13314	25628	25628	3623	25628	4389	32285	28051	59153
369	10978	39919	47153	TIMEOUT	39919	15897	21956	39919	39919	5826	39919	6884	50897	43718	168651
370	12070	56379	64556	TIMEOUT	56379	17780	24140	56379	56379	6859	56379	8249	68449	61030	293995
371	7464	27969	74652	TIMEOUT	28375	16812	14928	27758	28375	15391	28375	13918	34865	30720	173985
372	557	1078	320186	TIMEOUT	1253	1048	1114	1077	1253	5277	1253	1507	1078	1252	2364
373	668	1298	306037	TIMEOUT	1486	1470	1336	1297	1486	12441	1486	2400	1298	1457	3840
374	8270	30508	71378	TIMEOUT	37537	91689	16540	30220	37537	142960	37537	35747	38075	33926	210567
375	12633	45611	92608	TIMEOUT	51973	192410	25264	45457	51973	226470	51973	53828	57663	0	TIMEOUT
376	694	1286	1263906	TIMEOUT	8301	2191	1388	1286	8301	8094	8301	2546	1288	1610	2705
377	570	1006	1426617	TIMEOUT	7382	1784	1140	1006	7382	6215	7382	2047	1006	1196	2005
378	21423	58442	94759	TIMEOUT	64250	TIMEOUT	42846	58205	60135	TIMEOUT	62621	TIMEOUT	76713	0	TIMEOUT
379	38615	90926	95642	TIMEOUT	98392	TIMEOUT	77230	90653	91022	TIMEOUT	95639	TIMEOUT	126314	0	TIMEOUT
380	3141	6000	666192	TIMEOUT	6302	15112	6282	6000	6000	TIMEOUT	6302	33197	6000	0	TIMEOUT
381	3216	6053	656035	TIMEOUT	6587	18370	6432	6053	6053	TIMEOUT	6587	39550	6053	0	TIMEOUT
382	11806	47304	105868	TIMEOUT	77862	285408	16756	47281	47281	TIMEOUT	56575	TIMEOUT	54883	0	TIMEOUT
383	17881	65883	103564	TIMEOUT	123460	TIMEOUT	27438	65847	65847	TIMEOUT	74207	TIMEOUT	78891	0	TIMEOUT
384	732	548	2549922	TIMEOUT	1196	715	1464	548	1196	1563	1196	1161	548	1129	731
385	834	574	2340536	TIMEOUT	1737	936	1658	573	1737	1988	1737	1272	574	1240	777
386	7559	28602	39892	TIMEOUT	28607	9584	15118	28570	28607	5051	28607	7599	36044	31677	71333
387	12083	44583	75272	TIMEOUT	63422	27186	24050	44320	63422	74510	63422	28685	56302	0	TIMEOUT
388	106	212	54782	TIMEOUT	244	261	212	212	244	599	244	291	212	236	395
389	100	200	215398	600155	200	289	200	200	200	842	200	401	200	200	413
390	7265	26905	44209	TIMEOUT	41085	71855	14058	26439	41085	536336	41085	97988	33551	0	TIMEOUT
391	11754	41534	61677	TIMEOUT	55967	147432	22558	40960	40960	TIMEOUT	53808	TIMEOUT	52501	0	TIMEOUT
392	608	1213	147317	TIMEOUT	9492	6587	1216	1213	9492	405177	9492	8692	1213	1841	2540
393	776	1552	178504	TIMEOUT	7149	7785	1552	1552	1552	TIMEOUT	7149	15258	1552	2360	10515
394	9163	31483	104801	TIMEOUT	33135	34910	18142	31193	33135	230353	33135	60083	39875	0	TIMEOUT
395	24648	62478	96644	TIMEOUT	60193	TIMEOUT	43604	60242	60242	TIMEOUT	66385	TIMEOUT	82576	0	TIMEOUT
396	597	1153	824722	TIMEOUT	1772	1744	1194	1153	1772	14571	1772	2554	1153	1449	3067
397	1494	2922	736275	TIMEOUT	8721	6987	2988	2922	8721	196197	8721	12694	2922	3447	67569
398	7419	27882	72570	TIMEOUT	28188	15429	14838	27696	28188	12911	28188	13463	34778	30587	162384
399	512	991	744600	TIMEOUT	1113	1052	1024	991	1113	4776	1113	1333	991	1126	2276
400	7999	30008	61398	TIMEOUT	30603	14880	15998	29907	30603	13836	30603	12031	37576	33314	134038
401	423	786	1358435	TIMEOUT	1256	860	846	786	1256	4392	1256	1390	789	907	1406
402	1627	2230	2621	43310	2230	444	3254	2230	2230	476	2230	487	3857	3332	854
403	2479	3894	4515	124086	3894	665	4958	3894	3894	693	3894	743	6373	5629	1411
404	2	45	49	127	45	80	4	45	45	67	45	52	47	45	222
405	4	49	56	137	49	85	8	49	49	80	49	58	53	51	236
406	2	92	98	144	92	88	4	92	92	84	92	59	94	91	237
407	4	97	107	169	97	94	8	97	97	87	97	84	101	99	248
410	476	1340	7701	119314	1371	TIMEOUT	948	1339	1561	2960	1561	2107	1759	1725	1838
411	250	1199	2046	10098	1199	484	500	1199	1199	316	1199	270	1449	1339	444
412	919	3532	6170	65257	3532	1617	1838	3532	3532	695	3532	804	4451	4252	854
413	1085	4625	7641	112197	4625	1654	2170	4625	4625	889	4625	932	5710	5474	1100
414	25	50	591	8830	52	159	50	50	52	219	52	156	50	54	274
415	7755	40108	107649	TIMEOUT	40014	10605	15504	39986	40014	6481	40014	6927	47687	43156	152674
416	12272	56774	90396	TIMEOUT	56681	19351	24538	56650	56681	10832	56681	10945	68844	61313	528612
417	176	343	3315103	TIMEOUT	343	820	352	343	343	12170	343	1094	343	343	917
418	202	395	2973754	TIMEOUT	397	977	404	395	397	40274	397	1628	395	399	1295
419	1636	4806	307946	TIMEOUT	9783	47627	2992	4470	9785	211531	9785	40191	5733	6236	71784
420	1505	5297	553318	TIMEOUT	6074	10198	2960	5169	6074	9208	6074	6506	6384	6528	14172
421	717	1274	820573	TIMEOUT	4649	3377	1432	1273	4651	34551	4651	4957	1282	1845	3413
422	420	672	1024987	TIMEOUT	1051	1374	840	672	1051	6318	1051	2023	674	942	1682
423	619	714	1063	7984	714	322	1238	714	714	291	714	295	1333	1222	460
424	786	1507	417993	TIMEOUT	2119	2294	1456	1463	2119	5560	2119	2450	2235	2209	2033
425	11625	26750	34307	TIMEOUT	26750	58616	23250	26750	26750	8501	26750	10692	38375	32586	67656
426	24421	44891	65747	TIMEOUT	44891	165061	48842	44891	44891	19425	44891	25044	69312	56626	451350
430	359	178	282	2228	178	219	718	178	178	235	178	223	345	473	342
432	238	137	306	1154	137	230	476	137	137	194	137	191	375	294	328
433	242	137	308	1021	137	240	484	137	137	187	137	190	379	295	320
435	1	9081	9081	5393	9081	395	2	9081	9081	477	9081	477	9082	9075	1308
436	2308	24788	117091	TIMEOUT	52853	71249	4616	24014	52853	352469	52853	54473	25552	27170	246549
437	44247	91145	90903	TIMEOUT	119556	124104	88494	90904	90904	TIMEOUT	119556	109220	133869	0	TIMEOUT
438	1512	3024	315739	TIMEOUT	22410	27164	3024	3024	3024	TIMEOUT	22410	55197	3024	4677	23576
445	120	1222	1412	3128	1222	242	240	1222	1222	218	1222	200	1342	1303	436
446	209	1700	240641	TIMEOUT	1747	410	328	1659	1747	623	1747	439	1864	1826	520
448	24892	49657	72630	TIMEOUT	67986	184427	49694	49406	67986	30027	67986	28836	74255	61495	455440
449	225	2064	302688	TIMEOUT	2162	712	414	2013	2162	717	2162	537	2201	2172	619
450	379	2872	448464	TIMEOUT	3147	931	716	2838	3147	924	3147	644	3179	3236	653
451	2257	2862	5333	229753	2862	1678	4514	2862	2862	1058	2862	1133	5119	4979	945
452	3163	4116	7468	454205	4116	2424	6326	4116	4116	1464	4116	1703	7279	6820	1545
454	69	416	185925	TIMEOUT	3343	774	138	347	3343	1334	3343	770	416	420	329
457	80	1604	1857	3420	1604	299	160	1604	1604	224	1604	216	1684	1653	456
459	4019	6905	93867	TIMEOUT	7330	5262	8026	6900	7330	5189	7330	3393	10918	10098	6745
460	9023	10382	17505	TIMEOUT	11064	9788	18046	10382	11064	4391	11064	5316	19402	18007	12197
462	11474	15066	135305	TIMEOUT	156479	574268	18866	13435	13633	TIMEOUT	123124	TIMEOUT	24442	0	TIMEOUT
463	9433	10352	140081	TIMEOUT	155476	582183	18866	10339	10537	TIMEOUT	119519	TIMEOUT	17687	0	TIMEOUT
464	229	6	6	142	6	96	458	6	6	140	6	136	235	151	300
465	282	132	268	1049	132	238	564	132	132	198	132	222	414	346	336
468	5	720	728	462	720	122	10	720	720	132	720	115	725	724	357
469	53	878	894	1470	878	180	106	878	878	162	878	161	931	923	371
470	44414	75146	75146	TIMEOUT	75146	64611	88828	75146	75146	23433	75146	31249	119559	0	TIMEOUT
471	42734	78977	78977	TIMEOUT	78977	42394	85468	78977	78977	20825	78977	28307	121711	0	TIMEOUT
472	44414	75146	75146	TIMEOUT	75146	65642	88828	75146	75146	23768	75146	31809	119559	0	TIMEOUT
473	42734	78977	78977	TIMEOUT	78977	41970	85468	78977	78977	20823	78977	28714	121711	0	TIMEOUT
474	16	72	92	204	72	101	32	72	72	102	72	87	88	75	267
475	22	83	107	265	83	120	44	83	83	113	83	98	105	93	250
476	1834	2713	1026452	TIMEOUT	5016	6565	3668	2687	5016	41907	5016	9090	2811	4082	8755
477	156743	10606	10667	TIMEOUT	10606	7972	313486	10606	10606	14393	10606	16686	167349	0	TIMEOUT
479	323	566	431002	TIMEOUT	584	TIMEOUT	645	566	681	1225	681	1863	811	745	562
480	327	663	444967	TIMEOUT	669	TIMEOUT	653	663	728	1293	728	1848	918	830	610
483	34035	116906	114237	TIMEOUT	114251	TIMEOUT	58044	114237	114533	TIMEOUT	126475	TIMEOUT	128780	0	TIMEOUT
484	37999	102008	101911	TIMEOUT	116950	TIMEOUT	75998	101911	102013	TIMEOUT	109286	TIMEOUT	137395	0	TIMEOUT
485	2593	5291	814617	TIMEOUT	5451	15645	5186	5291	5291	TIMEOUT	5451	33195	5291	5574	547530
486	11187	46982	105329	TIMEOUT	75867	264926	15554	46980	46980	TIMEOUT	56115	TIMEOUT	54561	0	TIMEOUT
487	17153	65521	102628	TIMEOUT	120679	TIMEOUT	26030	65519	65519	TIMEOUT	73789	TIMEOUT	78529	0	TIMEOUT
488	11187	46969	102250	TIMEOUT	75854	268813	15554	46967	46967	TIMEOUT	56227	TIMEOUT	54548	0	TIMEOUT
489	13640	52447	105776	TIMEOUT	87871	555145	19014	52445	52445	TIMEOUT	60803	TIMEOUT	61942	0	TIMEOUT
496	10238	3220	11468	TIMEOUT	3219	3521	20476	3220	3220	2706	3220	2785	13458	12764	4415
497	8316	23	23	1284	23	681	16632	23	23	1005	23	988	8339	7540	3145
498	8316	23	23	1562	23	649	16632	23	23	1074	23	1035	8339	7540	3204
500	1622	1990	524990	TIMEOUT	4369	7648	3242	1988	4369	216717	4369	15184	1988	3375	16479
502	1878	1924	9147	TIMEOUT	1926	1370	3756	1924	1926	1363	1926	1133	3800	3646	789
504	48	658	42328	TIMEOUT	671	264	96	636	671	235	671	198	661	686	362
505	9	151	151	173	151	91	18	151	151	86	151	78	160	159	252
508	50	267	397701	TIMEOUT	285	255	99	267	285	170	285	165	298	306	310
511	345	276	35216	TIMEOUT	276	TIMEOUT	700	285	469	508	469	473	614	632	394
512	458	800	2832	22253	1057	1310	669	800	1057	606	1057	635	823	1288	485
513	38	309	419	829	309	187	76	309	309	168	309	143	347	331	308
514	38	309	419	803	309	185	76	309	309	148	309	138	347	331	299
515	870	2366	3201	46053	2366	697	1740	2366	2366	535	2366	551	3232	3105	640
518	11036	9363	390351	TIMEOUT	27264	152414	22070	9363	9363	TIMEOUT	16268	TIMEOUT	9363	0	TIMEOUT
519	73	93	93	221	93	95	146	93	93	103	93	96	166	143	270
520	76	91	91	217	91	94	152	91	91	108	91	97	167	144	269
521	7276	3640	3640	60549	3640	1009	14552	3640	3640	1222	3640	1506	10916	10908	6222
522	4233	169	286	8946	169	426	8466	169	169	658	169	632	4402	4082	1198
523	4233	169	286	8405	169	420	8466	169	169	642	169	605	4402	4082	1184
526	193	280	626	1837	282	271	386	280	282	212	282	210	473	350	342
527	502	4	4	152	4	119	1004	4	4	190	4	148	506	499	349
530	3	10609	10620	7435	10609	469	6	10609	10609	528	10609	585	10612	10611	1491
531	7	11839	11867	10279	11839	524	14	11839	11839	567	11839	554	11846	11840	1737
532	11943	38053	107730	TIMEOUT	38093	65243	23886	38045	38093	12980	38093	13691	49670	43913	229069
533	32907	61414	80819	TIMEOUT	73325	TIMEOUT	65814	61062	61062	TIMEOUT	73954	TIMEOUT	85832	0	TIMEOUT
534	315	630	2114030	TIMEOUT	630	1007	630	630	630	17393	630	1518	630	630	1788
535	8479	4621	432522	TIMEOUT	7057	34441	16958	4621	4621	TIMEOUT	7057	125087	4622	10681	442660
536	6762	36439	53743	TIMEOUT	36572	14175	13524	36438	36572	25968	36572	12115	43099	0	TIMEOUT
537	11089	51964	73115	TIMEOUT	52125	24657	22178	51961	52125	56793	52125	18967	62949	0	TIMEOUT
538	102	204	1091602	600722	204	294	204	204	204	801	204	356	204	204	401
539	104	208	1145302	601342	210	278	208	208	210	835	210	378	208	211	401
540	1744	13345	117528	TIMEOUT	14090	7138	3308	13265	14090	26414	14090	7149	14906	14833	26228
541	11973	28600	117812	TIMEOUT	27132	TIMEOUT	18266	27181	27181	TIMEOUT	33384	TIMEOUT	37703	0	TIMEOUT
542	9	18	582	11781	18	92	18	18	18	100	18	78	18	18	233
543	9	18	564	11248	18	94	18	18	18	95	18	71	18	18	236
544	5972	3271	12909	TIMEOUT	3271	3463	11944	3271	3271	2258	3271	2633	9243	8697	3505
545	6276	3351	13310	TIMEOUT	3351	3539	12552	3351	3351	2353	3351	2443	9627	9077	4294
546	1952	775	1616	29201	775	710	3904	775	775	612	775	637	2727	2487	650
547	1952	780	1630	30343	780	666	3904	780	780	612	780	649	2732	2490	662
548	93	4361	4566	10937	4361	397	186	4361	4361	356	4361	345	4454	4441	607
550	3	853	862	416	853	128	6	853	853	128	853	115	856	851	340
553	50453	90333	90333	TIMEOUT	nan	ERROR	100906	90333	115244	584786	115244	159387	110363	0	TIMEOUT
554	74235	106867	106867	TIMEOUT	193716	326395	148466	106867	109204	TIMEOUT	135961	TIMEOUT	132350	0	TIMEOUT
555	134	1043	453083	TIMEOUT	1064	462	266	993	1066	703	1066	464	1044	1052	733
556	499	1532	453005	TIMEOUT	1924	2737	1144	1549	1976	914	1976	995	1948	2297	668
560	9	130	632	2253	133	191	18	130	133	127	133	105	138	134	268
561	107	685	140830	TIMEOUT	853	501	214	662	853	324	853	306	762	779	405
562	57	710	770	1347	710	169	114	710	710	156	710	150	767	764	380
563	75	983	1107	1881	983	207	150	983	983	192	983	176	1058	1046	392
566	2505	49988	52572	TIMEOUT	50009	12017	4990	49983	50011	5105	50011	4540	52406	50883	59487
569	966	1750	389535	TIMEOUT	2442	2709	1830	1701	2442	5995	2442	2717	2652	2520	2444
570	38	1102	1158	1609	1102	191	76	1102	1102	173	1102	157	1140	1130	394
571	39	1357	1432	1696	1357	205	78	1357	1357	188	1357	174	1396	1388	401
572	19651	57494	78076	TIMEOUT	60197	70344	39188	57494	60197	30051	60197	19052	76599	0	TIMEOUT
573	36922	91847	91611	TIMEOUT	113959	211769	73728	91611	113959	146914	113959	59636	128026	0	TIMEOUT
574	535	736	271119	TIMEOUT	2462	1973	956	736	2462	27004	2462	2821	736	1178	960
575	479	700	613004	TIMEOUT	2255	2001	958	700	2255	25045	2255	3257	700	1124	1004
576	26	66	234	537	89	209	52	66	90	136	90	135	92	90	260
577	15	16	16	105	16	71	30	16	16	69	16	60	31	16	224
580	8	272	276	268	272	104	16	272	272	105	272	98	280	280	275
581	5	316	320	247	316	109	10	316	316	120	316	89	321	321	288
582	184	647	553165	TIMEOUT	648	385	310	622	711	420	711	406	803	743	404
589	112	939	1134	1849	939	224	224	939	939	211	939	188	1051	988	391
590	16	605	73397	TIMEOUT	613	1738	26	605	613	227	613	213	614	669	376
591	69	2529	2722	4250	2529	288	138	2529	2529	263	2529	226	2598	2565	502
592	106	3414	4004	8409	3414	472	212	3414	3414	316	3414	313	3520	3441	592
593	192	2049	2336	8743	2049	255	384	2049	2049	277	2049	244	2241	2172	478
594	177	1984	2073	6883	1984	262	354	1984	1984	256	1984	255	2161	2140	477
595	219	2894	68451	TIMEOUT	21135	3844	438	2703	21135	5917	21135	3689	2918	2897	566
596	181	2022	2134	7906	2022	270	362	2022	2022	266	2022	273	2203	2180	484
597	223	2933	89368	TIMEOUT	21174	3809	446	2742	21174	6044	21174	3702	2961	2934	592
598	4	1	1	81	1	50	8	1	1	50	1	40	5	3	230
600	177	1983	2072	6888	1983	248	354	1983	1983	244	1983	260	2160	2139	448
605	84	650	960	2489	650	258	168	650	650	182	650	185	734	658	351
624	98	915	2475	12410	925	TIMEOUT	190	915	940	296	940	314	998	968	442
626	683	2108	544344	TIMEOUT	2195	1616	1000	1931	2195	2310	2195	1364	2581	2545	1443
627	572	2221	3423	38698	2221	620	1144	2221	2221	465	2221	475	2793	2572	600
631	812	2653	620159	TIMEOUT	2802	1788	1144	2452	2802	2940	2802	1927	3225	3163	1742
632	500	1895	397657	TIMEOUT	2190	1462	1000	1895	2190	3060	2190	1490	2185	2271	1233
636	1652	940	181491	TIMEOUT	1282	1117	4188	939	1282	817	1282	876	2585	2746	758
637	92	239	54626	TIMEOUT	233	239	184	181	233	341	233	248	259	237	341
638	124	278	83878	TIMEOUT	320	268	248	204	320	440	320	310	297	292	343
639	353	254	287	1773	254	175	706	254	254	202	254	181	607	568	351
640	408	394	447	1828	394	205	816	394	394	212	394	197	802	736	383
645	2091	1594	3839	140047	1594	1036	4182	1594	1594	806	1594	855	3685	3269	901
646	2532	2301	5399	266857	2301	1481	5064	2301	2301	985	2301	1008	4833	4343	1087
648	4	232	239	206	232	99	8	232	232	101	232	90	236	234	293
649	663	284	478	3547	284	411	1326	284	284	313	284	339	947	904	403
657	1732	2654	218660	TIMEOUT	3405	6663	3284	2580	3405	31145	3405	6692	4223	4142	6764
658	11957	16680	165873	TIMEOUT	15217	TIMEOUT	18234	15266	15266	TIMEOUT	21480	TIMEOUT	25787	0	TIMEOUT
660	9040	14988	151086	TIMEOUT	13653	TIMEOUT	13346	13597	13597	TIMEOUT	21147	TIMEOUT	21656	0	TIMEOUT
665	299	3166	80929	TIMEOUT	21407	4222	598	2975	21407	6324	21407	4045	3270	3186	664
666	269	2346	68208	TIMEOUT	20971	3704	538	2153	20971	5699	20971	3637	2418	2346	545
667	1181	506	963	11231	506	523	2362	506	506	432	506	436	1687	1568	509
669	3530	4880	5701	308568	4880	1028	7060	4880	4880	984	4880	969	8410	8261	1987
670	7079	5693	17355	TIMEOUT	5693	3234	14158	5693	5693	2196	5693	2448	12772	9688	8182
673	115	1929	2030	4490	1929	250	230	1929	1929	238	1929	222	2044	2016	481
675	25194	67697	82655	TIMEOUT	68710	TIMEOUT	50388	67697	72770	TIMEOUT	72770	404336	90959	0	TIMEOUT
676	1921	1662	632565	TIMEOUT	4756	5285	3842	1662	4756	64556	4756	17088	1662	3277	12814
677	1608	1283	1116231	TIMEOUT	3926	4220	3214	1282	3926	46498	3926	12410	1282	2670	6127
678	7558	11408	140327	TIMEOUT	30739	6727	15114	11217	30739	12801	30739	7116	18511	15734	51963
679	260	472	587172	TIMEOUT	1293	1202	518	472	1293	17084	1293	2003	472	751	698
680	7414	11064	58535	TIMEOUT	29305	5915	14828	10873	29305	6952	29305	5570	18167	15144	13137
681	116	57	147	1332	57	123	232	57	57	165	57	146	57	147	293
682	24701	50202	72307	TIMEOUT	68461	169379	49402	50011	68461	28609	68461	29142	74647	61964	428424
683	61	68	2790	46907	85	156	122	68	85	208	85	163	68	115	293
684	12683	62377	85773	TIMEOUT	81553	23589	25366	62185	81553	42202	81553	17352	74471	0	TIMEOUT
685	394	755	2191795	TIMEOUT	1197	2241	788	754	1197	55971	1197	3422	755	1046	2451
686	36894	106605	106414	TIMEOUT	124846	199740	73788	106414	124846	38444	124846	39435	143120	0	TIMEOUT
687	184	92	92	317	92	98	368	92	92	132	92	128	92	248	298
689	1054	451	688	6839	451	314	2108	451	451	355	451	341	1505	1290	489
690	1291	975	1792	32256	975	550	2582	975	975	530	975	555	2266	2016	603
694	6207	1624	3273	316870	1624	1256	12414	1624	1624	1219	1624	1351	7831	7187	1519
695	7708	2842	5859	TIMEOUT	2842	1879	15416	2842	2842	1543	2842	1905	10550	9698	2303
700	1053	1025	2297	38186	1025	18719	4350	1025	1025	17420	1025	13814	2076	3304	196634
701	861	982	664256	TIMEOUT	nan	ERROR	3944	982	1589	10592	1589	9787	1820	3462	62168
702	774	789	1600	19290	789	6753	3050	789	789	7231	789	7510	1561	2279	39945
703	1160	1210	503186	TIMEOUT	nan	ERROR	4906	1210	2004	19120	2004	18527	2347	4297	286437
704	355	419	914	6078	419	4246	1404	419	419	3043	419	2897	772	1113	4177
705	380	337	813	6409	337	3805	1606	337	337	3207	337	3329	715	1302	6190
706	342	336	874	6099	336	3107	1236	336	336	2760	336	2459	676	993	4304
707	257	280	672	3783	280	2196	946	280	280	1835	280	1742	535	799	1969
708	125	159	371	1808	159	925	452	159	159	664	159	753	282	431	644
709	130	145	363	1770	145	835	476	145	145	650	145	820	273	401	630
710	240	235	617	3757	235	1919	900	235	235	1698	235	1391	473	745	1940
711	245	289	656	4026	289	1625	928	289	289	1535	289	1465	532	765	1640
712	502	681	619715	TIMEOUT	993	13792	1924	681	993	4430	993	4270	1160	1971	12518
713	455	425	1058	9352	425	6873	2056	425	425	4626	425	3843	878	1504	12841
714	193	195	490	2694	195	1784	726	195	195	1115	195	1148	386	644	1245
715	567	451	1171	10785	451	6213	2080	451	451	5385	451	4580	1016	1572	22348
716	640	605	1369	14720	605	9421	2602	605	605	7440	605	6033	1243	2028	33399
717	5	43	58	204	43	109	14	43	43	89	43	68	46	51	242
718	97	127	266	1280	127	608	358	127	127	429	127	456	222	311	420
719	488	421	1047	9157	421	4978	1938	421	421	4637	421	3832	907	1527	14449
720	190	254	515	2653	254	1780	720	254	254	959	254	974	442	587	782
721	222	213	497	2859	213	1900	848	213	213	1181	213	1273	433	670	1256
722	411	490	982	7070	490	3468	1636	490	490	2869	490	2896	899	1276	4561
723	225	249	569	3253	249	2296	914	249	249	1573	249	1388	472	757	1515
724	828	947	1781	23706	947	11487	3650	947	947	9362	947	8786	1773	2600	39899
725	5	44	59	181	44	115	14	44	44	91	44	68	47	56	241
726	283	388	712	4152	388	2488	1124	388	388	1848	388	1664	669	939	1595
727	833	985	1827	23808	985	13858	3922	985	985	10096	985	8326	1816	2965	47935
728	728	881	637296	TIMEOUT	1357	14911	2774	881	1357	7168	1357	7690	1586	2593	35063
729	54	94	174	759	94	331	200	94	94	266	94	254	146	210	335
730	3	42	54	162	42	98	8	42	42	81	42	58	43	48	233
731	148	173	390	2294	173	1325	602	173	173	827	173	824	319	511	780
732	402	391	894	6714	391	3351	1560	391	391	2761	391	3112	791	1228	5515
733	702	676	1619	19760	676	7141	2992	676	676	9810	676	6819	1376	2255	48402
734	78	114	251	1188	114	529	278	114	114	372	114	335	190	288	390
735	290	287	705	4471	287	1971	1082	287	287	2089	287	1810	575	915	2321
736	7	48	64	193	48	119	22	48	48	100	48	88	53	62	248
737	227	228	555	3496	228	7103	854	228	228	1355	228	1399	453	673	1525
738	159	211	424	2615	211	1084	622	211	211	768	211	771	368	510	751
739	234	271	590	3751	271	1584	936	271	271	1362	271	1403	503	765	1301
740	289	316	740	4524	316	1864	1030	316	316	2044	316	1622	603	930	2256
741	752	722	1485	18393	722	10537	3424	722	722	9129	722	7191	1472	2561	47264
742	191	198	439	2632	198	1507	726	198	198	857	198	1018	387	571	989
743	708	961	1541	26940	961	8831	2868	961	961	4908	961	5748	1667	2152	11060
744	228	303	625	3196	303	1886	922	303	303	1333	303	1274	529	759	1327
745	329	335	795	5596	335	2865	1382	335	335	2418	335	2458	662	1037	3754
746	490	468	1071	9536	468	6185	2130	468	468	4896	468	3892	956	1605	13520
747	419	437	983	7902	437	8850	1822	437	437	4103	437	3264	854	1350	8061
748	223	271	596	3270	271	1525	820	271	271	1255	271	1237	492	698	1102
749	469	517	1058	8263	517	4068	1802	517	517	3587	517	3200	984	1426	7112
750	209	283	546	2949	283	2197	872	283	283	1033	283	1134	490	671	956
751	248	253	617	3880	253	2615	940	253	253	1587	253	1469	499	743	1781
752	772	788	1570	19372	788	11758	3346	788	788	8487	788	7840	1558	2426	42816
753	207	221	510	2856	221	1947	808	221	221	1209	221	1274	426	659	1247
754	932	973	443555	TIMEOUT	1604	85279	3742	973	1604	11531	1604	12315	1882	3396	114856
755	459	471	1056	8525	471	3985	1794	471	471	4063	471	3480	928	1454	8433
756	578	597	1288	12312	597	6126	2356	597	597	6112	597	5480	1173	1784	21153
759	2532	5317	9430	581480	5405	2455	5064	5317	5405	1343	5405	1390	7848	7455	2260
760	57692	171905	170834	TIMEOUT	172117	TIMEOUT	101627	170834	170887	TIMEOUT	nan	ERROR	222048	0	TIMEOUT
761	5598	13151	51034	TIMEOUT	25439	TIMEOUT	11195	13151	14278	TIMEOUT	18816	TIMEOUT	18747	0	TIMEOUT
762	2508	6825	137880	TIMEOUT	32700	127334	5016	6634	6861	TIMEOUT	11946	TIMEOUT	9136	0	TIMEOUT
763	124	385	94475	TIMEOUT	369	286	248	311	369	399	369	288	402	378	352
766	218	2036	88646	TIMEOUT	20181	3948	436	1845	20181	5902	20181	3775	2057	2034	557
768	2532	5752	9865	600008	5840	2484	5064	5752	5840	1266	5840	1383	8283	7825	2569
769	2532	2653	6518	311963	2653	1855	5064	2653	2653	1038	2653	1225	5185	4695	1226
770	2532	2666	6779	343001	2754	2511	5064	2666	2754	1275	2754	1301	5196	4787	1247
772	6	653	134379	TIMEOUT	656	13006	12	653	656	207	656	188	619	669	361
773	55	590	906	2544	620	509	103	577	620	226	620	214	604	631	354
775	59	331	1071908	TIMEOUT	nan	ERROR	209	330	548	499	548	828	298	497	360
778	42054	113187	105682	TIMEOUT	116577	TIMEOUT	84108	113187	113187	TIMEOUT	nan	ERROR	91618	0	TIMEOUT
781	187	243	65814	TIMEOUT	254	TIMEOUT	188	243	553	315	553	325	373	430	347
783	187	241	53484	TIMEOUT	405	TIMEOUT	188	241	526	298	526	343	371	432	352
784	65	997	1883	3359	1013	389	114	987	1013	217	1013	193	933	1007	367
786	76401	109114	109114	TIMEOUT	196594	331225	152798	109114	111699	TIMEOUT	nan	ERROR	135545	0	TIMEOUT
787	45442	61046	96136	TIMEOUT	61359	TIMEOUT	98690	59418	59418	TIMEOUT	nan	ERROR	58730	0	TIMEOUT
788	13	2289	134752	TIMEOUT	2296	88957	22	2289	2296	254	2296	225	2294	2355	499
789	13	2342	137974	TIMEOUT	2351	72609	24	2342	2351	231	2351	240	2347	2416	522
790	10	2550	145445	TIMEOUT	2556	60863	18	2550	2556	254	2556	261	2554	2627	523
792	27875	42590	80493	TIMEOUT	nan	ERROR	62914	42585	42585	TIMEOUT	67411	TIMEOUT	56605	0	TIMEOUT
793	159	135	132652	TIMEOUT	233	619	313	135	233	379	233	402	284	337	347
795	47412	65392	101382	TIMEOUT	309978	TIMEOUT	94824	65392	65392	TIMEOUT	nan	ERROR	112804	0	TIMEOUT

2. Blown up ontologies experiments

In these experiments, we use as input the same ontologies as in the previous experiments, on which we applied a blow-up transformation adding at most 5 side atoms to each GTGD's guard atom. So, the statistics on the number of Datalog rules or non-full TGDs in the input are the same as the previous experiments.

You can find on this repository the input files used to run the experiments and the resulting statistics files from which the following results come from. You can also visit the website of our system GSat.

2.1. Times Comparison

Cactus plot of the times

<AxesSubplot:>

2.2. Timeout analysis

2.2.1. All the algorithm reach the timeout

The following table contains the rows where all the algorithm executions reach the timeout sorted by the input size. Their number:

NAME	NFTGD	FTGD	Exb_TIME	SK_TIME	HYPER_TIME
3	16709	2159	ERROR	TIMEOUT	ERROR
4	16705	2107	ERROR	TIMEOUT	ERROR
14	139	1551	ERROR	TIMEOUT	ERROR
20	83	1326	TIMEOUT	TIMEOUT	TIMEOUT
21	110	1206	TIMEOUT	TIMEOUT	TIMEOUT
24	139	1551	TIMEOUT	TIMEOUT	TIMEOUT
26	23858	30697	ERROR	TIMEOUT	ERROR
27	23858	31647	ERROR	TIMEOUT	ERROR
29	1776	4040	ERROR	TIMEOUT	ERROR
30	2096	3626	ERROR	TIMEOUT	ERROR
32	2096	4040	ERROR	TIMEOUT	ERROR
33	12339	9462	ERROR	TIMEOUT	ERROR
34	12339	9364	ERROR	TIMEOUT	ERROR
36	12329	9456	TIMEOUT	TIMEOUT	ERROR
37	12323	9445	TIMEOUT	TIMEOUT	ERROR
38	12339	9457	TIMEOUT	TIMEOUT	ERROR
39	2437	4936	ERROR	TIMEOUT	ERROR
40	50790	103042	TIMEOUT	TIMEOUT	ERROR
41	21197	68508	TIMEOUT	TIMEOUT	ERROR
42	22295	72365	TIMEOUT	TIMEOUT	ERROR
43	25490	116974	TIMEOUT	TIMEOUT	ERROR
44	21197	68471	TIMEOUT	TIMEOUT	ERROR
45	49531	100829	TIMEOUT	TIMEOUT	ERROR
46	22297	70404	TIMEOUT	TIMEOUT	ERROR
47	21309	68696	TIMEOUT	TIMEOUT	ERROR
174	1776	3626	ERROR	TIMEOUT	ERROR
283	86	972	ERROR	TIMEOUT	TIMEOUT
285	66179	46602	TIMEOUT	TIMEOUT	TIMEOUT
350	942	3062	TIMEOUT	TIMEOUT	ERROR
354	1501	4839	ERROR	TIMEOUT	TIMEOUT
374	8270	30508	TIMEOUT	TIMEOUT	ERROR
375	12633	45611	TIMEOUT	TIMEOUT	ERROR
378	21423	58442	TIMEOUT	TIMEOUT	ERROR
379	38615	90926	TIMEOUT	TIMEOUT	ERROR
382	11806	47304	TIMEOUT	TIMEOUT	ERROR
383	17881	65883	TIMEOUT	TIMEOUT	ERROR
387	12083	44583	TIMEOUT	TIMEOUT	ERROR
390	7265	26905	TIMEOUT	TIMEOUT	ERROR
391	11754	41534	TIMEOUT	TIMEOUT	ERROR
395	24648	62478	TIMEOUT	TIMEOUT	ERROR
410	476	1340	TIMEOUT	TIMEOUT	TIMEOUT
425	11625	26750	TIMEOUT	TIMEOUT	ERROR
426	24421	44891	TIMEOUT	TIMEOUT	TIMEOUT
436	2308	24788	TIMEOUT	TIMEOUT	ERROR
437	44247	91145	TIMEOUT	TIMEOUT	ERROR
448	24892	49657	TIMEOUT	TIMEOUT	ERROR
462	11474	15066	TIMEOUT	TIMEOUT	ERROR
463	9433	10352	TIMEOUT	TIMEOUT	ERROR
470	44414	75146	TIMEOUT	TIMEOUT	ERROR
471	42734	78977	TIMEOUT	TIMEOUT	ERROR
472	44414	75146	TIMEOUT	TIMEOUT	TIMEOUT
473	42734	78977	TIMEOUT	TIMEOUT	ERROR
477	156743	10606	TIMEOUT	TIMEOUT	ERROR
479	323	566	TIMEOUT	TIMEOUT	TIMEOUT
480	327	663	TIMEOUT	TIMEOUT	TIMEOUT
483	34035	116906	TIMEOUT	TIMEOUT	ERROR
484	37999	102008	TIMEOUT	TIMEOUT	ERROR
486	11187	46982	TIMEOUT	TIMEOUT	ERROR
487	17153	65521	TIMEOUT	TIMEOUT	ERROR
488	11187	46969	TIMEOUT	TIMEOUT	ERROR
489	13640	52447	TIMEOUT	TIMEOUT	ERROR
518	11036	9363	TIMEOUT	TIMEOUT	ERROR
532	11943	38053	TIMEOUT	TIMEOUT	ERROR
533	32907	61414	TIMEOUT	TIMEOUT	ERROR
537	11089	51964	TIMEOUT	TIMEOUT	ERROR
541	11973	28600	TIMEOUT	TIMEOUT	ERROR
553	50453	90333	ERROR	TIMEOUT	ERROR
554	74235	106867	TIMEOUT	TIMEOUT	ERROR
572	19651	57494	TIMEOUT	TIMEOUT	ERROR
573	36922	91847	TIMEOUT	TIMEOUT	ERROR
658	11957	16680	TIMEOUT	TIMEOUT	ERROR
660	9040	14988	TIMEOUT	TIMEOUT	ERROR
675	25194	67697	ERROR	TIMEOUT	ERROR
682	24701	50202	TIMEOUT	TIMEOUT	TIMEOUT
684	12683	62377	TIMEOUT	TIMEOUT	ERROR
686	36894	106605	TIMEOUT	TIMEOUT	ERROR
700	1053	1025	ERROR	TIMEOUT	ERROR
701	861	982	ERROR	TIMEOUT	TIMEOUT
702	774	789	ERROR	TIMEOUT	TIMEOUT
703	1160	1210	ERROR	TIMEOUT	TIMEOUT
704	355	419	ERROR	TIMEOUT	ERROR
705	380	337	TIMEOUT	TIMEOUT	TIMEOUT
706	342	336	TIMEOUT	TIMEOUT	TIMEOUT
707	257	280	TIMEOUT	TIMEOUT	TIMEOUT
710	240	235	ERROR	TIMEOUT	TIMEOUT
711	245	289	TIMEOUT	TIMEOUT	ERROR
712	502	681	ERROR	TIMEOUT	ERROR
713	455	425	ERROR	TIMEOUT	ERROR
714	193	195	TIMEOUT	TIMEOUT	TIMEOUT
715	567	451	ERROR	TIMEOUT	ERROR
716	640	605	ERROR	TIMEOUT	TIMEOUT
719	488	421	ERROR	TIMEOUT	TIMEOUT
720	190	254	TIMEOUT	TIMEOUT	TIMEOUT
722	411	490	ERROR	TIMEOUT	TIMEOUT
723	225	249	TIMEOUT	TIMEOUT	TIMEOUT
724	828	947	ERROR	TIMEOUT	ERROR
726	283	388	ERROR	TIMEOUT	ERROR
727	833	985	ERROR	TIMEOUT	ERROR
728	728	881	ERROR	TIMEOUT	TIMEOUT
732	402	391	TIMEOUT	TIMEOUT	TIMEOUT
733	702	676	ERROR	TIMEOUT	ERROR
735	290	287	TIMEOUT	TIMEOUT	TIMEOUT
737	227	228	ERROR	TIMEOUT	ERROR
739	234	271	TIMEOUT	TIMEOUT	ERROR
740	289	316	TIMEOUT	TIMEOUT	ERROR
741	752	722	ERROR	TIMEOUT	ERROR
742	191	198	ERROR	TIMEOUT	TIMEOUT
743	708	961	ERROR	TIMEOUT	ERROR
744	228	303	ERROR	TIMEOUT	TIMEOUT
745	329	335	ERROR	TIMEOUT	ERROR
746	490	468	ERROR	TIMEOUT	TIMEOUT
747	419	437	ERROR	TIMEOUT	TIMEOUT
748	223	271	TIMEOUT	TIMEOUT	ERROR
749	469	517	ERROR	TIMEOUT	ERROR
750	209	283	ERROR	TIMEOUT	TIMEOUT
752	772	788	ERROR	TIMEOUT	ERROR
753	207	221	TIMEOUT	TIMEOUT	TIMEOUT
754	932	973	ERROR	TIMEOUT	ERROR
755	459	471	ERROR	TIMEOUT	ERROR
756	578	597	TIMEOUT	TIMEOUT	TIMEOUT
760	57692	171905	TIMEOUT	TIMEOUT	ERROR
761	5598	13151	TIMEOUT	TIMEOUT	ERROR
762	2508	6825	TIMEOUT	TIMEOUT	ERROR
778	42054	113187	TIMEOUT	TIMEOUT	ERROR
786	76401	109114	TIMEOUT	TIMEOUT	TIMEOUT
787	45442	61046	TIMEOUT	TIMEOUT	ERROR
792	27875	42590	ERROR	TIMEOUT	ERROR
795	47412	65392	TIMEOUT	TIMEOUT	ERROR

2.2.2. Timeout summary

The number of ontologies on which two algorithms reach the timeout simultaneously

	Exb	SK	HYPER
Exb	26	0	20
SK	0	62	56
HYPER	20	56	101

The times on the ontologies where at least one algorithm reaches timeout except SimpleDR.

2.2.3. Existential-based DR timeout

The following table contains the rows where the Gsat execution reaches the timeout, while another algorithm is not, sorted by the input size.

NAME	NFTGD	FTGD	Exb_TIME	SK_TIME	HYPER_TIME
729	54	94	TIMEOUT	12360	269262
343	4	97	TIMEOUT	545	1656
734	78	114	TIMEOUT	179633	ERROR
718	97	127	TIMEOUT	127021	145299
709	130	145	TIMEOUT	497554	TIMEOUT
708	125	159	TIMEOUT	289877	TIMEOUT
731	148	173	ERROR	243061	40969
738	159	211	TIMEOUT	32267	ERROR
721	222	213	TIMEOUT	355732	ERROR
783	187	241	TIMEOUT	65848	TIMEOUT
781	187	243	TIMEOUT	9132	TIMEOUT
319	187	243	TIMEOUT	15565	TIMEOUT
751	248	253	ERROR	244113	TIMEOUT
511	345	276	TIMEOUT	61598	TIMEOUT
775	59	331	ERROR	267561	TIMEOUT
282	66	893	ERROR	504489	TIMEOUT
624	98	915	TIMEOUT	13242	ERROR
16	65	1069	ERROR	95796	TIMEOUT
19	68	1092	TIMEOUT	247415	TIMEOUT
18	85	1145	TIMEOUT	155274	ERROR
17	65	1191	TIMEOUT	112559	TIMEOUT
284	84	1237	TIMEOUT	452166	TIMEOUT
13	76	1279	TIMEOUT	181888	TIMEOUT
788	13	2289	TIMEOUT	3300	42187
1	254	2476	TIMEOUT	62255	TIMEOUT
790	10	2550	TIMEOUT	2852	21003

2.2.4. Skolem DR timeout

The following table contains the rows where the SkolemDR executions reach the timeout, while another algorithm is not, sorted by the input size.

NAME	NFTGD	FTGD	Exb_TIME	SK_TIME	HYPER_TIME
417	176	343	1641	TIMEOUT	ERROR
418	202	395	2219	TIMEOUT	ERROR
679	260	472	2179	TIMEOUT	47360
384	732	548	2203	TIMEOUT	ERROR
385	834	574	3394	TIMEOUT	ERROR
534	315	630	2207	TIMEOUT	ERROR
422	420	672	3496	TIMEOUT	TIMEOUT
575	479	700	4033	TIMEOUT	ERROR
574	535	736	5058	TIMEOUT	ERROR
685	394	755	6251	TIMEOUT	ERROR
401	423	786	1903	TIMEOUT	ERROR
399	512	991	2084	TIMEOUT	ERROR
377	570	1006	6689	TIMEOUT	ERROR
372	557	1078	2242	TIMEOUT	40541
396	597	1153	3657	TIMEOUT	ERROR
392	608	1213	20523	TIMEOUT	ERROR
421	717	1274	13379	TIMEOUT	ERROR
677	1608	1283	13155	TIMEOUT	ERROR
376	694	1286	10796	TIMEOUT	ERROR
373	668	1298	2884	TIMEOUT	ERROR
424	786	1507	7602	TIMEOUT	75809
393	776	1552	23983	TIMEOUT	ERROR
676	1921	1662	19864	TIMEOUT	ERROR
569	966	1750	8610	TIMEOUT	59134
632	500	1895	4772	TIMEOUT	60571
500	1622	1990	24729	TIMEOUT	ERROR
766	218	2036	63388	TIMEOUT	ERROR
626	683	2108	5326	TIMEOUT	65210
666	269	2346	84269	TIMEOUT	ERROR
631	812	2653	5793	TIMEOUT	ERROR
657	1732	2654	37732	TIMEOUT	ERROR
476	1834	2713	17491	TIMEOUT	ERROR
595	219	2894	52580	TIMEOUT	ERROR
397	1494	2922	20156	TIMEOUT	ERROR
597	223	2933	60895	TIMEOUT	ERROR
438	1512	3024	165806	TIMEOUT	ERROR
665	299	3166	65469	TIMEOUT	ERROR
353	221	3426	74778	TIMEOUT	ERROR
352	221	3447	61195	TIMEOUT	ERROR
535	8479	4621	136824	TIMEOUT	ERROR
419	1636	4806	254138	TIMEOUT	ERROR
485	2593	5291	50456	TIMEOUT	ERROR
420	1505	5297	62248	TIMEOUT	ERROR
768	2532	5752	38785	TIMEOUT	TIMEOUT
380	3141	6000	46662	TIMEOUT	ERROR
381	3216	6053	53776	TIMEOUT	ERROR
459	4019	6905	29786	TIMEOUT	ERROR
460	9023	10382	380608	TIMEOUT	ERROR
680	7414	11064	151175	TIMEOUT	ERROR
678	7558	11408	167266	TIMEOUT	ERROR
540	1744	13345	35451	TIMEOUT	ERROR
398	7419	27882	277361	TIMEOUT	ERROR
371	7464	27969	254680	TIMEOUT	ERROR
386	7559	28602	152322	TIMEOUT	ERROR
400	7999	30008	233238	TIMEOUT	ERROR
394	9163	31483	465225	TIMEOUT	ERROR
286	13961	32979	498850	TIMEOUT	TIMEOUT
536	6762	36439	227584	TIMEOUT	ERROR
369	10978	39919	354034	TIMEOUT	ERROR
415	7755	40108	123648	TIMEOUT	TIMEOUT
370	12070	56379	384146	TIMEOUT	TIMEOUT
416	12272	56774	407818	TIMEOUT	TIMEOUT

2.2.5. HyperDR timeout

The following table contains the rows where the HyperDR executions reach the timeout, while another algorithm is not, sorted by the input size.

NAME	NFTGD	FTGD	Exb_TIME	SK_TIME	HYPER_TIME
475	22	83	233	1642	TIMEOUT
734	78	114	TIMEOUT	179633	ERROR
709	130	145	TIMEOUT	497554	TIMEOUT
708	125	159	TIMEOUT	289877	TIMEOUT
172	108	190	6908	44718	TIMEOUT
539	104	208	615	118462	TIMEOUT
738	159	211	TIMEOUT	32267	ERROR
721	222	213	TIMEOUT	355732	ERROR
783	187	241	TIMEOUT	65848	TIMEOUT
781	187	243	TIMEOUT	9132	TIMEOUT
319	187	243	TIMEOUT	15565	TIMEOUT
751	248	253	ERROR	244113	TIMEOUT
511	345	276	TIMEOUT	61598	TIMEOUT
775	59	331	ERROR	267561	TIMEOUT
417	176	343	1641	TIMEOUT	ERROR
418	202	395	2219	TIMEOUT	ERROR
22	13	433	4635	2701	TIMEOUT
384	732	548	2203	TIMEOUT	ERROR
385	834	574	3394	TIMEOUT	ERROR
773	55	590	4448	24418	TIMEOUT
534	315	630	2207	TIMEOUT	ERROR
422	420	672	3496	TIMEOUT	TIMEOUT
575	479	700	4033	TIMEOUT	ERROR
574	535	736	5058	TIMEOUT	ERROR
685	394	755	6251	TIMEOUT	ERROR
401	423	786	1903	TIMEOUT	ERROR
282	66	893	ERROR	504489	TIMEOUT
624	98	915	TIMEOUT	13242	ERROR
636	1652	940	5482	126729	TIMEOUT
2	432	941	8299	81075	ERROR
399	512	991	2084	TIMEOUT	ERROR
784	65	997	3110	16718	TIMEOUT
377	570	1006	6689	TIMEOUT	ERROR
16	65	1069	ERROR	95796	TIMEOUT
19	68	1092	TIMEOUT	247415	TIMEOUT
18	85	1145	TIMEOUT	155274	ERROR
396	597	1153	3657	TIMEOUT	ERROR
17	65	1191	TIMEOUT	112559	TIMEOUT
392	608	1213	20523	TIMEOUT	ERROR
284	84	1237	TIMEOUT	452166	TIMEOUT
421	717	1274	13379	TIMEOUT	ERROR
13	76	1279	TIMEOUT	181888	TIMEOUT
677	1608	1283	13155	TIMEOUT	ERROR
376	694	1286	10796	TIMEOUT	ERROR
373	668	1298	2884	TIMEOUT	ERROR
556	499	1532	50872	484841	TIMEOUT
393	776	1552	23983	TIMEOUT	ERROR
676	1921	1662	19864	TIMEOUT	ERROR
502	1878	1924	8447	87687	ERROR
500	1622	1990	24729	TIMEOUT	ERROR
766	218	2036	63388	TIMEOUT	ERROR
666	269	2346	84269	TIMEOUT	ERROR
515	870	2366	3007	15949	TIMEOUT
1	254	2476	TIMEOUT	62255	TIMEOUT
631	812	2653	5793	TIMEOUT	ERROR
657	1732	2654	37732	TIMEOUT	ERROR
770	2532	2666	14468	215300	TIMEOUT
476	1834	2713	17491	TIMEOUT	ERROR
695	7708	2842	12280	34220	ERROR
450	379	2872	4393	51822	TIMEOUT
595	219	2894	52580	TIMEOUT	ERROR
397	1494	2922	20156	TIMEOUT	ERROR
597	223	2933	60895	TIMEOUT	ERROR
438	1512	3024	165806	TIMEOUT	ERROR
665	299	3166	65469	TIMEOUT	ERROR
496	10238	3220	47562	114545	ERROR
544	5972	3271	32098	150655	ERROR
545	6276	3351	35080	212331	ERROR
353	221	3426	74778	TIMEOUT	ERROR
352	221	3447	61195	TIMEOUT	ERROR
412	919	3532	5551	56497	ERROR
452	3163	4116	14808	80137	ERROR
535	8479	4621	136824	TIMEOUT	ERROR
413	1085	4625	6268	49221	ERROR
419	1636	4806	254138	TIMEOUT	ERROR
485	2593	5291	50456	TIMEOUT	ERROR
420	1505	5297	62248	TIMEOUT	ERROR
759	2532	5317	20894	264104	ERROR
670	7079	5693	28838	88734	ERROR
768	2532	5752	38785	TIMEOUT	TIMEOUT
380	3141	6000	46662	TIMEOUT	ERROR
381	3216	6053	53776	TIMEOUT	ERROR
459	4019	6905	29786	TIMEOUT	ERROR
460	9023	10382	380608	TIMEOUT	ERROR
680	7414	11064	151175	TIMEOUT	ERROR
678	7558	11408	167266	TIMEOUT	ERROR
540	1744	13345	35451	TIMEOUT	ERROR
52	3764	25233	30085	83171	ERROR
368	6657	25628	122137	432786	ERROR
398	7419	27882	277361	TIMEOUT	ERROR
371	7464	27969	254680	TIMEOUT	ERROR
386	7559	28602	152322	TIMEOUT	ERROR
400	7999	30008	233238	TIMEOUT	ERROR
394	9163	31483	465225	TIMEOUT	ERROR
286	13961	32979	498850	TIMEOUT	TIMEOUT
536	6762	36439	227584	TIMEOUT	ERROR
369	10978	39919	354034	TIMEOUT	ERROR
415	7755	40108	123648	TIMEOUT	TIMEOUT
566	2505	49988	253286	391804	ERROR
370	12070	56379	384146	TIMEOUT	TIMEOUT
416	12272	56774	407818	TIMEOUT	TIMEOUT

2.3. Winning Algorithms

In the following, we show the ontologies on which an algorithm "wins" over another meaning that:

the slower algorithm requires more than 500ms to compute the saturation,
the faster algorithm requires 50% less time than the lowest.

2.3.1. ExbDR vs SkolemDR

Ontologies on which ExbDR wins over SkolemDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	SK_OUTPUT	Exb_OUTPUT	SK_TIME	Exb_TIME	TIME_FACTOR
389	100	200	632	548	548	257	111231	452	246.1
538	102	204	520	495	495	229	82540	420	196.5
539	104	208	724	556	564	287	118462	615	192.6
454	69	416	849	1227	12134	3343	355507	1859	191.2
555	134	1043	1073	3454	3691	1195	180779	1127	160.4
388	106	212	574	531	667	281	49081	361	136
638	124	278	1159	637	1050	352	38530	614	62.8
637	92	239	917	644	877	296	27856	502	55.5
446	209	1700	1149	6268	6593	1904	59801	1349	44.3
414	25	50	225	110	114	52	8377	201	41.7
763	124	385	891	998	1225	402	19280	605	31.9
582	184	647	1394	2134	2328	731	26943	1060	25.4
636	1652	940	19994	2962	3672	2229	126729	5482	23.1
449	225	2064	1362	6851	7370	2194	78026	3454	22.6
683	61	68	208	167	232	103	3241	193	16.8
770	2532	2666	20622	9823	10353	2756	215300	14468	14.9
759	2532	5317	21518	15858	16211	7561	264104	20894	12.6
450	379	2872	1996	10696	11595	3219	51822	4393	11.8
793	159	135	1036	564	1105	417	41532	3695	11.2
320	124	146	760	523	2899	1008	8531	770	11.1
512	458	800	3119	2967	4509	1631	72519	6932	10.5
502	1878	1924	8982	8538	8548	3297	87687	8447	10.4
412	919	3532	4146	12586	12586	3532	56497	5551	10.2
2	432	941	4769	3671	4978	1623	81075	8299	9.8
556	499	1532	5433	5529	7901	2582	484841	50872	9.5
681	116	57	436	122	122	108	1404	151	9.3
769	2532	2653	11795	9077	9077	2653	81094	9142	8.9
561	107	685	752	2336	3170	959	17672	2079	8.5
413	1085	4625	4954	15633	15633	4625	49221	6268	7.9
646	2532	2301	11446	7683	7683	2301	50487	6584	7.7
475	22	83	218	308	308	103	1642	233	7
173	120	98	940	356	488	127	3206	457	7
504	48	658	408	2088	2210	697	4076	597	6.8
543	9	18	81	40	40	18	804	118	6.8
172	108	190	859	655	1802	516	44718	6908	6.5
451	2257	2862	10088	9296	9296	2862	50892	7881	6.5
114	24	25	246	77	269	99	1944	302	6.4
542	9	18	90	39	39	18	785	122	6.4
348	20	159	151	462	655	241	1710	269	6.4
545	6276	3351	27993	10414	10414	3351	212331	35080	6.1
645	2091	1594	9189	5442	5442	1594	29305	4883	6
773	55	590	480	2175	2532	849	24418	4448	5.5
546	1952	775	9004	2914	2914	775	14124	2602	5.4
452	3163	4116	15470	14167	14167	4221	80137	14808	5.4
784	65	997	517	4675	4854	1101	16718	3110	5.4
515	870	2366	4183	8933	8979	2443	15949	3007	5.3
78	43	715	173	2431	3612	1056	3061	611	5
667	1181	506	5374	1870	1870	506	9485	1910	5
430	359	178	2324	369	369	208	2160	440	4.9
360	1059	1616	4740	5905	5905	1616	8961	1833	4.9
649	663	284	2831	1341	1341	284	4477	935	4.8
82	200	263	782	999	1006	274	2676	560	4.8
544	5972	3271	26666	11861	11861	3271	150655	32098	4.7
49	15	51	103	182	226	72	1501	329	4.6
110	177	244	666	924	929	254	2215	486	4.6
423	619	714	2687	2329	2329	714	3600	800	4.5
411	250	1199	1125	4169	4169	1199	6128	1380	4.4
358	101	267	456	943	943	267	2431	568	4.3
600	177	1983	727	4609	4609	1983	2033	497	4.1
465	282	132	2137	418	418	132	1700	434	3.9
547	1952	780	8815	2931	2931	780	12396	3284	3.8
25	68	997	515	4154	4298	1092	9399	2532	3.7
432	238	137	1036	451	451	137	1460	396	3.7
690	1291	975	5671	3330	3330	975	7073	1974	3.6
689	1054	451	5110	1548	1548	451	4387	1237	3.5
368	6657	25628	38484	89186	89186	26705	432786	122137	3.5
594	177	1984	563	4795	4795	1984	1663	474	3.5
356	1719	1901	7791	7377	7377	1901	5126	1498	3.4
433	242	137	1025	428	428	137	1307	401	3.3
694	6207	1624	22928	5295	5295	1624	20792	6395	3.3
526	193	280	837	945	951	289	1762	552	3.2
548	93	4361	405	15922	15922	4361	2862	897	3.2
596	181	2022	1038	5283	5283	2022	1929	615	3.1
589	112	939	513	3332	3332	939	1174	381	3.1
670	7079	5693	31621	19267	19267	5693	88734	28838	3.1
521	7276	3640	32866	3642	3642	3640	7172	2348	3.1
445	120	1222	510	3924	3924	1222	1464	483	3
357	1794	1981	8217	7024	7024	1981	6211	2051	3
627	572	2221	2532	7494	7510	2233	7629	2538	3
469	53	878	230	2919	2919	878	836	283	3
513	38	309	188	1135	1135	309	975	331	2.9
673	115	1929	514	6560	6560	1929	1365	465	2.9
640	408	394	1761	1232	1232	394	1096	376	2.9
592	106	3414	495	12694	12694	3414	3691	1292	2.9
6	1075	165	5027	639	639	165	749	263	2.8
593	192	2049	762	6893	6893	2049	1438	510	2.8
402	1627	2230	7217	8216	8216	2230	4167	1482	2.8
669	3530	4880	15673	12965	12965	4880	11431	4069	2.8
695	7708	2842	37238	10036	10036	2842	34220	12280	2.8
52	3764	25233	17243	87590	87590	25233	83171	30085	2.8
457	80	1604	379	5692	5692	1604	1898	699	2.7
498	8316	23	36903	23	23	23	3301	1242	2.7
366	40	96	189	319	333	103	607	231	2.6
530	3	10609	15	35885	35885	10609	2508	966	2.6
571	39	1357	169	4804	4804	1357	993	387	2.6
497	8316	23	37058	23	23	23	3352	1311	2.6
403	2479	3894	11133	13907	13907	3894	8164	3221	2.5
591	69	2529	245	8501	8501	2529	1490	591	2.5
531	7	11839	27	38335	38335	11839	2634	1063	2.5
605	84	650	360	2237	2237	650	1377	563	2.4
562	57	710	261	2366	2366	710	711	292	2.4
496	10238	3220	49015	11781	11781	3219	114545	47562	2.4
563	75	983	307	3569	3569	983	935	391	2.4
639	353	254	1581	786	786	254	845	355	2.4
81	93	679	503	1610	1610	717	678	297	2.3
522	4233	169	19352	719	719	169	2716	1193	2.3
118	19	89	198	312	393	128	1217	536	2.3
508	50	267	423	1030	1132	337	1623	717	2.3
736	7	48	68	199	208	57	510	226	2.3
523	4233	169	18924	537	537	169	2539	1132	2.2
435	1	9081	2	26232	26232	9081	1885	862	2.2
176	30	70	164	239	314	109	512	240	2.1
514	38	309	161	1150	1150	309	662	313	2.1
570	38	1102	155	3634	3634	1102	655	311	2.1
359	515	181	2189	537	537	181	625	300	2.1

Ontologies on which SkolemDR wins over ExbDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	SK_OUTPUT	Exb_OUTPUT	SK_TIME	Exb_TIME	TIME_FACTOR
789	13	2342	125	7978	8022	2357	2857	591823	207.1
772	6	653	59	2294	2297	656	2409	57109	23.7
151	48	263	261	907	967	324	3955	46116	11.7
590	16	605	108	1990	2026	632	3801	31181	8.2
15	13	353	110	1497	1577	376	2543	15270	6
281	13	353	117	1513	1596	400	3109	8763	2.8

2.3.2. ExbDR vs HyperDR

Ontologies on which ExbDR wins over HyperDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	HYPER_OUTPUT	Exb_OUTPUT	HYPER_TIME	Exb_TIME	TIME_FACTOR
637	92	239	917	644	877	296	165724	502	330.1
25	68	997	515	4154	4308	1092	557754	2532	220.3
793	159	135	1036	564	1105	417	468002	3695	126.7
414	25	50	225	110	114	52	7385	201	36.7
388	106	212	574	531	667	281	12100	361	33.5
638	124	278	1159	637	1050	352	20449	614	33.3
389	100	200	632	548	548	257	13367	452	29.6
348	20	159	151	462	655	241	6832	269	25.4
451	2257	2862	10088	9296	9296	2862	198302	7881	25.2
454	69	416	849	1227	12134	3343	45834	1859	24.7
555	134	1043	1073	3454	3691	1195	25574	1127	22.7
679	260	472	1074	1073	3905	1317	47360	2179	21.7
582	184	647	1394	2134	2328	731	20806	1060	19.6
538	102	204	520	495	495	229	7727	420	18.4
372	557	1078	2592	2890	3536	1392	40541	2242	18.1
349	8	98	45	217	253	118	2971	190	15.6
114	24	25	246	77	269	99	4692	302	15.5
423	619	714	2687	2329	2329	714	11125	800	13.9
690	1291	975	5671	3330	3330	975	25915	1974	13.1
632	500	1895	3523	6369	7313	2407	60571	4772	12.7
736	7	48	68	199	208	57	2799	226	12.4
445	120	1222	510	3924	3924	1222	5935	483	12.3
626	683	2108	4523	7321	8375	2460	65210	5326	12.2
640	408	394	1761	1232	1232	394	4555	376	12.1
360	1059	1616	4740	5905	5905	1616	22100	1833	12.1
320	124	146	760	523	2899	1008	8961	770	11.6
82	200	263	782	999	1006	274	6428	560	11.5
446	209	1700	1149	6268	6597	1904	15218	1349	11.3
592	106	3414	495	12694	12694	3414	13764	1292	10.7
561	107	685	752	2336	3170	959	22132	2079	10.6
526	193	280	837	945	951	289	5746	552	10.4
669	3530	4880	15673	12965	12965	4880	41811	4069	10.3
424	786	1507	4662	4954	7399	2119	75809	7602	10
543	9	18	81	40	40	18	1142	118	9.7
763	124	385	891	998	1225	402	5768	605	9.5
645	2091	1594	9189	5442	5442	1594	44851	4883	9.2
411	250	1199	1125	4169	4169	1199	12471	1380	9
546	1952	775	9004	2914	2914	775	22225	2602	8.5
173	120	98	940	356	488	127	3855	457	8.4
681	116	57	436	122	122	108	1266	151	8.4
600	177	1983	727	4609	4609	1983	4099	497	8.2
596	181	2022	1038	5283	5283	2022	5072	615	8.2
542	9	18	90	39	39	18	987	122	8.1
512	458	800	3119	2967	4509	1631	55842	6932	8.1
81	93	679	503	1610	1610	717	2369	297	8
6	1075	165	5027	639	639	165	2097	263	8
649	663	284	2831	1341	1341	284	7436	935	8
167	12	451	56	1635	1638	460	2408	303	7.9
504	48	658	408	2088	2210	697	4692	597	7.9
281	13	353	117	1513	1596	400	68710	8763	7.8
769	2532	2653	11795	9077	9077	2653	70661	9142	7.7
627	572	2221	2532	7494	7510	2233	19394	2538	7.6
110	177	244	666	924	929	254	3684	486	7.6
49	15	51	103	182	226	72	2469	329	7.5
402	1627	2230	7217	8216	8216	2230	11080	1482	7.5
403	2479	3894	11133	13907	13907	3894	23962	3221	7.4
430	359	178	2324	369	369	208	3217	440	7.3
356	1719	1901	7791	7377	7377	1901	10941	1498	7.3
591	69	2529	245	8501	8501	2529	4269	591	7.2
594	177	1984	563	4795	4795	1984	3391	474	7.2
689	1054	451	5110	1548	1548	451	8789	1237	7.1
694	6207	1624	22928	5295	5295	1624	45087	6395	7.1
683	61	68	208	167	232	103	1339	193	6.9
646	2532	2301	11446	7683	7683	2301	45640	6584	6.9
569	966	1750	4864	5711	8843	2455	59134	8610	6.9
508	50	267	423	1030	1132	337	4885	717	6.8
358	101	267	456	943	943	267	3766	568	6.6
514	38	309	161	1150	1150	309	2050	313	6.5
593	192	2049	762	6893	6893	2049	3310	510	6.5
347	8	98	79	223	239	110	1028	160	6.4
78	43	715	173	2431	3612	1056	3892	611	6.4
465	282	132	2137	418	418	132	2744	434	6.3
520	76	91	375	256	256	91	725	116	6.2
717	5	43	53	200	204	49	1268	208	6.1
366	40	96	189	319	333	103	1380	231	6
589	112	939	513	3332	3332	939	2261	381	5.9
521	7276	3640	32866	3642	3642	3640	13801	2348	5.9
432	238	137	1036	451	451	137	2309	396	5.8
169	22	168	125	478	478	183	1097	190	5.8
118	19	89	198	312	393	128	3089	536	5.8
357	1794	1981	8217	7024	7024	1981	11407	2051	5.6
639	353	254	1581	786	786	254	1891	355	5.3
563	75	983	307	3569	3569	983	2062	391	5.3
55	23	212	201	760	770	227	1188	226	5.3
667	1181	506	5374	1870	1870	506	9943	1910	5.2
513	38	309	188	1135	1135	309	1721	331	5.2
279	26	168	121	425	425	176	960	185	5.2
673	115	1929	514	6560	6560	1929	2401	465	5.2
332	9	228	39	534	541	237	837	166	5
547	1952	780	8815	2931	2931	780	16193	3284	4.9
469	53	878	230	2919	2919	878	1370	283	4.8
296	16	66	73	180	180	71	870	181	4.8
116	11	31	92	95	141	49	772	163	4.7
562	57	710	261	2366	2366	710	1378	292	4.7
171	12	61	53	228	231	67	785	172	4.6
457	80	1604	379	5692	5692	1604	3168	699	4.5
570	38	1102	155	3634	3634	1102	1388	311	4.5
548	93	4361	405	15922	15922	4361	3994	897	4.5
605	84	650	360	2237	2237	650	2474	563	4.4
176	30	70	164	239	314	109	1020	240	4.2
433	242	137	1025	428	428	137	1697	401	4.2
359	515	181	2189	537	537	181	1236	300	4.1
290	7	149	52	460	460	139	666	163	4.1
730	3	42	34	168	169	46	600	148	4.1
571	39	1357	169	4804	4804	1357	1551	387	4
449	225	2064	1362	6851	7370	2194	13736	3454	4
7	22	168	119	501	501	181	693	179	3.9
120	10	53	75	100	113	75	676	179	3.8
112	20	115	96	296	320	137	694	188	3.7
12	13	279	79	859	859	286	646	180	3.6
153	24	186	136	658	658	194	541	163	3.3
725	5	44	37	196	202	51	599	181	3.3
522	4233	169	19352	719	719	169	3948	1193	3.3
94	17	138	68	382	396	161	503	157	3.2
23	13	440	142	1850	1937	458	17781	5674	3.1
468	5	720	30	2385	2385	720	589	190	3.1
550	3	853	14	2990	2990	853	573	185	3.1
523	4233	169	18924	537	537	169	3227	1132	2.9
531	7	11839	27	38335	38335	11839	3016	1063	2.8
498	8316	23	36903	23	23	23	3512	1242	2.8
530	3	10609	15	35885	35885	10609	2571	966	2.7
576	26	66	265	198	244	113	1571	609	2.6
497	8316	23	37058	23	23	23	3334	1311	2.5
435	1	9081	2	26232	26232	9081	1766	862	2

Ontologies on which HyperDR wins over ExbDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	HYPER_OUTPUT	Exb_OUTPUT	HYPER_TIME	Exb_TIME	TIME_FACTOR
772	6	653	59	2294	2297	656	4245	57109	13.5
789	13	2342	125	7978	8022	2357	52466	591823	11.3
151	48	263	261	907	967	324	7122	46116	6.5

2.3.3. SkolemDR vs HyperDR

Ontologies on which SkolemDR wins over HyperDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	SK_OUTPUT	HYPER_OUTPUT	SK_TIME	HYPER_TIME	TIME_FACTOR
25	68	997	515	4154	4298	4308	9399	557754	59.3
281	13	353	117	1513	1596	1596	3109	68710	22.1
729	54	94	554	419	492	492	12360	269262	21.8
789	13	2342	125	7978	8022	8022	2857	52466	18.4
788	13	2289	117	7690	7712	7712	3300	42187	12.8
793	159	135	1036	564	1105	1105	41532	468002	11.3
349	8	98	45	217	240	253	293	2971	10.1
790	10	2550	86	8635	8664	8664	2852	21003	7.4
637	92	239	917	644	877	877	27856	165724	5.9
736	7	48	68	199	208	208	510	2799	5.5
590	16	605	108	1990	2026	2026	3801	18365	4.8
23	13	440	142	1850	1937	1937	3691	17781	4.8
167	12	451	56	1635	1638	1638	569	2408	4.2
640	408	394	1761	1232	1232	1232	1096	4555	4.2
445	120	1222	510	3924	3924	3924	1464	5935	4.1
348	20	159	151	462	655	655	1710	6832	4
451	2257	2862	10088	9296	9296	9296	50892	198302	3.9
592	106	3414	495	12694	12694	12694	3691	13764	3.7
690	1291	975	5671	3330	3330	3330	7073	25915	3.7
669	3530	4880	15673	12965	12965	12965	11431	41811	3.7
520	76	91	375	256	256	256	201	725	3.6
81	93	679	503	1610	1610	1610	678	2369	3.5
169	22	168	125	478	478	478	325	1097	3.4
526	193	280	837	945	951	951	1762	5746	3.3
514	38	309	161	1150	1150	1150	662	2050	3.1
423	619	714	2687	2329	2329	2329	3600	11125	3.1
15	13	353	110	1497	1577	1577	2543	7849	3.1
343	4	97	18	354	355	355	545	1656	3
508	50	267	423	1030	1132	1132	1623	4885	3
403	2479	3894	11133	13907	13907	13907	8164	23962	2.9
332	9	228	39	534	539	541	290	837	2.9
591	69	2529	245	8501	8501	8501	1490	4269	2.9
6	1075	165	5027	639	639	639	749	2097	2.8
717	5	43	53	200	204	204	463	1268	2.7
296	16	66	73	180	180	180	324	870	2.7
279	26	168	121	425	425	425	358	960	2.7
402	1627	2230	7217	8216	8216	8216	4167	11080	2.7
120	10	53	75	100	108	113	256	676	2.6
596	181	2022	1038	5283	5283	5283	1929	5072	2.6
347	8	98	79	223	239	239	403	1028	2.6
627	572	2221	2532	7494	7510	7510	7629	19394	2.5
118	19	89	198	312	393	393	1217	3089	2.5
360	1059	1616	4740	5905	5905	5905	8961	22100	2.5
55	23	212	201	760	770	770	487	1188	2.4
114	24	25	246	77	269	269	1944	4692	2.4
82	200	263	782	999	1006	1006	2676	6428	2.4
171	12	61	53	228	231	231	336	785	2.3
116	11	31	92	95	141	141	333	772	2.3
7	22	168	119	501	501	501	300	693	2.3
593	192	2049	762	6893	6893	6893	1438	3310	2.3
366	40	96	189	319	333	333	607	1380	2.3
639	353	254	1581	786	786	786	845	1891	2.2
563	75	983	307	3569	3569	3569	935	2062	2.2
694	6207	1624	22928	5295	5295	5295	20792	45087	2.2
356	1719	1901	7791	7377	7377	7377	5126	10941	2.1
94	17	138	68	382	396	396	236	503	2.1
570	38	1102	155	3634	3634	3634	655	1388	2.1
560	9	130	46	462	475	475	448	942	2.1
576	26	66	265	198	222	244	755	1571	2.1
725	5	44	37	196	202	202	288	599	2.1
12	13	279	79	859	859	859	314	646	2.1
594	177	1984	563	4795	4795	4795	1663	3391	2
411	250	1199	1125	4169	4169	4169	6128	12471	2
600	177	1983	727	4609	4609	4609	2033	4099	2
689	1054	451	5110	1548	1548	1548	4387	8789	2

Ontologies on which HyperDR wins over SkolemDR:

NAME	NFTGD	FTGD	SK_NFTGD	SK_FTGD	SK_OUTPUT	HYPER_OUTPUT	SK_TIME	HYPER_TIME	TIME_FACTOR
538	102	204	520	495	495	495	82540	7727	10.7
389	100	200	632	548	548	548	111231	13367	8.3
454	69	416	849	1227	12134	12134	355507	45834	7.8
555	134	1043	1073	3454	3691	3691	180779	25574	7.1
731	148	173	1284	668	848	848	243061	40969	5.9
449	225	2064	1362	6851	7370	7370	78026	13736	5.7
388	106	212	574	531	667	667	49081	12100	4.1
446	209	1700	1149	6268	6593	6597	59801	15218	3.9
763	124	385	891	998	1225	1225	19280	5768	3.3
683	61	68	208	167	232	232	3241	1339	2.4

2.3.4. Winning case summary

A table showing the number of ontologies on which the algorithm on the row is winning against the column algorithm by a factor 2:

	Exb	SK	HYPER
Exb	nan	171	199
SK	28	nan	103
HYPER	9	16	nan

The same with a factor 5:

	Exb	SK	HYPER
Exb	nan	92	151
SK	18	nan	36
HYPER	7	12	nan

The same with a factor 10 (one order of magnitude). This table is in the article:

	Exb	SK	HYPER
Exb	nan	61	87
SK	11	nan	21
HYPER	6	4	nan

The number of ontologies on which HyperDR wins with an order of magnitude against another algorithm (except SimpleDR):

The same with a factor 100 (two orders of magnitude):

	Exb	SK	HYPER
Exb	nan	23	25
SK	4	nan	2
HYPER	1	0	nan

The number of ontologies on which ExbDR loses with two orders of magnitude against another algorithm:

Times corresponding to the table with a factor 10

2.4. Times vs input size

2.4.1. ExbDR

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs

2.4.2. SkolemDR

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs (full and non-full after skolemization)

2.4.3. HyperDR

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs (full and non-full after skolemization)

2.4.4. Comparison

Scatter plot of the time in ms in function of the size of the input i.e. number of TGDs (full and non-full for ExbDR)

<AxesSubplot:xlabel='INPUT', ylabel='TIME'>

2.5. Output Analysis

2.5.1. Output size comparison

Below we compare the number of the outputted full Datalog rules of the different algorithm, we remove from this number of Datalog rules in the input without transformation.

Between ExbDR and SkolemDR

Cases where ExbDR output is larger than the one of SkolemDR

NAME

NFTGD

FTGD

Exb_NEW_OUTPUT

SK_NEW_OUTPUT

SIZE_FACTOR

Exb_TIME

SK_TIME

Cases where SkolemDR output is larger than the one of ExbDR

NAME	NFTGD	FTGD	SK_NEW_OUTPUT	Exb_NEW_OUTPUT	SIZE_FACTOR	SK_TIME	Exb_TIME
370	12070	56379	140351	0	inf	TIMEOUT	384146
369	10978	41811	101505	0	inf	TIMEOUT	354034
368	6657	26705	62481	0	inf	432786	122137
52	3764	25233	62357	0	inf	83171	30085
531	7	11839	26496	0	inf	2634	1063
530	3	10609	25276	0	inf	2508	966
435	1	9081	17151	0	inf	1885	862
670	7079	5693	13574	0	inf	88734	28838
548	93	4361	11561	0	inf	2862	897
413	1085	4625	11008	0	inf	49221	6268
403	2479	3894	10013	0	inf	8164	3221
452	3163	4221	9946	0	inf	80137	14808
592	106	3414	9280	0	inf	3691	1292
412	919	3532	9054	0	inf	56497	5551
544	5972	3271	8590	0	inf	150655	32098
496	10238	3219	8562	0	inf	114545	47562
669	3530	4880	8085	0	inf	11431	4069
695	7708	2842	7194	0	inf	34220	12280
545	6276	3351	7063	0	inf	212331	35080
451	2257	2862	6434	0	inf	50892	7881
769	2532	2653	6424	0	inf	81094	9142
402	1627	2230	5986	0	inf	4167	1482
591	69	2529	5972	0	inf	1490	591
356	1719	1901	5476	0	inf	5126	1498
646	2532	2301	5382	0	inf	50487	6584
357	1794	1981	5043	0	inf	6211	2051
593	192	2049	4844	0	inf	1438	510
673	115	1929	4631	0	inf	1365	465
360	1059	1616	4289	0	inf	8961	1833
457	80	1604	4088	0	inf	1898	699
645	2091	1594	3848	0	inf	29305	4883
694	6207	1624	3671	0	inf	20792	6395
571	39	1357	3447	0	inf	993	387
596	181	2022	3261	0	inf	1929	615
411	250	1199	2970	0	inf	6128	1380
594	177	1984	2811	0	inf	1663	474
445	120	1222	2702	0	inf	1464	483
600	177	1983	2626	0	inf	2033	497
563	75	983	2586	0	inf	935	391
570	38	1102	2532	0	inf	655	311
589	112	939	2393	0	inf	1174	381
690	1291	975	2355	0	inf	7073	1974
547	1952	780	2151	0	inf	12396	3284
546	1952	775	2139	0	inf	14124	2602
550	3	853	2137	0	inf	407	185
469	53	878	2041	0	inf	836	283
293	16	2086	1835	0	inf	617	365
468	5	720	1665	0	inf	400	190
562	57	710	1656	0	inf	711	292
423	619	714	1615	0	inf	3600	800
605	84	650	1587	0	inf	1377	563
667	1181	506	1364	0	inf	9485	1910
689	1054	451	1097	0	inf	4387	1237
649	663	284	1057	0	inf	4477	935
81	93	717	893	0	inf	678	297
514	38	309	841	0	inf	662	313
640	408	394	838	0	inf	1096	376
513	38	309	826	0	inf	975	331
534	315	811	771	0	inf	TIMEOUT	2207
358	101	267	676	0	inf	2431	568
581	5	316	642	0	inf	199	156
580	8	272	629	0	inf	223	132
12	13	286	573	0	inf	314	180
522	4233	169	550	0	inf	2716	1193
648	4	232	548	0	inf	182	121
639	353	254	532	0	inf	845	355
6	1075	165	474	0	inf	749	263
153	24	194	464	0	inf	486	163
417	176	516	418	0	inf	TIMEOUT	1641
523	4233	169	368	0	inf	2539	1132
359	515	181	356	0	inf	625	300
290	7	139	321	0	inf	343	163
7	22	181	320	0	inf	300	179
432	238	137	314	0	inf	1460	396
169	22	183	295	0	inf	325	190
389	100	257	291	0	inf	111231	452
433	242	137	291	0	inf	1307	401
465	282	132	286	0	inf	1700	434
538	102	229	266	0	inf	82540	420
505	9	151	263	0	inf	140	106
279	26	176	249	0	inf	358	185
519	73	93	240	0	inf	196	124
301	3	131	214	0	inf	137	123
407	4	97	211	0	inf	173	118
475	22	103	205	0	inf	1642	233
406	2	92	192	0	inf	142	108
474	16	72	174	0	inf	284	146
170	9	122	168	0	inf	169	164
520	76	91	165	0	inf	201	116
430	359	208	161	0	inf	2160	440
63	12	67	118	0	inf	182	130
296	16	71	109	0	inf	324	181
60	9	76	100	0	inf	197	142
62	11	76	100	0	inf	145	110
404	2	45	92	0	inf	100	107
405	4	49	85	0	inf	141	121
68	2	33	83	0	inf	94	82
72	1	31	60	0	inf	92	101
316	1	42	57	0	inf	99	98
66	1	21	50	0	inf	89	97
79	2	31	50	0	inf	98	93
236	6	23	48	0	inf	160	110
229	2	37	45	0	inf	108	109
222	5	51	43	0	inf	147	105
65	3	14	31	0	inf	188	107
71	1	15	28	0	inf	88	89
59	5	47	26	0	inf	111	99
215	7	13	24	0	inf	121	98
57	3	11	23	0	inf	118	109
543	9	18	22	0	inf	804	118
542	9	18	21	0	inf	785	122
69	1	8	16	0	inf	84	94
214	11	25	16	0	inf	150	111
235	6	21	16	0	inf	129	120
681	116	108	14	0	inf	1404	151
58	3	7	12	0	inf	99	95
113	12	24	9	0	inf	98	93
209	18	35	9	0	inf	154	105
210	6	22	8	0	inf	121	118
233	1	3	8	0	inf	88	88
242	5	19	8	0	inf	98	91
224	2	7	6	0	inf	112	91
220	2	5	4	0	inf	86	91
527	502	4	3	0	inf	352	148
221	1	16	2	0	inf	87	93
521	7276	3640	2	0	inf	7172	2348
416	12269	58718	136864	31	4415	TIMEOUT	407818
415	7752	40159	95583	28	3413.7	TIMEOUT	123648
502	1878	3295	5253	2	2626.5	87687	8447
386	7559	30770	68301	37	1846	TIMEOUT	152322
167	12	459	1179	1	1179	569	303
110	177	253	676	1	676	2215	486
536	6762	38687	86028	134	642	TIMEOUT	227584
789	13	2348	5674	9	630.4	2857	591823
772	6	653	1644	3	548	2409	57109
627	572	2221	5289	12	440.8	7629	2538
82	200	272	734	2	367	2676	560
418	202	594	679	2	339.5	TIMEOUT	2219
526	193	287	664	2	332	1762	552
566	2505	50063	121769	367	331.8	391804	253286
75	2	127	312	1	312	147	106
339	4	95	165	1	165	154	117
515	870	2397	6582	46	143.1	15949	3007
398	7419	32165	68226	513	133	TIMEOUT	277361
371	7464	29183	68086	636	107.1	TIMEOUT	254680
485	2593	5540	15758	160	98.5	TIMEOUT	50456
759	2532	7472	8739	89	98.2	264104	20894
400	7999	32252	77927	805	96.8	TIMEOUT	233238
770	2532	2667	7686	89	86.4	215300	14468
106	4	45	85	1	85	200	109
171	12	65	166	2	83	336	172
55	23	220	550	7	78.6	487	226
590	16	614	1412	18	78.4	3801	31181
73	6	79	78	1	78	131	130
241	1	29	72	1	72	118	105
539	104	283	281	4	70.2	118462	615
730	3	44	125	2	62.5	339	148
23	13	432	1505	26	57.9	3691	5674
446	164	1814	4779	90	53.1	59801	1349
332	9	231	308	6	51.3	290	166
736	7	54	154	3	51.3	510	226
504	48	662	1548	35	44.2	4076	597
15	13	348	1229	28	43.9	2543	15270
784	65	1011	3843	90	42.7	16718	3110
25	68	1013	3285	79	41.6	9399	2532
394	9071	35537	77706	1956	39.7	TIMEOUT	465225
725	5	47	155	4	38.8	288	181
540	1654	14473	32195	848	38	TIMEOUT	35451
459	4013	6928	17288	458	37.7	TIMEOUT	29786
449	207	2045	5325	149	35.7	78026	3454
555	133	1122	2569	73	35.2	180779	1127
22	13	426	1388	40	34.7	2701	4635
560	9	130	345	10	34.5	448	527
366	40	96	237	7	33.9	607	231
333	5	67	66	2	33	226	126
582	154	680	1648	51	32.3	26943	1060
717	5	44	160	5	32	463	208
414	25	50	64	2	32	8377	201
380	3141	6811	8144	302	27	TIMEOUT	46662
281	13	350	1246	50	24.9	3109	8763
450	341	2856	8739	363	24.1	51822	4393
94	17	150	246	11	22.4	236	157
626	500	2188	5796	272	21.3	TIMEOUT	5326
508	50	296	836	41	20.4	1623	717
238	5	15	20	1	20	197	125
151	48	285	682	39	17.5	3955	46116
460	9023	15836	27409	1599	17.1	TIMEOUT	380608
632	500	2112	4805	295	16.3	TIMEOUT	4772
112	20	125	195	12	16.2	349	188
381	3216	8271	8622	534	16.1	TIMEOUT	53776
631	572	2558	5388	358	15.1	TIMEOUT	5793
763	124	341	884	61	14.5	19280	605
173	120	98	390	29	13.4	3206	457
388	106	249	418	32	13.1	49081	361
347	8	99	140	11	12.7	403	160
399	512	1363	1495	122	12.3	TIMEOUT	2084
420	1480	5349	11681	980	11.9	TIMEOUT	62248
218	6	11	11	1	11	159	106
637	92	236	641	60	10.7	27856	502
373	668	1641	2008	189	10.6	TIMEOUT	2884
49	15	56	170	16	10.6	1501	329
286	13961	38228	86251	8368	10.3	TIMEOUT	498850
341	2	33	30	3	10	91	111
657	1642	3791	8074	839	9.6	TIMEOUT	37732
561	107	701	2469	258	9.6	17672	2079
372	557	1216	1674	176	9.5	TIMEOUT	2242
118	19	96	297	32	9.3	1217	536
78	43	726	2886	330	8.7	3061	611
683	61	86	146	17	8.6	3241	193
768	2532	7494	15121	1830	8.3	TIMEOUT	38785
176	30	81	233	28	8.3	512	240
773	55	608	1924	241	8	24418	4448
2	432	1123	3855	500	7.7	81075	8299
349	8	98	142	20	7.1	293	190
116	11	34	107	15	7.1	333	163
638	124	233	817	119	6.9	38530	614
556	499	1662	6239	920	6.8	484841	50872
348	20	166	489	75	6.5	1710	269
172	108	252	1550	264	5.9	44718	6908
569	915	1714	3997	741	5.4	TIMEOUT	8610
424	728	1463	3491	656	5.3	TIMEOUT	7602
512	458	951	3558	680	5.2	72519	6932
114	24	43	226	56	4	1944	302
454	69	347	11787	2996	3.9	355507	1859
793	159	175	930	242	3.8	41532	3695
120	10	62	46	13	3.5	256	179
320	124	209	2690	799	3.4	8531	770
576	26	67	155	46	3.4	755	609
636	1652	1573	2099	656	3.2	126729	5482
164	3	32	3	1	3	85	106
396	597	1163	1629	619	2.6	TIMEOUT	3657
401	423	1056	1141	470	2.4	TIMEOUT	1903
384	732	889	1336	648	2.1	TIMEOUT	2203
685	394	786	923	443	2.1	TIMEOUT	6251
419	1496	4638	11178	5485	2	TIMEOUT	254138

Between ExbDR and HyperDR

Cases where ExbDR output is larger

NAME

NFTGD

FTGD

Exb_NEW_OUTPUT

HYPER_NEW_OUTPUT

SIZE_FACTOR

Exb_TIME

HYPER_TIME

Cases where HyperDR output is larger

NAME	NFTGD	FTGD	HYPER_NEW_OUTPUT	Exb_NEW_OUTPUT	SIZE_FACTOR	HYPER_TIME	Exb_TIME
370	12070	56379	140351	0	inf	TIMEOUT	384146
531	7	11839	26496	0	inf	3016	1063
530	3	10609	25276	0	inf	2571	966
435	1	9081	17151	0	inf	1766	862
548	93	4361	11561	0	inf	3994	897
403	2479	3894	10013	0	inf	23962	3221
592	106	3414	9280	0	inf	13764	1292
669	3530	4880	8085	0	inf	41811	4069
451	2257	2862	6434	0	inf	198302	7881
769	2532	2653	6424	0	inf	70661	9142
402	1627	2230	5986	0	inf	11080	1482
591	69	2529	5972	0	inf	4269	591
356	1719	1901	5476	0	inf	10941	1498
646	2532	2301	5382	0	inf	45640	6584
357	1794	1981	5043	0	inf	11407	2051
593	192	2049	4844	0	inf	3310	510
673	115	1929	4631	0	inf	2401	465
360	1059	1616	4289	0	inf	22100	1833
457	80	1604	4088	0	inf	3168	699
645	2091	1594	3848	0	inf	44851	4883
694	6207	1624	3671	0	inf	45087	6395
571	39	1357	3447	0	inf	1551	387
596	181	2022	3261	0	inf	5072	615
411	250	1199	2970	0	inf	12471	1380
594	177	1984	2811	0	inf	3391	474
445	120	1222	2702	0	inf	5935	483
600	177	1983	2626	0	inf	4099	497
563	75	983	2586	0	inf	2062	391
570	38	1102	2532	0	inf	1388	311
589	112	939	2393	0	inf	2261	381
690	1291	975	2355	0	inf	25915	1974
547	1952	780	2151	0	inf	16193	3284
546	1952	775	2139	0	inf	22225	2602
550	3	853	2137	0	inf	573	185
469	53	878	2041	0	inf	1370	283
293	16	2086	1835	0	inf	715	365
468	5	720	1665	0	inf	589	190
562	57	710	1656	0	inf	1378	292
423	619	714	1615	0	inf	11125	800
605	84	650	1587	0	inf	2474	563
667	1181	506	1364	0	inf	9943	1910
689	1054	451	1097	0	inf	8789	1237
649	663	284	1057	0	inf	7436	935
81	93	717	893	0	inf	2369	297
514	38	309	841	0	inf	2050	313
640	408	394	838	0	inf	4555	376
513	38	309	826	0	inf	1721	331
358	101	267	676	0	inf	3766	568
581	5	316	642	0	inf	244	156
580	8	272	629	0	inf	254	132
12	13	286	573	0	inf	646	180
522	4233	169	550	0	inf	3948	1193
648	4	232	548	0	inf	274	121
639	353	254	532	0	inf	1891	355
6	1075	165	474	0	inf	2097	263
153	24	194	464	0	inf	541	163
523	4233	169	368	0	inf	3227	1132
359	515	181	356	0	inf	1236	300
290	7	139	321	0	inf	666	163
7	22	181	320	0	inf	693	179
432	238	137	314	0	inf	2309	396
169	22	183	295	0	inf	1097	190
389	100	257	291	0	inf	13367	452
433	242	137	291	0	inf	1697	401
465	282	132	286	0	inf	2744	434
538	102	229	266	0	inf	7727	420
505	9	151	263	0	inf	157	106
279	26	176	249	0	inf	960	185
519	73	93	240	0	inf	294	124
301	3	131	214	0	inf	202	123
407	4	97	211	0	inf	197	118
475	22	103	205	0	inf	TIMEOUT	233
406	2	92	192	0	inf	173	108
474	16	72	174	0	inf	367	146
170	9	122	168	0	inf	240	164
520	76	91	165	0	inf	725	116
430	359	208	161	0	inf	3217	440
63	12	67	118	0	inf	412	130
296	16	71	109	0	inf	870	181
60	9	76	100	0	inf	439	142
62	11	76	100	0	inf	295	110
404	2	45	92	0	inf	106	107
405	4	49	85	0	inf	150	121
68	2	33	83	0	inf	85	82
72	1	31	60	0	inf	87	101
316	1	42	57	0	inf	90	98
66	1	21	50	0	inf	82	97
79	2	31	50	0	inf	146	93
236	6	23	48	0	inf	217	110
229	2	37	45	0	inf	132	109
222	5	51	43	0	inf	223	105
65	3	14	31	0	inf	265	107
71	1	15	28	0	inf	80	89
59	5	47	26	0	inf	152	99
215	7	13	24	0	inf	175	98
57	3	11	23	0	inf	156	109
543	9	18	22	0	inf	1142	118
542	9	18	21	0	inf	987	122
69	1	8	16	0	inf	110	94
214	11	25	16	0	inf	185	111
235	6	21	16	0	inf	175	120
681	116	108	14	0	inf	1266	151
58	3	7	12	0	inf	154	95
113	12	24	9	0	inf	111	93
209	18	35	9	0	inf	192	105
210	6	22	8	0	inf	136	118
233	1	3	8	0	inf	88	88
242	5	19	8	0	inf	122	91
224	2	7	6	0	inf	119	91
220	2	5	4	0	inf	86	91
527	502	4	3	0	inf	338	148
221	1	16	2	0	inf	87	93
521	7276	3640	2	0	inf	13801	2348
416	12269	58718	136874	31	4415.3	TIMEOUT	407818
415	7752	40159	95585	28	3413.8	TIMEOUT	123648
167	12	459	1179	1	1179	2408	303
110	177	253	676	1	676	3684	486
789	13	2348	5674	9	630.4	52466	591823
772	6	653	1644	3	548	4245	57109
627	572	2221	5289	12	440.8	19394	2538
82	200	272	734	2	367	6428	560
526	193	287	664	2	332	5746	552
75	2	127	312	1	312	159	106
339	4	95	165	1	165	269	117
515	870	2397	6557	46	142.5	TIMEOUT	3007
106	4	45	85	1	85	338	109
171	12	65	166	2	83	785	172
770	2532	2667	7230	89	81.2	TIMEOUT	14468
55	23	220	550	7	78.6	1188	226
590	16	614	1412	18	78.4	18365	31181
73	6	79	78	1	78	193	130
241	1	29	72	1	72	148	105
539	104	283	273	4	68.2	TIMEOUT	615
730	3	44	125	2	62.5	600	148
23	13	432	1505	26	57.9	17781	5674
446	164	1814	4783	90	53.1	15218	1349
332	9	231	310	6	51.7	837	166
736	7	54	154	3	51.3	2799	226
504	48	662	1548	35	44.2	4692	597
15	13	348	1229	28	43.9	7849	15270
784	65	1011	3795	90	42.2	TIMEOUT	3110
25	68	1013	3295	79	41.7	557754	2532
725	5	47	155	4	38.8	599	181
449	207	2045	5325	149	35.7	13736	3454
555	133	1122	2569	73	35.2	25574	1127
560	9	130	345	10	34.5	942	527
22	13	426	1372	40	34.3	TIMEOUT	4635
366	40	96	237	7	33.9	1380	231
333	5	67	66	2	33	296	126
582	154	680	1648	51	32.3	20806	1060
717	5	44	160	5	32	1268	208
414	25	50	64	2	32	7385	201
281	13	350	1246	50	24.9	68710	8763
450	341	2856	8599	363	23.7	TIMEOUT	4393
626	500	2188	6187	272	22.7	65210	5326
94	17	150	246	11	22.4	503	157
508	50	296	836	41	20.4	4885	717
238	5	15	20	1	20	246	125
632	500	2112	5201	295	17.6	60571	4772
151	48	285	682	39	17.5	7122	46116
112	20	125	195	12	16.2	694	188
763	124	341	884	61	14.5	5768	605
173	120	98	390	29	13.4	3855	457
372	557	1216	2320	176	13.2	40541	2242
388	106	249	418	32	13.1	12100	361
347	8	99	140	11	12.7	1028	160
218	6	11	11	1	11	159	106
637	92	236	641	60	10.7	165724	502
49	15	56	170	16	10.6	2469	329
286	13961	38228	83378	8368	10	TIMEOUT	498850
341	2	33	30	3	10	113	111
569	915	1714	7129	741	9.6	59134	8610
561	107	701	2469	258	9.6	22132	2079
118	19	96	297	32	9.3	3089	536
424	728	1463	5936	656	9	75809	7602
78	43	726	2886	330	8.7	3892	611
683	61	86	146	17	8.6	1339	193
176	30	81	233	28	8.3	1020	240
349	8	98	155	20	7.8	2971	190
116	11	34	107	15	7.1	772	163
638	124	233	817	119	6.9	20449	614
773	55	608	1635	241	6.8	TIMEOUT	4448
348	20	166	489	75	6.5	6832	269
768	2532	7494	10930	1830	6	TIMEOUT	38785
556	499	1662	5015	920	5.5	TIMEOUT	50872
512	458	951	3558	680	5.2	55842	6932
679	259	496	3409	821	4.2	47360	2179
172	108	252	1112	264	4.2	TIMEOUT	6908
114	24	43	226	56	4	4692	302
454	69	347	11787	2996	3.9	45834	1859
120	10	62	51	13	3.9	676	179
793	159	175	930	242	3.8	468002	3695
576	26	67	177	46	3.8	1571	609
320	124	209	2690	799	3.4	8961	770
164	3	32	3	1	3	86	106
636	1652	1573	1435	656	2.2	TIMEOUT	5482
422	420	727	1019	455	2.2	TIMEOUT	3496

2.6. All Statistics

All the statistics:

NAME	NFTGD	FTGD	Exb_OUTPUT	Exb_TIME	SK_NFTGD	SK_FTGD	SK_OUTPUT	SK_TIME	HYPER_OUTPUT	HYPER_TIME
1	254	2476	2678	TIMEOUT	2206	9466	9807	62255	9642	TIMEOUT
2	432	941	1623	8299	4769	3671	4978	81075	nan	ERROR
3	16709	2159	nan	ERROR	133458	9812	9812	TIMEOUT	nan	ERROR
4	16705	2107	nan	ERROR	175402	7275	7275	TIMEOUT	nan	ERROR
6	1075	165	165	263	5027	639	639	749	639	2097
7	22	168	181	179	119	501	501	300	501	693
12	13	279	286	180	79	859	859	314	859	646
13	76	1279	1297	TIMEOUT	643	5543	6038	181888	5639	TIMEOUT
14	139	1551	nan	ERROR	1308	7400	8691	TIMEOUT	nan	ERROR
15	13	353	376	15270	110	1497	1577	2543	1577	7849
16	65	1069	nan	ERROR	581	4525	5188	95796	4937	TIMEOUT
17	65	1191	1208	TIMEOUT	551	5559	6530	112559	5754	TIMEOUT
18	85	1145	1162	TIMEOUT	738	5046	5827	155274	nan	ERROR
19	68	1092	1104	TIMEOUT	635	5068	5704	247415	5180	TIMEOUT
20	83	1326	1353	TIMEOUT	831	5975	7210	TIMEOUT	6367	TIMEOUT
21	110	1206	1243	TIMEOUT	1025	5688	6933	TIMEOUT	6146	TIMEOUT
22	13	433	466	4635	135	1738	1814	2701	1798	TIMEOUT
23	13	440	458	5674	142	1850	1937	3691	1937	17781
24	139	1551	1591	TIMEOUT	1370	7039	8635	TIMEOUT	7383	TIMEOUT
25	68	997	1092	2532	515	4154	4298	9399	4308	557754
26	23858	30697	nan	ERROR	276503	121603	121623	TIMEOUT	nan	ERROR
27	23858	31647	nan	ERROR	267473	129941	129985	TIMEOUT	nan	ERROR
29	1776	4040	nan	ERROR	21566	17296	18425	TIMEOUT	nan	ERROR
30	2096	3626	nan	ERROR	26951	15044	16435	TIMEOUT	nan	ERROR
32	2096	4040	nan	ERROR	27415	17553	18807	TIMEOUT	nan	ERROR
33	12339	9462	nan	ERROR	124580	39279	39319	TIMEOUT	nan	ERROR
34	12339	9364	nan	ERROR	111699	37551	37551	TIMEOUT	nan	ERROR
36	12329	9456	12606	TIMEOUT	116576	38612	38632	TIMEOUT	nan	ERROR
37	12323	9445	13836	TIMEOUT	121765	41874	42133	TIMEOUT	nan	ERROR
38	12339	9457	15016	TIMEOUT	121481	43468	43479	TIMEOUT	nan	ERROR
39	2437	4936	nan	ERROR	30167	19855	20933	TIMEOUT	nan	ERROR
40	50790	103042	131215	TIMEOUT	432032	367636	367636	TIMEOUT	nan	ERROR
41	21197	68508	83961	TIMEOUT	100417	269227	269227	TIMEOUT	nan	ERROR
42	22295	72365	80983	TIMEOUT	101365	262243	262243	TIMEOUT	nan	ERROR
43	25490	116974	131296	TIMEOUT	192918	414043	414043	TIMEOUT	nan	ERROR
44	21197	68471	73543	TIMEOUT	120323	243279	243279	TIMEOUT	nan	ERROR
45	49531	100829	135013	TIMEOUT	374857	392489	392489	TIMEOUT	nan	ERROR
46	22297	70404	83371	TIMEOUT	128324	242701	242701	TIMEOUT	nan	ERROR
47	21309	68696	83460	TIMEOUT	128480	261853	261853	TIMEOUT	nan	ERROR
49	15	51	72	329	103	182	226	1501	226	2469
52	3764	25233	25233	30085	17243	87590	87590	83171	nan	ERROR
55	23	212	227	226	201	760	770	487	770	1188
57	3	11	11	109	14	34	34	118	34	156
58	3	7	7	95	13	19	19	99	19	154
59	5	47	47	99	23	73	73	111	73	152
60	9	72	76	142	60	176	176	197	176	439
62	11	72	76	110	53	176	176	145	176	295
63	12	61	67	130	55	185	185	182	185	412
65	3	12	14	107	18	45	45	188	45	265
66	1	20	21	97	2	71	71	89	71	82
68	2	33	33	82	2	116	116	94	116	85
69	1	8	8	94	5	24	24	84	24	110
71	1	14	15	89	3	43	43	88	43	80
72	1	31	31	101	4	91	91	92	91	87
73	6	77	80	130	30	152	157	131	157	193
75	2	125	128	106	10	434	439	147	439	159
78	43	715	1056	611	173	2431	3612	3061	3612	3892
79	2	29	31	93	14	81	81	98	81	146
81	93	679	717	297	503	1610	1610	678	1610	2369
82	200	263	274	560	782	999	1006	2676	1006	6428
94	17	138	161	157	68	382	396	236	396	503
106	4	43	46	109	26	128	130	200	130	338
110	177	244	254	486	666	924	929	2215	929	3684
112	20	115	137	188	96	296	320	349	320	694
113	12	24	24	93	30	33	33	98	33	111
114	24	25	99	302	246	77	269	1944	269	4692
116	11	31	49	163	92	95	141	333	141	772
118	19	89	128	536	198	312	393	1217	393	3089
120	10	53	75	179	75	100	108	256	113	676
151	48	263	324	46116	261	907	967	3955	967	7122
153	24	186	194	163	136	658	658	486	658	541
164	3	31	33	106	9	34	35	85	35	86
167	12	451	460	303	56	1635	1638	569	1638	2408
169	22	168	183	190	125	478	478	325	478	1097
170	9	120	122	164	43	290	290	169	290	240
171	12	61	67	172	53	228	231	336	231	785
172	108	190	516	6908	859	655	1802	44718	1364	TIMEOUT
173	120	98	127	457	940	356	488	3206	488	3855
174	1776	3626	nan	ERROR	19854	15114	16502	TIMEOUT	nan	ERROR
176	30	70	109	240	164	239	314	512	314	1020
209	18	27	35	105	98	44	44	154	44	192
210	6	19	22	118	25	30	30	121	30	136
212	2	3	3	85	15	3	3	90	3	87
213	2	3	4	81	10	4	4	84	4	73
214	11	21	25	111	57	41	41	150	41	185
215	7	10	13	98	26	37	37	121	37	175
217	1	8	9	85	6	9	9	79	9	59
218	6	8	12	106	33	21	22	159	22	159
220	2	3	5	91	11	9	9	86	9	86
221	1	16	16	93	7	18	18	87	18	87
222	5	51	51	105	22	94	94	147	94	223
223	4	8	11	97	22	11	11	97	11	99
224	2	7	7	91	12	13	13	112	13	119
229	2	36	37	109	9	82	82	108	82	132
230	2	5	5	86	11	5	5	82	5	76
233	1	3	3	88	10	11	11	88	11	88
235	6	18	21	120	31	37	37	129	37	175
236	6	22	23	110	32	71	71	160	71	217
237	1	2	2	81	2	2	2	60	2	44
238	5	14	16	125	38	31	35	197	35	246
241	1	28	30	105	2	100	101	118	101	148
242	5	16	19	91	23	27	27	98	27	122
267	4	7	7	85	13	7	7	87	7	84
279	26	168	176	185	121	425	425	358	425	960
281	13	353	400	8763	117	1513	1596	3109	1596	68710
282	66	893	nan	ERROR	593	3748	4788	504489	3866	TIMEOUT
283	86	972	nan	ERROR	835	4050	4964	TIMEOUT	4361	TIMEOUT
284	84	1237	1238	TIMEOUT	780	5521	6237	452166	5657	TIMEOUT
285	66179	46602	75625	TIMEOUT	591180	213429	213442	TIMEOUT	213490	TIMEOUT
286	13961	32979	46596	498850	129103	121266	124479	TIMEOUT	121606	TIMEOUT
290	7	149	139	163	52	460	460	343	460	666
293	16	2083	2086	365	63	3921	3921	617	3921	715
296	16	66	71	181	73	180	180	324	180	870
301	3	129	131	123	19	345	345	137	345	202
316	1	43	42	98	2	99	99	99	99	90
319	187	243	693	TIMEOUT	948	1044	3848	15565	2545	TIMEOUT
320	124	146	1008	770	760	523	2899	8531	2899	8961
332	9	228	237	166	39	534	539	290	541	837
333	5	66	69	126	33	131	133	226	133	296
339	4	93	96	117	19	256	260	154	260	269
341	2	33	36	111	3	60	63	91	63	113
343	4	97	101	TIMEOUT	18	354	355	545	355	1656
347	8	98	110	160	79	223	239	403	239	1028
348	20	159	241	269	151	462	655	1710	655	6832
349	8	98	118	190	45	217	240	293	253	2971
350	942	3062	3374	TIMEOUT	8159	11215	14155	TIMEOUT	nan	ERROR
352	221	3447	21690	61195	2088	8562	38773	TIMEOUT	nan	ERROR
353	221	3426	21866	74778	1864	9044	17164	TIMEOUT	nan	ERROR
354	1501	4839	nan	ERROR	12070	13061	13061	TIMEOUT	13071	TIMEOUT
356	1719	1901	1901	1498	7791	7377	7377	5126	7377	10941
357	1794	1981	1981	2051	8217	7024	7024	6211	7024	11407
358	101	267	267	568	456	943	943	2431	943	3766
359	515	181	181	300	2189	537	537	625	537	1236
360	1059	1616	1616	1833	4740	5905	5905	8961	5905	22100
366	40	96	103	231	189	319	333	607	333	1380
368	6657	25628	26705	122137	38484	89186	89186	432786	nan	ERROR
369	10978	39919	41811	354034	58884	143316	143316	TIMEOUT	nan	ERROR
370	12070	56379	56379	384146	71658	196730	196730	TIMEOUT	196730	TIMEOUT
371	7464	27969	29819	254680	49503	97236	97269	TIMEOUT	nan	ERROR
372	557	1078	1392	2242	2592	2890	2890	TIMEOUT	3536	40541
373	668	1298	1830	2884	3617	3649	3649	TIMEOUT	nan	ERROR
374	8270	30508	41657	TIMEOUT	76967	109634	109634	TIMEOUT	nan	ERROR
375	12633	45611	55840	TIMEOUT	70541	161672	161685	TIMEOUT	nan	ERROR
376	694	1286	8638	10796	4393	3677	3677	TIMEOUT	nan	ERROR
377	570	1006	7852	6689	2744	2928	2928	TIMEOUT	nan	ERROR
378	21423	58442	63294	TIMEOUT	119297	206592	206592	TIMEOUT	nan	ERROR
379	38615	90926	93084	TIMEOUT	201756	320873	320873	TIMEOUT	nan	ERROR
380	3141	6000	7113	46662	19374	14955	14955	TIMEOUT	nan	ERROR
381	3216	6053	8805	53776	16254	16893	16893	TIMEOUT	nan	ERROR
382	11806	47304	53734	TIMEOUT	62553	157867	157867	TIMEOUT	nan	ERROR
383	17881	65883	69502	TIMEOUT	105070	221577	221577	TIMEOUT	nan	ERROR
384	732	548	1537	2203	4764	1437	2225	TIMEOUT	nan	ERROR
385	834	574	2247	3394	7703	1432	2674	TIMEOUT	nan	ERROR
386	7559	28602	30807	152322	47575	99071	99071	TIMEOUT	nan	ERROR
387	12083	44583	70887	TIMEOUT	86656	162879	162879	TIMEOUT	nan	ERROR
388	106	212	281	361	574	531	667	49081	667	12100
389	100	200	257	452	632	548	548	111231	548	13367
390	7265	26905	42221	TIMEOUT	42707	91199	91199	TIMEOUT	nan	ERROR
391	11754	41534	52752	TIMEOUT	97362	148722	148722	TIMEOUT	nan	ERROR
392	608	1213	10077	20523	3671	3333	3333	TIMEOUT	nan	ERROR
393	776	1552	7149	23983	4710	3541	3541	TIMEOUT	nan	ERROR
394	9163	31483	37493	465225	57037	113243	113243	TIMEOUT	nan	ERROR
395	24648	62478	69269	TIMEOUT	166522	211495	211496	TIMEOUT	nan	ERROR
396	597	1153	1782	3657	3454	2792	2792	TIMEOUT	nan	ERROR
397	1494	2922	9598	20156	6988	8106	8106	TIMEOUT	nan	ERROR
398	7419	27882	32678	277361	52816	100391	100391	TIMEOUT	nan	ERROR
399	512	991	1485	2084	3244	2858	2858	TIMEOUT	nan	ERROR
400	7999	30008	33057	233238	48857	109259	110179	TIMEOUT	nan	ERROR
401	423	786	1526	1903	2601	2197	2197	TIMEOUT	nan	ERROR
402	1627	2230	2230	1482	7217	8216	8216	4167	8216	11080
403	2479	3894	3894	3221	11133	13907	13907	8164	13907	23962
404	2	45	45	107	7	137	137	100	137	106
405	4	49	49	121	14	134	134	141	134	150
406	2	92	92	108	8	284	284	142	284	173
407	4	97	97	118	13	308	308	173	308	197
410	476	1340	2271	TIMEOUT	4028	4672	6161	TIMEOUT	4728	TIMEOUT
411	250	1199	1199	1380	1125	4169	4169	6128	4169	12471
412	919	3532	3532	5551	4146	12586	12586	56497	nan	ERROR
413	1085	4625	4625	6268	4954	15633	15633	49221	nan	ERROR
414	25	50	52	201	225	110	114	8377	114	7385
415	7755	40108	40187	123648	44412	135742	135742	TIMEOUT	135744	TIMEOUT
416	12272	56774	58749	407818	72773	195582	195582	TIMEOUT	195592	TIMEOUT
417	176	343	516	1641	1452	934	934	TIMEOUT	nan	ERROR
418	202	395	596	2219	1598	1273	1273	TIMEOUT	nan	ERROR
419	1636	4806	10123	254138	17395	15816	15816	TIMEOUT	nan	ERROR
420	1505	5297	6329	62248	7981	16970	17030	TIMEOUT	nan	ERROR
421	717	1274	5369	13379	4372	3822	3822	TIMEOUT	nan	ERROR
422	420	672	1182	3496	2646	1618	1618	TIMEOUT	1746	TIMEOUT
423	619	714	714	800	2687	2329	2329	3600	2329	11125
424	786	1507	2119	7602	4662	4954	4954	TIMEOUT	7399	75809
425	11625	26750	26750	TIMEOUT	52471	93535	93535	TIMEOUT	nan	ERROR
426	24421	44891	44891	TIMEOUT	109954	154541	154541	TIMEOUT	154541	TIMEOUT
430	359	178	208	440	2324	369	369	2160	369	3217
432	238	137	137	396	1036	451	451	1460	451	2309
433	242	137	137	401	1025	428	428	1307	428	1697
435	1	9081	9081	862	2	26232	26232	1885	26232	1766
436	2308	24788	47673	TIMEOUT	14089	76518	76518	TIMEOUT	nan	ERROR
437	44247	91145	111642	TIMEOUT	334674	324522	324522	TIMEOUT	nan	ERROR
438	1512	3024	22410	165806	16632	7020	7020	TIMEOUT	nan	ERROR
445	120	1222	1222	483	510	3924	3924	1464	3924	5935
446	209	1700	1904	1349	1149	6268	6593	59801	6597	15218
448	24892	49657	68307	TIMEOUT	113432	169004	169089	TIMEOUT	nan	ERROR
449	225	2064	2194	3454	1362	6851	7370	78026	7370	13736
450	379	2872	3219	4393	1996	10696	11595	51822	11455	TIMEOUT
451	2257	2862	2862	7881	10088	9296	9296	50892	9296	198302
452	3163	4116	4221	14808	15470	14167	14167	80137	nan	ERROR
454	69	416	3343	1859	849	1227	12134	355507	12134	45834
457	80	1604	1604	699	379	5692	5692	1898	5692	3168
459	4019	6905	7386	29786	24636	23424	24216	TIMEOUT	nan	ERROR
460	9023	10382	17435	380608	59258	41468	43245	TIMEOUT	nan	ERROR
462	11474	15066	30877	TIMEOUT	100061	54336	54336	TIMEOUT	nan	ERROR
463	9433	10352	36779	TIMEOUT	70603	36456	36456	TIMEOUT	nan	ERROR
464	229	6	6	111	951	6	6	207	6	193
465	282	132	132	434	2137	418	418	1700	418	2744
468	5	720	720	190	30	2385	2385	400	2385	589
469	53	878	878	283	230	2919	2919	836	2919	1370
470	44414	75146	101902	TIMEOUT	356005	303638	303638	TIMEOUT	nan	ERROR
471	42734	78977	96918	TIMEOUT	388108	348635	348635	TIMEOUT	nan	ERROR
472	44414	75146	97625	TIMEOUT	334151	280312	280881	TIMEOUT	280418	TIMEOUT
473	42734	78977	92411	TIMEOUT	315281	288452	288452	TIMEOUT	nan	ERROR
474	16	72	72	146	76	246	246	284	246	367
475	22	83	103	233	218	308	308	1642	308	TIMEOUT
476	1834	2713	5043	17491	9031	7168	7168	TIMEOUT	nan	ERROR
477	156743	10606	10606	TIMEOUT	708261	32642	32642	TIMEOUT	nan	ERROR
479	323	566	915	TIMEOUT	3238	2017	2453	TIMEOUT	2118	TIMEOUT
480	327	663	1136	TIMEOUT	2811	2632	2921	TIMEOUT	2696	TIMEOUT
483	34035	116906	129685	TIMEOUT	233758	340679	340679	TIMEOUT	nan	ERROR
484	37999	102008	108396	TIMEOUT	193949	354778	354832	TIMEOUT	nan	ERROR
485	2593	5291	5700	50456	19442	21298	21298	TIMEOUT	nan	ERROR
486	11187	46982	55019	TIMEOUT	53025	163874	163874	TIMEOUT	nan	ERROR
487	17153	65521	77681	TIMEOUT	64960	226186	226198	TIMEOUT	nan	ERROR
488	11187	46969	53894	TIMEOUT	59290	155231	155231	TIMEOUT	nan	ERROR
489	13640	52447	59423	TIMEOUT	51256	185797	185797	TIMEOUT	nan	ERROR
496	10238	3220	3219	47562	49015	11781	11781	114545	nan	ERROR
497	8316	23	23	1311	37058	23	23	3352	23	3334
498	8316	23	23	1242	36903	23	23	3301	23	3512
500	1622	1990	5321	24729	10511	5125	5125	TIMEOUT	nan	ERROR
502	1878	1924	3297	8447	8982	8538	8548	87687	nan	ERROR
504	48	658	697	597	408	2088	2210	4076	2210	4692
505	9	151	151	106	39	414	414	140	414	157
508	50	267	337	717	423	1030	1132	1623	1132	4885
511	345	276	465	TIMEOUT	4202	1120	1550	61598	1299	TIMEOUT
512	458	800	1631	6932	3119	2967	4509	72519	4509	55842
513	38	309	309	331	188	1135	1135	975	1135	1721
514	38	309	309	313	161	1150	1150	662	1150	2050
515	870	2366	2443	3007	4183	8933	8979	15949	8954	TIMEOUT
518	11036	9363	35838	TIMEOUT	60734	19446	19446	TIMEOUT	nan	ERROR
519	73	93	93	124	289	333	333	196	333	294
520	76	91	91	116	375	256	256	201	256	725
521	7276	3640	3640	2348	32866	3642	3642	7172	3642	13801
522	4233	169	169	1193	19352	719	719	2716	719	3948
523	4233	169	169	1132	18924	537	537	2539	537	3227
526	193	280	289	552	837	945	951	1762	951	5746
527	502	4	4	148	2250	7	7	352	7	338
530	3	10609	10609	966	15	35885	35885	2508	35885	2571
531	7	11839	11839	1063	27	38335	38335	2634	38335	3016
532	11943	38053	38224	TIMEOUT	54606	131799	131799	TIMEOUT	nan	ERROR
533	32907	61414	61862	TIMEOUT	183356	215397	215397	TIMEOUT	nan	ERROR
534	315	630	811	2207	2797	1582	1582	TIMEOUT	nan	ERROR
535	8479	4621	9803	136824	67559	11384	11384	TIMEOUT	nan	ERROR
536	6762	36439	38821	227584	59038	124715	124715	TIMEOUT	nan	ERROR
537	11089	51964	60073	TIMEOUT	72735	181726	181726	TIMEOUT	nan	ERROR
538	102	204	229	420	520	495	495	82540	495	7727
539	104	208	287	615	724	556	564	118462	556	TIMEOUT
540	1744	13345	15321	35451	10374	46668	46668	TIMEOUT	nan	ERROR
541	11973	28600	33723	TIMEOUT	65543	104612	104612	TIMEOUT	nan	ERROR
542	9	18	18	122	90	39	39	785	39	987
543	9	18	18	118	81	40	40	804	40	1142
544	5972	3271	3271	32098	26666	11861	11861	150655	nan	ERROR
545	6276	3351	3351	35080	27993	10414	10414	212331	nan	ERROR
546	1952	775	775	2602	9004	2914	2914	14124	2914	22225
547	1952	780	780	3284	8815	2931	2931	12396	2931	16193
548	93	4361	4361	897	405	15922	15922	2862	15922	3994
550	3	853	853	185	14	2990	2990	407	2990	573
553	50453	90333	nan	ERROR	454414	338900	338993	TIMEOUT	nan	ERROR
554	74235	106867	140691	TIMEOUT	694518	413430	413454	TIMEOUT	nan	ERROR
555	134	1043	1195	1127	1073	3454	3691	180779	3691	25574
556	499	1532	2582	50872	5433	5529	7901	484841	6677	TIMEOUT
560	9	130	140	527	46	462	475	448	475	942
561	107	685	959	2079	752	2336	3170	17672	3170	22132
562	57	710	710	292	261	2366	2366	711	2366	1378
563	75	983	983	391	307	3569	3569	935	3569	2062
566	2505	49988	50430	253286	11822	170747	171832	391804	nan	ERROR
569	966	1750	2455	8610	4864	5711	5711	TIMEOUT	8843	59134
570	38	1102	1102	311	155	3634	3634	655	3634	1388
571	39	1357	1357	387	169	4804	4804	993	4804	1551
572	19651	57494	60035	TIMEOUT	95866	202203	202451	TIMEOUT	nan	ERROR
573	36922	91847	103266	TIMEOUT	224448	338951	338951	TIMEOUT	nan	ERROR
574	535	736	2914	5058	3728	1987	1987	TIMEOUT	nan	ERROR
575	479	700	2391	4033	2379	1571	1571	TIMEOUT	nan	ERROR
576	26	66	113	609	265	198	222	755	244	1571
577	15	16	16	105	65	16	16	112	16	111
580	8	272	272	132	28	901	901	223	901	254
581	5	316	316	156	13	958	958	199	958	244
582	184	647	731	1060	1394	2134	2328	26943	2328	20806
589	112	939	939	381	513	3332	3332	1174	3332	2261
590	16	605	632	31181	108	1990	2026	3801	2026	18365
591	69	2529	2529	591	245	8501	8501	1490	8501	4269
592	106	3414	3414	1292	495	12694	12694	3691	12694	13764
593	192	2049	2049	510	762	6893	6893	1438	6893	3310
594	177	1984	1984	474	563	4795	4795	1663	4795	3391
595	219	2894	21428	52580	1488	7195	14997	TIMEOUT	nan	ERROR
596	181	2022	2022	615	1038	5283	5283	1929	5283	5072
597	223	2933	21466	60895	2163	8006	10770	TIMEOUT	nan	ERROR
598	4	1	1	57	8	1	1	53	1	43
600	177	1983	1983	497	727	4609	4609	2033	4609	4099
605	84	650	650	563	360	2237	2237	1377	2237	2474
624	98	915	978	TIMEOUT	803	3162	3328	13242	nan	ERROR
626	683	2108	2460	5326	4523	7321	7984	TIMEOUT	8375	65210
627	572	2221	2233	2538	2532	7494	7510	7629	7510	19394
631	812	2653	2916	5793	4605	7495	7946	TIMEOUT	nan	ERROR
632	500	1895	2407	4772	3523	6369	6917	TIMEOUT	7313	60571
636	1652	940	2229	5482	19994	2962	3672	126729	3008	TIMEOUT
637	92	239	296	502	917	644	877	27856	877	165724
638	124	278	352	614	1159	637	1050	38530	1050	20449
639	353	254	254	355	1581	786	786	845	786	1891
640	408	394	394	376	1761	1232	1232	1096	1232	4555
645	2091	1594	1594	4883	9189	5442	5442	29305	5442	44851
646	2532	2301	2301	6584	11446	7683	7683	50487	7683	45640
648	4	232	232	121	14	780	780	182	780	274
649	663	284	284	935	2831	1341	1341	4477	1341	7436
657	1732	2654	4630	37732	15588	11865	11865	TIMEOUT	nan	ERROR
658	11957	16680	15967	TIMEOUT	78822	54498	54498	TIMEOUT	nan	ERROR
660	9040	14988	14362	TIMEOUT	39700	48735	48735	TIMEOUT	nan	ERROR
665	299	3166	21797	65469	2141	8878	34000	TIMEOUT	nan	ERROR
666	269	2346	21168	84269	2466	7388	10461	TIMEOUT	nan	ERROR
667	1181	506	506	1910	5374	1870	1870	9485	1870	9943
669	3530	4880	4880	4069	15673	12965	12965	11431	12965	41811
670	7079	5693	5693	28838	31621	19267	19267	88734	nan	ERROR
673	115	1929	1929	465	514	6560	6560	1365	6560	2401
675	25194	67697	nan	ERROR	164064	244240	244240	TIMEOUT	nan	ERROR
676	1921	1662	4957	19864	13283	3113	3113	TIMEOUT	nan	ERROR
677	1608	1283	4782	13155	9209	3039	3039	TIMEOUT	nan	ERROR
678	7558	11408	31066	167266	37001	39417	39417	TIMEOUT	nan	ERROR
679	260	472	1317	2179	1074	1073	1073	TIMEOUT	3905	47360
680	7414	11064	29598	151175	34347	36358	36400	TIMEOUT	nan	ERROR
681	116	57	108	151	436	122	122	1404	122	1266
682	24701	50202	50246	TIMEOUT	111447	174501	177378	TIMEOUT	174501	TIMEOUT
683	61	68	103	193	208	167	232	3241	232	1339
684	12683	62377	84133	TIMEOUT	75505	212258	212258	TIMEOUT	nan	ERROR
685	394	755	1229	6251	3794	1709	1709	TIMEOUT	nan	ERROR
686	36894	106605	108479	TIMEOUT	171444	371698	374449	TIMEOUT	nan	ERROR
687	184	92	92	97	368	92	92	146	92	136
689	1054	451	451	1237	5110	1548	1548	4387	1548	8789
690	1291	975	975	1974	5671	3330	3330	7073	3330	25915
694	6207	1624	1624	6395	22928	5295	5295	20792	5295	45087
695	7708	2842	2842	12280	37238	10036	10036	34220	nan	ERROR
700	1053	1025	nan	ERROR	15029	3908	3908	TIMEOUT	nan	ERROR
701	861	982	nan	ERROR	9736	4011	4067	TIMEOUT	4011	TIMEOUT
702	774	789	nan	ERROR	7925	2900	2900	TIMEOUT	3078	TIMEOUT
703	1160	1210	nan	ERROR	26050	4980	4980	TIMEOUT	4995	TIMEOUT
704	355	419	nan	ERROR	6132	1451	1474	TIMEOUT	nan	ERROR
705	380	337	630	TIMEOUT	4600	1471	1471	TIMEOUT	1680	TIMEOUT
706	342	336	336	TIMEOUT	3962	1200	1266	TIMEOUT	1202	TIMEOUT
707	257	280	412	TIMEOUT	2992	1155	1291	TIMEOUT	1155	TIMEOUT
708	125	159	251	TIMEOUT	1186	732	800	289877	748	TIMEOUT
709	130	145	145	TIMEOUT	1666	453	453	497554	453	TIMEOUT
710	240	235	nan	ERROR	3115	1178	1270	TIMEOUT	1214	TIMEOUT
711	245	289	482	TIMEOUT	1855	1248	1407	TIMEOUT	nan	ERROR
712	502	681	nan	ERROR	8094	2889	2889	TIMEOUT	nan	ERROR
713	455	425	nan	ERROR	5834	2030	2030	TIMEOUT	nan	ERROR
714	193	195	350	TIMEOUT	2485	949	1031	TIMEOUT	962	TIMEOUT
715	567	451	nan	ERROR	6904	2064	2064	TIMEOUT	nan	ERROR
716	640	605	nan	ERROR	4727	2554	2554	TIMEOUT	2673	TIMEOUT
717	5	43	49	208	53	200	204	463	204	1268
718	97	127	154	TIMEOUT	838	456	596	127021	596	145299
719	488	421	nan	ERROR	4160	1694	2010	TIMEOUT	1846	TIMEOUT
720	190	254	255	TIMEOUT	2491	937	1093	TIMEOUT	1016	TIMEOUT
721	222	213	244	TIMEOUT	2739	752	783	355732	nan	ERROR
722	411	490	nan	ERROR	7414	1815	1815	TIMEOUT	1815	TIMEOUT
723	225	249	250	TIMEOUT	2195	767	887	TIMEOUT	794	TIMEOUT
724	828	947	nan	ERROR	16310	3812	3812	TIMEOUT	nan	ERROR
725	5	44	51	181	37	196	202	288	202	599
726	283	388	nan	ERROR	4688	1702	1819	TIMEOUT	nan	ERROR
727	833	985	nan	ERROR	13456	4800	4800	TIMEOUT	nan	ERROR
728	728	881	nan	ERROR	8205	3876	3876	TIMEOUT	4007	TIMEOUT
729	54	94	150	TIMEOUT	554	419	492	12360	492	269262
730	3	42	46	148	34	168	169	339	169	600
731	148	173	nan	ERROR	1284	668	848	243061	848	40969
732	402	391	461	TIMEOUT	5103	1597	1645	TIMEOUT	1701	TIMEOUT
733	702	676	nan	ERROR	13174	2435	2435	TIMEOUT	nan	ERROR
734	78	114	148	TIMEOUT	910	372	372	179633	nan	ERROR
735	290	287	354	TIMEOUT	3774	1186	1361	TIMEOUT	1228	TIMEOUT
736	7	48	57	226	68	199	208	510	208	2799
737	227	228	nan	ERROR	3040	762	762	TIMEOUT	nan	ERROR
738	159	211	301	TIMEOUT	1373	849	880	32267	nan	ERROR
739	234	271	326	TIMEOUT	3399	952	1093	TIMEOUT	nan	ERROR
740	289	316	376	TIMEOUT	2449	1146	1244	TIMEOUT	nan	ERROR
741	752	722	nan	ERROR	10924	3376	3376	TIMEOUT	nan	ERROR
742	191	198	nan	ERROR	2561	968	1119	TIMEOUT	1039	TIMEOUT
743	708	961	nan	ERROR	9822	3797	3797	TIMEOUT	nan	ERROR
744	228	303	nan	ERROR	3358	1428	1428	TIMEOUT	1428	TIMEOUT
745	329	335	nan	ERROR	4954	1369	1369	TIMEOUT	nan	ERROR
746	490	468	nan	ERROR	4081	2092	2092	TIMEOUT	2092	TIMEOUT
747	419	437	nan	ERROR	3970	1783	1783	TIMEOUT	1827	TIMEOUT
748	223	271	439	TIMEOUT	3630	1219	1302	TIMEOUT	nan	ERROR
749	469	517	nan	ERROR	6098	1731	1731	TIMEOUT	nan	ERROR
750	209	283	nan	ERROR	2170	1269	1423	TIMEOUT	1300	TIMEOUT
751	248	253	nan	ERROR	1852	885	969	244113	921	TIMEOUT
752	772	788	nan	ERROR	8342	2679	2679	TIMEOUT	nan	ERROR
753	207	221	277	TIMEOUT	2171	752	752	TIMEOUT	752	TIMEOUT
754	932	973	nan	ERROR	17675	4031	4031	TIMEOUT	nan	ERROR
755	459	471	nan	ERROR	6060	1811	1811	TIMEOUT	nan	ERROR
756	578	597	683	TIMEOUT	7370	2332	2332	TIMEOUT	2342	TIMEOUT
759	2532	5317	7561	20894	21518	15858	16211	264104	nan	ERROR
760	57692	171905	215553	TIMEOUT	440258	648884	648884	TIMEOUT	nan	ERROR
761	5598	13151	14811	TIMEOUT	78409	46753	46753	TIMEOUT	nan	ERROR
762	2508	6825	19124	TIMEOUT	28272	27190	27190	TIMEOUT	nan	ERROR
763	124	385	402	605	891	998	1225	19280	1225	5768
766	218	2036	20278	63388	1721	6547	16858	TIMEOUT	nan	ERROR
768	2532	5752	9324	38785	28364	17105	22615	TIMEOUT	18424	TIMEOUT
769	2532	2653	2653	9142	11795	9077	9077	81094	9077	70661
770	2532	2666	2756	14468	20622	9823	10353	215300	9897	TIMEOUT
772	6	653	656	57109	59	2294	2297	2409	2297	4245
773	55	590	849	4448	480	2175	2532	24418	2243	TIMEOUT
775	59	331	nan	ERROR	924	1517	2541	267561	1675	TIMEOUT
778	42054	113187	136434	TIMEOUT	406079	236806	236806	TIMEOUT	nan	ERROR
781	187	243	889	TIMEOUT	906	938	4228	9132	3592	TIMEOUT
783	187	241	1410	TIMEOUT	1417	1022	4796	65848	3531	TIMEOUT
784	65	997	1101	3110	517	4675	4854	16718	4806	TIMEOUT
786	76401	109114	143229	TIMEOUT	675865	430611	430630	TIMEOUT	430698	TIMEOUT
787	45442	61046	66917	TIMEOUT	310984	215050	215050	TIMEOUT	nan	ERROR
788	13	2289	2299	TIMEOUT	117	7690	7712	3300	7712	42187
789	13	2342	2357	591823	125	7978	8022	2857	8022	52466
790	10	2550	2555	TIMEOUT	86	8635	8664	2852	8664	21003
792	27875	42590	nan	ERROR	270066	169023	169029	TIMEOUT	nan	ERROR
793	159	135	417	3695	1036	564	1105	41532	1105	468002
795	47412	65392	95583	TIMEOUT	386531	275468	275468	TIMEOUT	nan	ERROR

Experiments on Datalog rewriting

Table of Contents

1. Oxford ontology library experiments

1.1. Statistics on the input ontologies

1.2. Times Comparison

1.3. Timeout analysis

1.3.1. All the algorithm reach the timeout

1.3.2. Timeout summary

1.3.3. Existential-based DR timeout

1.3.4. Skolem DR timeout

1.3.5. HyperDR timeout

1.3.6. KAON2 timeouts

1.4. Winning Algorithms

1.4.1. ExbDR vs SkolemDR

1.4.2. ExbDR vs HyperDR

1.4.3. ExbDR vs KAON2

1.4.4. SkolemDR vs HyperDR

1.4.5. SkolemDR vs KAON2

1.4.6. HyperDR vs KAON2

1.4.7. Winning case summary

1.5. Times vs input size

1.5.1. ExbDR

1.5.2. SkolemDR

1.5.3. HyperDR

1.5.4. KAON2

1.5.5. Comparison

1.6. Output Analysis

1.6.1. Output summary

1.6.2. Output size comparison

1.7. All Statistics

2. Blown up ontologies experiments

2.1. Times Comparison

2.2. Timeout analysis

2.2.1. All the algorithm reach the timeout

2.2.2. Timeout summary

2.2.3. Existential-based DR timeout

2.2.4. Skolem DR timeout

2.2.5. HyperDR timeout

2.3. Winning Algorithms

2.3.1. ExbDR vs SkolemDR

2.3.2. ExbDR vs HyperDR

2.3.3. SkolemDR vs HyperDR

2.3.4. Winning case summary

2.4. Times vs input size

2.4.1. ExbDR

2.4.2. SkolemDR

2.4.3. HyperDR

2.4.4. Comparison

2.5. Output Analysis

2.5.1. Output size comparison

2.6. All Statistics