You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-13 - 08:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed May 13, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1049094997064,4cyclictest1147785-21kworker/u8:0+flush-259:021:30:002
1049094995752,3cyclictest1054669-21kworker/u8:2+flush-259:020:30:012
1049099995552,2cyclictest1362147-21kworker/u8:2+events_unbound00:33:173
1049099995349,3cyclictest1356631-21gpgv00:05:013
1049099995349,3cyclictest1356631-21gpgv00:05:003
1049099995148,2cyclictest1147785-21kworker/u8:0+events_unbound21:52:363
1049099995148,2cyclictest1054669-21kworker/u8:2+events_unbound20:51:393
1049099995047,2cyclictest1147785-21kworker/u8:0+events_unbound21:32:393
1049094995045,4cyclictest1236218-21kworker/u8:1+flush-259:023:25:002
1049099994946,2cyclictest1351560-21kworker/u8:4+events_unbound00:26:393
1049099994946,2cyclictest1215194-21kworker/u8:2+events_unbound22:24:393
1049099994845,2cyclictest1351560-21kworker/u8:4+events_unbound00:19:413
1049099994845,2cyclictest1351560-21kworker/u8:4+events_unbound00:19:403
1049099994845,2cyclictest1215194-21kworker/u8:2+events_unbound22:42:403
1049099994845,2cyclictest1054669-21kworker/u8:2+events_unbound20:01:403
1049094994844,3cyclictest1147785-21kworker/u8:0+flush-259:021:05:192
1049099994745,2cyclictest1308853-21kworker/u8:0+events_unbound23:21:393
1049094994743,3cyclictest1183775-21kworker/u8:3+events_unbound21:40:202
1049087994741,4cyclictest1387933-21latency_hist00:35:000
1049099994643,2cyclictest1292921-21kworker/u8:0+flush-259:023:05:003
1049099994643,2cyclictest1111281-21kworker/u8:4+events_unbound20:22:173
1049099994642,3cyclictest1362147-21kworker/u8:2+events_unbound00:13:033
1049099994640,5cyclictest1302325-21ntpq23:10:223
1049099994543,2cyclictest1183775-21kworker/u8:3+events_unbound21:55:253
1049099994543,2cyclictest1054669-21kworker/u8:2+events_unbound19:22:053
1049099994542,2cyclictest3195954-21kworker/u8:0+events_unbound19:51:393
1049087994531,12cyclictest1313153-21ntpq23:20:220
1049099994441,2cyclictest1236218-21kworker/u8:1+events_unbound22:52:463
1049094994436,5cyclictest1215176-21latency_hist21:50:002
1049090994440,3cyclictest1236218-21kworker/u8:1+flush-259:022:50:131
1049090994440,3cyclictest1183775-21kworker/u8:3+flush-259:021:35:001
1049094994337,4cyclictest1215194-21kworker/u8:2+events_unbound23:05:172
1049087994337,4cyclictest1199738-21latency_hist21:35:000
1049090994237,4cyclictest1303337-21gpgv23:15:001
1049090994233,6cyclictest252-21systemd-journal23:30:001
1049099994139,2cyclictest3195954-21kworker/u8:0+events_unbound19:17:393
1049094994137,3cyclictest1147785-21kworker/u8:0+flush-259:021:55:002
1049087994035,4cyclictest1141688-21ntpq20:35:190
1049094993935,3cyclictest1215194-21kworker/u8:2+events_unbound22:50:242
1049094993935,3cyclictest1054669-21kworker/u8:2+events_unbound20:12:392
1049094993832,4cyclictest252-21systemd-journal19:18:392
1049090993831,5cyclictest1246516-21kworker/u8:0+flush-259:022:30:151
1049090993829,6cyclictest252-21systemd-journal23:00:001
1049087993832,4cyclictest1314418-21diskstats23:25:150
1049099993734,2cyclictest1236218-21kworker/u8:1+events_unbound23:35:273
1049099993731,4cyclictest252-21systemd-journal21:35:383
1049087993732,3cyclictest1251940-21apt-get22:25:110
1049094993633,2cyclictest3195954-21kworker/u8:0+flush-259:020:24:302
1049094993633,2cyclictest1236218-21kworker/u8:1+events_unbound23:37:382
1049090993631,3cyclictest1351595-21apt-get00:00:121
1049090993631,3cyclictest1351595-21apt-get00:00:121
1049090993629,5cyclictest1267119-21latency_hist22:40:011
1049090993629,5cyclictest1054669-21kworker/u8:2+flush-259:019:20:161
1049087993632,3cyclictest1356542-21gpgv00:05:010
1049087993632,3cyclictest1356542-21gpgv00:05:000
1049087993628,7cyclictest75-21kswapd019:10:020
1049094993531,3cyclictest3195954-21kworker/u8:0+events_unbound20:15:222
1049094993531,3cyclictest1183775-21kworker/u8:3+events_unbound22:17:402
1049094993530,3cyclictest3195954-21kworker/u8:0+flush-259:019:40:152
1049099993432,2cyclictest1054669-21kworker/u8:2+events_unbound20:35:263
1049094993431,2cyclictest1147785-21kworker/u8:0+flush-259:022:00:252
1049094993430,3cyclictest1054669-21kworker/u8:2+events_unbound21:20:192
1049094993428,4cyclictest509-21rs:main2
1049087993423,10cyclictest1122283-21apt-get20:20:110
1049094993331,1cyclictest1236218-21kworker/u8:1+events_unbound23:12:502
1049090993327,4cyclictest1307945-21ntpq23:15:221
1049087993327,5cyclictest1350075-21ntpq23:55:210
1049099993227,4cyclictest1168572-21/usr/sbin/munin21:05:133
1049099993227,4cyclictest1049458-21base6419:10:003
1049094993228,3cyclictest990412-21kworker/u8:3+events_unbound19:12:392
1049094993228,3cyclictest1362147-21kworker/u8:2+events_unbound00:34:402
1049094993228,3cyclictest1272300-21kworker/u8:3+events_unbound23:19:412
1049094993228,3cyclictest1246516-21kworker/u8:0+events_unbound22:25:222
1049094993228,3cyclictest1137478-21kworker/u8:1+events_unbound20:37:212
1049090993225,5cyclictest1357028-21cat00:05:001
1049087993229,2cyclictest1372690-21apt-get00:20:110
1049087993226,4cyclictest1194115-21apt-get21:30:000
1049099993126,3cyclictest1350901-21latency_hist00:00:003
1049094993125,4cyclictest1075143-21latency_hist19:35:012
1049090993124,5cyclictest1178610-21latency_hist21:15:001
1049087993125,4cyclictest1147758-21latency_hist20:45:010
1049099993027,2cyclictest1173489-21kworker/u8:1+events_unbound21:12:253
1049094993024,4cyclictest1198893-21ntpq21:30:232
1049090993022,6cyclictest252-21systemd-journal20:50:001
1049090993022,6cyclictest1334583-21ntpq23:40:221
1049087993017,11cyclictest1340841-21apt-get23:50:120
1049099992926,2cyclictest3195954-21kworker/u8:0+events_unbound19:42:383
1049099992926,2cyclictest1215194-21kworker/u8:2+events_unbound22:14:393
1049099992926,2cyclictest1215194-21kworker/u8:2+events_unbound22:05:383
1049094992926,2cyclictest1054669-21kworker/u8:2+events_unbound19:20:222
1049094992925,3cyclictest1215194-21kworker/u8:2+events_unbound23:00:002
1049094992925,3cyclictest1054669-21kworker/u8:2+events_unbound19:55:212
1049094992924,3cyclictest1111281-21kworker/u8:4+events_unbound20:45:162
1049094992923,4cyclictest1335462-21latency_hist23:45:002
1049099992825,2cyclictest1236218-21kworker/u8:1+events_unbound23:48:403
1049094992824,3cyclictest3195954-21kworker/u8:0+events_unbound20:06:402
1049090992824,3cyclictest1183775-21kworker/u8:3+flush-259:021:40:001
1049090992823,3cyclictest1215194-21kworker/u8:2+flush-259:022:10:241
1049090992821,5cyclictest1340577-21latency_hist23:50:001
1049087992824,3cyclictest1147785-21kworker/u8:0+flush-259:022:00:000
1049099992724,2cyclictest1362147-21kworker/u8:2+events_unbound00:39:403
1049099992724,2cyclictest1147785-21kworker/u8:0+events_unbound21:45:393
1049099992724,2cyclictest1054669-21kworker/u8:2+events_unbound20:44:563
1049090992719,5cyclictest1137467-21latency_hist20:35:011
1049099992624,1cyclictest1054669-21kworker/u8:2+events_unbound20:13:393
1049099992623,2cyclictest1236218-21kworker/u8:1+events_unbound23:51:413
1049099992622,3cyclictest1054669-21kworker/u8:2+events_unbound19:58:243
1049099992619,5cyclictest1241802-21diskstats22:15:133
1049094992624,1cyclictest1236218-21kworker/u8:1+flush-259:023:30:232
1049094992623,2cyclictest1236218-21kworker/u8:1+events_unbound22:45:232
1049094992623,2cyclictest1183775-21kworker/u8:3+flush-259:022:05:202
1049094992622,3cyclictest1236218-21kworker/u8:1+events_unbound00:00:232
1049094992622,3cyclictest1236218-21kworker/u8:1+events_unbound00:00:232
1049094992622,3cyclictest1183775-21kworker/u8:3+events_unbound21:55:222
1049090992620,4cyclictest1215194-21kworker/u8:2+flush-259:022:20:161
1049090992620,4cyclictest1048843-21apt-get19:10:011
1049087992623,2cyclictest1215194-21kworker/u8:2+flush-259:022:40:000
1049099992522,2cyclictest1054669-21kworker/u8:2+events_unbound20:59:573
1049094992522,2cyclictest1111281-21kworker/u8:4+flush-259:020:40:262
1049094992522,2cyclictest1054669-21kworker/u8:2+events_unbound20:55:202
1049094992521,3cyclictest1351560-21kworker/u8:4+flush-259:000:20:162
1049094992518,3cyclictest1340051-21kworker/u8:0+events_unbound00:10:202
1049090992518,4cyclictest509-21rs:main1
1049087992517,6cyclictest1090649-21latency_hist19:50:010
1049087992517,6cyclictest1090649-21latency_hist19:50:010
1049099992421,2cyclictest1351560-21kworker/u8:4+events_unbound00:23:403
1049099992421,2cyclictest1215194-21kworker/u8:2+events_unbound23:09:573
1049094992421,2cyclictest1351560-21kworker/u8:4+flush-259:000:25:212
1049094992420,3cyclictest1183775-21kworker/u8:3+events_unbound21:35:222
1049090992421,2cyclictest1183775-21kworker/u8:3+flush-259:022:10:011
1049099992320,2cyclictest3195954-21kworker/u8:0+events_unbound20:18:313
1049099992320,2cyclictest1351560-21kworker/u8:4+events_unbound00:09:563
1049099992320,2cyclictest1246516-21kworker/u8:0+events_unbound22:34:563
1049099992320,2cyclictest1054669-21kworker/u8:2+events_unbound20:09:233
1049094992320,2cyclictest1382955-21kworker/u8:0+events_unbound00:35:212
1049094992319,3cyclictest1340051-21kworker/u8:0+events_unbound00:15:292
1049094992319,3cyclictest1340051-21kworker/u8:0+events_unbound00:15:282
1049094992319,3cyclictest1340051-21kworker/u8:0+events_unbound00:05:022
1049094992319,2cyclictest990412-21kworker/u8:3+flush-259:019:25:152
1049094992318,3cyclictest252-21systemd-journal20:03:372
1049090992319,3cyclictest1183775-21kworker/u8:3+events_unbound21:55:181
1049090992318,4cyclictest1350902-21apt-get00:00:001
1049087992319,3cyclictest1272300-21kworker/u8:3+flush-259:022:55:000
1049087992319,3cyclictest1215194-21kworker/u8:2+flush-259:023:00:010
1049087992319,3cyclictest1048872-21kworker/u8:1+flush-259:019:20:000
1049087992318,4cyclictest1288000-21/usr/sbin/munin23:00:160
1049087992318,4cyclictest1215596-21diskstats21:50:130
1049087992317,4cyclictest1074322-21ntpq19:30:220
1049099992219,2cyclictest1308853-21kworker/u8:0+events_unbound23:29:243
1049099992219,2cyclictest1215194-21kworker/u8:2+events_unbound22:04:563
1049099992219,2cyclictest1054669-21kworker/u8:2+events_unbound21:23:413
1049099992217,4cyclictest1048838-21latency_hist19:10:003
1049094992220,2cyclictest1054669-21kworker/u8:2+events_unbound21:18:382
1049094992218,3cyclictest1111281-21kworker/u8:4+events_unbound20:50:132
1049090992219,2cyclictest1142606-21turbostat.cron20:40:001
1049090992217,3cyclictest1075384-21/usr/sbin/munin19:35:191
1049090992216,4cyclictest1127461-21apt-get20:25:111
1049087992218,3cyclictest1111281-21kworker/u8:4+flush-259:021:10:010
1049087992215,5cyclictest252-21systemd-journal21:45:000
1049087992211,10cyclictest60350irq/132-enp0s29f1:rx-023:07:040
1049099992118,2cyclictest990412-21kworker/u8:3+events_unbound19:27:553
1049099992118,2cyclictest3195954-21kworker/u8:0+events_unbound20:25:373
1049099992118,2cyclictest3195954-21kworker/u8:0+events_unbound19:35:583
1049099992118,2cyclictest1183775-21kworker/u8:3+events_unbound21:40:023
1049099992118,2cyclictest1054669-21kworker/u8:2+events_unbound20:34:543
1049099992117,3cyclictest1054669-21kworker/u8:2+events_unbound19:33:533
1049094992118,2cyclictest1340051-21kworker/u8:0+events_unbound23:50:182
1049094992118,2cyclictest1054669-21kworker/u8:2+events_unbound20:30:252
1049090992115,4cyclictest1065082-21apt-get19:25:131
104908799218,2cyclictest60350irq/132-enp0s29f1:rx-023:45:200
104908799218,1cyclictest0-21swapper/021:45:250
104908799218,11cyclictest0-21swapper/020:10:240
104908799213,16cyclictest1200147-21df21:35:130
1049087992117,3cyclictest1215194-21kworker/u8:2+flush-259:022:45:000
1049087992116,4cyclictest507-21in:imuxsock22:15:000
1049087992116,4cyclictest1225736-21apt-get22:00:120
104908799211,5cyclictest1049091-21latency_hist19:09:590
1049087992114,4cyclictest1251677-21latency_hist22:25:000
1049087992112,8cyclictest60350irq/132-enp0s29f1:rx-019:50:120
1049099992017,2cyclictest3195954-21kworker/u8:0+events_unbound19:48:463
1049099992017,2cyclictest3195954-21kworker/u8:0+events_unbound19:48:463
1049099992017,2cyclictest1246516-21kworker/u8:0+events_unbound22:39:423
1049099992017,2cyclictest1236218-21kworker/u8:1+events_unbound22:48:113
1049090992017,2cyclictest1090914-21apt-get19:50:121
1049090992016,3cyclictest1183775-21kworker/u8:3+flush-259:021:25:261
1049087992016,3cyclictest1132331-21sh20:30:000
1049087992014,4cyclictest252-21systemd-journal23:45:000
1049099991917,2cyclictest1272300-21kworker/u8:3+events_unbound23:40:013
1049099991916,2cyclictest1215194-21kworker/u8:2+events_unbound22:25:343
1049099991916,2cyclictest1147785-21kworker/u8:0+events_unbound21:15:023
1049099991916,2cyclictest1111281-21kworker/u8:4+events_unbound21:01:123
1049099991916,2cyclictest1111281-21kworker/u8:4+events_unbound20:49:513
1049099991915,3cyclictest1054669-21kworker/u8:2+events_unbound21:28:573
1049094991916,2cyclictest1246516-21kworker/u8:0+events_unbound22:35:242
1049094991915,3cyclictest1215194-21kworker/u8:2+events_unbound23:00:232
1049094991915,3cyclictest1054669-21kworker/u8:2+flush-259:019:53:542
1049090991914,3cyclictest1367548-21apt-get00:15:131
1049090991914,3cyclictest1367548-21apt-get00:15:121
1049090991913,4cyclictest252-21systemd-journal20:56:381
1049090991911,5cyclictest1168341-21latency_hist21:05:011
104908799194,3cyclictest1157085-21grep20:50:190
104908799194,1cyclictest1106117-21turbostat20:05:000
1049087991916,2cyclictest1340051-21kworker/u8:0+events_unbound00:05:170
1049087991914,4cyclictest1147785-21kworker/u8:0+flush-259:021:15:140
104908799190,2cyclictest1330323-21latency_hist23:40:000
1049099991815,2cyclictest1308853-21kworker/u8:0+events_unbound23:31:263
1049099991815,2cyclictest1215194-21kworker/u8:2+events_unbound22:58:073
1049094991815,2cyclictest1272300-21kworker/u8:3+flush-259:023:45:152
1049094991814,3cyclictest1236218-21kworker/u8:1+events_unbound22:40:132
1049094991814,3cyclictest1054669-21kworker/u8:2+events_unbound19:45:222
1049094991814,3cyclictest1054669-21kworker/u8:2+events_unbound19:45:212
1049090991810,6cyclictest1324925-21cp23:35:001
104908799187,1cyclictest0-21swapper/022:30:140
1049087991813,4cyclictest252-21systemd-journal23:20:000
1049094991714,2cyclictest1111281-21kworker/u8:4+events_unbound21:02:392
1049094991713,3cyclictest1215194-21kworker/u8:2+events_unbound22:10:252
1049090991714,2cyclictest1393059-21cron00:40:001
1049090991714,2cyclictest1245589-21ntp_kernel_pll_22:15:201
1049090991714,2cyclictest0-21swapper/120:15:001
1049087991714,2cyclictest1272949-21irqcore22:45:160
1049087991711,5cyclictest1303224-21apt-get23:15:020
104908799170,4cyclictest1163184-21cron21:00:000
104908799170,2cyclictest1079497-21ntpq19:35:220
1049094991613,2cyclictest1215194-21kworker/u8:2+flush-259:022:20:242
1049094991613,2cyclictest0-21swapper/219:40:002
1049090991612,3cyclictest1382955-21kworker/u8:0+flush-259:000:35:001
1049090991611,3cyclictest0-21swapper/120:20:001
104908799165,2cyclictest1362544-21df_inode00:10:160
1049087991614,1cyclictest60350irq/132-enp0s29f1:rx-021:24:060
1049087991611,4cyclictest1340051-21kworker/u8:0+flush-259:000:15:180
1049087991611,4cyclictest1340051-21kworker/u8:0+flush-259:000:15:170
1049094991512,2cyclictest1246516-21kworker/u8:0+events_unbound22:34:082
1049094991512,2cyclictest1173489-21kworker/u8:1+events_unbound21:10:302
1049094991511,3cyclictest1308853-21kworker/u8:0+events_unbound23:26:092
1049094991511,3cyclictest1049222-21apt-key19:10:002
104909099159,4cyclictest509-21rs:main1
1049090991511,3cyclictest1147785-21kworker/u8:0+events_unbound21:05:201
1049090991510,3cyclictest1340051-21kworker/u8:0+flush-259:000:15:001
104908799159,5cyclictest1381903-21ntpq00:25:250
1049087991513,1cyclictest60350irq/132-enp0s29f1:rx-000:35:480
1049087991512,3cyclictest60350irq/132-enp0s29f1:rx-022:09:360
1049087991511,2cyclictest0-21swapper/019:25:000
104909099149,4cyclictest1111281-21kworker/u8:4+flush-259:020:50:171
1049090991410,3cyclictest1272606-21cpuspeed_turbos22:45:141
104908799148,2cyclictest60350irq/132-enp0s29f1:rx-021:03:310
1049087991412,2cyclictest60350irq/132-enp0s29f1:rx-023:33:140
1049087991412,1cyclictest60350irq/132-enp0s29f1:rx-021:10:280
1049087991412,1cyclictest1-21systemd19:43:390
104909099138,3cyclictest3195954-21kworker/u8:0+flush-259:020:00:001
104909099131,4cyclictest12683941kthreadcore22:40:181
1049090991311,1cyclictest0-21swapper/120:05:241
1049090991310,2cyclictest1377582-21cron00:25:001
1049087991311,1cyclictest60350irq/132-enp0s29f1:rx-022:17:380
1049087991310,2cyclictest60350irq/132-enp0s29f1:rx-020:45:120
1049087991310,2cyclictest60350irq/132-enp0s29f1:rx-020:15:200
1049087991310,2cyclictest60350irq/132-enp0s29f1:rx-019:55:110
104909099129,2cyclictest1219507-21ntp_offset21:50:231
104909099129,1cyclictest0-21swapper/120:20:211
104909099128,3cyclictest1147785-21kworker/u8:0+flush-259:021:15:191
104909099126,5cyclictest513-21gdbus19:45:001
104909099118,1cyclictest0-21swapper/122:25:221
104909099118,1cyclictest0-21swapper/120:00:241
104909099116,4cyclictest1054669-21kworker/u8:2+flush-259:019:45:201
104909099116,4cyclictest1054669-21kworker/u8:2+flush-259:019:45:201
104909099116,3cyclictest1-21systemd19:20:001
104909099115,4cyclictest1298071-21cron23:10:001
104908799118,2cyclictest60350irq/132-enp0s29f1:rx-020:30:170
104909099106,3cyclictest1210297-21apt-get21:45:121
104909099106,2cyclictest1310053-21irqstats23:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional