You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 09:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Wed Sep 16, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1041594994440,3cyclictest1306894-21base6423:25:011
1041595994339,3cyclictest1003414-21kworker/u8:2+events_unbound19:20:122
1041595994239,2cyclictest1285709-21kworker/u8:4+events_unbound23:10:232
1041594994136,3cyclictest1003414-21kworker/u8:2+flush-259:019:10:251
1041595994037,2cyclictest1186748-21kworker/u8:0+flush-259:022:15:202
1041594993834,3cyclictest1171451-21apt-get21:15:121
1041594993833,4cyclictest1083217-21apt-get19:50:121
1041595993734,2cyclictest1077829-21kworker/u8:2+events_unbound21:20:252
1041595993633,2cyclictest1249092-21kworker/u8:0+events_unbound23:00:212
1041595993632,3cyclictest1098482-21kworker/u8:3+flush-259:020:15:112
1041594993529,4cyclictest1108836-21apt-get20:15:001
1041601993430,3cyclictest1343376-21kworker/u8:1+flush-259:000:20:163
1041601993329,3cyclictest1077829-21kworker/u8:2+flush-259:020:50:193
1041595993330,2cyclictest1269637-21kworker/u8:2+flush-259:023:21:352
1041595993329,3cyclictest1135239-21kworker/u8:4+flush-259:022:05:212
1041601993229,3cyclictest1238993-21kworker/u8:3+flush-259:022:20:223
1041601993228,3cyclictest1207793-21diskstats21:50:143
1041595993227,4cyclictest1166273-21apt-get21:10:122
1041595993225,5cyclictest1139373-21ntpq20:40:222
1041594993124,5cyclictest1154796-21ntpq20:55:201
1041593993128,2cyclictest1077829-21kworker/u8:2+flush-259:020:05:170
1041593993127,3cyclictest1249092-21kworker/u8:0+events_unbound22:55:280
1041601993025,4cyclictest335557-21systemd-journal21:45:003
1041595993027,2cyclictest1135239-21kworker/u8:4+flush-259:022:35:182
1041595993024,4cyclictest1342192-21ntpq23:55:232
1041595992922,5cyclictest1233132-21latency_hist22:15:012
1041593992924,4cyclictest1228005-21latency_hist22:10:010
1041595992825,2cyclictest1322362-21kworker/u8:0+events_unbound00:10:202
1041594992825,2cyclictest1093263-21kworker/u8:1+flush-259:020:25:261
1041601992724,2cyclictest1181444-21kworker/u8:1+flush-259:022:00:013
1041601992723,3cyclictest1186748-21kworker/u8:0+events_unbound22:00:003
1041601992722,4cyclictest1109358-21base6420:15:003
1041594992724,2cyclictest1223110-21apt-get22:05:111
1041594992723,2cyclictest1135239-21kworker/u8:4+flush-259:021:35:011
1041601992623,2cyclictest1249092-21kworker/u8:0+events_unbound22:45:193
1041601992620,4cyclictest335557-21systemd-journal23:45:003
1041595992623,2cyclictest509-21rs:main2
1041595992621,3cyclictest1186748-21kworker/u8:0+flush-259:021:55:242
1041595992618,5cyclictest1253404-21ntpq22:30:222
1041594992623,2cyclictest1285709-21kworker/u8:4+flush-259:023:35:011
1041594992621,4cyclictest1202494-21apt-get21:45:111
1041593992620,4cyclictest1196204-21ntpq21:35:240
1041601992522,2cyclictest1077829-21kworker/u8:2+events_unbound20:00:193
1041601992518,5cyclictest1296285-21/usr/sbin/munin23:15:153
1041595992522,2cyclictest1249092-21kworker/u8:0+flush-259:022:45:252
1041595992521,3cyclictest1135239-21kworker/u8:4+flush-259:022:00:212
1041594992520,4cyclictest1269637-21kworker/u8:2+flush-259:023:40:001
1041594992518,5cyclictest1378526-21ntpq00:30:241
1041593992522,2cyclictest1269637-21kworker/u8:2+flush-259:022:50:150
1041601992421,2cyclictest1186748-21kworker/u8:0+events_unbound21:35:203
1041601992421,2cyclictest1135239-21kworker/u8:4+events_unbound22:30:013
1041595992421,2cyclictest1077829-21kworker/u8:2+events_unbound20:50:172
1041595992421,2cyclictest1041500-21kworker/u8:0+flush-259:019:40:252
1041595992420,3cyclictest1114624-21kworker/u8:0+events_unbound20:26:072
1041595992420,3cyclictest1041500-21kworker/u8:0+events_unbound19:58:362
1041595992418,4cyclictest1312247-21apt-get23:30:122
1041595992417,6cyclictest335557-21systemd-journal23:30:002
1041595992416,3cyclictest1114624-21kworker/u8:0+events_unbound20:20:242
1041594992420,3cyclictest1254251-21latency_hist22:35:001
1041594992419,3cyclictest335557-21systemd-journal22:41:231
1041594992418,5cyclictest1135004-21latency_hist20:40:001
1041593992421,2cyclictest1003414-21kworker/u8:2+events_unbound19:20:180
1041593992419,4cyclictest1150573-21latency_hist20:55:010
1041601992320,2cyclictest1003414-21kworker/u8:2+events_unbound19:20:223
1041595992320,2cyclictest1238993-21kworker/u8:3+events_unbound22:20:132
1041595992320,2cyclictest1186748-21kworker/u8:0+flush-259:021:35:162
1041595992319,3cyclictest1343376-21kworker/u8:1+events_unbound00:01:322
1041595992319,3cyclictest1249092-21kworker/u8:0+events_unbound22:57:352
1041595992319,3cyclictest1087761-21kworker/u8:3+events_unbound19:54:362
1041595992316,5cyclictest1244127-21/usr/sbin/munin22:25:142
1041594992319,3cyclictest1098482-21kworker/u8:3+flush-259:020:15:161
1041601992218,3cyclictest1269637-21kworker/u8:2+flush-259:023:50:243
1041601992218,3cyclictest1186748-21kworker/u8:0+flush-259:022:15:243
1041595992219,2cyclictest1373973-21kworker/u8:2+flush-259:000:35:252
1041595992219,2cyclictest1135239-21kworker/u8:4+events_unbound21:27:362
1041595992218,3cyclictest1269637-21kworker/u8:2+events_unbound23:54:362
1041595992217,3cyclictest1155990-21apt-get21:00:152
1041595992217,3cyclictest1093263-21kworker/u8:1+events_unbound20:35:282
1041594992219,2cyclictest1077829-21kworker/u8:2+flush-259:021:25:001
1041594992218,3cyclictest1322362-21kworker/u8:0+flush-259:000:05:001
1041594992218,3cyclictest1217959-21apt-get22:00:131
1041594992218,3cyclictest1135239-21kworker/u8:4+events_unbound22:25:201
1041594992216,4cyclictest1305508-21ntpq23:20:191
1041593992219,2cyclictest1306407-21gpgv23:25:000
1041593992218,3cyclictest1338182-21apt-get23:55:130
1041593992218,3cyclictest1181444-21kworker/u8:1+events_unbound21:30:180
1041601992118,2cyclictest1322362-21kworker/u8:0+flush-259:000:05:153
1041601992118,2cyclictest1077829-21kworker/u8:2+flush-259:021:05:163
1041601992117,3cyclictest1135239-21kworker/u8:4+events_unbound22:05:143
1041601992117,3cyclictest1114624-21kworker/u8:0+events_unbound21:00:253
1041595992118,2cyclictest1322362-21kworker/u8:0+events_unbound00:05:152
1041595992117,3cyclictest1374411-21kworker/u8:4+events_unbound00:31:292
1041595992117,3cyclictest1343376-21kworker/u8:1+events_unbound00:20:162
1041595992117,3cyclictest1093263-21kworker/u8:1+events_unbound20:34:352
1041595992117,3cyclictest1093263-21kworker/u8:1+events_unbound20:34:352
1041595992116,4cyclictest1322362-21kworker/u8:0+events_unbound23:45:272
1041595992116,4cyclictest1135239-21kworker/u8:4+events_unbound21:33:372
1041594992118,2cyclictest1269767-21munin-plugin-st22:50:001
1041594992117,3cyclictest1327823-21apt-get23:45:111
1041594992117,3cyclictest1114624-21kworker/u8:0+flush-259:020:40:251
1041594992117,3cyclictest1077829-21kworker/u8:2+flush-259:020:00:221
1041594992115,4cyclictest509-21rs:main1
1041593992118,2cyclictest1135239-21kworker/u8:4+events_unbound21:10:230
1041593992118,2cyclictest1003414-21kworker/u8:2+flush-259:019:15:210
1041593992116,4cyclictest335557-21systemd-journal22:45:000
1041601992017,2cyclictest1269637-21kworker/u8:2+flush-259:022:50:133
1041601992017,2cyclictest1041500-21kworker/u8:0+flush-259:019:30:173
1041601992014,4cyclictest1155722-21latency_hist21:00:013
1041595992016,2cyclictest1301205-21sh23:20:012
1041594992017,2cyclictest1093263-21kworker/u8:1+flush-259:020:30:281
1041594992017,2cyclictest1093263-21kworker/u8:1+flush-259:020:30:271
1041594992015,3cyclictest1275579-21/usr/sbin/munin22:55:241
1041594992015,3cyclictest1238366-21systemctl22:20:001
1041593992017,2cyclictest1269637-21kworker/u8:2+events_unbound23:51:360
1041593992015,4cyclictest335557-21systemd-journal19:50:000
1041593992015,4cyclictest1331796-21ntpq23:45:200
1041593992013,6cyclictest1066591-21ntpq19:30:220
1041601991916,2cyclictest1285709-21kworker/u8:4+events_unbound23:30:213
1041601991916,2cyclictest1093263-21kworker/u8:1+events_unbound20:08:353
1041601991916,2cyclictest1003414-21kworker/u8:2+flush-259:019:25:283
1041601991915,3cyclictest1373973-21kworker/u8:2+events_unbound00:35:133
1041595991916,2cyclictest1259425-21kworker/u8:1+flush-259:022:40:202
1041595991916,2cyclictest1181444-21kworker/u8:1+events_unbound21:50:212
1041595991915,3cyclictest1275357-21kworker/u8:1+flush-259:023:05:242
1041595991915,3cyclictest1135239-21kworker/u8:4+events_unbound21:15:032
1041595991915,3cyclictest1114624-21kworker/u8:0+events_unbound20:45:142
1041595991915,3cyclictest1041500-21kworker/u8:0+events_unbound19:30:122
1041595991913,4cyclictest335557-21systemd-journal21:06:102
1041594991915,3cyclictest1114624-21kworker/u8:0+flush-259:020:20:261
1041594991915,2cyclictest1077829-21kworker/u8:2+events_unbound21:05:221
1041593991917,1cyclictest1213221-21irqcore21:55:150
1041593991915,2cyclictest1077829-21kworker/u8:2+events_unbound19:50:180
1041601991815,2cyclictest1077829-21kworker/u8:2+flush-259:019:55:153
1041601991814,3cyclictest1181444-21kworker/u8:1+events_unbound22:10:133
1041601991814,3cyclictest1077829-21kworker/u8:2+flush-259:021:22:403
1041595991815,2cyclictest1003414-21kworker/u8:2+flush-259:019:15:212
1041595991814,3cyclictest1098482-21kworker/u8:3+events_unbound20:10:202
1041595991814,3cyclictest1098482-21kworker/u8:3+events_unbound20:09:352
1041595991814,3cyclictest1072408-21kworker/u8:1+events_unbound19:37:482
1041594991814,3cyclictest1077829-21kworker/u8:2+events_unbound20:50:151
1041593991815,2cyclictest1285709-21kworker/u8:4+flush-259:023:40:190
1041593991815,2cyclictest1181444-21kworker/u8:1+flush-259:021:30:020
1041593991815,2cyclictest1003414-21kworker/u8:2+events_unbound19:35:370
1041593991815,2cyclictest0-21swapper/021:50:000
1041593991814,3cyclictest335557-21systemd-journal21:20:350
1041593991814,3cyclictest1358915-21apt-get00:15:110
1041593991814,3cyclictest1130069-21/usr/sbin/munin20:35:140
1041601991714,2cyclictest1322362-21kworker/u8:0+events_unbound00:25:143
1041601991714,2cyclictest1285709-21kworker/u8:4+flush-259:023:50:013
1041601991714,2cyclictest1249092-21kworker/u8:0+events_unbound22:44:283
1041601991714,2cyclictest1093263-21kworker/u8:1+events_unbound20:25:193
1041601991714,2cyclictest1003414-21kworker/u8:2+events_unbound19:15:183
1041594991715,2cyclictest1343376-21kworker/u8:1+events_unbound00:20:211
1041594991715,1cyclictest0-21swapper/120:50:011
104159499171,15cyclictest1-21systemd00:00:011
1041593991714,2cyclictest1135239-21kworker/u8:4+events_unbound22:35:200
1041593991714,2cyclictest1135239-21kworker/u8:4+events_unbound22:15:130
1041593991714,2cyclictest1077829-21kworker/u8:2+events_unbound21:05:180
1041593991713,3cyclictest1373973-21kworker/u8:2+events_unbound00:35:120
1041593991713,3cyclictest1353518-21sh00:10:010
1041593991713,3cyclictest1275357-21kworker/u8:1+events_unbound23:15:210
1041593991713,3cyclictest1077829-21kworker/u8:2+events_unbound21:15:180
1041593991712,4cyclictest335557-21systemd-journal22:50:010
1041601991613,2cyclictest1256795-21kthreadcore22:35:163
1041601991613,2cyclictest1098482-21kworker/u8:3+flush-259:020:10:203
1041601991612,3cyclictest1114624-21kworker/u8:0+events_unbound20:40:143
1041595991613,2cyclictest1269637-21kworker/u8:2+events_unbound22:50:252
1041595991613,2cyclictest1135239-21kworker/u8:4+flush-259:021:41:512
1041595991612,3cyclictest1322362-21kworker/u8:0+events_unbound00:26:302
1041595991612,3cyclictest1285709-21kworker/u8:4+events_unbound23:36:252
1041595991612,3cyclictest1003414-21kworker/u8:2+events_unbound19:25:022
1041594991613,2cyclictest1135239-21kworker/u8:4+events_unbound22:10:211
1041594991612,3cyclictest1003414-21kworker/u8:2+events_unbound19:25:201
1041593991614,1cyclictest0-21swapper/022:25:010
1041593991613,3cyclictest1181444-21kworker/u8:1+events_unbound21:50:240
1041593991613,2cyclictest60350irq/132-enp0s29f1:rx-022:10:220
1041593991613,2cyclictest60350irq/132-enp0s29f1:rx-020:45:130
1041593991613,2cyclictest1373973-21kworker/u8:2+flush-259:000:30:200
1041593991613,2cyclictest1135239-21kworker/u8:4+events_unbound21:40:180
1041593991612,3cyclictest1135239-21kworker/u8:4+events_unbound22:25:220
1041601991513,2cyclictest1135239-21kworker/u8:4+events_unbound20:50:003
1041601991512,2cyclictest0-21swapper/300:05:013
1041601991511,3cyclictest509-21rs:main3
1041601991511,3cyclictest509-21rs:main3
1041595991510,4cyclictest1135239-21kworker/u8:4+events_unbound21:45:152
1041594991512,2cyclictest1135239-21kworker/u8:4+flush-259:021:35:361
1041594991510,4cyclictest1135239-21kworker/u8:4+events_unbound22:35:231
104159399159,5cyclictest335557-21systemd-journal23:15:010
104159399159,5cyclictest1123790-21ntpq20:25:220
1041593991514,1cyclictest60350irq/132-enp0s29f1:rx-000:12:390
1041593991513,1cyclictest61150irq/133-enp0s29f1:tx-023:00:110
1041593991513,1cyclictest60350irq/132-enp0s29f1:rx-020:15:200
1041593991513,1cyclictest60350irq/132-enp0s29f1:rx-020:00:160
1041593991512,2cyclictest60350irq/132-enp0s29f1:rx-000:20:160
1041593991512,2cyclictest1181444-21kworker/u8:1+events_unbound22:00:200
1041593991512,2cyclictest1093263-21kworker/u8:1+flush-259:020:30:200
1041593991512,2cyclictest1093263-21kworker/u8:1+flush-259:020:30:200
1041593991511,3cyclictest1322362-21kworker/u8:0+events_unbound00:25:190
104160199149,3cyclictest1171548-21cut21:15:133
1041601991411,2cyclictest500-21systemd-logind00:35:003
1041601991411,2cyclictest1301606-21cpuspeed_turbos23:20:123
1041601991411,1cyclictest0-21swapper/320:25:003
1041595991410,3cyclictest1093263-21kworker/u8:1+events_unbound20:03:362
104159499149,3cyclictest1003414-21kworker/u8:2+flush-259:019:30:211
1041594991412,1cyclictest1-21systemd22:20:361
1041594991411,2cyclictest1135239-21kworker/u8:4+events_unbound21:55:181
1041594991411,2cyclictest1072408-21kworker/u8:1+events_unbound19:45:241
1041594991410,3cyclictest1322362-21kworker/u8:0+flush-259:000:25:291
1041594991410,3cyclictest1322362-21kworker/u8:0+flush-259:000:17:301
1041594991410,3cyclictest1275357-21kworker/u8:1+flush-259:023:15:251
1041594991410,3cyclictest1275357-21kworker/u8:1+flush-259:023:05:351
1041593991413,1cyclictest60350irq/132-enp0s29f1:rx-022:32:030
1041593991413,1cyclictest60350irq/132-enp0s29f1:rx-020:13:370
1041593991413,1cyclictest60350irq/132-enp0s29f1:rx-019:27:280
1041593991412,1cyclictest60350irq/132-enp0s29f1:rx-020:42:210
1041593991411,2cyclictest60350irq/132-enp0s29f1:rx-021:00:160
1041593991411,2cyclictest1290442-21unixbench_singl23:05:260
1041593991410,3cyclictest1114624-21kworker/u8:0+events_unbound20:20:180
104160199139,3cyclictest1135239-21kworker/u8:4+events_unbound21:45:223
104160199138,4cyclictest335557-21systemd-journal23:11:253
1041601991310,3cyclictest1135239-21kworker/u8:4+events_unbound22:30:163
1041601991310,2cyclictest1363349-21unixbench_multi00:15:253
1041601991310,2cyclictest1275357-21kworker/u8:1+flush-259:023:35:213
1041601991310,2cyclictest1275357-21kworker/u8:1+flush-259:023:25:203
1041601991310,2cyclictest1275357-21kworker/u8:1+flush-259:023:05:213
1041601991310,2cyclictest1041500-21kworker/u8:0+events_unbound19:45:003
104159599139,3cyclictest1114624-21kworker/u8:0+events_unbound20:55:412
1041595991310,2cyclictest1285709-21kworker/u8:4+events_unbound23:40:172
1041594991310,2cyclictest1333241-21fschecks_time23:50:141
1041594991310,2cyclictest1077829-21kworker/u8:2+events_unbound20:05:231
1041593991312,1cyclictest60350irq/132-enp0s29f1:rx-023:36:280
1041593991312,1cyclictest60350irq/132-enp0s29f1:rx-020:59:050
1041593991311,1cyclictest60350irq/132-enp0s29f1:rx-000:00:140
1041593991310,2cyclictest1306422-21kworker/u8:0+events_unbound23:25:230
104159499129,2cyclictest507-21in:imuxsock21:30:011
104159499128,3cyclictest1047006-21/usr/sbin/munin19:15:211
104159499128,2cyclictest1322362-21kworker/u8:0+flush-259:000:05:251
104159499125,5cyclictest1326670-21ntpq23:40:201
1041593991210,1cyclictest60350irq/132-enp0s29f1:rx-019:55:150
104160199116,4cyclictest335557-21systemd-journal22:57:343
104159599118,2cyclictest1078455-21irqcore19:45:172
104159599117,3cyclictest1322362-21kworker/u8:0+flush-259:000:15:152
104159499118,2cyclictest0-21swapper/123:15:001
104159499118,2cyclictest0-21swapper/120:00:001
104159499117,3cyclictest1322362-21kworker/u8:0+flush-259:000:10:181
104159399119,2cyclictest60350irq/132-enp0s29f1:rx-023:30:340
104159399117,3cyclictest1041500-21kworker/u8:0+events_unbound19:40:130
104160199108,2cyclictest1181444-21kworker/u8:1+flush-259:021:30:123
104160199106,3cyclictest1135239-21kworker/u8:4+events_unbound21:10:243
104159499106,2cyclictest1274468-21ntpq22:50:211
10416019995,3cyclictest1081863-21sed19:45:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional