You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 04:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Jun 16, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1021798994338,4cyclictest1073277-21ntpq19:55:213
1021796994336,5cyclictest1282354-21latency_hist23:20:012
1021796994335,5cyclictest1225594-21latency_hist22:25:012
1021791994235,5cyclictest1220355-21latency_hist22:20:011
1021798994037,2cyclictest1267061-21kworker/u8:2+flush-259:023:15:163
1021798993936,2cyclictest1298213-21kworker/u8:0+flush-259:023:55:213
1021798993936,2cyclictest1142248-21kworker/u8:1+flush-259:021:10:203
1021783993733,3cyclictest1111644-21kworker/u8:0+flush-259:021:25:000
1021798993532,2cyclictest968674-21kworker/u8:4+flush-259:020:10:013
1021798993529,4cyclictest1163487-21latency_hist21:25:003
1021783993530,4cyclictest1111651-21kworker/u8:3+flush-259:020:55:000
1021783993427,5cyclictest1265968-21ntpq23:00:210
1021798993330,2cyclictest1256549-21kworker/u8:1+flush-259:023:20:203
1021796993331,1cyclictest1318617-21fwupd23:52:132
1021796993327,4cyclictest1328813-21ntpq00:00:212
1021796993325,5cyclictest1246229-21latency_hist22:45:012
1021783993325,6cyclictest335557-21systemd-journal21:10:000
1021798993228,3cyclictest1256549-21kworker/u8:1+flush-259:023:30:213
1021798993228,3cyclictest1220590-21kworker/u8:2+flush-259:022:40:253
1021791993228,2cyclictest1335151-21apt-get00:10:121
1021791993228,2cyclictest1335151-21apt-get00:10:121
1021791993226,4cyclictest1146635-21ntpq21:05:201
1021791993126,3cyclictest1021994-21/usr/sbin/munin19:10:131
1021783993127,3cyclictest1047991-21gpgv19:35:010
1021798993026,3cyclictest1355677-21kworker/u8:2+flush-259:000:30:203
1021798993023,5cyclictest1021734-21latency_hist19:10:003
1021783993026,3cyclictest1329108-21kworker/u8:5+flush-259:000:20:200
1021783993026,3cyclictest1106515-21apt-get20:30:100
1021798992925,3cyclictest1132095-21kworker/u8:4+events_unbound20:58:203
1021798992925,3cyclictest1111644-21kworker/u8:0+events_unbound21:25:183
1021798992923,4cyclictest509-21rs:main3
1021791992924,3cyclictest1209676-21kworker/u8:0+flush-259:022:55:261
1021783992924,3cyclictest968674-21kworker/u8:4+events_unbound19:45:210
1021783992924,3cyclictest509-21rs:main0
1021798992825,2cyclictest1246463-21kworker/u8:4+flush-259:023:35:243
1021798992823,4cyclictest1220590-21kworker/u8:2+flush-259:022:25:173
1021798992823,4cyclictest1027169-21kworker/u8:0+events_unbound19:49:223
1021798992723,3cyclictest1037239-21kworker/u8:2+events_unbound19:30:233
1021798992722,3cyclictest1053778-21kworker/u8:3+events_unbound20:25:133
1021798992720,5cyclictest1090366-21latency_hist20:15:003
1021798992720,2cyclictest968674-21kworker/u8:4+events_unbound19:35:223
1021791992722,3cyclictest1168671-21kworker/u8:3+flush-259:021:55:001
1021791992721,4cyclictest509-21rs:main1
1021783992724,2cyclictest1282471-21gpgv23:20:000
1021783992723,3cyclictest1168671-21kworker/u8:3+flush-259:022:15:210
1021783992722,4cyclictest1111655-21/usr/sbin/munin20:35:250
1021798992622,3cyclictest1173834-21kworker/u8:5+events_unbound21:42:223
1021798992622,3cyclictest1168671-21kworker/u8:3+flush-259:022:05:003
1021798992621,4cyclictest968674-21kworker/u8:4+events_unbound19:19:213
1021798992621,4cyclictest1105875-21kworker/u8:2+events_unbound21:03:223
1021783992622,3cyclictest1267061-21kworker/u8:2+events_unbound23:20:020
1021783992622,3cyclictest1011729-21kworker/u8:3+events_unbound19:10:230
1021798992522,2cyclictest1011729-21kworker/u8:3+flush-259:019:10:203
1021798992521,3cyclictest1298420-21kworker/u8:2+events_unbound23:50:233
1021798992519,4cyclictest335557-21systemd-journal20:24:203
1021798992518,5cyclictest1053778-21kworker/u8:3+flush-259:019:55:013
1021796992518,5cyclictest1100694-21latency_hist20:25:002
1021791992521,3cyclictest335557-21systemd-journal22:31:571
1021791992521,3cyclictest1142248-21kworker/u8:1+flush-259:021:55:211
1021791992521,3cyclictest1142248-21kworker/u8:1+flush-259:021:55:201
1021791992519,4cyclictest1085375-21base6420:10:011
1021783992522,2cyclictest968674-21kworker/u8:4+flush-259:019:40:220
1021783992522,2cyclictest1256549-21kworker/u8:1+events_unbound23:30:250
1021783992521,3cyclictest1298420-21kworker/u8:2+events_unbound23:49:200
1021783992518,5cyclictest1042804-21latency_hist19:30:000
1021798992421,2cyclictest1209676-21kworker/u8:0+events_unbound23:00:233
1021798992421,2cyclictest1168671-21kworker/u8:3+events_unbound22:05:233
1021798992421,2cyclictest1111644-21kworker/u8:0+events_unbound21:05:233
1021798992420,3cyclictest1340347-21kworker/u8:1+events_unbound00:15:153
1021798992420,3cyclictest1340347-21kworker/u8:1+events_unbound00:15:153
1021798992420,3cyclictest1340153-21kworker/u8:0+events_unbound00:26:223
1021798992420,3cyclictest1142248-21kworker/u8:1+flush-259:021:46:513
1021791992420,3cyclictest1209676-21kworker/u8:0+flush-259:022:50:251
1021791992419,3cyclictest1205182-21apt-get22:05:121
1021791992418,4cyclictest1329693-21latency_hist00:05:001
1021783992420,3cyclictest1209676-21kworker/u8:0+flush-259:022:32:250
1021783992420,3cyclictest1105875-21kworker/u8:2+events_unbound20:50:000
1021783992420,3cyclictest1053778-21kworker/u8:3+events_unbound20:00:230
1021783992418,5cyclictest1111644-21kworker/u8:0+flush-259:021:30:150
1021783992418,4cyclictest1303610-21/usr/sbin/munin23:40:130
1021798992320,2cyclictest1329108-21kworker/u8:5+events_unbound00:20:193
1021798992320,2cyclictest1308742-21kworker/u8:3+flush-259:000:05:193
1021798992319,3cyclictest1355677-21kworker/u8:2+events_unbound00:37:213
1021798992319,3cyclictest1168671-21kworker/u8:3+events_unbound22:16:223
1021798992317,4cyclictest1116599-21latency_hist20:40:013
1021796992320,2cyclictest1355677-21kworker/u8:2+flush-259:000:30:252
1021796992318,4cyclictest1063851-21kworker/u8:1+flush-259:020:00:002
1021796992318,3cyclictest509-21rs:main2
1021796992318,3cyclictest500-21systemd-logind23:35:002
1021791992317,4cyclictest1037756-21cat19:25:001
1021783992320,2cyclictest1132095-21kworker/u8:4+flush-259:021:15:200
1021783992319,3cyclictest1142248-21kworker/u8:1+events_unbound21:43:210
1021783992319,3cyclictest1111644-21kworker/u8:0+events_unbound21:04:210
1021783992319,2cyclictest1209676-21kworker/u8:0+events_unbound22:50:200
1021783992318,3cyclictest1111644-21kworker/u8:0+flush-259:020:40:250
1021798992218,3cyclictest1256549-21kworker/u8:1+events_unbound23:25:213
1021798992215,5cyclictest335557-21systemd-journal20:55:013
1021796992216,5cyclictest1355677-21kworker/u8:2+flush-259:000:40:002
1021791992218,3cyclictest1340373-21apt-get00:15:111
1021791992218,3cyclictest1340373-21apt-get00:15:111
1021791992218,3cyclictest1256549-21kworker/u8:1+events_unbound23:20:211
1021791992218,3cyclictest1246463-21kworker/u8:4+events_unbound23:35:221
1021791992217,3cyclictest968674-21kworker/u8:4+events_unbound20:15:211
1021791992216,4cyclictest335557-21systemd-journal20:30:201
1021783992219,2cyclictest1298213-21kworker/u8:0+events_unbound23:55:230
1021783992219,2cyclictest1246463-21kworker/u8:4+events_unbound00:10:240
1021783992219,2cyclictest1246463-21kworker/u8:4+events_unbound00:10:240
1021783992218,3cyclictest1355922-21apt-get00:30:100
1021783992216,4cyclictest1260793-21ntpq22:55:220
1021798992118,2cyclictest1053778-21kworker/u8:3+events_unbound20:00:013
1021798992116,3cyclictest1011279-21kworker/u8:1+flush-259:019:25:203
1021796992117,3cyclictest1132095-21kworker/u8:4+flush-259:021:09:592
1021791992115,4cyclictest1121755-21latency_hist20:45:011
1021791992115,4cyclictest1058948-21apt-get19:45:111
1021791992114,5cyclictest1084850-21latency_hist20:10:001
1021783992118,2cyclictest1163721-21kworker/u8:2+events_unbound21:35:230
1021783992118,2cyclictest1053778-21kworker/u8:3+events_unbound19:55:190
1021783992117,3cyclictest1340153-21kworker/u8:0+events_unbound00:25:190
1021783992117,3cyclictest1220590-21kworker/u8:2+flush-259:022:37:280
1021783992117,3cyclictest1209676-21kworker/u8:0+events_unbound22:47:210
1021783992116,4cyclictest1272294-21apt-get23:10:120
102179699205,5cyclictest1266830-21munin-run23:05:012
1021791992017,2cyclictest1308742-21kworker/u8:3+events_unbound23:45:221
1021791992016,3cyclictest1256549-21kworker/u8:1+flush-259:023:30:251
1021791992015,3cyclictest1246463-21kworker/u8:4+events_unbound23:45:001
1021791992014,4cyclictest1105829-21apt-get20:30:011
102179199200,17cyclictest335557-21systemd-journal19:15:201
1021783992018,1cyclictest1132095-21kworker/u8:4+events_unbound22:20:170
1021783992016,3cyclictest1246463-21kworker/u8:4+events_unbound23:05:190
1021783992016,3cyclictest1220590-21kworker/u8:2+flush-259:022:40:250
1021783992016,3cyclictest1168671-21kworker/u8:3+events_unbound22:10:150
1021783992016,3cyclictest1168671-21kworker/u8:3+events_unbound21:47:210
1021783992015,3cyclictest335557-21systemd-journal00:04:200
1021798991916,2cyclictest1329108-21kworker/u8:5+flush-259:000:10:203
1021798991916,2cyclictest1329108-21kworker/u8:5+flush-259:000:10:203
1021798991916,2cyclictest1298213-21kworker/u8:0+events_unbound23:45:143
1021798991916,2cyclictest1241278-21kworker/u8:3+flush-259:023:05:253
1021798991915,3cyclictest1246463-21kworker/u8:4+events_unbound23:40:183
1021798991915,3cyclictest1209676-21kworker/u8:0+flush-259:022:35:013
1021796991911,6cyclictest335557-21systemd-journal20:35:012
1021796991911,5cyclictest1334891-21latency_hist00:10:002
1021796991911,5cyclictest1256527-21latency_hist22:55:012
1021796991911,5cyclictest1083927-21ntpq20:05:222
1021791991916,2cyclictest968674-21kworker/u8:4+events_unbound19:30:201
1021791991915,3cyclictest1209676-21kworker/u8:0+flush-259:023:00:211
1021791991915,3cyclictest1209676-21kworker/u8:0+flush-259:022:42:281
1021791991915,3cyclictest1158304-21sh21:19:591
1021791991914,4cyclictest335557-21systemd-journal22:27:201
1021791991914,4cyclictest1037241-21latency_hist19:25:001
1021783991916,2cyclictest968674-21kworker/u8:4+flush-259:020:20:240
1021783991916,2cyclictest968674-21kworker/u8:4+events_unbound20:15:180
1021783991915,3cyclictest968674-21kworker/u8:4+events_unbound19:21:590
1021798991815,2cyclictest1241278-21kworker/u8:3+flush-259:023:10:203
1021798991815,2cyclictest1225826-21kworker/u8:1+flush-259:022:40:013
1021798991814,2cyclictest1209676-21kworker/u8:0+events_unbound22:45:223
1021796991815,2cyclictest0-21swapper/219:25:012
1021791991814,3cyclictest968674-21kworker/u8:4+flush-259:019:40:141
1021791991814,3cyclictest1105875-21kworker/u8:2+flush-259:020:45:151
1021791991813,3cyclictest1105875-21kworker/u8:2+flush-259:020:40:001
1021783991816,1cyclictest0-21swapper/022:10:000
1021783991815,2cyclictest1105875-21kworker/u8:2+events_unbound20:55:220
1021783991814,3cyclictest1256549-21kworker/u8:1+events_unbound23:36:200
1021783991813,4cyclictest1209676-21kworker/u8:0+flush-259:022:30:010
1021798991714,2cyclictest1111644-21kworker/u8:0+flush-259:020:46:353
1021798991713,3cyclictest1163721-21kworker/u8:2+events_unbound21:34:573
1021798991713,3cyclictest1105875-21kworker/u8:2+events_unbound20:43:213
102179699174,7cyclictest1179023-21munin-run21:39:592
1021796991712,4cyclictest1053778-21kworker/u8:3+flush-259:020:10:172
1021796991712,3cyclictest1158543-21/usr/sbin/munin21:20:182
1021791991712,4cyclictest335557-21systemd-journal23:55:211
1021783991714,2cyclictest60350irq/132-enp0s29f1:rx-023:25:250
1021783991714,2cyclictest1308742-21kworker/u8:3+events_unbound00:05:140
1021783991713,3cyclictest1105816-21idleruntime-cro20:30:010
102179899169,5cyclictest1214309-21ntpq22:10:203
1021798991612,3cyclictest1220590-21kworker/u8:2+events_unbound22:20:223
1021796991613,2cyclictest1132095-21kworker/u8:4+events_unbound22:15:182
1021796991612,3cyclictest1194533-21cron21:55:002
102179199169,5cyclictest335557-21systemd-journal23:54:201
1021791991613,2cyclictest1251409-21cron22:50:001
1021791991612,3cyclictest1168671-21kworker/u8:3+flush-259:022:10:231
1021791991612,3cyclictest1142248-21kworker/u8:1+flush-259:021:10:171
1021791991612,3cyclictest1063851-21kworker/u8:1+events_unbound20:02:031
1021791991611,4cyclictest335557-21systemd-journal00:22:171
1021791991611,3cyclictest1064062-21/usr/sbin/munin19:50:181
1021783991612,3cyclictest1079754-21kworker/u8:0+events_unbound20:05:150
1021798991511,3cyclictest1142248-21kworker/u8:1+flush-259:021:35:253
1021798991511,3cyclictest1142248-21kworker/u8:1+events_unbound21:50:113
1021798991511,3cyclictest1095549-21kworker/u8:1+flush-259:020:30:273
102179699159,4cyclictest335557-21systemd-journal19:52:012
102179699154,5cyclictest1058693-21apt19:45:002
102179699153,2cyclictest1041882-21ntpq19:25:202
1021796991512,2cyclictest1168671-21kworker/u8:3+events_unbound22:05:172
1021796991512,2cyclictest1021779-21cyclictest23:30:002
1021796991511,3cyclictest500-21systemd-logind19:35:002
1021796991511,3cyclictest1267262-21fschecks_count23:05:152
1021796991510,3cyclictest335557-21systemd-journal00:29:552
1021791991512,2cyclictest1220590-21kworker/u8:2+events_unbound22:20:231
1021791991510,4cyclictest1350697-21/usr/sbin/munin00:25:131
1021791991510,3cyclictest1365994-21idleruntime-cro00:40:001
1021783991513,2cyclictest60350irq/132-enp0s29f1:rx-020:10:280
1021783991513,2cyclictest60350irq/132-enp0s29f1:rx-019:36:160
1021783991512,2cyclictest60350irq/132-enp0s29f1:rx-022:00:110
1021783991512,2cyclictest60350irq/132-enp0s29f1:rx-021:14:360
1021783991512,2cyclictest1308742-21kworker/u8:3+flush-259:000:15:230
1021783991512,2cyclictest1308742-21kworker/u8:3+flush-259:000:15:230
1021783991512,2cyclictest0-21swapper/023:55:000
1021798991410,3cyclictest1298213-21kworker/u8:0+flush-259:000:00:053
1021798991410,3cyclictest1142248-21kworker/u8:1+events_unbound21:55:123
1021798991410,3cyclictest1142248-21kworker/u8:1+events_unbound21:55:123
102179699147,5cyclictest1142375-21latency_hist21:05:012
102179699146,5cyclictest1261687-21latency_hist23:00:012
102179699146,1cyclictest191rcu_preempt22:30:192
102179699143,6cyclictest41-21ksoftirqd/220:45:222
102179699143,2cyclictest1183282-21ntpq21:40:212
102179699142,2cyclictest1214380-21ntpq22:10:212
102179699141,4cyclictest1157435-21ntpq21:15:232
102179699141,11cyclictest1241032-21awk22:40:002
102179199147,5cyclictest1188504-21ntpq21:45:201
1021791991411,2cyclictest1100200-21unixbench_multi20:20:241
1021791991410,3cyclictest1267061-21kworker/u8:2+flush-259:023:17:311
1021791991410,3cyclictest1179284-21apt-get21:40:121
1021783991412,1cyclictest60350irq/132-enp0s29f1:rx-021:55:140
1021783991412,1cyclictest60350irq/132-enp0s29f1:rx-021:55:130
1021783991412,1cyclictest60350irq/132-enp0s29f1:rx-021:27:180
1021783991412,1cyclictest60350irq/132-enp0s29f1:rx-000:35:240
102179899139,3cyclictest509-21rs:main3
1021798991310,2cyclictest1209676-21kworker/u8:0+events_unbound22:50:283
102179699133,6cyclictest1127469-21hddtemp_smartct20:50:142
102179699132,4cyclictest1173594-21runrttasks21:32:262
102179699132,3cyclictest1350439-21runrttasks00:24:562
102179699131,7cyclictest1272441-21df23:10:132
102179699131,7cyclictest1246464-21/usr/sbin/munin22:45:252
102179699131,2cyclictest1094658-21ntpq20:15:212
1021796991310,2cyclictest1062956-21ntp_kernel_pll_19:45:212
1021796991310,1cyclictest0-21swapper/223:50:002
102178399138,4cyclictest1189812-21diskstats21:50:140
1021783991310,2cyclictest1064154-21cpuspeed_turbos19:50:120
102179899129,2cyclictest0-21swapper/319:25:013
102179899128,3cyclictest1256549-21kworker/u8:1+events_unbound22:58:213
102179699129,1cyclictest0-21swapper/219:35:132
102179699122,3cyclictest1287605-21runrttasks23:21:422
102179699122,2cyclictest1323683-21/usr/sbin/munin23:55:222
102179699121,6cyclictest1022323-21hddtemp_smartct19:10:142
1021796991210,1cyclictest401ktimers/221:55:232
1021796991210,1cyclictest401ktimers/221:55:222
102179699120,3cyclictest41-21ksoftirqd/220:35:242
102179699120,2cyclictest1200255-21fw_conntrack22:00:132
102179899118,2cyclictest968674-21kworker/u8:4+flush-259:019:40:173
102179699113,1cyclictest191rcu_preempt23:40:102
102179699112,5cyclictest0-21swapper/220:55:132
102179699112,2cyclictest41-21ksoftirqd/222:25:142
102179699111,2cyclictest41-21ksoftirqd/200:15:252
102179699111,2cyclictest41-21ksoftirqd/200:15:252
102179699111,2cyclictest1027486-21fw_conntrack19:15:142
102179699110,2cyclictest1298737-21fw_conntrack23:35:152
102179199107,2cyclictest1267311-21fschecks_time23:05:161
10217919993,5cyclictest1174078-21apt-get21:35:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional