You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 19:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu Jul 30, 2026 12:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2900866996259,2cyclictest2957899-21kworker/u8:1+flush-259:008:25:002
2900861995854,3cyclictest2993745-21kworker/u8:0+events_unbound08:58:470
2900863995550,4cyclictest3073711-21gpgv09:55:001
2900861995246,4cyclictest3203543-21ntpq11:55:210
2900871994947,1cyclictest3015280-21lspci08:58:183
2900866994941,6cyclictest3220430-21latency_hist12:15:002
2900863994943,4cyclictest335557-21systemd-journal09:36:301
2900863994643,2cyclictest3015280-21lspci08:58:191
2900866994440,3cyclictest335557-21systemd-journal09:20:002
2900861994340,2cyclictest3073821-21kworker/u8:0+events_unbound10:40:100
2900861994240,2cyclictest3183775-21kworker/u8:3+events_unbound12:15:230
2900861994038,2cyclictest3063342-21kworker/u8:1+events_unbound10:50:010
2900866993935,3cyclictest3021208-21kworker/u8:4+events_unbound09:31:262
2900866993935,3cyclictest2993745-21kworker/u8:0+flush-259:008:58:432
2900861993936,2cyclictest3120874-21kworker/u8:3+events_unbound11:15:210
2900861993935,3cyclictest3009814-21kworker/u8:2+flush-259:009:30:000
2900866993834,3cyclictest3073821-21kworker/u8:0+flush-259:010:35:012
2900866993833,4cyclictest2993793-21latency_hist08:40:002
2900863993833,3cyclictest3215525-21apt-get12:10:121
2900866993734,3cyclictest3183775-21kworker/u8:3+flush-259:012:20:232
2900863993731,4cyclictest2921484-21latency_hist07:30:001
2900861993734,2cyclictest2993745-21kworker/u8:0+events_unbound09:00:580
2900861993733,3cyclictest3157504-21latency_hist11:15:010
2900866993634,1cyclictest3183775-21kworker/u8:3+events_unbound12:30:002
2900866993632,3cyclictest3167573-21kworker/u8:0+flush-259:011:25:002
2900861993634,2cyclictest2900597-21kworker/u8:2+events_unbound08:02:580
2900861993633,2cyclictest3063342-21kworker/u8:1+events_unbound10:00:110
2900871993532,2cyclictest3173053-21kworker/u8:1+events_unbound11:45:213
2900866993532,2cyclictest2978515-21kworker/u8:4+flush-259:008:45:012
2900866993532,2cyclictest2957899-21kworker/u8:1+events_unbound08:05:242
2900866993529,4cyclictest3084352-21latency_hist10:05:002
2900861993532,2cyclictest3021208-21kworker/u8:4+events_unbound09:21:590
2900871993428,4cyclictest335557-21systemd-journal11:55:013
2900866993430,3cyclictest2993745-21kworker/u8:0+flush-259:008:45:572
2900866993428,4cyclictest3100296-21latency_hist10:20:002
2900863993429,3cyclictest3189179-21apt-get11:45:091
2900861993431,2cyclictest3183775-21kworker/u8:3+events_unbound12:20:130
2900861993431,2cyclictest3152343-21kworker/u8:2+flush-259:011:40:160
2900861993431,2cyclictest2957899-21kworker/u8:1+events_unbound08:07:570
2900861993431,2cyclictest2851841-21kworker/u8:4+events_unbound07:10:220
2900861993429,3cyclictest335557-21systemd-journal07:25:000
2900866993330,2cyclictest2900597-21kworker/u8:2+flush-259:007:39:322
2900866993327,5cyclictest3136418-21latency_hist10:55:012
2900863993328,4cyclictest3063590-21apt-get09:45:141
2900861993330,2cyclictest2978306-21kworker/u8:2+events_unbound08:30:230
2900871993229,2cyclictest3073821-21kworker/u8:0+flush-259:010:40:013
2900871993229,2cyclictest3021208-21kworker/u8:4+flush-259:009:45:003
2900871993228,3cyclictest2900597-21kworker/u8:2+events_unbound07:52:593
2900861993230,2cyclictest3009814-21kworker/u8:2+events_unbound09:08:590
2900861993230,1cyclictest3021209-21kworker/u8:5+flush-259:009:35:170
2900861993229,2cyclictest3204451-21kworker/u8:2+events_unbound12:11:580
2900861993229,2cyclictest3173053-21kworker/u8:1+events_unbound12:05:140
2900861993229,2cyclictest3152343-21kworker/u8:2+events_unbound11:30:570
2900871993127,3cyclictest2900597-21kworker/u8:2+events_unbound07:24:173
2900866993128,2cyclictest3021208-21kworker/u8:4+events_unbound09:44:582
2900861993129,2cyclictest3009814-21kworker/u8:2+events_unbound09:12:580
2900861993128,3cyclictest2916343-21kworker/u8:4+events_unbound07:39:390
2900861993128,2cyclictest3152343-21kworker/u8:2+events_unbound11:27:590
2900861993127,3cyclictest3173053-21kworker/u8:1+events_unbound12:02:580
2900871993027,2cyclictest3183775-21kworker/u8:3+events_unbound11:40:583
2900871993026,3cyclictest3189338-21kworker/u8:0+events_unbound11:55:063
2900866993027,2cyclictest3241242-21kworker/u8:1+events_unbound12:39:592
2900866993027,2cyclictest3063342-21kworker/u8:1+flush-259:011:20:012
2900863993024,4cyclictest335557-21systemd-journal07:22:471
2900861993028,2cyclictest3063342-21kworker/u8:1+events_unbound10:12:580
2900861993027,2cyclictest3173053-21kworker/u8:1+events_unbound11:45:140
2900861993027,2cyclictest3084581-21kworker/u8:3+events_unbound10:09:580
2900861993027,2cyclictest3021209-21kworker/u8:5+events_unbound09:33:580
2900861993027,2cyclictest2900597-21kworker/u8:2+events_unbound07:30:150
2900861993025,4cyclictest3136620-21gpgv10:55:000
2900871992927,2cyclictest3073821-21kworker/u8:0+events_unbound10:27:583
2900871992926,2cyclictest3009814-21kworker/u8:2+flush-259:009:20:013
2900866992926,2cyclictest3073821-21kworker/u8:0+events_unbound10:35:162
2900863992924,4cyclictest335557-21systemd-journal08:35:001
2900861992926,2cyclictest3073821-21kworker/u8:0+events_unbound10:30:150
2900861992926,2cyclictest2900597-21kworker/u8:2+events_unbound07:50:120
2900861992926,2cyclictest2900597-21kworker/u8:2+events_unbound07:40:200
2900861992925,3cyclictest3073821-21kworker/u8:0+flush-259:010:15:110
2900871992825,2cyclictest3063342-21kworker/u8:1+events_unbound11:05:143
2900871992825,2cyclictest2942345-21kworker/u8:3+events_unbound08:19:533
2900871992824,3cyclictest3215496-21kworker/u8:0+events_unbound12:18:593
2900866992825,2cyclictest2916343-21kworker/u8:4+flush-259:007:44:342
2900861992825,2cyclictest3021209-21kworker/u8:5+flush-259:009:15:220
2900861992823,4cyclictest3073594-21apt-get09:55:000
2900866992724,2cyclictest3173053-21kworker/u8:1+events_unbound12:00:122
2900866992722,4cyclictest3224679-21ntpq12:15:202
2900863992722,4cyclictest2957899-21kworker/u8:1+events_unbound08:10:001
2900863992720,5cyclictest3231398-21cp12:25:011
2900871992624,2cyclictest2993745-21kworker/u8:0+events_unbound09:05:583
2900871992623,2cyclictest3063342-21kworker/u8:1+flush-259:010:50:163
2900871992623,2cyclictest3063342-21kworker/u8:1+flush-259:010:45:113
2900871992623,2cyclictest2900597-21kworker/u8:2+flush-259:008:00:003
2900871992619,5cyclictest335557-21systemd-journal09:24:203
2900866992623,2cyclictest3173053-21kworker/u8:1+events_unbound11:45:192
2900866992623,2cyclictest3021208-21kworker/u8:4+events_unbound09:46:582
2900866992621,4cyclictest335557-21systemd-journal10:08:572
2900863992622,3cyclictest3084581-21kworker/u8:3+flush-259:010:15:001
2900863992619,5cyclictest335557-21systemd-journal08:46:561
2900861992623,2cyclictest2978515-21kworker/u8:4+events_unbound08:39:590
2900871992522,2cyclictest2900597-21kworker/u8:2+events_unbound07:34:273
2900871992522,2cyclictest2851841-21kworker/u8:4+flush-259:007:10:203
2900871992520,3cyclictest3204962-21base6412:00:013
2900866992522,2cyclictest3073821-21kworker/u8:0+events_unbound10:21:592
2900866992522,2cyclictest3021209-21kworker/u8:5+flush-259:009:10:002
2900866992521,3cyclictest2900597-21kworker/u8:2+events_unbound07:31:482
2900863992521,3cyclictest3173053-21kworker/u8:1+flush-259:012:00:211
2900861992522,2cyclictest3073821-21kworker/u8:0+events_unbound10:25:220
2900861992522,2cyclictest3063342-21kworker/u8:1+events_unbound11:05:570
2900871992421,3cyclictest3073821-21kworker/u8:0+events_unbound10:18:573
2900871992421,2cyclictest3120874-21kworker/u8:3+events_unbound10:57:573
2900871992421,2cyclictest3073821-21kworker/u8:0+events_unbound10:20:193
2900871992420,3cyclictest3073821-21kworker/u8:0+events_unbound10:30:083
2900871992418,4cyclictest3241489-21latency_hist12:35:003
2900871992418,4cyclictest3090399-21diskstats10:10:153
2900866992421,2cyclictest3167573-21kworker/u8:0+flush-259:011:25:212
2900863992420,3cyclictest3021209-21kworker/u8:5+flush-259:009:25:161
2900863992417,4cyclictest3141996-21latency_hist11:00:011
2900861992422,2cyclictest3120874-21kworker/u8:3+events_unbound11:20:210
2900861992421,2cyclictest2890524-21kworker/u8:0+events_unbound07:15:140
2900861992420,3cyclictest3073821-21kworker/u8:0+events_unbound10:20:130
2900861992419,4cyclictest2963086-21apt-get08:10:130
2900871992319,3cyclictest2993745-21kworker/u8:0+flush-259:008:50:133
2900871992317,4cyclictest335557-21systemd-journal10:00:003
2900866992320,2cyclictest3178208-21gpgv11:35:012
2900866992319,3cyclictest335557-21systemd-journal10:55:022
2900866992318,3cyclictest335557-21systemd-journal08:17:582
2900863992320,2cyclictest3063342-21kworker/u8:1+flush-259:011:10:241
2900863992316,5cyclictest335557-21systemd-journal07:45:001
2900861992320,2cyclictest3120874-21kworker/u8:3+flush-259:010:55:140
2900861992320,2cyclictest2993745-21kworker/u8:0+events_unbound08:54:580
2900861992320,2cyclictest2942345-21kworker/u8:3+events_unbound08:20:130
2900866992219,2cyclictest2905899-21kworker/u8:1+flush-259:007:25:232
2900866992212,2cyclictest3063342-21kworker/u8:1+events_unbound09:50:182
2900863992218,3cyclictest2916343-21kworker/u8:4+flush-259:007:35:231
2900871992118,2cyclictest3063342-21kworker/u8:1+events_unbound11:20:573
2900871992118,2cyclictest3021208-21kworker/u8:4+flush-259:009:45:283
2900866992119,2cyclictest3073821-21kworker/u8:0+events_unbound09:57:002
2900866992118,3cyclictest3063342-21kworker/u8:1+events_unbound10:26:572
2900866992117,3cyclictest3152343-21kworker/u8:2+events_unbound11:11:562
2900866992117,3cyclictest3126375-21apt-get10:45:102
2900866992116,4cyclictest335557-21systemd-journal11:40:002
2900863992117,3cyclictest3152343-21kworker/u8:2+events_unbound11:30:161
2900863992117,3cyclictest3052654-21gpgv09:35:001
2900863992117,3cyclictest3021208-21kworker/u8:4+events_unbound09:24:201
2900861992114,5cyclictest2982612-21ntpq08:25:200
2900871992017,2cyclictest3063342-21kworker/u8:1+flush-259:010:44:583
2900871992017,2cyclictest2942345-21kworker/u8:3+events_unbound08:39:383
2900871992017,2cyclictest2905899-21kworker/u8:1+events_unbound07:25:233
2900871992016,3cyclictest3063342-21kworker/u8:1+events_unbound11:20:013
2900863992017,2cyclictest2942345-21kworker/u8:3+flush-259:007:55:161
2900863992016,3cyclictest3105739-21apt-get10:25:091
2900863992016,3cyclictest3063342-21kworker/u8:1+events_unbound10:25:011
2900863992016,3cyclictest2942345-21kworker/u8:3+events_unbound08:00:121
2900863992015,4cyclictest335557-21systemd-journal09:10:571
2900863992015,3cyclictest335557-21systemd-journal11:50:571
2900871991917,2cyclictest2942345-21kworker/u8:3+events_unbound08:34:363
2900871991916,2cyclictest2942345-21kworker/u8:3+events_unbound08:21:573
2900871991914,4cyclictest3053091-21cp09:35:003
2900871991914,3cyclictest335557-21systemd-journal09:34:433
2900866991917,2cyclictest3009814-21kworker/u8:2+events_unbound09:24:212
2900866991916,2cyclictest3183775-21kworker/u8:3+flush-259:011:50:152
2900866991916,2cyclictest2942345-21kworker/u8:3+flush-259:008:00:202
2900866991916,2cyclictest2942345-21kworker/u8:3+events_unbound08:10:242
2900863991916,2cyclictest3183775-21kworker/u8:3+flush-259:011:55:241
2900863991915,3cyclictest3074287-21apt-get09:55:121
2900863991915,3cyclictest2942345-21kworker/u8:3+flush-259:008:35:261
2900861991917,2cyclictest3183775-21kworker/u8:3+events_unbound12:25:180
2900861991916,2cyclictest3021209-21kworker/u8:5+events_unbound09:44:430
2900861991914,4cyclictest2957899-21kworker/u8:1+flush-259:008:20:000
2900871991816,1cyclictest2942345-21kworker/u8:3+events_unbound08:25:133
2900871991815,3cyclictest3173053-21kworker/u8:1+events_unbound11:35:143
2900871991815,2cyclictest3215496-21kworker/u8:0+events_unbound12:10:173
2900871991815,2cyclictest3021209-21kworker/u8:5+flush-259:009:25:243
2900871991815,2cyclictest2942345-21kworker/u8:3+events_unbound08:00:153
2900871991814,3cyclictest3183775-21kworker/u8:3+events_unbound12:37:583
2900871991814,3cyclictest3183775-21kworker/u8:3+events_unbound12:06:593
2900866991816,2cyclictest3215496-21kworker/u8:0+events_unbound12:30:242
2900866991815,2cyclictest3021209-21kworker/u8:5+flush-259:009:25:222
2900866991815,2cyclictest2905899-21kworker/u8:1+events_unbound07:20:122
2900866991814,3cyclictest3183775-21kworker/u8:3+events_unbound12:07:592
2900866991814,3cyclictest3183775-21kworker/u8:3+events_unbound11:55:242
2900863991813,3cyclictest3089545-21latency_hist10:10:011
2900861991815,2cyclictest3183775-21kworker/u8:3+events_unbound11:50:170
2900871991714,2cyclictest3167573-21kworker/u8:0+events_unbound11:25:203
2900871991714,2cyclictest3084581-21kworker/u8:3+events_unbound10:05:213
2900871991714,2cyclictest3073661-21apt-key09:54:593
2900871991714,2cyclictest2905899-21kworker/u8:1+events_unbound07:19:303
2900866991714,2cyclictest2978306-21kworker/u8:2+events_unbound08:30:532
2900866991714,2cyclictest2851841-21kworker/u8:4+events_unbound07:10:482
2900863991713,3cyclictest3183775-21kworker/u8:3+flush-259:012:30:261
2900863991713,3cyclictest2999467-21kworker/u8:1+flush-259:009:05:001
2900863991712,4cyclictest3063342-21kworker/u8:1+flush-259:010:35:131
2900861991715,2cyclictest3063342-21kworker/u8:1+flush-259:010:35:240
2900861991715,2cyclictest2900597-21kworker/u8:2+events_unbound07:45:320
2900861991714,2cyclictest3173053-21kworker/u8:1+events_unbound11:35:240
2900861991714,2cyclictest3068448-21cron09:49:590
2900861991714,2cyclictest2942345-21kworker/u8:3+events_unbound07:55:280
2900861991710,5cyclictest3078329-21ntpq09:55:210
2900871991612,3cyclictest2900597-21kworker/u8:2+flush-259:007:49:383
2900866991612,3cyclictest3084581-21kworker/u8:3+flush-259:010:10:002
2900866991611,4cyclictest335557-21systemd-journal07:55:002
2900863991612,3cyclictest3021208-21kworker/u8:4+flush-259:009:15:211
290086399160,14cyclictest3173015-21awk11:30:011
2900861991612,3cyclictest3241761-21apt-get12:35:100
2900861991612,3cyclictest2999467-21kworker/u8:1+events_unbound08:49:140
2900871991512,2cyclictest3063342-21kworker/u8:1+events_unbound10:00:183
2900871991511,3cyclictest3183775-21kworker/u8:3+events_unbound12:25:083
2900871991511,3cyclictest2993745-21kworker/u8:0+events_unbound08:40:223
290086699159,4cyclictest3188914-21latency_hist11:45:012
2900866991512,2cyclictest2942345-21kworker/u8:3+events_unbound07:59:472
2900866991512,2cyclictest2905899-21kworker/u8:1+events_unbound07:49:582
2900866991511,3cyclictest2978546-21apt-get08:25:092
2900863991512,1cyclictest0-21swapper/112:25:001
2900863991511,3cyclictest3063342-21kworker/u8:1+flush-259:010:40:201
2900863991511,3cyclictest2971-21cron09:10:011
2900863991510,4cyclictest3157763-21apt-get11:15:111
2900861991513,1cyclictest60350irq/132-enp0s29f1:rx-012:30:220
2900861991513,1cyclictest60350irq/132-enp0s29f1:rx-008:40:060
2900871991411,2cyclictest3152343-21kworker/u8:2+events_unbound11:12:573
2900871991410,3cyclictest2900597-21kworker/u8:2+flush-259:007:40:243
2900871991410,2cyclictest0-21swapper/311:30:233
2900866991412,2cyclictest3021209-21kworker/u8:5+events_unbound09:35:512
2900866991411,3cyclictest2905899-21kworker/u8:1+events_unbound07:17:472
2900866991411,2cyclictest2993745-21kworker/u8:0+events_unbound09:02:572
2900866991410,3cyclictest3152319-21latency_hist11:10:012
290086399149,4cyclictest2890524-21kworker/u8:0+flush-259:007:10:011
290086399148,4cyclictest3009769-21latency_hist08:55:001
2900863991411,2cyclictest2942345-21kworker/u8:3+events_unbound08:15:201
2900863991410,3cyclictest2942345-21kworker/u8:3+flush-259:008:10:171
2900861991411,2cyclictest60350irq/132-enp0s29f1:rx-011:00:150
2900861991411,2cyclictest60350irq/132-enp0s29f1:rx-007:27:470
290087199137,4cyclictest335557-21systemd-journal07:40:013
2900871991310,3cyclictest2957899-21kworker/u8:1+events_unbound08:12:573
290086699139,3cyclictest3142260-21apt-get11:00:112
290086399138,3cyclictest335557-21systemd-journal08:24:551
290086399136,5cyclictest335557-21systemd-journal08:45:011
2900863991310,2cyclictest3130826-21unixbench_singl10:45:241
2900863991310,2cyclictest2907258-21tr07:15:181
290087199129,2cyclictest0-21swapper/308:10:003
290087199128,3cyclictest3063342-21kworker/u8:1+events_unbound11:00:113
2900871991210,2cyclictest2993745-21kworker/u8:0+events_unbound09:00:253
2900871991210,1cyclictest0-21swapper/312:24:593
290086699129,2cyclictest2993745-21kworker/u8:0+events_unbound09:10:232
290086399129,2cyclictest3131631-21cpuspeed_turbos10:50:161
290086399126,4cyclictest3152343-21kworker/u8:2+events_unbound11:40:191
290086399118,2cyclictest500-21systemd-logind12:40:001
290086399118,2cyclictest2942345-21kworker/u8:3+flush-259:007:55:001
290086399113,1cyclictest2938752-21grep07:45:181
290086399107,2cyclictest3063342-21kworker/u8:1+flush-259:011:00:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional